go for it!!, you're not alone. Some of my best classmates were the big guys (35+). Sometimes, they where already parents and even grandfathers/grandmothers, they were mature and knew what they wanted in life. They gave me a big example in life. I was always worried about finishing college right in time (5yrs the max) and through them I saw that there shall be no rush, sometimes, life is not about having a major, but to enjoy it, and as "COEngineeer" stated above, if being and engineer is going to satisfy yourself, enjoy the college life, why not?!! Try it , even if your math skills are waaayy back, almost forgoten, give it a try, otherwise you will always be thinking in getting or not into college,
Regards, best whishes, do well!!!