How much trial-and-error at your work location?
How much trial-and-error at your work location?
(OP)
I'm just curious as to the prevalence of trial and error in different industries. Below, I describe two situations with two different design methods. It may be sucessfully argued either way that one is better than the other.
Method 1:
Try a 1/4 inch shaft on the new conveyor belt design. Put the max load on it. It broke. Hmmmm, I wonder why. Let's try a 1/2 inch shaft. Install the 1/2 inch shaft. Put the max load on it. It worked for a few hours, then broke. Hmmmm, I wonder why. Let's try a 1 inch shaft. Install the 1 inch shaft on the new belt. Put the max load on it. It didn't break! Cool. We'll use a 1 inch shaft for production. Total design time: 8 hr.
Method 2:
An engineer models the shaft and coupling. It takes him about 12 hr to set up the CAD model. This model includes worse-case extremes of shaft misalignment, temperature, shock load, speed, etc. It takes him about 4 hours to go through the model with different shaft diameters. He concludes that a 7/8 inch shaft is the minimum acceptable to gaurantee the life of the product, so he adds a margin to increase the diameter to 1 inch and specifies a 1 inch shaft for production. Total design time: 16 hr.
How much of method-1 do you see at your work location?
Method 1:
Try a 1/4 inch shaft on the new conveyor belt design. Put the max load on it. It broke. Hmmmm, I wonder why. Let's try a 1/2 inch shaft. Install the 1/2 inch shaft. Put the max load on it. It worked for a few hours, then broke. Hmmmm, I wonder why. Let's try a 1 inch shaft. Install the 1 inch shaft on the new belt. Put the max load on it. It didn't break! Cool. We'll use a 1 inch shaft for production. Total design time: 8 hr.
Method 2:
An engineer models the shaft and coupling. It takes him about 12 hr to set up the CAD model. This model includes worse-case extremes of shaft misalignment, temperature, shock load, speed, etc. It takes him about 4 hours to go through the model with different shaft diameters. He concludes that a 7/8 inch shaft is the minimum acceptable to gaurantee the life of the product, so he adds a margin to increase the diameter to 1 inch and specifies a 1 inch shaft for production. Total design time: 16 hr.
How much of method-1 do you see at your work location?





RE: How much trial-and-error at your work location?
P.S. I would go with method 3, use an equation for shaft strength and assumptions for worst case load, then calculate; about 2 hours work maybe.
RE: How much trial-and-error at your work location?
RE: How much trial-and-error at your work location?
A: More than I'd like given we're meant to be engineers. Sadly the way schedules are set and progress reported to management it often seems it's better to get to half a$$ed hardware more quickly by minimizing analysis etc. rather than spending more time on design but taking longer.
In fairness some of our stuff is cutting edge, new applications... so at least some can be difficult to predict but still, I reckon we could do better sometimes.
(Oh and I don't mean just throwing every model into FEA etc. by default, I agree with 1gibson that sometimes the middle ground is most appropriate.)
What is Engineering anyway: FAQ1088-1484: In layman terms, what is "engineering"?
RE: How much trial-and-error at your work location?
RE: How much trial-and-error at your work location?
RE: How much trial-and-error at your work location?
Outside of that, most of us will use Option 3 with varying safety factors. I'll usually calculate whatever limiting parameter is being discussed with a zero safety factor. Then do it again with a non-zero safety factor and compare the results and make an Engineering Decision on what to use. In my work if something breaks in the field it can cost millions of dollars to fix it and get back on line. We use large safety factors.
David Simpson, PE
MuleShoe Engineering
"Belief" is the acceptance of an hypotheses in the absence of data.
"Prejudice" is having an opinion not supported by the preponderance of the data.
"Knowledge" is only found through the accumulation and analysis of data.
RE: How much trial-and-error at your work location?
RE: How much trial-and-error at your work location?
Star for
David Simpson, PE
MuleShoe Engineering
"Belief" is the acceptance of an hypotheses in the absence of data.
"Prejudice" is having an opinion not supported by the preponderance of the data.
"Knowledge" is only found through the accumulation and analysis of data.
RE: How much trial-and-error at your work location?
Option A is to keep breaking things without learning anything useful.
RE: How much trial-and-error at your work location?
Method 3 works well for me. Spend a several hours on hand calculations. The drawings/modelings are near final product. Build a test model to prove the design. Make adjustments. Test to prove. Done. This has served us well for real time to market with a product we won't see come back very soon because of design failure.
Ted
RE: How much trial-and-error at your work location?
-handleman, CSWP (The new, easy test)
RE: How much trial-and-error at your work location?
What he said. Engineering is thinking about things before you build them, not throwing different-sized rocks at a problem and hoping it goes away.
Also what he said. If you build things without understanding, it's just a matter of time before you aren't allowed to build things anymore.
Testing is essential for good design - good final design. It's not a replacement for thought, and trying to use it as such on every nut and bolt along the way will bankrupt your company.
(As an aside: if it takes you 12 hours to model a shaft/coupling in CAD, you either need to get better at CAD or hire someone who is.)
"Engineers like to solve problems. If there are no problems handily available, they will create their own problems." -Scott Adams
RE: How much trial-and-error at your work location?
We do a lot of looking for new applications for new materials. Thus we have to do some trials because the data is usually not available.
Secondly, the data we do get has often been through a marketing filter. The engineers supply figures but marketing takes whatever looks best and publishes that. We run our own tests because we want it to break in testing not at the customer’s.
Thomas J. Walz
Carbide Processors, Inc.
www.carbideprocessors.com
Good engineering starts with a Grainger Catalog.
RE: How much trial-and-error at your work location?
Famous words of their wisdom...
I have been doing this for 20 years and it always worked.
It worked last time...
My responses vary from ...
And where did you get your engineering degree from..
After 20 years - you should know better OR you have been doing it wrong for 20 years!!
RE: How much trial-and-error at your work location?
They have top quality engineers who specialise in a specific discipline, they have cutting edge technology, workshops, materials, simulation software, analysists and testing facilities at their disposal and huge budgets, but still things do not perform as expected and it all comes down to time on the test track.
RE: How much trial-and-error at your work location?
Most good design is done with a considerable amount of technical, materials and engineering knowledge, experience and judgement in the mix. There will likely be knowledge of a previous product or project to refer to for a starting point. There is also just a good general engineering education and background which gives you some direction as you start a project. The process generally isn’t a hit-n-miss endeavor. That doesn’t mean there is no place for testing, but that generally isn’t the starting point of most general engineering design and product development work.
RE: How much trial-and-error at your work location?
David Simpson, PE
MuleShoe Engineering
"Belief" is the acceptance of an hypotheses in the absence of data.
"Prejudice" is having an opinion not supported by the preponderance of the data.
"Knowledge" is only found through the accumulation and analysis of data.
RE: How much trial-and-error at your work location?
It can take some effort to refine one's "math model" to match reality, but once they sync up, great things are possible. A well-refined model saves many precious hours not trying things that are destined to fail. A well refined model also can be used to predict things beyond experience.
RE: How much trial-and-error at your work location?
RE: How much trial-and-error at your work location?
That is to say..., if failure is not an option and things are expected to work correctly right out of the gate then there may be a "trial" after any "error".
But if failures are of little consequence -- in terms of safety and cost -- then trial-and-error can be acceptable. Why design a $1000 solution for a 10-cent problem?
But most companies with engineering departments have them for a reason: they do want/need the design to work correctly right out of the gate. Overkill on the up-front design effort can avoid lots of costly errors/failures downstream.
16 hours of one designer's time is a lot cheaper than 4 hours of 5 techs and 2 managers staring at the failed design (i.e. 4 x 7 = 28 man-hours). Not to mention the additional cost due to "There is never time to do it right, but always times time to do it over" syndrome.
The good news here is that seasoned designers don't reinvent the wheel. Sizing a shaft, for example, will typically be calculated once and then future designs can be quickly WAG'ed based on the experience of the previous design calculations.
Sort like if a 300-lb man can walk across a 5-ft long 2x4 board calculated to withstand that load, then a year later a designer will confidently recommend using a 5-ft 2x4 to support a 200-lb man.
Unless there is an overpowering reason to optimize the design, the previous calculated design becomes the rule-of-thumb. And, sure, although testing will almost always be conducted to validate a design, the calculations minimize the number of test failures -- which would lead to another round of costly tests.
So pure trail-and-error should be considered a no-no except for rare situations of precious little significance and consequence.
RE: How much trial-and-error at your work location?
"So pure trail-and-error should be considered a no-no except for rare situations of precious little significance and consequence. "
Then no new devices would ever get created. Real R+D is a lot of educated guessing, followed by testing, followed by analysis and then repeated as required until the error (what you've got vs. what you wanted) is reduced to an acceptable level. Sometimes, not very often I would agree, but often enough, you find yourself blazing truly new territory. It's pretty fun when it happens, and you have to be willing to stub your toes and break stuff in trying to get stuff working the way you think/hope it ought to.
I find it funny that a discrete control PID loop is essentially a trial and error process used to control all kinds of widgets in the real world.
RE: How much trial-and-error at your work location?
RE: How much trial-and-error at your work location?
David
RE: How much trial-and-error at your work location?
RE: How much trial-and-error at your work location?
Regards,
Cockroach
RE: How much trial-and-error at your work location?
To some extent all of these are open loop investigations, there is often no specific target and the result is the best you can get as a judgement, in the time available, with the hardware to hand.
Cheers
Greg Locock
New here? Try reading these, they might help FAQ731-376: Eng-Tips.com Forum Policies http://eng-tips.com/market.cfm?
RE: How much trial-and-error at your work location?
Welcome to every company ever :)
NX 7.5.5.4 with Teamcenter 8 on win7 64
Intel Xeon @3.2GHz
8GB RAM
Nvidia Quadro 2000
RE: How much trial-and-error at your work location?
Every custom design outfit, even geesamand' shop, is using trial and error, but they refuse to admit it. Their trials, in the form of one-off designs, get tested in the field, by their customers.
Cockroach, would you say that testing is also of no value then? I.e. why bother to test a product, since you "know" that you have designed it correctly? We test products because we know there are deviations that occur between real world objects and our simplified analytical models, and that these are beyond our limited ability and/or finances to completely control, and we hope that those deviations don't reduce the performance of the product beyond acceptable limits. But if you don't test it, your customer will. Just hope that the feedback loop gets closed by the customer directly, and not via his lawyers or those of his survivors.
RE: How much trial-and-error at your work location?
But don't get trial-and-error mixed up with "testing". We test all the time, usually destructively for on the first-off. This is consistent with ISO 9001 Design Control were the interest is in "verification", not "validation". By the time the prototype is build, we have a real good handle on validation. If something doesn't test within our strict set of limits, then the model is in error and we search for the understanding as a design error. Validation has failed. This essentially means we go back to the drawing board and after a full review, design again to get it right. Hopefully it is a mathematical error, maybe a poor model or something, but more times than not it is a fundamental oversight in the input design statement(s).
Perhaps it is my mathematical physics background, but I just don't buy into taking a good guess and homing in on reality following a few good tests. That's how I regard trial-and-error, aside from Greg's comment on "fine tuning".
Regards,
Cockroach
RE: How much trial-and-error at your work location?
So, we (engineers) make educated assumptions about such things and refine our assumptions as a design progresses. Critical areas of a machine which push the mechanical or thermal limits of the machine's components are often validated with component tests, which further help us to understand their behavior. Finally, once we have done the best we can at producing a working design, we build the machine and test it as well.
At the end of the day, designing is all about trial and error. We use the best tools we have to make the smartest decisions about our designs that we're able to... and as we learn more about the thing we're designing, we iterate. Finally, after a lot of iteration, crumpled up papers, and frustration, we arrive at a design that we think is adequate and meets its design requirements... and we build it. From there, we see how we did, and how the device performs. We monitor it in service and listen to what customers like or dislike about it. We monitor performance, follow maintenance issues, wear issues, and other serviceability issues. We learn what worked well and what could be improved, and we use that input when designing our next machine.
Engineering is all about trial and error, actually. However, it's also about using your knowledge of physical sciences to make smart design decisions and minimize design iterations.
Could you imagine building an automobile by making parts through trial and error as was described in the initial post? There are thousands of parts which need to be sized. How much would it cost to have so many failed tries? How would you ever arrive at a competitive design?
RE: How much trial-and-error at your work location?
Hence the various comments of there still being trial and error on some 'cutting edge' applications - as well as on those which might not be cutting edge as such but we still have trouble fully defining/analyzing.
What is Engineering anyway: FAQ1088-1484: In layman terms, what is "engineering"?
RE: How much trial-and-error at your work location?
Test components were often constructed for machines, however. One method for evaluating them involved painting parts with shellac; areas where the shellac cracked were assumed to have excessive strain and the design was modified to correct it.
Design has always been a bit scientific... and always has involved some level of trial and error.