×
INTELLIGENT WORK FORUMS
FOR ENGINEERING PROFESSIONALS

Log In

Come Join Us!

Are you an
Engineering professional?
Join Eng-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!
  • Students Click Here

*Eng-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

Jobs

Tolerance and significant digits
2

Tolerance and significant digits

Tolerance and significant digits

(OP)
Let's say I have a print with +/- 0.003" tolerance on a dimension. Typically with 3 significant digits, one would round numbers like 0.0034 down to 0.003. My question is should a +/- 0.003" tolerance be interpreted as +/- 0.0034" due to significant digit rounding?

RE: Tolerance and significant digits

Brad1979,

Where does .0034" come from?

The ASME Y14.5 standard states that a tolerance of .003" means .003000000 etc. If you measured something .0034" out of specification, it should be rejected.

--
JHG

RE: Tolerance and significant digits

What drafting standards do you use?

Quote (ASME Y14.5M-1994 section 2.4)

All limits are absolute. Dimensional limits, regardless of the number of decimal places, are used as if they were continued with zeros.

Examples:
12.2 means 12.20...0
12.0 means 12.00...0
12.01 means 12.010...0

To determine conformance within limits, the measured value is compared directly with the specified value and any deviation outside the specified limiting value signifies non-conformance with the limits.

So no you don't round in the way you're suggesting, at least to ASME. +/-.003" equates to +/-.00300000000000000000000...0. +.0034 would be out of limits.

Posting guidelines FAQ731-376: Eng-Tips.com Forum Policies http://eng-tips.com/market.cfm? (probably not aimed specifically at you)
What is Engineering anyway: FAQ1088-1484: In layman terms, what is "engineering"?

RE: Tolerance and significant digits

(OP)
Thanks guys. I was not aware of that section of Y14.5M. That's what I was looking for.

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Eng-Tips Forums free from inappropriate posts.
The Eng-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Eng-Tips forums is a member-only feature.

Click Here to join Eng-Tips and talk with other members!


Resources