Continue to Site

Eng-Tips is the largest engineering community on the Internet

Intelligent Work Forums for Engineering Professionals

  • Congratulations waross on being selected by the Eng-Tips community for having the most helpful posts in the forums last week. Way to Go!

When does 55 not equal 55? 1

Status
Not open for further replies.

jmw

Industrial
Jun 27, 2001
7,435
I'm using an IF function to position a number relative to other numbers which are arranged in an ascending order.
So I am saying IF a>b, b else IF a>c, b else c

Then I thought of a problem. My number might actually equal one of the numbers in my table so I wanted to create a rule for that eventuality.

This rule says something like IF:a=b,1 else 0
b is a calculation result.

Now to test this I set up data for the calculation such that I ought to get b=55 and, while some other results where coming out to 4 or 5 decimal places (general format for the cells) b came out as 55.

Unfortunately, when a= 55 and b=55 Excel insists b is greater than a and returns False.

I therefore formatted the cells as numbers with a set number of decimal places and b now returns 55.00000 and a 55.00
but I still get a false return with Excel insisting b>a

Any ideas?


JMW
 
Replies continue below

Recommended for you

We are in the presence of greatness.... but does an internet forum count as one of the 6 degrees of separation? can we all claim to be 3 away from Big Bill?

Actually, wasn't there one of the early Pentium maths processors that had a glitch in it somewhere and they refused to make a general recall as they said it would only affect a very few people?
Or is this it?
(I wish I had a better memory)

JMW
 
By the way, BigInch, is a letter signed by Bill Gates from 1980 as valuable as a Beatles signature? Have you had it valued?
It seems an typical example of buck passing and an original GIGO? Should enhance the value a bit?


JMW
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor