matlab accuracy problem
matlab accuracy problem
(OP)
Hi everyone,
I am currently trying to store some image locations, with corresponding vote locations for objects. For some reason Matlab is storing a certain entry with the decimal point incorrectly (one place to the left too far)
For example:
the matrix I have is:
30.0000 323.5900 291.6 323.0900 28.3760
where the last entry is incorrect.
When filling the matrix I included some print statements to display the values to the command window, which yielded the correct value:
283.76.
Are there any reasons as to why Matlab would be cutting a power of 10 off this value?
Any help would be most appreciated,
Thanks,
J
I am currently trying to store some image locations, with corresponding vote locations for objects. For some reason Matlab is storing a certain entry with the decimal point incorrectly (one place to the left too far)
For example:
the matrix I have is:
30.0000 323.5900 291.6 323.0900 28.3760
where the last entry is incorrect.
When filling the matrix I included some print statements to display the values to the command window, which yielded the correct value:
283.76.
Are there any reasons as to why Matlab would be cutting a power of 10 off this value?
Any help would be most appreciated,
Thanks,
J





RE: matlab accuracy problem
RE: matlab accuracy problem
I rewrote the code where it was placed into the matrix and there must have been something there matlab didn't like. All is fine now though.
Thanks,
J