| Author |
 Topic  |
|
|
Jeepaholic
Average Member
USA
697 Posts |
 Posted - 20 August 2001 : 19:58:45
|
Well, I've racked my brain on this. For whatever reason, after a number of iterations of comparisions, the statistics code I'm writing for a different project starts comparing inaccurately.
The comparisons I'm doing are for integers, which I solved by doing a cint(integervalue), and for decimal numbers...which I've yet to figure out.
Basic comparisons (a < b) are coming out incorrectly...and I'm a bit at a loss for this. I guess I just don't understand enough as to what's going on with the numbers behind the scenes to figure this out.
Any thoughts?
Al Bsharah
Jeepaholics Anonymous |
|
|
Doug G
Support Moderator
USA
6493 Posts |
|
|
davemaxwell
Access 2000 Support Moderator
USA
3020 Posts |
Posted - 21 August 2001 : 08:04:21
|
Like Doug said, you could be going over your max or having rounding problems. Also check that your numbers aren't null which will give you odd results.
For reference:
Integer(cint) - -32,788 to 32,787
Long (clng) - over 32,787
Double (cdbl) - Anything with decimals (has a high max, but can't remember which)
Dave Maxwell
--------------
Proud to be a "World Class" Knucklehead |
 |
|
|
Jeepaholic
Average Member
USA
697 Posts |
Posted - 23 August 2001 : 10:26:28
|
Thanks for the info, will dig into this. Definitely a probably cause...thanks!
Al Bsharah
Jeepaholics Anonymous |
|
|
| |
Topic |
|
Topic Locked
