problem about converting "float" to "int"

Thread view:

Enable EMail Alerts

Start New Thread

Thread rating:

pango - 04 Jul 2004 15:00 GMT

I write below code in my program:
float f=0.371f;
int i=(int)(f*1000.0f);

I think the result of "i" should be "371",but in fact it is "370",why?How to solve it?

Reply to this Message

doug mansell - 06 Jul 2004 02:28 GMT

> I write below code in my program:
> float f=0.371f;
> int i=(int)(f*1000.0f);
>
> I think the result of "i" should be "371",but in fact it is "370",why?How to solve it?

If you look at f in your debugger you will see it is actually
0.37099999. This is the nature of floating point representation. The
other key thing to note is that float to integer conversions don't
round. If you want rounding, you write your own.

And, as an exercise in confusion, inspect this with your debugger:

int i2 = (0.371 * 1000.0);

doug.

Reply to this Message

Ronald Laeremans [MSFT] - 06 Jul 2004 16:41 GMT

Search for "what every programmer should know about floating point" using
your favorite search engine for the classic (and well written) article
describing this and other relevant issues.

Ronald Laeremans
Visual C++ team

>> I write below code in my program:
>> float f=0.371f;
[quoted text clipped - 13 lines]
>
> doug.

Reply to this Message

Rate this thread:

problem about converting "float" to "int"

Free Magazines