Community

Question

Hi guys,

this seems like a really stupid question to have to be asking but Unity can't seem to manage to do a simple maths sum. (Its probably me and I'll kick myself for it afterwards I'm sure)

a code sample:

function Update () {
    var division = 3/4;
    print (division);
}

this simple piece of code in a much larger script is giving me a lot of hassle. For some reason Unity decides that the answer to 3/4 is 0?!

whereas in this example:

function Update () {
    var division = 3 * 0.25;
    print (division);
}

it works out the right answer. I need to use the equivalant to the first example as I am using variables instead of the simple numbers

Any help would be much appreciated. I'm guessing its just me having a dumb moment

thanks Scribe

Answer 1

0

You are getting the result of an integer division. You just need to make the divisor (the 4) a float value:

var division = 3/4.0;

answered Mar 30 '11 at 08:01 PM

_MGB_
678 ● 4 ● 7 ● 16

(comments are locked)

Answer 2

0

var division : float = 3/4;

You may need to define the type as shown above. In your second example, you use a floating point value so Unity automatically defines it as a float. I believe that may be your problem.

answered Mar 30 '11 at 07:49 PM

tool55
710 ● 1 ● 3 ● 12

Thank you both 1 up to both of you but tool55 got their first sorry MGB

Mar 30 '11 at 08:09 PM Scribe

Heh. Unfortunately tool55's code still results in a zero.

Mar 30 '11 at 08:33 PM _MGB_

Using integer values in an operation will always result in an integer value, regardless of what type the variable is.

Mar 30 '11 at 08:42 PM Eric5h5

Scribe: You do realize this doesn't solve the problem though?

Mar 30 '11 at 09:02 PM Statement ♦♦

@Scribe: MGB's answer is correct, and I'm afraid tool55's is not. It doesn't matter whether you're using literals or variables, the point is that the things that are doing the actual math have to be floats, not the variable you're assigning the result to.

Mar 31 '11 at 07:38 AM Eric5h5

show 2 more replies

(comments are locked)

Answer 3

0

The reason that your not getting the correct answer is because an "int" is defined as an integer (If you don't know what an integer is, its a whole number).

Edited at the request of Statement: (Whole numbers are numbers with no decimal part value. Ex: 2, 30012, 4239842. These are not whole numbers: 1.2, 1.4, 54.4 )

When you divide with integers, it rounds to the nearest whole number. In this case, its closer to 0, so it rounds down. Like numerous people have already said, adding ".0" would have converted it to a floating point decimal (float) which would have an integer plus the string of digits past the decimal.

Another way to get around this is to cast. For instance, you might be using values that are awkward if they aren't integers (health or experience are common variables that are best left as ints).

This is how you cast in javascript:

function Update () {
    var division = parseFloat(3)/parseFloat(4);
    print (division);
}

And this is how you cast in C# for you C# lurkers :P

void Update () {
    float division = (float)3/(float)4;
    print (division);
}

answered Mar 31 '11 at 05:28 AM

SirGive
1.2k ● 25 ● 32 ● 50

Thanks for the answer but it just gave the error: The type 'float' does not have a visible constructor that matches the argument list '(int)' I'm guessing that means thats not how you cast but 1up for answering anyway It would be useful to find a way of keeping them as ints

Mar 31 '11 at 05:41 AM Scribe

hmm hold on. let me find an example. I've done this before, but i normally stick to c#

Mar 31 '11 at 05:46 AM SirGive

that should be the right syntax

Mar 31 '11 at 05:49 AM SirGive

come now, in elementary we learn what whole numbers and decimals are :P

Apr 15 '11 at 06:59 AM SirGive

Seriously, if you don't know what an int/whole number is, cease programming now. :D

Apr 15 '11 at 07:04 AM SirVictory

show 2 more replies

(comments are locked)

Answer 4

0

//better  using  like  this: 
#Pragma strict 
function Update () {
var division:float = 3/4;    
print (division);
}

answered Mar 31 '11 at 01:40 AM

u3d_loveye
11 ● 1 ● 1 ● 5

This doesn't appear significantly different from @tool55's answer.

Mar 31 '11 at 01:54 AM Cyclops

I'm assuming the #Pramga Strict allows for float values from the operation. I try to avoid using such things like this when i'm not doing much in my code relevant to #pragma strict

Mar 31 '11 at 05:59 AM SirGive

"#pragma strict" is completely irrelevant here, and that code won't work anyway. As I already commented, using integer values in an operation will always result in an integer value, regardless of what type the variable is. This is why it's usually a good idea to test your code before posting it. (You would see that it prints 0.)

Mar 31 '11 at 07:35 AM Eric5h5

Eric, as a follow up question, will the returned value have the same decimal accuracy as the value one uses? In other words, if I use 3.0/4.0 will I get one decimal accuracy as opposed to 3.00/4.00 where I might expect two decimal accuracy? Just curious. Thanks, as always.

Mar 31 '11 at 01:50 PM tool55

@tool55, you'll get the full accuracy of a float in either case, which means 32-bit precision (roughly 7 digits). Which side of the decimal point your digits fall on, depends on the number. http://msdn.microsoft.com/en-us/library/aa691146(v=vs.71).aspx

Mar 31 '11 at 05:40 PM Cyclops

show 3 more replies

(comments are locked)

Community

Int vs. Float operations

Follow this question

Welcome to Unity Answers

Unity Answers tutorial video!

Related Questions