Forum Discussion

Altera_Forum's avatar
Altera_Forum
Icon for Honored Contributor rankHonored Contributor
14 years ago

ALTFP_INV_SQRT problem

I have instanced ALTFP_INV_SQRT (y = 1/sqrt(y)) mega function in Quartus 10. I’m using single precision. When I calculate X”3F800001" (almost 1) the result is X”3F000000” (0.5). Calculating X” 3F80...