User Tools

Site Tools


pdclib:floatingpoint

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Last revision Both sides next revision
pdclib:floatingpoint [2019/10/18 14:37]
solar [Fixed Point Fraction Output]
pdclib:floatingpoint [2019/10/18 14:40]
solar [Fixed Point Fraction Output]
Line 208: Line 208:
     * Fractional part <m>0.835</m> is larger than mask <m>0.15625</m>, and smaller than <m>1 - 0.15625 = 0.84375</m>, so <m>6</m> is our first (fractional) digit, and the loop continues     * Fractional part <m>0.835</m> is larger than mask <m>0.15625</m>, and smaller than <m>1 - 0.15625 = 0.84375</m>, so <m>6</m> is our first (fractional) digit, and the loop continues
   * Second (<m>k = 2</m>) loop   * Second (<m>k = 2</m>) loop
-    * multiply <m>R = 0.835</m> by <m>B = 10</m> for integral part <m>8</m>, fractional part <m>0.35<m> +    * multiply <m>R = 0.835</m> by <m>B = 10</m> for integral part <m>8</m>, fractional part <m>0.35</m> 
-    * multiply <m>M = 0.15625<m> by <m>B = 10</m> for new <m>M = 1.5625</m>+    * multiply <m>M = 0.15625</m> by <m>B = 10</m> for new <m>M = 1.5625</m>
     * Fractional part <m>.35</m> is smaller than mask <m>1.5625</m>, and not smaller than <m>1 - 1.5625 = -0.5625</m>, so the loop terminates     * Fractional part <m>.35</m> is smaller than mask <m>1.5625</m>, and not smaller than <m>1 - 1.5625 = -0.5625</m>, so the loop terminates
   * Post-loop   * Post-loop
pdclib/floatingpoint.txt · Last modified: 2019/10/21 10:13 by solar