Floating Point/Rounding
Jump to navigation
Jump to search
Rounding[edit | edit source]
IEEE 754 specified four distinct rounding modes. We will talk about those modes, and their effects in this chapter. Also, rounding can play an important role in the accuracy of a floating-point computation, so we will discuss those effects here as well.
Rounding Modes[edit | edit source]
Rounding Errors[edit | edit source]
Relative Error[edit | edit source]
Relative error is one measure of error commonly used with floating point numbers. If is an approximation to , then the relative error, , is defined as