Floating Point/Rounding

From Wikibooks, open books for an open world
Jump to navigation Jump to search

Rounding[edit | edit source]

IEEE 754 specified four distinct rounding modes. We will talk about those modes, and their effects in this chapter. Also, rounding can play an important role in the accuracy of a floating-point computation, so we will discuss those effects here as well.

Rounding Modes[edit | edit source]

Rounding Errors[edit | edit source]

Relative Error[edit | edit source]

Relative error is one measure of error commonly used with floating point numbers. If is an approximation to , then the relative error, , is defined as