Lines Matching refs:precision
35 The precision of the mathematical operations on 32 bit floats is affected by the pragmas
41 Different precision/speed tradeoffs can be achieved by using variants of the common math
43 <li>native_: May have custom hardware implementations with weaker precision. Additionally,
637 This function is similar to @mad(). fma() retains full precision of the multiplied result
639 This extra precision is not guaranteed in rs_fp_relaxed mode.
759 summary: Reciprocal computed to 16 bit precision
763 The precision is that of a 16 bit floating point value.
775 summary: Reciprocal of a square root computed to 16 bit precision
779 The precision is that of a 16 bit floating point value.
791 summary: Square root computed to 16 bit precision
795 The precision is that of a 16 bit floating point value.
973 This function is similar to @fma(). @fma() retains full precision of the multiplied result
1498 It is valid for inputs from -86.f to 86.f. The precision is no worse than what would be
1516 It is valid for inputs from -37.f to 37.f. The precision is no worse than what would be
1534 It is valid for inputs from -125.f to 125.f. The precision is no worse than what would be