Sentence examples for precision in computation from inspiring English sources

In some test cases, all particles end up having zero weights due to finite precision in computation.

For adequate precision in the computation of the response surface, we thus need to first search the DoE for such structures.

The FPGA implementation provides higher frame rates and less power consumption, whereas the GPU implementation provides more precision in the computation and therefore higher quality output images.

The clusters are not numbered in the exact order of significance due to the limits of numerical precision in the computation of p-values.

Spheres of radii (non-dimensionalized in terms of a mean free path) in the range 10−6 106 are considered, and a transformation of the range from (R, ∞) to (0, 1), is used together with successively high order quadratures, and high precision in all computations.

A similar trade-off is achieved using low precision arithmetic, with improvements in computation and communication speed and savings in storage and memory requirements.

When the denominator is zero, the ratio should actually be 0/0 but can be a large value subject to precision in the numerical computations.

It is shown that the precision in the Added Masses computation and the computational time depend on the meshing quality of the model and power of the PC on which the software runs.

When registers can support double-precision floating-point numbers, but the numbers used in computation are in single-precision or half-precision, packing can improve the efficiency.

Multi-numerical results based on modified IEEE 123 nodes test feeder are presented and discussed, demonstrating that the proposed method achieves much better performance than existing ones in both precision and computation aspects.

Different subpixel motion measurement algorithms are compared in terms of precision and computation time.