Sentence examples for bit accuracy from inspiring English sources

Eight bit accuracy of ADC is used since only seven distinct levels of input are required.

Resultant bit accuracy was found to be 10.4 for 122 MHz input signal band.

The readout circuitry is designed for 12 bit accuracy at frame rates of up to 6.25 kHz.

So in the recommended design we used as minimum DSP slice as we can and as a benefit of using DSP slice is higher calculations accuracy as the DSP capabilities of having 48 bit accuracy in addition and 18 x 18 bit accuracy in multiplication.

When incorporated in a vision chip, resolutions of up to 12 bit accuracy can be obtained in kernel convolution functions with 35×28 μm2 layout area usage per pixel in a 90 nm technology.

This was deemed an appropriate tradeoff in terms of bit accuracy, and may have contributed (among the inherent inaccuracy of running ADC at full-speed, ten-bit mode) to the ever slight tremor of the cursor at rest – more on this later.

The amplifier offsets can be adjusted individually with 3-bit accuracy to compensate for process mismatch.

This means that to get 8-bit accuracy after you change Vref, you must wait 1/256 = exp -t/600) or t~3 mSexp -t/600dorng anot~3r conversion!

Aiming at digitizing output multiplexed data from the upstream analog filters banks, the converter must ensure 11-bit accuracy and a sampling frequency of about 5 MS/s.

By using a combination of 32-bit and 64-bit floating point arithmetic, the performance of many dense and sparse linear algebra algorithms can be significantly enhanced while maintaining the 64-bit accuracy of the resulting solution.

That's the other thing that is fundamentally different about our technology bit for-bit accuracy.