The soil samples were analysed individually, whereas the plant samples (blocks of 30?×?30 cm) were pooled into plant families prior further processing to keep the sample size manageable to allow a parallel DNA-based and microscopic study.
Hence, we incorporated the annotation guidelines into the HIT itself, in particular, by embedding major scenarios into user options while still keeping the number of options manageable for human processing (44).
For the largest datasets, e.g., Triticum and Zea, it was necessary to undertake this strategy twice, so as to maintain datasets of manageable size throughout the processing.
The use of TBLASTX is not proposed because its output is not manageable in subsequent post-processing (e.g., alignments in overlapping non-coding reading frames).
To provide an example in the bioinformatics field, in The Cancer Genome Atlas project researchers implemented the process of "sharding," splitting genome data into smaller more manageable chunks for cluster-based processing, utilising the Hadoop framework and the Genome Analysis Toolkit (GATK) [ 31, 32].
To reduce the network data traffic and the processing time to manageable levels, the HLT uses seeded, step-wise reconstruction, aiming at the earliest possible rejection of background events.
Instead of one huge, complex, difficult-to-debug-and-maintain piece of code, the software is broken into much more manageable independent functions on different central processing units (CPUs).
Data needs to be focused and cut into manageable packets for live transmission and processing.
This problem is not as significant as storage space and processing requirement may be manageable, but the concept of "curse of dimensionality" may apply here.
However, the processing time is still manageable and is worth the wait to obtain high quality data.
The burden it places on study participants is relatively low, and sample processing and analysis are manageable and affordable.
