Parameter optimization is conducted within the 98 miRNAs (97 miRNAs for training and 1 miRNA for test) and performance evaluation is based on the validation part.
The test dataset is used to estimate the weights and the significance of slope parameters is based on the validation data where the weighted score is fixed.
Additionally, we hold out pristine examples for testing, integrated result over multiple classifiers retaining only predictions that show a high degree of consensus, chose classifier parameters based on the cross-validation tests, and used a simpler predictor where possible, to address the overfitting issue.
An ROC curve and a contingency table (Additional file 6) are used to analyze the performance characteristics of this gene signature, based on results of the validation test.
Many of them have passed at least one of the validation tests based on the British Hypertension Society protocol [ 13], International protocol of the European Society of Hypertension [ 14] or Association for the Advancement of Medical Instrumentation AAMII) protocol [ 15].
Based on the live/dead fluorescent validation tests that we performed and since we performed the peg harvesting in accordance with published methods using the MBEC peg model [ 13, 14] we have assumed that recovery is 100%.
This identification step is based on all subjects in the derivation sample, pooled across the state, province, and country cohorts, with subsequent confirmation based on the re-test validation sample.
The choice was based on the obtained z-values of the thermostable and thermolabile fractions, on the cost and on the validation tests.
Two test procedures were applied for the model performance assessment: standard 10-fold cross validation procedure and validation based on the external test set containing 45 records describing.
Our criteria were selected based on validation test results from the random H. sp. NRC-1 sequences searched against the nr protein database at NCBI.
