All models were shown to achieve outstanding predictive performance, the lowest being NS2 model with 96.57% accuracy (AUC = 0.980; MCC = 0.916), while HA prediction model achieved the best predictive performance of 98.62% accuracy (AUC = 0.998; MCC = 0.972).
Based on the Table, quality-score [ 20], PSIPred [ 21, 22], SEG [ 23] and GlobPlot [ 24] obtained their best predictive performance of (TPR-FPR) at 0.61, 0.50, 0.41 and 0.39 respectively (see entries marked '*' in the last column).
The best predictive performances of the models were assessed by means of various descriptive statistical indicators.
As this model uses all the observations up to 12 weeks collected for both MPG and HbA1c, it is not surprising that this model has the best predictive performance for end-of-trial HbA1c.
Overall, the count of diagnoses had the best predictive performance for hospital utilization while the Elixhauser index, followed by the Charlson index, had the best predictive performance for mortality.
The model containing the Elixhauser index had the best predictive performance for all outcomes except for hospitalization for any reason, where number of diagnoses performed well.
IWI was the best predictive performance index of weaning outcome and can be used in the intensive care unit setting.
According to MAE and RMSE, ordinary least squares and MM-estimates based on the model 2 specification have the best predictive performance across both methods of valuation.
Based on the data from Additional file 2: Table S1, quality-score [ 20], PSIPred [ 21, 22], SEG [ 23] and GlobPlot [ 24] obtained their best predictive performance at (TPR-FPR) of 0.61, 0.50, 0.41 and 0.39 respectively.
This simulation study showed that, at least in a relatively simple mixed effects modelling context with a set of prespecified models, minimal mean AIC c corresponded to best predictive performance even in the presence of relatively large interindividual variability.
In conclusion, the present simulation study demonstrated that, at least in a relatively simple mixed effects modeling context with a set of prespecified models, minimum mean AIC c coincided with best predictive performance, also in the presence of interindividual variability.
