Announcing mccvshiny

mccvshiny is a Shiny for Python app that showcases the flexibility of the peer-reviewed Monte Carlo Cross Validation (MCCV) algorithm using simulated data distributions

Published

July 30, 2023

During my PhD I wrote the algorithm Monte Carlo Cross Validation (MCCV) to address a question about generating evidence for a prognostic biomarker of an adverse outcome1,2. The algorithm first ingests biomarker data from two groups, such as the concentration levels of proteins in patient’s blood samples. Next, the algorithm utilizes a subset of the biomarker data for training machine learning models (using cross validation) to mathematically separate the two groups. Then, the algorithm predicts the group for the unseen biomarker subset using the trained machine learning model. Lastly, MCCV employs this same routine many, many times for generating predictive evidence. This framework is very flexible in ingesting different data, choosing machine learning models, and how much evidence to generate. To showcase this flexibility, I turned to showcasing MCCV within a web application which also presented itself as an opportunity for learning Shiny for Python.

mccvshiny is a Shiny for Python web application that showcases the flexibility of the prediction framework MCCV. This web application is a proof-of-concept because 1) it is computationally slow by not running the algorithm in parallel, and 2) it doesn’t incorporate as many machine learning models as is available. Notwithstanding, it’s a worthwhile application for others to learn from and it was a great learning experience for myself 😊

Click the link here or on the GitHub site GitHub to check out the app or code. Feel free to contribute to the codebase for increasing the capabilities of the app by making a pull request (PR) on github. I’m not planning to develop the application more, but I’m happy to collaborate with others who would like to 😁 Shoutout to the Shiny team for developing a great tool for pythonistas!

References

1.
Giangreco NP, Lebreton G, Restaino S, Jane Farr M, Zorn E, Colombo PC, Patel J, Levine R, Truby L, Soni RK, Leprince P, Kobashigawa J, Tatonetti NP, Fine BM. Plasma kallikrein predicts primary graft dysfunction after heart transplant. J. Heart Lung Transplant. 2021;40(10):1199–1211.
2.
Giangreco NP, Lebreton G, Restaino S, Farr M, Zorn E, Colombo PC, Patel J, Soni RK, Leprince P, Kobashigawa J, Tatonetti NP, Fine BM. Alterations in the kallikrein-kinin system predict death after heart transplant. Sci. Rep. 2022;12(1):14167.