Machine Learning-Assisted Morphological Assessment of Stem Cell Colony Quality
DOI:
https://doi.org/10.5281/zenodo.22274906Keywords:
Induced pluripotent stem cells; Machine learning; Colony morphology; Image analysis; Model validationAbstract
Background: Automated morphological assessment of stem cell colonies is widely reported to exceed ninety per cent accuracy,
but published figures rest on incompatible validation designs.
Objective: To read the field through the validation regime attached to each accuracy figure and ask what the reported numbers
actually measure.
Methods: Narrative review of colony imaging studies, model benchmarks and inter-observer agreement data.
Findings: On 165,190 images across 32 cell lines and 93 batches, one model reached 99.9% accuracy under a batch-stratified split
and 89.1% under a batch-separated split. A model trained on single-cell bright-field images reached 0.923 accuracy on the held-out
20% but 71.89-82.73% on separate experiments using inducers absent from training. Two experts agreed on 48% of 449 colony
images.
Conclusions: The evidence supports reporting split construction with every accuracy and grouping splits by batch and donor; it
does not support ranking published accuracies against one another.
References
Vo, Q.D., Saito, Y., Ida, T., Nakamura, K., Yuasa, S. (2024) The use of artificial intelligence in induced pluripotent stem cell-based technology over 10-year period: A systematic scoping review. PLOS ONE, 19(5): e0302537.
Deininger, L., Caldarelli, P., Zernicka-Goetz, M., Mikut, R. (2026) From pixels to patterns: the AI revolution in stem cell-derived models. Nature Methods, 23(9): 1710-1723.
Coronnello, C., Francipane, M.G. (2022) Moving Towards Induced Pluripotent Stem Cell-based Therapies with Artificial Intelligence and Machine Learning. Stem Cell Reviews and Reports, 18(2): 559-569.
National Institute of Standards and Technology, Information Systems Group. Pluripotency Scoring dataset. Web resource, https://isg.nist.gov/deepzoomweb/data/pluripotencyScori ng. Not a peer-reviewed publication.
Paternot, G., Devroe, J., Debrock, S., D'Hooghe, T.M., Spiessens, C. (2009) Intra- and inter-observer analysis in the morphological assessment of early-stage embryos. Reproductive Biology and Endocrinology, 7: 105.
Kakulavarapu, R.K., Delbarre, E., Sharma, A., Jahanlu, D., Riegler, M.A., Haugen, T.B., et al. (2026) Investigating discrepancies in accuracy, agreement and interpretability for single-frame embryo classification tasks conducted by embryologists and deep learning models. Frontiers in Reproductive Health, 8: 1778326.
Piotrowski, T., Rippel, O., Elanzew, A., Niessing, B., Stucken, S., Jung, S., et al. (2021) Deep-learning-based multi-class segmentation for automated, non-invasive routine assessment of human pluripotent stem cell culture status. Computers in Biology and Medicine, 129: 104172.
Maddah, M., Shoukat-Mumtaz, U., Nassirpour, S., Loewke, K. (2014) A System for Automated, Noninvasive, Morphology-Based Evaluation of Induced Pluripotent Stem Cell Cultures. SLAS Technology, 19(5): 454-460.
Tokunaga, K., Saitoh, N., Goldberg, I.G., Sakamoto, C., Yasuda, Y., Yoshida, Y., et al. (2014) Computational image analysis of colony and nuclear morphology to evaluate human induced pluripotent stem cells. Scientific Reports, 4: 6996.
Kato, R., Matsumoto, M., Sasaki, H., Joto, R., Okada, M., Ikeda, Y., et al. (2016) Parametric analysis of colony morphology of non-labelled live human pluripotent stem cells for cell quality control. Scientific Reports, 6: 34009.
Joutsijoki, H., Haponen, M., Rasku, J., Aalto-Setälä, K., Juhola, M. (2016) Machine Learning Approach to Automated Quality Identification of Human Induced Pluripotent Stem Cell Colony Images. Computational and Mathematical Methods in Medicine, 2016: 3091039.
Nagasaka, R., Gotou, Y., Yoshida, K., Kanie, K., Shimizu, K., Honda, H., et al. (2017) Image-based cell quality evaluation to detect irregularities under same culture process of human induced pluripotent stem cells. Journal of Bioscience and Bioengineering, 123(5): 642-650.
Perestrelo, T., Chen, W., Correia, M., Le, C., Pereira, S.L., Rodrigues, A.S., et al. (2017) Pluri-IQ: Quantification of Embryonic Stem Cell Pluripotency through an Image-Based Analysis Software. Stem Cell Reports, 9(2): 697-709.
Waisman, A., La Greca, A., Mobbs, A.M., Scarafia, M.A., Santin Velazque, N.L., Neiman, G., et al. (2019) Deep Learning Neural Networks Highly Predict Very Early Onset of Pluripotent Stem Cell Differentiation. Stem Cell Reports, 12(4): 845-859.
Kusumoto, D., Lachmann, M., Kunihiro, T., Yuasa, S., Kishino, Y., Kimura, M., et al. (2018) Automated Deep Learning-Based System to Identify Endothelial Cells Derived from Induced Pluripotent Stem Cells. Stem Cell Reports, 10(6): 1687-1695.
Chu, S.-L., Sudo, K., Yokota, H., Abe, K., Nakamura, Y., Tsai, M.-D. (2022) Human induced pluripotent stem cell formation and morphology prediction during reprogramming with time-lapse bright-field microscopy images using deep learning methods. Computer Methods and Programs in Biomedicine, 229: 107264.
Fan, K., Zhang, S., Zhang, Y., Lu, J., Holcombe, M., Zhang, X. (2017) A Machine Learning Assisted, Label-free, Non-invasive Approach for Somatic Reprogramming in Induced Pluripotent Stem Cell Colony Formation Detection and Prediction. Scientific Reports, 7(1): 13496.
Buggenthin, F., Buettner, F., Hoppe, P.S., Endele, M., Kroiss, M., Strasser, M., et al. (2017) Prospective identification of hematopoietic lineage choice by deep learning. Nature Methods, 14(4): 403-406.
Klinker, M.W., Marklein, R.A., Lo Surdo, J.L., Wei, C.-H., Bauer, S.R. (2017) Morphological features of IFN-gamma-stimulated mesenchymal stromal cells predict overall immunosuppressive capacity. Proceedings of the National Academy of Sciences, 114(13): E2598-E2607.
Marklein, R.A., Klinker, M.W., Drake, K.A., Polikowsky, H.G., Lessey-Morillon, E.C., Bauer, S.R. (2019) Morphological profiling using machine learning reveals emergent subpopulations of interferon-gamma-stimulated mesenchymal stromal cells that predict immunosuppression. Cytotherapy, 21(1): 17-31.
Tong, L., Corrigan, A., Kumar, N.R., Hallbrook, K., Orme, J.P., Wang, Y., et al. (2024) CLANet: A comprehensive framework for cross-batch cell line identification using brightfield images. Medical Image Analysis, 94: 103123.
Zhu, Y., Huang, R., Wu, Z., Song, S., Cheng, L., Zhu, R. (2021) Deep learning-based predictive identification of neural stem cell differentiation. Nature Communications, 12: 2614.
Kavitha, M.S., Kurita, T., Park, S.-Y., Chien, S.-I., Bae, J.-S., Ahn, B.-C. (2017) Deep vector-based convolutional neural network approach for automatic recognition of colonies of induced pluripotent stem cells. PLOS ONE, 12(12): e0189974.
Krasnova, O.A., Gursky, V.V., Chabina, A.S., Kulakova, K.A., Alekseenko, L.L., Panova, A.V., et al. (2022) Prognostic Analysis of Human Pluripotent Stem Cells Based on Their Morphological Portrait and Expression of Pluripotent Markers. International Journal of Molecular Sciences, 23(21): 12902.
Vedeneeva, E., Gursky, V., Samsonova, M., Neganova, I. (2023) Morphological Signal Processing for Phenotype Recognition of Human Pluripotent Stem Cells Using Machine Learning Methods. Biomedicines, 11(11): 3005.
Mamaeva, A., Krasnova, O., Khvorova, I., Kozlov, K., Gursky, V., Samsonova, M., et al. (2023) Quality Control of Human Pluripotent Stem Cell Colonies by Computational Image Analysis Using Convolutional Neural Networks. International Journal of Molecular Sciences, 24(1): 140.
Mai, M., Luo, S., Fasciano, S., Oluwole, T.E., Ortiz, J., Pang, Y., et al. (2023) Morphology-based deep learning approach for predicting adipogenic and osteogenic differentiation of human mesenchymal stem cells (hMSCs). Frontiers in Cell and Developmental Biology, 11: 1329840.
Marzec-Schmidt, K., Ghosheh, N., Stahlschmidt, S.R., Kuppers-Munther, B., Synnergren, J., Ulfenborg, B. (2023) Artificial Intelligence Supports Automated Characterization of Differentiated Human Pluripotent Stem Cells. Stem Cells, 41(9): 850-861.
Arevalo, J., Su, E., Ewald, J.D., van Dijk, R., Carpenter, A.E., Singh, S. (2024) Evaluating batch correction methods for image-based cell profiling. Nature Communications, 15: 6516.
Kim, V., Adaloglou, N., Osterland, M., Morelli, F.M., Halawa, M., König, T., et al. (2025) Self-supervision advances morphological profiling by unlocking powerful image representations. Scientific Reports, 15: 4876.
Schaub, N.J., Hotaling, N.A., Manescu, P., Padi, S., Wan, Q., Sharma, R., et al. (2020) Deep learning predicts function of live retinal pigment epithelium from quantitative microscopy. The Journal of Clinical Investigation, 130(2): 1010-1023.
Yogo, T., Iwamoto, Y., Becker, H.J., Kimura, T., Ishida, R., Sugiyama-Finnis, A., et al. (2025) Quantitative phase imaging with temporal kinetics predicts hematopoietic stem cell diversity. Nature Communications, 16: 6496.
Salmikangas, P., Carlsson, B., Klumb, C., Reimer, T., Thirstrup, S. (2023) Potency testing of cell and gene therapy products. Frontiers in Medicine, 10: 1190016.
Tucker, B.A., Mullins, R.F., Stone, E.M. (2020) Autologous cell replacement: a noninvasive AI approach to clinical release testing. The Journal of Clinical Investigation, 130(2): 608-611.
