Journal of Reproduction & Infertility

Journal of Reproduction & Infertility

Improving Deep Learning-Based Algorithm for Ploidy Status Prediction Through Combined U-NET Blastocyst Segmentation and Sequential Time-Lapse Blastocysts Images

Authors
Nining Handayan 1
Gunawan Danardono 2
Arief Boediono 3
Budi Wiweko 4
Ivan Sini 5
Batara Sirait 6
Arie Polim 7
Irham Suheimi 5
Anom Bowolaks 8
1 Doctoral Program in Biomedical Sciences, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia; IRSI Research and Training Centre, Jakarta, Indonesia
2 IRSI Research and Training Centre, Jakarta, Indonesia
3 IRSI Research and Training Centre, Jakarta, Indonesia; Morula IVF Jakarta Clinic, Jakarta, Indonesia; Department of Anatomy, Physiology and Pharmacology, IPB University, Bogor, Indonesia
4 Division of Reproductive Endocrinology and Infertility, Department of Obstetrics and Gynecology, Faculty of Medicine, Universitas Indonesia, Jakarta, Indonesia; Yasmin IVF Clinic, Dr Cipto Mangunkusumo General Hospital, Jakarta, I
5 IRSI Research and Training Centre, Jakarta, Indonesia; Morula IVF Jakarta Clinic, Jakarta, Indonesia
6 IRSI Research and Training Centre, Jakarta, Indonesia; Morula IVF Jakarta Clinic, Jakarta, Indonesia; Department of Obstetrics and Gynaecology, Faculty of Medicine, Universitas Kristen Indonesia, Jakarta, Indonesia
7 Department of Obstetrics and Gynecology, School of Medicine and Health Sciences, Atma Jaya Catholic University of Indonesia, Jakarta, Indonesia
8 Cellular and Molecular Mechanisms in Biological System (CEMBIOS) Research Group, Department of Biology, Faculty of Mathematics and Natural Sciences, Universitas Indonesia, Depok, Indonesia
10.18502/jri.v25i2.16006
Abstract
Background: Several approaches have been proposed to optimize the construction of an artificial intelligence-based model for assessing ploidy status. These encompass the investigation of algorithms, refining image segmentation techniques, and discerning essential patterns throughout embryonic development. The purpose of the current study was to evaluate the effectiveness of using U-NET architecture for embryo segmentation and time-lapse embryo image sequence extraction, three and ten hr before biopsy to improve model accuracy for prediction of embryonic ploidy status. Methods: A total of 1.020 time-lapse videos of blastocysts with known ploidy status were used to construct a convolutional neural network (CNN)-based model for ploidy detection. Sequential images of each blastocyst were extracted from the time-lapse videos over a period of three and ten hr prior to the biopsy, generating 31.642 and 99.324 blastocyst images, respectively. U-NET architecture was applied for blastocyst image segmentation before its implementation in CNN-based model development. Results: The accuracy of ploidy prediction model without applying the U-NET segmented sequential embryo images was 0.59 and 0.63 over a period of three and ten hr before biopsy, respectively. Improved model accuracy of 0.61 and 0.66 was achieved, respectively with the implementation of U-NET architecture for embryo segmentation on the current model. Extracting blastocyst images over a 10 hr period yields higher accuracy compared to a three-hr extraction period prior to biopsy. Conclusion: Combined implementation of U-NET architecture for blastocyst image segmentation and the sequential compilation of ten hr of time-lapse blastocyst images could yield a CNN-based model with improved accuracy in predicting ploidy status.
Keywords
Artificial intelligence
image processing
Neural Networks
Ploidy measurement
  1. Huang L, Bogale B, Tang Y, Lu S, Xie XS, Racowsky C. Noninvasive preimplantation genetic testing for aneuploidy in spent medium may be more reliable than trophectoderm biopsy. Proc Natl Acad Sci USA. 2019;116(28):14105-12.
  2. Rubio C, Navarro-Sánchez L, García-Pascual CM, Ocali O, Cimadomo D, Venier W, et al. Multicenter prospective study of concordance between embryonic cell-free DNA and trophectoderm biopsies from 1301 human blastocysts. Am J Obstet Gynecol. 2020;223(5):751.e1-751.e13.
  3. Feichtinger M, Vaccari E, Carli L, Wallner E, Mädel U, Figl K, et al. Non-invasive preimplantation genetic screening using array comparative genomic hybridization on spent culture media: a proof-of-concept pilot study. Reprod Biomed Online. 2017;34 (6):583-9.
  4. Fishel S, Campbell A, Montgomery S, Smith R, Nice L, Duffy S, et al. Time-lapse imaging algorithms rank human preimplantation embryos according to the probability of live birth. Reprod Biomed Online. 2018;37(3):304-13.
  5. Campbell A, Fishel S, Bowman N, Duffy S, Sedler M, Thornton S. Retrospective analysis of outcomes after IVF using an aneuploidy risk model derived from time-lapse imaging without PGS. Reprod Biomed Online. 2013;27(2):140-6.
  6. Reignier A, Lammers J, Barriere P, Freour T. Can time-lapse parameters predict embryo ploidy? A systematic review. Reprod Biomed Online. 2018;36(4):380-7.
  7. Pennetta F, Lagalla C, Borini A. Embryo morphokinetic characteristics and euploidy. Curr Opin Obstet Gynecol. 2018;30(3):185-96.
  8. Kramer YG, Kofinas JD, Melzer K, Noyes N, McCaffrey C, Buldo-Licciardi J, et al. Assessing morphokinetic parameters via time lapse microscopy (TLM) to predict euploidy: are aneuploidy risk classification models universal? J Assist Reprod Genet. 2014;31(9):1231-42.
  9. Liang B, Gao Y, Xu J, Song Y, Xuan L, Shi T, et al. Raman profiling of embryo culture medium to identify aneuploid and euploid embryos. Fertil Steril. 2019;111(4):753-62.e1.
  10. Bori L, Dominguez F, Fernandez EI, Del Gallego R, Alegre L, Hickman C, et al. An artificial intelligence model based on the proteomic profile of euploid embryos and blastocyst morphology: a preliminary study. Reprod Biomed Online. 2021;42 (2):340-50.
  11. Chavez-Badiola A, Flores-Saiffe-Farías A, Mendizabal-Ruiz G, Drakeley AJ, Cohen J. Embryo ran-king intelligent classification algorithm (ERICA): artificial intelligence clinical assistant predicting embryo ploidy and implantation. Reprod Biomed Online. 2020;41(4):585-93.
  12. Lee CI, Su YR, Chen CH, Chang TA, Kuo EES, Zheng WL, et al. End-to-end deep learning for recognition of ploidy status using time-lapse videos. J Assist Reprod Genet. 2021;38(7):1655-63.
  13. Diakiw SM, Hall JMM, VerMilyea MD, Amin J, Aizpurua J, Giardini L, et al. Development of an artificial intelligence model for predicting the likelihood of human embryo euploidy based on blastocyst images from multiple imaging systems during IVF. Hum Reprod. 2022;37(8):1746-59.
  14. Huang TT, Huang DH, Ahn HJ, Arnett C, Huang CT. Early blastocyst expansion in euploid and aneuploid human embryos: evidence for a non-invasive and quantitative marker for embryo selection. Reprod Biomed Online. 2019;39(1):27-39.
  15. Louis CM, Handayani N, Aprilliana T, Polim AA, Boediono A, Sini I. Genetic algorithm–assisted machine learning for clinical pregnancy prediction in in vitro fertilization. AJOG Glob Rep. 2023;3(1):100133.
  16. VerMilyea M, Hall JMM, Diakiw SM, Johnston A, Nguyen T, Perugini D, et al. Development of an artificial intelligence-based assessment model for prediction of embryo viability using static images captured by optical light microscopy during IVF. Hum Reprod. 2020;35(4):770-84.
  17. Huang TTF, Kosasa T, Walker B, Arnett C, Huang CTF, Yin C, et al. Deep learning neural network analysis of human blastocyst expansion from time-lapse image files. Reprod Biomed Online. 2021;42 (6):1075-85.
  18. Danardono GB, Handayani N, Louis CM, Polim AA, Sirait B, Periastiningrum G, et al. Embryo ploidy status classification through computer-assisted morphology assessment. AJOG Glob Rep. 2023;3(3):100209.
  19. Tran D, Cooke S, Illingworth PJ, Gardner DK. Deep learning as a predictive tool for fetal heart pregnancy following time-lapse incubation and blastocyst transfer. Hum Reprod. 2019;34(6):1011-8.
  20. Louis CM, Handayani N, Aprilliana T, Polim AA, Boediono A, Sini I. Genetic algorithm–assisted machine learning for clinical pregnancy prediction in in vitro fertilization. AJOG Glob Rep. 2022;3 (1):100133.
  21. Boediono A, Handayani N, Sari HN, Yusup N, Indrasari W, Polim AA, et al. Morphokinetics of embryos after IMSI versus ICSI in couples with sub-optimal sperm quality: a time-lapse study. Andrologia. 2021;53(4):e14002.
  22. Gardner DK, Lane M, Stevens J, Schlenker T, Schoolcraft WB. Blastocyst score affects implantation and pregnancy outcome: Towards a single blastocyst transfer. Fertil Steril. 2000;73(6):1155-8.
  23. Polim AA, Handayani N, Nurputra DK, Lubis AM, Sirait B, Jakobus D, et al. Birth of spinal muscular atrophy unaffected baby from genetically at-risk parents following a pre-implantation genetic screening: a case report. Int J Reprod Biomed. 2022;20 (9):779-86.
  24. García-Pascual CM, Navarro-Sánchez L, Navarro R, Martínez L, Jiménez J, Rodrigo L, et al. Optimized NGS approach for detection of aneuploidies and mosaicism in PGT-A and imbalances in PGT-SR. Genes (Basel). 2020;11(7):724.
  25. Leigh D, Cram DS, Rechitsky S, Handyside A, Wells D, Munne S, et al. PGDIS position statement on the transfer of mosaic embryos 2021. Reprod Biomed Online. 2022;45(1):19-25.
  26. Mumusoglu S, Ozbek IY, Sokmensuer LK, Polat M, Bozdag G, Papanikolaou E, et al. Duration of blastulation may be associated with ongoing pregnancy rate in single euploid blastocyst transfer cycles. Reprod Biomed Online. 2017;35(6):633-9.
  27. Mumusoglu S, Yarali I, Bozdag G, Ozdemir P, Polat M, Sokmensuer LK, et al. Time-lapse morphokinetic assessment has low to moderate ability to predict euploidy when patient- and ovarian stimulation–related factors are taken into account with the use of clustered data analysis. Fertil Steril. 2017;107(2):413-21.e4.
  28. Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, et al. TensorFlow: a system for largescale machine learning. Proceedings of the 12th USENIX symposium on operating systems design and implementation (OSDI). Savannah, GA, USA, 2016. 265 p.
  29. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In proceedings of the 18th international conference on medical image computing and computer-assisted intervention–MICCAI. Munich, Germany, 5–9 October 2015; Springer: Cham, Switzerland, 2015. 234 p.
  30. Handayani N, Louis CM, Erwin A, Aprilliana T, Polim AA, Sirait B, et al. Machine learning approach to predict clinical pregnancy potential in women undergoing IVF program. Fertil Reprod. 2022;04(02):77-87.
  31. K. He, X. Zhang, S. Ren and J. Sun. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). Las Vegas, NV, USA, 2016. 770 p.
  32. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). Las Vegas, NV, USA, 2016. 2818 p.
  33. Tan M, Le QV. Efficientnet: rethinking model scaling for convolutional neural networks. Proceeding of the 36th international conference on machine learning (ICML). Rovira I Virgilly University, Tarragona, Spain, 2019. 10691 p.
  34. Thirumalaraju P, Kanakasabapathy MK, Bormann CL, Gupta R, Pooniwala R, Kandula H, et al. Evaluation of deep convolutional neural networks in classifying human embryo images based on their morphological quality. Heliyon. 2021;7(2):e06298.
  35. Chen TJ, Zheng WL, Liu CH, Huang I, Lai HH, Liu M. Using deep learning with large dataset of microscope images to develop an automated embryo grading system. Fertil Reprod. 2019;1(01):51-6.
  36. Danardono GB, Erwin A, Purnama J, Handayani N, Polim AA, Sini I, et al. A Homogeneous ensem-ble of robust pre-defined neural network enables automated annotation of human embryo morphokinetics. J Reprod Infertil. 2022;23(4):250-6.
  37. Fernandez EI, Ferreira AS, Cecílio MHM, Chéles DS, de Souza RCM, Nogueira MFG, et al. Artificial intelligence in the IVF laboratory: overview through the application of different types of algorithms for the classification of reproductive data. J Assist Reprod Genet. 2020;37(10):2359-76.
  38. Khan A, Sohail A, Zahoora U, Qureshi AS. A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev. 2020; 53:5455-516.
  39. Huang B, Tan W, Li Z, Jin L. An artificial intelligence model (euploid prediction algorithm) can predict embryo ploidy status based on time-lapse data. Reprod Biol Endocrinol. 2021;19(1):185.
  40. Kragh MF, Karstoft H. Embryo selection with artificial intelligence: how to evaluate and compare methods? J Assist Reprod Genet. 2021;38(7):1675-89.
Journal of Reproduction & Infertility
Volume 25, Issue 2
Spring 2024
Pages 110-119