Reproducible machine learning methods for lung cancer detection using computed tomography images: Algorithm development and validation

Kun Hsing Yu, Tsung Lu Michael Lee, Ming Hsuan Yen, S. C. Kou, Bruce Rosen, Jung Hsien Chiang, Isaac S. Kohane

研究成果: Article同行評審

48 引文 斯高帕斯(Scopus)


Background: Chest computed tomography (CT) is crucial for the detection of lung cancer, and many automated CT evaluation methods have been proposed. Due to the divergent software dependencies of the reported approaches, the developed methods are rarely compared or reproduced. Objective: The goal of the research was to generate reproducible machine learning modules for lung cancer detection and compare the approaches and performances of the award-winning algorithms developed in the Kaggle Data Science Bowl. Methods: We obtained the source codes of all award-winning solutions of the Kaggle Data Science Bowl Challenge, where participants developed automated CT evaluation methods to detect lung cancer (training set n=1397, public test set n=198, final test set n=506). The performance of the algorithms was evaluated by the log-loss function, and the Spearman correlation coefficient of the performance in the public and final test sets was computed. Results: Most solutions implemented distinct image preprocessing, segmentation, and classification modules. Variants of U-Net, VGGNet, and residual net were commonly used in nodule segmentation, and transfer learning was used in most of the classification algorithms. Substantial performance variations in the public and final test sets were observed (Spearman correlation coefficient = .39 among the top 10 teams). To ensure the reproducibility of results, we generated a Docker container for each of the top solutions. Conclusions: We compared the award-winning algorithms for lung cancer detection and generated reproducible Docker images for the top solutions. Although convolutional neural networks achieved decent accuracy, there is plenty of room for improvement regarding model generalizability.

期刊Journal of medical Internet research
出版狀態Published - 2020 8月

All Science Journal Classification (ASJC) codes

  • 健康資訊學


深入研究「Reproducible machine learning methods for lung cancer detection using computed tomography images: Algorithm development and validation」主題。共同形成了獨特的指紋。