Diagnostic Efficiency of Various Systems for Automatic Analysis of Radiographs in the Detection of Lung Nodule
https://doi.org/10.52560/2713-0118-2022-3-51-66
Abstract
The purpose of the study was to compare the effectiveness of various artificial intelligence systems for detecting foci and rounded lesions in the lungs. For testing, we selected four software products based on convolutional neural networks, positioning themselves as a sensitive system for evaluating digital chest radiographs. An analytical validation method was used for clinical evaluation. For diagnostics, 3 data samples were formed with the identification of signs of diseases (sample 1–5150 radiographs, detection of pathological changes 3 %; sample 2–100 radiographs, detection of pathological changes 6 %; sample 3–300 radiographs, detection of the prevalence of pathological changes 50 %). None of the software products passed the AUC threshold of 0.811 on all three samples. In all three samples, all software products have high accuracy and high sensitivity in detecting round formations, which leads to rare cases of overdiagnosis and special cases of underdiagnosis. The use of digital X-ray image analysis systems based on artificial intelligence technologies is a promising direction for high-quality diagnostics, primarily when considering their young radiologists as an additional opinion.
About the Authors
U. A. SmolnikovaRussian Federation
Smol’nikova Uliana Alekseevna, Рostgraduate
2-4, Ligovskiy pr., St. Petersburg, 191036
Phone number: +7 (812) 775-75-55
P. V. Gavrilov
Russian Federation
Gavrilov Pavel Vladimirovich, Ph. D. Med., Leading Researcher, Head of the Department of Radiology
2-4, Ligovsky pr., St. Petersburg, 191036
Phone number: +7 (812) 775-75-55
P. K. Yаblonskiy
Russian Federation
Yаblonskiy Petr Kazimirovich, М. D. Med., Professor, Director
2-4, Ligovsky pr., St. Petersburg, 191036
Phone number: +7 (812) 775-75-55
References
1. Vasil’ev A. Yu., Maliy A. Yu., Serova N. S. Analysis of data from radiation research methods based on the principles of evidence-based medicine Moscow: GEOTAR-Media. 2008. 32 p. (in Russian).
2. Gavrilov P. V., Ushkov A. D., Smolnikova U. A. Detection of lumps in the lungs with digital X-ray: the role of the work experience of the radiologist. Medical alliance. 2019. No. 2. P. 51–56 (in Russian).
3. Gavrilov P. V., Smolnikova U. A. Evalua tion of diagnostic accuracy of the automatic system for the analysis of digital lung X-ray for detection of spherical masses. Almanac of Clinical Medicine. 2021. V. 49. No. 6. P. 359–364 (in Russian). doi:10.18786/2072-0505-2021-49-035.
4. Meldo А. А., Utkin L. V., Trofimova T. N. Artificial intelligence in medicine: modern condition and the main directions of deve lopment. Radiation diagnostics and the rapy. 2020. No. 1. P. 9–17 (in Russian). doi:10.22328/2079-5343-2020-11-1-9-17.
5. Morozov S. P., Vladzimirskiy A. V., Ledikhova N. V., Sokolina I. A., Kulberg N. S., Gombolevskiy V. A. Evaluation of diagnostic accuracy of the system for pulmonary tuberculosis screening based on artificial neural networks. Tuberculosis and Lung Diseases. 2018. V. 96 (8). P. 42–49 (in Russian). doi.org/10.21292/2075-1230-2018-96-8-42-49.
6. Morozov S. P., Vladzimirskii A. V., Klyashtornyi V. G., Andreichenko A. E., Kulberg N. S., Gombolevskii V. A. Clinical Trials of Intelligent Software (radiation diagnostics). Series «Best Practices in Radiation and Instrumental Diagnostics». М, 2019. 34 p. (in Russian).
7. Morozov S. P., Kokina D. Yu., Pavlov N. A., Kirpichev Yu. S., Gombolevskiy V. A., Аndreychenko A. E. Clinical as pects of using artificial intelligence for the interpretation of chest X-rays. Tuberculosis and Lung Diseases. 2021. V. 99 (4). P. 58–64 (in Russian). https://doi.org/10.21292/2075-1230-2021-99-4-58-64
8. Lee J. H., Sun H. Y., Park S., Kim H., Hwang E. J., Goo J. M., Park C. M. Performance of a Deep Learning Algo rithm Compared with Radiologic Interpretation for Lung Cancer Detection on Chest Radiographs in a Health Scree ning Population. Radiol. 2020 Dec; 297(3): 687–696. doi: 10.1148/radiol.2020201240
9. Nakamura K. et al. Studies on the diagnostic value of 70 mm radiophotograms by mirror camera and the reading ability of physicians. Kekkaku. 1970. V. 45. No. 4. P. 121–128.
Supplementary files
Review
For citations:
Smolnikova U.A., Gavrilov P.V., Yаblonskiy P.K. Diagnostic Efficiency of Various Systems for Automatic Analysis of Radiographs in the Detection of Lung Nodule. Radiology - Practice. 2022;(3):51-66. (In Russ.) https://doi.org/10.52560/2713-0118-2022-3-51-66