<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">sredob</journal-id><journal-title-group><journal-title xml:lang="ru">Здоровье населения и среда обитания – ЗНиСО</journal-title><trans-title-group xml:lang="en"><trans-title>Public Health and Life Environment – PH&amp;LE</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2219-5238</issn><issn pub-type="epub">2619-0788</issn><publisher><publisher-name>ФБУЗ ФЦГиЭ Роспотребнадзора</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.35627/2219-5238/2023-31-11-23-32</article-id><article-id custom-type="elpub" pub-id-type="custom">sredob-1813</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ВОПРОСЫ УПРАВЛЕНИЯ И СОЦИАЛЬНОЙ ГИГИЕНЫ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>ISSUES OF MANAGEMENT AND SOCIAL HYGIENE</subject></subj-group></article-categories><title-group><article-title>Новая модель организации массовых профилактических исследований, основанная на автономном искусственном интеллекте для сортировки результатов флюорографии</article-title><trans-title-group xml:lang="en"><trans-title>A New Model of Organizing Mass Screening Based on Stand-Alone Artificial Intelligence Used for Fluorography Image Triage</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-0208-5218</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Васильев</surname><given-names>Ю. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Vasilev</surname><given-names>Yu. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Васильев Юрий Александрович – к.м.н., директор</p><p>ул. Петровка, д. 24, стр. 1, г. Москва, 127051</p></bio><bio xml:lang="en"><p>Yuriy A. Vasilev, Cand. Sci. (Med.), Director</p><p>Bldg 1, 24 Petrovka Street, Moscow, 127051</p></bio><email xlink:type="simple">npcmr@zdrav.mos.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-9337-624X</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Тыров</surname><given-names>И. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Tyrov</surname><given-names>I. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Тыров Илья Александрович – заместитель руководителя</p><p>Оружейный пер., д. 43, г. Москва, 127006</p></bio><bio xml:lang="en"><p>Ilya A. Tyrov, Deputy Head</p><p>43 Oruzheynyy Lane, Moscow, 127006</p></bio><email xlink:type="simple">npcmr@zdrav.mos.ru</email><xref ref-type="aff" rid="aff-2"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-2990-7736</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Владзимирский</surname><given-names>А. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Vladzymyrskyy</surname><given-names>A. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Владзимирский Антон Вячеславович – д.м.н., профессор, заместитель директора по научной работе </p><p>ул. Петровка, д. 24, стр. 1, г. Москва, 127051</p></bio><bio xml:lang="en"><p>Anton V. Vladzymyrskyy, Dr. Sci. (Med.), Professor, Deputy Director for Research</p><p>Bldg 1, 24 Petrovka Street, Moscow, 127051</p></bio><email xlink:type="simple">npcmr@zdrav.mos.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-7786-0349</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Арзамасов</surname><given-names>К. М.</given-names></name><name name-style="western" xml:lang="en"><surname>Arzamasov</surname><given-names>K. M.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Арзамасов Кирилл Михайлович – к.м.н., руководитель отдела медицинской информатики, радиомики и радиогеномики</p><p>ул. Петровка, д. 24, стр. 1, г. Москва, 127051</p></bio><bio xml:lang="en"><p>Kirill M. Arzamasov, Cand. Sci. (Med.), Head of the Department of Medical Informatics, Radiomics and Radiogenomics</p><p>Bldg 1, 24 Petrovka Street, Moscow, 127051</p></bio><email xlink:type="simple">ArzamasovKM@zdrav.mos.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-1786-4329</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Пестренин</surname><given-names>Л. Д.</given-names></name><name name-style="western" xml:lang="en"><surname>Pestrenin,</surname><given-names>L. D.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Пестренин Лев Дмитриевич – младший научный сотрудник отдела медицинской информатики, радиомики и радиогеномики </p><p>ул. Петровка, д. 24, стр. 1, г. Москва, 127051</p></bio><bio xml:lang="en"><p>Lev D. Pestrenin, Junior Researcher, Department of Medical Informatics, Radiomics and Radiogenomics</p><p>Bldg 1, 24 Petrovka Street, Moscow, 127051</p></bio><email xlink:type="simple">PestreninLD@zdrav.mos.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-7613-5273</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Шулькин</surname><given-names>И. М.</given-names></name><name name-style="western" xml:lang="en"><surname>Shulkin</surname><given-names>I. M.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Шулькин Игорь Михайлович – заместитель директора по перспективному развитию</p><p>ул. Петровка, д. 24, стр. 1, г. Москва, 127051</p></bio><bio xml:lang="en"><p>Igor M. Shulkin, Deputy Director for Prospective Development</p><p>Bldg 1, 24 Petrovka Street, Moscow, 127051</p></bio><email xlink:type="simple">npcmr@zdrav.mos.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>ГБУЗ города Москвы «Научно-практический клинический центр диагностики и телемедицинских технологий&#13;
Департамента здравоохранения города Москвы»</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Department&#13;
of Health</institution><country>Russian Federation</country></aff></aff-alternatives><aff-alternatives id="aff-2"><aff xml:lang="ru"><institution>Департамент здравоохранения города Москвы</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Moscow Department of Health</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2023</year></pub-date><pub-date pub-type="epub"><day>11</day><month>12</month><year>2023</year></pub-date><volume>31</volume><issue>11</issue><fpage>23</fpage><lpage>32</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Васильев Ю.А., Тыров И.А., Владзимирский А.В., Арзамасов К.М., Пестренин Л.Д., Шулькин И.М., 2023</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="ru">Васильев Ю.А., Тыров И.А., Владзимирский А.В., Арзамасов К.М., Пестренин Л.Д., Шулькин И.М.</copyright-holder><copyright-holder xml:lang="en">Vasilev Y.A., Tyrov I.A., Vladzymyrskyy A.V., Arzamasov K.M., Pestrenin, L.D., Shulkin I.M.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://zniso.fcgie.ru/jour/article/view/1813">https://zniso.fcgie.ru/jour/article/view/1813</self-uri><abstract><sec><title>Введение</title><p>Введение. В настоящее время отмечается бурное развитие программного обеспечения на основе технологии искусственного интеллекта, в том числе для анализа цифровых флюорограмм. Это программное обеспечение, предварительно зарегистрированное как медицинское изделие, может быть использовано для автономного анализа и сортировки исследований, что позволит врачам-рентгенологам сфокусировать внимание на исследованиях с патологией.</p></sec><sec><title>Цель исследования</title><p>Цель исследования: обосновать возможность и эффективность применения программного обеспечения на основе технологии искусственного интеллекта для автономного анализа и сортировки результатов цифровой флюорографии.</p></sec><sec><title>Материалы и методы</title><p>Материалы и методы. С помощью программного обеспечения на основе технологии искусственного интеллекта, зарегистрированного в РФ как медицинское изделие, было обработано 88 048 цифровых флюорограмм, выполненных в первом квартале 2023 г. Проведен ROC-анализ полученных данных.</p></sec><sec><title>Результаты</title><p>Результаты. При текущих настройках программного обеспечения: чувствительность 90,4 % (95 % ДИ: 88,2–92,7), специфичность 75,5 % (95 % ДИ: 75,2–75,8), точность 75,6 % (95 % ДИ: 75,3–75,9). При настройке программного обеспечения на максимальную чувствительность: чувствительность 100,0 % (95 % ДИ: 100–100), специфичность 77,4 % (95 % ДИ: 74,8–80,0), точность 77,9 % (95 % ДИ: 75,3–80,5). Предложена модель организации медицинской помощи, предусматривающая автономную сортировку результатов профилактической флюорографии: изображения анализируются программным обеспечением, результаты с «Нормой» сохраняются в медицинской документации без описания врачом-рентгенологом, результаты с «Не нормой» направляются на описание врачом-рентгенологом (в перспективе, по мере совершенствования технологий искусственного интеллекта, сразу направляются врачу клинической специальности).</p></sec><sec><title>Заключение</title><p>Заключение. Оптимальным сценарием видится использование программного обеспечения на основе технологии искусственного интеллекта для выявления исследований категории «Норма», пересмотр которых врачом-рентгенологом при настройке алгоритма на максимальную чувствительность необязателен. Обязательному пересмотру будут подвергаться только те исследования, которые будут классифицированы программным обеспечением как «Не норма». Экономическая выгода от практической реализации данного подхода в масштабах страны может составлять до 5,6 млрд рублей ежегодно.</p></sec></abstract><trans-abstract xml:lang="en"><sec><title>Introduction</title><p>Introduction: A rapid development of artificial intelligence software, including that for the analysis of digital fluorography images, has been noted recently. Pre-registered as a medical device, this software can be used for stand-alone analysis and triage of test results, allowing radiologists to focus on pathological findings.</p></sec><sec><title>Objective</title><p>Objective: To substantiate the possibility and efficiency of using artificial intelligence software for stand-alone analysis and triage of digital fluorography images.</p></sec><sec><title>Materials and methods</title><p>Materials and methods: 88,048 digital fluorograms obtained in the first quarter of 2023 were processed using the artificial intelligence software registered in the Russian Federation as a medical device and a ROC analysis of the findings was carried out.</p></sec><sec><title>Results</title><p>Results: We established that default software settings with the sensitivity of 90.4 % (95 % CI: 88.2–92.7) produced specificity of 75.5 % (95 % CI: 75.2–75.8) and accuracy of 75.6 % (95 % CI: 75.3–75.9). At the maximum sensitivity of 100.0 % (95 % CI: 100–100), specificity was 77.4 % (95 % CI: 74.8–80.0) and accuracy was as high as 77.9 % (95 % CI: 75.3–80.5). We have proposed a model of organizing health care which provides for stand-alone sorting of fluorography images by the software, saving normal results without their verification by a radiologist, and sending images with abnormal findings to a radiologist for diagnosis (in the future, as artificial intelligence improves, the latter will be immediately sent to a physician of the clinical specialty).</p></sec><sec><title>Conclusions</title><p>Conclusions: The established optimal scenario includes the use of artificial intelligence software to identify normal findings, which examination by a radiologist is optional when the algorithm is set to maximum sensitivity. Only the findings classified as abnormal will be subject to mandatory revision. The annual economic benefit gained by practical implementation of this approach nationwide can reach 5.6 billion rubles.</p></sec></trans-abstract><kwd-group xml:lang="ru"><kwd>профилактические исследования</kwd><kwd>флюорография</kwd><kwd>искусственный интеллект</kwd><kwd>диагностическая точность</kwd><kwd>экономический эффект</kwd></kwd-group><kwd-group xml:lang="en"><kwd>screening</kwd><kwd>fluorography</kwd><kwd>artificial intelligence</kwd><kwd>diagnostic accuracy</kwd><kwd>cost-benefit analysis</kwd></kwd-group><funding-group><funding-statement xml:lang="ru">исследование выполнено в рамках государственного задания «Научные методологии устойчивого развития технологий искусственного интеллекта в медицинской диагностике».</funding-statement><funding-statement xml:lang="en">The research was carried out within the government assignment “Scientific methodologies for the sustainable development of artificial intelligence technologies in medical diagnosis”.</funding-statement></funding-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Морозов С.П., Владзимирский А.В., Ледихова Н.В. Телерадиология в Российской Федерации: достигнутый уровень // Врач и информационные технологии. 2019. № 2. С. 67–73.</mixed-citation><mixed-citation xml:lang="en">Morozov SP, Vladzymyrskyy AV, Ledikhova NV. Teleradiology in Russian Federation: State-of-art. Vrach i Informatsionnye Tekhnologii. 2019;(2):67-73. (In Russ.)</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Карпов А.В., Болотских В.В., Карпов Д.С. Значение цифрового флюорографического обследования в ранней диагностике легочных форм туберкулеза в современных условиях // Туберкулез и социально-значимые заболевания. 2019. № 4. С. 50–51.</mixed-citation><mixed-citation xml:lang="en">Karpov AV, Bolotskikh VV, Karpov DS. [The value of digital fluorographic examination in the early diagnosis of pulmonary forms of tuberculosis in modern conditions.] Tuberkulez i Sotsial’no-Znachimye Zabolevaniya. 2019;(4):50-51. (In Russ.)</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Ломаков С.Ю., Строганов Е.А. Современные аспекты организации профилактических лучевых исследований методом флюорографии // Международный академический вестник. 2019. № 11 (43). С. 4–6.</mixed-citation><mixed-citation xml:lang="en">Lomakov SYu, Stroganov EA. [Modern aspects of organizing prophylactic radiation studies using fluorography.] Mezhdunarodnyy Akademicheskiy Vestnik. 2019;(11(43)):4-6. (In Russ.)</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Маркелов Ю.М., Щеголева Л.В. Клинико-экономические аспекты выявления туберкулеза при массовых флюорографических осмотрах населения // Вестник рентгенологии и радиологии. 2021. Т. 102. № 3. С. 148–154. doi: 10.20862/0042-4676-2021-102-3-148154</mixed-citation><mixed-citation xml:lang="en">Markelov YuM, Shchegoleva LV. Clinical and economic aspects of tuberculosis detection during mass fluorographic examinations of the population. Vestnik Rentgenologii i Radiologii. 2021;102(3):148-154. (In Russ.) doi: 10.20862/0042-4676-2021-102-3-148-154</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Маркелов Ю.М., Щеголева Л.В. Оценка клиникоэкономической эффективности и влияния массовых флюорографических осмотров на эпидемиологические показатели по туберкулезу в четырех федеральных округах РФ с различным уровнем охвата флюорографическими осмотрами населения // Туберкулез и болезни легких. 2023. Т. 101. № 1. С. 8–16. doi: 10.58838/2075-1230-2023-101-1-8-16</mixed-citation><mixed-citation xml:lang="en">Markelov YuM, Schegoleva LV. Evaluation of clinical and economic efficiency and impact of mass fluorography screening on tuberculosis epidemiological rates in four federal districts of the Russian Federation with different levels of population coverage with mass fluorography screening. Tuberkulez i Bolezni Legkikh. 2023;101(1):816. (In Russ.) doi: 10.58838/2075-1230-2023-101-1-8-16</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Рубис Л.В. Эффективность массовых профилактических осмотров городского населения в учреждениях, оказывающих первичную медико-санитарную помощь, с целью ранней диагностики туберкулеза // Современные проблемы здравоохранения и медицинской статистики. 2021. № 3. С. 1–13. doi: 10.24412/2312-2935-2021-3-1-13</mixed-citation><mixed-citation xml:lang="en">Rubis LV. Efficiency of mass preventive examinations of the urban population for the purpose of early diagnosis of tuberculosis in primary health care institutions. Sovremennye Problemy Zdravookhraneniya i Meditsinskoy Statistiki. 2021;(3):1-13. (In Russ.) doi: 10.24412/23122935-2021-3-1-13</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Geijer H, Geijer M. Added value of double reading in diagnostic radiology,a systematic review. Insights Imaging. 2018;9(3):287–301. doi: 10.1007/s13244-018-0599-0</mixed-citation><mixed-citation xml:lang="en">Geijer H, Geijer M. Added value of double reading in diagnostic radiology,a systematic review. Insights Imaging. 2018;9(3):287–301. doi: 10.1007/s13244-018-0599-0</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Posso M, Puig T, Carles M, Rué M, Canelo-Aybar C, Bonfill X. Effectiveness and cost-effectiveness of double reading in digital mammography screening: A systematic review and meta-analysis. Eur J Radiol. 2017;96:40-49. doi: 10.1016/j.ejrad.2017.09.013</mixed-citation><mixed-citation xml:lang="en">Posso M, Puig T, Carles M, Rué M, Canelo-Aybar C, Bonfill X. Effectiveness and cost-effectiveness of double reading in digital mammography screening: A systematic review and meta-analysis. Eur J Radiol. 2017;96:40-49. doi: 10.1016/j.ejrad.2017.09.013</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Johnson AEW, Pollard TJ, Berkowitz SJ, et al. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data. 2019;6(1):317. doi: 10.1038/s41597-019-0322-0</mixed-citation><mixed-citation xml:lang="en">Johnson AEW, Pollard TJ, Berkowitz SJ, et al. MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data. 2019;6(1):317. doi: 10.1038/s41597-019-0322-0</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Do HM, Spear LG, Nikpanah M, et al. Augmented radiologist workflow improves report value and saves time: A potential model for implementation of artificial intelligence. Acad Radiol. 2020;27(1):96-105. doi: 10.1016/j.acra.2019.09.014</mixed-citation><mixed-citation xml:lang="en">Do HM, Spear LG, Nikpanah M, et al. Augmented radiologist workflow improves report value and saves time: A potential model for implementation of artificial intelligence. Acad Radiol. 2020;27(1):96-105. doi: 10.1016/j.acra.2019.09.014</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Harris M, Qi A, Jeagal L, et al. A systematic review of the diagnostic accuracy of artificial intelligence-based computer programs to analyze chest x-rays for pulmonary tuberculosis. PLoS One. 2019;14(9):e0221339. doi: 10.1371/journal.pone.0221339</mixed-citation><mixed-citation xml:lang="en">Harris M, Qi A, Jeagal L, et al. A systematic review of the diagnostic accuracy of artificial intelligence-based computer programs to analyze chest x-rays for pulmonary tuberculosis. PLoS One. 2019;14(9):e0221339. doi: 10.1371/journal.pone.0221339</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Codlin AJ, Dao TP, Vo LNQ, et al. Independent evaluation of 12 artificial intelligence solutions for the detection of tuberculosis. Sci Rep. 2021;11(1):23895. doi: 10.1038/s41598-021-03265-0</mixed-citation><mixed-citation xml:lang="en">Codlin AJ, Dao TP, Vo LNQ, et al. Independent evaluation of 12 artificial intelligence solutions for the detection of tuberculosis. Sci Rep. 2021;11(1):23895. doi: 10.1038/s41598-021-03265-0</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Adams SJ, Henderson RDE, Yi X, Babyn P. Artificial intelligence solutions for analysis of X-ray images. Can Assoc Radiol J. 2021;72(1):60-72. doi: 10.1177/0846537120941671</mixed-citation><mixed-citation xml:lang="en">Adams SJ, Henderson RDE, Yi X, Babyn P. Artificial intelligence solutions for analysis of X-ray images. Can Assoc Radiol J. 2021;72(1):60-72. doi: 10.1177/0846537120941671</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Wu JT, Wong KCL, Gur Y, et al. Comparison of chest radiograph interpretations by artificial intelligence algorithm vs radiology residents. JAMA Netw Open. 2020;3(10):e2022779. doi: 10.1001/jamanetworkopen.2020.22779</mixed-citation><mixed-citation xml:lang="en">Wu JT, Wong KCL, Gur Y, et al. Comparison of chest radiograph interpretations by artificial intelligence algorithm vs radiology residents. JAMA Netw Open. 2020;3(10):e2022779. doi: 10.1001/jamanetworkopen.2020.22779</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Miró Catalina Q, Fuster-Casanovas A, Solé-Casals J, Vidal-Alaball J. Developing an artificial intelligence model for reading chest X-rays: Protocol for a prospective validation study. JMIR Res Protoc. 2022;11(11):e39536. doi: 10.2196/39536</mixed-citation><mixed-citation xml:lang="en">Miró Catalina Q, Fuster-Casanovas A, Solé-Casals J, Vidal-Alaball J. Developing an artificial intelligence model for reading chest X-rays: Protocol for a prospective validation study. JMIR Res Protoc. 2022;11(11):e39536. doi: 10.2196/39536</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Zinchenko V, Chetverikov S, Akhmad E, et al. Changes in software as a medical device based on artificial intelligence technologies. Int J Comput Assist Radiol Surg. 2022;17(10):1969-1977. doi: 10.1007/s11548-02202669-1</mixed-citation><mixed-citation xml:lang="en">Zinchenko V, Chetverikov S, Akhmad E, et al. Changes in software as a medical device based on artificial intelligence technologies. Int J Comput Assist Radiol Surg. 2022;17(10):1969-1977. doi: 10.1007/s11548-02202669-1</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Yoo H, Kim EY, Kim H, et al. Artificial intelligence-based identification of normal chest radiographs: A simulation study in a multicenter health screening cohort. Korean J Radiol. 2022;23(10):1009-1018. doi: 10.3348/kjr.2022.0189</mixed-citation><mixed-citation xml:lang="en">Yoo H, Kim EY, Kim H, et al. Artificial intelligence-based identification of normal chest radiographs: A simulation study in a multicenter health screening cohort. Korean J Radiol. 2022;23(10):1009-1018. doi: 10.3348/kjr.2022.0189</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Bradley SH, Bhartia BS, Callister ME, et al. Chest X-ray sensitivity and lung cancer outcomes: A retrospective observational study. Br J Gen Pract. 2021;71(712):e862-e868. doi: 10.3399/BJGP.2020.1099</mixed-citation><mixed-citation xml:lang="en">Bradley SH, Bhartia BS, Callister ME, et al. Chest X-ray sensitivity and lung cancer outcomes: A retrospective observational study. Br J Gen Pract. 2021;71(712):e862-e868. doi: 10.3399/BJGP.2020.1099</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Ahn JS, Ebrahimian S, McDermott S, et al. Association of artificial intelligence-aided chest radiograph interpretation with reader performance and efficiency. JAMA Netw Open. 2022;5(8):e2229289. doi: 10.1001/jamanetworkopen.2022.29289</mixed-citation><mixed-citation xml:lang="en">Ahn JS, Ebrahimian S, McDermott S, et al. Association of artificial intelligence-aided chest radiograph interpretation with reader performance and efficiency. JAMA Netw Open. 2022;5(8):e2229289. doi: 10.1001/jamanetworkopen.2022.29289</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Codlin AJ, Dao TP, Vo LNQ, et al. Independent evaluation of 12 artificial intelligence solutions for the detection of tuberculosis. Sci Rep. 2021;11(1):23895. doi: 10.1038/s41598-021-03265-0</mixed-citation><mixed-citation xml:lang="en">Codlin AJ, Dao TP, Vo LNQ, et al. Independent evaluation of 12 artificial intelligence solutions for the detection of tuberculosis. Sci Rep. 2021;11(1):23895. doi: 10.1038/s41598-021-03265-0</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Abedalla A, Abdullah M, Al-Ayyoub M, Benkhelifa E. Chest X-ray pneumothorax segmentation using U-Net with EfficientNet and ResNet architectures. PeerJ Comput Sci. 2021;7:e607. doi: 10.7717/peerj-cs.607</mixed-citation><mixed-citation xml:lang="en">Abedalla A, Abdullah M, Al-Ayyoub M, Benkhelifa E. Chest X-ray pneumothorax segmentation using U-Net with EfficientNet and ResNet architectures. PeerJ Comput Sci. 2021;7:e607. doi: 10.7717/peerj-cs.607</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Albahli S, Nazir T. AI-CenterNet CXR: An artificial intelligence (AI) enabled system for localization and classification of chest X-ray disease. Front Med (Lausanne). 2022;9:955765. doi: 10.3389/fmed.2022.955765</mixed-citation><mixed-citation xml:lang="en">Albahli S, Nazir T. AI-CenterNet CXR: An artificial intelligence (AI) enabled system for localization and classification of chest X-ray disease. Front Med (Lausanne). 2022;9:955765. doi: 10.3389/fmed.2022.955765</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Harkness R, Hall G, Frangi AF, Ravikumar N, Zucker K. The pitfalls of using open data to develop deep learning solutions for COVID-19 detection in chest X-rays. Stud Health Technol Inform. 2022;290:679-683. doi: 10.3233/SHTI220164</mixed-citation><mixed-citation xml:lang="en">Harkness R, Hall G, Frangi AF, Ravikumar N, Zucker K. The pitfalls of using open data to develop deep learning solutions for COVID-19 detection in chest X-rays. Stud Health Technol Inform. 2022;290:679-683. doi: 10.3233/SHTI220164</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
