TshFNA-Examiner:A Nuclei Segmentation and Cancer Assessment Framework for Thyroid Cytology Image  

作　　者：KE Jing ZHU Junchao YANG Xin ZHANG Haolin SUN Yuxiang WANG Jiayi LU Yizhou SHEN Yiqing LIU Sheng JIANG Fusong HUANG Qin 柯晶;朱俊超;杨鑫;张浩林;孙宇翔;王嘉怡;鲁亦舟;沈逸卿;刘晟;蒋伏松;黄琴

机构地区：[1]School of Electronic Information and Electrical Engineering,Shanghai Jiao Tong University,Shanghai 200240,China [2]School of Life Sciences and Biotechnology,Shanghai Jiao Tong University,Shanghai 200240,China [3]School of Engineering,Shanghai Ocean University,Shanghai 201306,China [4]Shanghai Advanced Research Institute,Chinese Academy of Sciences,Shanghai 201210,China [5]Department of Computer Science,Johns Hopkins University,Baltimore 21218,USA [6]Department of Thyroid Breast and Vascular Surgery,Shanghai Fourth People’s Hospital,Shanghai 200434,China [7]Department of Endocrinology and Metabolism,Shanghai Sixth People’s Hospital,Shanghai 200233,China [8]Department of Pathology,Shanghai Sixth People’s Hospital,Shanghai 200233,China

出　　处：《Journal of Shanghai Jiaotong university(Science)》2024年第6期945-957,共13页上海交通大学学报(英文版)

基　　金：the National Natural Science Foundation of China(No.62102247);the Natural Science Foundation of Shanghai(No.23ZR1430700)。

摘　　要：Examining thyroid fine-needle aspiration(FNA)can grade cancer risks,derive prognostic information,and guide follow-up care or surgery.The digitization of biopsy and deep learning techniques has recently enabled computational pathology.However,there is still lack of systematic diagnostic system for the complicated gigapixel cytopathology images,which can match physician-level basic perception.In this study,we design a deep learning framework,thyroid segmentation and hierarchy fine-needle aspiration(TshFNA)-Examiner to quantitatively profile the cancer risk of a thyroid FNA image.In the TshFNA-Examiner,cellular-intensive areas strongly correlated with diagnostic medical information are detected by a nuclei segmentation neural network;cell-level image patches are catalogued following The Bethesda System for Reporting Thyroid Cytopathology(TBSRTC)system,by a classification neural network which is further enhanced by leveraging unlabeled data.A cohort of 333 thyroid FNA cases collected from 2019 to 2022 from I to VI is studied,with pixel-wise and image-wise image patches annotated.Empirically,TshFNA-Examiner is evaluated with comprehensive metrics and multiple tasks to demonstrate its superiority to state-of-the-art deep learning approaches.The average performance of cellular area segmentation achieves a Dice of 0.931 and Jaccard index of 0.871.The cancer risk classifier achieves a macro-F1-score of 0.959,macro-AUC of 0.998,and accuracy of 0.959 following TBSRTC.The corresponding metrics can be enhanced to a macro-F1-score of 0.970,macro-AUC of 0.999,and accuracy of 0.970 by leveraging informative unlabeled data.In clinical practice,TshFNA-Examiner can help cytologists to visualize the output of deep learning networks in a convenient way to facilitate making the final decision.

关 键 词：thyroid fine-needle aspiration(FNA)cytology The Bethesda System for Reporting Thyroid Cytopathology(TBSRTC) diagnostic system nuclei segmentation cancer risk classification 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] R36[自动化与计算机技术—控制科学与工程]