透過您的圖書館登入
IP:3.238.79.169
  • 期刊

整合疾病階層關係輔助資料量不平均之診斷文字理解

Leveraging Hierarchical Category Knowledge for Data-Imbalanced Diagnosis Text Understanding

摘要


電子病歷中記錄了病人相關的症狀描述、看診的歷史紀錄等文字資料,每一筆紀錄都有其對應的診斷代碼,代表著該次就醫時醫師所下的診斷結果及其治療方案等資訊。此研究期望利用機器學習人工智慧之技術,建立一套自動標記代碼之系統,藉由閱讀醫師所寫下之文字資訊,自動產生對應之代碼。然而,需要考慮的代碼數量有上千個,有些代碼出現次數頻繁,有些代碼較罕見,在機器學習技術中,少見的代碼所對應的資料量也較為不足,而這些不平均的資料會造成標註成效不佳。故此研究另外利用專家在診斷代碼上建造之階層關係,進一步改善資料量不足之代碼之辨識效能。為了能讓模型有效利用診斷代碼的階層關係這類額外的專家知識,我們提出了各種不同的方式去計算卷積神經網路的損失函數以此來取得同一種類別的診斷中所共享的語義資訊。這樣的資訊不只讓模型有額外的醫學知識作為學習方向,也幫助解決訓練資料中樣本數量不平衡的問題。根據我們做在MIMIC3這份國際通用的資料集的結果顯示,我們提出的方法確實能夠有效利用階層種類的知識並提供模型有意義的資訊來幫助改善現階段最好的預測結果。而這樣的討論與研究也顯示了結合額外的專家知識於機器學習的模型中是有一定的好處與重要性,能啟發未來更多的研究方向。

並列摘要


Clinical notes are essential medical documents to record each patient's symptoms. Each record is typically annotated with medical diagnostic codes, which means diagnosis and treatment. This paper focuses on predicting diagnostic codes given the descriptive present illness in electronic health records by leveraging domain knowledge. We investigate various losses in a convolutional model to utilize hierarchical category knowledge of diagnostic codes in order to allow the model to share semantics across different labels under the same category. The proposed model not only considers the external domain knowledge but also addresses the issue about data imbalance. The MIMIC3 benchmark experiments show that the proposed methods can effectively utilize category knowledge and provide informative cues to improve the performance in terms of the top-ranked diagnostic codes which is better than the prior state-of-the-art. The investigation and discussion express the potential of integrating the domain knowledge in the current machine learning based models and guiding future research directions.

參考文獻


James Mullenbach, Sarah Wiegreffe, Jon Duke, et al: 2018. Explainable pre- diction of medical codes from clinical text. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies 2018;1:1101-11. doi: 10.18653/v1/N18-1100
Alistair EW Johnson, Tom J Pollard, Lu Shen, et al: Mimic-iii, a freely accessible critical care database. Scientific Data 2016;3:160035. doi: 10.1038/sdata.2016.35
Gaurav Singh, James Thomas, Iain Marshall, et al: Structured multi-label biomedical text tagging via attentive neural tree decoding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2018;2837-42. doi: 10.18653/v1/D18-1308
Yoon Kim: Convolutional neural networks for sentence classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2014;1746-51. doi: 10.3115/v1/D14-1181
Edward Choi, Mohammad Taha Bahadori, Andy Schuetz, et al: Doctor ai: Predicting clinical events via recurrent neural networks. In Machine Learning for Health- care Conference, PMLR 2016;56:301-18.

延伸閱讀