Can ChatGPT support clinical coding using the ICD-10-CM/PCS?
| Autor(a) principal: | |
|---|---|
| Data de Publicação: | 2024 |
| Outros Autores: | , , , |
| Tipo de documento: | Artigo |
| Idioma: | eng |
| Título da fonte: | Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| Texto Completo: | http://hdl.handle.net/10362/176965 |
Resumo: | Publisher Copyright: © 2024 by the authors. |
| id |
RCAP_93f3556c6946234f8a9e593cafa3d6b8 |
|---|---|
| oai_identifier_str |
oai:run.unl.pt:10362/176965 |
| network_acronym_str |
RCAP |
| network_name_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| repository_id_str |
https://opendoar.ac.uk/repository/7160 |
| spelling |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS?artificial intelligenceChatGPTclinical codingICD-10-CM/PCSCommunicationHuman-Computer InteractionComputer Networks and CommunicationsSDG 3 - Good Health and Well-beingPublisher Copyright: © 2024 by the authors.Introduction: With the growing development and adoption of artificial intelligence in healthcare and across other sectors of society, various user-friendly and engaging tools to support research have emerged, such as chatbots, notably ChatGPT. Objective: To investigate the performance of ChatGPT as an assistant to medical coders using the ICD-10-CM/PCS. Methodology: We conducted a prospective exploratory study between 2023 and 2024 over 6 months. A total of 150 clinical cases coded using the ICD-10-CM/PCS, extracted from technical coding books, were systematically randomized. All cases were translated into Portuguese (the native language of the authors) and English (the native language of the ICD-10-CM/PCS). These clinical cases varied in complexity levels regarding the quantity of diagnoses and procedures, as well as the nature of the clinical information. Each case was input into the 2023 ChatGPT free version. The coding obtained from ChatGPT was analyzed by a senior medical auditor/coder and compared with the expected results. Results: Regarding the correct codes, ChatGPT’s performance was higher by approximately 29 percentage points between diagnoses and procedures, with greater proficiency in diagnostic codes. The accuracy rate for codes was similar across languages, with rates of 31.0% and 31.9%. The error rate in procedure codes was substantially higher than that in diagnostic codes by almost four times. For missing information, a higher incidence was observed in diagnoses compared to procedures of slightly more than double the comparative rates. Additionally, there was a statistically significant excess of codes not related to clinical information, which was higher in procedures and nearly the same value in both languages under study. Conclusion: Given the ease of access to these tools, this investigation serves as an awareness factor, demonstrating that ChatGPT can assist the medical coder in directed research. However, it does not replace their technical validation in this process. Therefore, further developments of this tool are necessary to increase the quality and reliability of the results.NOVA Medical School|Faculdade de Ciências Médicas (NMS|FCM)Escola Nacional de Saúde Pública (ENSP)RUNNascimento Teixeira, BernardoLeitão, AnaNascimento, GenerosaCampos-Fernandes, AdalbertoCercas, Francisco2025-01-02T21:26:06Z2024-122024-12-01T00:00:00Zinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10362/176965eng2227-9709PURE: 105562712https://doi.org/10.3390/informatics11040084info:eu-repo/semantics/openAccessreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAP2025-01-06T01:34:53Zoai:run.unl.pt:10362/176965Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T19:27:39.661649Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse |
| dc.title.none.fl_str_mv |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? |
| title |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? |
| spellingShingle |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? Nascimento Teixeira, Bernardo artificial intelligence ChatGPT clinical coding ICD-10-CM/PCS Communication Human-Computer Interaction Computer Networks and Communications SDG 3 - Good Health and Well-being |
| title_short |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? |
| title_full |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? |
| title_fullStr |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? |
| title_full_unstemmed |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? |
| title_sort |
Can ChatGPT support clinical coding using the ICD-10-CM/PCS? |
| author |
Nascimento Teixeira, Bernardo |
| author_facet |
Nascimento Teixeira, Bernardo Leitão, Ana Nascimento, Generosa Campos-Fernandes, Adalberto Cercas, Francisco |
| author_role |
author |
| author2 |
Leitão, Ana Nascimento, Generosa Campos-Fernandes, Adalberto Cercas, Francisco |
| author2_role |
author author author author |
| dc.contributor.none.fl_str_mv |
NOVA Medical School|Faculdade de Ciências Médicas (NMS|FCM) Escola Nacional de Saúde Pública (ENSP) RUN |
| dc.contributor.author.fl_str_mv |
Nascimento Teixeira, Bernardo Leitão, Ana Nascimento, Generosa Campos-Fernandes, Adalberto Cercas, Francisco |
| dc.subject.por.fl_str_mv |
artificial intelligence ChatGPT clinical coding ICD-10-CM/PCS Communication Human-Computer Interaction Computer Networks and Communications SDG 3 - Good Health and Well-being |
| topic |
artificial intelligence ChatGPT clinical coding ICD-10-CM/PCS Communication Human-Computer Interaction Computer Networks and Communications SDG 3 - Good Health and Well-being |
| description |
Publisher Copyright: © 2024 by the authors. |
| publishDate |
2024 |
| dc.date.none.fl_str_mv |
2024-12 2024-12-01T00:00:00Z 2025-01-02T21:26:06Z |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10362/176965 |
| url |
http://hdl.handle.net/10362/176965 |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
2227-9709 PURE: 105562712 https://doi.org/10.3390/informatics11040084 |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.source.none.fl_str_mv |
reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia instacron:RCAAP |
| instname_str |
FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
| instacron_str |
RCAAP |
| institution |
RCAAP |
| reponame_str |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| collection |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) |
| repository.name.fl_str_mv |
Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia |
| repository.mail.fl_str_mv |
info@rcaap.pt |
| _version_ |
1833598111735349248 |