Evaluation of The Medical Board Exam in Portugal

Bibliographic Details
Main Author: Reis Marques*, Tiago
Publication Date: 2018
Other Authors: Laíns*, Inês, Martins, Maria João, Goiana-da-Silva, Francisco, Sampaio, Filipa, Pessanha, Inês, Fernandes, Diogo Hipólito, Brandão, Mariana, Pinto Teixeira, Pedro, Oliveira Santos, Manuel de, Silva, João Carlos, Ribeiro, João Carlos
Format: Article
Language: por
eng
Source: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
Download full: https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646
Summary: Introduction: There is a high heterogeneity in the structure of postgraduate medical training evaluation worldwide. However, in contrast to other countries, there have been no scientific studies of the final medical board examination, in Portugal. The present study aimed to evaluate the adequacy of the medical board examination including its validity as measured by its association with medical school grade average and national seriation examination.Material and Methods: Cross-sectional, observational study. We analyzed the final results on the medical board examination of 2439 physicians, across 47 specialties, who completed their training in 2016 and 2017, using measures of central tendency and variability. We assessed the association between these grades and the national exam to initiate residency, and the grade average in Medical School.Results: Measures of central tendency and variability, and consequent shape measures, revealed that the distribution of the scores of the final medical board exam is extremely negatively asymmetric and leptokurtic. A positive association was also found between the results in this exam and the score on national exam to initiate residency, and the grade average in Medical School.Conclusion: Although the medical board examination was, in general, positively associated with scores on the national exam to initiate residency, and the mean final Medical School grades, thus indicating its potential validity, our results demonstrate that this exam presents no satisfactory discriminative capacity. Therefore, there is room to improve the actual postgraduate medical examination model, including changes in its classification system and potentially consider other assessment models.
id RCAP_ad5ad5599a5a3f7c5d58b95056e10753
oai_identifier_str oai:ojs.www.actamedicaportuguesa.com:article/10646
network_acronym_str RCAP
network_name_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository_id_str https://opendoar.ac.uk/repository/7160
spelling Evaluation of The Medical Board Exam in PortugalAvaliação do Exame Final do Internato Médico em PortugalEducationMedicalGraduateEducational MeasurementInternship and ResidencyModelsEducationalSchoolsAvaliação EducacionalEducação Médica Pós-GraduadaEscolas MédicasInternato MédicoModelos EducacionaisIntroduction: There is a high heterogeneity in the structure of postgraduate medical training evaluation worldwide. However, in contrast to other countries, there have been no scientific studies of the final medical board examination, in Portugal. The present study aimed to evaluate the adequacy of the medical board examination including its validity as measured by its association with medical school grade average and national seriation examination.Material and Methods: Cross-sectional, observational study. We analyzed the final results on the medical board examination of 2439 physicians, across 47 specialties, who completed their training in 2016 and 2017, using measures of central tendency and variability. We assessed the association between these grades and the national exam to initiate residency, and the grade average in Medical School.Results: Measures of central tendency and variability, and consequent shape measures, revealed that the distribution of the scores of the final medical board exam is extremely negatively asymmetric and leptokurtic. A positive association was also found between the results in this exam and the score on national exam to initiate residency, and the grade average in Medical School.Conclusion: Although the medical board examination was, in general, positively associated with scores on the national exam to initiate residency, and the mean final Medical School grades, thus indicating its potential validity, our results demonstrate that this exam presents no satisfactory discriminative capacity. Therefore, there is room to improve the actual postgraduate medical examination model, including changes in its classification system and potentially consider other assessment models.Introdução: Existe uma elevada heterogeneidade na estrutura da avaliação da formação médica pós-graduada a nível mundial. No entanto, contrastando com outros países, não existem estudos científicos em Portugal que tenham avaliado o modelo da avaliação final da especialidade. O presente estudo pretendeu avaliar a adequação do exame do final da especialidade aos seus propósitos; aí incluída a sua validade enquanto consubstanciada na relação com a prova nacional de seriação e média final de curso de medicina.Material e Métodos: Estudo transversal, observacional. Foram analisadas com recurso a medidas de tendência central e variabilidade, as notas na avaliação final da especialidade de 2439 médicos, de 47 especialidades, que terminaram a sua formação em 2016 e 2017. Tendo em vista a sua validação cruzada, foram também avaliadas as correlações com a média final de curso e a nota na provanacional de seriação.Resultados: Das medidas de tendência central e variabilidade, e consequentes medidas de formato, resulta que a distribuição das pontuações do exame final de especialidade se apresenta com uma forma manifestamente assimétrica negativa e leptocúrtica. No geral, verificou-se a existência de uma associação positiva entre a avaliação final da especialidade e a média de curso e a prova nacional de seriação.Conclusão: Apesar de positivamente associado, no geral, com a média de curso e a prova nacional de seriação, o que indica a sua potencial validade, os resultados demonstram que a avaliação final de especialidade não apresenta uma capacidade discriminativa satisfatória. Deste modo, existe oportunidade para melhoria do modelo atual, nomeadamente através da alteração ao seu sistema de classificação e considerando outros modelos de exame.Ordem dos Médicos2018-11-30info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfapplication/pdfapplication/pdfapplication/pdfapplication/mswordapplication/mswordapplication/mswordapplication/pdfapplication/pdfapplication/pdfapplication/pdfhttps://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646oai:ojs.www.actamedicaportuguesa.com:article/10646Acta Médica Portuguesa; Vol. 31 No. 11 (2018): November; 670-679Acta Médica Portuguesa; Vol. 31 N.º 11 (2018): Novembro; 670-6791646-07580870-399Xreponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiainstacron:RCAAPporenghttps://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/5541https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/6062https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/5542https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/5543https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10226https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10227https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10228https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10229https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10436https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10847https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10873Direitos de Autor (c) 2018 Acta Médica Portuguesainfo:eu-repo/semantics/openAccessReis Marques*, TiagoLaíns*, InêsMartins, Maria JoãoGoiana-da-Silva, FranciscoSampaio, FilipaPessanha, InêsFernandes, Diogo HipólitoBrandão, MarianaPinto Teixeira, PedroOliveira Santos, Manuel deSilva, João CarlosRibeiro, João Carlos2022-12-20T11:06:02Zoai:ojs.www.actamedicaportuguesa.com:article/10646Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireinfo@rcaap.ptopendoar:https://opendoar.ac.uk/repository/71602025-05-28T10:41:18.120876Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologiafalse
dc.title.none.fl_str_mv Evaluation of The Medical Board Exam in Portugal
Avaliação do Exame Final do Internato Médico em Portugal
title Evaluation of The Medical Board Exam in Portugal
spellingShingle Evaluation of The Medical Board Exam in Portugal
Reis Marques*, Tiago
Education
Medical
Graduate
Educational Measurement
Internship and Residency
Models
Educational
Schools
Avaliação Educacional
Educação Médica Pós-Graduada
Escolas Médicas
Internato Médico
Modelos Educacionais
title_short Evaluation of The Medical Board Exam in Portugal
title_full Evaluation of The Medical Board Exam in Portugal
title_fullStr Evaluation of The Medical Board Exam in Portugal
title_full_unstemmed Evaluation of The Medical Board Exam in Portugal
title_sort Evaluation of The Medical Board Exam in Portugal
author Reis Marques*, Tiago
author_facet Reis Marques*, Tiago
Laíns*, Inês
Martins, Maria João
Goiana-da-Silva, Francisco
Sampaio, Filipa
Pessanha, Inês
Fernandes, Diogo Hipólito
Brandão, Mariana
Pinto Teixeira, Pedro
Oliveira Santos, Manuel de
Silva, João Carlos
Ribeiro, João Carlos
author_role author
author2 Laíns*, Inês
Martins, Maria João
Goiana-da-Silva, Francisco
Sampaio, Filipa
Pessanha, Inês
Fernandes, Diogo Hipólito
Brandão, Mariana
Pinto Teixeira, Pedro
Oliveira Santos, Manuel de
Silva, João Carlos
Ribeiro, João Carlos
author2_role author
author
author
author
author
author
author
author
author
author
author
dc.contributor.author.fl_str_mv Reis Marques*, Tiago
Laíns*, Inês
Martins, Maria João
Goiana-da-Silva, Francisco
Sampaio, Filipa
Pessanha, Inês
Fernandes, Diogo Hipólito
Brandão, Mariana
Pinto Teixeira, Pedro
Oliveira Santos, Manuel de
Silva, João Carlos
Ribeiro, João Carlos
dc.subject.por.fl_str_mv Education
Medical
Graduate
Educational Measurement
Internship and Residency
Models
Educational
Schools
Avaliação Educacional
Educação Médica Pós-Graduada
Escolas Médicas
Internato Médico
Modelos Educacionais
topic Education
Medical
Graduate
Educational Measurement
Internship and Residency
Models
Educational
Schools
Avaliação Educacional
Educação Médica Pós-Graduada
Escolas Médicas
Internato Médico
Modelos Educacionais
description Introduction: There is a high heterogeneity in the structure of postgraduate medical training evaluation worldwide. However, in contrast to other countries, there have been no scientific studies of the final medical board examination, in Portugal. The present study aimed to evaluate the adequacy of the medical board examination including its validity as measured by its association with medical school grade average and national seriation examination.Material and Methods: Cross-sectional, observational study. We analyzed the final results on the medical board examination of 2439 physicians, across 47 specialties, who completed their training in 2016 and 2017, using measures of central tendency and variability. We assessed the association between these grades and the national exam to initiate residency, and the grade average in Medical School.Results: Measures of central tendency and variability, and consequent shape measures, revealed that the distribution of the scores of the final medical board exam is extremely negatively asymmetric and leptokurtic. A positive association was also found between the results in this exam and the score on national exam to initiate residency, and the grade average in Medical School.Conclusion: Although the medical board examination was, in general, positively associated with scores on the national exam to initiate residency, and the mean final Medical School grades, thus indicating its potential validity, our results demonstrate that this exam presents no satisfactory discriminative capacity. Therefore, there is room to improve the actual postgraduate medical examination model, including changes in its classification system and potentially consider other assessment models.
publishDate 2018
dc.date.none.fl_str_mv 2018-11-30
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/article
format article
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646
oai:ojs.www.actamedicaportuguesa.com:article/10646
url https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646
identifier_str_mv oai:ojs.www.actamedicaportuguesa.com:article/10646
dc.language.iso.fl_str_mv por
eng
language por
eng
dc.relation.none.fl_str_mv https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/5541
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/6062
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/5542
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/5543
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10226
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10227
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10228
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10229
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10436
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10847
https://www.actamedicaportuguesa.com/revista/index.php/amp/article/view/10646/10873
dc.rights.driver.fl_str_mv Direitos de Autor (c) 2018 Acta Médica Portuguesa
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Direitos de Autor (c) 2018 Acta Médica Portuguesa
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
application/pdf
application/pdf
application/msword
application/msword
application/msword
application/pdf
application/pdf
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Ordem dos Médicos
publisher.none.fl_str_mv Ordem dos Médicos
dc.source.none.fl_str_mv Acta Médica Portuguesa; Vol. 31 No. 11 (2018): November; 670-679
Acta Médica Portuguesa; Vol. 31 N.º 11 (2018): Novembro; 670-679
1646-0758
0870-399X
reponame:Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
instname:FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron:RCAAP
instname_str FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
instacron_str RCAAP
institution RCAAP
reponame_str Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
collection Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
repository.name.fl_str_mv Repositórios Científicos de Acesso Aberto de Portugal (RCAAP) - FCCN, serviços digitais da FCT – Fundação para a Ciência e a Tecnologia
repository.mail.fl_str_mv info@rcaap.pt
_version_ 1833591126236332032