To the content
Спецвыпуск . 2022

GUIDE ON DEVELOPING MULTIPLE CHOICE QUESTIONS (MCQS) FOR HIGH STAKES CLINICAL EXAMS

Abstract

The goal of this guide is to help faculty members, authors and everyone engaged in developing exams for medical specialists, whose aim is the reliable and valid assessment. This guide contains recommendations, their clarification, examples and most common flaws, and they may help novice authors to develop Multiple Choice Questions. We hope that this guide will be useful training aid for every medical teacher.

Keywords:MCQ; clinical vignette; assessment; validity; reliability; competency

Funding. The study had no sponsor support.

Conflict of interest. The authors declare no conflict of interest.

For citation: Balkizov Z.Z., Alekseeva A.Yu., Ashkhotov E.R., Khadzugov A.B., Stupin V.A. Guide on developing Multiple Choice Questions (MCQs) for high stakes clinical exams. Meditsinskoe obrazovanie i professional’noe razvitie [Medical Education and Professional Development]. 2022; 13 (2): 34–47. DOI: https://doi.org/10.33029/2220-8453-2022-13-2-34-47 (in Russian)

ЛИТЕРАТУРА

1. Harden R.M., Stevenson M., Downie W.W., Wilson G.M. Assessment of clinical competence using objective structured examination // BMJ. 1975. Vol. 1. P. 447-451.

2. Harden R.M. What is an OSCE? // Med. Teach. 1988. Vol. 10. P. 19-23.

3. Harden R.M. How to assess clinical competence - an overview // Med. Teach. 1979. Vol. 1. P. 289-296.

4. Harden R.M., Cairncross R.G. Assessment of practical skills: the objective structured practical examination (OSPE) // Studies High Educ. 1980. Vol. 5. P. 187-196.

5. Harden R.M., Stevenson M., Downie W.W., Wilson G.M. Assessment of clinical competence using objective structured examination // BMJ. 1975. Vol. 1. P. 447-451.

6. Khan K., Ramachandran S. Conceptual framework for performance assessment: competency, competence and performance in the context of assessments in healthcare - deciphering the terminology // Med. Teach. 2012. Vol. 34. P. 920-928.

7. Norcini J., Anderson B., Bollela V. et al. Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference.

8. Harden R.M., Gleeson F.A., Assessment of clinical competence using an objective structured clinical examination (OSCE) // ASME Medical education booklet No. 8

9. Miller G.E. The assessment of clinical skills/competence/performance // Acad. Med. 1990. Vol. 65. S63-S67.

10. Norcini J.J. Death of a long case // BMJ. 2002. Vol. 324. P. 408-409.

11. Norcini J.J., Mckinley D.W. Assessment methods in medical education // Teaching Teach. Educ. 2007. Vol. 23. P. 239-250.

12. Swanson D.B., Norman G.R., Linn R.L. Performance-based assessment: lessons from the health professions // Educ. Res. 1995. Vol. 24. P. 5-11

13. Patricio M. A best evidence medical education (BEME) review on the feasibility, reliability and validity of the objective structured clinical examination (OSCE) in undergraduate medical studies // PhD dissertation. Faculty of Medicine of the University of Lisbon, Portugal. http://hdl.handle.net/10451/7600 - (2012).

14. Schoonheim-Klein, M. The use of the objective structured clinical examination (OSCE) in dental education // Thesis: Academic Centre for Dentistry Amsterdam (ACTA), The Netherlands - 2008.

15. Pell G., Fuller R., Homer M., Roberts T. How to measure the quality of the OSCE: a review of metrics. AMEE guide No. 49. // Med Teach. 2010. Vol. 32 (Iss.10). P. 802-811.

16. Tavakol M., Dennick R. Post-examination analysis of objective tests. AMEE guide No. 54. // Med Teach. 2011.Vol. 33 (Iss. 6). P. 447-458.

17. Tavakol M., Dennick R. Post-examination interpretation of objective test data: monitoring and improving the quality of high-stakes examinations: AMEE Guide No. 66. // Med Teach. 2012. Vol. 34 (Iss. 3). e161-e175.

18. Кан К.З., Рамачандран С., Гонт К., Пушкар П. Объективный структурированный клинический экзамен (ОСКЭ): Руководство АМЕЕ № 81. Часть 1: Историческая и теоретическая перспективы (под ред. З.З. Балкизова и Т.В. Семеновой) // Мед. образование и проф. развитие. 2014. № 2. С. 23-40.

19. Кан К.З., Рамачандран С., Гонт К., Пушкар П. Руководство AMEE № 81: Объективный структуриро­ванный клинический экзамен (ОСКЭ). Часть 2. Организация и управление (под ред. З.З. Балкизова и Т.В. Семеновой) // Мед. образование и проф. развитие. 2014. № 3. С. 18-53.

20. Adamo G. Simulated and standardized patients in OSCE s: Achievements and challenges 1992-2003 // Med. Teach. 2003. Vol. 25. P. 262-270.

21. Cleland J.A., Abe K., Rethans J.-J. The use of simulated patients in medical education: AMEE Guide No 42 // Med. Teach. 2009. Vol. 31. P. 477-486.

22. Kaufman D.M., Mann K.V., Muijtjens A.M. et al. A comparison of standard-setting procedures for an ОSCE in undergraduate medical education // Acad. Med. 2000. Vol. 75. P. 267-271.

23. Kowlowitz V., Hoole A.J., Sloane P.D. Implementing the objective structured clinical examination in a traditional medical school // Acad. Med. 1991. Vol. 66. P. 345-347.

24. Kramer A., Muijtjens A., Jansen K. et al. Comparison of a rational and an empirical standard setting procedure for an ОSCE. Objective structured clinical examinations // Med. Educ. 2003. Vol. 37. P. 132-139.

25. TOOLBOX OF ASSESSMENT METHODS© Accreditation Council for Graduate Medical Education, American Board of Medical Specialties (ABMS) // 2000.

26. Балкизов З.З., Семенова Т.В. Объективный структурированный клинический экзамен. Руководство // Мед. образование и проф. развитие. 2016. № 3. С. 27-63.

All articles in our journal are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0 license)

CHIEF EDITOR
CHIEF EDITOR
Balkizov Zalim Zamirovich
Secretary General of the Russian Society of Medical Education Specialists, Director of the Institute of Training of Medical Education Specialists of the Russian Medical Academy of Continuing Professional Education, 125993, Moscow, Russian Federation, Professor of the Department of Vocational Education and Educational Technologies of the N.I. Pirogov RNIMU of the MOH of Russia, CEO of GEOTAR-Med, Advisor President of the National Medical Chamber, Moscow, Russian Federation

Journals of «GEOTAR-Media»