GUIDE ON ASSESSMENT PLANNING. EXAM BLUEPRINTING

• Zalim Z. Balkizov
• Aleksandra Yu. Alekseeva
• Elberd R. Ashkhotov
• Viktor A. Stupin
• Tatyana V. Semenova

Abstract

Assessment is an important component of learning, its content determines what is most important in the curriculum and guides learning. For the successful implementation of any assessment activities, whether it is a current (formative) assessment or a final one, an exam, it is necessary to carefully plan it, consistently going through several stages.

With the knowledge of this guide, you will be able to master the first four stages of exam planning. As a result, the blueprint, or examination scheme, is being designed. The blueprint is a tabular specification that reflects the content and assessment tools that depend on the objectives, as well as weighting to determine the share of different topics and assessment domains in the exam.

The blueprint allows one to adequately evaluate the course content, to reflect the main goals and objectives of the course, to include the right material that needs to be studied, to determine the appropriate formats for knowledge, skills, and professionalism being assessed.

Blueprint can be used not only to build an exam, but also for other purposes. It informs students about the most important topics in the program and serves as a compass for them, facilitates learning by providing students with a framework or course outline, and conveys expectations from the training course to all stakeholders (students, other faculty members, and administration).

Keywords:assessment; knowledge; skills; attitudes; exam blueprint; medical education

References

1.ACGME Outcomes Project & ABMS. Toolbox of assessment methods. Chicago, IL: Accreditation Council for Graduate Medical Education and American Board of Medical Specialties. 2000.

2.Al-Eraky M., Marei H. A fresh look at Miller’s pyramid: assessment at the ‘is’ and ‘do’ levels. Meditsinskoe obrazovanie i professional’noe razvitie [Medical education and professional development]. 2020; 11 (2): 118–26. (in Russian)

3.Anderson T., Dron J. Learning technology through three generations of technology enhanced distance learning pedagogy. 2012. Translation from Spanish at http://www.eurodl.org/materials/contrib/2012/Anderson_Dron.pdf

4.Bloom B.S., Engelhart M.D., Furst E.J., Hill W.H., Krathwohl D.R. (Eds.). Taxonomy of educational objectives – the classification of educational goals. Handbook 1: Cognitive Domain. London, WI: Longmans, Green & Co. Ltd, 1956.

5.Boulet J.R., Gimpel J.R. Errichetti A.M., Meoli F.G. Using national medical care survey data to validate examination // Journal of the American Osteopathic Association. 2003; 103 (5): 225–31.

6.Downing & T.M. Haladyna (Eds.). Handbook of Test Development. Mahwah, NJ: Lawrence Erlbaum Associates. P. 181–223.

7.Downing S M., Yudkowsky R. Assessment in health professions education. New York, NY: Routledge, 2009.

8.Hamdy H. Blueprinting for the assessment of health care professionals. The clinical teacher 2006; (3): 175–9. URL: http://eppicinc.files.wordpress.com/2011/08/sugrue_bloom_critique_perfxprs.pdf

9.Krathwohl D.R., Bloom B.S., Masia B.B. Taxonomy of educational objectives, the classification of educational goals. Handbook II: Affective Domain. New York, David McKay Co., Inc., 1973.

10. Mark R. Raymond. Establishing weights for test plans for licensure and certification examinations. Applied measurement in education. 1996; 9 (3): 237–56. DOI: https://doi.org/10.1207/s15324818ame0903_3

11. Miller G.E. The assessment of clinical skills/performance. Academic Medicine (Supplement). 1990; 65: S 63–S 70.

12. Moore D.S. Reconsidering Bloom’s Taxonomy of educational objectives, Cognitive domain. Educational Theory.1982; 32 (1): 29–34.

13. Raymond M.R., Neustel S.N. Determining the content of credentialing examinations. Handbook of Test Development. In S. M, 2006. 44 p.

14. Raymond M.R. Job analysis and the specification of content for licensure and certification examinations. Applied Measurement in Education. 2001; 14: 369–415.

15. Raymond M., Grande J. A practical guide to test blueprinting. Medical Teacher. 2019; 41: 1–8. DOI: https://doi.org/10.1080/0142159X.2019.1595556

16. Representation of the “Miller´s Pyramid”, extracted from Wass V., van der Vleuten C., Shatzer J., Jones R. Assessment of clinical competence. Lancet. 2001; 357: 945–9.

17. Sugrue B. Problems with Bloom’s taxonomy, 2002.

18. Coderre S., Woloschuk W., McLaughlin K. Dr. Twelve tips for blueprinting. Medical Teacher. 2009; 31 (4): 322–4. DOI: https://doi.org/10.1080/01421590802225770

19. Test Blueprinting II: Creating a Test Blueprint, NBME, 2019.

20. Van Der Vleuten C.P.M. The assessment of professional competence: Developments, research and practical implications. Adv Health Sci Educ 1. 1966: 41–67. DOI: https://doi.org/10.1007/BF00596229

21. Van Luijk S.J., Van der Vleuten C.P.M. A comparison of checklists and rating scales in performance-based testing. Current developments in assessing clinical competence. Montreal: Can Health Publications. 1992: 357–82.

22. Wass V., van der Vleuten C., Shatzer J. Jones R. Assessment of clinical competence. Lancet. 2001; 357: 945–9.

23. Alekseeva A. Yu., Balkizov Z.Z., Perelman V., Semenova T.V., Sizova Zh.M. Objective structured clinical examination as a tool for accreditation of medical specialists. Meditsinskoe obrazovanie i professional’noe razvitie [Medical education and professional development]. 2018; (1): 15–18. (in Russian)

24. Balkizov Z.Z., Alekseeva A. Yu., Ashkhotov E.R., Khadzugov A.B., Stupin V.A. Guide on developing Multiple Choice Questions (MCQs) for high stakes clinical exams. Meditsinskoe obrazovanie i professional’noe razvitie [Medical Education and Professional Development]. 2022; 13 (2): 34-47. DOI: https://doi.org/10.33029/2220-8453-2022-13-2-34-47 (in Russian)

All articles in our journal are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0 license)