A New Methodology For Comparison Of Three-Test Exam Techniques In Medical Students


Nayer Rassaian 1 , *

1 Professor of Physiology, Shaheed Beheshti University of Medical Sciences and Health Services.

How to Cite: Rassaian N. A New Methodology For Comparison Of Three-Test Exam Techniques In Medical Students, J Med Edu. 2004 ; 5(1):e105084. doi: 10.22037/jme.v5i1.814.


Journal of Medical Education: 5 (1); e105084
Published Online: March 09, 2009
Article Type: Research Article
Received: March 08, 2009
Accepted: March 09, 2009


Background: In studies on validities of different methods for student assessment, each technique has been independently evaluated, but literature confirms the use of combination of different methods of assessment.Objectives: Searching for negative and positive aspects of assessment tools, and introducing the more preferable technique.Methods: In this descriptive-analytical research, 1372 medical students were tested using three types of questions; short-answer, multiple-choice, and true-false, so that the result of each method can be compared with those of the other two for each student. Nine classes from different curricula were randomly selected and in each of them, 30 questions for 10 selected topics (total 270), were distributed.Results: The students' score analysis after excluding questions with a discrimination index of less than 0.3, showed that the most valid assessment tool was the short-answer questions (r0.685). The kappa coefficients of the shortanswer method and the other two were in the "fair" range of agreement. The highest coefficient of contingency is between the multiple-choice and true-false questions (0.402). The percentage of correct answers is the lowest in short-answer questions (53%), and the highest in true-false questions (65%). The higher percentage of incorrect answers in multiple-choice (32%) compared with the true-false (26%) questions can be the result of the students being confronted with alternative choices in multiple-choice question, which apparently encourages them to chooseone without using the relevant knowledge.Conclusion: It is recommended to use short-answer and true-false questions as the main components of examination, instead of multiple-choice question alone, so that student's learning and recall would be tested and students would not be misled.


The body of the article can be found in the PDF file.


  • 1.

    References are available in the PDF file

  • © 2004, Journal of Medical Education. This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (http://creativecommons.org/licenses/by-nc/4.0/) which permits copy and redistribute the material just in noncommercial usages, provided the original work is properly cited.