Home Print this page Email this page Small font sizeDefault font sizeIncrease font size
Users Online: 7991

 

Home About us Editorial board Search Ahead of print Current issue Archives Submit article Instructions Subscribe Advertise Contacts Login 
     

  Table of Contents  
ORIGINAL ARTICLE
Year : 2013  |  Volume : 54  |  Issue : 5  |  Page : 302-305  

The impact of various assessment parameters on medical students' performance in first professional examination in physiolog


1 Department of Physiology, Benue State University, Makurdi, Nigeria
2 Department of Ophthalmology, Benue State University, Makurdi, Nigeria
3 Department of Human Kinetics, and Health Education, Benue State University, Makurdi, Nigeria

Date of Web Publication28-Nov-2013

Correspondence Address:
Olasupo Stephen Adeniyi
Department of Physiology, College of Health Sciences, P. M. B. 102119, Benue State University, Makurdi
Nigeria
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/0300-1652.122330

Rights and Permissions
   Abstract 

Background: This study was carried out to assess the relationship between thevarious assessment parameters, viz. continuous assessment (CA), multiple choice questions (MCQ), essay, practical, oral with the overall performance in the first professional examination in Physiology. Materials and Methods: The results of all 244 students that sat for the examination over 4 years were used. The CA, MCQ, essay, practical, oral and overall performance scores were obtained. All the scores were rounded up to 100% to give each parameter equal weighting. Results: Analysis showed that the average overall performance was 50.8 ± 5.3. The best average performance was in practical (55.5 ± 9.1), while the least was in MCQ (44.1 ± 7.8). In the study, 81.1% of students passed orals, 80.3% passed practical, 72.5% passed CA, 58.6% passed essay, 22.5% passed MCQ and 71.7% of students passed on the overall performance. All assessment parameters significantly correlated with overall performance. Continuous assessment had the best correlation (r = 0.801, P = 0.000), while oral had the least correlation (r = 0.277, P = 0.000) with overall performance. Essay was the best predictor of overall performance (β = 0.421, P = 000), followed by MCQ (β = 0.356, P = 000), while practical was the least predictor of performance (β = 0.162, P = 000). Conclusion: We suggest that the department should uphold the principle of continuous assessment and more effort be made in the design of MCQ so that performance can improve.

Keywords: Continuous assessment, essay, examination, MCQ, oral, practical


How to cite this article:
Adeniyi OS, Ogli SA, Ojabo CO, Musa DI. The impact of various assessment parameters on medical students' performance in first professional examination in physiolog. Niger Med J 2013;54:302-5

How to cite this URL:
Adeniyi OS, Ogli SA, Ojabo CO, Musa DI. The impact of various assessment parameters on medical students' performance in first professional examination in physiolog. Niger Med J [serial online] 2013 [cited 2024 Mar 28];54:302-5. Available from: https://www.nigeriamedj.com/text.asp?2013/54/5/302/122330


   Introduction Top


Assessments are educational tools that help teachers evaluate students, serve to motivate and help students structure their academic efforts and helps a teacher understand how successfully he is presenting the material. [1],[2] In the medical school, multiple-choice questions (MCQs), [3],[4],[5] essays, [5],[6] viva, [5],[7] practical and continuous assessment (CA) [5],[8] are used to assess students performance.

Haven conducted first professional Bachelor of Medicine (MBBS) examination at Benue State University, Makurdi, to students for five consecutive sessions; we decided to investigate the relationship of the assessment parameters, viz. continuous assessment, MCQ, essay, practical and oral with the students' overall performance in Physiology at the First professional MBBS examination.


   Materials and Methods Top


The examination record of all students from five sets of students that had sat for the first professional MBBS examination in Physiology between 2008-2009 session and 2011-2012 session (within 4 years) was used. The dates of examination and the total number of students that sat for each examination are shown in [Table 1]. This included students that passed, re-sat the examinations and those advised to withdraw. The study was approved by Ethics Committee, Benue State University. Confidentiality was maintained, as there was no disclosure of the names of the students from whom the data were derived.
Table 1: Type of physiology examination and the number of candidates that sat for the examinations


Click here to view


The Faculty presently adopts a scoring system in which continuous assessment contributes 30, MCQ-25, Essay-25, practical-10 and orals-10, all adding up to 100% at the final MBBS examination. However, to obtain equal weighting for all the assessment parameters of the final score, all the parameters were made up to 100 as follows:

Continuous assessment: 30 × 3.33 = 100

Essay: 25 × 4 = 100

MCQ: 25 × 4 = 100

Practical: 10 × 10 = 100

Oral: 10 × 10 = 100

In College of Health Sciences, Benue State University, total score of <50% is regarded as fail, score between 50% and 69% is considered as pass, while scores >70% is regarded as distinction.

Statistical analysis

Data were analysed using Statistical Package for Social Sciences (SPSS), version 17, values were expressed as mean ± SD. Percentages were calculated. Pearson's correlation coefficient (r) was calculated to determine the correlation between continuous assessment, essay, MCQ, practical, orals and the final score in Physiology examination. Standard multiple regression model was used to determine the best predictor of overall performance. The level of significance was taken to be P < 0.05.


   Results Top


Results of the 244 students that sat for Physiology examination are presented in [Table 2]. As shown in the Table, the best average performance was in practical (55.5%), while the average worst performance was in MCQ (44.1%). With the exception of the MCQ, students generally passed all component of the examination.
Table 2: Descriptive score of assessment parameters in the first professional MBBS examination in physiology


Click here to view


The assessment parameter with the highest percentage number of student that passed was oral examination where 81.1% (n = 198) passed and 18.9% (n = 4) failed, followed by practical examination, where 80.3% (n = 196) passed and 19.7% (n = 48) failed. The highest percentage fail was recorded in MCQ where 77.5% (n = 189) failed and 22.5% (n = 55) passed as shown in [Figure 1].
Figure 1

Click here to view


All parameters of examination significantly correlated with the overall performance score [Table 3], with the CA having the highest correlation with the total performance (r = 0.801), followed by essay (r = 0.755), then MCQ (r = 677). The parameter with the least correlation was oral examination (r = 0.277) [Table 2].
Table 3: Correlation between assessment parameters in physiology examination and the overall performance


Click here to view


In order to determine whether the independent variables were independently associated with overall performance, standard multiple regression analysis was conducted and the result showed that the independent variables could explain 97.3% of the variation in the overall performance score (R[2] = 0.973). Result showed that essay was the best predictor of performance in Physiology examination (β = 0.421, P = 000), followed by MCQ (β = 0.356, P = 000). The least predictor of overall performance was practical examination (β = 0.162, P = 000) as shown in [Table 4].
Table 4: Predictor of performance in the first professional MBBS examination in physiology


Click here to view



   Discussion Top


In College Of Health Science, Benue State University, external examiners are used for assessing orals rather than internal examiners. This removes the lack of objectivity that may arise from the teachers' prior knowledge of the students. This study showed that oral examination has the highest number of students' pass than any other component of assessment. This is similar to the report of Dakum et al., in a study carried out on final year medical students at the University of Jos. [5] However, oral examination had the least correlation with the overall performance of the students. This is also in agreement with the report of Torke et al. [9] It has been demonstrated that orals have low reliability as assessments of clinical competence; when the marks awarded to candidates by different examiners are compared there is low reliability between the marks. Some examiners tend to mark generously and some have a tendency to award low marks. [7],[10] There is also evidence that the low reliability is due to content specificity, reflecting the fact that competence is related to the case or topic covered in the oral. Studies indicated that the mark awarded to a candidate may reflect factors other than the candidate's competence; namely anxiety, percentage of words contributed to the discussion by the candidate, the examiner's visual impressions of the candidate or the candidate's self-confidence. [11],[12]

This study also showed that highest rate of failure was recorded in MCQ, and that more students passed essay question than MCQ. This is similar to the study of Dakum et al. [5] However, this is contrary to the report of Oyebola

et al., [13] and Pepple et al., [14] where students performed better in MCQ than in essay. The higher rate of failure in MCQ in this group might be due to the fundamental pattern associated with MCQ, that is, negative marking associated with wrong answer provided. [5] It might also be because MCQs have wider coverage of the course than any other method of assessment, such that a student cannot avoid any section he or she has not read or understood. McKeachie reported that students preparing for essay tests focus on broad issues, general concepts and interrelationships rather than on specific details, and this results in somewhat better student performance regardless of the type of exam they are given. [6] Many researchers believe that multiple choice examinations are only suitable for testing factual information, whereas essay examinations test higher order cognitive skills. [15],[16] However, other researchers believe that multiple choice tests can examine many of the same cognitive skill that essay tests do provided the questions are tailored with careful attention to quality by following good practice to avoid the pitfalls in their design. [17],[18],[19] Essay examination has its own short-comings, for instance, it can provide only a very limited sampling of attainment, with a small number of questions being included in any one test, and students who are lucky enough to select the right topics to revise tend to do best. Students who were cue-seekers' gained the best degrees and 'cue-deaf' students gained the poorest.

The better performance in essay than MCQ examination in this study is further supported by the higher correlation coefficient of essay examination with the overall performance than MCQ. This is contrary to the report of Shittu et al., however, they used a smaller sample size than that which is used in this study. [20] There was a significant correlation between essay examination and MCQ, though the relationship was weak. This suggests that the two methods of examination are related. Therefore we can say that the design of the MCQ has achieved a purpose close to essay questions in this study.

The result of this study showed that the continuous assessment had the best positive correlation with the final overall performance in Physiology examination. This shows the importance of continuous assessment and reveals that the final score of the students is strongly related to their performance all through the preclinical year and that the final score was not an accident. Continuous assessment places less emphasis on pure memory (particularly comparatively short-term memory) than terminal assessment, and correspondingly more emphasis on worthwhile learning in the deepest sense of the word. [21] Continuous assessment encourages regular, systematic study and discourages last-minute cramming, thus rewarding students who work steadily and conscientiously throughout their courses. It enables on-going monitoring of student performance to take place, it provide early warnings about students having problems with a course, thus enabling appropriate remedial help to be provided in time for the student to improve. [21]

Regression analysis revealed that performance in essay examination was the best predictor of success in the overall score in Physiology. That is a student who passed essay is more likely to pass in the overall score. This is followed by MCQ as a predictor of performance. This further supports the claim that essay questions assess comprehension, the ability to integrate and synthesize, and the ability to apply information to new situations. [22] Essay gives an opportunity to assess the quality of students thinking. There was a positive correlation between practical and the overall performance (r = 0.517). However, practical examination was the least predictor of performance in the first professional examination. Therefore, even though practical examination in Physiology is important, performance does not well predict the overall performance. The correlation of practical in the overall score in this study is lower than that reported by Shittu et al. [20]


   Conclusion Top


The result of this study reveals that there is a significant correlation between all the assessment parameters of the examination, viz. continuous assessment, essay, MCQ, practical and oral examination with the overall performance. The practice of giving continuous assessment to students should be held important. Efforts should be made to improve the design of MCQ questions and practical examinations to improve their effectiveness.

 
   References Top

1.DFES (Department for education and skills) Towards a Unified e-Learning Strategy: Consultation document, Nottingham: DFES Publications; 2003. Available from: http://dera.ioe.ac.uk/id/eprint/4748 [Last accessed date on 2012 July 4 th ].  Back to cited text no. 1
    
2.Crooks TJ. The impact of classroom evaluation practices on students. Rev Educ Res 1988;58:438-81.  Back to cited text no. 2
    
3.Des Marchais JE, Vu NV. Developing and evaluating and student assessment system in the preclinical problem-based curriculum at Sherbrooke. Acad Med 1996;71:274-83.  Back to cited text no. 3
    
4.Epstein RM. Assessment in medical education. N Engl J Med 2007;356:387-96.  Back to cited text no. 4
    
5.Dakum NK, Misauno M, Yiltok SJ, Ugwu BT, Madaki JK, Akwara AL, et al. An analysis of final year medical students' examination in surgery. Ann Afr Med 2009;8:66-8.  Back to cited text no. 5
[PUBMED]  Medknow Journal  
6.McKeachie WJ. Teaching tips: A Guidebook for the Beginning College Teacher, 8 th ed. Lexington, Mass: Heath; 1986.  Back to cited text no. 6
    
7.Muzzin Q. Oral examinations. In: Shannon S, Norman G, Falconer J, editors. Evaluation Methods: A Resource Handbook. Hamilton, Canada: McMaster University; 1995. p. 37-42.  Back to cited text no. 7
    
8.Ehiametalor ET. The application of continuous assessment model in Nigerian schools. Available from: http://unilorin.edu.ng/journals/education/ije/feb1983/THE%20APPLICATION%20OF%20CONTINUOUS%20ASSESSMENT%20MODEL%20IN%20NIGERIAN%20SCHOOLS.pdf [Last accessed date on 2012 July 4 th ].  Back to cited text no. 8
    
9.Torke S, Abraham RR, Ramnarayan K, Asha K. The impact of viva-voce examination on students' performance in theory component of the final summative examination in physiology. J Physiol Pathophysiol 2010;1:10-2.  Back to cited text no. 9
    
10.Thomas CS, Mellsop G, Callender K, Crawshaw J, Ellis PM, Hall A, et al. The oral examination: A study of academic and non-academic factors. Med Educ 1993;27:433-9.  Back to cited text no. 10
    
11.Evans LR, Ingersoll RW, Smith EJ. The reliability, validity and taxonomic structure of the oral examination. J Med Educ 1966;41:651-7.  Back to cited text no. 11
    
12.Wigton RS. The effect of student personal characteristics on the evaluation of clinical performance. J Med Educ 1980;55:423-7.  Back to cited text no. 12
    
13.Oyebola DD, Adewoye OE, Iyaniwura JO, Alada AR, Fasanmade AA, Raji Y. A comparative study of students' performance in preclinical physiology assessed by multiple choice and short essay questions. Afr J Med Med Sci 2000;29:201-5.  Back to cited text no. 13
    
14.Pepple DJ, Young LE, Carrol RG. A comparison of student performance in multiple-choice and long essay questions in the MBBS stage I physiology examination at the University of the West Indies (Mona Campus). Adv Physiol Educ 2010;34:86-9.  Back to cited text no. 14
    
15.Welsh AL. Multiple choice objective tests. In: Saunders P, Welsh AL, HansenWL, editors. Resource Manual for Teacher Training programs in Economics. New York: Joint Council on Economic Education; 1978. p. 191-228.  Back to cited text no. 15
    
16.Grondlund NE. How to construct achievement tests. Englewood Cliffs, NJ: Prentice-Hall; 1988.  Back to cited text no. 16
    
17.Fuhrman M. Developing good multiple-choice tests and test questions. J Geosci Educ 1996;44:379-84.  Back to cited text no. 17
    
18.Carneson J, Delpierre G, Masters K. Designing and managing multiple choice questions. Australia: Southrock Corporation Ltd; 2003.  Back to cited text no. 18
    
19.Harper R. Multiple-choice questions-A reprieve. BEE-J 2003;2:2-6.  Back to cited text no. 19
    
20.Shittu LA, Zachariah MP, Izegbu MC, Adesanya OA, Ashiru OA. The differential impact of various assessment parameters on the medical students performance in the professional anatomy examination in a new medical school. Int J Morphol 2006;24:659-64.  Back to cited text no. 20
    
21.Ellington H, Earl S. Making effective use of continuous assessment and portfolios. The Robert Gordon University. Russia: CICED Publications. Ó; 1997.  Back to cited text no. 21
    
22.Jacobs LC, Chase CI. Developing and using tests effectively: A guide for faculty. San Francisco: Jossey-Bass Publishers; 1992.  Back to cited text no. 22
    


    Figures

  [Figure 1]
 
 
    Tables

  [Table 1], [Table 2], [Table 3], [Table 4]


This article has been cited by
1 EFFECTIVENESS OF SAQ AND LAQ IN ASSESSING COGNITIVE DOMAIN AMONG FIRST YEAR MBBS, BIOCHEMISTRY STUDENTS
Paliwal Manoj Narayan,Prachi Paliwal,Darshana Jain
Journal of Evolution of Medical and Dental Sciences. 2016; 5(95): 6982
[Pubmed] | [DOI]



 

Top
  
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  In this article
    Abstract
   Introduction
    Materials and Me...
   Results
   Discussion
   Conclusion
    References
    Article Figures
    Article Tables

 Article Access Statistics
    Viewed5496    
    Printed183    
    Emailed0    
    PDF Downloaded117    
    Comments [Add]    
    Cited by others 1    

Recommend this journal