Back to Journals » Diabetes, Metabolic Syndrome and Obesity » Volume 15

A Pilot Study of Modified Mini-Clinical Evaluation Exercises (Mini-CEX) in Rotation Students in the Department of Endocrinology

Authors He Y, Wen S , Zhou M, Li X, Gong M, Zhou L

Received 25 April 2022

Accepted for publication 5 July 2022

Published 9 July 2022 Volume 2022:15 Pages 2031—2038

DOI https://doi.org/10.2147/DMSO.S372253

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Prof. Dr. Juei-Tang Cheng



Yanju He,1,* Song Wen,1,* Mingyue Zhou,2 Xiucai Li,1 Min Gong,1 Ligang Zhou1,3

1Department of Endocrinology, Shanghai Pudong Hospital, Fudan University, Shanghai, 201399, People’s Republic of China; 2Helen Driller Family Comprehensive Cancer Center, University of California, San Francisco, CA, USA; 3Shanghai Key Laboratory of Vascular Lesions Regulation and Remodeling, Shanghai Pudong Hospital, Fudan University, Shanghai, 201399, People’s Republic of China

*These authors contributed equally to this work

Correspondence: Ligang Zhou, Department of Endocrinology, Shanghai Pudong Hospital, Fudan University, Shanghai, 201399, People’s Republic of China, Tel +8613611927616, Email [email protected]

Background: The mini-clinical evaluation exercise (mini-CEX) is an excellent tool for assessing the clinical abilities of medical students in intense clinical practice. In this study, the Mini-CEX was adapted to professional questionnaires for Diabetes Mellitus (DM), and examined in medical students completing their clerkship rotation in the department of endocrinology.
Methods: From January 2021 to January 2022, all rotating medical students at Shanghai Pudong Hospital completed two mini-CEX exams before and following their rotation under the supervision and guidance of six tutors. The mini-CEX form was modified in this study primarily for inpatient management based on our clinical experience and updated DM guidelines of the American Diabetes Association (ADA), the European Association for the Study of Diabetes (EASD), and the Chinese Diabetes Society (CDS). Each component of the mini-CEX assessment, including medical interviews, physical examination, clinical judgment, clinical management, and overall clinical competence was evaluated using a nine-item questionnaire.
Results: Our findings revealed that the second-round performance on the assessments significantly improved, as indicated by higher scores on each component. The Pearson association analysis revealed that the feedback time of the first examination was markedly associated with improved overall scores (r= 0.391, p< 0.001). However, no correlations were discovered between patient age, gender, disease severity disparity, or the interval between examinations (p> 0.05). Additional regression analysis revealed that the feedback time during the initial examination was the most significant contributor to the increased overall scores (β=0.391, p< 0.001).
Conclusion: This newly designed mini-CEX form based on current ADA and EASD guidelines may assist trainees in more effectively diagnosing and managing DM in inpatients, particularly those with macrovascular, microvascular, or peripheral nerve neuropathy. This study aims to assess the efficacy of administering a modified mini-CEX form to rotating trainees participating in an endocrine clerkship.

Keywords: mini-clinical evaluation exercise, diabetes, medical student, feedback time

Background

The mini-Clinical Evaluation Exercise (mini-CEX) is a clinical evaluation instrument used to assess trainee-patient interactions in hospitals and other clinical settings.1 It is a brief assessment that takes approximately 15 minutes for each domain and is incredibly valuable during a hectic medical rotation. The original mini-CEX evaluation form requires that trainees focus on at least five categories, including medical interviewing ability, physical examination ability, clinical judgment ability, therapeutic ability, and overall clinical competence.2 Trainers grade these five domains on a nine-point Likert scale ranging from “inadequate” to “outstanding.” A feedback section is mentioned at the end of the assessment.

Mini-CEX has demonstrated its clinical utility and universality in medical student and resident training.3–5 However, due to a lack of comprehensive and specialized knowledge on a single specific disease, its operationalization is currently limited.6 Therefore, the original mini-CEX is frequently modified for use in specialized training fields.7–9 Type 2 diabetes (T2D) is a prevalent metabolic disease that causes many complications in multiple organs and systems,10,11 necessitating the completion of numerous questionnaires for medical history and physical examination.12 It is also a disease that is commonly used in the Department of Endocrinology to assess the efficacy of training in medical students and clinicians. As a consequence, a special mini-CEX form is required for the assessment of residents or medical students participating in an endocrine rotation clerkship. In this study, the original form of mini-CEX was modified, and its educational impact on trainee performance was investigated.

Methods

Instrument Development

The nine-point Likert scale in the original form of mini-CEX, ranging from “unsatisfactory” to “outstanding”, was designated as the 9-item questionnaire on diabetes diagnosis and treatment in this study, and was categorized into the 5 specific domains described above (Table 1). These nine items were referred to the American Diabetes Association (ADA) 2022 guideline,13 the European Association for the Study of Diabetes (EASD) guideline,14 and China’s 2020 standard of medical care for type 2 diabetes (Chinese Diabetes Society).15 Because diabetes is a chronic, complex condition, and outpatient management would take longer than a month to master, as would the application of diabetes pharmacology alone, we required that each student master inpatient diabetes clinical practice for the duration of a one-month rotation.

Table 1 The Modified Mini-CEX Form for Assessment of Trainees Who Interviewed Diabetes Mellitus (DM) Patients

Participants and Setting

From January 2021 to January 2022, all 79 rotating students at the hospital participated in two mini-CEX sessions before and after clerkship training, under the monitoring and guidance of 10 professional tutors in the department of Endocrinology. The trainees were notified of these assessments as part of a rotation during their first mini-CEX assessment. The modified mini-CEX form was used as a self-evaluation tool throughout the approximately one-month rotation period preceding the second assessment. The initial evaluation was conducted by each rotation student’s tutor (6 tutors) under the supervision of a senior physician of the treatment group, who were experienced attending and chief physicians in our department, proficient in the diagnosis and treatment of both diabetes and its complications. In addition, this evaluation was undertaken without any guidance from the tutor, and the student was blinded to the patient’s diagnosis and treatment information unless each part of the assessment was completed. The final assessment was performed by the same student’s rotation tutor under the same conditions, with the exception that the patient was reselected and the student was blinded to the patient’s information. Both initial and final assessment durations were specified to be within 40 minutes.

Statistical Analyses

All statistical analyses were performed using SPSS software (Version 25, USA). The Kolmogorov–Smirnov test was used to assess the normal distribution of the data. The 5 domains of the mini-CEX scale were compared using a paired t-test. Pearson correlation was used to determine the primary contributor to the overall increase in scale. Multilinear regression analyses were performed to identify the critical traits assessed by mini-CEX that contributed to the overall score. For each analysis, p<0.05 was considered statistically significant.

Result

Comparisons of the Progress of Scores Assessing Five Mini-CEX Domains

The mini-CEX forms were distributed to all 79 rotation students before and after the approximately one-month training, and response rates were 100%. As expected, the scores for each domain on the mini-CEX form significantly increased when medical interviewing skills, physical examination skills, clinical judgment, medical management skills, overall clinical competencies, and total scores were evaluated (p<0.0001) (Figure 1).

Figure 1 Increased scores on the mini-CEX in 5 domains including medical interview skills (A), physical examination skills (B), clinical judgment (C), clinical management skills (D), and overall clinical competence (E) as well as an increase in total scores (F) among rotating medical students before and after type 2 diabetes-specific training. N=79, ****P<0.0001.

The Factors Associated with the Increase in Total Score Before and After Training

Correlational analyses of the increasing total score revealed that, in addition to the five components of primary assessment throughout training, the feedback time of the first examination is critical (p<0.001). However, the association between patient age, gender, disease severity disparity, examination interval, consultation type, observation time disparity, and second examination feedback time were relatively weak. The precise r and p-values are shown in Table 2.

Table 2 The Correlation Between Changes in Age, Patients’ Gender, the Interval Between Examinations, Clinical Skills Scores, Observation Time, Feedback Time, and Change in Disease Severity in Relation to Increases in Total Scores

Multilinear Regression Analyses of the Major Components Contributed to the Progress of the Increased Overall Score

Based on a stepwise regression analysis, the feedback time of the first examination was determined to be the only significant factor in this study (β=0.391, p<0.001) (Table 3). Patient-related variables such as age, gender, severity, consultation type, and exam interval period had no effect on the increase in the total score.

Table 3 Multiple Linear Regression Analysis of Factors Influencing the Increase in the Total Score Before and After Training

Discussion

Previous studies have demonstrated that using mini-CEX during a demanding clerkship rotation is not only convenient but also professional. This customized mini-CEX assessment form benefits our clinical training plan in the department of endocrinology. Trainees in the Department of endocrinology who are interested in advancing their knowledge and skills can benefit from this assessment. In addition, as with previous studies, this form should assist trainers in guiding trainees through more professional structured interviews, in-depth sympathetic engagement, excellent communication skills, and bedside manner.9,16

Within the Endocrinology Department, the trainee can use this form as an extended instructional resource for learning DM. The five domains in the form have been modified in accordance with the DM diagnostic and therapy approach. We later discovered that the progression of each student’s total score was independent of changes in the patients’ properties and the background environment, indicating that the exam is objective enough and has a high degree of reliability to accurately reflect each resident’s virtual ability and progress during the rotation, with the findings of previous research.17 Our examination includes five domains, which encompass nearly all aspects and fundamental skills necessary for students’ development and routine work in our department. There are 9 items in the medical interview that are primarily concerned with establishing compatible relationships with patients and completing the initial impression on diagnoses and the patient’s condition. This section primarily requires students to have concise and clear logical communication abilities in counseling, as well as the ability to understand the primary paradox at the moment patients require treatment in a hospital. The 9 major items in the physical examinations (PE) section encompass the numerous aspects that we should conduct in diabetic patients because the PE is critical not only for correctly diagnosing patients but also for further communication with patients. In addition, there are nine items in the clinical judgment section that assess a prospective trainee’s analytical ability, experience, and knowledge as demonstrated by his or her ability to collect illness histories, perform physical examinations, and interpret laboratory tests, as well as make numerous differential diagnoses and develop an appropriate prognosis for each patient. The medical management skills major assess a prospective physician’s practical competence to integrate newly acquired data with previous experiences and knowledge to solve medical problems for patients. The overall clinical competence component summarizes and assigns a score based on the previous performance in the other four sections. We design these examination frameworks to evaluate participants’ comprehensive qualities, provide them with specific constructive suggestions, and guide them in overcoming their deficiencies in their future medical careers.18

In addition, immediately following testing, participants receive feedback from tutors confirming the correct clinical process and indicating their errors, which help them improve their skills and attain a higher standard in their future routine work. In reality, the tutors identified the exact issues that the student encountered in his or her evaluation and provided suitable solutions that the student must immediately investigate on his or her own based on the daily assessment questionnaire. In accordance with the current diabetic guidelines, the supported reference tool could be discovered in official internal medicine or diagnosis training materials. A student may also obtain the answers by searching clinical resources like PubMed. Throughout each rotation, the tutors will provide the students with substantial clinical errors relevant to the examination, for which they will be required to discover remedies. In addition, the department regularly held training rounds and mini-lectures provided by senior physicians. We discovered that each participant’s performance improved significantly one month later on the second examination and that this effect was strongly related to the feedback time of the first examination, but had little correlation with the interval period between the two exams, implying that the feedback time is the most critical factor in improving trainee’s clinical abilities. During their one-month rotation, participants were asked to complete additional self-assessments following the first mini-CEX evaluation. Although the interval period varied by the student, our study found no correlation between the duration of the interval period and performance on the second test. One possibility is that one month is sufficient time for a trainee to develop clinical skills in DM clinical practice for general inpatient management, given that diabetes is a chronic, complex condition, and outpatient management would take longer than a month to master, as would the application of diabetes pharmacology alone. Furthermore, the study found that the majority of trainees prefer this type of training because it enables them to concentrate on a specific area of weakness.19 Consequently, as demonstrated by this study, they can devote more time and achieve a higher score on the second min-CEX exam. Several studies have demonstrated that feedback time and the structuring of this evaluation process are critical components of mini-CEX.20 In this study, however, feedback time was found to have only a limited causal effect (R2=0.153) on trainees’ total score improvement. We did not know how long each participant spent following the initial examination, nor did we know about the participant’s attributes, such as intellect and personal characteristics,21,22 which may have played a significant effect in this improvement. In a future study, a more customized mini-CEX will be developed to account for each participant’s distinguishing characteristics.

Conclusion

In the current study, we modified a mini-CEX form often used for in-patient treatment based on the most recent guideline for diabetes mellitus diagnosis and treatment. We found that regardless of the patient’s characteristics or clinical circumstances, the feedback time during the initial examination is essential for attaining improved overall scores. This mini-CEX form could be expanded to include additional variables, such as trainees’ personality qualities from other standard scales or methods, to support trainers in assisting trainees both personally and in achieving greater success in their future inpatient clinical practices.

Data Sharing Statement

All data generated or analyzed during this study are included in this published article.

Ethical Approval and Consent to Participate

This study, including the examinations, obtained ethical approvals from the institution of Shanghai Pudong Hospital, Fudan University (Shanghai, China). Informed consent was received from study participants before the start of the study. The outlined guidelines and procedures were conducted in accordance with the Declaration of Helsinki.

Consent for Publication

Each participant provided written informed consent for the publication of this study.

Acknowledgments

We would like to express our gratitude to every tutor as well as other clerks in the department of endocrinology for their active participation in this project, and their selfless dedication to the growth of each rotation student despite the hectic nature of their routine clinical work.

Author Contributions

All authors made significant contributions to the work reported, whether in the conception, study design, execution, data acquisition, analysis, and interpretation, or in all these areas; participated in drafting, revising, or critically reviewing the article. All authors approved the final version of the manuscript and the journal to which the article has been submitted, and they all agreed to be accountable for all aspects of this study.

Funding

This work was supported by the Project of Key Medical Discipline of Pudong Hospital of Fudan University (Zdxk2020-11), Project of Key Medical Specialty and Treatment Center of Pudong Hospital of Fudan University (Zdzk2020-24), Integrative Medicine special fund of Shanghai Municipal Health Planning Committee (ZHYY- ZXYJHZX-2-201712), Special Department Fund of the Pudong New Area Health Planning Commission (PWZzk2017-03), Outstanding Leaders Training Program of Pudong Health Bureau of Shanghai (PWR12014-06), Pudong New Area Clinical Plateau Discipline Project (PWYgy-2021-03), the Natural Science Foundation of China (21675034), National Natural Science Foundation of China (81370932), and Shanghai Natural Science Foundation (19ZR1447500).

Disclosure

The authors declare that they have no conflict of interest.

References

1. Kogan JR, Holmboe ES, Hauer KE. Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA. 2009;302(12):1316–1326. doi:10.1001/jama.2009.1365

2. Ma ZJ, Ma L, Zhou YF, et al. Application of modified mini-clinical evaluation exercise in the cultivation of orthopaedic students. Int J Clin Pract. 2021;75(12):e15007. doi:10.1111/ijcp.15007

3. Liang Y, Noble LM. Chinese doctors’ views on workplace-based assessment: trainee and supervisor perspectives of the mini-CEX. Med Educ Online. 2021;26(1):1869393. doi:10.1080/10872981.2020.1869393

4. Kurdi MS, Hungund BR. Evaluation of mini-clinical evaluation exercise (mini-CEX) as a method for assessing clinical skills in anaesthesia postgraduate education. Indian J Anaesth. 2021;65(3):248–252. doi:10.4103/ija.IJA_1458_20

5. Véliz C, Fuentes‐Cimma J, Fuentes‐López E, et al. Adaptation, psychometric properties, and implementation of the Mini-CEX in dental clerkship. J Dent Educ. 2021;85(3):300–310. doi:10.1002/jdd.12462

6. Pelgrim EA, Kramer AW, Mokkink HG, et al. Quality of written narrative feedback and reflection in a modified mini-clinical evaluation exercise: an observational study. BMC Med Educ. 2012;12:97. doi:10.1186/1472-6920-12-97

7. Suhoyo Y, Schönrock-Adema J, Emilia O, et al. How students and specialists appreciate the mini-clinical evaluation exercise (mini-CEX) in Indonesian clerkships. BMC Med Educ. 2020;20(1):144. doi:10.1186/s12909-020-02062-z

8. Wei C-J, Lu T-H, Chien S-C, et al. The development and use of a pharmacist-specific Mini-CEX for postgraduate year trainees in Taiwan. BMC Med Educ. 2019;19(1):165. doi:10.1186/s12909-019-1602-2

9. Meresh E, Daniels D, Sharma A, et al. Review of mini-clinical evaluation exercise (mini-CEX) in a psychiatry clerkship. Adv Med Educ Pract. 2018;9:279–283. doi:10.2147/AMEP.S160997

10. Wen S, Liu C, Li Y, et al. Psoriasis Exacerbates the State of Insulin Resistance in Patients with Type 2 Diabetes. Diabetes Metab Syndr Obes. 2021;14:2389–2397. doi:10.2147/DMSO.S312420

11. Defronzo RA. From the triumvirate to the ominous octet: a new paradigm for the treatment of type 2 diabetes mellitus. Diabetes. 2009;58(4):773–795. doi:10.2337/db09-9028

12. Norcini JJ, Blank LL, Arnold GK, Kimball HR. The mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med. 1995;123(10):795–799. doi:10.7326/0003-4819-123-10-199511150-00008

13. Draznin B, Aroda VR, Bakris G. et al. 4. Comprehensive Medical Evaluation and Assessment of Comorbidities: standards of Medical Care in Diabetes-2022. Diabetes Care. 2022;45(Suppl 1):S46–s59.

14. Davies MJ, D’Alessio DA, Fradkin J, et al. Management of Hyperglycemia in Type 2 Diabetes, 2018. A Consensus Report by the American Diabetes Association (ADA) and the European Association for the Study of Diabetes (EASD). Diabetes Care. 2018;41(12):2669–2701. doi:10.2337/dci18-0033

15. Chinese Diabetes Society. [Clinical guidelines for prevention and treatment of type 2 diabetes mellitus in the elderly in China (2022 edition)]. Zhonghua Nei Ke Za Zhi. 2022;61(1):12–50. Chinese. doi:10.3760/cma.j.cn112138-20211027-00751

16. Cruess R, McIlroy JH, Cruess S, et al. The Professionalism Mini-evaluation Exercise: a preliminary investigation. Acad Med. 2006;81(10 Suppl):S74–8. doi:10.1097/00001888-200610001-00019

17. Chen YY. Is the rating result reliable? A new approach to respond to a medical trainee’s concerns about the reliability of Mini-CEX assessment. J Formos Med Assoc. 2021.

18. Mortaz Hejri S, Jalili M, Masoomi R, et al. The utility of mini-Clinical Evaluation Exercise in undergraduate and postgraduate medical education: a BEME review: BEME Guide No. Med Teach. 2020;42(2):125–142. doi:10.1080/0142159X.2019.1652732

19. Bashir K, Arshad W, Azad AM. et al. Acceptability and Feasibility of Mini Clinical Evaluation Exercise (Mini-CEX) in the Busy Emergency Department. Open Access Emerg Med. 2021;13:481–486. doi:10.2147/OAEM.S321161

20. Martinsen SSS, Espeland T, Berg EA. et al. Examining the educational impact of the mini-CEX: a randomised controlled study. BMC Med Educ. 2021;21(1):228. doi:10.1186/s12909-021-02670-3

21. Alahdab F, Halvorsen AJ, Mandrekar JN, et al. How do we assess resilience and grit among internal medicine students at the Mayo Clinic? A longitudinal validity study including correlations with medical knowledge, professionalism and clinical performance. BMJ Open. 2020;10(12):e040699. doi:10.1136/bmjopen-2020-040699

22. Lee V, Brain K, Martin J. Factors Influencing Mini-CEX Rater Judgments and Their Practical Implications: a Systematic Literature Review. Acad Med. 2017;92(6):880–887. doi:10.1097/ACM.0000000000001537

Creative Commons License © 2022 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.