Back to Journals » Advances in Medical Education and Practice » Volume 8

Association between the Medical College Admission Test scores and Alpha Omega Alpha Medical Honors Society membership

Authors Gauer JL , Jackson JB

Received 8 July 2017

Accepted for publication 17 August 2017

Published 15 September 2017 Volume 2017:8 Pages 627—632

DOI https://doi.org/10.2147/AMEP.S145839

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Md Anwarul Azim Majumder



Jacqueline L Gauer,1 J Brooks Jackson2

1Office of Medical Education, 2Department of Laboratory Medicine and Pathology, Medical School, University of Minnesota, Minneapolis, MN, USA

Introduction: Medical schools worldwide are faced with the challenge of selecting from among many qualified applicants. One factor that might help admissions committees identify future exceptional medical students is scores on standardized entrance exams. The purpose of this study was to determine the association between scores on the most commonly used standardized medical school entrance exam in the USA, the Medical College Admission Test (MCAT), and election to the US medical honors society, Alpha Omega Alpha (AOA).
Method: MCAT scores and AOA membership data were analyzed for all the students pursuing Doctor of Medicine degrees at the University of Minnesota Medical School and who graduated between 2012–2016 (n=1,309).
Results: An independent-samples t-test found a significant difference (t=6.132, p<0.001) in MCAT scores between those who were elected to AOA (n=179) and those who were not (n=1,130). On average, students who were elected to AOA had composite MCAT scores of 1.65 points higher than those who were not. Percentages of students elected to AOA gradually but inconsistently increased with MCAT score. No student who scored <27 on the MCAT was elected to AOA. Among students with MCAT scores at the 99th percentile or above (scores of ≥38), 13 of 48 (27.1%) were elected to AOA.
Discussion: Election to AOA during medical school was significantly associated with higher MCAT scores. Admissions committees should carefully consider the role of standardized entrance exam scores, in the context of a holistic review, when selecting for exceptional medical students.

Keywords: AOA election, t-test, admissions, medical school, cumulative percentage, medical student honors, selection

Plain language summary

Medical school admissions committees are faced with the challenge of identifying potential top-performing medical students from among many highly qualified applicants. One indicator of exceptional performance in medical school in the USA is membership in the national medical honors society, Alpha Omega Alpha (AOA). The purpose of this study was to explore whether membership in AOA was related to scores on the Medical College Admission Test (MCAT), the most commonly used standardized entrance exam for medical school in the USA.

The researchers analyzed data from 1,309 students at the University of Minnesota Medical School who graduated in 2012–2016. They found that those students who were members of AOA did have statistically significantly higher MCAT scores than those who were not. As MCAT scores increased, so did the proportion of students who were AOA members. No student who scored <27 on the MCAT was elected to AOA in the five graduating classes in this study.

These results find that admissions committees should consider MCAT scores, in the context of a holistic review process, when attempting to identify future exceptional performers at their medical school.

Introduction

Amid calls for transparent and holistic admissions practices, medical school admissions committees worldwide debate how to weight the various possible criteria they may use to discern future exceptional performers from among many highly qualified applicants. One indicator of exceptional academic performance in medical school in the USA is election to the national medical honors society, Alpha Omega Alpha (AOA). This study attempts to examine the relationship between AOA membership and scores on the Medical College Admission Test (MCAT), the most frequently used standardized entrance exam for medical school in the USA.

AOA is the national medical honors society in the USA. Founded in 1902, it now has 128 chapters in the USA and Lebanon, and more than 150,000 members have been elected since its founding.1 Each medical school with a chapter elects up to one sixth of their expected graduating class from the top quartile of academic performers.2 The specific process for election is determined by the medical school, and processes vary widely. Since election to AOA provides students with a certain stature that tends to positively influence their future careers,3 calls have been made for fairness, transparency, and periodic evaluations of election processes.4

The literature shows that election to AOA has positive repercussions for medical students applying for residency. In a national survey of Residency Program Directors in the USA, the National Resident Matching Program (NRMP) found that 61% of residency programs consider AOA membership when selecting students to interview, and 45% of them consider AOA when ranking students.5 Decroff et al3 found that AOA membership significantly improved a student’s chances of matching into the more competitive specialties. They found that AOA membership was also beneficial for matching into less competitive specialties, but less so than for more competitive specialties. This pattern is carried out in the national-level match data from the NRMP, with up to 51% of successfully matched US allopathic seniors in competitive specialties such as dermatology belonging to AOA.6 Research in orthopedic surgery residency programs has found that AOA membership correlates significantly with global evaluation scores7 and trends toward significance with in-training examination performance.8

As medical school admissions committees consider which applicants to select for their institutions, it is helpful for them to be able to identify potential high-performing students. Standardized exams are an attractive option for evaluating applicants, as they allow for the comparison of applicants across a heterogeneous pool of undergraduate institutions.9 In the USA, the most commonly used standardized entrance exam for medical school is the MCAT. Research has found the MCAT to be valuable for predicting medical school success10,11 and licensing exam scores.12,13 However, a literature search found no research to date on the association between MCAT scores and AOA membership. The purpose of this study, therefore, was to explore the association between MCAT scores and AOA membership in a large sample including students from five graduating classes at the University of Minnesota (UMN) Medical School. We hypothesized that AOA membership would be significantly associated with higher MCAT composite scores.

At UMN, there are two steps in the AOA election process. First, a de-identified class rank list is compiled based on course grades and US Medical Licensing Exam (USMLE) Step 1 scores, and students in the top quartile are invited to submit essays, the topic of which is usually related to personal qualities such as professionalism and empathy. These essays are then scored on a scale of 1 (worst)–10 (best) by members of the AOA Committee, including students, faculty, and alumni. The exact number of graders varies by year, but typically each essay is scored by at least 10 graders. The highest and lowest scores are dropped, and the remaining scores are averaged. The essay scores are then added to the class rank scores such that the essay score comprises 20% of the overall score, and the list is reranked. The top members of the reranked list are then invited to join AOA.14

Method

Institutional approval

Ethical approval for this research was granted by the Institutional Review Board (IRB) at UMN (on May 4, 2017; IRB ID: STUDY00000329). The IRB waived the requirement of informed consent for this medical student record review.

Participants

The participants for this study included all students pursuing doctor of medicine degrees at UMN who graduated in 2012–2016 and had MCAT scores on record (n=1,309). At UMN, medical students matriculate at either the Twin Cities campus or the Duluth campus. They complete the first 2 years of the degree (foundational science courses) at their campus of matriculation, and then, all students complete the second 2 years of the degree (clinical clerkships) through the Twin Cities campus. Of the students in this study, 974 (74.4%) students matriculated at the Twin Cities campus and 335 (25.6%) matriculated at the Duluth campus. Table 1 provides means and SDs for exam scores, as well as demographic information.

Table 1 Demographic information, MCAT scores, and USMLE Step 1 and Step 2 CK scores for graduates of the University of Minnesota Medical School between 2012 to 2016, divided by membership in the national medical honors society, AOA

Note: aDifference between AOA and non-AOA groups is significant at the p<0.05 level.

Abbreviations: AOA, Alpha Omega Alpha; CK, clinical knowledge; F, female; M, male; MCAT, Medical College Admission Test; USMLE, US Medical Licensing Exam.

A new version of the MCAT was released in 2015. All students in this study took the version of the MCAT that was in use prior to the 2015 revision, since all the included students matriculated prior to 2015. Possible composite MCAT scores for that version ranged from 3 to 45. For students in the current study, composite MCAT scores ranged from 19 to 44 (mean =31.4, SD =3.4).

Sources of data

Academic, demographic, and AOA membership data were collected from student records held by the Office of Medical Education in the Academic Health Center at UMN. Data regarding participants’ MCAT composite scores were retrieved from UMN’s access to primary application data through the American Medical College Application Service. For students who had multiple MCAT scores, the highest composite score was utilized, as this is the score that is given most weight by the admissions committee at UMN. The data used in this study were de-identified.

Analyses

Using SPSS version 22 (IBM, Armonk, NY, USA), we performed an independent samples t-test to examine the association between AOA membership and MCAT scores. We used SPSS and Excel 2016 (Microsoft, Redmond, WA, USA) to calculate numbers and percentages of students with each MCAT score who were elected to AOA.

Results

Table 2 presents the numbers and percentages of students who scored each MCAT composite score and were elected to AOA. Figure 1 presents the cumulative percentages of students elected and not elected to AOA for each MCAT composite score. Overall, 179 of the 1,309 students in the data set (13.67%) were elected to AOA. Percentages of students elected to AOA gradually but inconsistently increased with MCAT score. No student who scored <27 on the MCAT was elected to AOA in the five graduating classes included in this analysis. Among students with MCAT scores at the 99th percentile or above (scores of ≥38), 13 of 48 (27.1%) were elected to AOA.

Table 2 MCAT composite scores for students at the University of Minnesota Medical School who graduated between 2012–2016 (n=1,309), the number of students achieving each score, and the number and percentage of students with each score who were elected to the AOA Medical Honors Society

Abbreviations: AOA, Alpha Omega Alpha; MCAT, Medical College Admission Test.

Figure 1 Cumulative percentages of students who were (n=179) and were not (n=1,130) elected to AOA for each MCAT composite score, for graduates of the University of Minnesota Medical School from 2012–2016 (total n=1,309).

Abbreviations: AOA, Alpha Omega Alpha; MCAT, Medical College Admission Test.

An independent samples t-test found a significant difference (t=6.132, p<0.001) in MCAT scores between those who were elected to AOA (n=179) and those who were not (n=1,130). On average, students who were elected to AOA had composite MCAT scores 1.65 points higher than those who were not.

Discussion

The results of our analyses confirm our hypothesis that there is a relationship between standardized entrance exam (MCAT) scores and election to the national medical honors society (AOA). Students who were elected to AOA had significantly higher MCAT scores than students who were not. In fact, no student with a composite MCAT score <27 was elected to AOA at UMN in the five graduating classes under review. This pattern of higher scores for AOA members is further illustrated by the cumulative percentages of each group scoring each MCAT composite score in Figure 1. It should be noted, however, that AOA membership was far from perfectly predicted by MCAT score. MCAT score should be viewed as a predictive, but not deterministic, factor for eventual AOA membership. Our results support the continued use of the MCAT in medical school admissions, in the context of the holistic process advocated by the Association of American Medical Colleges (AAMC).15,16

Medical school admissions committees must balance the desire to select the best possible applicants for their institutions with an understanding that not all future physicians need to be exceptional academically. Many very successful physicians are not AOA members, and aspects of successful medical practice such as empathy and professionalism, while included to an extent in the AOA election process, are de-emphasized in the election process relative to academic performance. Even when it comes to applying for residency, AOA membership is not necessary for a successful match process, even in the most competitive residency programs.6

A recent article by Boatright et al. investigated racial and ethnic disparities in AOA membership among medical students from 123 allopathic US medical schools. The authors found that, even after controlling for possible confounding factors, black and Asian medical students were less likely to be AOA members.17 Furthermore, a study of national MCAT data in 2013 found that black and Latino examinees had lower mean MCAT scores than white examinees, although the same article also concluded that the difference was not due to racial bias in the exam.18 These articles suggest that medical schools must be proactive in attempts to avoid bias, both when admitting students and when electing students to AOA.

Limitations

In April 2015, the AAMC released a new version of the MCAT, featuring revised content and a new scoring system.19 Therefore, future medical school applicants will take a version of the MCAT that is not the same as the version under analysis in the current study. It is a fair assumption, however, that the versions are not so different that the clear pattern found in our analyses will not continue to hold for the new version of the exam. Furthermore, the current analyses provide foundational information on the old version of the exam that will help facilitate the analysis of the new version.

It could be argued that AOA membership is simply a reflection of test-taking ability, given that Step 1 scores and grades (which are themselves largely composed of test scores) comprise a large part of the election criteria. In that case, the association between high MCAT scores and AOA membership could simply be due to both measuring the same criterion of test-taking ability. However, AOA election criteria at UMN also include a personal essay and clinical clerkship performance. Therefore, AOA membership, at least at UMN, does appear to capture more than simple test-taking ability. On the other hand, the predictive value of essays in accurately reflecting the personal characteristics of applicants is debatable. Future research should explore the extent to which AOA membership reflects desirable personal characteristics outside of academic and test-taking ability and whether essays are the most effective method to select for those characteristics.

Conclusion

In our study of 1,309 medical students over five graduating classes, we found a significant association between MCAT scores and membership in AOA. As AOA membership is a reflection of exceptional medical school performance, as well as beneficial for matching into competitive residency programs, medical school admissions committees should consider the role of standardized entrance exam scores in the context of a holistic review when selecting for successful medical school applicants.

Acknowledgments

The authors wish to thank Barb Smith and Jonathan Marston for providing the data used in this study. The UMN Medical School provides funding for the salaries of the researchers.

Author contributions

JLG is responsible for data acquisition and analysis, interpretation of findings, and preparation of this manuscript. JBJ is responsible for the conceptualization and oversight of this study and revision of this manuscript. All authors contributed toward data analysis, drafting and revising the paper and agree to be accountable for all aspects of the work. All the authors reviewed and approved the final manuscript.

Disclosure

The authors report no conflicts of interest in this work.

References

1.

Alpha Omega Alpha [homepage on the Internet]. AOA’s history [updated November 30, 2015]. Available from: http://alphaomegaalpha.org/history.html. Accessed April 14, 2017.

2.

Alpha Omega Alpha [homepage on the Internet]. How members are chosen [updated August 12, 2016]. Available from: http://alphaomegaalpha.org/how.html. Accessed April 14, 2017.

3.

DeCroff CM, Mahabir RC, Zamboni WA. The impact of Alpha Omega Alpha membership on successfully matching to residency. Plast Reconstr Surg. 2010;126(2):113e–115e.

4.

Mendelson MA, Golay DR. Electing students to the Alpha Omega Alpha Honor Medical Society. Acad Med. 1992;67(3):178.

5.

National Resident Matching Program, Data Release and Research Committee. Results of the 2014 NRMP Program Director Survey. Washington, DC: National Resident Matching Program; 2014.

6.

National Resident Matching Program. Charting Outcomes in the Match: Characteristics of Applicants Who Matched to Their Preferred Specialty in the 2014 Main Residency Match. Washington, DC: National Resident Matching Program; 2014 (Charting Outcomes in the Match; 5th ed.).

7.

Raman T, Alrabaa RG, Sood A, Maloof P, Benevenia J, Berberian W. Does residency selection criteria predict performance in orthopaedic surgery residency? Clin Orthop Relat Res. 2016;474:908–914.

8.

Carmichael KD, Westmoreland JB, Thomas JA, Patterson RM. Relation of residency selection factors to subsequent orthopaedic in-training examination performance. South Med J. 2005;98(5):528–532.

9.

Hall FR, Bailey BA. Correlating students’ undergraduate science GPAs, their MCAT scores, and the academic caliber of their undergraduate colleges with their first-year academic performances across five classes at Dartmouth Medical School. Acad Med. 1992;67:121–123.

10.

Callahan CA, Hojat M, Veloski J, Erdmann JB, Gonnella JS. The predictive validity of three versions of the MCAT in relation to performance in medical school, residency, and licensing examinations: a longitudinal study of 36 classes of Jefferson Medical College. Acad Med. 2010;85(6):980–987.

11.

Donnon T, Paolucci EO, Violato C. The predictive validity of the MCAT for medical school performance and medical board licensing examinations: a meta-analysis of the published research. Acad Med. 2007;82(1):100–106.

12.

Gauer JL, Wolff J, Jackson JB. Do MCAT scores predict USMLE scores? An analysis on 5 years of medical student data. Med Educ Online. 2016;21:31795

13.

Veloski JJ, Callahan CA, Xu G, Hojat M, Nash DB. Prediction of students’ performances on licensing examinations using age, race, sex, undergraduate GPAs, and MCAT scores. Acad Med. 2000;75(10 Suppl):S28–S30.

14.

Alpha Omega Alpha [homepage on the Internet]. University of Minnesota Medical School election criteria. Available from: http://alphaomegaalpha.org/alpha_minnesota_elections.html. Accessed April 14, 2017.

15.

Witzburg RA, Sondheimer HM. Holistic review – shaping the medical profession one applicant at a time. N Engl J Med. 2013;368(17):1565–1567.

16.

Association of American Medical Colleges. Holistic Review Homepage. Association of American Medical Colleges website. Available from: https://www.aamc.org/initiatives/holisticreview/. Accessed April 14, 2017.

17.

Boatright D, Ross D, O’Connor P, Moore E, Nunez-Smith M. Racial disparities in medical student membership in the Alpha Omega Alpha Honor Society. JAMA Intern Med. 2017;177:659–665.

18.

Davis D, Dorsey JK, Franks RD, Sackett PR, Searcy CA, Zhao X. Do racial and ethnic group differences in performance on the MCAT exam reflect test bias? Acad Med. 2013;88(5):593–602.

19.

Schwartztein RM, Rosenfeld GC, Hilborn R, Oyewole SH, Mitchell K. Redesigning the MCAT exam: balancing multiple perspectives. Acad Med. 2013;88(5):560–567.

Creative Commons License © 2017 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.