Back to Journals » Advances in Medical Education and Practice » Volume 5

An international validation study of two achievement goal measures in a pharmacy education context

Authors Alrakaf S, Abdelmageed A, Kiersma M, Coulman S, John D, Tordoff J , Anderson C , Noreddin A, Sainsbury E, Rose G, Smith L 

Received 22 May 2014

Accepted for publication 7 July 2014

Published 27 September 2014 Volume 2014:5 Pages 339—345

DOI https://doi.org/10.2147/AMEP.S68241

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 3



Saleh Alrakaf,1 Ahmed Abdelmageed,2 Mary Kiersma,2 Sion A Coulman,3 Dai N John,3 June Tordoff,4 Claire Anderson,5 Ayman Noreddin,6 Erica Sainsbury,1 Grenville Rose,7 Lorraine Smith1

1Faculty of Pharmacy, University of Sydney, Sydney, NSW, Australia; 2Faculty of Pharmacy, Manchester University, Fort Wayne, IN, USA; 3School of Pharmacy and Pharmaceutical Sciences, Cardiff University, Cardiff, UK; 4School of Pharmacy, University of Otago, Dunedin, NZ; 5School of Pharmacy, University of Nottingham, Nottingham, UK; 6School of Pharmacy, Hampton University, Hampton, VA, USA; 7Aftercare, Sydney, NSW, Australia

Background: Achievement goal theory helps us understand what motivates students to participate in educational activities. However, measuring achievement goals in a precise manner is problematic. Elliot and McGregor's Achievement Goal Questionnaire (AGQ) and Elliot and Murayama's revised Achievement Goal Questionnaire (AGQ-R) are widely used to assess students' achievement goals. Both instruments were developed and validated using undergraduate psychology students in the USA.
Methods: In this study, our aims were to first of all, assess the construct validity of both questionnaires using a cohort of Australian pharmacy students and, subsequently, to test the generalizability and replicability of these tools more widely in schools of pharmacy in other English-speaking countries. The AGQ and the AGQ-R were administered during tutorial class time. Confirmatory factor analysis procedures, using AMOS 19 software, were performed to determine model fit.
Results: In contrast to the scale developers' findings, confirmatory factor analysis supported a superior model fit for the AGQ compared with the AGQ-R, in all countries under study.
Conclusion: Validating measures of achievement goal motivation for use in pharmacy education is necessary and has implications for future research. Based on these results, the AGQ will be used to conduct future cross-sectional and longitudinal analyses of the achievement goals of undergraduate pharmacy students from these countries.

Keyword: confirmatory factor analysis, achievement goal theory, pharmacy education

Introduction

For more than three decades, achievement goal theory has been one of the most important motivational theories in the field of education and has undergone significant conceptual development during this time.13 Achievement goals are precise types of goals that consider “competence” as the aim for any individual.4 Achievement goals are defined as a “future-focused cognitive representation that guides behavior to a competence-related end state that the individual is committed to either approach or avoid”.5 Current understanding centers around four types of goals that are seen to influence motivation for students’ achievement in learning environments. These are: 1) Mastery-Approach (M-AP), where the individual is motivated to learn or improve his/her skills; 2) Mastery-Avoidance (M-AV), where the individual is motivated to avoid failure to learn or declines in skill; 3) Performance-Approach (P-AP), where the individual is motivated to outperform others or appear talented; and 4) Performance-Avoidance (P-AV), where the individual is motivated to avoid doing worse than others or appearing less talented.610

A number of studies have linked the M-AP goal to positive outcomes, such as high interest,11 high persistence,12 using deep learning strategies,13 and seeking help when needed.14 However, despite these beneficial outcomes, no significant positive relationship between this type of achievement goal and academic achievement has been found.5,9 The P-AP goal, however, is associated with different effects. On the one hand, it is linked to memorization instead of deep learning15 and on the other, this type of achievement goal has a significant positive correlation with academic achievement.9,1618 The avoidance types of achievement goals (ie, M-AV and P-AV) are associated with negative outcomes, such as low intrinsic motivation, anxiety, and low academic achievement.1925

Despite the positive contributions achievement goal theory has made to the field of education, achieving precision in measuring these achievement goals has been difficult,5,26 and this is reflected in researchers’ continued endeavors to examine the theoretical underpinnings of achievement goal motivation. For example, one well-known instrument is the Achievement Goals Questionnaire (AGQ),6,27 reported by Elliot and McGregor.6 This instrument was developed and validated in higher education settings in the US, using a cohort of psychology students. More recently, the AGQ underwent further refinement in an attempt to develop a more precise instrument. According to Elliot and Murayama,26 some items on the AGQ assess either a value (eg, “It is important for me to do better than other students”) or a concern (eg, “I worry that I may not learn all that I possibly could in this class”), instead of a goal. In addition, the authors argued that one of the items intended to measure the P-AV construct was instead, measuring the goal with the reason behind this goal (eg, “My fear of performing poorly in this class is often what motivates me”). According to the authors Elliot and Murayama, the AGQ was designed to measure the goal regardless of the reasons behind it. Furthermore, Elliot and Murayama argued that the word “grades” that appears in one item intended to measure the P-AP construct could be applicable for both mastery and performance goals. Based on these concerns, a Revised Achievement Goal Questionnaire (AGQ-R)26 was developed by Elliot and Murayama, which was administered to undergraduate psychology students enrolled in US universities. In both questionnaires (Figure 1), each achievement goal is measured by three variables (ie, 12 variables for each questionnaire). Elliot and Murayama26 used confirmatory factor analysis to compare the construct validity of the AGQ with the AGQ-R, and the latter was found to provide a better fit to the data and to be superior to the AGQ in predicting and determining achievement goals.26

Figure 1 Schematic model of relationship between construct and questionnaire items.
Abbreviation: I, item.

More recently, Elliot et al2 developed a new questionnaire that builds on the achievement goal construct. This questionnaire measures six types of achievement goals: task-approach, task-avoidance, self-approach, self-avoidance, other-approach, and other-avoidance.2 These achievement goals have some similarities with the “classical achievement goals”, for example, “task” goals are mirrored in the performance goals and “self” goals are mirrored in the mastery goals. However, these new developments are beyond the scope of the current study.

Comparative face validity review of the content of AGQ and AGQ-R suggests that some items in the revised questionnaire are confusing and hard to understand. However, face validity review can be influenced by subjectivity and is less empirical28,29 than an examination of the construct validity of the two instruments. The construct validity approach provides a more rigorous and defensible method of assessing the relationships between the questionnaire items and the achievement goal constructs they are purported to measure.3032 Furthermore, it is possible that in a different educational context and discipline area, such as a pharmacy education setting, these two measures may not be as precise in their measurement of university student achievement goal orientations. In addition, very little research has been conducted to investigate the utility of scales for measuring achievement goals in different educational settings, including pharmacy education. The research that has been conducted in this field has related more to learning styles,33,34 rather than achievement goals.

Validation of the AGQ and AGQ-R in an Australian pharmacy education setting is an important first step in determining the usability of these scales at a local level. However, since multinational data might influence the validity of these questionnaires,35 inclusion of participants from different countries will provide a more rigorous and generalizable investigation of the validity of the AGQ and AGQ-R measures. To our knowledge, there have been no cross-national validation studies of the motivational preferences of pharmacy students. Thus, results of this study will lay a foundation for future studies into undergraduate pharmacy students’ achievement goals and will facilitate comparative and longitudinal research between different countries. Knowing pharmacy students’ achievement goals will provide academics with invaluable understanding of how their students respond when they encounter academic activity.23 Yet the first step is to determine a precise instrument to use for measuring these goals.

Therefore, the aims of this project were to, first, assess the construct validity of the AGQ and AGQ-R, using a cohort of Australian undergraduate pharmacy students and, subsequently, to test the generalizability and replicability of these tools in schools of pharmacy in other English-speaking countries. Ultimately, the most psychometrically appropriate version of the model can be determined.

Methods

Ethical approval was granted by human ethics committees at the six participating universities.

Sample and procedure

Study 1

Australian participants for this study were undergraduate students enrolled in the 4-year Bachelor of Pharmacy degree at the Faculty of Pharmacy, University of Sydney. The study was initiated during the first semester of 2012.

The researchers invited students to participate in the study during normal lecture or tutorial periods. They were advised that participation was voluntary and that if they chose to participate, they could withdraw from the project at any time. In addition, students were advised that their decision to participate would not impact on their academic results or influence their student–teacher relationships. Researchers approached the students as a group and not individually. The questionnaires were administrated to students in paper form by the researchers. Completion of the questionnaires took approximately 15 minutes.

Study 2

International participants were those students enrolled in a professional pharmacy degree program at universities in the US (two universities), UK (two universities), and New Zealand (one university). The locations for data collection were selected by the first and last authors, who contacted researchers in different countries of interest at pharmaceutical conferences. The three locations were purposefully chosen as they are comparable in terms of language, education, and culture. The data collection method for Study 2 (international study) was the same as for Study 1 (Australian study).

English proficiency was an essential criterion for admission at all the participating universities. Such proficiency is measured either by International English Learning Testing System (IELTS) or Test of English as a Foreign Language (TOEFL) exams.3641

Materials

The AGQ and AGQ-R6,26 were used. Both questionnaires contain 12 items that are intended to measure the constructs underpinning achievement goal motivation, known as latent factors. In the AGQ and AGQ-R models, these latent factors are the four goal orientations (P-AP, M-AV, M-AP, and P-AV). The AGQ uses a seven-point Likert scale, scored from 1= “not at all true of me” to 7= “very true of me”, and the AGQ-R uses a five-point Likert scale, scored from from 1= “strongly disagree” to 5= “strongly agree”. The questionnaires were combined into one survey, a total of 24 questions. Sociodemographic indicators included in the survey were sex and age.

Analysis

SPSS Statistics for Windows, Version 21.0 (IBM Corp, Armonk, NY, USA) was used for descriptive statistics regarding year group, sex, and age for all participants. Confirmatory factor analyses, using IBM SPSS AMOS 21.0 (IBM Corp.) software, were conducted on the data, for both the AGQ and AGQ-R, to determine whether the data replicated the expected factor/scale structure. The analyses were conducted on covariance matrices, and the solutions were generated on the basis of maximum likelihood estimation. No modifications were made to the model, which was a direct replication of the original model developed by Elliot et al (ie, Elliot and McGregor, and Elliot and Murayama).

The quality of any instrument is evaluated by its goodness of fit to the data.42 The most commonly used and reliable fit indices are the Comparative Fit Index (CFI), Tucker-Lewis Index (TLI), chi-square degrees of freedom ratio or normalized chi square (χ2/df), Akaike Information Criterion (AIC), and root-mean-square error of approximation (RMSEA).4246

On this basis, therefore, several indexes were used in this study, to compare the fit of the models to the data: χ2/df, CFI, TLI, AIC, and RMSEA. The following criteria were used to assess the adequacy of model fit: χ2/df ≤2.0,47 CFI ≥0.90,48 TLI ≥0.90,48 AIC (the minimum value of the two models),49 and RMSEA ≤0.08.48

The Australian and UK sample sizes were sufficient to conduct separate confirmatory factor analyses; however, the New Zealand and US sample sizes were not (n<5 participants per observed variable).50 For this reason, we combined both countries into one group (NZ/US). The Australian data set was analyzed first, followed by the UK and NZ/US data set.

Results

Study 1: Australia

A total of 209 students (122 female and 78 male), with a mean age of 21.4 years, completed the questionnaires (Table 1).

Table 1 Participant demographics
Note: N=877.
Abbreviation: SD, standard deviation.

Factor loadings and correlations

The results of factor loadings for AGQ and AGQ-R are shown in Table 2. For the AGQ, the model shows overall high to very high loadings between observed indicators (questionnaire items) and their related latent factors, ranging from λ=0.67 to λ=0.95. Similar results were obtained from the AGQ-R model. However, in this revised model, one observed indicator (Item 3) in particular showed a weak relationship (λ=0.49) with its latent factor (M-AV).

Table 2 Factor loadings: AGQ and AGQ-R
Abbreviations: AGQ, Achievement Goal Questionnaire; AGQ-R, Achievement Goal Questionnaire – Revised.

As shown in Table 3, correlations between the latent factors in the AGQ were weak, suggesting the presence of distinct constructs. In contrast, the correlations between the latent factors in the AGQ-R were somewhat higher, especially between the M-AP and M-AV, and P-AP and P-AV constructs (Cronbach’s α =0.84 and =0.79, respectively).

Table 3 Factor correlations for AGQ/AGQ-R
Abbreviations: AGQ, Achievement Goal Questionnaire; AGQ-R, Achievement Goal Questionnaire – Revised.

Fit indices

Table 4 shows the results of fit indices for both models. The AGQ model showed good fit for data (eg, χ2/df =1.80, RMSEA =0.06). However, the AGQ-R showed poor fit for the Australian data (eg, χ2/df =2.58, RMSEA =0.09).

Table 4 Goodness of fit summary for AGQ and AGQ-R*
Notes: *Recommended criteria: χ2/df ≤2.0, CFI ≥0.90, TLI ≥0.90, AIC – minimum value of the two models; RMSEA ≤0.08.
Abbreviations: AGQ, Achievement Goal Questionnaire; AGQ-R, Achievement Goal Questionnaire – Revised; AIC, Akaike Information Criterion; CFI, Comparative Fit Index; RMSEA, root-mean-square error of approximation; TLI, Tucker-Lewis Index; df, degrees of freedom.

Study 2: UK and NZ/US

A total of 667 out of 721 students (92.5%) (483 female, 232 male, and six with undisclosed sex), with a mean age of 21.7 years, completed both questionnaires in this study. We deleted cases containing incomplete data (54 participants).31 Descriptive statistics for the participants, by country, are reported in Table 1.

Factor loadings and correlations

Table 2 presents the factor loadings for the AGQ and AGQ-R models. For the AGQ, in UK and NZ/US samples, the model showed overall medium to high loadings between the observed indicators and their related latent factors, ranging from λ=0.94 to λ=0.54. Similar factor loading results were obtained for the AGQ-R (Table 3), with factor loadings ranging from λ=0.92 to λ=0.52.

In both the UK and NZ/US samples, the AGQ produced a weak correlation between the model’s latent factors, thus suggesting the presence of distinct constructs (Table 3). However, the correlations between the latent factors (Table 3) were somewhat higher in the AGQ-R, especially between the P-AP and P-AV constructs (Cronbach’s α =0.69 and 0.71, for the UK and NZ/US, respectively).

Fit indices

The AGQ model showed good fit for the UK and NZ/US data (eg, χ2/df =1.92, RMSEA =0.05 for the UK; χ2/df =1.65, RMSEA =0.06 for NZ/US). However, the AGQ-R showed poor fit for the UK and NZ/US data (Table 4) (eg, χ2/df =5.01, RMSEA =0.09 for the UK; χ2/df =3.82, RMSEA =0.11 for NZ/US).

Discussion

Although the positive impact of achievement goal theory on education in general and higher education specifically is well known, measuring achievement goals in a precise manner is problematic.5 The AGQ and AGQ-R are validated instruments widely used to assess students’ achievement goals. In this study, our aims were to assess the construct validity of the AGQ and AGQ-R, using a cohort of Australian pharmacy students, in order to determine the most psychometrically appropriate version of the model and to assess the applicability and generalizability of both questionnaires across a range of pharmacy disciplines in English-speaking countries.

In contrast to Elliot and Murayama’s findings,26 our results show the AGQ to be a more robust measure of pharmacy students’ achievement goal orientations compared with the AGQ-R, in all six study sites. The factor loadings, correlations, and fit indices all indicate that the AGQ demonstrated better construct validity when using an international pharmacy student cohort. Results indicate that students from six schools of pharmacy in four different countries were better able to understand and interpret the questionnaire items for the AGQ than the AGQ-R, that the AGQ was a more appropriate measure of achievement goals in our pharmacy cohorts, and that the AGQ was a more psychometrically robust measure than the AGQ-R.

Item 3, “I am striving to avoid an incomplete understanding of the course material”, in particular, appears to be problematic. It showed low factor loadings across all samples in our study (λ ranging from 0.49 to 0.59). Such a low factor loading may be attributed to the double negative construction of this item, which is in general, hard to understand.51 Interestingly, this finding mirrors those reported by Hart et al,52 whose validation study utilizing a sample of African American high school students revealed that Item 3, with its latent factor M-AV, had a low factor loading (λ=0.42). Furthermore, Hart et al52 also found high correlations between achievement goal constructs in the AGQ-R, especially between P-AP and P-AV, suggesting that the model cannot measure separate latent factors effectively.

The findings in our study, contradictory to those of Elliot and Murayama, may be attributed to the differences between the cohorts used in the original validation study and the current study. To the best of our knowledge, there are no studies that compare pharmacy and psychology students’ learning styles and achievement goals, and therefore further work is warranted to better understand any differences between the two subject areas. Overall, these results emphasize the importance of confirming the validation of measures of achievement goal motivation in different educational settings.

Limitations

In interpreting the study’s findings, it is important to note to its limitations. The findings might not be generalizable to all pharmacy students as only four countries were included in this study. Additional construct validity studies for both questionnaires, using pharmacy students from other cultures, is required before we can generalize our findings globally. This study has laid a foundation for future studies into pharmacy students’ achievement goals and will facilitate comparative and longitudinal research between different countries to better understand students’ motivations.

Conclusion

The AGQ met the criteria for a good-fitting model in the context under investigation, while the AGQ-R did not, which is in contrast to the findings of Elliot and Murayama. Based on these results, the research will proceed to cross-sectional and longitudinal studies of the goal orientations and approaches to learning of pharmacy students, using the AGQ. Furthering our understanding of achievement goal constructs and their relevance to pharmacy education may facilitate future improvements to pharmacy education teaching and learning.

Disclosure

The authors report no conflicts of interest in this work.


References

1.

Conley AM. Patterns of motivation beliefs: Combining achievement goal and expectancy-value perspectives. J Educ Psychol. 2012;104(1):32–47.

2.

Elliot AJ, Murayama K, Pekrun R. A 3 x 2 achievement goal model. J Educ Psychol. 2011;103(3):632–468.

3.

Kaplan A, Maehr ML. The contributions and prospects of goal orientation theory. Educ Psychol Rev. 2007;19(2):141–184.

4.

Elliot AJ, Dweck CS. Competence and motivation: competence as the core of achievement motivation. In: Elliot AJ, Dweck CS, editors. Handbook of Competence and Motivation. New York, NY: The Guilford Press; 2005:3–12.

5.

Hulleman CS, Schrager SM, Bodmann SM, Harackiewicz JM. A meta-analytic review of achievement goal measures: different labels for the same constructs or different constructs with similar labels? Psychol Bull. 2010;136(3):422–449.

6.

Elliot AJ, McGregor HA. A 2 X 2 achievement goal framework. J Pers Soc Psychol. 2001;80(3):501–519.

7.

Elliot AJ, Thrash T. Achievement goals and the hierarchical model of achievement motivation. Educ Psychol Rev. 2001;13(2):139–156.

8.

Huang C. Discriminant and criterion-related validity of achievement goals in predicting academic achievement: A meta-analysis. J Educ Psychol. 2012;104(1):48–73.

9.

Hulleman CS, Senko C. Up round the bend: forecasts for achievement goal theory and research in 2020. In: Urdan TC, Karabenick SA, editors. The Decade Ahead: Theoretical Perspectives on Motivation and Achievement. Bingley: Emerald Group Publishing Limited; 2010:71–104.

10.

Murayama K, Elliot AJ, Yamagata S. Separation of performance-approach and performance-avoidance achievement goals: a broader analysis. J Educ Psychol. 2011;103(1):238–256.

11.

Harackiewicz JM, Barron KE, Pintrich PR, Elliot AJ, Thrash TM. Revision of achievement goal theory: necessary and illuminating. J Educ Psychol. 2002;94(3):638–645.

12.

Wolters CA. Advancing achievement goal theory: using goal structures and goal orientations to predict students’ motivation, cognition, and achievement. J Educ Psychol. 2004;96(2):236–250.

13.

Diseth Å. Self-efficacy, goal orientations and learning strategies as mediators between preceding and subsequent academic achievement. Learn Individ Differ. 2011;21(2):191–195.

14.

Roussel P, Elliot AJ, Feltman R. The influence of achievement goals and social goals on help-seeking from peers in an academic context. Learn Instr. 2011;21(3):394–402.

15.

Elliot AJ, McGregor HA, Gable S. Achievement goals, study strategies, and exam performance: A mediational analysis. J Educ Psychol. 1999; 91(3):549–563.

16.

Barron KE, Harackiewicz JM. Achievement goals and optimal motivation: testing multiple goal models. J Pers Soc Psychol. 2001;80(5):706–722.

17.

Cury F, Elliot AJ, Da Fonseca D, Moller AC. The social-cognitive model of achievement motivation and the 2 x 2 achievement goal framework. J Pers Soc Psychol. 2006;90(4):666–679.

18.

Barron KE, Harackiewicz JM. Achievement goals and optimal motivation: testing multiple goal models. J Pers Soc Psychol. 2001;80(5):706–722.

19.

Putwain DW, Symes W. Achievement goals as mediators of the relationship between competence beliefs and test anxiety. Br J Educ Psychol. 2012;82(Pt 2):207–224.

20.

Maier MA, Barchfeld P, Elliot AJ, Pekrun R. Context specificity of implicit preferences: the case of human preference for red. Emotion. 2009;9(5):734–738.

21.

Stamovlasis D, Sideridis GD. Ought-approach versus ought-avoidance: nonlinear effects on arousal under achievement situations. Nonlinear Dynamics Psychol Life Sci. 2014;18(1):67–90.

22.

Murayama K, Elliot AJ. The competition-performance relation: a meta-analytic review and test of the opposing processes model of competition and performance. Psychol Bull. 2012;138(6):1035–1070.

23.

Van Yperen NW. A novel approach to assessing achievement goals in the context of the 2 x 2 framework: identifying distinct profiles of individuals with different dominant achievement goals. Pers Soc Psychol Bull. 2006;32(11):1432–1445.

24.

Linnenbrink-Garcia L, Patall EA, Messersmith EE. Antecedents and consequences of situational interest. Br J Educ Psychol. 2013;83(Pt 4):591–614.

25.

Van Yperen NW. A novel approach to assessing achievement goals in the context of the 2 x 2 framework: identifying distinct profiles of individuals with different dominant achievement goals. Pers Soc Psychol Bull. 2006;32(11):1432–1445.

26.

Elliot AJ, Murayama K. On the measurement of achievement goals: critique, illustration, and application. J Educ Psychol. 2008;100(3):613–628.

27.

Muis KR, Winne PH. Assessing the psychometric properties of the achievement goals questionnaire across task contexts. CJE. 2012;35(2):232–248.

28.

Goodwin CJ. Research in Psychology: Methods and Design. 6th ed. Hoboken, NJ: John Wiley & Son Inc.; 2010.

29.

Sushil S, Verma N. Questionnaire validation made easy. Eur J Sci Res. 2010;46(2):172–178.

30.

DeVon HA, Block ME, Moyle-Wright P, et al. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007;39(2):155–164.

31.

Kane MT. Current concerns in validity theory. J Educ Meas. 2001;38(4):319–342.

32.

Parsian N, Dunning TAM. Developing and validating a questionnaire to measure spirituality: a psychometric process. Glob J Health Sci. 2009;1(1):2–11.

33.

Smith L, Krass I, Sainsbury E, Rose G. Pharmacy students’ approaches to learning in undergraduate and graduate entry programs. Am J Pharm Educ. 2010;74(6):106.

34.

Smith L, Saini B, Krass I, Chen T, Bosnic-Anticevich S, Sainsbury E. Pharmacy students’ approaches to learning in an Australian university. Am J Pharm Educ. 2007;71(6):120.

35.

Klassen RM, Tze VM, Hannok W. Internalizing problems of adults with learning disabilities: a meta-analysis. J Learn Disabil. 2013;46(4):317–327.

36.

Sydney.edu.au [homepage on the Internet]. Bachelor of pharmacy. The University of Sydney 2013 [updated August 11, 2014; cited June 19, 2014]. Available from: http://sydney.edu.au/courses/Bachelor-of-Pharmacy. Accessed August 11, 2014.

37.

manchester.edu [homepage on the Internet]. FAQs. Manchester University; 2014 [cited June 19, 2014]. Available from: http://admissions.manchester.edu/international-students/frequently-asked-questions. Accessed August 11, 2014.

38.

cardiff.ac.uk [homepage on the Internet]. Cardiff University. English and foundation courses. IELTS test centre. IELTS™. Cardiff University; 2014 [cited June 19, 2014]. Available from: http://cardiff.ac.uk/for/prospective/international/english-foundation-courses/english-language-programmes/ielts.html. Accessed August 11, 2014.

39.

otago.ac.nz [homepage on the Internet]. Applying for an undergraduate programme. University of Otago; 2014 [cited June 19, 2014]. Available from: http://www.otago.ac.nz/international/undergraduate/index.html. Accessed August 11, 2014.

40.

nottingham.ac.uk [homepage on the Internet]. School of Pharmacy. Entry requirements – undergraduates. University of Nottingham; 2014 [cited June 19, 2014]. Available from: http://www.nottingham.ac.uk/pharmacy/prospectivestudents/undergraduates/entryreqs-ugs.aspx. Accessed August 11, 2014.

41.

hampton.edu [homepage on the Internet]. Admission requirements. Hampton University; 2014 [cited June 19, 2014]. Available from: http://www.hamptonu.edu/apply/requirements.cfm. Accessed August 11, 2014.

42.

Brown TA. Confirmatory Factor Analysis for Applied Research. New York, NY: Guilford Press; 2006.

43.

Heene M, Hilbert S, Freudenthaler HH, Buhner M. Sensitivity of SEM fit indexes with respect to violations of uncorrelated errors. Struct Equ Modeling. 2012;19(1):36–50.

44.

Hooper D, Coughlan J, Mullen MR. Structural equation modelling: guidelines for determining model fit. EJBRM. 2008;6(1):53–60.

45.

In’nami Y, Koizumi R. Structural equation modeling in language testing and learning research: a review. Lang Assess Q. 2011;8(3):250–276.

46.

Lombardi L, Pastore M. Sensitivity of fit indices to fake perturbation of ordinal data: a sample by replacement approach. Multivariate Behav Res. 2012;47(4):519–546.

47.

Hair JF Jr, Anderson RE, Tatham RL, Black WC. Multivariate Data Analysis with Readings. 4th ed. Upper Saddle River, NJ: Prentice Hall; 1995.

48.

Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen KA, Long JS, editors. Testing Structural Equation Models. Newbury Park, CA: Sage Publications, Inc.; 1993:136–162.

49.

Burnham KP, Anderson DR. Multimodel inference. Understanding AIC and BIC in model selection. Sociol Methods Res. 2004;33(2):261–304.

50.

Bryant FB, Yarnold PR. Principal-components analysis and exploratory and confirmatory factor analysis. In: Grimm LG, Yarnold PR, editors. Reading and Understanding Multivariate Statistics. Washington, DC: American Psychological Association; 1995:99–136.

51.

Rosenthal DJA. Logical quantifiers in affirmative and negative contexts. J Gen Psychol. 1980;102(1):99–106.

52.

Hart CO, Mueller CE, Royal KD, Jones MH. Achievement goal validation among African American high school students CFA and Rasch results. J Psychoeduc Assess. 2013;31(3):284–299.

Creative Commons License © 2014 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.