Validity and reliability of Mini-Mental State Examination in Older Adults in China: Inline Mini-Mental State Examination with cognitive functions

Authors

  • Teck Kiang Tan Institute for Applied Learning Sciences and Educational Technology, National University of Singapore, Singapore
  • Qiushi Feng Department of Sociology, Centre for Family and Population Research, National University of Singapore, Singapore

DOI:

https://doi.org/10.18063/ijps.v8i1.1285

Keywords:

Mini-Mental State Examination, Validation, Exploratory factor analysis, Confirmatory factor analysis, Factorial invariance

Abstract

The main aim of the study is to validate the factor structure of the Mini-Mental State Examination (MMSE) of China’s older population using the Chinese Longitudinal Healthy Longevity Survey. The validation process used the exploratory factor analysis (EFA) to determine the number of dimensions of MMSE, the confirmatory factor analysis (CFA) to confirm the factorial structure of MMSE, and the factorial invariance to conclude the factor structure does not differ between the young-old (aged 65 – 79) and old-old (aged 80 or older). The results of the EFAs suggested two possible factor structures: A six-factor and a seven-factor solution. The seven-factor confirmatory factor model turned out as the best fit by comparison to the four competing confirmatory models. Strict factorial invariance was attained for the two age groups, indicating a high level of measurement equality, a property of invariance was seldom achieved in the literature of factorial invariance studies. In comparison to the MMSE literature that focused solely on EFA that aims to establish a single summated score, the present study suggests using EFA, CFA, and factorial invariance that takes into consideration of measurement errors as the preferred procedure since it establishes the appropriate MMSE dimensionality that is in line with their respective cognitive functions.

Author Biographies

Teck Kiang Tan, Institute for Applied Learning Sciences and Educational Technology, National University of Singapore, Singapore

Institute for Applied Learning Sciences and Educational Technology

Senior Research Fellow

Qiushi Feng, Department of Sociology, Centre for Family and Population Research, National University of Singapore, Singapore

Department of Sociology

Associate Professor

References

Arevalo-Rodriguez I, Smailagic N, Roqué-Figuls M, et al. (2021). Mini-mental state examination (MMSE) for the early detection of dementia in people with mild cognitive impairment (MCI). Cochrane Database of Systematic Reviews, 7(7):CD010783. https:// doi.org/10.1002/14651858.CD010783.pub3

Baek MJ, Kim K, Park YH, et al. (2016). The validity and reliability of the MMSE-2 for detecting mild cognitive impairment and Alzheimer’s disease in a Korean population. PLoS One, 11(9):e0163792. https://doi.org/10.1371/journal.pone.0163792

Bartlett MS. (1951). The effect of standardization on a Chi-Square approximation in factor analysis. Biometrika, 38:337-344. https:// doi.org/10.1093/biomet/38.3-4.337

Bentler PM. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107:238-246. https://doi.org/10.1037/0033- 2909.107.2.238

Bentler PM. (1995). EQS 5 [Computer Program]. Encino, CA: Multivariate Software Inc.

Bollen K and Lennox R. (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110:305-314. https://doi.org/10.1037/0033-2909.110.2.305

Bollen KA. (1989). Structural Equations with Latent Variables. New York: Wiley.

Brown TA. (2006). Confirmatory Factor Analysis for Applied Research. New York: The Guilford Press.

Browne MW and Cudeck R. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21:230-258. https:// doi.org/10.1177/0049124192021002005

Burke SL, Grudzien A, Burgess A, et al. (2021). The utility of cognitive screeners in the detection of dementia spectrum disorders in Spanish-speaking populations. Journal of Geriatric Psychiatry and Neurology, 34(2):102-118. https://doi. org/10.1177/0891988720915513

Cattell RB. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1:245-276. https://doi.org/10.1207/ s15327906mbr0102_10

Cheung GW and Rensvold RB. (2002). Evaluating goodness of fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2):233-255. https://doi.org/10.1207/s15328007sem0902_5

CLHLS. (2020). Chinese Longitudinal Healthy Longevity Survey, Data Collection and Quality Control Procedures. Available from: https://sites.duke.edu/centerforaging/programs/chinese-longitudinal-healthy-longevity-survey-clhls/design-method-study-population/design-method-data-collection-quality-control-procedures. [Last accessed on 2022 Jan 26]. https://doi. org/10.1007/978-1-4020-6752-5_2

Comtois D. (2021). summarytools: Tools to Quickly and Neatly Summarize Data. R package version 1.0.0. Available from: https:// CRAN.R-project.org/package=summarytools.[Last accessed on 2022 Jan 26].

Davey RJ and Jamieson S. (2004). The validity of using the mini-mental state examination in NICE dementia guidelines. Journal of Neurology Neurosurgery and Psychiatry, 75:343-344.

Deb S and Braganza J. (1999). Comparison of rating scales for the diagnosis of dementia in adults with Down’s syndrome. Journal of Intellectual Disability Research, 43(5):400-407. https://doi.org/10.1046/j.1365-2788.1999.043005400.x

Dinno A. (2009). Exploring the sensitivity of Horn’s parallel analysis to the distributional form of simulated data. Multivariate Behavioral Research, 44(3):362-388. https://doi.org/10.1080/00273170902938969

Fillenbaum GG, Heyman A, Wilkinson WE, et al. (1987). Comparison of two screening tests in Alzheimer’s disease. The correlation and reliability of the mini-mental state examination and the modified blessed test. Archives of Neurology, 44:924-927. https://doi. org/10.1001/archneur.1987.00520210026014

Finch WH. (2020). Using fit statistic differences to determine the optimal number of factors to retain in an exploratirt factor analysis. Educational and Psychological Measurement, 80(2):217-241. https://doi.org/10.1177/0013164419865769

Folstein MF, Folstein SE, and McHugh PR. (1975). “Mini-mental state”: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12:189-198. https://doi.org/10.1016/0022-3956(75)90026-6

Fox, J. (2019). polycor: Polychoric and Polyserial Correlations. R package version 0.7-10. Available from: https://CRAN.R-project. org/package=polycor. [Last accessed on 2022 Jan 26].

Garrodp LE, Abad FJ, and Ponsoda V. (2013). A new look at Horn’s parallel analysis with ordinal variables. American Psychological Association, 18(4):454-474. https://doi.org/10.1037/a0030005

Glorfeld LW. (1995). An Improvement on Horn’s parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement, 55(3):377-393. https://doi.org/10.1177/0013164495055003002

Gu D. (2005). Assessment of Data Quality of the Chinese Longitudinal Healthy Longevity Survey in 2002. The CLHLS Technical Report No.2005-1.

Gu D, Feng Q, Chen H, et al. (2021). Chinese longitudinal healthy longevity survey. In: D Gu and ME Dupre (eds.). Encyclopedia of Gerontology and Population Aging. Switzerland AG, Cham: Springer Nature. p.957-970.

Hayton JC, Allen DG, and Scarpello V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2):191-205. https://doi.org/10.1177/1094428104263675

Horn JL and McArdle JJ. (1992). A practical and theoretical guide to MI in aging research. Experimental Aging Research, 18:117-144. https://doi.org/10.1080/03610739208253916

Horn JL. (1965). A rationale and a test for the number of factors in factor analysis. Psychometrika, 30:179-185. https://doi.org/10.1007/ bf02289447

Hsieh SW, Wu DW, Wang CW, et al. (2021). Poor cognitive function is associated with obstructive lung diseases in Taiwanese adults. International Journal of Environmental Research and Public Health, 18:2344. https://doi.org/10.3390/ijerph18052344

Hu L and Bentler PM. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6:1-55. https://doi.org/10.1080/10705519909540118

Jackson DJ, Gillaspy JA, and Purc-Steogebsib R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1):6-23. https://doi.org/10.1037/a0014694

Jöreskog KG. (1993). Testing structural equation models. In: KA Bollen and JS Long (eds.). Testing Structural Equation Models. Newbury Park, CA: Sage, p.294-316.

Kaiser HF and Rice J. (1974). Little jiffy, mark Iv. Educational and Psychological Measurement, 34(1):111-117. https://doi. org/10.1177/001316447403400115

Kaiser HF. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20:114- 151. http://dx.doi.org/10.1177/001316446002000116

Kaiser HF. (1970). A second generation little jiffy. Psychometrika, 35(4):401-415. https://doi.org/10.1007/BF02291817

Lane FC, Anderson B, Ponce HF, et al. (2012). Factorial invariance of LibQUAL as a measure of library service quality over time. Library and Information Science Research, 34:22-30. https://doi.org/10.1016/j.lisr.2011.07.004

Langa KM, Llewellyn DJ, Lang IA, et al. (2009). Cognitive health among older adults in the United States and in England. BMC Geriatrics, 9:23. https://doi.org10.1186/1471-2318-9-23

Lezak MD, Howieson DB, and Loring DW. (2004). Neuropsychological Assessment. 4th ed. New York: Oxford University Press.

Liau AK, Chow D, Tan TK, et al. (2010). Development and validation of the Personal strengths inventory using exploratory and confirmatory factor analyses. Journal of Psychoeducational Assessment, 29:14-26. https://doi.org/10.1177/0734282910365648

Lim M, Li Z, Xie H, et al. (2019). An Asian study on clinical and psychological factors associated with personal recovery in people with psychosis. BMC Psychiatry, 19:256. https://doi.org/10.1186/s12888-019-2238-9

Meredith W. (1993). Measurement invariance, factor analysis, and factorial invariance. Psychometrika, 58:525-543. https://doi. org/10.1007/bf02294825

Mitchell AJ. (2009). A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. Journal of Psychiatric Research, 43(4):411-431. https://doi.org/10.1016/j.jpsychires.2008.04.014

Mullen M. (1995). Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 3:573- 596. https://doi.org/10.1057/palgrave.jibs.8490187

Osterweil D, Mulford P, Syndulko K, et al. (1994). Cognitive function in old and very old residents of a residential facility: Relationship to age, education, and dementia. Journal of the American Geriatric Society, 42(7):766-773. https://doi.org/10.1111/j.1532-5415.1994. tb06539.x

Park MH, Kwon DY, Jung JM, et al. (2012). Mini-mental status examination as predictors of mortality in the elderly. Acta Psychiatrica Scandinavica, 127:298-304. https://doi.org/10.1111/j.1600-0447.2012.01918.x

Pett MA, Lackey NR, and Sullivan JJ. (2003). Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781412984898

Pomplun M and Omar MH. (2001). The factorial invariance of a test of reading comprehension across groups of limited English proficient students. Applied Measurement in Education, 14:261-283. https://doi.org/10.1207/s15324818ame1403_4

Putnick DL and Bornstein MH. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Development Review, 41:71-90. https://doi.org/10.1016/j.dr.2016.06.004

Reilly S, Challis D, Burns A, et al. (2004). The use of assessment scales in old age psychiatry services in England and Northern Ireland. Aging and Mental Health, 8(3):249-55. https://doi.org/10.1080/13607860410001669787

Revelle W and Rocklin T. (1979). Very simple structure: An alternative procedure for estimating the optimal number of interpretable factors. Multivariate Behavioral Research, 14:403-414. https://doi.org/10.1207/s15327906mbr1404_2

Revelle W. (2021). psych: Procedures for Personality and Psychological Research. Evanston, Illinois, USA: Northwestern University. Available from: https://CRAN.R-project.org/package=psych Version = 2.1.9. [Last accessed on 2022 Jan 26].

Revuelta J, Franco-Martinez A, and Ximénez C. (2021). Nominal factor analysis of situational judgment tests: Evaluation of latent dimensionality and factorial invariance. Educational and Psychological Measurement, 81(6):1054-1088. https://doi. org/10.1177/0013164421994321

Rosseel Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2):1-36. https://doi. org/10.18637/jss.v048.i02

Schürer S, van Ophuysen, S, and Behrmann, L. (2021). A new instrument for assessing cohesion in primary and grammar school classes factorial structure and measurement invariance of the GruKo4. Journal of Psychoeducational Assessment, 39(3):271-285. https:// doi.org/10.1177/0734282920966825

Schwartz G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6:461-464.

Sclove LS. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52:333-343. https://doi.org/10.1007/bf02294360

Shigemori K, Ohgi S, Okuyama E, et al. (2010). The factorial structure of the mini-mental state examination (MMSE) in Japanese dementia patients. BMC Geriatrics, 10:36. https://doi.org/10.1186/1471-2318-10-36

Shulman KI, Herrmann N, Brodaty H, et al. (2006). IPA survey of brief cognitive screening instruments. International Psychogeriatrics, 18:281-294. https://doi.org/10.1017/s1041610205002693

Tinklenberg J, Brooks JO, Tanke ED, et al. (1990). Factor analysis and preliminary validation of the mini-mental state examination from a longitudinal perspective. International Psychogeriatrics, 2(2):123-134. https://doi.org/10.1017/s1041610290000382

Tucker LR and Lewis C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1):1-10. https:// doi.org/10.1007/BF02291170

van der Meulen M, Dirven L, Bakunina K, et al. (2021). MMSE is an independent prognostic factor for survival in primary central nervous system lymphoma. Journal of Neurooncology, 152:357-362. https://doi.org/10.1007/s11060-021-03708-8

Vandenberg RJ and Lance CE. (2000). A review and synthesis of the MI literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3:4-69. https://doi.org/10.1177/109442810031002

Velicer WF and Jackson DN. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25:1-28. https://doi.org/10.1207/s15327906mbr2501_1

Velicer WF. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41:321-327. https://doi.org/10.1007/bf02293557

Wong SS and Fong NK. (2009). Reliability and validity of the telephone version of the cantonese mini-mental state examination (T-SMMSE) when used with elderly patients with and without dementia in Hong Kong. International Psychogeriatrics, 1(2):345- 353. https://doi.org/10.1017/s1041610209008588

Yi Z and Vaupel JW. (2002). Functional capacity and self-evaluation of health and life of oldest old in China. Journal of Social Issue, 58:733-748. https://doi.org/10.1111/1540-4560.00287

Yoon M and Millsap RE. (2007). Detecting violations of factorial invariance using data-based specification searches: A monte carlo study. Structural Equation Modeling, 14(3):435-463. https://doi.org/10.1080/10705510701301677

Zumbo BD, Gadermann AM, and Zeisser C. (2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6(1):21-29. https://doi.org/10.22237/jmasm/1177992180

Downloads

Additional Files

Published

2022-06-08

Issue

Vol. 8 No. 1 (2022)

Section

Research Articles

License

Authors contributing to International Journal of Population Studies agree to publish their articles under the Creative Commons Attribution-Noncommercial 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit, that the work is not used for commercial purposes, and that in the event of reuse or distribution, the terms of this license are made clear. With this license, the authors hold the copyright without restrictions and are allowed to retain publishing rights without restrictions as long as the International Journal of Population Studies is the original publisher of the articles.