Cultural Effects on the Performance of Older Haitian Immigrants on Timed Cognitive Tests

Marie Adonis-Rizzo¹, Ruth M. Tappen¹, Monica Rosselli²˒³, David Newman¹, Joshua Conniff³, Jinwoo Jang⁴, KwangSoo Yang⁵, Borko Furht⁵*

 

1. Christine E. Lynn College of Nursing, Florida Atlantic University, 777 Glades Road NU-84, Boca Raton, FL 33431, USA
2. Department of Psychology, Florida Atlantic University, 3200 College Ave, ES-BC52, Room 268, Davie, FL, 33314, USA
3. Neuropsychology Lab, Department of Psychology, Florida Atlantic University, 777 Glades Road, Boca Raton, FL, 33431, USA
4. Department of Civil Engineering and I-Sense, Florida Atlantic University, 777 Glades Road, EE 503D, Boca Raton, FL, 33431
5. Department of Electrical Engineering and Computer Science, Florida Atlantic University, 777 Glades Road, EE 428 & 526, Boca Raton, FL, 33431

---

OPEN ACCESS

PUBLISHED:30 November 2024

CITATION: Rizzo, MA., et al., 2024. Cultural Effects on the Performance of Older Haitian Immigrants on Timed Cognitive Tests. Medical Research Archives, [online] 12(11).
https://doi.org/10.18103/mra.v12i11.5868

COPYRIGHT: © 2024 European Society of Medicine. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

DOI https://doi.org/10.18103/mra.v12i11.5868

ISSN 2375-1924

ABSTRACT 

Ignoring the cultural factors that can affect cognitive testing outcomes for older adults, particularly those from societies where emphasis is placed upon accuracy rather than speed, potentially contributes to misdiagnosis of Alzheimer’s disease (AD) in many older members of ethnic minority groups. In 2024, 6.9 million older adults in the US and seven million in Europe were living with AD or related dementia. An estimated fifty-five million people globally have been diagnosed with AD or related dementia. This research aims to explore the performance of older Haitian immigrants on timed cognitive tests compared to English-speaking groups.

Keywords: cognitive testing, Alzheimer’s disease, cultural factors, Haitian immigrants, timed cognitive tests

Introduction

Time constraints on neurocognitive tests may impact performance for many older adults, particularly those from societies where emphasis is placed upon accuracy rather than speed, potentially contributing to misdiagnosis of Alzheimer’s disease (AD) in many older members of ethnic minority groups¹. In 2024, 6.9 million older adults in the US and seven million in Europe were living with AD or related dementia. An estimated fifty-five million people globally have been diagnosed with AD or related dementia². Underrepresented groups, such as Black and Hispanic populations, are reported to experience higher rates of the disease which are attributed to factors such as low socioeconomic status and the prevalence of atherosclerotic disease but may also be due in part to the absence of test norms for these groups². The World Health Organization reported that 955 or 1.9 % of total deaths in Haiti are due to Alzheimer’s disease and dementia³.

Early diagnosis and intervention are crucial for timely treatment and slowing the disease’s progression. However, there are concerns about accurately screening and diagnosing individuals from culturally, educationally and linguistically diverse backgrounds.

Recent efforts in cross-cultural research on cognitive testing reflect recognition of the need to evaluate members of ethnic minority groups globally⁴. Caution is needed when using normative data from other groups, as it was neither intended nor developed for them. More specifically, there is also a tendency to group all Black individuals together in research studies instead of recognizing the cultural and educational differences among recent immigrants from Africa and the Caribbean as those whose families may have been resident in the US, UK or other countries for several generations⁴˒⁵˒⁶. South Florida is home to a large and growing population of Afro-Caribbeans, including Haitian Americans. Similarly, large groups of Haitians have established communities in France, Canada, and French Caribbean territories. To date, there are no validated or normed cognitive tests specifically designed for this group of older adults, who are culturally and linguistically distinct. Literature on cognitive testing in this population is also very scarce. The cognitive tests currently available were designed for Western countries and English speakers⁷˒⁵. Some norms have been established for African Americans on tests such as the MoCA, Boston Naming Test, Controlled Word Association, Category Fluency, Animal Naming, Token Test, WRAT-3 Reading, Trail Making Test, Stroop Test, and Judgment of Line Orientation⁷˒⁵. There is no evidence, however, of their applicability or fairness when administered to individuals of Caribbean or African origin.

Several researchers have identified cultural factors such as time orientation as potential contributors to poor performance on timed neuropsychological tests⁸˒⁹. Studies that allow a limited amount of time may be influenced by familiarity with these limitations and the test taker’s culture-based attitudes regarding time. Abreu et al. (1989)¹⁰ argue that the quality of education also impacts cognitive abilities, particularly in ethnic minority groups, who may have experienced educational disparities, particularly related to quality of instruction.

A body of literature on the test performance of non- English speakers has shown mixed findings. Rosselli et al. (2000)¹¹ found that bilingual Spanish-English individuals performed similarly to native English speakers on verbal fluency and repetition tests administered in English. Other studies suggest that bilinguals, through acquiring language skills and vocabulary in a new language, may perform better in executive function tasks including inhibitory control and cognitive flexibility¹². Kisser et al. (2012)¹³ corroborated these findings in their study, where they administered selected measures to native and non-native English speakers. They found that non- native English speakers performed worse on language processing tasks, letter fluency, category fluency, the Cognitive Estimation Test, and Trail Making Test A. However, they had no significant differences in tests of executive functioning

Other researchers have suggested that slower language processing in non-English speakers may play a role in poorer performance on letter and category fluency tasks, as more time is required for word generation¹⁴. However, language interference alone may not fully explain these differences. In a European study, for example, Finnish and Scandinavian participants demonstrated slower processing and working memory speeds than did American, French, and German participants¹⁵. Similarly, Eizaguirre et. al. (2020)¹⁶ found that the performance of Argentinian and Mexican groups were similar on the oral processing speed task, but scores were lower than the Anglo-American groups. These differences were attributed at least in part to cultural attitudes toward test-taking, where accuracy is valued over speed. Rosselli and Ardila (2003)¹⁷ found that Americans tend to focus on fast-paced performance and may do better on cognitive tasks requiring speed than do members of other cultures.

Cognitive test performance depends upon education level and the quality of the education obtained¹⁸. Socioeconomic and political factors and forced migration have contributed to the low literacy rate of Haitian immigrants. Approximately 8% of Haitian schools are public and 92 % are private, resulting in a lack of access to school for many families living in rural areas and neighboring towns¹⁸. Creole is the primary spoken language in Haiti, but French is the primary written language in schools and on the national exams that are required to pass grades 6, 9, and 13, leading to premature dropout from school. Haitian immigrants residing in the US, Canada, Europe, and the Caribbean may not have been exposed to or acquired the skills and strategies needed to perform well on timed cognitive tests.

The purpose of the current study was to explore differences in neuropsychological test performance of two groups of older adults, Creole-speaking immigrants to the U.S. educated primarily in Haiti and English-speaking individuals born and educated in the U.S. We describe the differences in test performance between the two groups and explore the factors that may account for the differences found. It was anticipated that the English-speaking group’s mean scores would be higher on the timed tests due to factors such as differences in education, cultural differences in time perception and lack of familiarity with testing of this type on the part of the Haitian Creole speakers.

Method

DESIGN
This is an exploratory comparative matched pairs design study conducted on data from an ongoing study. This design allowed for the comparison of mean scores on cognitive timed tests of two groups, native Haitian Creole speakers and native English Speakers¹⁹˒²⁰˒²¹.

The two groups consisting of twelve native Haitian Creole speaking and twelve native English-speaking older adults matched by age and gender were selected from an ongoing longitudinal driving and cognition study “In vehicle sensors to Detect Cognitive Change in Older Drivers?”²². The diverse sample of older adults recruited from Southeast Florida includes African American, Afro-Caribbean, Hispanic and non-Hispanic European Americans. The participants signed consents in their primary language. The study from which this data was obtained was approved by Florida Atlantic University IRB.

MEASURES

A battery of cognitive tests was administered to participants in the parent study to detect changes that may have occurred over time. Before use, two bilingual native Creole-English researchers translated and adapted the measures to Haitian Creole. Several meetings with two researchers in neuropsychology took place before and during the translation process to ensure the retention of the meaning of test questions. Since there are no validated Haitian Creole cognitive tests, we sought feedback from an older native Haitian Creole speaker on the translated items, understanding that Haitian Creole has dialects that vary geographically²³.

the groups’ performance on five timed cognitive tests used in traditional neuropsychological assessment.

GLOBAL COGNITIVE FUNCTION
The Montreal Cognitive Assessment (MoCA) is frequently used as a screening test. The MoCA assesses short-term memory, visuospatial function, executive function, attention, concentration, working memory, language, and orientation²⁴, and takes about 10 minutes to administer. The whole test is not timed, but the verbal fluency item (Letter F) is timed. The participant is asked to cite as many words that begin with the letter F as possible in 1 minute.

EXECUTIVE FUNCTION
The Trail Making Test (TMT), which consists of two parts, TMT A and TMT B, is a measure of executive function, cognitive response, and shifting attention²⁵˒²⁶. Errors made and the time to complete the test in seconds are recorded. TMT A involves connecting twenty-five numbers in order. Participants begin at number 1 and follow a trail, connecting all numbers in sequence. TMT B consists of twenty-five alternating numbers and letters to be connected in numerical and alphabetical order allowing a maximum of 300 seconds to complete.

The Stroop-Color Word Test (SCWT) is used to evaluate the ability to inhibit cognitive interference, which may occur while processing two stimuli at the same time²⁷. The participant has 45 seconds to complete reading color words or naming colors. The SCWT has three conditions. The first condition (W) requires participants to read a list of words (names of colors printed in black ink) as quickly as possible. The color condition requires participants to name colors (C) from Xs printed in three different colors, and the color-word (CW) condition requires the participants to name the color of the ink of color names written in different ink colors. The Stroop effect is when it’s more difficult and takes more time to name the color of the ink when the color name is written in a different ink because there is an automatic tendency to read the word and, therefore, to perform well, the participant must inhibit the reading of the word. Participants were evaluated for color blindness prior to administering the test. The colors used were red, green, and blue. The length of the color words differed in Creole and English. Only the word red was longer in Creole (Rouj)²⁸. Green and Blue were shorter in Creole (Vet and Ble)²⁸.

LANGUAGE
Verbal Fluency was assessed using category (animals) and phonemic (letter P) items. This test also measures executive function and language processing²⁹. The participant is asked to list as many animals or words as they can in one minute.

The participants were evaluated by trained psychometricians. A bilingual Haitian Creole-English speaker tested the Creole participants (M. A-R).

TESTING LOCATIONS
English speaking participants were evaluated on several Florida Atlantic University campus sites in Broward and Palm Beach Counties. All but two of the Haitian Creole speaking participants were evaluated at the university. The two exceptions were tested at their place of worship.

Data collection was scheduled every three months in this longitudinal study following two baseline testing sessions, divided to reduce participant fatigue. Baseline test results were used in this analysis. Demographic information was obtained at visit 1. The MoCA, Trail Making Test A and B, Animal category, letter P fluency, and Stroop Color Test were administered at Baseline visit 2.

STATISTICAL ANALYSIS
Statistical analysis was conducted using SPSS³⁰. One-tailed independent samples t-tests were conducted to examine whether the results of the cognitive timed measures were different across the 12 Haitian Creole speakers and 12 English speakers.

---

Results

SAMPLE CHARACTERISTICS
The groups were closely matched by gender with 50% male and 50% female in each group and by age (t((22)) = 0.17, p = .431). See Table 1.

Table 1. Demographic Profiles of Creole and English Samples on Matching Variables

We made considerable effort to match the groups by education level, but it was not feasible because the mean years of education were significantly different between the Haitian Creole and English speakers, (t (13.55) = -2.36, p = .034). See Table 2.

---

Table 2. One-Tailed Independent Samples t-Test for education by Group

Note: N = 24. Degrees of Freedom for the t-statistic = 13.55. d represents Cohen’s d.

---

COGNITIVE TEST ANALYSES
The two groups’ means and standard deviations for different cognitive tests are presented in Table 3. Significant differences were found between the groups in the performance of all tests except the Color-Word interference. The MoCA total adjusted scores for Haitian Creole speakers differed significantly from those of the English speakers. The mean for Haitian Creole speakers was significantly lower than the mean for English speakers, with a medium effect size. Likewise, there were significant differences found in letter P words generated for the Haitian Creole speaking group versus the English-speaking group with a large effect size. However, the mean of Letter_ P_rule_violations was not significantly different between the Haitian Creole speaking and English- speaking group. English speakers produced a significantly higher total number of animals correctly named than did the Creole speaking group with a large effect size. There were no significant differences in rule violations between the two groups. See Table 3.

Haitian Creole speaking participants were slower than the English-speaking group in completing the TMT A test, with a large effect size. Similarly, the mean between the two groups. It should be noted that at least 5 Creole speaking participants, including those with no formal education, were unable to complete TMT B. When this occurs, a maximum of 300 seconds is then recorded. See Table 3.

Analyses of the two Stroop tests results revealed a significant difference in score between the groups, also with a large effect size. The mean reading total for the Creole speaking group was lower than that of the English speaking group, as was the Name Color total for which the mean was significantly lower for the Creole speaking participants (M= 44.8; SD = 16.9) as compared with the English speaking group. However, the Creole speaking group performed better on the color word total than did the English speaking group. Although this difference was not statistically significant, the moderate effect was noteworthy.

Table 3. Timed Cognitive Test Results for the Creole and English-speaking groups

Note: One-tailed independent t-test. N = 24. d Represents Cohen’s d.

---

Discussion

This study explored the challenges Haitian Creole speaking older adults face when subjected to neuropsychological assessments validated for English-speaking populations with higher levels of education. Our research shows a significant difference in test performance between Haitian Creole speakers and their English-speaking counterparts on timed neuropsychological measures when matched on age and gender. Bugallo-Carrera et al. (2024)³¹ and Malek-Ahmadi et al. (2015)³² reported that demographic data such as age and sex have a significant impact on MoCA test results. Our groups were equivalent in their mean age and gender distribution. The results from our Haitian Creole speaking group highlight the critical role of cultural and linguistic context in cognitive task performance.

The differences between groups in level of education is also a factor in determining test outcomes, but we cannot rule out the effect of the cultural context in the interpretation of cognitive outcomes¹⁷. The observation that initiation time (the pause to think about one’s answers before beginning to list words that start with a particular letter, for example) in cognitive tests often causes a delay among participants echoes previous research with underrepresented ethnic/racial groups³³.

The parent study utilized the MoCA to screen potential participants for eligibility²². Despite its widespread translation and validation in approximately 100 languages, the MoCA has not been validated in Haitian Creole, an oversight in achieving linguistic and cultural representation in cognitive assessment. The suggested cutoff scores for identifying mild cognitive impairment (MCI) in various racial and ethnic groups with low levels of education reflect a recognition of the importance of avoiding misdiagnosis, especially among ethnically underrepresented groups such as Haitian Americans. Given our findings of a mean MoCA score of 23.1 among the Haitian Creole speaking group compared to 25.7 in the English-speaking group, applying existing norms would invariably result in exclusion of eligible participants. Previous authors have suggested the importance of better understanding the effects of the level of education on the MoCA and the need to create appropriate cutoff scores for older adults with very low education³⁴˒³⁵˒³⁶. Moreover our results support previous findings suggesting that linguistic and cultural factors must be considered when the MoCA is used as a clinical screening test of individuals with limited education due to the high number of items that depend on culture and academic skills such as reading, writing and math³⁶.

In the verbal fluency tests, the English-speaking group generated significantly more words than did the Haitian Creole-speaking group. This is consistent with previous studies on verbal fluency tasks across languages³⁸. Production of words on a verbal fluency test is affected by word frequency³⁹ and the frequency of words that start with a particular letter or that belong to a particular semantic category varies across languages.

Stewart et al. (2001)¹⁶ found that Afro Caribbean participants aged 55-75 scored lower on verbal fluency and the Boston Naming Test, while their memory test scores were similar. The Afro-Caribbean population is not a monolithic group, however, so caution should still be taken with assigning norms from one ethnic group or one region to the next. Stewart et al. (2001)¹⁶ for example, did not specify the ethnicities or preferred language of their groups, highlighting the challenges of cognitive screening in may be because of speed emphasis in timed tests, language processing, age, and education⁴⁰. This study explored the possible effect of timed testing and speed on text performance.

There were also no significant differences in rule violations between the groups. Instead, the most noticeable differences were observed in the total scores and the number of words and animals generated. It was observed (by M. A-R) that a delayed response time occurred in the Creole speaking group during testing, with a long pause before initiating the first word. After stopping the clock, participants often provided additional words and animals, another example of focusing on accuracy rather than speed. Information processing may also be affected by bilingualism as was suggested by the Creole speaking group’s higher Stroop Color Word subtest. This study did not address the impact of acculturation on verbal fluency test performance. The Creole-speaking participants had lived in the US for over 15 years, and all but four of them had received some formal schooling in the US. Five participants were Creole-English bilingual while seven participants were Creole monolingual. A study conducted by Manly et al. (2004)⁴³ observed that the correlation between reading level and test performance was primarily in measures of verbal abstraction, naming, and phonemic fluency. However, when other demographic factors such as acculturation and years of education were considered alongside reading level, the influence on test performance was attenuated.

The Haitian Creole speaking groups clearly took longer to complete the TMT A and TMT B tests than did the English group. The effect sizes were large. In this study, we cannot definitively conclude that a combination of age and education level were responsible for the lower scores in the Creole speaking group as we were unable to match participants on years of education. We do suggest, however, that education level as well as type of education may have played a role. Ardilla et al., (2005)⁴⁸ noted that lack of exposure to specific tests is a cognitive bias that would impact the test performance. Five members of the Creole speaking group did not complete the TMT B test within the 300 seconds allowed. A few of them became frustrated and asked permission to stop doing the task. The ones who completed both trials were still slower than the English groups and took the total time allocated for each test, 150 for TMT A and 300 for TMT B. Results for this study support previous findings suggesting that the TMT has an educational bias that makes it inapplicable to people with low levels of education due to its dependence on the alphabet⁴¹.

Further investigation is warranted regarding task performance beyond the designated time. Agranovich et al. (2011)⁴⁹ examined cultural differences in time attitudes and their effect on timed neuropsychological tests. After administering several neuropsychological tests, their participants completed the Culture of Time Inventory-33 Items (COTI-33). They reported that Americans outperformed Russians on several subtests of items and that attitudes towards time affected test results.

Haitian-Creole speaking participants were slower in the Stroop reading total number test and Stroop naming color total number than the English-speaking group. However, the Creole speaking group scored better on the color name total than did the English-speaking group. This difference was marginally significant, and therefore, a larger sample should be compared to corroborate this finding. One explanation of this preliminary finding is that the lower level of reading of the Haitian Creole group compared to the English-speaking group may not create the interference that is expected in this part of the test. This result questions the validity of the Stroop test of inhibitory control test in individuals with low levels of education. Although we are not certain why they were faster in the latter task, this is consistent with previous research on bilingual participants. Bilingual and monolinguals experience different Stroop interference and facilitation effects, revealing a bilingual cognitive advantage⁴². Future research with a larger sample should be done to corroborate this finding.

Cultural effects on the performance of older Haitian immigrants on timed cognitive tests
emphases in testing may explain the differences in performance, help guide cognitive test development and prevent inappropriate labeling of individuals as having dementia. With the growing population of disadvantaged minority groups across the US, Europe and other regions, and their reported increasing rates of Alzheimer’s disease and related dementias, accurate screening for early diagnosis is needed.

Funding Statement:
This research was supported by a grant from the National Institute on Aging titled In-Vehicle Sensors to Detect Cognitive Change in Older Drivers. Grant # 1R01AGO68472-01.

Acknowledgements:
None

---

Conclusion

In this study we found differences in performance on timed cognitive tests between Haitian Creole-speaking and US English-Speaking older adults and explored some of the factors that may account for these differences. Since the groups were well matched in age and gender, we can begin to understand how early educational experiences have a greater impact on test performance than is usually acknowledged. Culture specific factors such as time perception and emphasis on accuracy vs. speed in test taking may play a vital role in poorer performance. We had a mixed group of older Haitian Creole speaking adults with varying levels of literacy. While the majority had less than twelve years of education, two males attended college in the US, two males attended trade school in the US, and three females completed nursing assistant programs. Separate norms and assessment profiles for ethnic groups such as Haitian older adults are needed. Future studies of cognitive function across various domains that address differences in literacy are also needed. Some studies examining differences in cultural attitudes and educational emphases in testing may explain the differences in performance, help guide cognitive test development and prevent inappropriate labeling of individuals as having dementia. With the growing population of disadvantaged minority groups across the US, Europe and other regions, and their reported increasing rates of Alzheimer’s disease and related dementias, accurate screening for early diagnosis is needed.

 

References

1. Rosselli, M., Uribe, I. V., Ahne, E., & Shihadeh, L. (2023). Culture, ethnicity, and level of education in Alzheimer’s disease. Neurotherapeutics, 19(1), 26-54.

2. Alzheimer’s disease facts and figures. Alzheimer’s Dement. 2024 May;20(5):3708-3821. doi:10.1002/alz.13809. Epub 2024 Apr 30. PMID: 38689398; PMCID: PMC11095490.

3. World Health Organization 2020. Alzheimer’s & Dementia Death in Haiti. Access September 23, 2024

4. Nielsen, T. Rune. “Cognitive assessment in culturally, linguistically, and educationally diverse populations in Europe.” American Journal of Alzheimer’s Disease & Other Dementias® 37 (2022): 15333175221117006.

5. Moering RG, Schinka JA, Mortimer JA, Graves AB. Normative data for elderly African Americans for the Stroop Color and Word Test. Arch Clin Neuropsychol. 2004;19(1):61-716.

6. Stewart R, Richards M, Brayne C, Mann A. Cognitive function in UK community-dwelling African Caribbean elders: normative data for a test battery. Int J Geriatr Psychiatry. 2001;16(5):518-527. doi:10.1002/gps.384

7. Lucas JA, Ivnik RJ, Willis FB, et al. Mayo’s Older African Americans Normative Studies: normative data for commonly used clinical neuropsychological measures. Clin Neuropsychol. 2005;19(2):162-183. doi:10.1080/13854040590945265

8. Ardila, A. (2005). Cultural values underlying psychometric cognitive testing.
Neuropsychologyreview, 15(4), 185-195.

9. Agranovich AV, Panter AT, Puente AE, Touradji P. The culture of time in neuropsychological assessment: exploring the effects of culture-specific time attitudes on timed test performance in Russian and American samples. J Int Neuropsychol Soc. 2011;17(4):692-701. doi:10.1017/S1355617711000592 2024

10. Ardila A. Cultural values underlying psychometric cognitive testing [published correction appears in Neuropsychol Rev. 2021 Mar;31(1):220. doi: 10.1007/s11065-020-09471-3]. Neuropsychol Rev. 2005;15(4):185-195. doi:10.1007/s11065-005-9180-y

11. Rosselli, M., Ardila, A., Araujo, K., Weekes, V. A., Caracciolo, V., Padilla, M., & Ostrosky-Solí, F. (2000). Verbal fluency and repetition skills in healthy older Spanish-English bilinguals. Applied neuropsychology, 7(1), 17-24.

12. Bialystok, Ellen, and Fergus IM Craik. “Cognitive and linguistic processing in the bilingual mind.” Current directions in psychological science 19.1 (2010): 19-23.

13. Kisser JE, Wendell CR, Spencer RJ, Waldstein SR. Neuropsychological performance of native versus non-native English speakers. Arch Clin Neuropsychol. 2012;27(7):749-755. doi:10.1093/arclin/acs082

14. Ransdell SE, Fischler I. Memory in a monolingual mode: When are bilinguals at a disadvantage? Journal of Memory and Language. 1987;26(4):392-405.

15. Roivainen, Eka. “European and American WAIS IV norms: Cross‐national differences in perceptual reasoning, processing speed and working memory subtest scores.” Scandinavian Journal of Psychology 60.6 (2019): 513-519.

16. Eizaguirre, María Bárbara, et al. “Symbol digit modalities test-oral version: An analysis of culture influence on a processing speed test in Argentina, Mexico, and the USA.” Developmental Neuropsychology 45.3 (2020): 129-138.

17. Rosselli, Monica, and Alfredo Ardila. “The impact of culture and education on non-verbal neuropsychological measurements: A critical review.” Brain and cognition 52.3 (2003): 326-333.

18. World Bank. 2023. “One day I will be…” School attendance and be keen interest in learning are priorities for many young Haitians, The World Bank Group, November 15, 2023, “One day I will be…” – School attendance and a keen interest in learning are priorities for many young Haitians (worldbank.org)

19. Gravetter, F. J., and L. B. Wallnau. “Statistics for The Behavioral Sciences 10th.” Statistics for The Behavioral Science (2017).

20. Field, Andy. “Discovering Statistic Using IBM SPSS Statistic, 5th Edn. ed J.” Seaman (Los) Angeles, CA (2018).

21. Cook, Thomas D., and Donald T. Campbell. Experimental and quasi-experimental designs for generalized causal inference. Figures, 2007.

22. Tappen, Ruth, et al. “Study protocol for “In-vehicle sensors to detect changes in cognition of older drivers”.” BMC geriatrics 23.1 (2023): 854.

23. Michaelis, Susanne Maria, et al., eds. The Survey of Pidgin and Creole Languages: Volume 1.Vol. 1. Oxford University Press, USA, 2013.

24. Nasreddine ZS, Phillips NA, Bédirian V, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment [published correction appears in J Am Geriatr Soc. 2019 Sep;67(9):1991. doi: 10.1111/jgs.15925]. J Am Geriatr Soc. 2005;53(4):695-699. doi:10.1111/ j.1532-5415.2005. 53221.x

25. D. Hood, Elexsia, et al. “Are there differences in performance validity test scores between African American and White American neuropsychology clinic patients?.” Journal of Clinical and Experimental Neuropsychology 44.1 (2022): 31-41.

26. Dobbs, Bonnie M., and Simran S. Shergill. “How effective is the Trail Making Test (Parts A and B) in identifying cognitively impaired drivers?.” Age and ageing 42.5 (2013): 577-581.

27. Coderre, Emily L., Walter JB Van Heuven, and Kathy Conklin. “The timing and magnitude of Stroop interference and facilitation in monolinguals and bilinguals.” Bilingualism: Language and Cognition 16.2 (2013): 420-441.
28. Theodore, Charmant. “Haitian Creole dictionary & phrasebook: Haitian Creole-English, English-Haitian Creole.” (No Title) (2008).

29. Whiteside, Douglas M., et al. “Verbal fluency: language or executive function measure?” Applied Neuropsychology: Adult 23.1 (2016): 29-34.

30. SPSS, I. B. M. “IBM SPSS statistics for Windows, version 20.0.” New York: IBM Corp 440 (2011): 394.

31. Bugallo-Carrera, César, et al. “Factors that indicate performance on the MoCA 7.3 in healthy adults over 50 years old.” BMC geriatrics 24.1 (2024): 482.

32. Malek-Ahmadi, Michael, et al. “Age-and education-adjusted normative data for the Montreal Cognitive Assessment (MoCA) in older adults age 70–99.” Aging, Neuropsychology, and Cognition 22.6 (2015): 755-761.

33. Manly, Jennifer J., et al. “Acculturation, reading level, and neuropsychological test performance among African American elders.” Applied neuropsychology 11.1 (2004): 37-46.

34. Tavares-Júnior, José Wagner Leonel, et al. “Cognitive assessment tools for screening older adults with low levels of education: a critical review.” Frontiers in psychiatry 10 (2019): 878.

35. Tsiakiri, Anna, et al. “Influence of social and demographic factors on the Montreal Cognitive Assessment (MoCA) Test in rural population of north-eastern Greece.” Geriatrics 6.2 (2021): 43.

36. Julayanont, Parunyou, et al. “The montreal cognitive assessment—basic: a screening tool for mild cognitive impairment in illiterate and low‐educated elderly adults.” Journal of the American Geriatrics Society 63.12 (2015): 2550-2554.

37. Gómez, F., et al. “Applicability of the MoCA‐S test in populations with little education in Colombia.” International journal of geriatric psychiatry 28.8 (2013): 813-820.

38. Rosselli, Mónica, et al. “A cross-linguistic comparison of verbal fluency tests.” International Journal of Neuroscience 112.6 (2002): 759-776.

39. Jescheniak, Jörg D., and Willem JM Levelt. “Word frequency effects in speech production: Retrieval of syntactic information and of phonological form.” Journal of experimental psychology: learning, Memory, and cognition 20.4 (1994): 824.

40. Mathuranath, P. S., et al. “Effects of age, education and gender on verbal fluency.” Journal of clinical and experimental neuropsychology 25.8 (2003): 1057-1064.

41. Carvallo, Claudia, and Miguel Ramos‐Henderson. “Trail making test–black & white (TMT B&W): Normative study for the Chilean population.” Journal of Neuropsychology (2024).

42. Ratcliffe, Lauren N., et al. “Classification statistics of the Montreal Cognitive Assessment (MoCA): Are we interpreting the MoCA correctly?.” The Clinical Neuropsychologist 37.3 (2023): 562-576.