Original Research

The Validation of the Turkish Version of the PRISMA-7 Questionnaire; A Case-finding Instrument for Detecting Older Adults Living with Frailty

10.4274/ejgg.galenos.2022.2022-8-2

  • Arzu Okyar Baş
  • Serdar Ceylan
  • Merve Güner
  • Meltem Koca
  • Burcu Balam Doğu
  • Meltem Gülhan Halil
  • Mustafa Cankurtaran
  • Cafer Balcı

Received Date: 17.08.2022 Accepted Date: 12.11.2022 Eur J Geriatric Gerontol 2023;5(1):52-58

Objective:

Numerous easy-to-apply and reliable tools have been developed for frailty detection with realizing the obvious importance of it. We aimed to evaluate the reliability and validity of the PRISMA-7 questionnaire in the Turkish community-dwelling older population, incorporating the geriatrician perspective.

Materials and Methods:

Upon application of the exclusion criteria, a total of 97 older patients were enrolled. All participants underwent a comprehensive geriatric assessment. After the necessary permissions were obtained, the Turkish version of PRISMA-7 was properly translated into Turkish with a forward-backward translation approach. The adaptation was made complied with the guideline recommendations. A reference tool, the Turkish version of the clinical frailty scale (CFS), was used for validation.

Results:

Median (interquartile range) age of participants was 72 (10) years, and 61 (62.9%) were female. According to CFS, 17.5% (n=17) patients were in the frail group, and 82.4% (n=80) were in the Robust/Vulnerable group. When we evaluated the concordance of PRISMA-7 and CFS, there was a moderate concordance (Cohen’s kappa: 0.589, p<0.001). At its optimal cut-off for differentiating frail from non-frail patients (≥3), the PRISMA-7 questionnaire had a sensitivity of 94.1% and a specificity of 82.5% (area under the curve: 0.956, p<0.001). For PRISMA-7 inter-rater and retest reliabilities, Cohen’s kappas were 0.615, p=0.03 & 1.0, p<0.001, respectively.

Conclusion:

The Turkish version of PRISMA-7 is a valid and reliable frailty evaluation instrument for the Turkish geriatric population.

Keywords: Frailty, PRISMA-7 questionnaire, Turkish validation, older adults

Introduction

Frailty is characterized by a reduction in physiological reserve and in resistance to physical and psychological stressors (1). Because of the rapid aging of the population, the prevalence of frailty is projected to increase (2). However, frailty prevalence can change depending on the screening method and population. In addition, it has been reported that in community-dwelling older adults, frailty prevalence may vary from 4% to 59.1% (3). People living with frailty have an increased risk of mortality, hospitalization, falls, and institutionalization (1). In other words, frailty is a major public health concern that can initiate a vicious cycle of many negative outcomes, including death (4). Moreover, early identification of the people living with frailty may enable a proper intervention that will enhance life quality and prevent negative consequences (5).

With realizing the obvious importance of frailty, numerous easy-to-apply and reliable tools have been developed for its detection. Based on two basic approaches, physical frailty and cumulative deficit evaluation tests have been developed to assess frailty. The fried frailty index, Edmonton Frailty scale, clinical frailty scale (CFS), and Program of Research to Integrate the Services for the Maintenance of Autonomy-7 (PRISMA-7) questionnaire are among the most commonly used tools (6). The PRISMA-7 identifies frailty by utilizing a combination of seven simple self-reported components. The questions pertain to age, general health, activities, and social support, and each response receives a score of one or zero (7). PRISMA-7 has been translated into a number of languages and validated in a number of nations. Moreover, a previous study in the primary care setting tried to validate the Turkish version of PRISMA-7. However, since the study mentioned above used a reference tool that is also non-validated, it undermines that validation’s credibility.

This study aimed to evaluate the validity and reliability of the PRISMA-7 questionnaire in the Turkish community-dwelling older population, incorporating the geriatrician perspective.


Materials and Methods

Participants

In this cross-sectional study conducted over a three-month period, one hundred twenty (120) older patients were evaluated after being admitted to the geriatrics outpatient clinic (November 2021-January 2022). The inability to communicate or answer questions and the presence of an acute illness were determined as exclusion criteria. Therefore, patients aged 65 years and older without exclusion criteria were included in the study. A total of 97 patients aged 65 and older were included in the study. The participants’ demographic information (age, gender, education, occupation, and place of residence), chronic diseases, multimorbidity (two or more chronic diseases), geriatric syndromes, medications, polypharmacy (using five or more drugs), smoking, falls, and fracture history from the previous year were collected.

Comprehensive Geriatric Assessment (CGA)

Standardized tools were utilized to perform an optimal CGA. The Katz activities of daily living scale was used to assess the patient’s functional status (8). It scored the patient over 6 points based on how independently they performed basic daily tasks and care, with a higher score indicating greater independence (9,10). The Lawton-Brody ınstrumental activities of daily living scale was utilized to assess patients’ instrumental daily living activities (11). The mini-mental state examination test, which assesses orientation, memory, attention, calculation, recall, language, motor function, and perception skills, was used to gauge the participants’ cognitive status (12). The nutritional screening was made using the mini nutritional assessment short-form; scores >11 points indicate normal nutrition status, 8-11 points indicate malnutrition risk, and 7 points indicate malnutrition (13). Using the Yesavage geriatric depression scale, the patient’s mood was evaluated. The evaluation was conducted over 15 points, and patients with more than 5 points were clinically evaluated for depression (14).

The handgrip measurements were performed using the Takei grip strength dynamometer to determine the patients’ muscle strength. The dominant hand was measured three times while seated, with the elbow bent at 90 degrees and the hand in the neutral position. In the analysis, the highest of the three repeated measurements was used. Low handgrip strength (HGS) was stated as less than 16 kg for women and more than 27 kg for men, respectively. The physical performance was evaluated by measuring the gait speed. During the 4-meter walking test, the patient was told to walk at a normal pace (with an auxiliary device, if one was used) and stop at a designated point. The elapsed time was recorded in seconds, and the patient’s walking speed was then calculated in meters per second. Values below 0.8 m/s were deemed indicative of poor physical performance (15).

Study Tool

PRISMA-7 questionnaire is a tool recommended by the British Geriatric Society (2014) to quickly and simply screen frailty (16). It contains seven simple self-reported questions to detect frailty: Older than 85 years; male; health problems that limit activities; support of another person needed; health problems requiring staying at home; social support; and the use of a cane/walker/wheelchair. Each question is answered as “yes” or “no”, and the “yes” answer is scored as 1 point and the “no” answer as 0 points. A total score ≥3 deems as frailty (7). In order to verify the intra- and inter-observer reliability, a sample of 20 participants (10 participants for intra-observer, 10 participants for interobserver reliability) was selected.

Translation

The necessary permissions were obtained from the authors who created the PRISMA-7 questionnaire. The process of forward-backward translation approach and adaptation was made complied with the recommendations of the ISPOR task force for translation and cultural adaptation report (17). Initially, the original PRISMA-7 tool was translated into Turkish by two native Turkish speakers who are also experts in translation and speak English fluently. All authors have reviewed and approved the Turkish version. Then, a professional, native English-speaking translator completed the backward translation without knowledge of the screening tool. Finally, the Turkish version of the PRISMA-7 instrument was administered to a convenient sample of community-dwelling older adults in order to assess cultural adaptation.

Reference Tool

The CFS, a tool created to measure frailty in the second phase of the Canadian Study of Health and Aging, was chosen as the reference instrument. CFS is a frailty screening instrument based on the “cumulative deficit evaluation” model (18). CFS describes frailty by assigning a score between 1 and 9 (1: Very fit; 2: Well; 3: Well with the treated comorbid disease; 4: Apparently vulnerable; 5: Mildly frail; 6: Moderately frail; 7: Severely frail; 8: Very severely frail; and 9: Terminally ill) according to the physician’s clinical opinion. Each point on this scale corresponds to a written description of frailty and is accompanied by a visual classification chart. Scores more than five are considered frail (19). The reliability and validation study of the Turkish version of CFS was conducted by Özsürekci et al. (20).

Statistics

Version 24.0 of SPSS was used to conduct the statistical analysis. To ascertain whether or not variables are normally distributed, visual (histogram, probability plots) and analytical methods were used to investigate the variables. For variables with a normal distribution, descriptive statistics were presented as mean and standard deviation (SD), for variables with an asymmetric distribution, as median [interquartile range (IQR)], and for nominal variables, as the number of cases and percentage (%). Additionally, the Spearman correlation test was run for the variables in the correlation analysis without a normal distribution.

The sample size was calculated using two rater kappa statistics (21) by providing 90% power to determine the correct kappa when two categories according to the CFS scale, Robust+Vulnerable and Frail frequencies in Turkey (20), were 64.0% and 36.0%, respectively.

To evaluate the construct validity of the PRISMA-7, the CFS was accepted as the reference tool. The CFS was classified as robust/ vulnerable (scores <5) and frail (scores ≥5) when assessed in its concordance with the PRISMA-7. Cohen’s Kappa was utilized to investigate the construct validity and inter-rater reliability of the PRISMA-7. Cohen’s Kappa was also utilized to assess test-retest reliability. Sensitivity, specificity, as well as positive and negative predictive values were determined. P-values less than 0.05 were accepted as statistically significant.


Results

Ninety-seven older adults with a median (IQR) age of 72 (10) years were enrolled in the study, of whom 61 (62.9%) were female. Among the participants, 72.2% (n=70) of patients were hypertensive, 51.5% (n=50) had diabetes mellitus, 18.6% (n=18) had coronary heart disease, 12.4% (n=12) had atrial fibrillation, and 10.3% (n=10) had chronic respiratory diseases. The most common geriatric syndromes in this study were polypharmacy, with a prevalence of 55.7% (n=54), and urinary incontinence, with a prevalence of 41.2% (n=40). The mean (± SD) body mass index was 30.06 (±5.82) kg/cm2. Mean (± SD) HGS was 18.09 (±5.08) and 27.58 (±7.57) for females and males, respectively. The mean (± SD) gait speed was 0.93 (±0.35) m/sn. The median (IQR) CFS score was 3.0 (1.0). According to CFS, 17.5% (n=17) patients were in the Frail group, and 82.4% (n=80) were in the Robust/Vulnerable group. Demographic characteristics, comorbidities, nutritional status, and CGA parameters were summarized in Table 1.

When we evaluated the concordance of PRISMA-7 and CFS, there was a moderate concordance (Cohen’s kappa: 0.589, p<0.001) (Table 2). At its optimal cut-off, for differentiating frail from non-frail patients (≥3), calculated using the maximal accuracy approach, the PRISMA-7 questionnaire had a sensitivity of 94.1% and a specificity of 82:5% (area under the curve: 0.956, p<0.001) (Figure 1). For PRISMA-7 inter-rater and retest reliabilities, Cohen’s kappas were 0.615, p=0.03 & 1.0, p<0.001, respectively (Table 3).

According to the reference scale, the positive predictive value of PRISMA-7 determined was 53.33%, and the negative predictive value was 98.51% (Table 2). The total prevalence of each component of PRISMA-7 was presented in Table 4.


Discussion

Since frailty is an important problem for aging populations, screening tools that can detect it simply and quickly become prominent. Furthermore, it is clear that frailty screening tools require cross-cultural adaptations. Therefore, this study aimed to evaluate the validity and reliability of the PRISMA-7 questionnaire in the Turkish community-dwelling older population by comparing it with CFS. Our results revealed that the Turkish version of PRISMA-7 and CFS have a good and positive concordance for evaluating frailty.

According to the Turkish Statistical Institute data presented in 2021, the ratio of individuals aged 65 and over has increased to 9.7% (22). Furthermore, since it is expected to increase to 12.9% in 2030 in Turkey (23), it is obvious that frailty will be an essential concern in Turkey as an aging country. Considering that frailty reflects a health burden, particularly in the geriatric population, detecting and intervening at the earliest stages is crucial. In this study, PRISMA-7 was chosen to be evaluated whether it is a proper tool to screen frailty for older adults in Turkey since it is an easy-applicable and brief form to perform in geriatrics outpatient clinics.

The prevalence of frailty may vary depending on the environment and the instruments used for screening. In the Frail TURK project, a study designed to assess frailty in the population aged 65 and over in Turkey, Fried Frailty criteria were used, and 39.0% of 1126 participants were defined as frail (23). Similarly, in the validation study of the Turkish version of CFS, frailty frequency was reported as 35.6% (20). In concordance with the previous studies, 30.9% of participants in our study were frail, according to the Turkish version of PRISMA-7.

Although CGA is the standard method for frailty evaluation, numerous frailty screening instruments have been created based on the physical frailty and cumulative deficit accumulation frailty models. Since CFS is focused on both biological theory and clinical judgment, it distinguishes from other methods based on cumulative frailty. Since, recently, the associations between social, cognitive and physical frailty were revealed, combining cognitive and physical function items is one of the advantages of CFS (19). Furthermore, a valid and reliable Turkish version of CFS was presented in a recent study (20). Therefore, CFS was chosen as a standard tool for this validation study. A previous study conducted in primary care in Turkey, tried to validate PRISMA-7 by comparing it with CFS. Unfortunately, when the study mentioned above was carried out, there was no validated version of the CFS (24). As this main limitation makes proper validation necessary, we re-performed an appropriate validation study by comparing the Turkish version of the PRISMA-7 questionnaire to the valid Turkish version of CFS.

International guidelines also advise using the PRISMA-7, one of the quick and practical tools for identifying frailty in older adults (25,26). Additionally, some studies have been carried out to evaluate how accurately it predicts the risk of negative outcomes in frail adults (27). The suitability of PRISMA-7 was also investigated in primary care, which is an important step in assessing frailty. In a study carried out by Hoogendijk et al. (28), five instruments (i.e., the Groningen frailty indicator, prescription of multiple medications, clinical judgement of the general practitioner, the self-rated health of the older adult and PRISMA-7) have been compared, and PRISMA-7 has been the most accurate one of these tools for identifying frailty in primary care. It has also been demonstrated to be useful in a hospital ward as a screening instrument to define elderly older adults who may benefit from further geriatric assessment during their hospitalization (29). Although this study was not primarily designed to assess the power of the Turkish version of PRISMA-7 for detecting adverse health outcomes related to frailty, future studies may evaluate this predictive value in both outpatient and hospital settings.

Study Limitations

This study has several limitations as well. Although there is no universally accepted strategy for performing a cross-cultural adaptation of questionnaires, our methodology adhered to commonly stated guidelines. In addition, the lack of a standard instrument for the accurate evaluation of frailty hinders comparability. Since reviews on frailty tools constantly document the clinical and diagnostic power of the CFS, we used CFS as a reference tool to alleviate this limitation.


Conclusion

The Turkish version of PRISMA-7 is a valid and reliable frailty evaluation tool for the Turkish geriatric population.

Ethics

Ethics Committee Approval: The study was approved by the Clinical Research Ethics Committee in the Department of Medicine at Hacettepe University (GO-21/1313). All processes were carried out in compliance with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards, as well as the ethical standards of the institutional and/or national research committee.

Informed Consent: All participants provided written informed consent.

Peer-review: Externally peer-reviewed.

Authorship Contributions

Surgical and Medical Practices: A.O.B., S.C., Concept: A.O.B., M.K., B.B.D., C.B., Design: A.O.B., M.K., M.G.H., M.C., C.B., Data Collection or Processing: A.O.B., S.C., M.G., Analysis or Interpretation: A.O.B., S.C., B.B.D., M.G.H., M.C., C.B., Literature Search: A.O.B., Writing: A.O.B., S.C., C.B.

Conflict of Interest: No conflict of interest was declared by the authors.

Financial Disclosure: The authors declared that this study received no financial support.


  1. Clegg A, Young J, Iliffe S, Rikkert MO, Rockwood K. Frailty in elderly people. Lancet 2013;381:752-762.
  2. Hoogendijk EO, Afilalo J, Ensrud KE, Kowal P, Onder G, Fried LP. Frailty: implications for clinical practice and public health. Lancet 2019;394:1365-1375.
  3. Collard RM, Boter H, Schoevers RA, Oude Voshaar RC. Prevalence of frailty in community-dwelling older persons: a systematic review. J Am Geriatr Soc 2012;60:1487-1492.
  4. Cesari M, Prince M, Thiyagarajan JA, De Carvalho IA, Bernabei R, Chan P, Gutierrez-Robledo LM, Michel JP, Morley JE, Ong P, Rodriguez Manas L, Sinclair A, Won CW, Beard J, Vellas B. Frailty: An Emerging Public Health Priority. J Am Med Dir Assoc 2016;17:188-192.
  5. Commission E. The 2015 ageing report. Economic and budgetary projections for the 28 EU Member States (2013–2060). European Economy 2015;3:1-120.
  6. Faller JW, Pereira DDN, de Souza S, Nampo FK, Orlandi FS, Matumoto S. Instruments for the detection of frailty syndrome in older adults: A systematic review. PLoS One 2019;14:e0216166.
  7. Raîche M, Hébert R, Dubois MF. PRISMA-7: a case-finding tool to identify older adults with moderate to severe disabilities. Arch Gerontol Geriatr 2008;47:9-18.
  8. McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology 1984;34:939-944.
  9. Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffe MW. Studies of Illness in The Aged. The Index of Adl: A Standardized Measure of Biological and Psychosocial Function. JAMA 1963;185:914-919.
  10. Arik G, Varan HD, Yavuz BB, Karabulut E, Kara O, Kilic MK, Kizilarslanoglu MC, Sumer F, Kuyumcu ME, Yesil Y, Halil M, Cankurtaran M. Validation of Katz index of independence in activities of daily living in Turkish older adults. Arch Gerontol Geriatr 2015;61:344-350.
  11. Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 1969;9:179-186.
  12. Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 1975;12:189-198.
  13. Guigoz Y, Lauque S, Vellas BJ. Identifying the elderly at risk for malnutrition. The Mini Nutritional Assessment. Clin Geriatr Med 2002;18:737-757.
  14. Yesavage JA, Brink TL, Rose TL, Lum O, Huang V, Adey M, Leirer VO. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiatr Res 1982-1983;17:37-49.
  15. Cruz-Jentoft AJ, Bahat G, Bauer J, Boirie Y, Bruyère O, Cederholm T, Cooper C, Landi F, Rolland Y, Sayer AA, Schneider SM, Sieber CC, Topinkova E, Vandewoude M, Visser M, Zamboni M; Writing Group for the European Working Group on Sarcopenia in Older People 2 (EWGSOP2), and the Extended Group for EWGSOP2. Sarcopenia: revised European consensus on definition and diagnosis. Age Ageing 2019;48:16-31.
  16. Johnson GV, Stoothoff WH. Tau phosphorylation in neuronal cell function and dysfunction. J Cell Sci 2004;117:5721-5729.
  17. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P; ISPOR Task Force for Translation and Cultural Adaptation. Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health 2005;8:94-104.
  18. Morley JE, Vellas B, van Kan GA, Anker SD, Bauer JM, Bernabei R, Cesari M, Chumlea WC, Doehner W, Evans J, Fried LP, Guralnik JM, Katz PR, Malmstrom TK, McCarter RJ, Gutierrez Robledo LM, Rockwood K, von Haehling S, Vandewoude MF, Walston J. Frailty consensus: a call to action. J Am Med Dir Assoc 2013;14:392-397.
  19. Rockwood K, Song X, MacKnight C, Bergman H, Hogan DB, McDowell I, Mitnitski A. A global clinical measure of fitness and frailty in elderly people. CMAJ 2005;173:489-495.
  20. Özsürekci C, Balcı C, Kızılarslanoğlu MC, Çalışkan H, Tuna Doğrul R, Ayçiçek GŞ, Sümer F, Karabulut E, Yavuz BB, Cankurtaran M, Halil MG. An important problem in an aging country: identifying the frailty via 9 Point Clinical Frailty Scale. Acta Clin Belg 2020;75:200-204.
  21. Flack VF, Afifi A, Lachenbruch P, Schouten H. Sample size determinations for the two rater kappa statistic. Psychometrika 1988;53:321-325.
  22. Institute TS. The results of Address Based Population Registration System, 2020.
  23. Eyigor S, Kutsal YG, Duran E, Huner B, Paker N, Durmus B, Sahin N, Civelek GM, Gokkaya K, Doğan A, Günaydın R, Toraman F, Cakir T, Evcik D, Aydeniz A, Yildirim AG, Borman P, Okumus M, Ceceli E; Turkish Society of Physical Medicine and Rehabilitation, Geriatric Rehabilitation Working Group. Frailty prevalence and related factors in the older adult-FrailTURK Project. Age (Dordr) 2015;37:9791.
  24. Yaman H, Ünal Z. The validation of the PRISMA-7 questionnaire in community-dwelling elderly people living in Antalya, Turkey. Electron Physician 2018;10:7266-7272.
  25. Dent E, Lien C, Lim WS, Wong WC, Wong CH, Ng TP, Woo J, Dong B, de la Vega S, Hua Poi PJ, Kamaruzzaman SBB, Won C, Chen LK, Rockwood K, Arai H, Rodriguez-Mañas L, Cao L, Cesari M, Chan P, Leung E, Landi F, Fried LP, Morley JE, Vellas B, Flicker L. The Asia-Pacific Clinical Practice Guidelines for the Management of Frailty. J Am Med Dir Assoc 2017;18:564-575.
  26. Excellence NIfC. Multimorbidity: clinical assessment and management. United Kingdom: NICE. 2016.
  27. Salminen M, Viljanen A, Eloranta S, Viikari P, Wuorela M, Vahlberg T, Isoaho R, Kivelä SL, Korhonen P, Irjala K, Löppönen M, Viikari L. Frailty and mortality: an 18-year follow-up study among Finnish community-dwelling older people. Aging Clin Exp Res 2020;32:2013-2019.
  28. Hoogendijk EO, van der Horst HE, Deeg DJ, Frijters DH, Prins BA, Jansen AP, Nijpels G, van Hout HP. The identification of frail older adults in primary care: comparing the accuracy of five simple instruments. Age Ageing 2013;42:262-265.
  29. Hoffmann S, Wiben A, Kruse M, Jacobsen KK, Lembeck MA, Holm EA. Predictive validity of PRISMA-7 as a screening instrument for frailty in a hospital setting. BMJ Open 2020;10:e038768.