- Open Access
Psychometric characteristics of the of COVID Stress Scales-Arabic version (CSS-Arabic) in Egyptian and Saudi university students
Middle East Current Psychiatry volume 28, Article number: 14 (2021)
Mental health sufferings due to the COVID-19 pandemic were reported in many countries worldwide. However, there is a lack of a validated Arabic tool to measure stress related to this pandemic in the Arab countries. This study aims to translate into Arabic and measure the psychometric characteristics of the previously developed English COVID Stress Scales (CSS). Using a forward-backward translation, the CSS was translated into Arabic and 22 jurors assessed its content validity. An online-based survey was carried out among 1080 university students (Egyptian and Saudi) to assess internal consistency and validity of the Arabic version (CSS-Arabic) using Cronbach’s α and factor analysis.
The content validity indices of the scale were 0.943 and 0.932 for both relevance and clarity. The internal consistency of the total CSS-Arabic was satisfactory (with α = 0.94) within the acceptable range for different subscales. Confirmatory factor analysis reveals 5-factor model with 36 retained items similar to the original English CSS.
CSS-Arabic is a reliable and valid self-reporting tool for screening of stress due to COVID-19 among the university students. Further work should be done by healthcare providers to assess the magnitude of the stress during the COVID-19 pandemic.
The newly emerging epidemic of the COVID-19 appeared at the end of 2019 in China and has been described as a pandemic by World Health Organization (WHO) . The virus is transmitted to humans through small droplets that are sprinkled from the nose or mouth with coughing and sneezing or through small droplets scattered on the surfaces surrounding the human being. Its main symptoms are fever, dry cough, and fatigue, and some cases experience respiratory difficulties that necessitates intensive care .
This pandemic has drawn global attention largely focusing on the physical health as well as the clinical and diagnostic aspects. The psychological health effects cannot be overlooked . With the widespread debate about the recently developed vaccine and empirically unproven effective treatments , countries were forced to adopt population-level widespread restrictions such as lock downs, in order to limit contact between people to slow down the transmission and exponential growth of cases .
The pandemic meets the criteria for a traumatic event and leads to the development of post-traumatic distress syndrome PTSD . Stress affects one’s mental and physical well-being where the individual reflects the stressor and its stressfulness . Stress is compounded by the alarming figures reported by local and international media all the time about the numbers of infections and deaths caused by the emerging COVID-19 virus; people are experiencing widespread panic, anxiety, and tension that humankind had not seen in a long period of time . Many previous studies in different countries including Arabic ones revealed that the extent of the negative psychological effects of COVID-19 pandemic include stress, anxiety, despair, depression, suicidal thinking, sleep disorders, eating disorders, and decreased quality of life [9,10,11,12,13,14,15,16,17].
Taylor et al.  suggested psychological effects of COVID-19 underneath the name of COVID-19 stress syndrome, which is described by distress of becoming infected, distress of being contaminated, distress of foreigners who might be carrying infection (i.e., disease-related xenophobia), distress of the socio-economic consequences of the pandemic, compulsive checking and reassurance-seeking, and traumatic stress symptoms about the pandemic (e.g., nightmares, intrusive thoughts).
Taylor et al.  listed that healthcare suppliers should have a valid tool to evaluate the psychological effects of COVID-19 during the pandemic. To the best of the authors’ knowledge, the English SCC was not translated into other languages including Arabic.
The current study deals with the psychometric properties of the Arabized version from the stress of the COVID-19 pandemic and thus seeks to provide a scientifically sound measuring instrument based on the reality of Arab culture. Thus, standardization of the scale in the Arab environment opens new horizons for research in the field of diagnosing and measuring the stress associated with the pandemic of the COVID-19 and its psychological effects. This is an essential step in the confrontational strategies and psychotherapy practices. The ideal tool should be psychometrically tested for reliability and validity.
Aim of the study
This study aims to translate into Arabic and measure the psychometric characteristics (content validity, internal consistency, and construct or component validity) of the COVID Stress Scales  in Egyptian and Saudi samples of university students.
Study design and date
This cross-section validation study was conducted during the period from 10th July to 23rd August 2020.
The study was carried out on university students in Mansoura University, Egypt, and King Khalid University, Saudi Arabia.
Sample size calculation
There are no absolute rules for the sample size required to validate constructs or study tools due to the various types of tools and the number of their items . Guidelines for the respondent-to-item ratio ranged from 5:1, 10:1, 15:1, or 30:1 . As larger samples are always better than smaller samples, we will use the respondent-to-item ratio of 30:1 for better confirmatory factor analysis . The scale contains 36 items; thus, the final sample size is 1080 students.
Procedures and data collection
Participants were volunteered to enroll using an anonymous online survey, administered by Google Forms to ensure wide reach and easy access. The electronic link was published on social media and student forums; the participants agreed to participate voluntarily without any compensation or incentives. Data were collected anonymously including sociodemographics (e.g., age, sex, nationality, residence, and college) and the Arabic version of COVID-19 stress scale.
The COVID-19 Stress Scales (CSS) prepared by Taylor et al.  consists of 36 items, distributed over five dimensions stable factor, corresponding to scales assessing COVID-related stress and anxiety symptoms: (1) danger and contamination fears (12 items), (2) fears about economic consequences (6 items), (3) xenophobia (6 items), (4) compulsive checking and reassurance seeking (6 items), and (5) traumatic stress symptoms about COVID-19 (6 items). Items were rated on a 5-point scale ranging from 0 (not at all) to 4 (extremely). The scales were intentionally designed so they could be readily adapted for future pandemics. The CSS were developed and initially validated in population-representative samples from Canada and the USA. The scale performed well on various indices of reliability and validity. The scales were inter-correlated, providing evidence of a COVID stress syndrome.
Arabic translation of CSS
The English version was translated into the Arabic language by two independent translators, and the two translations were compared to reach an agreed initial version. This initial version was revised from a linguistic, grammar, and other perspective. The Arabic version was back translated into the English language again by another two translators unaware about the original English version, to ensure the accuracy of the translation and the consistency of the synonyms and the translation did not differ between the English and Arabic versions .
The content validity indices were estimated by 22 experts (11 Egyptian and 11 Saudi) jurors specialized in psychology, psychiatry, and public health. They included 7 professors, 13 associate professors, and 2 lecturers. The Arabic version of the scale was evaluated for clarity, relevance, and translation of the contents. The experts were asked independently to review each item (clarity and relevance) using three-point ordinal scale and translation using correct or wrong. If wrong, they add their suggestions. The content validity index (CVI) was calculated at the item level (I-CVI), expert level (E-CVI), and scale level (S-CVI).
To obtain the CVI at the item level (I-CVI), the number of experts judging the item as relevant or clear (rating 3) were divided by the total number of experts. The CVI per expert (E-CVI) is calculated by dividing number of items scored 3/total number of items. If the CVI is higher than 0.79, the item was appropriate. If it is between 0.70 and 0.79, it needs revision. If it is less than 0.70, it is eliminated. The CVI for the entire scale (S-CVI) was assessed using the S-CVI with the average approach, by summing all I-CVI for relevancy divided by the number of items. The scale as a tool was considered to be valid if S-CVI greater than or equal to 0.90 .
I-CVI and S-CVI were calculated using the following formulae :
The CVI for each expert (E-CVI) is number of items scored 3 (relevant)/total number of items.
Reliability was assessed in the forms of internal consistency. To test the reliability of the CSS-Arabic, the final version was completed by1080 students. Internal consistency was examined by Cronbach’s α reliability coefficients. Cronbach’s α value of 0.50–0.70 was acceptable, whereas 0.70 or higher shows good homogeneity among the items .
Exploratory factor analysis
Exploratory factor analysis of the 36 items was done using RML rotation using MPlus. Parallel analysis was used to determine the number of factors to retain. The selection of goodness-of-fit indices was based on conventional guidelines .
Data were analyzed with SPSS version 24 (IBM Corporation, Chicago, IL, USA). Qualitative variables were presented as number and percent, whereas quantitative variables were presented as mean (SD). CVIs were calculated for each item and each expert. Cronbach’s α were calculated to measure the internal consistency between items. P ≤ 0.05 was considered statistically significant. Validity and factor analysis were determined using robust maximum likelihood (RML) rotation using MPlus examining the full scale ; the researchers used RML because it is robust to departures from a normality distribution of the data sample.
Internal consistency was assessed by Cronbach alpha coefficients (α), inter-item correlations and corrected item-total correlations. A Cronbach’s α of .70 or higher indicates acceptable reliability . Goodness of fit was assessed according to the following criteria: root mean square error of approximation (RMSEA ≤ .10), comparative fit index (CFI > .90 or more desirably ≥ .95), and standardized root mean square residual (SRMR ≤ .08) [28, 29].
Table 1 shows that the I-CVI ranged from 0.818 to 1.0 in different items of both relevance and clarity. While the E-CVI ranged from 0.722 to 1.0 in different items of both relevance and clarity. The S-CVIs were 0.943 and 0.932 for relevance and clarity, respectively.
The mean age of participating students was 20.8 ± 1.9 years, 76.95 are females, 55% are Egyptians, 57.6% of rural residence, and 40.3% are enrolled arts and humanities faculties (Table 2).
Table 3 displays the exploratory factor analysis of the resulting of the 36 items. Good fit is indicated by SRMR (0.04) ≤ .08, RMSEA (0.07) ≤ .08, SRMR = 0.03 ≥ .95, and CFI (0.90) ≥ .90. The first five eigenvalues were as follows: 12.90, 2.97, 2.49, 1.67, and 1.31.
Table 4 shows the first-order confirmatory factor analysis conducted for identifying the measurability of implicit structures of danger and contamination, socio-economic consequences, xenophobia, traumatic stress, and compulsive checking parameters used for CSS is depicted in Fig. 1. All of modification indication of the model have goodness of fit (χ2 = 2642.742, SRMR = 0.05, CFI = 0.91, TLI = 0.90, RMSEA = 0.07). Also, the second order confirmatory factor analysis for CSS indicating the structural of danger and contamination, socio-economic consequences, xenophobia, traumatic stress, and compulsive checking parameters dimensions with the one dimension of CSS is constructed and depicted in Fig. 2. All of modification indication of the model have goodness of fit (χ2 = 2681.171, SRMR = 0.05, CFI = 0.90, TLI = 0.90, RMSEA = 0.08).
Table 5 presents Cronbach alpha coefficients for the scales. The coefficients were > 0.80, indicating good to excellent.
At the time of writing, the coronavirus pandemic is the most important health problem worldwide, with the starting of the second wave and emergence of new strains of the virus. Apart from its impacts on physical health, COVID-19 also has significant effects on mental health. The development of the vaccines does not alleviate the psychological effects of the COVID-19. Few tools are available for assessment of these psychological consequences in Arabic countries. The only available validated tools are the Arabic Fear of COVID-19 Scale (FCV-19S)  and the Arabic version of COVID-19 Anxiety Scale (CAS) . CSS is the first tool that evaluates various aspects of psychological consequences of COVID related to five domains: COVID danger and contamination fears, COVID fears about economic consequences, COVID xenophobia, COVID compulsive checking and reassurance seeking, and COVID traumatic stress symptoms.
Content validity index (CVI) is the most commonly used method to calculate content validity quantitatively. There are multiple methods for testing content validity . The most common method for measuring content validity is calculating the item level CVI (I-CVI). This paper considered the I-CVI, expert-level CVI (E-CVI), and scale CVI (S-CVI) since the S-CVI is an average score that can be skewed by outliers. It is important to distinguish between content validity at the item level and at the scale level .
The number of experts (n = 22) was considered adequate for content validation [33, 34]. An I-CVI of 0.78 or higher is considered excellent. It was concluded that individual items were important and relevant to measuring the content validity. The minimum acceptable S-CVI is considered to be any value between 0.80 and 0.90 [22, 34]. In the current study, the CVIs are satisfactory for relevance and clarity ranged from 0.8 to 1.0 for I-CVI, E-CVI, and S-CVI.
The current study revealed that the Cronbach alphas of the different domains are satisfactory and ranged from 0.86 to 0.91. These are comparable to those of the original English version of SCC. Cronbach alphas ranged from 0.83 to 0.94 in the Canadian sample and from 0.86 to 0.95 in the US sample .
Factor analysis revealed 5-factor loading. This analysis using the total score and the all five factors would likely yield the most clinically reliable information regarding COVID-19 stress severity, particularly when used in population-based samples. Exploratory factor analysis was done using RML rotation using MPlus; good fit is indicated by SRMR (0.05) ≤ .08, RMSEA (0.07) ≤ .08, TLI = 0.90 ≤ .90, and CFI (0.91) ≤ .90. Also, findings of first and second order confirmatory factor analysis for CSS resulted the 5-factor model from the sample was tested. CFA solution performed gives goodness of fit in modification indication.
The obtained results are in harmony with that detected by Taylor et al.  who demonstrated that parallel analysis indicated a 5-factor solution, rather than a 6-factor solution in which each factor corresponded to each of the six scales of the CSS. The first six Eigen values were as follows: 15.84, 2.86, 2.06, 1.58, 1.55, and 0.88. The model performed well in terms of the goodness-of-fit and indicates RMSEA = 0.050 (90% confidence interval 0.049−0.051), SRMR = 0.042, and CFI = .93.
The results of the SCC-Arabic’s internal consistency revealed a good to excellent Cronbach’s α coefficient. The alphas of the different domains ranged from 0.86 to 0.91 with a total scale coefficient of 0.94. These findings are comparable to coefficients of the original English scale (with α ranging from 0.80 to 0.93 for different domains) in both Canadian and US populations .
First, the study was conducted using online modalities, which might make the measure inaccessible to some individuals. However, given the requirement of quarantine and physical distancing, online surveys might be the only option during certain periods of a pandemic. This may have introduced selection bias, where only those who received the study link had the chance to participate.
Second, participants were recruited only from university students who have accessibility to internet. Also, they were not representative of the adult population in both countries. Future studies involving more diverse adult samples from different countries would help further establish the validity and utility of CSS-Arabic. Third, test-retest and inter-rater reliabilities as well as scale sensitivity and specificity were not examined for the SCC-Arabic. Finally, there was no evidence of convergent or discriminant validity.
The findings show that the Arabic CSS had a multidimensional structure, good internal consistency, and good construct validity. The authors believe that the CSS-Arabic is a potentially useful instrument that can be used by healthcare providers to assess the magnitude of the stress during the COVID-19 pandemic. It may provide comprehensive information regarding stress and anxiety of an individual because of its multidimensional structure. However, the CSS is long and takes a longer time to complete.
Availability of data and materials
Data are available upon request from the corresponding author. Also, CSS-Arabic is available as an Additional file 1.
COVID Stress Scales
Content validity index
Item content validity index
Expert content validity index
Danger and contamination
Root mean square residual
Bentler’s Comparative Fit Index
Root mean square error of approximation
World Health Organization (2020) WHO announces COVID-19 outbreak a pandemic . Available at: https://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-announces-covid-19-outbreak-a-pandemic.
Li Q, Guan X, Wu P, Wang X, Zhou L, Tong Y, Xing X (2020) Early transmission dynamics in Wuhan, China, of novel coronavirus–infected pneumonia. N Engl J Med 382:1199–1207. https://doi.org/10.1056/NEJMoa2001316
Satici B, Gocet-Tekin E, Deniz ME et al (2020) Adaptation of the Fear of COVID-19 Scale: Its association with psychological distress and life satisfaction in Turkey. Int J Ment Health Addict. https://doi.org/10.1007/s11469-020-00294-0 Advance online publication
Rome BN, Avorn J (2020) Drug evaluation during the Covid-19 pandemic. N Engl J Med 382:2280–2282. https://doi.org/10.1056/NEJMp2009457
Atalan A (2020) Is the lockdown important to prevent the COVID-19 pandemic? Effects on psychology, environment and economy-perspective. Ann Med Surg 56:38–42. https://doi.org/10.1016/j.amsu.2020.06.010
Restauri N, Sheridan A (2020) Burnout and posttraumatic stress disorder in the coronavirus disease 2019 (COVID-19) pandemic: intersection, impact, and interventions. J Am Coll Radiol 17:921–926. https://doi.org/10.1016/j.jacr.2020.05.021
Whitehead BR (2020) COVID-19 as a stressor: pandemic expectations, perceived stress, and negative affect in older adults. J Gerontol B:gbaa153. https://doi.org/10.1093/geronb/gbaa153
Thirumalaisamy PV, Christian GM (2020) The COVID-19 epidemic. Trop Med Int Health 25(3):278–280. https://doi.org/10.1111/tmi.13383
Huang Y, Zhao N (2020) Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 epidemic in China: a web-based cross-sectional survey. medRxiv. https://doi.org/10.1101/2020.02.19.20025395
Lee S (2020) Coronavirus anxiety scale: a brief mental health screener for COVID-19 related anxiety. Death Stud 44(7):1–9. https://doi.org/10.1080/07481187.2020.1748481
Liu S, Yang L, Zhang C et al (2020) Online mental health services in China during the COVID-19 outbreak. Lancet Psychiatry 7(4):17–18. https://doi.org/10.1016/S2215-0366(20)30077-8
Samlani Z, Lemfadli Y, Ait Errami A et al (2020) The impact of the COVID-19 pandemic on quality of life and well-being in Morocco. Community Med Public Health 6(2):130–134
ChanduV C, Marella Y, Panga GS et al (2020) Measuring the impact of COViD-19 on mental health: a scoping review of the existing scales. Indian J Psychol Med 42(5):421–427. https://doi.org/10.1177/0253717620946439
Torales J, Ríos-González C, Barrios I et al (2020) Self-perceived stress during the quarantine of COVID-19 pandemic in Paraguay: an exploratory survey. Front Psychiatry 11:558691. https://doi.org/10.3389/fpsyt.2020.558691
Wang Y, Di Y, Ye J et al (2020) Study on the public psychological states and its related factors during the outbreak of coronavirus disease 2019 (COVID-19) in some regions of China. Psychol Health Med. https://doi.org/10.1080/13548506.2020.1746817
Zhou S, Zhang L, Wang L et al (2020) Prevalence and socio-demographic correlates of psychological health problems in Chinese adolescents during the outbreak of COVID-19. Eur Child Adolesc Psychiatry 29:749–758. https://doi.org/10.1007/s00787-020-01541-4
Al Omari O, Al Sabei S, Al Rawajfah O et al (2020) Prevalence and predictors of depression, anxiety, and stress among youth at the time of CoViD-19: an online cross-sectional multicountry study. Depress Res Treat 2020:8887727. https://doi.org/10.1155/2020/8887727
Taylor S, Landry C, Paluszek M et al (2020) Development and initial validation of the COVID stress scales. J Anxiety Disord 72:1–7. https://doi.org/10.1016/j.janxdis.2020.102232
Osborne JW, Costello AB (2004) Sample size and subject to item ratio in principal components analysis. Pract Assess Res Eval 9(1):11. https://doi.org/10.7275/ktzq-jq66
Pedhazur RJ (1997) Multiple regression in behavioral research: explanation and prediction. Harcourt Brace College Publishers, Fort Worth
Brislin RW (1970) Back-translation for cross-cultural research. J Cross Cult Psychol 1(3):185–216. https://doi.org/10.1177/135910457000100301
Polit DF, Beck CT (2006) The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health 29(5):489–497. https://doi.org/10.1002/nur.20147
Almanasreh E, Moles R, Chen TF (2019) Evaluation of methods used for estimating content validity. Res Social Adm Pharm 15(2):214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Bolarinwa OA (2015) Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Niger Postgrad Med J 22(4):195
Parry S (2020) Fit Indices commonly reported for CFA and SEM. Cornell University, Corneii Statistical Consulting Unit Available at: https://www.cscu.cornell.edu/news/Handouts/SEM_fit.pdf
Muthén LK, Muthén BO (1998-2017) Mplus user’s guide, 8th edn. Muthén & Muthén, Los Angeles
DeVellis RF (2017) Scale Development: Theory and Applications (4th ed.). Sage, Thousand Oaks
Cole DA (1987) Utility of confirmatory factor analysis in test validation research. J Consult Clin Psychol 55(4):584. https://doi.org/10.1037/0022-006X.55.4.584
Lei PW, Wu Q (2007) Introduction to structural equation modeling: issues and practical considerations. Educ Meas Issues Pract 26(3):33–43. https://doi.org/10.1111/j.1745-3992.2007.00099.x
Alyami M, Henning M, Krägeloh CU et al (2020) Psychometric evaluation of the Arabic version of the Fear of COVID-19 Scale. Int J Ment Health Addict. https://doi.org/10.1007/s11469-020-00316-x
El Sayed S, Shokry D, Gomaa S (2020) Coronavirus anxiety scale: content validity and reliability of Arabic version. Egypt J Hosp Med 81(4):1775–1779. https://doi.org/10.12816/ejhm.2020.120009
Rodrigues IB, Adachi JD, Beattie KA et al (2017) Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskelet Disord 18(1):1–9. https://doi.org/10.1186/s12891-017-1914-5
Zamanzadeh V, Ghahramanian A, Rassouli M et al (2015) Design and implementation content validity study: development of an instrument for measuring patient-centered communication. J Caring Sci 4(2):78–165. https://doi.org/10.15171/jcs.2015.017
Yamada J, Stevens B, Sidani S et al (2010) Content validity of a process evaluation checklist to measure intervention implementation fidelity of the EPIC intervention. Worldviews Evid Based Nurs 7(3):158–164. https://doi.org/10.1111/j.1741-6787.2010.00182.x
We are appreciative to all university students that participated in the research.
Ethics approval and consent for participate
In agreement with the Declaration of Helsinki, the proposal was approved by the Institutional Review Board (IRB), Faculty of Medicine, Mansoura University (code R.20.07.953). A written informed consent was obtained from all students who were willing to participate in the study after ensuring confidentiality. Approval and license to translate the original SCC was obtained from the corresponding author (see Additional file 2).
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
Additional file 2.
Additional file 3.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Abbady, A.S., El-Gilany, AH., El-Dabee, F.A. et al. Psychometric characteristics of the of COVID Stress Scales-Arabic version (CSS-Arabic) in Egyptian and Saudi university students. Middle East Curr Psychiatry 28, 14 (2021). https://doi.org/10.1186/s43045-021-00095-8
- COVID stress scale
- COVID stress scale-Arabic