Skip to main content

Validation of the Warwick-Edinburgh Mental Well-Being Scale for the Mental Health Surveillance (MHS) of German adults

Abstract

Background

Mental health encompasses more than just the absence of mental disorders. Thus, a Mental Health Surveillance (MHS) and reporting system for Germany should monitor mental well-being in addition to psychopathology to capture a more complete picture of population mental health. The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) is an internationally established inventory for the integrated assessment of different aspects of mental well-being (i.e., hedonic and eudaimonic) in population samples that has not yet been validated for Germany.

Methods

Using data from a cross-sectional online survey of a convenience sample of N = 1.048 adults aged 18–79 years (51% female) living in Germany, the factorial structure, measurement invariance (age, sex) and psychometric properties of the WEMWBS in its long (14 items) and short (7 items) versions were analyzed. Additionally, correlations to relevant factors (e.g., health-related quality of life, psychological distress) were investigated as indicators of criterion validity.

Results

Means of model fit indices did not confirm a unidimensional factor structure for either version. The three-factor-correlative models showed moderate to good fit while the bifactor model with one general mental well-being factor and three grouping factors fitted the data best. The full range of possible responses was used for all items, and the distribution of both scales was approximately normal. Moreover, the results revealed measurement invariance across sex and age groups. Initial evidence of criterion validity was obtained. Internal consistencies were α = 0.95 and α = 0.89, respectively. Average mental well-being was comparable to that of other European countries at 3.74 for the long version and 3.84 for the short version. While there were no differences by sex, comparisons between age groups revealed higher mental well-being among the older age groups.

Conclusions

Both versions of the WEMWBS showed sound psychometric characteristics in the present German sample. The findings indicate that the instrument is suitable for measuring mental well-being at the population level due to its distributional properties. These results are promising, suggesting that the scale is suitable for use in a national MHS that aims to capture positive mental health in the population as a foundation for prevention and promotion efforts within public mental health.

Background

The regular and systematic surveillance of population health including mental health is crucial for effective public health practice. Surveillance aims to monitor the current state of population mental health and to evaluate trends. The data it provides enables practitioners and political stakeholders to plan and evaluate public mental health measures as well as to respond rapidly and effectively to potentially adverse effects caused by crisis [1, 2].

The German Mental Health Surveillance (MHS) was established at the Robert Koch Institute (RKI) in 2019 and has since been in ongoing development. The MHS is intended to regularly collect, integrate, process, analyze and interpret data on the mental health of the population. Timely reporting of findings on the current state and trends of population mental health is to provide a reliable database for evidence-based policy [3, 4]. To develop an MHS for Germany, suitable core indicators were identified within a structured consensus building process involving experts and stakeholders. In accordance with the dual continua model of mental health [2], both indicators capturing psychopathology in the population and indicators of positive mental health were included in the final set.

The dual continua model of mental health assumes that psychopathology (i.e., represented by mental disorders) and positive mental health (i.e., represented by mental well-being) are two related but distinct dimensions comprising shared as well as distinct predictors (see [5] for an overview). This assumption is in line with the definition of good mental health encompassing more than the absence of mental disorders [6]. With regard to monitoring public mental health, information on the dimension of psychopathology (i.e., the spectrum ranging from psychological distress to mental disorders) is particularly important for initiating and evaluating public health measures addressing mental health care and rehabilitation. Data on positive mental health (including mental well-being) provides information on the need for mental health promotion and prevention [2]. Therefore, mental well-being should be assessed and reported as a distinct dimension (and with its own measurement instrument) in addition to psychopathology in an MHS for Germany.

The WHO defines good mental health as a “a state of well-being in which the individual realizes his or her own abilities, can cope with the normal stresses of life, can work productively and fruitfully, and is able to make a contribution to his or her community” [6]. In line with this definition and from other reviews on well-being, we refer to mental well-being as a generic term different from physical well-being and encompassing components of hedonic (“feeling good”) and eudaimonic (“functioning well”) well-being, as well as social aspects of well-being (e.g., satisfactory interpersonal relationships) [7,8,9].

The hedonic perspective focuses on the subjective experience of happiness (high positive affect combined with less negative affect; the so-called affective-evaluative component of hedonic well-being) and life satisfaction (the so-called cognitive-evaluative component of hedonic well-being) [7]. In the past, hedonic well-being, following Diener, has also been referred to as ‘subjective well-being’ (defined as “a person’s cognitive and affective evaluation of life” [10]) or in line with Ryff and Keyes ‘emotional well-being’ [11].

The eudaimonic perspective focuses on the psychological functioning of a person, including concepts of autonomy, competence, self-acceptance and personal growth as well as positive interpersonal relationships. Eudaimonic well-being has sometimes been referred to as ‘psychological well-being’ [11] and was extended by a concept called ‘social well-being’, including dimensions of social functioning and relatedness with respect to society [8].

The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) is an internationally established short measurement tool designed to integratively assess different dimensions of mental well-being on a population level. The WEMWBS covers hedonic aspects with a focus on positive affect (optimism, cheerfulness, relaxation), eudaimonic aspects of psychological functioning (autonomy, competency, self-acceptance, personal growth), and positive interpersonal relationships [12].

The original version with 14 positively worded items was developed in the United Kingdom (UK) and has been translated into various other languages to monitor the mental well-being of the population and various subgroups [13]. Across several countries and populations, the WEMWBS showed psychometrically sound properties such as internal consistency [14], factorial validity [15] and criterion validity regarding a broad range of outcomes (e.g., health-related quality of life [16, 17], psychological distress [18] and psychological resources [12]). These findings suggest that the scale is an appropriate tool for its original purpose of monitoring population mental well-being and evaluating public health promotion and prevention measures. While several validation studies have confirmed the one-factor solution of the original version (e.g., [12]), some validation studies provide evidence suggesting three key factors as originally intended by the expert panel involved in the scale’s construction (i.e., hedonic, eudaimonic, interpersonal relationships [17, 19,20,21]). Recent evidence shows, that the factor structure might be best explained by applying a bifactor model with one general mental well-being factor and three grouping factors representing the structure mentioned above [20,21,22].

Concerns about item redundancy led to the construction of a brief 7-item version by the authors of the original scale using Rasch models. Although this short version (SWEMWBS) prioritizes the eudaimonic perspective over the hedonic perspective, its use is recommended in population surveys due to its brevity and robust psychometric properties [23].

There is a German version of the WEMWBS from Austria validated in an Austrian sample [17], but neither a long version nor a short version has been validated in a German sample. Hence, the present study aimed to validate this German version of the (S)WEMWBS and assess its suitability as the measure of mental well-being for the German MHS.

Materials and methods

Procedure and participants

The sample recruitment and data collection was conducted by a market and opinion research agency (respondi AG) on behalf of the RKI. Participants were recruited via the in-house access panel (convenience sample). Data were collected by means of a cross-sectional online survey in December 2020. After providing informed consent, participants answered several questions on socioeconomic (e.g., age, sex, education [24], employment status) and health characteristics (e.g., self-reported diagnoses of chronic conditions and/or lifetime mental disorders [Have you ever been diagnosed with a chronic condition/mental disorder in your life?]). The forced choice character of the items allowed for analyses using the full data set. In total, N = 1.048 participated in the study, balanced by sex (female/male) and age group (18–34, 35–49, 50–64, 65–79 years). Further sample characteristics are shown in Table 1.

Table 1 Sample characteristics

Measures

Warwick-Edinburgh mental well-being scale

Participants completed the German translation of the 14-item WEMWBS [17] on a 5-point scale (1 = ‘none of the time’ to 5 = ‘all of the time’) referring to a two-week period. The total score ranges from 14 to 70, with higher scores indicating higher mental well-being. Participants’ responses to the long version were also used to validate the 7-item short version (with a total score ranging from 7 to 35). Items and item characteristics of the (S)WEMWBS are presented in Table 2.

Table 2 (S)WEMWBS: item statistics (N = 1,048, 18–79 years)

To assess the criterion validity of the scale’s short and long versions, associations to related constructs (hedonic well-being, health-related quality of life, psychological distress, proactive coping and self-efficacy) were examined. Hedonic well-being was measured using the WHO-5 (Bech, 2004 [25,26,27]). Health-related quality of life was measured using the Short-Form Health Survey (SF-12 [28]), the Assessment of Quality of Life – 6D scale (AQoL-6D [29]) and the WHOQoL-BREF; [30]. Psychological distress was operationalized with the Kessler-10 distress scale (K-10 [31,32,33]). Proactive coping was measured using the Proactive Coping Inventory (PCI [34, 35]), and self-efficacy was assessed with the Allgemeine Selbstwirksamkeitsskala (ASKU [36]). Detailed information on these instruments is included in the supplementary materials. In accordance with findings from other validation studies [12, 15,16,17], we expected high convergent validity with instruments assessing closer constructs, namely, hedonic well-being, health-related quality of life (positive correlations) and psychological distress (negative correlation). Small to moderate positive associations were expected for the instruments assessing related but more distant constructs reflecting psychological resources, namely, proactive coping and self-efficacy.

Statistical analyses

The analyses were carried out with the software R statistics (R Version 4.4.0; RStudio Version 2024.04.0 + 735 “Chocolate Cosmos” 3) [37] in the following five steps: testing (1) factorial validity and (2) measurement invariance as well as (3) criterion validity, (4) face validity, and (5) internal consistency.

Factorial validity

To test the factorial structures of the (S)WEMWBS for different models, confirmatory factor analyses (CFA) were performed using maximum likelihood parameter estimates using standard errors robust to non-normality (MLR) and computed by means of the R package ‘lavaan’ [38]. The chi-square (χ2) value is highly affected by the size of the sample [39]. Thus, the standardized root mean square residual (SRMR), the root mean square error of approximation (RMSEA) and the comparative fit index (CFI) were used to evaluate the model fit [40]. Cutoffs for an acceptable fit were set as RMSEA ≤ 0.08, SRMR ≤ 0.10 and CFI ≥ 0.95, while a good model fit was assumed with RMSEA ≤ 0.05, SRMR ≤ 0.05 and CFI ≥ 0.97 [41]. Fit indices were compared to explore whether the factorial structure could be better explained by the suggestions of the one factor model published in the original UK validation [12] or the three factor model presented by the Austrian validation [17], respectively.

Since evidence for the appropriateness of fitting the (S)WEMWBS has accumulated recently (e.g [20,21,22]). and the Austrian validation based on a German-speaking sample used the same modelling [17], we additionally calculated a bifactor model as suggested by Eid and colleagues [42]. The bifactor-(SI – 1) model included item #6 as reference item loading only on the general factor. The selection of the reference item is based on theoretical and statistical considerations based on other data as described in Cohrdes and Junker [21].

Measurement invariance

Measurement invariance was investigated for self-reported sex (female and male) and age (above and below the sample’s mean of 50 years following the approach of Koushede and colleagues [15]). The following three measurement invariance steps were taken into account: (1) configural (equivalence of model form), (2) metric (equivalence of factor loading), (3) scalar (equivalence of item intercepts) [40]. Differences for Δ RMSEA ≤ 0.015, Δ CFI ≤ 0.010 and Δ SRMR ≤ 0.030 from configural to metric invariance and Δ RMSEA ≤ 0.015, Δ CFI ≤ 0.010 and Δ SRMR ≤ 0.015 from metric to scalar invariance were considered acceptable [43].

Measurement invariance was tested with the ‘semTools’ package and the measEq.syntax command using theta-parametrization and by standardizing the common factor [44]; model comparisons were performed with the comparFit command from ‘semTools’. For measurement invariance we followed the procedure as recommended by Jorgensen and colleagues [44] and fitted one model at a time. After establishing invariance of thresholds, we proceeded to test equivalence of loadings and intercepts (metric and scalar invariance, respectively).

Criterion validity

Pearson product-moment correlations were used to estimate the associations between the (S)WEMWBS and relevant external criteria as indicators of criterion (convergent) validity. In accordance with Cohen [45], the strength of association was interpreted as follows: r > .10 small, r > .30 medium, r > .50 large effect size.

Face validity - descriptive item analysis

Response behavior was checked via frequency analyses for each item to analyze the appropriateness of the WEMWBS 5-point scale. Distributions of single item scores and total scores were analyzed via visual inspection of histograms and residual plots. Frequency analyses were used to assess the mean, standard deviation, skewness (< |2.0|) and kurtosis (< |7.0|). On the basis of these analyses, ceiling and floor effects were checked carefully.

Internal consistency and Scale properties

Cronbach’s alpha (α) was used as a reliability estimator. Additionally, in congruence with other validations of the (S)WEMWBS, internal consistency estimates greater than r = .7 were considered appropriate [14, 19]. Estimates above 0.9 were considered an indicator of item redundancy. Group differences were determined by t-tests and the strength of differences was indicated by Cohen’s d.

Results

Factorial validity

The unidimensional factor structure showed no acceptable fit indices regarding RMSEA and CFI for both versions. For both the short and long scale versions, the correlated three-factor models showed superiority over the one-factor models, as indicated by better fit indices (considered as moderate to good with regard to all applied indices except RMSEA (see Table 3). The bifactor model fitted the data best with fit indices considered as good for both versions except RMSEA for the long version, which indicated moderate fit. The amount of common variance explained for the bifactor models for the WEMWBS were 0.87 (general factor), 0.04 (eudaimonic), 0.17 (hedonic), 0.26 (interpersonal relationships) and for the SWEMWBS 0.78 (general factor), 0.26 (eudaimonic), 0.25 (hedonic), 0.28 (interpersonal relationships). Detailed results of all for models can be find in the Supplementary Materials (Tables S1.1-S1.6; Tables S2.1-S2.6).

Modification indices were considered for the best fitting models (3-factor solutions and bifactor models) in order to explore improvements:

For the the WEMWBS (3-factor solution) based on modification indices we allowed items #2 and #13 to also load on the respective two other factors (#2: eudaimonic, interpersonal relationship; #13: hedonic, interpersonal relationship). This resulted in an improved model fit (X2(72) = 554.740, p < .001, CFI = 0.956, RMSEA = 0.078 CI [0.071–0.085], SRMR = 0.044, AIC = 29079.056.) However, modification indices of this modified model suggested further model improvement by removing either item #7 or #11 due to high intercorrelatedness (MI = 119.296). The WEMWBS bifactor model consistently showed potential for model improvement by allowing item #2 to also load on the hedonic and interpersonal relationship factor based on modification indices (MI = 39.307, 35.574, respectively). Moreover, item #13 revealed a negative loading on the eudaimonic factor. The fit indices for a modified model allowing item #2 to also load on the other two factors and excluding item #13 improved with X2(49) = 236.539, p < .001, CFI = 0.982, RMSEA = 0.058 CI [0.049–0.067], SRMR = 0.019, AIC = 26477.716.

Based on the modification indices of the 3-factor solution of the SWEMWBS we allowed item #6 to also load on the other factors (hedonic, interpersonal relationship). This resulted in an improved model fit of (X2(9) = 49.250, p < .001, CFI = 0.990, RMSEA = 0.063 CI [0.043–0.085], SRMR = 0.020, AIC = 15736.330). For the SWEMWBS bifactor model, modification indices showed no potential for model improvement.

Table 3 Model fit indices resulting from CFA using maximum-likelihood estimation with robust standard errors

Measurement invariance

Across sex and age groups and for all tested models (one-factor model, three-factor model, bifactor model), the configural and metric invariance models indicated invariance of model form and factor loadings for both the long and short versions. The change in fit indices between the scalar invariance models and the metric invariance models all met the applied cutoff indices for both versions (WEMWBS and SWEMWBS) in all tested models (one-factor model, three-factor model, bifactor model) for invariant intercepts as well. All values are depicted in Tables 4 and 5.

Table 4 Results from measurement invariance analyses across sex groups (male, female) based on maximum-likelihood estimation with robust standard errors (MLR)
Table 5 Results from measurement invariance analyses across age groups (above and below the mean value of 50 years) based on maximum-likelihood estimation with robust standard errors

Criterion validity

SWEMWBS was highly correlated with the full WEMWBS (r = .97) as well as with a version of the WEMWBS only including items that are not part of the SWEMWBS (r = .90). With regard to criterion validity, all associations between the (S)WEMWBS and the validation scales showed in the expected directions (Table 6).

Table 6 Correlations of the (S)WEMWBS with relevant constructs as indicators for criterion validity1

Face validity - descriptive item analysis

Table 2 gives an overview of the item means, standard deviations, skewness, kurtosis and response frequencies. The full width of the response format was used with regard to all items. The results indicate appropriateness of the 5-point scale as well as a sufficient differentiation ability of the scale’s items. Figures 1 and 2 show an approximately left-shifted normal distribution of both total scores. No ceiling or floor effects could be detected. Items 7 and 11 showed higher means and smaller variation than the other items. This was found in a different validation study as well [46].

Fig. 1
figure 1

WEMWBS total score distribution

Fig. 2
figure 2

SWEMWBS total score distribution

Internal consistency and scale properties

Cronbach’s alpha and mean well-being scores can be found in Table 6. Higher Cronbach’s alpha values of the WEMWBS compared to the SWEMWBS items indicate item redundancy of the long version and the preferable use of the short version in population surveys, as suggested by the authors of the original versions [12, 20].

There were no significant differences in mental well-being scores (WEMWBS: t(1046) = 1.070, p = .285, d = 0.070; SWEMWBS: t(1046) = 0.790, p = .430, d = 0.043) between males (WEMWBS: M = 3.76 (SD = 0.70); SWEMWBS: M = 3.85 (SD = 0.69)) and females (WEMWBS: M = 3.71 (SD = 0.72); SWEMWBS: M = 3.82 (SD = 0.71)).

An effect of age could be obtained (WEMWBS: F(1044,3) = 8.996, p ≤ .001; SWEMWBS: F(1044,3) = 11.371, p ≤ .001). Post hoc tests (Tukey) revealed that the oldest age group between 65 and 79 years (WEMWBS: M = 3.91,SD = 0.64; SWEMWBS: M = 4.02, SD = 0.64) showed significantly higher (p ≤ .001) mental well-being than those between 18 and 34 years (WEMWBS: M = 3.65,SD = 0.73; d = 0.370; SWEMWBS: M = 3.72, SD = 0.73; d = 0.44) and those between 35 and 49 years (WEMWBS: M = 3.63, SD = 0.75,; d = 0.40; SWEMWBS: M = 3.72,SD = 0.73; d = 0.44) but not (p = .104) higher than those between 50 and 64 years (WEMWBS: M = 3.77,SD = 0.68; d = 0.21; SWEMWBS: M = 3.88, SD = 0.78; d = 0.21).

Discussion

The assessment of mental well-being is crucial to providing a complete picture of population mental health according to a dual continua model of mental health. Both the long and the short version of the (S)WEMWBS scale have been previously found to be suitable measures of mental well-being and were thus tested in a German sample for their use within Germany’s MHS. In line with other validation studies, the present study finds both versions of the scale to have sufficient psychometric properties.

Means of model fit indices did not confirm a unidimensional factor structure for either version. The three-factor-correlative models were superior to the single-factor models for all chosen cutoffs for the long as well as the short scale, except RMSEA for the SWEMWBS. Interestingly, also other validations of the (S)WEMWBS reported problems with the RMSEA indicating partly insufficient fit while the other used indices showed good fit [20]. However, the bifactor model fitted the data best for both versions with all fit indices indicating sufficient fit. This finding is in line with recent evidence that the factor structure of the (S)WEMWBS might be best explained by applying a bifactor model (with one general mental well-being factor and three grouping factors) [20, 22]. Results based on other German samples [17, 21, 47] have also shown that the three-factor structure outperforms the one-factor structure for the (S)WEMWBS. The present study achieves an even better fit to the data by applying a bifactor model based on the assumption of one general well-being factor and three subfactors, in line with other evidence [17, 20, 21]. The three factorial structure is theoretically based on the assumption of three well-being dimensions (hedonia, eudaimonia, interpersonal relationships) [12] and has been empirically confirmed in a prior validation study using data from an Austrian German-speaking sample [17]. In consideration of the relatively low common variance of the well-being subdimensions beyond a general mental well-being factor in the SWEMWBS bifactor model, we agree with the conclusion of Lang & Bachinger [17] that total scores can be formed.

Analyses of modification indices showed some improvement of the scales by excluding certain items (e.g., items #7, #11 and #13 for the long version, item #6 for the short version) or the permission of particular cross-loadings as it could be shown in other research as well [20, 22]. However, particular the bifactor models showed good model fit for both, the original short and long versions. These original versions should be given preferences to enable temporal and cultural comparisons and to retain item content of the construct of mental well-being.

Scalar measurement invariance for the both the long (WEMWBS) and short versions (SWEMWBS) was established for sex and age. The results indicate that the items had the same meaning for males and females as well as for younger (< 50 years) and older (> 50 years) adults, justifying comparisons on the mean and intercept level in reporting mental well-being within MHS.

In terms of criterion validity, all associations between the (S)WEMWBS showed in the expected directions. Associations of the short version and the external criteria corresponded with those of the long version. Closer constructs showed strong associations, while correlations to more distant constructs were of medium magnitudes. Correlations between the WHO-5 and the (S)WEMWBS were particularly high. Post-hoc correlations (not reported) showed that the hedonic facets of the (S)WEMWBS were more strongly associated with the WHO-5 than the facets representing eudaimonic and social aspects of well-being, confirming that the WHO-5 captures aspects of hedonic well-being better. Therefore, the use of the (S)WEMWBS can be recommended beyond the use of the WHO-5 and follows the OECD’s call to consider and assess not only hedonic but also eudaimonic aspects of well-being with appropriate instruments [48].

Validity analyses of the scales’ properties further showed that there were no differences in mental well-being by sex. However, we found significant differences between the younger age groups (< 50 years) and the oldest age group, with significantly higher mental well-being in adults above 65 years. These results are in line with those of the Austrian German validation study [17] and with other findings from well-being research using different measurement instruments [49, 50].

The mean values of the (S)WEMWBS were similar to those of other European countries [14]. The score distributions of both the long and short versions were approximately normal with a slight left skew and were thus comparable with those reported in the original validation studies [11, 16]. The obtained distributions indicate that the (S)WEMWBS discriminate sufficiently between different groups and are therefore suitable for use in a German MHS. Internal consistencies show item redundancy in the long version [13] and justify the application of the short version in monitoring population mental well-being. The SWEMWBS also showed similarly high correlations with the external criteria used to estimate criterion validity as the WEMWBS as well as a high correlation with the items of the longer WEMWBS not included in it, further suggesting that the application of the short version is appropriate.

In sum, our results provide evidence in favor of employing the widely-used SWEMWBS in Germany’s MHS with no need to modify the scale. However, it should be noted that neither the long nor the short version entirely covers all three mental well-being dimensions of hedonic, eudaimonic, and social well-being. For instance, life satisfaction, representing the cognitive-evaluative aspect of hedonic well-being, is one of the most commonly used indicators of well-being but is not represented in the WEMWBS [51]. In particular, the SWEMWBS mainly comprises items that can be assigned to eudaimonia. Therefore, critical consideration should be given to whether the (S)WEMWBS should be supplemented by additional relevant items for a comprehensive and internationally comparable German MHS (e.g., Satisfaction with Life Scale (SWLS; [52]). Moreover, it should be noted that social well-being as conceptualized by Keyes [8] is not covered by the SWEMWBS. The third factor of the WEMWBS captures social aspects of mental well-being but only with a view to the immediate social environment (i.e., interpersonal relationships), thus not fully covering the broader original concept of eudaimonia, which includes positive ties to society at large [7]. Given the increasing challenges associated with various emerging societal crises [1], well-being indicators capturing individuals’ relationship to broader society may be of growing importance for MHS.

The following limitations should be considered when interpreting the findings of the present study and deriving recommendations for future studies:

First, we used a convenience sample that was not representative of the German population structure (53). Future studies should investigate the properties of the (S)WEMWBS in representative samples, also in order to calculate norm values, which could be used as a benchmark for national and international comparisons both on the population and the individual level. In terms of more evidence-based mental health measures, norms can serve as a reference, for example when conducting impact analyses of targeted interventions for specific subgroups.

Second, data collection fell within the period of the COVID-19 pandemic, which could have impacted participants’ mental well-being at the time of measurement and thus the mean scores of the (S)WEMWBS. Long-term data are needed to replicate the reported findings.

Finally, we did not test the discriminant validity of the scale by examining its association with constructs hypothesized to be uncorrelated to mental well-being and did not conduct qualitative analyses to assess face validity. Future studies in German samples might implement a multimethod approach, for example, for validation among children and youth for whom the comprehensibility of items needs to be demonstrated in particular.

Conclusions

Positive mental health (i.e., mental well-being) represents an equally important object of comprehensive MHS alongside psychopathology following a dual continua model of mental health. Monitoring mental well-being on a regular basis provides an important evidentiary foundation for prevention and promotion in public mental health, including the development of measures to improve mental well-being tailored to specific subgroups. In fact, higher levels of mental well-being have already been shown to positively influence recovery from affective disorders, showing the potential utility of interventions targeting mental well-being in reducing the burden of mental disorders independent of the degree of psychopathology [54]. To assess mental well-being appropriately, a reliable and internationally comparable measure of well-being is needed for MHS. Conceptual discrepancies and the range of different measurement instruments in existence have posed challenges in identifying a suitable measure. The theoretically derived and empirically sound factorial structure as well as the psychometric properties of the (S)WEMWBS in this German validation study were in line with the original validation studies and previous findings from other countries. The present study therefore provides evidence in support of suitability of the (S)WEMWBS for use in Germany’s MHS for both comprehensive national monitoring of population mental health and international comparisons of mental well-being at the population level. The extent to which the scale should be complemented by further measures of mental well-being to address all dimensions of mental well-being (hedonia, eudaimonia, social) remains to be further investigated and discussed [55, 56].

Data availability

Since informed consent from study participants did not cover the public deposition of data, the datasets generated and analyzed during the current study are not publicly available but can be provided by the corresponding author on reasonable request.

Abbreviations

AIC:

Akaike Information Criterion

CFA:

Confirmatory Factor Analysis

CFI:

Comparative Fit Index

MHS:

Mental Health Surveillance

OECD:

Organization for Economic Cooperation and Development

RKI:

Robert Koch Institute

RMSEA:

Root Mean Square Error of Approximation

SRMR:

Standardized Root mean Square Residual

SWEMWBS:

Short Warwick-Edinburgh Mental Well-Being Scale

UK:

United Kingdom

WEMWBS:

Warwick-Edinburgh Mental Well-Being Scale

WHO:

World Health Organization

References

  1. Mauz E, Eicher S, Peitz D, Junker S, Holling H, Thom J. Mental health of the adult population in Germany during the COVID-19 pandemic. Rapid Rev J Health Monit. 2021;6(Suppl 7):2–63.

    Google Scholar 

  2. Thom J, Mauz E, Peitz D, Kersjes C, Aichberger M, Baumeister H, et al. Establishing a Mental Health Surveillance in Germany: development of a framework concept and indicator set. J Health Monit. 2021;6(4):34–63.

    PubMed  PubMed Central  Google Scholar 

  3. World Health Organization. WHO Mental Health Action Plan 2013–2020. Switzerland; 2013 Jan.

  4. Choi BC. The past, present, and future of public health surveillance. Scientifica (Cairo). 2012:875253.

  5. Iasiello M, Van Agteren J, Muir-Cochrane EC. Mental Health and/or Mental Illness: a scoping review of the evidence and implications of the Dual-Continua Model of Mental Health. Evid Base. 2020;1:1–45.

    Article  Google Scholar 

  6. World Health Organization. WHO Promoting Mental Health. CONCEPTS. EMERGING EVIDENCE. PRACTICE. Summary Report. Switzerland; 2004.

  7. Ryan RM, Deci EL. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66.

    Article  CAS  PubMed  Google Scholar 

  8. Keyes CLM. Social Well-Being Social Psychol Q. 1998;61(2):121–40.

    Google Scholar 

  9. Tov W. Well-being concepts and components. Handbook of subjective well-being. Salt Lake City, 2018. pp. 1–15.

  10. Diener E. Subjective well-being. Psychol Bull. 1984;95(3):542–75.

    Article  CAS  PubMed  Google Scholar 

  11. Ryff CD, Keyes CLM. The structure of psychological well-being revisited. J Personal Soc Psychol. 1995;69(4):719–27.

    Article  CAS  Google Scholar 

  12. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh Mental Well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Stewart-Brown S, Janmohamed K. Warwick-Edinburgh Mental Well-being scale (WEMWBS). User guide. Version 1. Warwick Medical School University of Warwick; 2008 Jun.

  14. Clarke A, Friede T, Putz R, Ashdown J, Martin S, Blake A, et al. Warwick-Edinburgh Mental Well-being scale (WEMWBS): validated for teenage school students in England and Scotland. A mixed methods assessment. BMC Public Health. 2011;11:487.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Koushede V, Lasgaard M, Hinrichsen C, Meilstrup C, Nielsen L, Rayce SB, et al. Measuring mental well-being in Denmark: validation of the original and short version of the Warwick-Edinburgh mental well-being scale (WEMWBS and SWEMWBS) and cross-cultural comparison across four European settings. Psychiatry Res. 2019;271:502–9.

    Article  PubMed  Google Scholar 

  16. Lopez MA, Gabilondo A, Codony M, Garcia-Forero C, Vilagut G, Castellvi P, et al. Adaptation into Spanish of the Warwick-Edinburgh Mental Well-being scale (WEMWBS) and preliminary validation in a student sample. Qual Life Res. 2013;22(5):1099–104.

    Article  PubMed  Google Scholar 

  17. Lang G, Bachinger A. Validation of the German Warwick-Edinburgh Mental Well-being scale (WEMWBS) in a community-based sample of adults in Austria: a bi-factor modelling approach. J Public Health. 2017;25:135–46.

    Article  Google Scholar 

  18. Castellvi P, Forero CG, Codony M, Vilagut G, Brugulat P, Medina A, et al. The Spanish version of the Warwick-Edinburgh mental well-being scale (WEMWBS) is valid for use in the general population. Qual Life Res. 2014;23(3):857–68.

    Article  PubMed  Google Scholar 

  19. Taggart F, Friede T, Weich S, Clarke A, Johnson M, Stewart-Brown S. Cross cultural evaluation of the Warwick-Edinburgh Mental Well-being scale (WEMWBS) --a mixed methods study. Health Qual Life Outcomes. 2013;11:27.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Sarasjärvi K, Elovainio M, Appelqvist-Schmidlechner K, Solin P, Tamminen N, Therman S. Exploring the structure and psychometric properties of the Warwick-Edinburgh Mental Well-being scale (WEMWBS) in a representative adult population sample. Psychiatry Res. 2023;328:115465.

    Article  PubMed  Google Scholar 

  21. Cohrdes C, Junker S. Shall we add some meaning? Investigating useful single item extensions to the short Warwick-Edinburgh Mental Well-Being Scale for national public health surveillance. In revision.

  22. Shannon S, Breslin G, Prentice G, Leavey G. Testing the factor structure of the Warwick-Edinburgh Mental Well-being scale in adolescents: a bi-factor modelling methodology. Psychiatry Res. 2020;293:113393.

    Article  PubMed  Google Scholar 

  23. Stewart-Brown S, Tennant A, Tennant R, Platt S, Parkinson J, Weich S. Internal construct validity of the Warwick-Edinburgh Mental Well-being scale (WEMWBS): a Rasch analysis using data from the Scottish Health Education Population Survey. Health Qual Life Outcomes. 2009;7:15.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Müller W, Lüttinger P, König W, Karle W. Class and education in industrial nations. Int J Sociol. 1989;19(3):3–39.

    Article  Google Scholar 

  25. Sischka PE, Costa AP, Steffgen G, Schmidt AF. The WHO-5 well-being index – validation based on item response theory and the analysis of measurement invariance across 35 countries. J Affect Disorders Rep. 2020;1:100020.

    Article  Google Scholar 

  26. Bech P. Measuring the dimensions of psychologicalgeneral well-being by the WHO-5. Qual Life Newsl. 2004;32:15–6.

    Google Scholar 

  27. Bech P, Olsen LR, Kjoller M, Rasmussen NK. Measuring well-being rather than the absence of distress symptoms: a comparison of the SF-36 Mental Health subscale and the WHO-Five well-being scale. Int J Methods Psychiatr Res. 2003;12(2):85–91.

    Article  PubMed  Google Scholar 

  28. Wirtz MA, Morfeld M, Glaesmer H, Brähler E. Normierung Des SF-12 Version 2.0 zur Messung Der Gesundheitsbezogenen Lebensqualität in Einer Deutschen bevölkerungsrepräsentativen Stichprobe. Diagnostica. 2018;64(4):215–26.

    Article  Google Scholar 

  29. Richardson JR, Peacock SJ, Hawthorne G, Iezzi A, Elsworth G, Day NA. Construction of the descriptive system for the Assessment of Quality of Life AQoL-6D utility instrument. Health Qual Life Outcomes. 2012;10:38.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Angermeyer MC, Kilian R, Matschinger H. WHOQOL-100 und WHOQOL-BREF. Handbuch für die deutschsprachigen Versionen der WHO Instrumente zur Erfassung von Lebensqualität2000.

  31. Havard Medical School. National Comorbidity Survey 2005 [https://www.hcp.med.harvard.edu/ncs/k6_scales.php

  32. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry. 2003;60(2):184–9.

    Article  PubMed  Google Scholar 

  33. Giesinger J, Rumpold G, Schüßler G. German version of the K10 screening scale for psychological distress. Psychosom und Konsiliarpsychiatrie. 2008;2(2):104–11.

    Article  Google Scholar 

  34. Schwarzer R, Greenglass ER, Taubert S. PCI - Deutsche Testversion zu allgemeiner und proaktiver Stressbewältigung. Deutsche Testversion 1 (2000) des Proactive Coping Inventory 2000 [http://userpage.fu-berlin.de/~gesund/skalen/PCI_-_Deutsche_Testversion/pci_-_deutsche_testversion.htm]]

  35. Greenglass E, Schwarzer R, Taubert S. The Proactive Coping Inventory (PCI): A Multidimensional Research Instrument Canada: York University; 1999 [http://userpage.fu-berlin.de/~health/greenpci.htm]]

  36. Beierlein C, Kovaleva A, Kemper CJ, Rammstedt B. ASKU. Allgemeine Selbstwirksamkeit Kurzskala [Verfahrensdokumentationen, Fragebogen Deutsch und Englisch]. Open Test Archive: Leibniz-Institut für Psychologie (ZPID);; 2012.

  37. R Core Team. A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing. 2024. [https://www.r-project.org/]]

  38. Rosseel Y. Lavaan: an R Package for Structural equation modeling. J Stat Softw. 2012;48(2):1–36.

    Article  Google Scholar 

  39. Buhner M. Einführung in die Test- und Fragebogenkonstruktion: Pearson; 2011. 640 p.

  40. Putnick DL, Bornstein MH. Measurement Invariance conventions and reporting: the state of the art and future directions for Psychological Research. Dev Rev. 2016;41:71–90.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol Res Online (MPR-online). 2003;8(8):23–74.

    Google Scholar 

  42. Eid M, Geiser C, Koch T, Heene M. Anomalous results in G-factor models: explanations and alternatives. Psychol Methods. 2017;22(3):541–62.

    Article  PubMed  Google Scholar 

  43. Chen FF. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equation Modeling: Multidisciplinary J. 2007;14(3):464–504.

    Article  Google Scholar 

  44. Jorgensen TD, Pornprasertmanit S, Schoemann AM, Rosseel Y. semTools Useful tools for structural equation modeling. R package version 0.5-6 2022 [https://CRAN.R-project.org/package=semTools

  45. Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum; 1988. pp. 1–579.

    Google Scholar 

  46. Hunter S, Houghton S, Wood L. Positive Mental Well-being in Australian adolescents: evaluating the Warwick-Edinburgh Mental Well-being Scale. Australian Educational Dev Psychol. 2015;32(2):93–104.

    Article  Google Scholar 

  47. Peitz D, Hoelling H, Born S, Rosario AS, Cohrdes C. German adult population norm values of the short Warwick-Edinburgh mental well-being scale (SWEMWBS). Qual Life Res. 2024;33(8):2145–50.

    Article  PubMed  PubMed Central  Google Scholar 

  48. OECD. Measuring Population Mental Health. 2023. [https://www.oecd-ilibrary.org/social-issues-migration-health/measuring-population-mental-health_5171eef8-en]]

  49. Blanchflower DGO. A. O. Do modern humans suffer a psychological low in midlife? Two approaches (with and without controls) in seven data sets.; 2018.

  50. Bauer JML, Munoz Boudet V, Nie AM, Sousa-Poza P. A. Subjective well-being across the Lifespan in Europe and Central Asia. Popul Ageing. 2017(10):125–58.

  51. Tennant R, Fishwick R, Platt S, Joseph S, Stewart-Brown S. Monitoring positive mental health in Scotland: validating the Affectometer 2 scale and developing the Warwick-Edinburgh Mental Well-Being Scale for the UK. 2006 Sep.

  52. Janke S, Glöckner-Rist A. Deutsche Version der Satisfaction with Life Scale (SWLS) 2012 [https://zis.gesis.org/skala/Janke-Gl%C3%B6ckner-Rist-Deutsche-Version-der-Satisfaction-with-Life-Scale-(SWLS)].

  53. Bundesamt S. Zahlen und Fakten 2023 [https://www.destatis.de/DE/ZahlenFakten]]

  54. Iasiello M, van Agteren J, Keyes CLM, Cochrane EM. Positive mental health as a predictor of recovery from mental illness. J Affect Disord. 2019;251:227–30.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Vaculíková J. Exploring the Multivariate aspects of the proactive coping inventory. TOJET: The Turkish Online Journal of Educational Technology; 2017.

    Google Scholar 

  56. Beierlein C, Kovaleva A, Kemper CJ, Rammstedt B. Allgemeine Selbstwirksamkeit Kurzskala (ASKU). Zusammenstellung sozialwissenschaftlicher Items und Skalen (ZIS). 2014.

Download references

Acknowledgements

We are grateful to all study participants and thank our colleagues from the RKI as well as our national and international collaborators for their high engagement and valuable contribution to the Mental Health Surveillance project. Moreover, we thank Heike Arndt and Anja Engel for their support in setting up the materials for this manuscript.

Funding

Open Access funding enabled and organized by Projekt DEAL. The first author conducted the work for the project “MHS - Establishment of a National Mental Health Surveillance at Robert Koch Institute” that was funded by the Federal Ministry of Health (Grant Number: ZMI5-2519FSB402).

Author information

Authors and Affiliations

Authors

Contributions

DP drafted the manuscript and conducted the statistical analyses. CC acquired the study funding and conceptualized, supervised the study as well as the analyses and writing process. and conducted further analyses within the review process JT, LW and HH provided substantial input for the final version of the manuscript. LW supported with the manuscript`s language. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Diana Peitz.

Ethics declarations

Ethics approval and consent to participate

Data protection audit was provided by RKI. The study was approved by the Ethics Committee of the Charité Universitätsmedizin Berlin (Nr. EA4/225/20).

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peitz, D., Thom, J., Walther, L. et al. Validation of the Warwick-Edinburgh Mental Well-Being Scale for the Mental Health Surveillance (MHS) of German adults. Health Qual Life Outcomes 22, 92 (2024). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12955-024-02304-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12955-024-02304-4

Keywords