- Research
- Open access
- Published:
Development and psychometric validation of a novel health literacy scale for family caregivers of preschool children
Health and Quality of Life Outcomes volume 23, Article number: 18 (2025)
Abstract
Background
Health literacy among family caregivers has been found to be strongly correlated with health exposures and outcomes for their children. Accurate assessment of their health literacy contributes to improving child health outcomes. Given the limited evidence on health literacy measures for family caregivers, the study aimed to develop and validate a novel Health Literacy Scale for Family Caregivers of Preschool Children (HLSFC).
Methods
The HLSFC was developed in 4 phases: 1) using Nutbeam’s conceptual framework of health literacy as a guide to clarify the content to be measured; 2) generating an item pool; 3) providing feedback on the initial items; 4) psychometric analyses. A cross-sectional survey of 443 family caregivers of preschoolers was conducted in Northwest China. Construct validity was assessed using exploratory factor analysis (n = 213) and confirmatory factor analysis (n = 230). Reliability was assessed using internal consistency, split-half reliability, and test–retest reliability.
Results
Thirty-Three items were included in the final instrument. Principal component analysis yielded a three-factor structure explaining 70.013% of the total variance. All fitting indices met the standard based upon confirmatory factor analysis. The composite reliability values of the factors ranged from 0.928 to 0.944 (> 0.7), and the average variance extracted values ranged from 0.552 to 0.590 (> 0.5), indicating acceptable convergent validity. The Cronbach’s alpha value was 0.963. The test–retest reliability was good, with an intraclass correlation coefficient of 0.909. Sociodemographic factors, such as caregiver education, occupation, residence, and monthly household income per person, were significantly associated with health literacy scores.
Conclusion
The HLSFC demonstrated adequate reliability and validity, and can measure a wide range of health literacy skills: from functional to interactive and critical health literacy. It could be potentially applied as an effective tool for the health literacy assessment among family caregivers of preschoolers.
Introduction
Health literacy (HL), understood as “the skills, knowledge, and motivation to access, understand, and appraise health-related information to make informed health decisions in daily life [1]” has been identified as a key determinant of health and a priority in the public health policy agenda [2]. It plays a crucial role in interpreting differences in health behaviors and outcomes across all populations and age groups [3]. Several recent studies have suggested that limited health literacy may be a substantial contributor to poorer health outcomes, broader inequalities, and higher healthcare costs [4]. Thus, governments around the world have adopted national policies and programs to promote health literacy [5,6,7]. These incentives foster the transition of health literacy from the margins to the mainstream. Meanwhile, healthcare stakeholders and professionals are also focusing on the health literacy of key groups such as caregivers of children. The Johnson Health Care Institute (HCI) trains Head Start leadership to support and empower parents to address their children’s health care concerns. HCI has implemented a range of initiatives with a focus on the development of parental health literacy and health knowledge [8]. National Health Commission of China has explicitly stated that the health literacy of child caregivers should be improved in the National Action Plan for the Health of Children (2021–2025) [9].
Children’s growth and development unfold in a series of distinct, sequential stages, with each stage presenting unique health challenges that require family caregivers to adapt and respond effectively [10]. The preschool years (ages 3–6, typically corresponding to the kindergarten stage) are a crucial period in children’s development, marked by rapid growth and significant changes across physical, cognitive, social, and emotional domains [11]. During this period, children are especially vulnerable to preventable health risks, including unintentional injuries (e.g., falls, poisoning, road traffic accidents) [12], infectious diseases (e.g., respiratory infections, gastrointestinal illnesses) [13], and the development of unhealthy habits related to nutrition, physical activity, and oral hygiene [14]. These early health experiences can profoundly and persistently affect lifelong health and well-being, shaping long-term health patterns [11]. Family caregivers play a pivotal role in managing these risks and influencing children’s health outcomes, as the healthy development of preschool children relies heavily on the nutrition, education, protection, and support provided by family caregivers [15, 16]. Caregivers’ ability to make informed health decisions, correctly administer medications, identify signs and symptoms of illness, and communicate effectively with healthcare providers is essential for preventing and managing health issues [17]. The health literacy of family caregivers directly affects their ability to fulfill these critical roles [18].
Inadequate health literacy among family caregivers is correlated with reduced access to preventive health services and increased exposure to health risks for children. These risks include second-hand tobacco smoke exposure, higher injury rates, obesity, poor oral health, improper medication administration, and unnecessary emergency department visits [19]. In contrast, improving caregiver health literacy leads to better health practices, enhanced disease prevention, and more effective healthcare management, ultimately resulting in improved health outcomes for children [18, 20]. The preschool years provide a critical opportunity to equip caregivers with the knowledge and skills to support their children’s well-being, laying the foundation for a healthier future [21]. Interventions designed to improve caregiver health literacy during this stage can help foster healthy habits, prevent chronic conditions, and benefit both children and families in the long term [17]. However, current efforts to improve the health literacy among family caregivers of preschool children remain in the early stages, with interventions such as mobile apps, videos, and web-based programs showing promise but lacking rigorous evaluation [22,23,24]. To maximize the impact of these interventions, reliable tools for assessing caregiver health literacy are essential. Such tools not only help identify family caregivers in need of support but also enable the evaluation of intervention effectiveness, guiding continuous improvements in health literacy initiatives [25].
Previous studies assessing the health literacy of parents or caregivers have applied instruments that examine general literacy or that predominantly evaluate health literacy in the adult healthcare context [24]. For example, the Test of Functional Health Literacy in Adults (TOFHLA) [26], the Newest Vital Sign (NVS) [27], and the Rapid Estimate of Adult Literacy in Medicine (REALM) [28]. They are often regarded as the “gold standard” for assessing health literacy [29]. However, they evaluate a relatively limited range of health literacy [30, 31] and are therefore less likely to capture changes across the broad range of skills targeted by health literacy interventions. In addition, they are developed for general use and have limited ability to assess the particular effectiveness of health literacy interventions tailored to specific populations [25]. Although validated health literacy tools for parents or caregivers exist, the Parental Health Literacy Activities Test (PHLAT) [32] and the Parenting Plus Skills Index (PPSI) [25], the content of their entries is based on government resources or specific health materials in the United States and Australia, respectively. The generalizability of these tools is limited. In addition, PHLAT can only assess the health literacy of infant caregivers. The Chinese parental health literacy questionnaire was also developed for caregivers of children aged 0–3 years [33]. In summary, current tools used by researchers to assess health literacy in preschooler caregivers have several key limitations. These include a lack of population-specific customization, a narrow focus on certain health literacy skills, regional content biases, and age-specific gaps in assessment [34, 35]. Due to these limitations, comprehensively capturing the diverse skills and knowledge needed by family caregivers of preschool children remained challenging. Such shortcomings may hinder accurate measurement of caregiver health literacy, making it challenging to identify those in need of support and to tailor interventions accordingly [35]. Furthermore, the absence of a dedicated tool for measuring caregiver health literacy impedes the evaluation of intervention effectiveness and research on the relationship between caregiver health literacy and preschool children’s health and well-being [35]. Consequently, inadequate attention to caregiver health literacy may negatively impact children’s health outcomes by promoting suboptimal health practices and parenting strategies [36].
Given these gaps, this study aims to develop a novel Health Literacy Scale for Family Caregivers of Preschool Children (HLSFC) and then evaluate its psychometric properties. The HLSFC is designed to assess the health literacy of family caregivers and capture improvements in health literacy skills throughout the specific interventions.
Methods
The development of the HLSFC was guided by a clear guideline for scale development published by Devellis et al. [37]. The development and validation processes were carried out in the following four phases (see Fig. 1). Phase 1, determine the target population and content to be measured, using Nutbeam’s (2008) health literacy framework [38] as an aid to clarity. Phase 2, generate an item pool by reviewing the relevant literature and conducting interviews. Phase 3, have the initial scale reviewed by experts, modify the first draft according to the experts’ review, and screen items by pilot testing the modified instrument. Phase 4, further validate the scale based on the results of exploratory factor analysis (EFA) and confirmatory factor analysis, and test the reliability of the final version of the scale. As there is no criterion (i.e. “gold standard”) validity for health literacy of family caregivers, we hypothesized that higher levels of caregivers’ education and income would be associated with improved HLSFC scores according to the established health literacy models [39, 40].
Phase 1: conceptual framework
Nutbeam’s conceptual model [38, 41] was employed to guide the scale development. Nutbeam defined health literacy as comprising three dimensions: Functional Health Literacy (FHL), Interactive Health Literacy (IHL), and Critical Health Literacy (CHL). The characteristics of preschoolers and the recommendations from relevant experts were combined in this study to define the dimensions and connotations of health literacy for family caregivers. In the context of childcare, Functional Health Literacy refers to the coverage and mastery of knowledge about health risks and health services for preschoolers, as well as the literacy skills to obtain health information for preschool children. Interactive Health Literacy refers to the literacy and social skills for the acquisition, communication, and application of information related to children’s health, and will contribute to the improvement of preschoolers’ motivation for health, the shaping of their healthy behavior and the improvement of their health status. Critical Health Literacy refers to the critical analysis of the reliability of child-health-related information and its applicability to exert great control over health-related situations.
Phase 2: Item generation
The item development process began with a comprehensive review of published research on Nutbeam’s definition of health literacy [38, 41, 42], its measurement [43,44,45,46], and health literacy assessment tools for caregivers of children [25, 32, 33]. The reference resources used for generating the item pool are displayed in Table 1 of the supplementary material. We further interviewed 26 caregivers of preschool children to fully understand their functional, interactive and critical health literacy needs and to propose items related to the three dimensions. Following these stages, an item pool consisting of 44 items and covering three dimensions was generated, including 20 items in FHL dimension, 14 items in IHL dimension, and 10 items in CHL dimension. The item pool addressed several health topics: nutrition/growth, physical activity, health behavior development, immunization, injury/safety, health monitoring, and preventive care. It assesses a range of cognitive, communicative, and social skills that may be necessary for family caregivers in their day-to-day care of children.
Phase 3: Item Modification
Modified expert panel
A multidisciplinary consensus committee, consisting of 15 experts specializing in pediatric health services research and health literacy, was established. Inclusion criteria required at least 10 years of professional experience, familiarity with pediatric healthcare or health literacy, and an intermediate or higher professional title. Expert consultation was conducted using the Delphi method to ensure independent and unbiased feedback. Each expert received a consultation form via email, which included an explanation of the study’s objectives, a brief introduction to Nutbeam’s health literacy conceptual model, and the preliminary scale items developed in Phase 2. Experts were asked to assess the importance of each item and provide feedback on the appropriateness of the items, clarity of descriptions, and difficulty level. The importance of each item was rated on a 5-point Likert scale (1 = “not important,” 2 = “slightly important,” 3 = “moderately important,” 4 = “very important,” and 5 = “extremely important”), with a comment section for suggested modifications. To maintain objectivity and prevent potential influence among experts, direct communication between panel members was not facilitated. Instead, the research team consolidated the feedback and provided summarized justifications for the changes in the second round of consultation. Following the experts’ suggestions, 11 items were deleted and 2 items were added. Finally, the initial version of the HLSFC consisted of 35 items, including 12 items in the FHL dimension, 14 items in the IHL dimension, and 9 items in the CHL dimension.
Pilot test
The research team pilot-tested the initial HLSFC on 30 family caregivers recruited through convenience sampling in Northwest China. All volunteers completed the scale and were interviewed about each item to identify any ambiguous or unclear items and to revise the wording. Minor changes were made for clarity and ease of understanding.
Phase 4: Validation of the scale
Study setting and participants
A cross-sectional study was conducted at 4 kindergartens using convenience sampling in Northwest China, including both urban and rural districts. Primary family caregivers of preschool children were the target participants. The inclusion criteria comprised: a) capability for literally communication with researchers; b) voluntary willingness to participate in the research. Exclusion criteria were acute or severe illnesses. To validate the initial version of HLSFC, a sample size of 443 family caregivers was recruited and administered the questionnaire, which is sufficient as the sample size for EFA should be at least five times larger than the total number of items, and the sample size for CFA should be no less than 200 [47]. After a full explanation of the study aims and procedures, informed consent was obtained from all participants. Ethical approval was granted by the Ethics Committees of Xi’an Jiaotong University (No. 2021–1511).
Instruments
The initial version of HLSFC. The initial 35-item HLSFC was scored using a five-point Likert scale. Items 1–12 were scored as 5 = “fully knowledgeable”, 4 = “mostly knowledgeable”, 3 = “partially knowledgeable”, 2 = “not very knowledgeable”, and 1 = “not at all knowledgeable”; items 13–35 were scored as: 5 = “almost always”, 4 = “often”, 3 = “sometimes”, 2 = “rarely”, 1 = “never”. The scores for each item were summed to obtain the total score. The higher the score, the higher the health literacy level of the respondent.
General Information Questionnaire. Socio-demographic data of children and their family caregivers were obtained with the General Information Questionnaire that we developed. The questionnaire includes the relationship to the child, the child’s and caregiver’s age, the child’s gender, the caregiver’s education, occupation, residence, difficulties with childcare, reports of their children’s overall health status, monthly household income per person, and only-child or not.
Statistical analysis
Statistical Package for the Social Sciences (SPSS) version 19.0 and Amos version 23.0 were used for data analysis. Frequency tables, means and standard deviations (SD) were employed to statistically describe the demographic variables. The 15 experts were tasked with evaluating the importance of each item utilizing a 5-point Likert scale (as mentioned above). The filter criteria for all items were set at a mean importance score of less than 4 or a coefficient of variation [48] greater than 0.25 [49]. After rating each item, experts could provide recommendations or suggestions in a designated column. Item validity was assessed through item analysis.
The Cronbach alpha coefficient was used to evaluate internal consistency, deeming a value of 0.7 or higher as sufficient [50]. Two weeks after the first survey, 30 participants who had completed the first survey were recruited to fill out the same scale once more to measure the test–retest reliability of the scale. Test–retest reliability was evaluated through the intraclass correlation coefficient (ICC) [51]. ICC values ranging from 0.5 to 0.75 indicated moderate reliability, values between 0.75 and 0.9 indicated good reliability, and values greater than 0.90 indicated excellent reliability [52]. Exploratory factor analysis (EFA) was conducted to ascertain the factor structure of the scale [53]. Confirmatory factor analysis [54] was additionally performed to validate the factor structure. Criteria for the recommended indices included [55]: (a) Chi-squared divided by the degrees of freedom ≤ 3; (b) root mean squared error of approximation (RMSEA) < 0.08; (c) comparative fit index (CFI) and incremental fit index (IFI) > 0.90; (d) parsimony-adjusted comparative fit index (PCFI) > 0.50. Additionally, Composite Reliability (CR) and Average Variance Extracted (AVE) values were computed for each factor to evaluate convergent validity. Discriminant validity was evaluated using the Fornell-Larcker criterion, which involved comparing the square root of the AVE value for each dimension with the corresponding correlations between dimensions. Discriminant validity was achieved when the square root of the AVE of each dimension was greater than its correlations with other dimensions [56]. The significance threshold was set at P < 0.05.
Results
Item modification and content validity
The item pool of 44 items was reviewed by experts. A total of 15 experts from various fields participated in this process, including child health and care (6 experts), preschool education (1 expert), health literacy (3 experts), pediatric clinical nursing (3 experts), psychology (1 expert), and nutrition (1 expert). The experts had an average professional experience of 23.07 ± 5.44 years and an average age of 46.25 ± 4.81 years, with all holding at least a Master’s degree. The demographic characteristics of the consulted experts are presented in Table 2 of the supplementary material.
In the initial round of consultation, experts independently reviewed all scale items, providing both quantitative ratings and qualitative feedback. The evaluation demonstrated high expert authority, with a judging basis coefficient (Ca) of 0.927, a familiarity coefficient (Cs) of 0.847, and an authority coefficient (Cr) of 0.887. The level of agreement among experts, as measured by Kendall’s W, was 0.285 (P < 0.001), indicating weak to moderate agreement [57]. This is typical at early stages of scale development due to the diverse perspectives of the panel. The coefficient of variation ranged from 0.00 to 0.272, identifying several items with relatively high variability.
Based on expert feedback, 4 items of the FHL dimension met the predefined cut off value (CV > 0.25), including item 3 (I know that children can supplement with light saline if they sweat more during intense activity), item 18 (I need help from others to read children’s health information), item 19 (I need help from others to fill in children’s health information) and item 20 (I need help from others to calculate the time and dosage of children’s medication). These items were considered to delete. In addition, several experts proposed that item 7 (I know that children should cover their mouths and noses with a handkerchief/tissue when coughing) and item 17 (I know that antibiotics for children should be administered under the supervision of a doctor) of the FHL dimension were more relevant to the health of the caregiver than the child. Furthermore, 2 experts noted that the content of these items was too specific to reflect the connotation of children’s health. Feedback also indicated that items 13 (I know the preventive measures for vitamin/trace element deficiencies in children) and 14 (I know the signs of common childhood injuries) of the FHL dimension were overly complicated for family caregivers. In the IHL dimension, items 22 (I can apply the child health information obtained to my daily life) and 34 (I am confident in taking care of children’s health and safety) were perceived to be conceptually unrelated to the dimensional connotation. Item 41 (I can respond appropriately to children’s loud crying or aggressive behavior) of the CHL dimension was suggested for deletion as it expressed a similar meaning as item 40 (I can identify possible psycho-behavioral problems in children). These 11 items were deleted after discussions among the research team. Following the experts’ suggestions, 2 items related to medical insurance and family interactions were added.
In the second round of consultation, the revised 35-item scale, along with detailed explanations of all modifications, was presented to the same expert panel. The response rate remained 100%. This iterative process led to improved agreement among the experts, with Kendall’s W increasing to 0.541 (P < 0.001), reflecting moderate agreement. Additionally, the CV narrowed to a range of 0.00–0.211, indicating reduced variability in expert ratings. This suggested a positive trend toward increasing consensus among the experts regarding the scale. Finally, the initial version of the scale consisted of 35 items, including 12 items in the FHL dimension, 14 items in the IHL dimension, and 9 items in the CHL dimension. A summary of the expert feedback on the scale items is presented in Table 3 of the supplementary material.
Pilot test
The initial 35-item scale was tested on a sample of 30 family caregivers recruited through convenience sampling in Northwest China. The wording of items 1–12 was “I know…”. They were scored using a five-point Likert scale (5 = “strongly agree,” 4 = “agree,” 3 = “uncertain,” 2 = “disagree,” 1 = “totally disagree”) in the initial scale. Several participants (n = 3) proposed to modify the scoring method as 5 = “Fully knowledgeable,” 4 = “mostly knowledgeable,” 3 = “partially knowledgeable,” 2 = “not very knowledgeable,” 1 = “not at all knowledgeable” for ease of understanding. The order of the individual items was adjusted. The researcher recorded participants’ suggestions during the pilot study and made modifications after discussion with experts.
Social and demographic characteristics of participants
Table 1 shows the social and demographic characteristics of caregivers and their children. A total of 443 caregiver-child dyads participated in the study, including 308 mothers (69.5%), 112 fathers (25.3%), and 23 grandparents or other caregivers (5.2%). The average age of caregivers and children was 34.20 ± 6.84 years and 5.00 ± 0.87 years, respectively. 63.2% of participants lived in rural areas. 30.2% of caregivers had a junior college degree or higher. Boys accounted for 52.6% of the participating children, and 77.0% were not the only child.
Item analysis
First, the HLSFC items were categorized into groups of high and low scores based on the participants’ total scores. The high sub-group comprises entries from participants with overall scores in the top 27%, while the low sub-group consists of entries in the bottom 27%. Subsequently, an independent sample t-test was utilized to assess the mean scores for each item between the two groups, and the critical ratio (CR) was calculated. The findings indicated that item scores differed significantly between the high and low subgroups (P < 0.001). The CR exceeded 3 for each item, indicating that each item was sufficiently discriminating without a floor or ceiling effect. None of the items were deleted at this stage.
Construct validity
The total data (n = 443) were randomly split into two parts. The first 213 samples were utilized for EFA, incorporating oblique rotation to consider the relationship between factors. The CFA was carried out on 230 samples based on the model selected from the EFA.
Exploratory factor analysis
All 35 items were analyzed using principal component analysis with oblique rotation. The correlation matrix indicated a sufficient sample size (Kaiser–Meyer–Olkin measure of 0.961), and the Bartlett test results (χ2 = 6512.288, P < 0.001) refuted the hypothesis of zero correlations. According to Kaiser’s criterion to extract factors with eigenvalues greater than 1, a 3-factor structure (Factor 1 = 17.050, Factor 2 = 4.077, Factor 3 = 2.684) was identified by the pattern matrix, explaining 68.031% of the variance in the data. Items 13 (I can proactively seek information about children’s health from a range of sources) and 24 (I can take the child to the doctor if he/she has symptoms such as fever and rash) were subsequently deleted because their factor loadings were below the threshold of 0.40.
After these revisions, the remaining 33 scale items were subjected to EFA. As shown in Table 2, the scale items have factor loadings ranging from 0.708 to 0.907, and each item had a communality value of above 0.575, which was higher than the acceptable value [58]. The principal component analysis with 33 items revealed 3 factors with eigenvalues greater than 1.0 and a total variance of 70.013%. Combined with the scree plot results (see Fig. 2), the Kaiser criterion (eigenvalue) and the significance of the factors, we obtained a 3-factor structure (Factor 1 = 16.371, Factor 2 = 4.076, Factor 3 = 2.657). Factor 1 included 12 items (items 14–23, and 25–26), all taken from the Interactive Health Literacy dimension; Factor 2 included 12 items (items 1–12), all taken from the Function Health Literacy dimension; Factor 3 included 9 items (items 27–35), all taken from the Critical Health Literacy dimension.
Confirmatory factor analysis
CFA was carried out on a total of 230 samples. According to the results of the EFA, a 3-factor structure was constructed (see Table 3 and Fig. 3). All fit indices within the model met the suggested parameters for satisfactory model fit: the RMSEA was 0.036, less than 0.08; χ2/df was 1.302, less than 3; the PCFI was 0.904, above 0.50; the CFI was 0.970 and the IFI was 0.971, exceeding the benchmark of 0.90. Ultimately, the 3-factor structure fitted the survey data well and was considered to be appropriate for the population studied.
Convergent and discriminant validity analysis
As shown in Table 4, the standardized regression weight of the standardized factor loading values ranged from 0.691 to 0.897. The composite reliability (CR) values ranged from 0.928 to 0.944 and the average variance extracted (AVE) values ranged from 0.552 to 0.590, meeting the standard value (CR > 0.7, AVE > 0.5) [59].
The square root of the AVE values for dimensions of FHL, IHL and CHL were 0.765, 0.743 and 0.768, respectively, which were greater than all correlations between the factors of the HLSFC (see Table 5). This result confirms the discriminant validity of the scale.
Known-group validity analysis
The study found that caregivers with higher education and income, living in urban areas, and reporting their children in very good health scored higher on the HLSFC (see Table 6).
Reliability
The overall 33-item HLSFC had high internal consistency (Cronbach’s α = 0.963), high split-half reliability (Spearman-Brown coefficient = 0.877) and high test–retest reliability (ICC = 0.909). Regarding the three dimensions, the Cronbach’s α coefficient was 0.951 (FHL), 0.954 (IHL) and 0.925 (CHL), respectively; the Spearman-Brown coefficient was 0.929, 0.952 and 0.954; and the test–retest reliability coefficient was 0.743, 0.747 and 0.752.
Discussion
In the present study, we developed and validated a novel health literacy assessment tool for family caregivers of preschool children. The research team developed and psychometrically validated the scale following established guidelines [37], which ensured the scientific rigor of the study. The validation study was carried out among 443 family caregivers recruited from both urban and rural areas. Psychometric analyses indicate that the HLSFC has good reliability and validity. The final 33-item HLSFC covers a variety of content areas (such as nutrition/growth, physical activity, health behavior development, immunization, injury/safety, health monitoring, and preventive care) and can be applied to measure a wide range of health literacy, from Functional Health Literacy to Interactive and Critical Health Literacy.
Compared to existing parental health literacy scales, such as the Chinese Parental Health Literacy Questionnaire (CPHLQ) [33], Parenting Plus Skills Index (PPSI) [25], and Parental Health Literacy Activities Test (PHLAT) [32], the HLSFC differed in several key aspects. The CPHLQ focused on caregivers of children aged 0–3 and primarily assessed health literacy in the areas of healthcare, disease prevention, and health promotion, it did not specifically address interactive or critical health literacy, which were included in the HLSFC. The PPSI and PHLAT, targeting Australian and infant caregivers, respectively, primarily assessed functional health literacy, emphasizing practical skills like interpreting health instructions. These scales tended to be more concise but less comprehensive. In contrast, the HLSFC appeared to offer a broader and more detailed evaluation, incorporating not only functional literacy but also interactive and critical literacy. This makes the HLSFC potentially well-suited for addressing the diverse challenges faced by family caregivers of preschool children, who must navigate a wide range of health issues.
The first three phases of this study aimed to develop and revise scale items. The application of Nutbeam’s [38] conceptual model of health literacy provided improved clarity regarding the connotation of health literacy and the three dimensions to be measured. An item pool consisting of 44 items was generated following the literature review and interview. Based on the recommendations of 15 experts, 4 items were deleted due to a coefficient of variation greater than 0.25 [48]. 6 items were deleted as they were too complicated for family caregivers, or less related to the child’s health and the dimensional connotation. 1 item was proposed for deletion as it had a similar meaning to another item. 2 items related to medical insurance, together with family interactions were added. The parenting plus skills index (PPSI), designed to assess the health literacy skills of Australian parents was also based on Nutbeam’s conceptual model of health literacy. Similarly, items that were more related to the parental health, as well as writing and calculation skills in the PPSI were deleted during the expert review stage [25]. After these modifications, the initial HLSFC contained 35 items.
Phase 4 assessed the construct validity and reliability of the initial 35-item HLSFC. The results of EFA indicated that items 13 and 24 should be removed as their factor loadings were less than 0.40 [59]. The EFA performed on the remaining 33 items yielded a KMO value of > 0.8 and a cumulative variance contribution rate of 70.013%. The three common factors extracted from the EFA fitted well with the previously adapted and defined dimensions for family caregivers of preschool children in phase 1 of the study. Functional Health Literacy is reflected in items 1–12, focusing on the caregivers’ knowledge about health risks and health services for preschool children. Interactive Health Literacy is reflected in items 14–23 and 25–26, measuring the family interactions to shape children’s healthy behavior and caregivers’ social skills. Critical Health Literacy is reflected in items 27–35. The definition of CHL is reflected in items 27–28, as caregivers’ critical analysis of the reliability and appropriateness of child-health-related information. Items 29–35 reflect the applicability of health information to exert great control over health-related situations. CFA results further indicated the three-factor structure accounted for an optimal model fit. Several other health literacy scales have also been developed based on Nutbeam’s conceptual model of health literacy, including the Chronic Pain Health Literacy Assessment (HLCP) [46], Cancer Health Literacy Scale (C-HLS) [60], and the Iranian Nutbeam Health Literacy Scale [44]. The Iranian Nutbeam Health Literacy Scale for the general population also supported a three-factor structure, demonstrating the broad applicability of Nutbeam’s model. However, EFA results on the HLCP and C-HLS revealed a four-factor structure. The additional factors identified in these scales were related to self-care practices and more specific aspects of critical health literacy. These factors were particularly relevant for populations managing chronic conditions or cancer, suggesting that disease-specific populations may require more detailed factors to capture the complex health literacy skills needed in their contexts.
The study found that caregivers with higher education and income, living in urban areas, and reporting their children in very good health scored higher on the HLSFC. This is consistent with previous studies that have reported demographic factors such as education level, residence and income are antecedents of health literacy [40, 61]. The HLSFC scores of caregivers living in urban districts were significantly higher than those living in rural districts, which may be related to the relatively concentrated distribution of urban health resources and the abundance of health education activities. Similarly, caregivers with lower levels of education and family income may have limited access to health knowledge and their children may have more unmet health care needs [62].
This 4-phase study resulted in a validated 33-item health literacy assessment tool. The HLSFC is designed based on the Nutbeam’s Conceptual Model of Health Literacy and measures a range of cognitive, communicative, and social skills that may be necessary for family caregivers in their day-to-day care of children. This tool has multifaceted implications. Firstly, it may facilitate more accurate identification of caregivers with limited health literacy, potentially guiding the development of targeted, timely interventions to reduce negative impacts on children’s health and well-being. Secondly, when used as a pre- and post-intervention assessment, the tool might offer evidence on the effectiveness of various strategies, supporting the design of more impactful programs. Thirdly, the data generated from the HLSFC could provide insights for healthcare policy decisions and resource allocation related to child health. A shared understanding of caregivers’ health literacy levels could possibly foster the creation of more cohesive and comprehensive support systems for families, ultimately contributing to improved health outcomes for both caregivers and children.
Despite the satisfactory results of the HLSFC, the study has several limitations. First, family caregivers in this study were recruited in Northwest China, which may lead to selection bias and have influenced the generalization and application of the scale to some extent. However, the sample in this study included a wide range of locations, educational backgrounds and occupations, suggesting that the HLSFC is generally understood and accepted by family caregivers of preschool children. Secondly, criterion validity remains undetermined due to the lack of a definitive gold standard. Future research should focus on further developing, validating, and applying the HLSFC to enhance its utility and impact. Firstly, researchers will conduct expanded validation across diverse populations through large-scale, multi-center studies. Secondly, the development of normative data will be prioritized to facilitate the interpretation of HLSFC scores. Statistical methods will be used to establish age- and demographic-adjusted norms, enabling the classification of caregivers into distinct health literacy levels. Finally, large-scale surveys will be undertaken to assess the prevalence of health literacy among family caregivers, identifying high-risk groups in need of targeted interventions. The effectiveness of these interventions in improving both parental health literacy and child health outcomes will be evaluated, alongside an examination of the predictive validity and clinical relevance of the HLSFC.
Conclusion
The HLSFC appears to be a sensitive measure of health literacy in family child care settings. The HLSFC assesses multiple dimensions of health literacy among family caregivers, reflecting the specific characteristics of preschool children. It has the potential to be used in various settings (e.g., research, clinical practice, and public health) to assess caregiver health literacy, evaluate the effectiveness of interventions, and inform policy decisions related to child health and well-being.
Data availability
No datasets were generated or analysed during the current study.
References
Palumbo R, Nicola C, Adinolfi P. Addressing health literacy in the digital domain: insights from a literature review. Kybernetes. 2022;51(13):82–97.
Vozikis A, Drivas K, Milioris K. Health literacy among university students in Greece: determinants and association with self-perceived health, health behaviours and health risks. Arch Public Health. 2014;72(1):15. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/2049-3258-72-15.
Batterham RW, Hawkins M, Collins PA, Buchbinder R, Osborne RH. Health literacy: applying current concepts to improve health services and reduce health inequalities. Public Health. 2016;132:3–12. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.puhe.2016.01.001.
Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155(2):97.
US Department of Health and Human Services OoDPaHP. National action plan to improve health literacy. Washington, DC: DHHS; 2010.
Schaeffer D, Gille S, Vogt D, Hurrelmann K. National action plan health literacy in Germany origin, development and structure. J Public Health Heidelberg. 2023;31(6):905–15. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s10389-021-01616-9.
Action NPCotHC. Healthy China Program (2019–2030). 2019.
Georgieff MK. Health and education in early childhood: predictors, interventions, and policies. 2016.
China NHCo. National action plan for the health of children (2021–2025). 2021.
Frosch CA, Schoppe-Sullivan SJ, O’Banion DD. Parenting and child development: a relational health perspective. Am J Lifestyle Med. 2021;15(1):45–59.
Black MM, Walker SP, Fernald LC, Andersen CT, DiGirolamo AM, Lu C, et al. Early childhood development coming of age: science through the life course. Lancet. 2017;389(10064):77–90.
Sharma SL, Reddy NS, Ramanujam K, Jennifer MS, Gunasekaran A, Rose A, et al. Unintentional injuries among children aged 1–5 years: understanding the burden, risk factors and severity in urban slums of southern India. Inj Epidemiol. 2018;5:1–10.
Prüss-Ustün A, Wolf J, Corvalán C, Neville T, Bos R, Neira M. Diseases due to unhealthy environments: an updated estimate of the global burden of disease attributable to environmental determinants of health. J Public Health. 2017;39(3):464–75.
Kipping R, Langford R, Brockman R, Wells S, Metcalfe C, Papadaki A, et al. Child-care self-assessment to improve physical activity, oral health and nutrition for 2-to 4-year-olds: a feasibility cluster RCT. Public Health Research. 2019;7(13):1–164.
Ayob Z, Christopher C, Naidoo D. Exploring caregivers’ perceptions on their role in promoting early childhood development. Early Child Dev Care. 2022;192(9):1462–76.
Fitzpatrick AM, Diani B, Kavalieratos D, Corace EA, Mason C, Van Dresser M, et al. Poorer caregiver mental and social health is associated with worse respiratory outcomes in preschool children with recurrent wheezing. The Journal of Allergy and Clinical Immunology In Practice. 2023;11(6):1814–22.
Morrison AK, Glick A, Yin HS. Health literacy: implications for child health. Pediatr Rev. 2019;40(6):263–77.
Keim-Malpass J, Letzkus LC, Kennedy C. Parent/caregiver health literacy among children with special health care needs: a systematic review of the literature. BMC Pediatrics. 2015;15:92.
Firmino RT, Ferreira FM, et al. Is parental oral health literacy a predictor of children’s oral health outcomes? Systematic review of the literature. Int J Paediatr Dent. 2018;28(5):459–71. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/ipd.12378.
Hertwig R, Mata J, Peters E, et al. Lower parental numeracy is associated with children being under- and overweight. Social science and medicine. 2016;161:126–33.
Li Y, Xiao Q, Chen M, Jiang C, Kang S, Zhang Y, et al. Improving parental health literacy in primary caregivers of 0-to 3-year-old children through a WeChat official account: cluster randomized controlled trial. JMIR Public Health Surveill. 2024;10: e54623.
Carroll LN, Smith SA, Thomson NR. Parents as teachers health literacy demonstration project: integrating an empowerment model of health literacy promotion into home-based parent education. Health Promot Pract. 2015;16(2):282.
Muscat DM, Ayre J, Nutbeam D, Harris A, Mccaffery KJ. Embedding a health literacy intervention within established parenting groups: an Australian feasibility study. HLRP Health Literacy Research and Practice. 2020;4(1):e67–78.
Mörelius E, Robinson S, Arabiat D, Whitehead L. Digital Interventions to improve health literacy among parents of children aged 0 to 12 years with a health condition: systematic review. J Med Internet Res. 2021;23(12). https://doiorg.publicaciones.saludcastillayleon.es/10.2196/31665.
Ayre J, Costa DSJ, Mccaffery KJ, Nutbeam D, Muscat DM. Validation of an Australian parenting health literacy skills instrument: the parenting plus skills index. Patient Education and Counseling. 2020;103(6):1245.
Gerald LB, Magruder T, Harrington, et al. The impact of parent’s health literacy on pediatric asthma outcomes. Pediatr Allergy Immunol Pulmonol. 2015;28(1):20–6.
Liechty JM, Saltzman JA, Musaad SM, Team SK. Health literacy and parent attitudes about weight control for children. Appetite. 2015;91:200–8. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.appet.2015.04.010.
Sanders LM, Thompson VT, Wilkinson JD. Caregiver health literacy and the use of child health services. Pediatrics. 2007;119(1): e86.
Haun JN, Valerio MA, McCormack LA, Sorensen K, Paasche-Orlow MK. Health literacy measurement: an inventory and descriptive summary of 51 instruments. J Health Commun. 2014;19:302–33. https://doiorg.publicaciones.saludcastillayleon.es/10.1080/10810730.2014.936571.
Nguyen TH, Paasche-Orlow MK, Mccormack LA. The state of the science of health literacy measurement. Stud Health Technol Inform. 2017;240:17–33.
Altin SV, Finke I, Kautz-Freimuth S, Stock S. The evolution of health literacy assessment tools: a systematic review. BMC Public Health. 2014;14. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/1471-2458-14-1207.
Kumar D, Sanders L, Perrin EM, Lokker N, Patterson B, Gunn V, et al. Parental understanding of infant health information: health literacy, numeracy, and the Parental Health Literacy Activities Test (PHLAT). Acad Pediatr. 2010;10(5):309–16. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.acap.2010.06.007.
Zhang Y, Li M, Jiang H, Shi HJ, Xu B, Atkins S, et al. Development and validation of a Chinese parental health literacy questionnaire for caregivers of children 0 to 3 years old. BMC Pediatrics. 2019;19(1). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12887-019-1670-9.
Welkom JS, Riekert KA, Rand CS, Eakin MN. Associations between caregiver health literacy and preschool children’s secondhand smoke exposure. J Pediatr Psychol. 2016;41(4):462–72.
Nutbeam D, McGill B, Premkumar P. Improving health literacy in community populations: a review of progress. Health Promot Int. 2018;33(5):901–11.
Zaidman EA, Scott KM, Hahn D, Bennett P, Caldwell PH. Impact of parental health literacy on the health outcomes of children with chronic disease globally: a systematic review. J Paediatr Child Health. 2023;59(1):12–31.
Devellis RF. Scale development: theory and applications, vol. 26. 3rd ed. 2012.
Nutbeam D. The evolving concept of health literacy. Soc Sci Med. 2008;67(12):2072–8. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.socscimed.2008.09.050.
Srensen K, Broucke SVD, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12(1):1–13.
Squiers L, Peinado S, Berkman N, Boudewyns V, McCormack L. The health literacy skills framework. J Health Commun. 2012;17:30–54. https://doiorg.publicaciones.saludcastillayleon.es/10.1080/10810730.2012.713442.
Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int. 2000;15(3):259–67. https://doiorg.publicaciones.saludcastillayleon.es/10.1093/heapro/15.3.259.
Nutbeam D. Defining and measuring health literacy: what can we learn from literacy studies? Int J Public Health. 2009;54(5):303–5.
Suka M, Odajima T, Kasa M. The 14-item health literacy scale for Japanese adults (HLS-14). Environmental Health, Preventive Medicine. 2013;18(5):407–15.
Miri MR, Moghadam HM, Eftekhari H, Yousef A, Norozi E. Developing and validating the functional, communicative, and critical health literacy questionnaire among the Iranian general population. Oman Medical Journal. 2020;35(2):e106-e.
Chi MJ, Peng LN, Chen LK, et al. Development and validation of the health literacy assessment tool for older people in Taiwan: potential impacts of cultural differences. Arch Gerontol Geriatr. 2015;61(2):289–95. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.archger.2015.06.015.
Chen S, Zhang X, Cao M, Zhao B, Fang J. Development and validation of the health literacy assessment instrument for patients with chronic pain. Evidence-based complementary and alternative medicine : eCAM. 2021;2021:9342746.
Maccallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychol Methods. 1999;4(1):84–99.
Morgan AJ, Fischer JA, Hart LM, Kelly CM, Kitchener BA, Reavley NJ, et al. Does mental health first aid training improve the mental health of aid recipients? The training for parents of teenagers randomised controlled trial. BMC Psychiatry. 2019;19(1):99. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12888-019-2085-8.
Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.
Osburn HG. Coefficient alpha and related internal consistency reliability coefficients. Psychol Methods. 2000;5(3):343–55.
Giavarina D. Understanding bland altman analysis. Biochem Med (Zagreb). 2015;25(2):141–51. https://doiorg.publicaciones.saludcastillayleon.es/10.11613/bm.2015.015.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jcm.2016.02.012.
Pryse Y, Mcdaniel A. Psychometric analysis of two new scales: the evidence-based practice nursing leadership and work environment scales. Worldviews on Evidence-Based Nursing. 2015;11(4):240–7.
Yin HS, Dreyer BP, Vivar KL, MacFarland S, van Schaick L, Mendelsohn AL. Perceived barriers to care and attitudes towards shared decision-making among low socioeconomic status parents: role of health literacy. Acad Pediatr. 2012;12(2):117–24. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.acap.2012.01.001.
Batista-Foguet JM, Coenders G, Alonso J. [Confirmatory factor analysis. Its role on the validation of health related questionnaires]. Medicina Clínica. 2004;122 Suppl 1:21–7.
Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981;18(1):39–50. https://doiorg.publicaciones.saludcastillayleon.es/10.2307/3151312.
Xu W, Hou Y, Hung Y, Zou Y. A comparative analysis of Spearman’s rho and Kendall’s tau in normal and contaminated normal models. Signal Process. 2013;93(1):261–76.
Wardat Y. Discovering statistics using SPSS. 2019.
Minglong W. The Practice of questionnaire statistical analysis: operation and application of SPSS. Chongqing: Chongqing University Press; 2011.
Chou H-L, Lo Y-L, Liu C-Y, Lin S-C, Chen Y-C. Development and psychometric evaluation of the cancer health literacy scale in newly diagnosed cancer patients. Cancer Nurs. 2020;43(5):E291–303.
DeWalt DA, Hink A. Health literacy and child health outcomes: a systematic review of the literature. Pediatrics. 2009;124(Suppl 3):S265–74. https://doiorg.publicaciones.saludcastillayleon.es/10.1542/peds.2009-1162B.
Thomas S, Ryan NP, Byrne LK, Hendrieckx C, White V. Unmet supportive care needs of families of children with chronic illness: a systematic review. J Clin Nurs. 2023;32(19–20):7101–24.
Acknowledgements
We thank all participants who voluntarily contributed to this study.
Funding
This work was supported by Xi’an Jiaotong University Fund.
Author information
Authors and Affiliations
Contributions
Yin-Ping Zhang: Conceptualization, Supervision. Yitong Jia: Formal analysis, Writing-original draft, Writing-review & editing. Xinqi Zhuang: Investigation, Methodology. Yanzi Zhao: Formal analysis, Writing-original draft. Ge Meng: Writing-review & editing. Jianzhong Zhang: Methodology, Resources. Yueying Cao: Writing-review & editing. All authors approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Ethics Committees of Xi’an Jiaotong University (approval number: 2021–1511). Informed consent was obtained from all individual participants included in the study.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Jia, Y., Zhuang, X., Zhao, Y. et al. Development and psychometric validation of a novel health literacy scale for family caregivers of preschool children. Health Qual Life Outcomes 23, 18 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12955-025-02349-z
Received:
Accepted:
Published:
DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12955-025-02349-z