This paper is in the following e-collection/theme issue:

General Parenting Education and Training (61) Research Instruments, Questionnaires, and Tools (576) Development of Instruments and Surveys (86)

Published on in Vol 2, No 1 (2019): Jan-Jun

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/11561, first published .
Advancing Optimal Development in Children: Examining the Construct Validity of a Parent Reflective Functioning Questionnaire

Advancing Optimal Development in Children: Examining the Construct Validity of a Parent Reflective Functioning Questionnaire

Advancing Optimal Development in Children: Examining the Construct Validity of a Parent Reflective Functioning Questionnaire

Authors of this article:

Monica De Roo1 Author Orcid Image ;   Gina Wong1 Author Orcid Image ;   Gwen R Rempel2 Author Orcid Image ;   Shawn N Fraser2 Author Orcid Image
Article Authors Cited by (29) Tweetations Metrics

    Original Paper

    1Graduate Centre for Applied Psychology, Faculty of Health Disciplines, Athabasca University, Athabasca, AB, Canada

    2Centre for Nursing and Health Studies, Faculty of Health Disciplines, Athabasca University, Athabasca, AB, Canada

    Corresponding Author:

    Shawn N Fraser, PhD

    Centre for Nursing and Health Studies

    Faculty of Health Disciplines

    Athabasca University

    1 University Drive

    Athabasca, AB, T9S 3A3

    Canada

    Phone: 1 7804300590

    Email: shawnf@athabascau.ca


    Background: Parental reflective functioning (PRF) is the capacity parents have to understand their own mental states and those of their children, as well as the influence of those mental states on behavior. Parents with greater capacity for PRF are more likely to foster secure attachment with their children. The Parental Development Interview is a gold standard measure of PRF but is hampered by cost, training, and length of administration. The 18-item Parent Reflective Functioning Questionnaire (PRFQ-18) is a simpler option developed to capture 3 types of PRF: (1) prementalizing, (2) parent’s certainty, and (3) interest and curiosity surrounding a child’s mental state.

    Objective: The aim of this study was to examine the factor structure and select psychometric properties of the PRFQ in a sample of Canadian parents.

    Methods: We examined the factor structure and discriminant and construct validity of the PRFQ-18 among 306 parents (males=120 and females=186) across Canada; the age range of children was 0 to 12 years. Parents also completed Web-based measures of perceived stress, parental coping, parenting competence, and social support.

    Results: A confirmatory factor analysis confirmed the hypothesized 3-factor structure of the PRFQ-18 providing evidence that the PRFQ-18 may be a useful and practical measure of PRF in Canadian adults and showed minor revisions may improve the suitability of the PRFQ-18 for assessing PRF.

    Conclusions: These results add support for the construct validity of the PRFQ-18.

    JMIR Pediatr Parent 2019;2(1):e11561

    doi:10.2196/11561

    Keywords

    mentalization; parent reflective functioning; questionnaire design; parenting 


    Background

    Decades of research unequivocally demonstrate that reflective processes enhance parental insight and sensitivity toward children’s emotions [1-5]. Reflective functioning (RF), first introduced by Fonagy et al in 1991, describes an individual’s cognitive capacity to recognize and interpret one’s own mental state as well as the mental state of others to identify and comprehend the meaning behind behavior [2,6]. In the literature, RF is akin to mentalizing, which is a fundamental and intrinsic human capacity to regulate affect and attune to interpersonal relationships [7]. Similarly, maternal mind-mindedness is described as a mother’s ability to recognize her child as a separate agent with independent thoughts, experiences, and emotions [8], and parental insightfulness is defined as a parent’s representation of their child’s intentions and mental states [3].

    Rather than a natural ability, RF is believed to develop through the internal organization of an individual’s understanding of one’s own and other’s feelings and behaviors through experiences, social and emotional information, meaning making [2,6], and interactions with primary caregivers [2,6,9]. In addition, social interactions, family structure, family size, parenting quality [9], and environmental responses [10] influence the development of RF. The development of the RF neurological function is noteworthy as it provides individuals with the ability to predict behavior, distinguish between manifestation and reality, and enhance interpersonal communications, self-organization [6], and impulse control and affect regulation [9]. Understanding the development of RF is crucial, given the relationship between how a parent chooses to respond to their child’s needs, which affects the child’s attachment status [2,4,11] as well as the child’s development and capacity to mentalize [1], and circumscribes the health of the parent-child relationship overall [5,12].

    Parental reflective functioning (PRF) pertains to a parent’s proclivity to understand and comprehend mental states influencing their child’s behavior [13], playing a crucial role in how parents respond to their child’s needs and feelings [4,14] and behaviors [6]. PRF is a core cognitive capacity that connects parents to their child’s emotions and also to their own early attachment experiences in an integrated way to see their parents’ experience as distinct from their own and to provide a secure base for their own children [1,6,7].

    PRF is described as an attachment-related concept [15], wherein parental ability to interpret a child’s mental state and the parents’ responsiveness, or lack thereof, act as a conduit that establishes the attachment status of children. In other words, a child’s attachment status is emblematic of the parent’s capacity for PRF. The interrelationships between attachment and (1) child psychopathology; (2) inflammation and health; (3) neurobiology; (4) empathy, compassion, and altruism; and (5) school readiness have been substantiated [16]. In addition, the quality of attachment to a parent has been shown to be predictive of numerous developmental outcomes in children such as general well-being, self-esteem, social competence with peers, problem-solving abilities, academic success, behavioral outcomes, and resilience [17-21].

    Parents with high RF who possess clear mentalizing abilities have a positive influence on the biological, interpersonal, cognitive, and emotional experiences of the child [1]. They understand their own mental states and those of their children, as well as the influence of those mental states on behavior [1]. In addition, those with high RF are better able to perceive themselves as parents and their relationships with their child, therefore seeking out social support [22] and enhancing parental coping abilities [23].

    Initial purposes of PRF measures were to directly measure maternal representations of their child [24] and the PRF functions that influence the intergenerational transmission of attachment [1,4]. The application of PRF measures has expanded to different contexts such as drug use disorders [25], mothers with childhood maltreatment [26,27], infant distress [28], and parenting programs [12,29-33].

    The gold standard narrative-based RF measure assessing parental representations of their relationship with their child is the Parent Development Interview (PDI) [24]. The interview takes approximately 2 hours to administer and is audio recorded for transcribing. The original 45-item PDI scoring process involved a trained coder who utilized narrative data to evaluate RF across 4 factors: (1) awareness of the nature of mental states, (2) the ability to tease out underlying behavior of mental states, (3) identifying developmental aspects of mental states, and (4) the mental states in relation to the interviewer [24]. The PDI has been revised to a 40-item and 29-item measure to assess parent RF relative to their own child, their parents, and self (personal communication, A. Slade, January 2016). Trained coders rate each item on a Likert scale from −1 to 9 to produce an RF score [24]. A limitation in terms of application and use of the PDI is that the training and coding requirements for the PDI are time consuming and expensive. Clinicians and researchers may experience these prohibitive factors, making the PDI unattractive and unrealistic.

    As an alternative to the narrative-based PDI, the Parent Reflective Functioning Questionnaire (PRFQ-18) is an 18-item self-report measure [13] which examines 3 domains of PRF: (1) prementalizing modes (PM), designed to capture a parent’s inability to hold the child’s mental state in mind; (b) interest and curiosity in mental states (IC), intended to capture the level of interest in parents thinking about their child’s mental states; and (c) certainty about mental states (CMS), measuring a parent’s acknowledgment that their thoughts about their child’s mental states are accurate [13]. The main advantage of the PFRQ-18 is that it is a brief screening tool of RF designed to meet the growing demand of measures to assess the effectiveness of interventions to improve parent-child attachment and PRF [13].

    The PRFQ-18 is an open source questionnaire available [34]. There is no training requirement; the questionnaire takes about 10 min to complete and the scoring syntax is downloadable. The questionnaire can be completed on paper or Web-based and is available in 10 languages. Parents rate each subscale item on a Likert scale from 1 (strongly disagree) to 7 (strongly agree). The preliminary studies 1 and 2 [13] have provided evidence supporting the validity and reliability of the PRFQ-18 for measuring PRF.

    In Study 1, PRF was examined in mothers with children aged 0 to 36 months [13]. Construct validity of the PRFQ-18 was supported with a confirmatory factor analysis (CFA) of a 3-factor model with a good fit (χ2123=217.73; P<.001; χ2/df=1.77; root mean square error of approximation [RMSEA]=.05; CI 0.04 to 0.06; comparative fit index [CFI]=.91; non-normed fit index [NNFI]=.91). Internal consistencies were good for PM (.70), IC (.82), and CMS (.75), and discriminant validity was identified in negative correlations between the PRFQ-18 factors and demographic features. As expected, PM was positively correlated to attachment avoidance, attachment anxiety, and symptomatic distress, whereas IC and CMS were not.

    In Study 2, opposing results in the correlations between IC and CMS were found [13], revealing factorial variance across mothers and fathers. In contrast to Study 1, correlations between PRFQ-18 factors and demographic features were nonexistent or moderately related to the subscales; no relationships were found between fathers PM, attachment, and symptomatic distress, indicating differences in factor loading among mothers and fathers. On the contrary, Study 2 identified similar correlations between parenting stress and mothers and fathers. Parenting stress had negative correlations with IC and CMS but positive correlations with PM on all subscales including parental competence. Furthermore, in Study 3, the PRFQ-18 was utilized with the Strange Situation Procedure (SSP) [35]. Preliminary studies found correlations between PM and IC and the SSP [13], supporting the notion that a parent’s ability to hold their child’s mental state is related to attachment security. Given that RF has previously been found to significantly correlate with infant attachment [2], Study 3 strongly supports the validity of the PRFQ-18 as an indicator of PRF.

    These studies from the originators of the PRFQ-18 provide some initial information on the psychometric properties of the PRFQ-18, but further research is warranted to offer an independent examination of the construct validity of the PRFQ-18. The purpose of this study was to examine the construct validity of the PRFQ-18 in a diverse sample of Canadian parents.

    Hypotheses

    On the basis of results of existing studies of the PRFQ-18 and existing conceptualizations for PRF, we tested 6 hypotheses:

    1. A CFA will support a 3-factor structure in the PRFQ-18, illustrating 3 distinct characteristics of RF (PM, IC, and CMS).
    2. Small-to-moderate correlations will exist between the 3 PRFQ-18 subscales.
    3. PM will negatively correlate with parental competence; IC and CMS will positively correlate with parental competence.
    4. PM will positively correlate with parenting stress; IC and CMS will negatively correlate with parenting stress.
    5. PM will negatively correlate with social support; IC and CMS will positively correlate with social support.
    6. PM will negatively correlate with parental coping; IC and CMS will positively correlate with parental coping.
    7. The PFRQ-18 will demonstrate measurement invariance between men and women.

    Ethical Approval

    Ethical approval for this study was obtained through our university’s Research Ethics Board. Subjects were then randomly contacted through SurveyMonkey’s Survey Audience to participate in a study of Experiences in Parenting. The survey panel members were randomly selected, contacted, and screened by SurveyMonkey, and the authors had no role in the recruitment and selection process other than defining the inclusion criteria for SurveyMonkey. Eligible participants were parents of at least 1 child living in the home aged 12 years or under. After screening for eligibility, parents completed the Web-based PRFQ-18, 4 additional measures, and the demographic data form, 52 questions excluding demographic data questions. Only 1 parent from each household provided study data.

    Measures

    Parent Reflective Functioning Questionnaire

    The PRFQ-18 [13] is an 18-item self-report measure for parents with children aged 0 to 5. It measures PRF across 3 domains: (1) PM (items 1, 4, 7, 10, 13, and 16), (2) IC (items 3, 6, 9, 12, 15, and 18), and (3) CMS (items 2, 5, 8, 11, 14, and 17). Parents are required to rate each subscale item on a Likert scale from 1 (strongly disagree) to 7 (strongly agree). The questionnaire is available from the authors.

    Parenting Sense of Competence Scale

    The Parenting Sense of Competence Scale (PSOC) is a 17-item self-report measure for assessing parents’ sense of confidence and satisfaction with their parenting [36]. Owing to poor factor loading for item 17 (.40), the PSOC was revised to a 16-item measure to assess parent sense of competence across 2 factors: (1) satisfaction and (2) efficacy and had good internal consistency for the total score (.79), satisfaction (.75), and efficacy (.76) [36]. Internal consistencies were reported .80 for both efficacy and satisfaction in mothers and .77 for efficacy and .80 for satisfaction in fathers [37]. Parents are required to rate each subscale item on a Likert scale from 1 (strongly disagree) to 6 (strongly agree). Higher scores indicate greater parenting self-confidence. For our sample, satisfaction internal consistency estimates were alpha=.89 and omega=.92 and efficacy estimates were alpha=.86 and omega=.90.

    Perceived Stress Scale

    The Perceived Stress Scale (PSS) [38] is originally a self-reported 14-item measure to examine the degree to which individuals view situations as stressful. The original PSS had good reliability in 3 preliminary samples (.84, .85, and .86) and in 2 test-retest samples (.85 and .55). The PSS was later revised to a simple 4-item (items 2, 6, 7, and 14) scale with an alpha reliability coefficient of .60, identifying it to be an adequate brief measure of perceptions of stress [39]. The PSS requires individuals to rate 4 items on a Likert scale from 0 (never) to 4 (very often). For our sample, internal consistency estimates were .68 for alpha and .85 for omega.

    Medical Outcome Study Social Support Survey

    The Medical Outcome Study Social Support Survey (MOS-SSS) [40] 12-item measure has 4 social support domains (tangible support, emotional information support, affectionate support, and positive interaction) [40]. The MOS-SSS has exhibited excellent reliability (.94) and good internal consistency for tangible support (.87), emotional information support (.91), affectionate support (.88), and positive interaction (.92) [40]. The MOS-SSS requires individuals to rate each subscale item on a Likert scale from 1 (none of the time) to 5 (all of the time). For our sample, internal consistency for the subscales ranged from alpha=.91 to .93 and from omega=.94 to .98.

    Parent Coping Scale

    The Parent Coping Scale (PCS) [41] is a single item scale to assess parent’s perception of their own ability to cope with parenting. A preliminary study of the PCS found strong intraclass correlation coefficients (.93) and concurrent criterion validity (.54) with the Parenting Self-Agency Measure [42]. The PCS requires parents to respond to a single question (“How are you coping with being a parent these days?”) on a response scale ranging from 1 (I feel I am not coping at all these days) to 5 (I always feel I am coping really well—things never or hardly ever get on top of me).

    Data Analysis

    Data were exported into IBM SPSS 23 for analysis. The data analysis was conducted in 3 stages. First, data were screened for outliers and missing data. Outliers were defined as unusually influential data or data with unusual or extreme values. For example, responses outside of possible ranges were considered unusual. Given the nature of the constrained response options (eg, Web-based Likert scales), we did not notice any unusual values. We also examined partial regression plots and did not notice any outliers. Screening for influential multivariate outliers was examined with Mahalanobis d-squared in IBM AMOS [43], and we noted no distinct values indicating influential outliers. Missing data were not imputed, given the small rates of missing data. Second, the hypothesized factor structure of the PRFQ-18 was tested using a CFA in IBM AMOS 23 graphics [43] and R 3.3.2 [44]. The CFA was conducted in the usual iterative fashion [45], that is, we tested the initial hypothesized factor structure as indicted in preliminary studies [13] followed by changes to the model based on model fit, nonsignificance of path coefficients, and/or substantive suggestions offered by modification indices. Model fit was determined by consulting multiple fit indices, consistent with suggested practice (eg, [46,47]). We consulted chi-square as a global fit index. Whereas this is not a particularly useful indicator of the fit of a given model owing to its sensitivity to sample size, for example (eg, as noted by Kelloway [48]), it can be useful in terms of model comparison [47]. Thus, a change in thechi-square value was used to test the improvement of a given model over a previous model. Other fit indices included the CFI, normed fit index (NFI), NNFI, and RMSEA. Akaike’s information criterion (AIC) was used as another indicator of comparative fit, where a lower AIC indicated a relatively better model fit. As noted, identifying precise cutoffs for model fit is probably unrealistic, given the behavior of fit statistics under varying conditions [20,49], as is shown by others [46]. Thus, we interpreted fit by consulting multiple indices and used a cutoff based upon adequate fit. Specifically, a fit of ≤ .08 was deemed adequate for the RMSEA and Standardized Root Mean Square Residual, and a fit of ≥ .90 was deemed adequate for the CFI, NFI, and NNFI [49]. Measurement invariance among men and women was tested using standard procedures [50], for example, using IBM AMOS 24 [43]. As we were only interested in testing whether or not the proposed CFA model held good for men and women, we tested configural, metric scale, and residual forms of invariance [49]. Finally, the relationships between the PRFQ-18 subscales and the subscales of the MOS-SSS, PSOC, PSS, and PCS data were investigated using bivariate correlations in IBM SPSS Statistics 23. RStudio (using R 3.3.2) was used to calculate ordinal alpha and omega forms of scale reliability [51] and to test for structural invariance.


    Sample Description

    A total of 344 Canadian adult parents (aged 20 to 60 years) with at least 1 child between the age of 0 and 12 years were randomly sampled through SurveyMonkey’s Survey Audience. After screening for eligibility, 317 participants completed the PRFQ-18 and 306 participants (120 male and 186 female) completed all study measures. Participant demographics of our diverse sample are reported in Table 1. Of the 306 participants who completed all study measures, most parents had 1 (n=106) or 2 (n=132) children in the home with 68 parents having more than 2 children in the home.

    Table 1. Demographics of the sample population.
    VariableMales (n=120), n (%)Females (n=186), n (%)Total (n=306), N (%)
    Age (years)

    		20-2915 (12.5)33 (17.7)48 (15.7)

    		30-3960 (50.0)91 (48.9)151 (49.3)

    		40-4936 (30.0)55 (29.6)91 (29.7)

    		50-609 (7.5)7 (3.8)16 (5.2)
    Age of child(ren) in household (years)

    		0-336 (30.0)83 (44.6)119 (38.9)

    		4-652 (43.3)64 (34.4)116 (37.9)

    		7-949 (40.8)64 (34.4)113 (36.9)

    		10-1237 (30.8)65 (34.9)102 (33.3)

    		13 and older23 (19.2)45 (24.2)68 (22.2)
    Children in household

    		Biological118 (38.6)184 (60.1)302 (98.7)

    		Step37 (12.1)52 (17.0)89 (29.1)

    		Foster32 (10.5)51 (16.7)83 (27.1)

    		Adopted32 (10.5)51 (16.7)83 (27.1)
    Education

    		Less than high school degree4 (3.3)6 (3.2)10 (3.2)

    		High school degree or equivalent20 (16.7)26 (14.0)46 (15.0)

    		Some college but no degree11 (9.2)29 (15.6)40 (13.1)

    		Technical degree or diploma26 (21.7)44 (23.7)70 (22.9)

    		Bachelor’s degree44 (36.7)59 (31.7)103 (33.7)

    		Graduate degree15 (12.5)22 (11.8)37 (12.1)
    Household income (Can $)

    		0-24,9996 (5.0)14 (7.5)20 (6.5)

    		25,000-74,99947 (39.1)75 (40.4)122 (39.9)

    		75,000-124,99944 (36.7)62 (33.3)106 (49.0)

    		125,000-199,99918 (15.1)20 (10.8)38 (20.3)

    		200,000 and above2 (1.7)1 (.5)3 (1.0)

    		Prefer not to answer3 (2.5)14 (7.5)17 (5.56)
    Relationship status

    		Married90 (75.0)131 (70.4)221 (72.2)

    		Widowed1 (0.8)1 (0.5)2 (1.0)

    		Divorced7 (5.8)6 (3.2)13 (4.2)

    		Separated3 (2.5)10 (5.4)13 (4.2)

    		Common law12 (10.0)21 (11.3)33 (10.8)

    		Single, never married6 (5.0)16 (8.6)22 (7.2)

    		Open relationship1 (0.8)1 (0.5)2 (1.0)
    Residence (province)

    		Western Canada32 (26.7)71 (38.2)103 (33.6)

    		Eastern Canada86 (71.1)115 (61.9)201 (65.7)
    Race/ethnicity

    		Asian and/or Pacific Islander17 (14.0)34 (18.2)50 (14.7)

    		African2 (1.7)0 (0.0)2 (0.6)

    		Black1 (0.8)1 (0.5)2 (0.6)

    		Canadian8 (6.7)14 (7.5)22 (5.8)

    		Caucasian80 (66.7)117 (62.9)198 (58.2)

    		European3 (2.5)1 (0.5)4 (1.2)

    		First Nations0 (0.0)4 (2.2)4 (1.2)

    		Latin1 (0.8)2 (1.1)3 (0.9)

    		Middle Eastern2 (1.6)2 (1.0)4 (1.2)

    		Mixed3 (2.5)3 (1.6)7 (2.0)

    		Prefer not to say3 (2.5)9 (4.8)12 (3.5)

    Parent Reflective Functioning Questionnaire-18 Factor Structure

    Factor structure analysis of the PRFQ-18 resulted in examining 4 different CFA models (see Table 2) utilizing 317 participants. The initial CFA model testing of the hypothesized 3-factor structure of the PRFQ-18 (PM, CMS, and IC) resulted in a reasonably poor model fit, as shown in Table 2. Results of the initial CFA indicated that Item 11 was not significantly (P=.10) contributing to the PRFQ-18 measure. To decipher whether or not the model fit could improve with the removal of Item 11, a second CFA was conducted. Results in Model 2 found improvements in the model fit in terms of the fit statistics reported in Table 2, and the chi-square difference test showed that the change in the chi-square value from Model 1 to 2 was significant (chi-square difference=138, P<.001). However, Model 2 showed a low standardized regression weight for Item 18 (.27). To attempt enhancing the model fit even further, Item 18 was removed in Model 3. After testing Model 3, results identified a more respectable model fit (see Table 2, chi-square difference test=.210 P<.001) and modification indices suggested a better model fit by adding a covariance between error terms 6 and 9. Adding a correlated error term between the errors for items 6 and 9 further improved the model fit as seen in Table 2 (Model 4, chi-square difference test=52; P<.001). Model 4 resulted in a negative correlation between PM and IC (−.26) and positive correlations between CMS and IC (.36) and between CMS and PM (.37), suggesting that the PRFQ-18 measures 3 relatively independent characteristics of PRF (see Figure 1). On the basis of this model, internal consistencies for the PM, IC, and CMS subscales were alpha=.91, .88, and .88, and omega=.91, .92, and .95, respectively.

    A test of measurement variance showed strong support for invariance between men and women. The test for configural invariance showed that the same factor model applied for both men and women (χ2200=435.60; P<.001; RMSEA=.062; 90% CI 0.054 to .070; CFI=.91; AIC=579.56). Measurement/metric invariance was also supported as seen in a change in chi-square, χ213=8.42, P=.82, and a small change in CFI of .001. Compared with the measurement invariance, structural invariance and then residual invariance showed a change in CFI of less than .001 each. These results show strong support for invariance between men and women suggesting the tool functions similarly among men and women.

    Table 2. Fit statistics for confirmatory factor analysis models.
    ModelChi-square (df)Chi-square/dfRoot mean square error of approximation (90% CI)Comparative fit indexNormed fit indexNon-normed fit index (Tucker Lewis Index)Akaike Information CriterionStandardized Root Mean Square Residual
    Model 1a703 (132)5.330.117 (0.109-0.126).81.78.78781.144
    Model 2565 (116)4.870.111 (0.102-0.120).84.81.82639.137
    Model 3355 (101)3.520.089 (0.079-0.099).91.87.89425.081
    Model 4303 (100)3.030.80 (0.070-0.091).92.89.91375.077

    aInitial model contains all 18 items: Model 2 has Item 11 removed, Model 3 has Items 11 and 18 removed, and Model 4 adds a correlated error term to Model 3.

    ‎
    Figure 1. The Parent Reflective Functioning Questionnaire (PRFQ) model without items 11 and 18.

    Intercorrelations Among Measures

    Following the CFA, we proceeded to examine the intercorrelations among study variables with the revised version of the PRFQ that does not include items 11 and 18. Complete data for these analyses were available for 306 participants.

    Relationships With Parenting Sense of Competence

    Similar to preliminary findings [13], the PSOC demonstrated a range of correlation results across the PRFQ-18 subscales (see Multimedia Appendix 1). Negative correlations were found between PM and satisfaction (rmales=−.65; rfemales=−.50) and efficacy for females (rfemales=−.14). This suggests that parents with an inability to hold their child’s mental state also have a lower sense of satisfaction with their parenting and a lower sense of efficacy for mothers. As expected, the IC subscale was positively correlated with efficacy (rmales=.44; rfemales=.28) but not with satisfaction. These results indicate that parents with relatively higher levels of interest and curiosity in their child’s mental state also have relatively higher levels of satisfaction as a parent and perceptions of parental competence. Finally, the CMS subscale had positive correlations with both satisfaction in men (rmales=.21) and efficacy for both men and women (rmales=.43; rfemales= .32). This shows that parents who are more certain of their child’s mental states report more efficacy for the parenting role. Furthermore, for fathers, more certainty around mental states was associated with more satisfaction around being a parent.

    Relationships With Stress

    Consistent with preliminary findings [13], both the IC (rmales=−.17; rfemales=− .09) and CMS (rmales=−.16; rfemales=−.13) subscales were negatively correlated with stress, but these were not significant. On the contrary, PM was positively correlated with stress (rmales=.30; rfemales=.27), that is, those reporting higher levels of stress had a relatively higher inability to hold their child’s mental state, as expected.

    Relationships With Social Support

    As expected, correlation results from the MOS-SSS subscales varied across the PRFQ-18 subscales. The PM subscale was negatively correlated to tangible support (rmales=−.27; rfemales=−.13), emotional information support (rmales=−.21; rfemales=−.24), affectionate support (rmales=−.24; rfemales=−.28), and positive interaction (rmales=−.23; rfemales=−.23) subscales. That is, those reporting less social support tended to report higher levels of prementalization. The IC subscale was positively correlated to tangible support (rmales=.27; rfemales=.17), emotional information support (rmales=.19; rfemales= .19), affectionate support (rmales=.28; rfemales= .22), and positive interaction (rmales=.22; rfemales=.19) subscales. Thus, those with relatively more social support reported higher levels of interest and curiosity in their child’s state of mind. Finally, the CMS subscale also had positive but nonsignificant correlations with social support subscales.

    Relationships With Parental Coping

    In line with our hypothesis, the PCS had positive correlations with IC (rmales=.37) and CMS (rmales=.33; rfemales=.14) and negative correlations among PM (rmales=−.21; rfemales=−.28; see Multimedia Appendix 1). In other words, those with a relatively high ability to cope with parenting also display better levels of mentalization than those with a relatively lower ability to cope.

    Relationships Between Mothers and Fathers

    Interestingly, key findings identified a variety of commonalities between mothers and fathers. Both mothers and fathers had negative correlations among PM (rmales=−.65; rfemales=−.50) and satisfaction. In addition, both mothers and fathers had positive correlations between both IC (rmales=.44; rfemales= .28) and CMS (rmales=.43; rfemales= .32) with efficacy. On the contrary, mothers had negative correlations (rfemales=−.27) and fathers had nonsignificant correlations between PM and efficacy. In correspondence to preliminary findings [13], we found positive correlations among PM (rmales=.30; rfemales=.27) and parental stress for both mothers and fathers [13], that is, a higher perceived stressful situation was associated with low mentalization in parents. In addition, both mothers and fathers had negative correlations between PM and social support subtypes. The exception was tangible support which was not related to prementalization in women. Overall, parents with more social support tended to have higher levels of RF. Finally, results showed negative correlations within PM and parental coping but only positive links with IC in fathers. Overall, these findings suggest that parents with high RF capabilities are better able to cope with parenting but that the type of RF related to coping might vary between mothers and fathers.


    Overview

    The PRFQ is a brief self-report instrument designed to assess parent RF capacities [13]. Support for the validity of the PRFQ-18 has been presented previously in mothers and fathers [13]. To date, we have been unable to find any independent studies examining the factor structure and testing the discriminant and construct validity of the PRFQ-18. This study intended to further test the factor structure by means of a CFA and to expand the discriminant and construct validity of the PRFQ-18 by exploring relationships between this measure and the MOS-SSS, PCOS, PCS, and the PSS in a Canadian sample (n=306) of parents of children aged 0 to 12 years.

    Results of this study extend and replicate earlier findings of the PRFQ-18 factor structure. Specifically, the CFA supported a 3-factor structure capturing key characteristics of RF: (1) prementalizing, (2) interest and curiosity, and (3) certainty of mental states. In addition, our results suggest items 11 and 18 may not be contributing to the measurement of PRFQ-18. Interestingly, items 11 and 18 are negatively worded and when removed, improved the PRFQ-18 model fit changes from poor to acceptable, as indicated in the fit measures. This may not be surprising as a mix of negative and positively worded items has the potential to cause problems as positively and negatively worded items may not be measuring the same underlying trait [52]. Taking this into consideration, it seems the removal of items 11 and 18 may be appropriate when using the PRFQ-18 in the future. Weak loadings for items 11 and 18 were also reported in preliminary studies [13]. However, given the early state of the PRFQ-18, 2 items in the PRFQ-18 were removed [13]. Our results suggest that it may be prudent to conduct further research examining the model fit of the 16-item measure reported here.

    Validity Evidence

    In terms of predictive and discriminant validity, the PRFQ-18 subscales were correlated with the MOS-SSS, PCOS, PCS, and PSS subscales in the expected directions, that is, the PRFQ-18 subscales were generally found to correlate with perceived social support, parental competence, and parent’s perceptions of coping abilities and stressful situations in the right direction. Furthermore, the intercorrelations among PRFQ-18 subscales were low-to-moderately correlated, supporting a relative distinction among these subtypes adding support to the notion of 3 separate PRF concepts.

    In terms of the PRFQ-18 construct validity support, prementalizing had negative correlations with coping, efficacy, and forms of social support. This result is similar to findings that individuals capable of perceiving themselves as parents and their relationships with their child will seek out social support [22]. In addition, PM was seen to have a positive relationship with satisfaction and perceived stress. These results are comparable to findings that identify parents with low RF as being unable to imagine the type of support they would need and if it would be available [23].

    Theoretical Explanations

    Interestingly, our results identified IC as positively correlated with parental coping, emotional information support, affectionate support, positive interaction, tangible support, and efficacy. These outcomes match findings that suggest parents with greater levels of parenting coping abilities and an awareness of stress display higher levels of RF, influencing how they feel about their parenting capabilities [23]. On the contrary, IC was negatively correlated to perceived stress and satisfaction, that is, a parent’s awareness and curiosity of a child’s mental state is relatively low among those reporting higher levels of stress and dissatisfaction with their parenting. These results are consistent with research and theory arguing that stress can impair one’s mentalization [53]. This consistency adds construct validity support to the PRFQ measure.

    Furthermore, CMS was positively correlated with satisfaction, efficacy, social support types, and coping. These results confirm that a parent’s perception that their thoughts about their child’s mental states are accurate contributes to their feelings of satisfaction, parental competence, and ability to manage and cope with parenting. In contrast, CMS was found to have nonsignificant negative associations with perceptions of stress. This suggests that stress may have less of an impact on this form of RF. This result requires further study, as it may speak to how specific forms of RF operate under different circumstances. In sum, our results show that PRFQ subscales are generally related to other social cognitive variables as one would expect based on the literature, adding support for the construct validity of the measure. Although the PRFQ-18 is a fairly new measure within the field of psychology [54], our results are consistent with those reported in preliminary studies [13].

    Finally, we identified both similarities and differences among mothers and fathers in terms of PRFQ correlates. In general, both mothers and fathers with high RF had lower levels of parental stress and more social support, satisfaction, efficacy, and better coping. However, some differences in terms of how RF operates in terms of coping and competence among men and women were noted here. Specifically, men who reported good coping with parenting reported more interest and curiosity in their child’s mental state, more certainty around understanding their child’s mental state, and better mentalization. Another notable difference was the relationship between parental efficacy and PM. Women with more parental efficacy had lower levels of PM and, thus, better mentalization. In contrast, PM was unrelated to a father’s efficacy. For women, good coping was primarily related to better mentalization, as seen in lower PM scores. However, for fathers, satisfaction with parenting was strongly negatively correlated with PM, showing that fathers with a great deal of satisfaction with being a parent also have a better ability to mentalize.

    Limitations and Future Directions

    Advantages of self-report measures include time efficiency, cost-effectiveness, and ease of administration. Self-report measures are reported to be valid measures in examining cognitive constructs, emotions, and moods [55]. However, one issue concerning self-report measures is the level of insight required from an individual [55]. Other cautions against self-report measures include potential inaccuracy in participants’ answers and various response styles influencing results [56]. To further support the validity of the PRFQ-18 and to allay concerns about the PRFQ-18 being a self-report measure, future research should consider including a gold standard measure such as the PDI to compare these results observed here to uncover if the PRFQ-18 can offer insights similar to the current gold standard measures. In addition, this research would provide more evidence as to the reliability and validity of the PRFQ-18.

    A limitation of this study is the reliance on a preexisting survey panel. Whereas this method allows for easy access to a wide cross-section of Canadians, the survey panel may differ in unknown and important ways from a true random sample of Canadians. If future research could replicate these findings in a random sample of Canadians recruited through other means, we would have increased confidence in the findings in this study.

    Ideally, an independent sample should be used as a follow-up to our CFA to determine the extent to which PRFQ-18 subscales are related to theoretically meaningful constructs. However, a follow-up study should attempt to replicate our findings to see if the removal of items 11 and 18 is supported in other samples. Considering the preliminary studies had similar findings to this study [13], we would expect this result to hold. In this study of parents with children aged 0 to 12 years, we found evidence supporting the construct validity of a revised PRFQ; however, it is possible that the PRFQ might perform differently between younger and older children [13]. This is a question for future research to examine in an independent sample. Finally, variances among mothers and fathers suggest further exploration between mothers, fathers, RF, and cognitive variables is needed. That is, our results suggest that RF subtypes may be differentially influenced by the social and psychological parenting context.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Summary of intercorrelations, means and stand deviations for scores on the Parent Reflective Functioning Questionnaire -18, Medical Outcome Study Social Support Survey, Parenting Sense of Competence Scale, Perceived Stress Scale, Parent Coping Scale in males and females.

    PDF File (Adobe PDF File), 94KB
    1. Slade A. Parental reflective functioning: an introduction. Attach Hum Dev. Sep 2005;7(3):269-281. [CrossRef] [Medline]
    2. Fonagy P, Steele M, Steele H, Moran G, Higgitt A. The capacity for understanding mental states: the reflective self in parent and child and its significance for security of attachment. Infant Ment Health J. Sep 12, 1991;12(3):201-218. [CrossRef]
    3. Koren-Karie N, Oppenheim D, Dolev S, Sher E, Etzion-Carasso A. Mothers' insightfulness regarding their infants' internal experience: relations with maternal sensitivity and infant attachment. Dev Psychol. Jul 2002;38(4):534-542. [CrossRef] [Medline]
    4. Grienenberger JF, Kelly K, Slade A. Maternal reflective functioning, mother-infant affective communication, and infant attachment: exploring the link between mental states and observed caregiving behavior in the intergenerational transmission of attachment. Attach Hum Dev. Sep 2005;7(3):299-311. [CrossRef] [Medline]
    5. Sadler LS, Slade A, Close N, Webb DL, Simpson T, Fennie K, et al. Minding the baby: enhancing reflectiveness to improve early health and relationship outcomes in an interdisciplinary home visiting program. Infant Ment Health J. Sep 1, 2013;34(5):391-405. [FREE Full text] [CrossRef] [Medline]
    6. Fonagy P, Target M, Steele H, Steele M. Mentalizacion y Psicoterapia. URL: https://mentalizacion.com.ar/images/notas/Reflective%20Functioning%20Manual.pdf [accessed 2019-04-11] [WebCite Cache]
    7. Fonagy P, Target M. Attachment and reflective function: their role in self-organization. Dev Psychopathol. 1997;9(4):679-700. [Medline]
    8. Meins E. Security of Attachment and the Social Development of Cognition. Hove, England. Psychology Press; 1997.
    9. Fonagy P, Gergely G, Target M. The parent-infant dyad and the construction of the subjective self. J Child Psychol Psychiatry. 2007;48(3-4):288-328. [CrossRef] [Medline]
    10. Srinivasan C. The Relationship Between Reflective Function and Psychopathology in Survivors of Childhood Abuse. New York, NY. New School University; 2005.
    11. Slade A, Grienenberger J, Bernbach E, Levy D, Locker A. Maternal reflective functioning, attachment, and the transmission gap: a preliminary study. Attach Hum Dev. Sep 2005;7(3):283-298. [CrossRef] [Medline]
    12. Ordway MR, Sadler LS, Dixon J, Close N, Mayes L, Slade A. Lasting effects of an interdisciplinary home visiting program on child behavior: preliminary follow-up results of a randomized trial. J Pediatr Nurs. 2014;29(1):3-13. [FREE Full text] [CrossRef] [Medline]
    13. Luyten P, Mayes LC, Nijssens L, Fonagy P. The parental reflective functioning questionnaire: development and preliminary validation. PLoS One. 2017;12(5):e0176218. [FREE Full text] [CrossRef] [Medline]
    14. Spinelli J. The Relationship Between Ego Mechanisms of Defense and Reflective Functioning. New York, United States. Long Island University; 2009.
    15. Borelli JL, St John HK, Cho E, Suchman NE. Reflective functioning in parents of school-aged children. Am J Orthopsychiatry. Jan 2016;86(1):24-36. [FREE Full text] [CrossRef] [Medline]
    16. Cassidy J. The nature of the child's ties. In: Cassidy J, Shaver PR, editors. Handbook of Attachment, Second Edition: Theory, Research, and Clinical Applications. New York, NY. Guilford Press; 2008:3-22.
    17. Landy S. Pathways to Competence: Encouraging Healthy Social and Emotional Development in Young Children, Second Edition. Baltimore, MD. Brookes Publishing; 2009.
    18. Mares S, Newman L, Warren B. Clinical Skills in Infant Mental Health: The First Three Years. Camberwell, AU. ACER Press; 2005.
    19. Siegel DJ. The Developing Mind: Toward a Neurobiology of Interpersonal Experience. New York, NY. The Guilford Press; 1999.
    20. Thompson B. Ten commandments of structural equation modeling. In: Grimm LG, Yarnold PR, editors. Reading and Understanding More Multivariate Statistics. Washington, DC. American Psychological Association; 2000:261-283.
    21. Thompson R. Early attachment and later development. In: Cassidy J, Shaver PR, editors. Handbook of Attachment, Second Edition: Theory, Research, and Clinical Applications. New York, NY. The Guilford Press; 2008:348-365.
    22. Sadler LS, Novick G, Meadows-Oliver M. "Having a Baby Changes Everything" Reflective Functioning in Pregnant Adolescents. J Pediatr Nurs. 2016;31(3):e219-e231. [FREE Full text] [CrossRef] [Medline]
    23. Rosen J. Parental Reaction to a Diagnosis of Autism: How Resolution Relates to Parental Reflective Functioning and Parenting Stress. New York, NY. Pace University; 2013.
    24. Slade A, Belsky J, Aber JL, Phelps JL. Mothers' representations of their relationships with their toddlers: links to adult attachment and observed mothering. Dev Psychol. May 1999;35(3):611-619. [CrossRef] [Medline]
    25. Suchman NE, DeCoste C, Leigh D, Borelli J. Reflective functioning in mothers with drug use disorders: implications for dyadic interactions with infants and toddlers. Attach Hum Dev. Nov 2010;12(6):567-585. [FREE Full text] [CrossRef] [Medline]
    26. Bottos S, Nilsen ES. The cross-generational effects of maternal maltreatment histories: implications for children's mentalizing development. Child Abuse Negl. Jun 2014;38(6):1094-1105. [CrossRef]
    27. Stacks AM, Muzik M, Wong K, Beeghly M, Huth-Bocks A, Irwin JL, et al. Maternal reflective functioning among mothers with childhood maltreatment histories: links to sensitive parenting and infant attachment security. Attach Hum Dev. 2014;16(5):515-533. [FREE Full text] [CrossRef] [Medline]
    28. Rutherford HJ, Goldberg B, Luyten P, Bridgett DJ, Mayes LC. Parental reflective functioning is associated with tolerance of infant distress but not general distress: evidence for a specific relationship using a simulated baby paradigm. Infant Behav Dev. Dec 2013;36(4):635-641. [FREE Full text] [CrossRef] [Medline]
    29. Bain K. "New beginnings" in South African shelters for the homeless: piloting of a group psychotherapy intervention for high-risk mother-infant dyads. Infant Ment Health J. 2014;35(6):591-603. [CrossRef] [Medline]
    30. Gray SA. Widening the circle of security: a quasi-experimental evaluation of attachment-based professional development for family child care providers. Infant Ment Health J. 2015;36(3):308-319. [CrossRef] [Medline]
    31. Pontoppidan M. The effectiveness of the Incredible Years™ Parents and Babies Program as a universal prevention intervention for parents of infants in Denmark: study protocol for a pilot randomized controlled trial. Trials. Sep 2, 2015;16:386. [FREE Full text] [CrossRef] [Medline]
    32. Ramsauer B, Lotzin A, Mühlhan C, Romer G, Nolte T, Fonagy P, et al. A randomized controlled trial comparing Circle of Security Intervention and treatment as usual as interventions to increase attachment security in infants of mentally ill mothers: study protocol. BMC Psychiatry. Jan 30, 2014;14:24. [FREE Full text] [CrossRef] [Medline]
    33. Sleed M, Baradon T, Fonagy P. New Beginnings for mothers and babies in prison: a cluster randomized controlled trial. Attach Hum Dev. 2013;15(4):349-367. [FREE Full text] [CrossRef] [Medline]
    34. University College London. URL: https://www.ucl.ac.uk/psychoanalysis/research/parental-reflective-functioning-questionnaire-prfq [accessed 2019-04-12] [WebCite Cache]
    35. Ainsworth MD, Blehar MC, Waters C, Wall S. Patterns of Attachment: A Psychological Study of the Strange Situation. Oxford, England. Lawrence Erlbaum; 1978.
    36. Johnston C, Mash EJ. A measure of parenting satisfaction and efficacy. J Clin Child Psychol. Jun 1989;18(2):167-175. [CrossRef]
    37. Ohan JL, Leung DW, Johnston C. The Parenting Sense of Competence scale: evidence of a stable factor structure and validity. Can J Behav Sci. 2000;32(4):251-261. [CrossRef]
    38. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. Dec 1983;24(4):385-396. [CrossRef] [Medline]
    39. Spacapan S, Oskamp S. Perceived stress in a probability sample of the United States. In: The Social Psychology Of Health: The Claremont Symposium On Applied Social Psychology. Thousand Oaks, CA, US. Sage Publications, Inc; 1989.
    40. Gjesfjeld CD, Greeno CG, Kim KH. A confirmatory factor analysis of an abbreviated social support instrument: the MOS-SSS. Res Soc Work Pract. 2008;18(3):231-237. [CrossRef]
    41. Ghate D, Moran P. The Colebrooke Centre. 2018. URL: http://www.cevi.org.uk [accessed 2018-07-04] [WebCite Cache]
    42. Dumka LE, Stoerzinger HD, Jackson KM, Roosa MW. Examination of the cross-cultural and cross-language equivalence of the parenting self-agency measure. Fam Relat. Apr 1996;45(2):216. [CrossRef]
    43. Arbuckle JL. IBM SPSS Amos 24 User's Guide. Chicago. IBM; 2016.
    44. R Core Team. R: A language and environment for statistical computing. Vienna, Austria. R Foundation for Statistical Computing; 2016. URL: http://www.r-project.org/ [accessed 2019-04-11] [WebCite Cache]
    45. Blunch N. Introduction To Structural Equation Modelling Using Spss And Amos. Los Angeles. Sage Publications Ltd; 2008.
    46. Chen F, Curran PJ, Bollen KA, Kirby J, Paxton P. An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociol Methods Res. Jan 1, 2008;36(4):462-494. [FREE Full text] [CrossRef] [Medline]
    47. Thompson B. Exploratory And Confirmatory Factor Analysis: Understanding Concepts And Applications. Washington, DC. Amer Psychological Association; 2004.
    48. Kelloway EK. Using LISREL for Structural Equation Modeling: A Researcher's Guide. Thousand Oaks, CA. Sage Publications; 1998.
    49. Keith TZ. Multiple Regression and Beyond: An Introduction to Multiple Regression and Structural Equation Modeling, Second Edition. New York, NY. Routledge; 2015.
    50. Byrne BM. Structural Equation Modeling With AMOS: Basic Concepts, Applications, and Programming, Third Edition. New York, NY. Routledge; 2016.
    51. Gadermann AM, Guhn M, Zumbo BD. Estimating ordinal reliability for Likert-type and ordinal item response data: a conceptual, empirical, and practical guide. Pract Assess Res Eval. 2012;17(3). [FREE Full text]
    52. Weems GH, Onwuegbuzie AJ. The impact of midpoint responses and reverse coding on survey data. Meas Eval Couns Dev. 2001;34(3):166-176. [FREE Full text]
    53. Freeman C. What is mentalizing? An overview. Br J Psychother. Apr 21, 2016;32(2):189-201. [CrossRef]
    54. DeRoo M. Reflective Functioning: an Analysis of Measures and the 18- Item Parent Reflective Functioning Questionnaire. Athabasca, AB, Canada. Athabasca University; 2016.
    55. Haeffel GJ, Howard GS. Self-report: psychology's four-letter word. Am J Psychol. 2010;123(2):181-188. [CrossRef] [Medline]
    56. Paulhus D, Vazire S. In: Robins RW, Fraley RC, Krueger RF, editors. Handbook of Research Methods in Personality Psychology. New York, NY. Guilford Press; 2007.

    ‎
    CFA: confirmatory factor analysis
    CFI: comparative fit index
    CMS: certainty about mental states
    IC: interest and curiosity in mental states
    MOS-SSS: Medical Outcome Study Social Support Survey
    NFI: normed fit index
    NNFI: non-normed fit index
    PCS: Parent Coping Scale
    PDI: Parent Development Interview
    PM: prementalizing modes
    PRF: parental reflective functioning
    PRFQ: Parent Reflective Functioning Questionnaire
    PSOC: Parenting Sense of Competence Scale
    PSS: Perceived Stress Scale
    RF: reflective functioning
    RMSEA: root mean square error of approximation
    SSP: Strange Situation Procedure

    Edited by G Eysenbach; submitted 16.07.18; peer-reviewed by L McGoron, M Das; comments to author 04.10.18; revised version received 05.03.19; accepted 30.03.19; published 09.05.19.

    Copyright

    ©Monica De Roo, Gina Wong, Gwen R Rempel, Shawn N Fraser. Originally published in JMIR Pediatrics and Parenting (http://pediatrics.jmir.org), 09.05.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on http://pediatrics.jmir.org, as well as this copyright and license information must be included.