This paper is in the following e-collection/theme issue:

Parenting (246) General Parenting Education and Training (52)

Published on in Vol 2, No 2 (2019): Jul-Dec

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/13023, first published .
Effectiveness of the Volunteer Family Connect Program in Reducing Isolation of Vulnerable Families and Supporting Their Parenting: Randomized Controlled Trial With Intention-To-Treat Analysis of Primary Outcome Variables

Effectiveness of the Volunteer Family Connect Program in Reducing Isolation of Vulnerable Families and Supporting Their Parenting: Randomized Controlled Trial With Intention-To-Treat Analysis of Primary Outcome Variables

Effectiveness of the Volunteer Family Connect Program in Reducing Isolation of Vulnerable Families and Supporting Their Parenting: Randomized Controlled Trial With Intention-To-Treat Analysis of Primary Outcome Variables

Authors of this article:

Rebekah Grace1 Author Orcid Image ;   Kelly Baird1 Author Orcid Image ;   Emma Elcombe1 Author Orcid Image ;   Vana Webster1 Author Orcid Image ;   Jacqueline Barnes2 Author Orcid Image ;   Lynn Kemp1 Author Orcid Image
Article Authors Cited by (4) Tweetations (2) Metrics

    Original Paper

    1Translational Research and Social Innovation, Western Sydney University, Liverpool, Australia

    2Institute for the Study of Children, Families and Social Issues, Birkbeck University of London, London, United Kingdom

    *all authors contributed equally

    Corresponding Author:

    Rebekah Grace, BA, PhD

    Translational Research and Social Innovation

    Western Sydney University

    1 Campbell St

    Level 3

    Liverpool, 2170

    Australia

    Phone: 61 87389362

    Email: r.grace2@westernsydney.edu.au


    Background: Volunteer home visiting is a widely adopted community-based approach to support families by linking isolated or vulnerable families with community volunteers who visit their homes weekly over approximately 12 months. This study seeks to robustly evaluate the effectiveness of this model of support for families with young children.

    Objective: This paper reports the intention-to-treat analysis of primary and secondary outcomes for a pragmatic randomized controlled trial (RCT) of the Volunteer Family Connect intervention, a volunteer home-visiting program designed to support families with young children who experience social isolation or a lack of parenting confidence and skills.

    Methods: The RCT was conducted across seven sites in Australia. Overall, 341 families were recruited: 169 intervention (services as usual+volunteer home visits) and 172 control (services as usual) families. Intervention families received the program for 3-12 months. Participants were invited to complete six data collection points over a 15-month period. Primary outcomes were community connectedness and parenting competence. Secondary outcomes included parent physical and mental health, general parent wellbeing, parent empowerment, the sustainability of family routines, and the parent-child relationship. According to the protocol, the program would be judged to be effective if at least one of the primary outcomes was significantly positive and the other was neutral (ie, intervention families did not demonstrate positive or negative outcomes compared to the control group).

    Results: The intervention group demonstrated significant improvement in the primary outcome variable parenting sense of competence as compared to the control group. Overall, there was no significant difference between the intervention and control groups with regard to the primary outcome variable community connectedness, other than on the “Guidance” subscale of the Social Provisions Scale. Because there were statistically significant findings for the total score of one primary outcome variable “parenting sense of competence” and largely neutral findings for the primary outcome variable “community connectedness,” the program met the previously defined criteria for program effectiveness. In relation to secondary outcomes, intervention families reported significantly higher wellbeing and were significantly more likely to feel that life was improving.

    Conclusions: The Volunteer Family Connect intervention was considered an effective intervention, with a role to play on the landscape of services available to support vulnerable families with young children.

    Trial Registration: Australian New Zealand Clinical Trial Registry ACTRN12616000396426; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=370304

    JMIR Pediatr Parent 2019;2(2):e13023

    doi:10.2196/13023

    Keywords

    volunteer home visiting; randomized controlled trial; families; support services; social relationships; community; Volunteer Family Connect 


    Background

    Volunteer home visiting is a widely used strategy to support those who are isolated within their communities and require additional support to engage with health and other community services that are available to them and with other local families. Typically, a community volunteer is assigned by a coordinating organization to someone who has been identified as needing social support. The volunteer will visit them on a regular basis, provide general support, and facilitate their engagement with formal services until the individual feels more connected to the community and better able to utilize services independently. Previous research has supported the importance of this less formal, relationship-based approach as complementary to other, more formal services on the service landscape. It is likely to be instrumental in breaking down barriers to service engagement, including language and cultural barriers [1]. Research supports the potential value of volunteer home visits in the distribution of health information [2], support of improved social networks to those who are isolated [3], promotion of emotional wellbeing and parenting competence [4], promotion of positive health outcomes [5], and support of those with chronic illnesses [6].

    In the Australian context, volunteer home visiting programs for families with young children have come under threat in recent years, with services reporting the withdrawal of government funding because of the lack of methodologically rigorous evidence demonstrating their effectiveness. The failure to evaluate the effectiveness of this model of support utilizing a robust, gold-standard research design in an Australian context has been mistaken for a lack of program effectiveness. Rigorous trials are required to determine the effectiveness of volunteer home visiting as a form of structured social relationships to support those who are isolated.

    Structured Social Relationships as Intervention

    The research evidence demonstrating the importance of social relationships as protective for health and wellbeing is strong. Much of the existing research has emphasized on the role of social networks in the prevention and treatment of mental health disorders such as depression [7,8]. Holt-Lunstad and colleagues [9] refocused attention on biomedical health outcomes, looking specifically at social connection as a risk factor for mortality. They conducted a meta-analytic review and found a 50% increase in the likelihood of survival for participants with strong social relationships. Social isolation was found to place participants at a higher risk of mortality than well-known risk factors, including smoking, excessive drinking, and obesity. Although the prevention of smoking and obesity attracts considerable attention and investment across the world, social relationships are still largely conceptualized as existing within the private realm beyond the scope of service intervention and public health campaigns. However, in recent years, at the level of policy, there has been a growing interest in the importance of social connection. For example, in January 2018, the Prime Minister of the United Kingdom announced the establishment of the Commission for Loneliness [10].

    The need to address social connections in the design of service solutions is further supported by research demonstrating rising levels of perceived social isolation and disconnection in the industrialized world. This is largely credited to the increased rates of divorce, separation and single parenthood, geographic mobility, and the decline in extended families living together [11]. In Australia, for example, conservative estimates indicate that 7%-9% of Australians report feeling socially isolated or very isolated, with younger adults being at the highest risk of perceived isolation [12,13].

    Addressing social connection through service intervention is not straightforward, because appropriately paid service professionals must maintain professional boundaries and are perceived to provide a service by clients rather than being part of their social network [9]. Nonetheless, increased understanding of the importance of social connection is having a direct impact on health service practice, with a growing emphasis on a relationship-based approach to nursing and allied health care [14]. Establishing support programs run by community volunteers represents an approach to supporting those who are isolated to build social connection within the local community and facilitate engagement with local services [15].

    Byrne and colleagues [1] proposed that a holistic approach to family health and wellbeing requires four interconnected arms of support: universal services (eg, primary health care), targeted services (eg, specialist medical services and child protection services), informal networks (eg, friends and families), and structured social support (eg, volunteer “befriending” programs). Organized volunteer programs are clearly not as organic as natural friendships or family ties, but they potentially provide an alternative for people who do not have an informal support network within their local community and may indeed be preferable if there are family tensions. Social networks, structured or organic, play a crucial role in breaking down the barriers to engagement with professional services and in fostering a sense of personal wellbeing [2].

    Structured Social Relationships to Support Parents of Young Children

    Parents, especially mothers, are at a high risk of social isolation, particularly in the early years of transition to parenthood when feelings of exhaustion or unpreparedness can be overwhelming [16,17]. In research involving parents with additional challenges, such as having a child with a disability [18], newly arriving in a country [19], or experiencing cognitive or mental health difficulties [20], social isolation is a common theme. A small body of existing research has examined the role of volunteer home visiting programs in supporting improved outcomes for vulnerable families. Collectively, the literature supports the potential value of a home visiting model in contributing to improved outcomes related to maternal emotional wellbeing and an enhanced sense of maternal parenting competence [4] as well as improved family social connectedness [21]. There is evidence to suggest that volunteer home visiting programs can also support child health outcomes such as improved immunization rates and higher rates of exclusive breastfeeding [22].

    The Volunteer Family Connect Effectiveness Trial

    This paper describes a pragmatic randomized controlled trial of volunteer home visiting, which was conducted across four states in the east of Australia. The project provides an exemplary model of service collaboration, bringing together three not-for-profit service organizations usually in competition with each other and all independently running volunteer home visiting programs for families with young children (Karitane, The Benevolent Society, and Save the Children Australia). The collaboration, including university research partners and a corporate partner, combined the best elements of the existing programs into one manualized “best practice” program built on research evidence, theoretical underpinning, and practice experience. This program, known as Volunteer Family Connect, was then implemented across all three organizations. Details of program implementation and the research protocol have been published previously [23].

    This study addressed two primary outcomes—community connectedness and parenting sense of competence—and compared intervention families (those randomly allocated to receive Volunteer Family Connect in addition to usual care services) with control group families (those randomly allocated to continue to receive usual care services only). In the Australian context, “usual care services” includes free universal health care, government-subsidized early childhood education and care services, and either free or low-cost playgroup or parenting support programs provided by nongovernment organizations varying from one location to another. The control group was therefore still potentially able to access considerable support from within their communities if they sought it out. No restrictions were placed on the intervention group in terms of accessing any additional community support. In fact, this was actively facilitated. Consequently, this study examined the added value of volunteer home visiting within a reasonably comprehensive service context. We hypothesized that intervention families would develop a stronger sense of parenting competence and stronger community support networks than those who continued to receive usual community support services.


    Study Design

    A pragmatic randomized controlled trial (RCT) was undertaken to rigorously assess the effectiveness of the Volunteer Family Connect intervention in real-world conditions [24]. Supported by the Pragmatic Explanatory Continuum Indicator Summary (PRECIS) tool [24] and in keeping with the “real-world” conditions for a pragmatic randomized trial, this study (1) recruited the full range of families referred (through usual referral pathways) to the Volunteer Family Connect intervention program delivered across the service organizations with no changes to the inclusion/exclusion criteria; (2) compared the volunteer home visiting program with other usual care support services; and (3) tested real-world implementation of the volunteer home visiting program by the service organizations with their current volunteer providers by using guidelines to support quality service provision, but acknowledging that there are variations in practice while rigorously assessing outcomes using standardized measurement tools. The use of the PRECIS tool in supporting the design of this RCT has been reported elsewhere [23].

    Primary Research Question

    Is Volunteer Family Connect, a volunteer home visiting intervention, effective in improving the parenting competence and community connectedness of vulnerable families with young children compared with families who receive usual community-based support services?

    Hypothesis

    Families receiving a volunteer home visitor will have significantly better family outcomes at program exit (ie, higher sense of parenting competence and stronger community connectedness) than those allocated to continue to receive usual care in the community.

    Secondary Research Question

    For the purposes of this paper, results are presented for the secondary research question: Do differences exist in the patterns of parent health, wellbeing, empowerment, parent-child relationship, and family routines over time between those who receive the Volunteer Family Connect program and those in the services as usual control group?

    Participants

    Eligibility Criteria

    Families were assessed against the following eligibility criteria: (1) having one or more children aged 0-5 years, (2) being at-risk of geographic or social isolation, (3) seeking to develop confidence and increase parenting knowledge and skills, (4) residing in the specified service area, and (5) being unable to access resources or other support services. Research participation was supported by the use of interpreters for families with a first language other than English.

    In line with usual program practice, families were unable to participate in the study if any of the following conditions applied: (1) active abuse or domestic violence within the family, (2) unmanaged mental illness within the family, (3) substance abuse issues in the family, (4) living in an environment that was unsafe for a volunteer to visit, or (5) under child protection orders or unsettled parenting arrangements. Families who experienced these challenges were referred to more specialized services.

    Recruitment

    Families were recruited to the study either through the usual service referral networks for the Volunteer Family Connect program (eg, child and family health nurses, general practitioners, or family support/social workers) or through self-referral to the program. Families who were eligible to receive the program were invited to speak with a researcher, and if interested, informed consent was secured. Using computer-generated random numbers, the research manager allocated families to the intervention group (services as usual+Volunteer Family Connect) or the control group (services as usual only). The procedure used to recruit and allocate families was described in the study protocol paper [23]. Participant attrition information is provided in Figure 1. At baseline, 341 families were recruited to the study: 169 intervention families (services as usual+Volunteer Family Connect) and 172 control families (services as usual only).

    ‎
    Figure 1. Consolidated Standards of Reporting Trials diagram of participant retention for eligible participants. VFC: Volunteer Family Connect.

    Intervention

    During the trial, the Volunteer Family Connect program was implemented in seven sites across the east of Australia in New South Wales, Queensland, Victoria, and Tasmania. The sites represented city communities (n=2), suburban communities (n=3), and rural communities (n=2).

    Families in the intervention group received the Volunteer Family Connect program delivered by one of the three service organizations. Program coordinators matched families with trained community volunteers who visited the family for approximately 2 hours once per week. Volunteers were community members with some experience in working with children, either because of personal parenting experiences or their employment experiences. Volunteers participated in at least 30 hours of training before being matched with a family and underwent police checks to ensure that they could work with children and families. Depending on the needs of the family, volunteers supported families to connect with other services/facilities in their local community as well as modelled positive interactions with children and encouraged parents to identify and meet their personal and family goals.

    Outcome Measures

    Table 1 presents the family outcome measures and the associated standardized instrument or, if unavailable, the tool specifically designed for use in this trial. Measurement tools that are widely used within the parenting research literature were selected wherever possible. Measures were presented to families in a single survey instrument, so that all information is parent self-report data. This survey instrument was tested in a feasibility/pilot study in advance of the trial and found to be acceptable to families [25].

    Table 1. Family and parent outcome measures.
    Outcomes measuredInstruments
    Primary outcomes

    		Parenting competenceParenting Sense of Competence Scale [26]. All three subscales were collected, including Parenting Satisfaction, Parenting Interest, and Parenting Efficacy. The total score was also calculated.

    		Community connectednessFour Community Connectedness questions were taken from the survey that is used in the Longitudinal Study of Australian Children [27]. Participants were asked to rate, on a 4-point scale, to what extent the following statements were true for them:
    • “If you need information about local services, you know where to find that information.”
    • “You feel a strong sense of identity with your neighbourhood.”
    • “Most people in your neighbourhood can be trusted; you are well informed about local affairs.”
    Social Provisions Scale [28]. All six subscales were used, including Guidance, Attachment, Opportunity for Nurturance, Social Integration, Reassurance of Worth, and Reliable Alliance.
    Secondary outcomes

    		Parent physical and mental healthShort Form-12 [29]. This is a short-form 12-item measure, which produces a physical health score and a mental health score.

    		Parent enablementModified Patient Enablement Instrument [30]. The instrument was modified because the original questions were framed within the health context. The wording was changed for the purposes of this study to apply more generically to the service system.

    		General parent wellbeingThe Outcome Rating Scale [31]. On this scale, participants are asked to rate how things have been going for them individually, interpersonally, socially, and overall. Two questions were added about whether life has improved over the last 3 months and whether the parent expects that life will continue to improve.

    		Sustainability of family routinesQuestions developed based on the Ecocultural Family Interview [32]. Participants were asked to rate family functioning on seven questions relating to family routines (eg, bed time routines, mealtime routines, play time routines, and accessing transport).

    		Child-parent relationshipParental questionnaire (questions from the Canadian National Survey of Parents of Young Children) [33]. Nine questions exploring the parent child relationship (ie, positive/warm parent child interactions and angry/punitive parenting) were taken from the Canadian National Survey. Participants were asked to rate on a 5-point Likert scale the extent to which the events described in the questions happen for them (eg, How often do you and your child laugh together?).

    Data Collection

    Families completed a survey every 3 months for 15 months, with a total of six data collection points. The first survey was completed when they were recruited to the study (baseline). The 15-month timeframe took into consideration the differing lengths of time that families remained engaged with the Volunteer Family Connect program (ie, 3-12 months) and allowed for at least one data collection point to take place after exiting from the program.

    Wherever possible, baseline surveys were completed face-to-face by a research assistant with families in their home. Following this, they had the option to complete the survey with a member of the research team (ie, at the participant’s home or over-the-phone) or self-complete. Surveys were available as a paper version (ie, pen and paper version completed by hand), an electronic version (Microsoft Word document emailed to the participant), or an online version (Web-based version of the survey using Qualtrics software). In addition, iPads (Apple Inc, Cupertino, California) were used for data collection with families who completed surveys face-to-face with a research assistant using the online Qualtrics (Provo, Utah) version of the survey. All other data (ie, collected on a paper version of the survey) were entered into the Qualtrics survey by a data entry officer.

    Data were stored on a password-protected Qualtrics database and backed up to a password-protected folder on a server. Only members of the research team had access to the data. Data were deidentified during data entry, with all names replaced by participant numbers. Storage of data was performed in accordance with the requirements of the Australian National Health and Medical Research Council and the Privacy Act 1988.

    Statistical Analysis

    Baseline characteristics were described using mean and SD for scale variables and proportions for categorical data. Statistical comparisons of baseline data were completed using Student t test, Mann-Whitney U, or Chi-squared test, as appropriate. All analyses were completed using SPSS (version 25.0.0.1; IBM Corp, Armonk, New York).

    Linear regression analyses were fitted using a two-way piece-wise regression slope (baseline to 12 months and 12 months to 15 months) to accommodate for the expectation of a nonlinear trajectory. The intention-to-treat regression models were adjusted for site (the stratification variable used for randomization). All regression analyses were completed using the mixed procedure, fitted using the restricted maximum likelihood criterion with the autoregressive one covariance matrix applied to repeated statement [34].

    Regression results are reported as mean differences where outcomes have been standardized to mean=0 and SD=1, enabling comparison of outcome measures on different scales. Prior to standardization, data normalization was completed for linear outcomes with nonnormal distributions.

    Effect sizes (ESs) were calculated for all regression models. Overall, the program was considered to have been effective if at least one of the primary outcomes was significantly positive and the other was neutral. By “neutral,” we mean that intervention families did not demonstrate a positive or negative outcome in relation to the control group.

    Ethics

    Ethical approval for the study was granted by the Macquarie University Human Research Ethics Committee (reference number: 5201401144).


    Participants were recruited between May 2015 and April 2017. Of the 410 participants screened for the intervention, 363 were eligible and 341 consented to be randomized. Of these, 305 completed the baseline survey and were enrolled into the trial. At 12 months, 228 (75%) women completed the follow-up survey.

    Baseline demographic characteristics are reported by randomization group in Table 2. At baseline, there were no statistical differences between the intervention and control groups in any of these characteristics.

    All primary outcome measures showed increasing scores over the duration of the intervention, indicating improvements in parenting sense of competence and community connectedness including social provisions,. Between baseline and 12 months, participants receiving the Volunteer Family Connect program improved significantly more than those in the control group in their parenting sense of competence (F367.6=11.2, P=.003). In addition, participants receiving the Volunteer Family Connect program had a significantly improved outcome on the Guidance subscale of the Social Provisions Scale (F1122.6=4.07, P=.04; Table 3). Findings were not significant for the other subscales of the Social Provisions Scale or for the Community Connectedness scale.

    Table 2. Demographic characteristics of intervention and control families.
    Demographic variableTotal (n=305)Intervention (n=157)Control (n=148)

    		Retaineda (n=228)Lost (n=77)Retained (n=112)Lost (n=45)Retained (n=116)Lost (n=32)
    Categorical variable, n (%)

    		Mother’s education less than year 1240 (17.5)11 (14.3)17 (15.2)6 (13.3)23 (19.8)5 (15.6)

    		Culturally and linguistically diverse50 (21.9)25 (32.5)27 (24.1)14 (31.1)23 (19.8)11 (34.4)

    		High support needsb for participant44 (19.3)12 (15.6)20 (17.9)8 (17.8)24 (20.7)4 (12.5)

    		High support needs for other adult in house11 (4.8)2 (2.6)5 (4.5)2 (4.4)6 (5.2)0 (0.0)

    		High support needs for child in house57 (25.0)17 (22.1)24 (21.4)9 (20.0)33 (28.4)8 (25.0)

    		High support needs for person in house at baseline62 (27.2)18 (23.4)28 (25.0)10 (22.2)34 (29.3)8 (25.0)

    		High support needs for person in house at any stage in program91 (39.9)19 (24.7)44 (39.3)11 (24.4)47 (40.5)8 (25.0)

    		Aboriginal or Torres Strait islander11 (4.8)4 (5.2)8 (7.1)2 (4.4)3 (2.6)2 (6.3)
    Scale, mean (SD)

    		Mother’s age34.1 (6.8)32.1 (5.5)34.3 (6.7)32.6 (5.8)33.9 (6.9)31.5 (5.0)

    		Adults living in household0.9 (0.6)0.9 (0.6)0.9 (0.6)0.8 (0.6)0.9 (0.7)0.9 (0.6)

    		Children living in household2.2 (1.2)2.1 (1.0)2.0 (1.1)2.1 (1.1)2.3 (1.2)2.1 (0.9)

    aRetained indicates participation to at least 12 months. Participants were also interviewed at 15 months during the postintervention period.

    b“High Support Needs” refers to a diagnosed disability, chronic health condition, or mental health condition.

    Table 3. Results of univariate regression demonstrating change from baseline to 12 months, comparing intervention (Volunteer Family Connect) and control families. Descriptive statistics report the sample size, mean, and SD of each outcome measure at 12 months.
    OutcomesDescriptive statisticsComparison statistics (baseline to 12 months)

    		InterventionControlStatisticaEffect over 3 monthsbAdjusted 95% CIP value

    		NMean (SD)NMean (SD)



    Primary outcomes

    		Parenting sense of competence1004.10 (0.67)1073.99 (0.75)0.1980.1090.04 to 0.18<.001c
     Community connectedness10114.85 (2.69)10913.90 (3.14)–0.0070.03–0.04 to 0.10.41
     Social provisions scale   
      Guidance10113.14 (2.14)10912.94 (2.17)0.1570.0760.01 to 0.14.03c
      Reassurance of worth9912.01 (1.99)10912.18 (2.01)0.0160.018–0.05 to 0.09.62
      Social integration10012.56 (1.91)10912.07 (1.98)0.1480.06–0.01 to 0.13.08
      Attachment10112.41 (2.38)10912.24 (2.27)0.1210.06–0.01 to 0.13.09
      Opportunity for nurturance10113.61 (2.14)10913.92 (1.86)–0.081–0.032–0.10 to 0.04.38
      Reliable Alliance10013.26 (1.98)10912.95 (2.13)0.0230.043–0.02 to 0.11.20
    Secondary outcomes
     Short Form-12   
      Physical10147.90 (9.53)10947.80 (9.93)–0.052–0.016–0.08 to 0.05.65
      Mental10144.37 (9.88)10945.1 (12.24)0.1230.039–0.03 to 0.11.27
     Parent enablement975.27 (3.94)1094.50 (3.83)0.1140.057–0.01 to 0.13.11
     Life in general980.86 (0.73)1090.78 (0.72)0.104–0.019–0.09 to 0.05.60
     Outcome rating scale10128.81 (7.22)10927.1 (7.55)0.0960.0690.00 to 0.14.04c
     Has life improved in the previous 3 months?1017.20 (2.26)1096.64 (2.21)0.1970.0690.00 to 0.14.04c
     Do you think life will improve in the next 3 months?1008.05 (1.77)1087.64 (1.72)0.0350.056–0.01 to 0.12.10
     Family routines   
      Getting out of the house1004.33 (2.84)1094.60 (3.01)0.0610.014–0.05 to 0.08.68
      Access to transport1012.23 (2.24)1092.61 (2.70)–0.122–0.037–0.11 to 0.03.29
      Time for tasks1015.61 (2.73)1095.64 (2.77)0.0620.014–0.05 to 0.08.68
      Time with child1007.89 (2.33)1097.45 (2.42)0.1960.0640.00 to 0.13.06
      Meal-time routine1017.87 (2.47)1097.38 (2.52)0.1750.053–0.01 to 0.12.12
      Bed-time routine1017.90 (2.32)1097.75 (2.35)0.1740.049–0.02 to 0.12.19
      Manage day-to-day tasks1016.96 (2.15)1086.94 (2.45)0.1530.053–0.02 to 0.12.13
     Parent-child relationship   
      Warmth10117.15 (2.27)10916.83 (2.18)0.0170.013–0.06 to 0.09.72
      Angry10111.0 (3.07)10910.83 (3.09)–0.064–0.017–0.09 to 0.06.66

    aComparative statistic is the mean difference (intervention minus control) of the outcome measure after data normalization and standardization.

    bEffect over 3 months represents change between Volunteer Family Control and control groups in standardized score during each 3-month period (estimated β).

    cSignificant results.

    Regarding the secondary outcomes, participants in the intervention group rated their individual, interpersonal, and social lives as significantly better at 12 months after baseline than control participants (F446.4=4.10, P=.04; Table 3). There were no statistically significant changes for the intervention group families compared to the control group families in parenting style, parent enablement, physical health, or mental health over the course of the intervention. There was a trend toward improvements (more time: P=.06, regular meals: P=.12, regular bed times: P=.19, life has got better: P=.04, and life will continue to get better: P=.10) in outcomes of family routines and life, including having more time to spend with their child, having more regular meal times and bed times, and feeling that life was getting better and would continue to get better (Table 3). The forest plot in Figure 2 presents the standardized change score and 95% CI for each variable. Multimedia Appendix 1 reports the full univariate outcome models.

    ‎
    Figure 2. Effect of intervention on outcome measures – baseline to 12 months. Effect represents change between Volunteer Family Connect and control groups in standardized score during each 3-month period, Est β. VFC: Volunteer Family Connect; SF: Short Form.

    Principal Findings

    The findings from this study met the criteria for program effectiveness defined in our previous peer reviewed protocol paper [23]. To be considered effective, the program needed to achieve positive results on at least one of the primary outcomes, with the other primary outcome achieving at least neutral results. A strong statistically significant finding was improved outcomes for the intervention group on the Parenting Sense of Competence Scale. However, the results for the Social Provisions Scale (SPS) were mixed. The SPS was a key measure of community connectedness, and only one subscale (Guidance) on this measure demonstrated a significant finding, indicating that families in the intervention group were more likely to report that there was someone in their life they could go to for advice and information. Nevertheless, the forest plot presenting effect sizes (Figure 2) shows positive trends for the intervention group on three additional SPS subscales, including Social Integration (sense of belonging to a group), Attachment (emotional closeness with another person), and Reliable Alliance (having someone who could be counted on in times of stress).

    There were some significant findings among the secondary outcomes measured. General parent wellbeing, as measured by the Outcome Rating Scale, was significantly higher for the parents who received the Volunteer Family Connect program. Volunteer Family Connect program parents were also significantly more likely to report that life had improved in the last 3 months, and there was a trend toward believing that life will continue to improve. Positive trends were present throughout the analysis, including a clear trend of improvement in parent enablement for the intervention families (P=.11). Of the seven variables designed to measure the sustainability of family routines, four showed improvement for the intervention families. Those who received the Volunteer Family Connect program were more likely to feel that they were spending more time with their children, had established sustainable meal and bedtime routines, and were managing day-to-day tasks more effectively. Our findings did not demonstrate differences between the intervention and control families on measures of health or parent-child relationship. Importantly, however, there were no significant impacts for the control group over the intervention group.

    Addressing the complexity of need that exists within communities in Australia requires a continuum in the range of services available: A rich service landscape that is responsive in the early identification of support needs and meaningful within the local community context [35]. The findings presented in this paper support the effectiveness of structured social relationships, in the form of a volunteer home visiting program, in improving outcomes for isolated or marginalized families with young children. The study contributes to the early intervention and prevention literature, providing evidence for the potential for communities to mobilize as an intervention force in addressing social isolation as a risk factor for vulnerable families [36]. Although the intervention families increased in their connection to community over the course of this research, so did the control group, resulting in nonsignificant findings on our measures of community connectedness for all but the Guidance subscale of the Social Provisions Scale. Our participant groups were predominantly recruited through referral from existing community services, and therefore, these findings may reflect some bias within the sample in that participants had at least some level of connection to community prior to the trial. A review of recruitment strategies to the program may be important to ensure that volunteer support is available to those families who experience significant isolation.

    This study was limited by the relatively small participant numbers, and it may be that some of the trends evident within the data would have reached significance with a larger sample size. Another limitation was that it was not possible to mask the group allocation of the participants for the data collection team. Although researchers were blind at the outset, participants disclosed this information in their responses to questions about their experiences with services. This intention-to-treat analysis did not include analyses of benefit of the program for families receiving a longer or shorter duration of intervention, the characteristics of families who may be more or less likely to benefit from this volunteer home visiting intervention, or the relationship between family outcomes and the fidelity of program delivery. These important analyses will be conducted and will be published in subsequent papers, providing an opportunity to explore greater precision in the targeting and provision of the Volunteer Family Connect program.

    Conclusions

    The findings from this pragmatic randomized controlled trial examining the effectiveness of the Volunteer Family Connect program demonstrated significant findings in one of the primary outcome, parenting sense of competence, and mixed findings in the other primary outcome community connectedness. The results suggest that high-quality volunteer home visiting programs such as Volunteer Family Connect, with volunteers given training, guidance, and supervision, have a role to play in the landscape of services designed to support families with diverse needs—a role that is complementary to formal service provision and strengthens the parenting confidence, wellbeing, and optimism of vulnerable families.

    Acknowledgments

    The research has been funded by a private, anonymous philanthropist. This funder has played no role in the design of the study or in the collection, analysis, and interpretation of the data and writing of the manuscript. We are sincerely grateful for the generosity of this philanthropist and his/her commitment to supporting Australian families. We would also like to acknowledge Dr Jayne Meyer-Tucker as the champion of this project and for her collaboration. Grainne O’Loughlin from Karitane, Leith Sterling from The Benevolent Society, and Anne Rowley and Simone Gianelli from Save the Children Australia played an invaluable leadership role as members of the Steering Committee. Thanks are extended to our research assistants, who support the participation of vulnerable families with kindness, grace, and humor, including Jane Frazer, Bryhana Kaplun, Kim Miller, Tiffany Kinoshita, Mymer Love, Kaylene O’Doherty, Angela Morrison, Elena Thayer, and Sijal Ansari.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Tests of fixed effects.

    PDF File (Adobe PDF File), 242 KB
    Multimedia Appendix 2

    CONSORT 2010 statement.

    PDF File (Adobe PDF File), 194 KB
    1. Byrne F, Grace R, Tredoux J, Kemp L. Structured social relationships: a review of volunteer home visiting programs for parents of young children. Aust Health Rev. Jun 2016;40(3):262-269. [CrossRef] [Medline]
    2. Johnson Z, Howell F, Molloy B. Community mothers' programme: randomised controlled trial of non-professional intervention in parenting. BMJ. May 29, 1993;306(6890):1449-1452. [FREE Full text] [Medline]
    3. Kelleher L, Johnson M. An evaluation of a volunteer-support program for families at risk. Public Health Nurs. 2004;21(4):297-305. [CrossRef] [Medline]
    4. Deković M, Asscher JJ, Hermanns J, Reitz E, Prinzie P, van den Akker AL. Tracing changes in families who participated in the home-start parenting program: parental sense of competence as mechanism of change. Prev Sci. Sep 2010;11(3):263-274. [FREE Full text] [CrossRef] [Medline]
    5. Duncanson K, Burrows T, Collins C. Peer education is a feasible method of disseminating information related to child nutrition and feeding between new mothers. BMC Public Health. Dec 12, 2014;14:1262. [FREE Full text] [CrossRef] [Medline]
    6. Wang C, Fetzer SJ, Yang Y, Wang J. The Impacts of using community health volunteers to coach medication safety behaviors among rural elders with chronic illnesses. Geriatric Nursing. Mar 2013;34(2):138-145. [CrossRef]
    7. Santini ZI, Koyanagi A, Tyrovolas S, Mason C, Haro JM. The association between social relationships and depression: a systematic review. J Affect Disord. Apr 01, 2015;175:53-65. [CrossRef] [Medline]
    8. Teo AR, Choi H, Valenstein M. Social Relationships and Depression: Ten-Year Follow-Up from a Nationally Representative Study. PLoS ONE. Apr 30, 2013;8(4):e62396. [CrossRef]
    9. Holt-Lunstad J, Smith TB, Layton JB. Social relationships and mortality risk: a meta-analytic review. PLoS Med. Jul 2010;7(7):e1000316. [FREE Full text] [CrossRef] [Medline]
    10. Gov.UK. 2018. URL: https://www.gov.uk/government/news/pm-commits-to-government-wide-drive-to-tackle-loneliness [accessed 2019-09-09]
    11. Australian Bureau of Statistics (ABS). Australian Bureau of Statistics. 2009. URL: http://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4102.0Main+Features20Dec+2009 [accessed 2019-09-09]
    12. Hawthorne G. Perceived social isolation in a community sample: its prevalence and correlates with aspects of peoples' lives. Soc Psychiatry Psychiatr Epidemiol. Feb 2008;43(2):140-150. [CrossRef] [Medline]
    13. Baker D. The Australia Institute. Sep 09, 2019. URL: https://www.tai.org.au/node/1866 [accessed 2019-09-18]
    14. Koloroutis M, editor. Relationship-based care: A model for transforming practice. MN. Creative Health Care Management; 2004.
    15. Black M, Kemp L. Volunteer home visiting: a systematic review of evaluations. Liverpool, NSW. Centre for Health Equity Training Research and Evaluation; 2004. URL: http://chetre.med.unsw.edu.au/files/Black_M_(2004)_VHV_Lit_Review.pdf [accessed 2019-09-09]
    16. Strange C, Fisher C, Howat P, Wood L. Fostering supportive community connections through mothers' groups and playgroups. J Adv Nurs. Dec 2014;70(12):2835-2846. [CrossRef] [Medline]
    17. Moore T, McArthur M. We're all in it together: supporting young carers and their families in Australia. Health Soc Care Community. Nov 2007;15(6):561-568. [CrossRef] [Medline]
    18. Grace R, Llewellyn G, Wedgwood N, Fenech M, McConnell D. Far From Ideal. Topics in Early Childhood Special Education. May 2008;28(1):18-30. [CrossRef]
    19. McMichael C, Manderson L. Somali Women and Well-Being: Social Networks and Social Capital among Immigrant Women in Australia. Human Organization. Mar 2004;63(1):88-99. [CrossRef]
    20. Llewellyn G, McConnell D, Cant R, Westbrook M. Support network of mothers with an intellectual disability: An exploratory study. Journal of Intellectual & Developmental Disability. Jul 10, 2009;24(1):7-26. [CrossRef]
    21. Small R, Taft AJ, Brown SJ. The power of social connection and support in improving health: lessons from social support interventions with childbearing women. BMC Public Health. 2011;11(Suppl 5):S4. [CrossRef]
    22. Scheiwe A, Hardy R, Watt R. Four-year follow-up of a randomized controlled trial of a social support intervention on infant feeding practices. Maternal and Child Nutrition. 2010;6(4):328-337. [CrossRef]
    23. Grace R, Kemp L, Barnes J, Elcombe E, Knight J, Baird K, et al. Community Volunteer Support for Families With Young Children: Protocol for the Volunteer Family Connect Randomized Controlled Trial. JMIR Res Protoc. Jul 16, 2018;7(7):e10000. [FREE Full text] [CrossRef] [Medline]
    24. Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. May 2009;62(5):464-475. [CrossRef] [Medline]
    25. Grace R, Baird K, Kemp L, Meyer-Tucker J, O'Loughlin G, Behrend Z, et al. Community volunteer home visiting to support the engagement of vulnerable families with early childhood services. In: Dublin, Ireland, September. 2016. Presented at: European Early Childhood Education Research Association (EECERA) Conference; September 6-8, 2010; Dublin, Ireland.
    26. Gibaud-Wallston J, Wandersman L. Development and utility of the Parenting Sense of Competency Scale. 1978. Presented at: 86th Annual Convention of the American Psychological Association; 1978; Toronto, Canada. [CrossRef]
    27. Zubrick S, Smith G, Nicholson J, Sanson A, Jackiewicz T. Parenting and families in Australia. 2008. URL: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1703269 [accessed 2019-09-09]
    28. Cutrona C, Russell D. The provision of social relationships and adaptation to stress. In: Jones WH, Perlman D, editors. Advances in Personal Relationships. Greenwich, CT. JAI Press; 1987:37-67.
    29. Ware J, Kosinski M, Keller S. SF-12: How to score the SF-12 Physical and Mental Health Summary Scales. Boston, MA. QualityMetric Incorporated, New England Medical Center; 1998.
    30. Howie JG, Heaney DJ, Maxwell M, Walker JJ. A comparison of a Patient Enablement Instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Family Practice. Apr 01, 1998;15(2):165-171. [CrossRef]
    31. Miller S, Duncan B. The Outcome and Session Rating Scales: Administration and scoring manuals. Chicago, IL. Institute of the Study of Therapeutic Change; 2000:A.
    32. Gallimore R, Weisner TS, Bernheimer LP, Guthrie D, Nihira K. Family responses to young children with developmental delays: accommodation activity in ecological and cultural context. Am J Ment Retard. Sep 1993;98(2):185-206. [Medline]
    33. Oldershaw L. A National Survey of Parents of Young Children: Executive Summary: Invest in Kids. Toronto, Ontario. Invest in Kids; 2002.
    34. West B, Welch K, Galecki A. Linear Mixed Models: A Practical Guide Using Statistical Software. London, UK. Chapman and Hall/CRC Press; 2014:A.
    35. Boag-Munroe G, Evangelou M. From hard to reach to how to reach: A systematic review of the literature on hard-to-reach families. Research Papers in Education. Apr 2012;27(2):209-239. [CrossRef]
    36. Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, et al. A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. J Clin Epidemiol. May 2009;62(5):464-475. [CrossRef] [Medline]

    ‎
    ES: effect size
    PRECIS: Pragmatic Explanatory Continuum Indicator Summary
    RCT: randomized controlled trial
    SPS: Social Provision Scale

    Edited by G Eysenbach; submitted 05.12.18; peer-reviewed by A Teo, K Fitzner; comments to author 14.02.19; revised version received 10.04.19; accepted 19.07.19; published 21.11.19.

    Copyright

    ©Rebekah Lorraine Grace, Kelly Baird, Emma Elcombe, Vana Webster, Jacqueline Barnes, Lynn Kemp. Originally published in JMIR Pediatrics and Parenting (http://pediatrics.jmir.org), 21.11.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on http://pediatrics.jmir.org, as well as this copyright and license information must be included.