Published on in Vol 6, No 4 (2020): Oct-Dec

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/15524, first published .
An Interactive Text Message Survey as a Novel Assessment for Bedtime Routines in Public Health Research: Observational Study

An Interactive Text Message Survey as a Novel Assessment for Bedtime Routines in Public Health Research: Observational Study

An Interactive Text Message Survey as a Novel Assessment for Bedtime Routines in Public Health Research: Observational Study

Original Paper

1University of Manchester, Manchester, United Kingdom

2University of Aberdeen, Aberdeen, United Kingdom

3University of Cambridge, Cambridge, United Kingdom

Corresponding Author:

George Kitsaras, BSc, MPH, MSc, PhD, CPsychol

University of Manchester

Dental Health Unit

Williams House Manchester Science Park

Manchester, M15 6SE

United Kingdom

Phone: 44 01612261211

Email: georgios.kitsaras@manchester.ac.uk


Background: Traditional research approaches, especially questionnaires and paper-based assessments, limit in-depth understanding of the fluid dynamic processes associated with child well-being and development. This includes bedtime routine activities such as toothbrushing and reading a book before bed. The increase in innovative digital technologies alongside greater use and familiarity among the public creates unique opportunities to use these technical developments in research.

Objective: This study aimed to (1) examine the best way of assessing bedtime routines in families and develop an automated, interactive, text message survey assessment delivered directly to participants’ mobile phones and (2) test the assessment within a predominately deprived sociodemographic sample to explore retention, uptake, feedback, and effectiveness.

Methods: A public and patient involvement project showed clear preference for interactive text surveys regarding bedtime routines. The developed interactive text survey included questions on bedtime routine activities and was delivered for seven consecutive nights to participating parents’ mobile phones. A total of 200 parents participated. Apart from the completion of the text survey, feedback was provided by participants, and data on response, completion, and retention rates were captured.

Results: There was a high retention rate (185/200, 92.5%), and the response rate was high (160/185, 86.5%). In total, 114 participants provided anonymized feedback. Only a small percentage (5/114, 4.4%) of participants reported problems associated with completing the assessment. The majority (99/114, 86.8%) of participants enjoyed their participation in the study, with an average satisfaction score of 4.6 out of 5.

Conclusions: This study demonstrated the potential of deploying SMS text message–based surveys to capture and quantify real-time information on recurrent dynamic processes in public health research. Changes and adaptations based on recommendations are crucial next steps in further exploring the diagnostic and potential intervention properties of text survey and text messaging approaches.

JMIR Public Health Surveill 2020;6(4):e15524

doi:10.2196/15524

Keywords



Background

Capturing high quality and quantity of data is the cornerstone of every successful research project. Most research studies, especially those focusing on behavioral, psychosocial, and wider public health research, use traditional approaches including paper-based questionnaires, interviews, and surveys [1]. These techniques can create barriers to participation for specific population groups, while increasing risk to the quality of data (ie, higher rates of drop out and lower response rates) [1-3]. Easier access, higher uptake, and better use of new technologies, especially mobile phones, create the potential of shifting a number of research-related activities away from traditional approaches [1-3]. In recognition of this shift, organizations around the globe, including the US Food and Drug Administration, recommend electronic capture of data for clinical trials, instead of traditional paper-based methods [4]. Moreover, research conducted by pharmaceutical companies, among others, involves considerable use of mobile-based technologies (37%) in clinical trials [1]. Finally, current trends in health care in the era of the rising P4 (predictive, preventive, personalized, and participatory) model demonstrate the need for innovative, cost-effective, and user-oriented approaches [5].

Currently, the use of mobile phones for communication and entertainment is very high, with approximately 93% of the population owning a mobile phone in the United Kingdom [5]. The use of text messages is also high, with an average of 100 text messages sent per mobile phone subscription per month in the United Kingdom [5]. Unlike many other new technologies, people from low socioeconomic backgrounds and varying ethnicities have similar access to mobile technology as the rest of the population [6]. Low income and minority groups not only show similar rates of using mobile phones but also report a higher percentage of text messaging than other groups [5,6]. Additionally, mobile phone use is the highest among less educated adults and those who rent or frequently change their address [7]. Therefore, in research, mobile phone–based text surveys may represent an important tool for accessing, with minimum effort and intrusiveness, a large number of participants, while obtaining high quality and quantity of data from individuals, including those in traditionally “hard to reach” groups.

Assessment of bedtime routines in families with young children represents an area where text surveys may be implemented in order to gain a better understanding of the fluid and dynamic processes involved. Bedtime routines have shown important associations with a variety of aspects of child development and well-being, especially quality of sleep, dental health, parental psychoemotional well-being, attitude toward learning, and cognitive development [8-15]. Despite evidence highlighting their importance, there is a clear lack of a reliable, flexible, innovative, and user-friendly method of assessment for bedtime routines [16,17].

The main approach when assessing bedtime routines has involved paper-based questionnaires and diaries [18]. Only few studies involved real-life capture of bedtime routines via video recording, possibly owing to the intrusiveness of this method and the associated ethical and legal implications [18]. When using paper-based questionnaires with a retrospective design, the possibility of recall and desirability bias is always present. With routines being incredibly variable and dynamic and with special consideration for intrusiveness and the likelihood of bias, it is important to approach the entire notion of bedtime routine assessment from a different angle. Broader research into families and children has utilized different methodological approaches, such as the ecological momentary assessment, that go some distance in addressing recall bias [19]. However, for most of these approaches, there is a lack of an interactive feature, limiting their dynamic scope.

The proposed novel perspective should use innovative user-friendly technologies that will allow for greater quantity and better quality of data on bedtime routines while minimizing intrusiveness and disruption to participants. Bedtime routines present an area of particular interest for this approach given their dynamic nature that necessitates real-time information collection. If this methodological approach functions in the context of this particular dynamic and repetitive behavior, the same approach can be used in a variety of other research areas.

Objectives

This study aimed to (1) examine the best way of assessing bedtime routines in families and develop an automated, interactive, text message survey assessment delivered directly to participants’ mobile phones and (2) test the assessment within a predominately deprived sociodemographic sample to explore retention, uptake, feedback, and effectiveness.


Overall Process

The study followed a series of steps, as presented in Figure 1. All steps were necessary since they informed the next stage of the study with important findings mapping back to the two main objectives.

Figure 1. Stepped approach for developing the intervention.
View this figure

Public and Patient Involvement

Public and patient involvement (PPI) work, prior to beginning the overall study, was completed during two separate visits to two preschool centers. The targeted sample for the PPI work was parents with children between the ages of 3 and 5 years. During the visits, a total of 15 mothers (no fathers attended the centers during the PPI work) with their children were approached. All mothers approached agreed to take part in the session, and mothers were approached at random. The mothers were asked questions (on a one-to-one basis) about their views on the best way of assessing their children’s bedtime routines as a recurrent dynamic health-related behavior. As compensation for their time, each family received toothpaste and toothbrushes for both adults and children, and a 2-minute toothbrushing timer. Multimedia Appendix 1 presents an overview of the questions and results from the PPI session.

Development of an Interactive Text Survey

Following the completion of the PPI work, an interactive text survey was chosen as the most appropriate method for assessing bedtime routines in families with young children. In total, three readily available software and online platforms were used for the design of the study. Figure 2 presents an overview of how the platforms worked alongside one another to produce the intervention.

Figure 2. Readily available platforms used in redesigning the text-survey.
View this figure

Using the idea of an ideal bedtime routine, as described by previous studies [18] and expert opinions, the assessment of bedtime routines focused on the following five target areas: (1) consistency (determined as a child going to bed within a space of an hour every night), (2) tooth brushing, (3) snacks/drinks before bed, (4) use of electronic devices before bed, and (5) book reading. These areas have been consistently included in bedtime routine studies as the most important for child well-being and development [18].

Parents predetermined the exact time they would prefer to receive the text survey; however, there was an option to delay the completion of the survey by 30 minutes or 1 hour, or opt out for that night. Detailed instructions on the appropriate answers for each question were provided using examples of accepted answers, and if someone responded incorrectly, a clarification text was sent to them immediately to help them with their responses. Failure to reply following the instructions in two consecutive attempts led to the end of the survey for that night.

The questions in the interactive text survey were both open-ended and closed. Filter questions (yes/no) led participants to different types of questions. Depending on their replies in filter questions, parents received different responses to strengthen the interactive features of the assessment. Overall, the minimum number of questions to answer each night was eight and the maximum number was 10. All participants were entered into the system via an electronic platform using unique IDs, and all data were managed through secure, university-based, password-protected computers. Table 1 presents a summary of the key characteristics of the interactive text survey as delivered to participants. The overall structure of the interactive text survey is presented in Multimedia Appendix 2.

Table 1. Characteristics of the interactive text survey developed following public and patient involvement work.
CharacteristicInteractive text survey value
Minimum number of questions8
Maximum number of questions10
Open questionsYes
Closed questionsYes
Question on current parental moodYes
Question on self-assessed bedtime routineYes
Questions on key bedtime routine activities (eg, tooth brushing)Yes
Opportunity to delay completionYes
Opportunity to opt out on a nightly basisYes
Predetermined time to receive assessmentYes
Number of nights receiving assessment7
Average completion time (min)2
Activation of a short code for free-of-charge repliesNo

The research team opted out from activating a “short code” that would have allowed participants to reply free of charge. The charge that applied to each reply was made clear to participants at the beginning of the study. The charge per text message reply was dependent upon the mobile phone contract and the provider, with most providers in the United Kingdom providing free unlimited text messages as part of their normal packages [5]. For those who do not have a mobile phone monthly package, a simple text message costs between 1 pence (p) and 10 p per text message depending on the provider [5].

Test Study

Recruitment and Eligibility

Recruitment took place between February and July 2018. Participants were approached during their routine appointments in general dental practices. The exclusion criteria were as follows: (1) not having English proficiency, (2) not owning a mobile phone, and (3) having only children under the age of 3 or over the age of 7 years. Participants were informed about the requirements of the study and asked to provide consent. During recruitment, each participant was informed about the compensation that they would receive at the end of the study in the form of online shopping vouchers. The compensation for their time in the study was a maximum of £10. Early withdrawal affected the amount of compensation.

Sample

In total, 200 parents were recruited. Parents had a mean age of 34.6 years (SD 5.01), with the youngest being 25 years of age and the oldest being 46 years of age. The vast majority of participants were female, with only 12.0% (24/200) male. Most families had only one child (130/200, 65.0%), with 5.0% (10/200) of families having three or more children. All the children were between the ages of 3 and 7 years. In total, 48.0% (96/200) of the sample had a white ethnic background, 39.5% (79/200) had an Asian/British-Asian ethnic background, and 12.5% (25/200) had a Black/Black British/Caribbean ethnic background. The vast majority (156/200, 78.0%) of participants lived in deprived areas. Deprivation was determined using the index of multiple deprivation (IMD), where higher scores (and quintiles) reflect higher deprivation. For the study, participants had an average IMD score of 41.83 (SD 16.43) and a maximum IMD score of 79.65, which was double the threshold for the fifth IMD quintile.

Data Collection

All participants received the interactive text survey on their mobile phones at a predetermined time for a total of seven consecutive nights. As described above, the assessment focused on their bedtime routine activities with a combination of open and closed questions. Feedback was collected using an automated feedback system utilizing the text survey. This system, like the bedtime routine assessment, included both open and closed questions for the experience of each parent. Finally, data relating to uptake, response, and retention rates were collected through an electronic platform (TextIt).

Data Analysis

All data were transferred and coded in SPSS (IBM SPSS Statistics for Macintosh, Version 25.0) for analysis. Data analyses focused on (1) bedtime routine activities with data collected from the interactive text survey, (2) feedback data regarding user experience, and (3) uptake, retention, and response rate information.

Ethical Approval and Consent to Participate

The study in its entirety, including consent forms and all study materials, was previously approved by the Health Research Authority (Integrated Research Application System [IRAS]; ID: 235385; Tyre and Wear South Committee). All participants accepted anonymized use of their data for further analyses and subsequent publication during consent. Written consent was obtained during recruitment. We obtained consent to publish from the participants (or legal parents or guardians for children) to report individual patient data.

Availability of Data and Materials

The data sets used and/or analyzed in this study are available from the corresponding author on reasonable request.


Uptake, Retention, and Response Rates

Of the 200 participants, 185 completed data collection, resulting in an overall 92.5% retention rate over the 7-day period. A total of 11 participants failed to reply to all of the text surveys, and only four participants opted out of the study after providing replies to at least one night of text surveys using the automated opt-out function.

From the 185 people who completed data collection, there was an average response rate across all nights of 87.0% (161/185). There was a steady decrease in the response rate per night during the study, with the first three nights showing response rates over 90%, while the last two nights of the assessment showed response rates below 80%. This may reflect fatigue with the assessment over time. On average, participants replied to at least 5.5 nights of text surveys. The majority (80/185) of participants replied to six nights, while 62 participants replied to all seven nights, 39 replied to five nights, and four replied to only four nights of the text survey. When participants received the text survey and engaged by replying to it, they completed the full survey. Once a participant started the assessment, he/she continued until the last question, resulting in a 100% completion rate per survey, with no missing data associated with noncompletion. Table 2 provides an overview of the completion of the assessment each night.

Table 2. Overview of assessment completion each night.
NightCompletion value (N=185), n (%)
1176 (95.1%)
2174 (94.1%)
3169 (91.4%)
4164 (88.6%)
5157 (84.9%)
6146 (78.9%)
7138 (74.6%)

Feedback From Users

In total, 114 participants provided anonymized feedback. The majority (99/114, 86.8%) of participants enjoyed their participation in the study, with an average satisfaction score of 4.6 out of 5 and no score below 3 based on the automated feedback system we deployed at the end of the study. The vast majority (107/114, 93.8%) of participants reported high satisfaction scores in receiving and replying to the text messages for seven nights. The average satisfaction score was 4.3 out of 5, and again, no score was below 3. Only a small number (5/114, 4.4%) of participants reported problems caused to their bedtime routines from receiving and replying to the text messages every night for seven nights in total. The low number of people who reported problems may highlight the limited intrusiveness of text messages in assessing behaviors. Participants found the text messages and the questions asked through them to be extremely easy to understand, with an average satisfaction score of 4.9 out of 5. All participants would recommend using text surveys for assessing bedtime routines in future research. The majority (63/114, 55.3%) of those who provided feedback supported the development of a bedtime routine text message support system for those who struggle with their bedtime routines. Finally, a marginal majority (59/114, 51.8%) of participants reported being helped by the nightly text messages in remembering what to do during their bedtime routines.

Effectiveness in Assessing Dynamic Behaviors

During the study, participants replied to a total of 1125 text surveys, generating 9157 unique data points. On average, each participant generated 50 unique data points by replying to an average of nine questions per night during the course of the study. The deployment of the interactive text survey allowed for a more in-depth observation of bedtime routine activities in families with young children. A small majority (95/185, 51.4%) of participants reported brushing their children’s teeth every night, while only a small percentage (2/185, 1.1%) reported never brushing teeth before bed. With regard to diet, 57.8% (107/185) of participants reported allowing food and/or drinks the hour before bed at some point during the week. A total of 24.9% (46/185) of participants read to their children every night of the week, 9.2% (17/185) never read or shared a book with their children during the course of the study, and 29.2% (54/185) read or shared a book with their children for at least half of the nights. Finally, with regard to the use of electronic devices the hour before bed, 13.5% (25/185) of parents allowed electronic devices to be used the hour before bed.


Principal Findings

Overall, the interactive text survey assessment of a recurrent dynamic behavior provided a large quantity and good quality of data on the targeted behavior. It managed to keep participants engaged throughout the duration of the study with limited drop out. Finally, the interactive text survey created a user-friendly nonintrusive experience for participants, as reflected in their feedback (Table 3).

Table 3. Key results of the study.
MetricValue, n (%) or score/number
Retention (N=200)185 (92.5%)
Response (overall) (N=185)161 (87.0%)
Overall feedback score (scale 0-5)4.6
Easiness of use score (scale 0-5)4.9
Reported problems to routines from receiving the assessment (N=114)5 (4.4%)
Recommended text surveys for future assessments (N=114)114 (100%)
Supported development of a text messaging bedtime routine intervention (N=114)63 (55.3%)
Average unique data points50

The benefits of administering an interactive text survey assessment for recurrent dynamic behaviors can be divided into the following three areas: (1) limiting recall bias, (2) securing higher volumes of data, and (3) providing a better experience for participants. Recall bias can have a potentially detrimental effect on research findings by either underestimating or overestimating the true effect of a given behavior [20]. Recall bias can be affected by a number of areas, with time elapsing between the targeted behavior and assessment of that behavior being one of the most prominent [21]. In traditional assessments, including questionnaires, with a retrospective approach (in some cases, up to a month after the targeted activity), recall bias has the potential to influence both the quality and quantity of collected data owing to the time lapsed [20]. In recurrent and dynamic behaviors, like bedtime routines, with a fluid nature, a narrow timeframe between the activity and assessment of the activity is crucial to be able to capture and investigate their intricate nature. With the development and utilization of approaches that capitalize on narrow timeframes, recall bias can potentially be eliminated.

As for the second area (securing high volumes of data), the deployment of the text survey assessment for bedtime routines led to a considerably higher response rate than with traditional questionnaires [22]. Additionally, once participants started answering the survey on a given night, they completed it without stopping midway or missing any of the questions. This resulted in an average of 50 unique data points. High response rates in conjunction with multiple data points over a short period of time resulted in wider flexibility when conducting further analyses. Finally, with respect to providing a better experience for participants, across all questions on the feedback form, most participants reported no issues and reported a high satisfaction rate. Moreover, when asked at the end of the study, every participant showed a clear preference for a text survey–style assessment against other measures, including questionnaires and video recordings. Across health-related research and intervention studies, there is considerable variation in retention rates, with some studies reporting retention rates as high as 97% and as low as 56% [23-25]. Approaches, such as interactive text surveys, should be further explored and utilized as an alternative method in achieving better user engagement and retention.

In this study, text surveys were used primarily for data collection as an alternative to traditional questionnaire and paper-based assessments for bedtime routines. As discussed, utilization of text surveys and text messages is not limited to data collection, with multiple other functionalities from recruitment to interventions [1,25]. Their increasing availability in conjunction with higher use of mobile phones across all age and demographic groups presents a great opportunity for harnessing their wide spectrum of applications in both research and clinical settings. Multiple organizations like the National Health Service (NHS) in the United Kingdom now deploy text messages and text surveys to contact and remind patients of their appointments and/or to gather feedback about services [26]. These examples showcase in practice how mobile phone–based text surveys and text messages can be used in a reciprocally beneficial relationship where service users or participants and organizations are mutually benefited. Solely for clinical applications, today’s demanding, dynamic, and highly variable health care needs present a great opportunity for mobile phone–based text messages given their cost effectiveness, high adaptability, and flexible format [27-29]. This opportunity is also relevant for pediatric populations given their clear preference for tailored, technology-based, and interactive programs such as mobile phone–based text messages and surveys [29].

Finally, medicine and health care as a whole are slowly but steadily moving to a personalized model of care, as shown by the recent P4 model [30,31]. This model emphasizes the importance of transforming the service from a reactive to a proactive one with regard to disease and care [32]. Even though the model is mainly focused on clinical and long-term conditions, including diabetes, cancer, and cardiovascular diseases, the same approach could possibly be used in a variety of health-related, well-being–related, and development-related behaviors. The P4 model of medicine and health care is driven by the evolution, expansion, and merging of the following three megatrends: (1) systems biology/systems medicine, (2) digital technologies for health care, and (3) consumer-driven health care [30]. Therefore, text message–based applications, including text surveys, can be active components in the era of P4 medicine and health care owing to their versatility, low cost per participant, ease of use, high personalization, and adaptation that transcends cultural, linguistic, and demographic boundaries.

Limitations

The utilization of a stepped approach in designing, refining, and redeveloping an interactive text survey helps to minimize its limitations. However, there are several areas where limitations are evident. One of the most important is with regard to the risk of bias, especially desirability bias. As with every assessment that relies on self-reported data, desirability bias cannot be fully excluded. Moreover, as highlighted by the comments made by several participants, despite attempting to only assess bedtime routines, the text survey might have acted as an unintended intervention, leading to changes in some family routines. This is not necessarily a negative limitation, since this type of feedback allowed for the consideration of intervening properties regarding text surveys and text messaging for bedtime routines. Finally, another limitation to consider concerns the lack of a reference measure for assessing bedtime routines alongside the utilization of the interactive text survey.

Recommendations

Despite the success of the approach, necessary changes and recommendations for future use are vital in further exploring the benefits of text surveys in assessing health-related behaviors. These changes can focus on both further improving user interaction with the system and maintaining an overall good user experience. Specific changes include (1) provision for a number to call when and if issues or difficulties arise during the completion of the text survey and (2) provision for free-of-charge replies by activating a “short code,” especially for research focusing on deprived socioeconomic areas and populations. Moreover, based on the feedback of some participants and on this particular area of research, it might be important to consider the development and examination of a text message–based bedtime routine intervention for achieving and sustaining better routines for families with young children.

Conclusion

The results of this study showed the potential for deploying text surveys within public health research as an attempt to capture real-time information on dynamic and highly variable recurrent behaviors that can have subsequent implications with regard to development and well-being. It also demonstrated that text surveys can be reliable alternatives for capturing data when compared with traditional methods or other technologies, possibly owing to their nonintrusiveness and generally easier user interface. Overall, text surveys and text messages are emerging as valuable alternative routes for capturing data and delivering interventions in wider public health research.

Acknowledgments

This study is part fulfillment for the requirement of completing a PhD in Dental Public Health at the Dental Health Unit, The University of Manchester. No additional funding was received with regard to the project described in the manuscript. The research team would like to thank all participating families. Moreover, the research team would like to thank all staff members and managers of the participating general dental practices for their unique contribution and support during recruitment.

Authors' Contributions

GK conceptualized and designed the study, organized and completed all recruitment and data collection processes, and wrote and submitted the manuscript. MG, JA, MPK, and IAP contributed to the conceptualization and design of the study, assisted during recruitment and data collection, were actively involved in data coding and analysis in accordance with their research expertise, and were involved in the drafting and critical review of the manuscript while offering invaluable continuous support throughout the process. GK, MG, JA, MPK, and IAP confirm that they have seen and approve the submission of the manuscript. They also state that they are accountable for all aspects of the work presented in the manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Public and patient involvement questions and results.

PDF File (Adobe PDF File), 158 KB

Multimedia Appendix 2

Branching flowchart for the text survey.

PDF File (Adobe PDF File), 267 KB

References

  1. von Niederhäusern B, Saccilotto R, Schädelin S, Ziesenitz V, Benkert P, Decker M, et al. Validity of mobile electronic data capture in clinical studies: a pilot study in a pediatric population. BMC Med Res Methodol 2017 Dec 08;17(1):163 [FREE Full text] [CrossRef] [Medline]
  2. Friend SH. App-enabled trial participation: Tectonic shift or tepid rumble? Sci Transl Med 2015 Jul 22;7(297):297ed10-297ed10 [FREE Full text] [CrossRef] [Medline]
  3. Dorsey ER, Venuto C, Venkataraman V, Harris DA, Kieburtz K. Novel methods and technologies for 21st-century clinical trials: a review. JAMA Neurol 2015 May 01;72(5):582-588 [FREE Full text] [CrossRef] [Medline]
  4. U.S. Department of Health Human Services FDA Center for Drug Evaluation Research, U.S. Department of Health Human Services FDA Center for Biologics Evaluation Research, U.S. Department of Health Human Services FDA Center for Devices Radiological Health. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual Life Outcomes 2006 Oct 11;4:79 [FREE Full text] [CrossRef] [Medline]
  5. Cape S, Rees J. Communications Market Report. London, UK: Office for Communications; Aug 04, 2016.
  6. Militello L, Kelly S, Melnyk B. Systematic review of text-messaging interventions to promote healthy behaviors in pediatric and adolescent populations: implications for clinical practice and research. Worldviews Evid Based Nurs 2012 Apr;9(2):66-77. [CrossRef] [Medline]
  7. Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009 Feb;36(2):165-173. [CrossRef] [Medline]
  8. Davies G, Bridgman C. Improving oral health among schoolchildren - which approach is best? Br Dent J 2011 Jan 22;210(2):59-61. [CrossRef] [Medline]
  9. Hale L, Berger LM, LeBourgeois MK, Brooks-Gunn J. Social and Demographic Predictors of Preschoolersʼ Bedtime Routines. Journal of Developmental & Behavioral Pediatrics 2009;30(5):394-402. [CrossRef]
  10. COUNCIL ON COMMUNICATIONS AND MEDIA. Media Use in School-Aged Children and Adolescents. Pediatrics 2016 Nov 21;138(5):e20162592 [FREE Full text] [CrossRef] [Medline]
  11. Kelly Y, Kelly J, Sacker A. Changes in bedtime schedules and behavioral difficulties in 7 year old children. Pediatrics 2013 Nov 14;132(5):e1184-e1193. [CrossRef] [Medline]
  12. Levine RS. Caries experience and bedtime consumption of sugar-sweetened food and drinks--a survey of 600 children. Community Dent Health 2001 Dec;18(4):228-231. [Medline]
  13. Mindell J, Leichman ES, DuMond C, Sadeh A. Sleep and Social-Emotional Development in Infants and Toddlers. J Clin Child Adolesc Psychol 2017;46(2):236-246. [CrossRef] [Medline]
  14. Sadeh A, Tikotzky L, Scher A. Parenting and infant sleep. Sleep Med Rev 2010 Apr;14(2):89-96. [CrossRef] [Medline]
  15. El-Sheikh M, Sadeh A. I. Sleep and development: introduction to the monograph. Monogr Soc Res Child Dev 2015 Mar;80(1):1-14. [CrossRef] [Medline]
  16. Kitsaras G, Goodwin M, Allan J, Kelly MP, Pretty IA. BMC Public Health 2018 Mar 21;18(1):386 [FREE Full text] [CrossRef] [Medline]
  17. Kitsaras G, Allan J, Pretty IA. Bedtime Routines Intervention for Children (BRIC) using an automated text messaging system for behaviour change: study protocol for an early phase study. Pilot Feasibility Stud 2020 Feb 6;6(1):14 [FREE Full text] [CrossRef] [Medline]
  18. Mindell JA, Williamson AA. Benefits of a bedtime routine in young children: Sleep, development, and beyond. Sleep Med Rev 2018 Aug;40:93-108 [FREE Full text] [CrossRef] [Medline]
  19. Smyth J, Heron K. Ecological Momentary Assessment (EMA) in Family Research. In: McHale S, Amato P, Booth A, editors. Emerging Methods in Family Research. National Symposium on Family Issues, vol 4. Cham: Springer; 2014:145-161.
  20. Althubaiti A. Information bias in health research: definition, pitfalls, and adjustment methods. JMDH 2016 May:211. [CrossRef]
  21. Kip KE, Cohen F, Cole SR, Wilhelmus KR, Patrick DL, Blair R, et al. Recall bias in a prospective cohort study of acute time-varying exposures. Journal of Clinical Epidemiology 2001 May;54(5):482-487. [CrossRef]
  22. Nulty DD. The adequacy of response rates to online and paper surveys: what can be done? Assessment & Evaluation in Higher Education 2008 Jun;33(3):301-314. [CrossRef]
  23. Zweben A, Fucito LM, O'Malley SS. Effective Strategies for Maintaining Research Participation in Clinical Trials. Drug Inf J 2009 Jul 30;43(4):459-467 [FREE Full text] [CrossRef] [Medline]
  24. Walters SJ, Bonacho Dos Anjos Henriques-Cadby I, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open 2017 Mar 20;7(3):e015276 [FREE Full text] [CrossRef] [Medline]
  25. Varma DS, Hart M, McIntyre DS, Kwiatkowski E, Cottler LB. A Research Protocol to Test the Effectiveness of Text Messaging and Reminder Calls to Increase Service Use Referrals in a Community Engagement Program. JMIR Res Protoc 2016 Jun 28;5(2):e133 [FREE Full text] [CrossRef] [Medline]
  26. Douglas J. Accessible Information Standard: Using email and text messages for communicating with patients. National Health Service. 2016 May 01.   URL: https://oxfordaasc.com/view/10.1093/acref/9780195301731.001.0001/acref-9780195301731-e-47561 [accessed 2020-12-15]
  27. Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R, Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst Rev 2013 Dec 05;7(12):CD007458 [FREE Full text] [CrossRef] [Medline]
  28. Leong KC, Chen WS, Leong KW, Mastura I, Mimi O, Sheikh MA, et al. The use of text messaging to improve attendance in primary care: a randomized controlled trial. Fam Pract 2006 Dec 11;23(6):699-705. [CrossRef] [Medline]
  29. Shapiro JR, Bauer S, Hamer RM, Kordy H, Ward D, Bulik CM. Use of text messaging for monitoring sugar-sweetened beverages, physical activity, and screen time in children: a pilot study. J Nutr Educ Behav 2008 Nov;40(6):385-391 [FREE Full text] [CrossRef] [Medline]
  30. Flores M, Glusman G, Brogaard K, Price ND, Hood L. P4 medicine: how systems medicine will transform the healthcare sector and society. Per Med 2013 Aug;10(6):565-576 [FREE Full text] [CrossRef] [Medline]
  31. Hood L, Auffray C. Participatory medicine: a driving force for revolutionizing healthcare. Genome Med 2013;5(12):110 [FREE Full text] [CrossRef] [Medline]
  32. Sagner M, McNeil A, Puska P, Auffray C, Price ND, Hood L, et al. The P4 Health Spectrum - A Predictive, Preventive, Personalized and Participatory Continuum for Promoting Healthspan. Prog Cardiovasc Dis 2017 Mar;59(5):506-521. [CrossRef] [Medline]


IMD: index of multiple deprivation
P4: predictive, preventive, personalized, and participatory
PPI: public and patient involvement


Edited by G Eysenbach; submitted 17.07.19; peer-reviewed by A Herbec, G Siapco, C Lammert, M George; comments to author 11.08.20; revised version received 10.09.20; accepted 27.09.20; published 21.12.20

Copyright

©George Kitsaras, Michaela Goodwin, Julia Allan, Michael Kelly, Iain Pretty. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 21.12.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.