This paper is in the following e-collection/theme issue:

Viewpoint and Opinions on Technology and Innovation in Public Health (50) Electronic/Mobile Data Capture, Internet-based Survey & Research Methodology (832) Research Instruments, Questionnaires, and Tools (576) Methods and New Tools in Mental Health Research (454)

Published on in Vol 9 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48138, first published .
Reconsidering the Use of Population Health Surveys for Monitoring of Mental Health

Reconsidering the Use of Population Health Surveys for Monitoring of Mental Health

Reconsidering the Use of Population Health Surveys for Monitoring of Mental Health

Authors of this article:

Jorge Arias de la Torre1, 2, 3 Author Orcid Image ;   Gemma Vilagut2, 4 Author Orcid Image ;   Amy Ronaldson5 Author Orcid Image ;   Ioannis Bakolis5 Author Orcid Image ;   Alex Dregan5 Author Orcid Image ;   Fernando Navarro-Mateu2 Author Orcid Image ;   Katherine Pérez2, 6, 7 Author Orcid Image ;   Anna Szücs8 Author Orcid Image ;   Xavier Bartoll-Roca6, 7 Author Orcid Image ;   Antonio J Molina2, 3 Author Orcid Image ;   Matilde Elices9 Author Orcid Image ;   Víctor Pérez-Solá9, 10 Author Orcid Image ;   Vicente Martín2, 3 Author Orcid Image ;   Antoni Serrano-Blanco2, 11 Author Orcid Image ;   Jose M Valderas12 Author Orcid Image ;   Jordi Alonso2, 4, 13 Author Orcid Image
Article Authors Cited by (1) Tweetations (4) Metrics

    Viewpoint

    1Care in Long Term Conditions Research Division, King's College London, London, United Kingdom

    2Centro de Investigación Biomédica en Red de Epidemiología y Salud Pública (CIBERESP), Instituto de Salud Carlos III, Madrid, Spain

    3Department of Biomedical Sciences, Universidad de León, León, Spain

    4Health Services Research Group, Hospital del Mar Medical Research Institute (IMIM), Barcelona, Spain

    5Institute of Psychiatry, Psychology, and Neuroscience (IoPPN), King's College London, London, United Kingdom

    6Agència de Salut Pública de Barcelona (ASPB), Barcelona, Spain

    7Institut d’Investigació Biomèdica Sant Pau (IIB SANT PAU), Barcelona, Spain

    8Department of Medicine, National University of Singapore (NUS), Singapore, Singapore

    9Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain

    10Hospital del Mar Medical Research Institute (IMIM), Barcelona, Spain

    11Institut de Recerca Sant Joan de Déu, Parc Sanitari Sant Joan de Déu, Barcelona, Spain

    12University of Exeter, Exeter, United Kingdom

    13Department of Medical and Life Sciences, Universitat Pompeu Fabra (UPF), Barcelona, Spain

    *these authors contributed equally

    Corresponding Author:

    Jose M Valderas, Prof Dr, PhD

    University of Exeter

    Magdalen Road, Smeall Building

    Exeter, EX12LU

    United Kingdom

    Phone: 44 6772 3874

    Email: jmvalderas@nus.edu.sg


    Monitoring of the mental health status of the population and assessment of its determinants are 2 of the most relevant pillars of public mental health, and data from population health surveys could be instrumental to support them. Although these surveys could be an important and suitable resource for these purposes, due to different limitations and challenges, they are often relegated to the background behind other data sources, such as electronic health records. These limitations and challenges include those related to measurement properties and cross-cultural validity of the tools used for the assessment of mental disorders, their degree of representativeness, and possible difficulties in the linkage with other data sources. Successfully addressing these limitations could significantly increase the potential of health surveys in the monitoring of mental disorders and ultimately maximize the impact of the relevant policies to reduce their burden at the population level. The widespread use of data from population health surveys, ideally linked to electronic health records data, would enhance the quality of the information available for research, public mental health decision-making, and ultimately addressing the growing burden of mental disorders.

    JMIR Public Health Surveill 2023;9:e48138

    doi:10.2196/48138

    Keywords

    mental health; public heath; burden; health surveys; monitoring; status; data collection; electronic health record; challenges; assessment tool; population; population health survey 


    In line with the motto of World Mental Health Day on October 10, 2022, “Make Mental Health and Well-Being for All a Global Priority,” mental health has become a public health and research priority in different countries worldwide. In the United States and the United Kingdom, for example, the White House and the UK Health Security Agency have included mental health as one of its corporate priority areas on their health and research strategies [1,2]. Such prioritization processes depend on the availability of data and on the quality of the evidence for a specific context and period. However, not all the data are considered equally relevant for this prioritization, and the evidence derived from population health surveys is often considered to be of lower quality than the evidence from other data sources, such as electronic health records (EHRs).

    Population health surveys are observational studies designed for research and public health purposes, aimed to obtain a representation of the distribution of different health conditions and the association of this distribution with sociodemographic, lifestyle, and other factors in well-defined populations. Since the second half of the previous century, these surveys have been carried out in different countries worldwide (eg, the National Health Interview Survey [NHIS] in the United States since 1957 [3] and the Health Survey for England in the United Kingdom since 1991 [4]). Due to their population-based nature (ie, based on representative as opposed to convenience sampling), data from these surveys may constitute a helpful resource to determine the burden of different mental health problems in the community, to identify vulnerable populations or population groups, and to inform the planning of health care resources and the development of health policies and targeted preventive measures [5]. Additionally, it must be highlighted that individual-level data from multiple health surveys worldwide, particularly from middle- and high-income countries, are publicly available for researchers to access and use (eg, data from the NHIS [3] or the National Health and Nutrition Examination Survey in the United States [6] and data from the European Health Interview Survey [EHIS] [7] or the European Social survey in Europe [8]). Some examples of the use of data from population health surveys for these purposes include the use of the data from the World Mental Health Surveys as a primary source to calculate the prevalence of major depression internationally [9], the identification of differences in depression among religious groups in Europe using data from the European Social Survey [10], and monitoring of the mental health and suicide prevention reforms in Australia [11]. While the use of data from population health surveys has been successfully implemented for these purposes, these data need to meet certain requirements, including the use of valid and reliable measures for the assessment of mental disorders and the selection of representative samples.

    In this context, we propose that extending the use of data from population health surveys would have a considerable impact on improving the evidence base of public mental health decision-making and, hence, could be instrumental in reducing the growing burden of mental disorders in the community.


    Monitoring of the mental health status of the population and assessment of its determinants (eg, sociodemographic factors, lifestyle habits, and use of health services) are 2 of the pillars of public mental health [12-14], and the use of harmonized data from multiple sources could be instrumental to support them.

    If the quality of the data could be guaranteed, the monitoring of mental health at the population level should be based on all the available data. For example, the Global Burden of Disease study integrates data from several sources, including data from more than 65,000 household health surveys and 87,000 medical records [15]. Although this can be considered the ideal scenario and there is growing interest on the data from population health surveys, particularly due to their potential to reach different population groups with low accessibility by using digital surveys, these data have been used less frequently than data from EHRs for monitoring and informing public mental health decision-making [16,17]. This is the case in several countries, such as Italy and the Netherlands, where EHRs have been used, for example, to monitor the impact of the COVID-19 pandemic on the mental health of the general population [18] and to monitor mental health conditions in children [19], respectively.

    One controversial aspect related to the use of data from population health surveys for the monitoring of mental health is the type of mental health measures included within them. Population health surveys commonly include self-reported measures (eg, the 8-item version of the Patient Health Questionnaire) that are considered less valid and reliable than clinical interviews. However, it must be highlighted that, in contrast with other medical conditions, and because of the subjective and self-reported nature of most of the symptoms of mental disorders [20,21], self-reported tools (eg, the 8-item version of the Patient Health Questionnaire) represent valid and reliable measures at the population level (group or aggregate level) and, hence, can be used for timely monitoring and identification of (vulnerable) groups of interest.

    Timely assessment and identification of factors related to mental disorders is another strength of the data captured by population health surveys. These surveys usually include within their questionnaires very rich information about sociodemographic and environmental determinants (eg, education and air pollution) and lifestyle habits (eg, diet or physical activity), constituting a valuable resource to assess their potential relationship with mental health. One example of the use of data from population health surveys to assess sociodemographic determinants of mental health is the use of data from the second and third waves of the EHIS (EHIS-2 and EHIS-3, respectively) to identify differences by country in the prevalence of depression across 27 European countries (with a higher prevalence: 1.8 times higher in Germany and 1.5 times higher in Luxembourg relative to the rest of Europe) [22,23]. Additionally, some population health surveys capture data about the use of mental health services (eg, the number of primary care consultations during a specific time), which is a potentially useful resource to inform the planning of public mental health resources [13,24,25]. This information has been previously used to investigate the unmet need of mental health care [9,24] and is particularly relevant for assessing vulnerable population groups that usually have higher rates of mental disorders, lower access to these services or, due to their circumstances, do not use these services when needed (eg, people experiencing homelessness) [26].


    While the use of population health surveys is suitable for different public mental health purposes, in some cases, data from EHRs could be a better option due to their potentially higher completeness and representativeness, the inclusion of richer relevant clinical data, and the possibility of following up with their participants over time (Table 1).

    Table 1. General characteristics of population health surveys and electronic health records (EHRs).

    		Population health surveysEHRs
    Population includedGeneral populationClinical population
    RepresentativenessHousehold samples to quota samplesUsually public providers
    Type of designUsually cross-sectionalLongitudinal
    Assessment of mental disordersUsually self-reportedUsually diagnostic codes
    Range of mental disorders usually consideredLimitedWide
    Other relevant variablesSociodemographic factors, lifestyle habits, and use of health servicesOnly clinical variables
    CostLowHigh

    One advantage that EHRs have over population health surveys is their potentially higher external validity. In contrast with surveys, which are usually carried out in samples with different degrees of representativeness, data from EHRs are more likely to include entire populations, such as the Hospital Episodes Statistics in England, in which more than 99% of attendees of mental health services from the National Health Service of the United Kingdom are captured [27]. Besides, data from EHRs usually capture high-quality clinical information, such as information about diagnostics (eg, International Classification of Diseases [ICD] codes), treatments (eg, prescribed medication), and other clinical aspects of care (eg, the number of consultations in a specific service), positioning them as the most suitable alternative for the assessment of the use of mental health services and to inform their planning [16,17.24]. Paradoxically, it should be noted that despite the quality of the data from EHRs (particularly to capture severe mental disorders), medical records are not designed for research purposes and focus on clinical populations (ie, not in the general population), thus limiting their generalizability to the general population and even more so to vulnerable population groups less likely to access these services [26]. Additionally, data from EHRs are limited by data capturing systems. However, given the potential differences in codification systems (eg, mental disorders codified using different ICD versions [21]) and across studies, achieving semantic interoperability is a key aspect to consider when leveraging data across multiple data sets [28]. As a consequence, certain relevant outcomes (eg, drug abuse) may be poorly documented and need to be validated for research, or they reach only public mental health service users, thus limiting their generalizability to the growing population groups using private health care services.

    Another advantage of EHRs over population health surveys is the possibility of long-term follow-up of participants. While population health surveys are often cross-sectional and anonymous (or anonymized) and participants cannot be followed up over time, the inclusion within EHRs of variables that facilitate the identification of participants and date variables (eg, dates of admission or follow-up consultations) make it possible to follow up with them over time. This is particularly important for correct estimation of the incidence of different health problems, the rates of recovery or relapse of some disorders over time, or the impact on mental health over time on different factors and the establishment inferences about potential causal associations [29]. However, there is an increasing interest in longitudinal surveys, in panel data with repeated assessments of the same individuals over time (eg, the British Cohort Study in the United Kingdom) [30,31], and in the inclusion of variables within the survey questionnaires that allow the follow-up of their participants over their life course (eg, participant identification codes). Thus, while EHRs could be considered currently more suitable for the timely assessment of clinical aspects of mental disorders, complementing their data with those from longitudinal surveys could enhance and enrich such assessment [32,33].

    Despite the abovementioned differences between the data from population health surveys and those from EHRs for monitoring of mental health, the complementary nature of these data sources must be highlighted. One successful example of their complementarity for the study of mental disorders has been reported in Denmark [32], where a shared identification number assigned to the individuals included in their information systems allows the linkage between population health surveys and EHRs [33]. The extensive linkage of individual data in the Danish population (including population health surveys; national records from hospitals, clinics, pharmacies, and death registries; and various other public and private data sources) synergistically enhanced the data’s overall quality for the assessment and monitoring of mental health conditions.


    Given all the potential benefits and applications indicated herein, widespread use of population health survey data (ideally linked with data from high-quality EHRs) could be helpful both for research purposes and to enhance decision-making in public mental health. Their widespread use might be achieved through not only the deployment of large, address-based probability-sampled surveys, similar to the deployment of the NHIS in the United States [3], but also encouraging individual research groups to join forces and carry out large-scale population health surveys or leverage the ones already implemented. However, in order to guarantee adequate and appropriate use of data from population health surveys, the development of a common usage framework and enhance their interoperability with other data sources remains essential.

    The development of a common usage framework of data from population health surveys must be in line with widely recognized initiatives such as the GRADE (Grading of Recommendations Assessment, Development and Evaluation) Evidence to Decision (EtD) framework [34], and will need to include unified protocols and guidelines for data collection, data analysis, and interpretation. For data collection, guidelines must consider both the tools used for monitoring of mental health and the minimum set of general domains (eg, socioeconomic and health service use) and specific factors (eg, educational level attained and number of primary care consultations during the last year) included within any population health survey.

    It should be also mentioned that the data collection process and the potential biases related to the representativeness of the data and their quality are also key challenges. The use of multistage sample designs and data verification techniques, for instance, would enhance the validity of data from population health surveys for both research and public mental health purposes. Additionally, for the correct interpretation of their results, a set of valid and reliable standard measures for the assessment of a broad range of mental disorders needs to be established, and their cross-cultural equivalence in different contexts should be ensured [10]. Therefore, the development of a common usage framework for the use of population health surveys for monitoring mental health would improve the suitability of their data for this purpose, enhance the comparability of their results and, consequently, increase their impact on public mental health decision-making.

    Finally, given the complementing advantages of the data from population health surveys and those from EHRs, another key step forward is to promote the interoperability of these 2 sources. However, to achieve interoperability, it will be necessary to systematically include variables within their data sets, which facilitate the identification and linkage of individuals across them while also ensuring anonymity. This linkage will be helpful to bring together their strengths and potentially improve the accuracy and relevance of both EHRs and health surveys as tools for monitoring mental health at the population level [35]. However, due to the substantial variation between countries in data protection laws, systematically including these types of variables could be challenging, particularly in the case of international surveys, such as the World Mental Health Surveys or EHIS. Hence, promoting the implementation of shared international regulations about data linkage and anonymization could be a helpful way to enhance the quality of administrative health data for monitoring the health status of the population.


    Monitoring of mental disorders at the population level, identifying their determinants, and determining their association with health care usage are key components for effective mental health prevention. Balancing their advantages and limitations, data from population health surveys are instrumental in addressing these challenges. However, to guarantee the adequate use of these data, there are different aspects that should be considered, including their specific limitations and challenges, the potential adoption of a common and shared framework for their use, and their interoperability with other data sources, such as EHRs, using shared identification variables. Promoting the use of linked data from population health surveys, EHRs, and other public and private data sources could enhance the quality of the information available for public mental health decision-making, particularly in middle- and high-income countries and ultimately improve the planning of mental health resources and maximize the impact of relevant policies to reduce the burden of mental disorders.

    Acknowledgments

    This work is partially funded by the University of Exeter, and CIBER (Centro de Investigación Biomédica en Red) Epidemiology and Public Health (grant ESP21PI05). This paper represents independent research partly funded by the National Institute for Health Research’s (NIHR’s) Biomedical Research Centre at South London and Maudsley NHS (National Health Service) Foundation Trust, and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health.

    Conflicts of Interest

    None declared.

    1. Prabhakar A, Rice S. White House Report on Mental Health Research Priorities. The White House. 2023. URL: https:/​/www.​whitehouse.gov/​wp-content/​uploads/​2023/​02/​White-House-Report-on-Mental-Health-Research-Priorities.​pdf [accessed 2023-03-18]
    2. PHE Strategy 2020 to 2025. Government of the United Kingdom. 2019. URL: https://www.gov.uk/government/publications/phe-strategy-2020-to-2025 [accessed 2023-10-25]
    3. Blewett LA, Dahlen HM, Spencer D, Rivera Drew JA, Lukanen E. Changes to the design of the National Health Interview Survey to support enhanced monitoring of health reform impacts at the state level. Am J Public Health. Nov 2016;106(11):1961-1966. [CrossRef]
    4. Mindell J, Biddulph JP, Hirani V, Stamatakis E, Craig R, Nunn S, et al. Cohort profile: the health survey for England. Int J Epidemiol. Dec 09, 2012;41(6):1585-1593. [CrossRef] [Medline]
    5. Aromaa A, Koponen P, Tafforeau J, Vermeire C, HIS/HES Core Group. Evaluation of health interview surveys and health examination surveys in the European Union. Eur J Public Health. Sep 2003;13(3 Suppl):67-72. [CrossRef] [Medline]
    6. Seeman T, Merkin SS, Crimmins E, Koretz B, Charette S, Karlamangla A. Education, income and ethnic differences in cumulative biological risk profiles in a national sample of US adults: NHANES III (1988-1994). Soc Sci Med. Jan 2008;66(1):72-87. [FREE Full text] [CrossRef] [Medline]
    7. Arias de la Torre J, Vilagut G, Ronaldson A, Valderas JM, Bakolis I, Dregan A, et al. Reliability and cross-country equivalence of the 8-item version of the Patient Health Questionnaire (PHQ-8) for the assessment of depression: results from 27 countries in Europe. Lancet Reg Health Eur. Aug 2023;31:100659. [FREE Full text] [CrossRef] [Medline]
    8. Huijts T, Stornes P, Eikemo T, Bambra C, HiNews Consortium. Prevalence of physical and mental non-communicable diseases in Europe: findings from the European Social Survey (2014) special module on the social determinants of health. Eur J Public Health. Feb 01, 2017;27(suppl_1):8-13. [CrossRef] [Medline]
    9. Demyttenaere K, Bruffaerts R, Posada-Villa J, Gasquet I, Kovess V, Lepine JP, et al. WHO World Mental Health Survey Consortium. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. JAMA. Jun 02, 2004;291(21):2581-2590. [CrossRef] [Medline]
    10. Schnittker J. Religion, social integration, and depression in Europe: Evidence from the European Social Survey. Soc Sci Med. Dec 2020;267:112376. [CrossRef] [Medline]
    11. Monitoring mental health and suicide prevention reform: national report 2019. National Mental Health Commission (Australia). 2019. URL: https://apo.org.au/sites/default/files/resource-files/2019-09/apo-nid260121.pdf [accessed 2022-10-04]
    12. Eaton WW. Public Mental Health. New York, NY. Oxford University Press; 2012.
    13. Andrews G, Issakidis C, Sanderson K, Corry J, Lapsley H. Utilising survey data to inform public policy: comparison of the cost-effectiveness of treatment of ten mental disorders. Br J Psychiatry. Jun 2004;184:526-533. [CrossRef] [Medline]
    14. Wahlbeck K. Public mental health: the time is ripe for translation of evidence into practice. World Psychiatry. Feb 2015;14(1):36-42. [FREE Full text] [CrossRef] [Medline]
    15. GBD 2019 Mental Disorders Collaborators. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Psychiatry. Feb 2022;9(2):137-150. [FREE Full text] [CrossRef] [Medline]
    16. Knapp M, Wong G. Economics and mental health: the current scenario. World Psychiatry. Feb 10, 2020;19(1):3-14. [FREE Full text] [CrossRef] [Medline]
    17. Jha AK. The promise of electronic records: around the corner or down the road? JAMA. Aug 24, 2011;306(8):880-881. [CrossRef] [Medline]
    18. Gualano MR, Lo Moro G, Voglino G, Bert F, Siliquini R. Monitoring the impact of COVID-19 pandemic on mental health: a public health challenge? Reflection on Italian data. Soc Psychiatry Psychiatr Epidemiol. Jan 2021;56(1):165-167. [FREE Full text] [CrossRef] [Medline]
    19. Koning NR, Büchner FL, van den Berg AW, Choi SYA, Leeuwenburgh NA, Paijmans IJM, et al. The usefulness of electronic health records from preventive youth healthcare in the recognition of child mental health problems. Front Public Health. May 31, 2021;9:658240. [FREE Full text] [CrossRef] [Medline]
    20. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. Virginia. American Psychiatric Association; 2013.
    21. Reed GM, First MB, Kogan CS, Hyman SE, Gureje O, Gaebel W, et al. Innovations and changes in the ICD-11 classification of mental, behavioural and neurodevelopmental disorders. World Psychiatry. Feb 02, 2019;18(1):3-19. [FREE Full text] [CrossRef] [Medline]
    22. Arias-de la Torre J, Vilagut G, Ronaldson A, Serrano-Blanco A, Martín V, Peters M, et al. Prevalence and variability of current depressive disorder in 27 European countries: a population-based study. Lancet Public Health. Oct 2021;6(10):e729-e738. [FREE Full text] [CrossRef] [Medline]
    23. Arias-de la Torre J, Vilagut G, Ronaldson A, Bakolis I, Dregan A, Martín V, et al. Prevalence and variability of depressive symptoms in Europe: update using representative data from the second and third waves of the European Health Interview Survey (EHIS-2 and EHIS-3). Lancet Public Health. Nov 2023;8(11):e889-e898. [FREE Full text] [CrossRef] [Medline]
    24. Moran V, Suhrcke M, Ruiz-Castell M, Barré J, Huiart L. Investigating unmet need for healthcare using the European Health Interview Survey: a cross-sectional survey study of Luxembourg. BMJ Open. Aug 03, 2021;11(8):e048860. [FREE Full text] [CrossRef] [Medline]
    25. Kilbourne AM, Beck K, Spaeth-Rublee B, Ramanuj P, O'Brien RW, Tomoyasu N, et al. Measuring and improving the quality of mental health care: a global perspective. World Psychiatry. Feb 19, 2018;17(1):30-38. [FREE Full text] [CrossRef] [Medline]
    26. Arias-de la Torre J, Valderas JM, Benavides FG, Alonso J. Cardboard floor: about the barriers for social progression and their impact on the representativeness of epidemiological studies. J Epidemiol Community Health. Feb 22, 2021;75(2):105-106. [CrossRef] [Medline]
    27. Davis KAS, Bashford O, Jewell A, Shetty H, Stewart RJ, Sudlow CLM, et al. Using data linkage to electronic patient records to assess the validity of selected mental health diagnoses in English Hospital Episode Statistics (HES). PLoS One. Mar 26, 2018;13(3):e0195002. [FREE Full text] [CrossRef] [Medline]
    28. de Mello BH, Rigo SJ, da Costa CA, da Rosa Righi R, Donida B, Bez MR, et al. Semantic interoperability in health records standards: a systematic literature review. Health Technol (Berl). 2022;12(2):255-272. [FREE Full text] [CrossRef] [Medline]
    29. de Zwart PL, Jeronimus BF, de Jonge P. Empirical evidence for definitions of episode, remission, recovery, relapse and recurrence in depression: a systematic review. Epidemiol Psychiatr Sci. May 17, 2018;28(5):544-562. [CrossRef]
    30. Mcelroy E, Villadsen A, Patalay P, Goodman A, Richards M, Northstone K, et al. Socioeconomic and sex inequalities in parent-reported adolescent mental ill-health: Time trends in four British birth cohorts. OSF Preprints. Preprint posted online January 13, 2022. [CrossRef]
    31. Arias-de la Torre J, Ronaldson A, Prina M, Matcham F, Pinto Pereira SM, Hatch SL, et al. Depressive symptoms during early adulthood and the development of physical multimorbidity in the UK: an observational cohort study. Lancet Healthy Longev. Dec 2021;2(12):e801-e810. [CrossRef]
    32. Momen NC, Plana-Ripoll O, Agerbo E, Benros ME, Børglum AD, Christensen MK, et al. Association between mental disorders and subsequent medical conditions. N Engl J Med. Apr 30, 2020;382(18):1721-1731. [CrossRef]
    33. Momen NC, Lasgaard M, Weye N, Edwards J, McGrath J, Plana-Ripoll O. Representativeness of survey participants in relation to mental disorders: a linkage between national registers and a population-representative survey. Int J Popul Data Sci. Oct 19, 2022;7(4):1759. [FREE Full text] [CrossRef] [Medline]
    34. Moberg J, Oxman AD, Rosenbaum S, Schünemann HJ, Guyatt G, Flottorp S, et al. GRADE Working Group. The GRADE Evidence to Decision (EtD) framework for health system and public health decisions. Health Res Policy Syst. May 29, 2018;16(1):45. [FREE Full text] [CrossRef] [Medline]
    35. Arias de la Torre J, Ronaldson A, Valderas JM, Vilagut G, Serrano-Blanco A, Hatch SL, et al. Diagnostic promiscuity: the use of real-world data to study multimorbidity in mental health. Br J Psychiatry. May 2021;218(5):237-239. [CrossRef] [Medline]

    ‎
    EHIS: European Health Interview Survey
    EHIS-2: second wave of the European Health Interview Survey
    EHIS-3: third wave of the European Health Interview Survey
    EHR: electronic health record
    EtD: Evidence to Decision
    GRADE: Grading of Recommendations Assessment, Development and Evaluation
    ICD: International Classification of Diseases
    NHIS: National Health Interview Survey

    Edited by A Mavragani, T Sanchez; submitted 12.04.23; peer-reviewed by N Robles, J Black, E Sükei; comments to author 07.08.23; revised version received 18.08.23; accepted 26.09.23; published 23.11.23.

    Copyright

    ©Jorge Arias de la Torre, Gemma Vilagut, Amy Ronaldson, Ioannis Bakolis, Alex Dregan, Fernando Navarro-Mateu, Katherine Pérez, Anna Szücs, Xavier Bartoll-Roca, Antonio J Molina, Matilde Elices, Víctor Pérez-Solá, Vicente Martín, Antoni Serrano-Blanco, Jose M Valderas, Jordi Alonso. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 23.11.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.