With increasing computerisation in general practice, national primary care networks are mooted as sources of data for health services and population health research and planning. Existing data collection programs – MedicinesInsight, Improvement Foundation, Bettering the Evaluation and Care of Health (BEACH) – vary in purpose, governance, methodologies and tools. General practitioners (GPs) have significant roles as collectors, managers and users of electronic health record (EHR) data. They need to understand the challenges to their clinical and managerial roles and responsibilities.
The aim of this article is to examine the primary and secondary use of EHR data, identify challenges, discuss solutions and explore directions.
Representatives from existing programs, Medicare Locals, Local Health Districts and research networks held workshops on the scope, challenges and approaches to the quality and use of EHR data. Challenges included data quality, interoperability, fragmented governance, proprietary software, transparency, sustainability, competing ethical and privacy perspectives, and cognitive load on patients and clinicians. Proposed solutions included effective change management; transparent governance and management of intellectual property, data quality, security, ethical access, and privacy; common data models, metadata and tools; and patient/community engagement. Collaboration and common approaches to tools, platforms and governance are needed. Processes and structures must be transparent and acceptable to GPs.
General practice is the cornerstone of primary care in Australia. The computerisation of general practice has placed general practitioners (GPs) at the forefront of moves to use the pooled data they hold to improve the care of populations1,2 as well as individual patients through the development of a national shared record.3 The many, often competing, data collection programs that operate at national, regional and local levels can be confusing to GPs and their patients. This detracts from a core issue that arises from the fact that electronic data derived from patients now have use beyond the GP’s clinical record. The bottom line is that GPs require an understanding of data quality and governance and the implications for the GP as a clinician and manager.
Optimising patient-care processes and outcomes requires effective communication, coordination, teamwork and judicious use of information and communication technology:
- within a medical home4
- across the health ‘neighbourhood’ comprising other primary and secondary care services and providers.5,6
Governments7,8 and health professional organisations9,10 have recommended the effective use of electronic health records (EHRs), personal health records (PHRs) and electronic decision-support tools to collect, share and use good-quality information. This information should support the provision of safe, effective and coordinated care across ‘patient journeys’ and ‘care pathways’ in the health system.11–13 Routinely collected observational EHR data, aggregated in data repositories, are increasingly mined, linked and used for audit, continuous quality improvement in care, health service planning, epidemiological study and evaluation research, and for measuring and monitoring the quality of coordinated care of patients with chronic diseases.
Despite increasing research and development (R&D) in health informatics, and improved informatics capabilities supporting the extraction, linkage and use of EHR data in a number of countries,14–19 data quality metrics in primary care2 and hospital systems20 are not optimal. There is also a lack of mutual trust and respect among primary and secondary care clinicians, researchers and managers, which hinders optimal information sharing.21 Many existing tools that collect/extract data, and assess and manage data quality, are inconsistent. These tools are also not validated in a transparent manner within a robust data and clinical governance framework.20,22 Data management methods using ontologies to define properties and relationships among the concepts within the dataset can automate and improve data quality management and fitness for purpose.23,24
We aimed to facilitate a discourse, including a series of workshops, to scan existing R&D programs in this domain, identify potential issues and implications, discuss potential solutions, and explore future directions. While the focus was primary care, the discussions also included secondary care in the context of integration and coordinated care.
Participants included representatives from existing primary care data collection programs in Australia: Electronic Practice-Based Research Network (ePBRN), Melbourne East MonAsh GeNeral PracticE DaTabase (MAGNET), MedicineInsight, Improvement Foundation, Bettering the Evaluation and Care of Health (BEACH) and the Australian Institute of Health and Welfare (AIHW); and international participants (UK, Europe, Canada and US) at the 2014 North American Primary Care Research Group (NAPCRG) meeting.
The methods for this program included:
- a scanning and scoping workshop at the Primary Health Care Research and Information Service (PHCRIS) conference in Canberra in August 201425
- an issues, methods, quality and ‘potential for a national approach’ workshop at the University of New South Wales (UNSW) in Sydney in October 2014
- contextualisation of the Australian findings and perspectives at an international workshop held at the 2014 NAPCRG meeting in New York in November 2014.26
The workshops were facilitated, questions clarified and answers discussed prior to being recorded in the notes. The presentations and notes from the Australian workshops were reviewed and themes identified. Participants in the UNSW workshop also voted on a number of priorities discussed. Following the NAPCRG workshop, the outcomes and suggestions from both Australian workshops were further clarified and contextualised internationally with groups such as the International Medical Informatics Association’s (IMIA’s) Primary Care Informatics Working Group. Key themes were identified.
Outcomes of the workshops
Scanning of projects and issues from all three workshops highlighted much commonality and some differences in the approaches taken by the main EHR-based programs (Table 1).
Table 1. Summary of some existing Australian programs collecting and using primary care data
||Collection of patient-level EHR data
||National sample (target: 500 practices)
||Data governance at program level; RACGP ethics
||GRHANITE™ extraction tool
||www.nps.org.au/ about-us/ what-we-do/medicineinsight
(Note: POLAR evolved from MAGNET to collect patient-level data)
|ML‐based collection of practice-level EHR data with links to other services
Note: MLs now superseded by PHNs
|Data governance at program level; multiple ethics approvals
||Was using PEN-CAT extraction tool, but now using GRHANITE™ as POLAR
||www.med.monash.edu.au/ general-practice/ magnet
||Collection and linkage of patient-level EHR data from primary and secondary care datasets in IHN
||IHN = hospital, ambulatory care, community health and GP services
||Data governance at program level; LHD and UNSW ethics committees; planned: ML/LHD joint governance
||GRHANITE™ extraction and linkage tool; SQL/XML, SAS/SPSS, Semantic web tools
||http://cphce.unsw.edu.au/ research-streams/ primary-health-care-informatics
||Collection of practice-level EHR data
||Data governance at program level
||PEN-CAT extraction tool
||Specific, non-routinely collected patient-level data (not from EHR)
||Rotating sample of 1000 GPs from a national sampling frame
||Data governance at program level
||BEACH in-house tools
||http://sydney.edu.au/ medicine/ fmrc/ about/index.php
||Specific, non-routinely collected practice-level data (not from EHR)
||Data governance at program level
||AIHW in-house tools
|AIHW, Australian Institute of Health and Welfare; BEACH, Bettering the Evaluation and Care of Health; CAT, Clinical Audit Tool; EHR, electronic health record; ePBRN, Electronic Practice Based Research Network; IHN, Integrated Health Neighbourhood; LHD, Local Health District; MAGNET, Melbourne East MonAsh GeNeral PracticE DaTabase; ML, Medicare Local; PHN, Primary Health Network; POLAR, Population Level Analysis and Reporting; RACGP, The Royal Australian College of General Practitioners
Participants at all three workshops highlighted the common challenges as:
- data quality, interoperability, fitness for use
- fragmented data and information governance
- proprietary models and transparency
- business model and sustainability of data linkage
- differing ethical perspectives to processes along the data production cycle
- cognitive load on patients and clinicians.
Proposed solutions to the above issues were discussed and categorised as the need for:
- building on Australian standards-based data and information models (eg National Health Information Model) and metadata (eg National Health Data Dictionary) and existing EHR-based programs, in an integrated ‘top-down’ and ‘bottom-up’ approach, to underpin the development of tools and applications
- standards-based tools and methods for data extraction, linkage, quality assessment and management that are amenable to critical appraisal prior to adoption and sharing
- engagement of user (clinician and manager) to maximise the workflow-friendliness of EHR implementations and promote a culture of good data quality and documentation
- integrated data and knowledge management, and intellectual property governance across the healthcare enterprise, promoting it as a core element of the organisational culture
- transparency at all levels and phases of the data production cycle, including the interactions with, and contributions of, consumer and clinician data creators and collectors
- strategies to address the proprietary model that inhibits sharing and rigorous evaluation of the quality and robustness of EHRs and data tools
- inclusive national and international partnerships, including professional bodies, consumer bodies, non-governmental organisations (NGOs), commercial groups and governments, to achieve consensus rules and governance for sharing of resources, tools and metadata (note: Metadata Online Registry [METeOR] defines metadata as ‘data about data’ [eg source, time of collection or documentation and other characteristics about data]; see http://meteor.aihw.gov.au/content/index.phtml/itemId/268284 for more information)
- open engagement of the vendor community in quality assessment of systems, tools and data
- engagement of the patient and community to promote quality of data and care.
There was agreement by workshop participants to use a common methodology to report on the quality of studies using routinely collected data. The Reporting of Studies Conducted using Observational Routinely Collected Data (RECORD) template18 was suggested as a starting point. Coding of data, using a standard or reference terminology, is to be encouraged. A coordinated approach and common metadata are essential to interpret loose terms entered into EHRs.
There was agreement on the need for a national consensus on basic principles, scope and organisational levels of governance, with the aim of engendering trust with primary care practitioners to facilitate their participation in EHR-based projects. This includes a recognition that data, information, clinical and managerial governance must be integrated across the health enterprise in order to address different clinical and managerial uses for, and stewardship of, data.27 Should the governance structure, data stewards and data quality management protocols be established at micro-, meso- or macro-organisational levels to optimise the engagement with clinical, managerial, informatics and technology stakeholders and the patient? There is a role for local Human Research Ethics Committees (HRECs) or similar institutional agencies in any local, regional, jurisdictional or national governance arrangements.
It was recommended that primary and secondary care data linkage be promoted to enable studies into vertical integration to support coordinated care. This includes the use of Australian national individual health identifiers (IHI) and other methods of patient identification, and working with both state/territory and Commonwealth government agencies.3
A communication and engagement plan and strategy are essential at this stage. It was proposed that electronic document sharing and communication platforms such as a ‘list-serve’ or ‘wiki’ be established to support this special interest group to engage with policymakers and tools developers. They will be able to discuss and guide the governance, development and implementation of robust and meaningful tools to optimise the use of observational EHR data.
There is much overlap among the EHR-based and non–EHR-based data collection programs in terms of types of data, tools and platforms, suggesting a need for harmonisation to share tools and resources to meet common objectives. However, there are differences in scope, focus and context, leading to variations in whether patient-level or practice-level data are collected, data quality management, and approaches to data and information governance. GPs should recognise the inevitability that, as with hospital practice, the electronic data derived from their patients will be used beyond the GP–patient relationship and their EHRs. They need to understand the data quality management, provenance and governance of this secondary use of data in their EHRs, and the implications for them as clinicians and managers. The governance processes and structures must be transparent and acceptable to GPs, who have significant roles as collectors, managers and users of the data.
Siaw-Teng Liaw PhD, FRACGP, FACHI, FACMI, Professor of General Practice, University of New South Wales; Director, General Practice Unit, South Western Sydney Local Health District, NSW. email@example.com
Gawaine Powell-Davies BA (Hons), MHP, Chief Executive, Centre for Primary Health Care and Equity, University of NSW, Sydney, NSW
Christopher Pearce PhD, MFM, MBBS, FRACGP, FACRRM, FAICD, FACHI, General Practice, University of Melbourne, VIC
Helena Britt, BA, PhD, Director, Family Medicine Research Centre, University of Sydney, Parramatta, NSW
Lisa McGlynn BAppSc, Lead of the Health Data Group, Australian Institute of Health & Welfare during this project; Assistant Secretary, Drug Strategy Branch, Department of Health Canberra, ACT
Mark Fort Harris MBBS, FRACGP, MD, Executive Director, Centre for Primary Health Care and Equity, University of NSW, Sydney, NSW
Competing interests: None.
Provenance and peer review: Not commissioned, externally peer reviewed.
Colin Frick and Dale Ford (Improvement Foundation), Danielle Mazza (Monash University), Margaret Williamson (MedicineInsight), Michelle Griever (University of Toronto), and participants of the workshops representing existing programs in Australia: Ochre Health and UNSW WHO Collaborating Centre (eHealth), ePBRN, APHID, MAGNET, MedicineInsight, Improvement Foundation, BEACH and AIHW; Medicare Locals, Local Health Districts; some Sydney universities (University of NSW, University of Sydney and University of Technology Sydney); IMIA Primary Care Informatics Working Group; and participants from UK, Europe, Canada and US at the NAPCRG workshop.
- Pearce C, Shearer M, Gardner K, Kelly J. A division’s worth of data. Aust Fam Physician 2011;40:167–70.
- Liaw ST, Taggart J, Dennis S, Yeo A. Data quality and fitness for purpose of routinely collected data – A case study from an electronic Practice-Based Research Network (ePBRN). American Medical Informatics Association Annual Symposium 2011. Washington, DC: Springer Verlag, 2011.
- Pearce C, Bainbridge M. A personally controlled electronic health record for Australia. J Am Med Inform Assoc 2014;21:707–13.
- Arend J, Tsang-Quinn J, Levine C, Thomas D. The patient-centered medical home: History, components, and review of the evidence. Mt Sinai J Med 2012;79:433–50.
- Sinsky CA. The patient-centered medical home neighbor: A primary care physician’s view. Ann Intern Med 2011;154:61–62.
- Yee JHF. The patient-centered medical home neighbor: A subspecialty physician’s view. Ann Intern Med 2011;154:63–64.
- Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academies Press, 2001.
- National Health and Hospitals Reform Commission CoA. A healthier future for all Australians – Final report of the National Health and Hospitals Reform Commission. Canberra: DOH, 2009.
- Krist A, Beasley JW CJ, Kibbe DC, et al. Electronic health record functionality needed to better support primary care. J Am Med Inform Assoc 2014;21:764–71.
- Kuhn T, Basch P, Barr M, Yackel T, Medical Informatics Committee of the American College of Physicians. Clinical documentation in the 21st century: Executive summary of a policy position paper from the American College of Physicians. Clinical Documentation in the 21st Century. Ann Intern Med 2015;162:301–03.
- Institute of Medicine. The computer-based patient record: An essential technology for health care. Revised edn. Dick RS, Steen EB, Detmer DE, editors. Washington, DC: National Academies Press, 1997.
- National Electronic Decision Support Taskforce. Report to health ministers: Electronic decision support in Australia. Canberra: National Health Information Management Advisory Committee, 2002.
- National Electronic Health Records Taskforce. A health information network for Australia. Canberra: National Electronic Health Records Taskforce, 2000.
- de Lusignan S, Liaw ST, Michalakidis G, Jones S. Defining data sets and creating data dictionaries for quality improvement and research in chronic disease using routinely collected data: An ontology driven approach. Inform Prim Care 2011;19:127–34.
- de Lusignan S, Pearce C, Shaw N, et al. What are the barriers to conducting international research using routinely collected primary care data? Stud Health Technol Inform 2011;165:135–40.
- de Lusignan S, Liaw ST, Krause P, et al. Key concepts to assess the readiness of data for international research: Data quality, lineage and provenance, extraction and processing errors, traceability, and curation. Yearb Med Inform 2011;6:112–21.
- Liyanage H, Liaw ST, de Lusignan S. Accelerating the development of an information ecosystem in health care, by stimulating the growth of safe intermediate processing of health information (IPHI). Inform Prim Care 2012;20:81–86.
- Liyanage H, Liaw S, de Lusignan S. Reporting of Studies Conducted using Observational Routinely Collected Data (RECORD) statement: Call for contributions from the clinical informatics community. Inform Prim Care 2012;20:221–24.
- Liyanage H dLS, Liaw ST, Kuziemsky CE, et al. Big data usage patterns in the health care domain: A use case driven approach applied to the assessment of vaccination benefits and risks. IMIA Yearb Med Inform 2014;9:27–35.
- Liaw ST, Chen H, Maneze D, et al. Health reform: Is current electronic information fit for purpose? Emerg Med Australas 2011;24:57–63.
- Halamka J, Overhage J, Ricciardi L, Rishel W, Shirky C, Diamond C. Exchanging health information: Local distribution, national coordination. Health Aff (Millwood) 2005;24:1170–79.
- Liaw S, Taggart J, Yu H, de Lusignan S. Data extraction from electronic health records – Existing tools may be unreliable and potentially unsafe. Aust Fam Physician 2013;42:820–23.
- Liyanage H, Liaw ST, Kuziemsky C, de Lusignan S. Ontologies to improve chronic disease management research and quality improvement studies – A conceptual framework. In: Aronsky D, Leong S, editors. Medinfo 2013. Copenhagen: Elsevier Press, 2013.
- Liaw ST, Rahimi A, Ray P, et al. Towards an ontology for data quality in integrated chronic disease: A realist review of the literature. Int J Med Informatics 2013;82:10–24.
- Mazza D, Pearce C, Huang N, Liaw ST, Britt H. Workshop: Using routinely collected general practice data to inform practice and policy: What do we have now, where do we need to go and how are we going to get there? Primary Health Care Conference. Canberra: PHC Research Information Service, 2014.
- Greiver M, Tu K, Sullivan F, et al. Using EMR data and data linkages for primary care research: International perspectives on challenges and solutions. Forum – NAPCRG Annual Meeting, 22 Nov 2014. New York: NAPCRG, 2014.
- Liaw ST, Pearce C, Liyanage H, Cheah-Liaw G, de Lusignan S. An integrated organisation-wide data quality management and information governance framework: Theoretical underpinnings. Inform Prim Care 2014;21:1–8.