Topic selection
The HANDI team collect possible topics from a variety of sources including online evidence summaries (eg ACCESS and Cochrane databases), suggestions from the Committee members and suggestions posted to the HANDI website.
Committee members choose topics that are relevant to general practice and for which there is Randomised Controlled Trial (RCT) evidence. This is followed by a search for systematic reviews and subsequent trials.
Each potential HANDI entry then goes through a 3-stage process before being published.
Stage 1: Assessing the evidence and relevance
The Committee assess the effectiveness of the proposed non-drug intervention in this stage. Individual members present their assessment to the team, using a standard assessment template, followed by general discussion and a voting process. The Committee consider two questions for assessing inclusion in the handbook:
- Is the quality of the evidence strong enough?
- Is the intervention relevant to and practical for general practice teams?
For inclusion in HANDI interventions must be supported by at least two good quality RCTs with patient-relevant outcomes, or one RCT with strong supportive evidence for the causal connection under investigation. Interventions may be included where evidence is rated as relatively lower quality, if there are minimal or no downsides to the patient ie benefits clearly outweigh possible harms.
At this first stage the Committee note issues that need to be considered in drafting the handbook entry.
Criteria for inclusion in HANDI are high; despite looking only at treatments with promising evidence, about half of the proposed interventions based on the criteria above are rejected.
Using GRADE for HANDI entries
The RAGCP initially used the NHMRC levels of evidence for evidence evaluation and transitioned to using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology in 2020.
GRADE allows rating of both the certainty of the evidence and also the strength of recommendations. However, HANDI only states the Quality of Evidence, expressed as Certainty (Very Low, Low, Moderate, High) and does not state strength of recommendations as is done with guidelines. This is because HANDI is not a clinical guideline as it does not compare and rank alternative interventions. HANDI entries are presented much like a medical pharmacopoeia lists medicines.
Stage 2: Drafting the HANDI entry
If the quality of evidence is acceptable and the intervention is relevant to general practice, the intervention is then included.
The Committee works with a medical editor, with trial authors and other experts in the type of intervention where possible, to develop a detailed “how to” guide for the use of the non-drug intervention.
The format is similar to that of a drug formulary. It includes indications, contraindications, precautions, adverse effects, availability, practice tips and a description of the intervention. It also includes consumer resources, where available.
Stage 3: Final review
Once drafted, the entry is reviewed by the committee and the RACGP’s Expert Committee-Quality Care, prior to finalisation and publication onto the HANDI website.
The committee currently meets quarterly and considers up to four new potential entries at each meeting. Discussion typically includes: the evidence for new possible entries; development of draft entries; and the review and update of existing entries.