Incorporating the GAIN-SS into a tablet-based self-reported assessment for use in an integrated youth health centre
Gabrielle Chartier, MD-MSc (1); Javiera Pumarino (2,3,4) ; Steve Mathias, MD (1,2,3) ; Chris Richardson, PhD (2,3,4)
1. Department of Psychiatry, UBC; 2. Inner City Youth Program, Providence Health Care; 3. Centre for Health Evaluation & Outcome Sciences (CH.OS), Providence Health Care; 4. School of Population and Public Health, UBC
Quality improvement evaluation of a tablet-based waiting room assessment implemented in a youth-oriented integrated primary care centre, which:
- Captures clients’ (a) psychosocial functioning and (b) sociodemographic characteristics.
- Generates real-time report with clinical profile of youths' mental health and substance use for clinicians to review immediately prior to clinical encounter.
These assessments can improve the quality of care by:
- Reducing time devoted to data-gathering.
- Helping orient encounters according to youths' priorities.
- Acting as a "patient-activation" tool.
Real-time clinical report may help clinicians to:
- Identify and address mental health and substance use problems in early stage.
- Show more empathy and engagement during encounter.
• Design and implement tablet-based CAHPS administration in a safety net setting.
• Conduct formative qualitative work to create shorter, lower literacy patient experience items.
• Explore broader concepts of & preferences for reporting patient experience among vulnerable patients.
1. Tablet-based waiting-room survey (n=465):
- Completed between Aug. 2015 and Aug. 2016 at the Granville Youth Health Centre in Vancouver, BC.
- HEADSS and GAIN-SS, plus Q.I. indicators: youth's perceptions of the tablet system.
- $5 gift card as honorarium.
2. Anonymous exit survey (n=625):
- Clients were invited to complete survey on the tablet-based system after their clinical encounter (Aug. 2015 to Aug. 2016.)
- Included: (a) perceptions of pre-visit survey and (b) whether they felt it improved their clinical experience.
- $5 gift card as honorarium.
3. Staff survey and interviews (n=15):
- Staff completed survey of perceptions of the tablet-based health survey and report between Sep. and Oct. 2015.
- They were also interviewed to get feedback on the system and identify potential short-term improvements.
Developed through a process of co-creation with youth, health care professionals and administrators.
- Gamification, pictograms, and icons:
- Increased youth engagement and appreciation.
- Decreased level of literacy.
- Reduced cultural biases.
- Higher self-disclosure of stigmatized behaviours.
- Assessment content is organized into HEADSS blocks:
- Home and Demographics
- Emotions (GAIN-SS)
GAIN-SS (Global Appraisal of Individual Needs Short Screener)
- Mental health and substance use screening tool for youth.
- 5 minutes, 23 items, 4 subscales:
- Internalizing Disorder
- Externalizing Disorder
- Substance Disorder
- Crime & Violence
- Produced in real-time for clinicians to review prior to clinical encounter.
- Can be reviewed online, printed, or downloaded as pdf.
- Provides overview of patient's situation:
- GAIN-SS summary
- All responses
- Female: 54%
- Mean Age: 21.3, Range 12-30
- Aboriginal: 23%, Caucasian 60%
- Graduated high school: 57%
- Homeless or Couch Surfed in the past month: 39%
Today I am here to discuss (pick up to 3):
- My Feelings (59%)
- Physical Health (35%)
- Alcohol/Drugs (25%)
- Sexual health (22%)
- School/work issues (18%)
- Eating/nutrition (15%)
- Family issues (11%)
- Relationship issues (11%)
- My Safety (9%)
Source: Waiting room survey
- Majority of the staff was satisfied with training. Suggested to complete Health Survey before training.
- Staff did not feel familiar with the GAIN-SS, which is most often used in research; would have liked more training.
- Alerts were appreciated by the staff, helped to identify rapidly what was relevant. Provided suggestions to improve alerts' clinical relevance.
- Some Feedback
“I was able to hone some of my questions into a specific area more quickly”
“Provided more in depth information”
"Survey helps her feel more focused during the interview and get to the point faster.
"Overall this is an excellent tool. I sometimes find it challenging with time management of booked appointments (...)"
"Great work! I like it a lot"
"This has been a lot easier than expected"
- Encouraging results! One year after implementation:
- Youth are satisfied and seem comfortable with the survey platform.
- Youth think survey helps prepare them for visit and helps staff provide better care.
- One month after implementation:
- Staff are using the reports and finding them to be a useful tool to support their clinical practice.
- Staff have a quick access to demographic data, which is thought to reduce the time allowed to data-gathering and help them focus the sessions on identified priorities.
- Survey makes encounter more efficient for most staff, although reviewing the reports reduced efficiency in some cases
In partnership with Silver Wheaton, The Canadian Institute of Health Research and the Centre for Health Evaluation & Outcome Sciences
Chaim,G.,& Henderson, J. (Eds.). (2009). Innovations in collaboration: Findings from the GAIN
collaborating network project.Ottowa,ON: Canadian Mental Health Association
Chisolm DJ,GardnerW, Julian T, Kelleher KJ (2008).Adolescent Satisfaction with Computer- Assisted Behavioural Risk Screening in Primary Care.Child and Adolescent Mental Health, 13(4), 163-168
Gadomski AM, Fothergill KE, Larson S,Wissow LS,Winegrad H,Nagykaldi ZJ,Olson AL, Roter DL (2015). Integrating mental health into adolescent annual visits: impact of previsit comprehensive screening on within-visit processes. Journal of Adolescent Health, 56(3):267-73
Kingston D,McDonald S, Biringer A,Austin MP,Hegadoren K,McDonald S,Giallo R,Ohinmaa A, Lasiuk G,MacQueen G, SwordW, Lane-Smith M, van Zanten SV (2014).Comparing the feasibility, acceptability, clinical-, and cost-effectiveness of mental health e-screening to paper-based screening on the detection of depression, anxiety, and psychosocial risk in pregnant women: a study protocol of a randomized, parallel-group, superiority trial.Trials, 15:3
Olson AL,Gaffney CA,Hedberg VA,Gladstone GR (2009).Use of inexpensive technology to enhance adolescent health screening and counseling.Archives of Pediatrics & Adolescent Medicine,163(2):172-7
Nagykaldi ZJ,Voncken-Brewster V,Aspy CB,Mold JW(2013).Novel computerized health risk appraisal may improve longitudinal health and wellness in primary care.Applied clinical informatics, 4(1):75-87
Whitehouse SR, Lam PY, Balka E,McLellan S,Deevska M, Penn D, Issenman R, Paone M (2013).Co-CreationWith TickiT: Designing and Evaluating a Clinical eHealth Platform for Youth. JMIR Research Protocols, 2(2), e42