Peer supervision for assuring the quality of non-specialist provider delivered psychological intervention: Lessons from a trial for perinatal depression in Goa, India

Abstract

Background. The aims of the current study were three-fold: i) to estimate the reliability and predictive validity of a therapy quality measure for use by peers; ii) to assess the extent to which peer delivery agents could be trained to evaluate their peers' counsellors as reliably as experts; and iii) to identify barriers and facilitators of several implemented models of peer supervision. Methods. 26 peers (called 'Sakhis' in the study context), with no previous experience or formal training in mental health care delivery, were trained by experts to deliver the Thinking Healthy Program Peerdelivered (THPP) and conduct peer-led supervision. Using the Therapy Quality Scale (TQS)-an 18 item Likert scale (0-2) measuring both general and treatment-specific skills-both peers and experts independently rated 167 individual sessions to estimate: a) the psychometric properties of TQS; and b) the mean difference between peer and expert TQS ratings; these data were analyzed using SAS 9.3. This was complemented with qualitative data (two rounds of in-depth interviews with four experts and focus group discussions with all Sakhis) which were analyzed using framework analysis. Results. We observed good internal consistency on TQS ratings among expert (α=0.814) and Sakhis (α=0.843) and good to excellent scores of inter-rater reliability among experts (ICC=0.779) and Sakhis (ICC=0.714). TQS ratings were not significantly related to patient depressive symptoms at 6-months post-child birth but were significantly related to patient activation scores (r=0.375, p<0.01 for treatment-specific skills and 0.313, p<0.01 for general skills) at 3-months post-child birth, which in turn were significantly related to depressive symptom scores at 6-months post-child birth (r=-0.455, p<0.001), highlighting a potential temporal pathway between therapy quality, patient behaviours and patient outcomes. Following additional training and with growing expertise, Sakhis eventually evaluated their peers' counselling sessions as reliably as experts-demonstrating no significant mean differences on general (t=-0.42, p>0.05) or treatment-specific (t=-1.44, p>0.05) subscale scores. Qualitative findings were also consistent between experts and Sakhis: barriers included peers' initial difficulties in rating the TQS and leading supervision which declined over time. Most Sakhis and experts reported the benefits of using a structured scale to rate therapy quality which in turn facilitated consistent and relevant feedback and motivation to ultimately improve Sakhis' counselling skills. In addition, most Sakhis and experts found that peer supervision methods were acceptable and feasible, particularly when linked to financial incentives and expert supervisor. Conclusion.With time, non-specialist or lay providers can be trained to implement peer supervision and assess therapy quality as reliably as experts using a psychometrically-sound measure. However, peer supervision with experts was more preferred than peer supervision without experts to facilitate structured, rel...

Peer supervision experiences of drug sellers in a rural district in East-Central Uganda: a qualitative study

“…Results from this study revealed that after piloting peer supervision, both drug sellers and peer supervisors felt that peer supervision was reliable, regular and predictable. These results are similar to those from India where peer supervisors were able to reliably assess the quality of a therapy just as experts did [24]. However, while an amalgamation of peer supervisors with experts was preferred in India, in Luuka District, peer supervisors preferred an amalgamation with drug inspectors for quality assurance purposes.…”

“…Through repeated networking with fellow supervisees, peer supervision is seen as one of the best ways of accessing the wisdom of others in a cooperative and mutual way providing an opportunity to refine professional skills through immediate feedback [23]. Therefore, to strengthen supervision among drug sellers, it was envisaged that since peer supervision had been effective in other settings such as mental health care delivery [24], there was a likelihood that similar results would be achieved among drug sellers in rural settings in Uganda. The piloting of peer supervision among rural private drug sellers in Luuka District was premised on the fact that that despite being licensed, receiving iCCM training and being inspected by District Drug Inspectors (DDIs), inappropriate treatment of children under 5 years continues unabated [25].…”

‘I know those people will be approachable and not mistreat us’: a qualitative study of inspectors and private drug sellers’ views on peer supervision in rural Uganda

“…This study did not use therapy quality scales (TQS) to measure general and speci c skills of inspection and peer supervision during data collection [49]. Instead, views from participants were explored using a constructivist grounded theory approach by Kathy Charmaz [24].…”

‘I know those people will be approachable and not mistreat us’: a qualitative study of inspectors and private drug sellers on peer supervision in rural Uganda

“…This study did not use therapy quality scales (TQS) to measure general and speci c skills of inspection and peer supervision during data collection [44]. Instead, views from participants were explored using a constructivist grounded theory approach by Kathy Charmaz [21].…”