Quantitative survey findings are important in measuring health-related phenomena, including on sensitive topics such as respectful maternity care (RMC). But how well do survey results truly capture respondent experiences and opinions? Quantitative tool development and piloting often involve translating questions from other settings and assessing the mechanics of implementation, which fails to deeply explore how respondents understand survey questions and response options. To address this gap, we conducted cognitive interviews on survey questions (n = 88) adapted from validated RMC instruments used in Ethiopia, Kenya and elsewhere in India. Cognitive interviews with rural women (n = 21) in Madhya Pradesh, India involved asking the respondent the survey question, recording her response, then interviewing her about what the question and response options meant to her. We analysed the interviews to revise the tool and identify question failures, which we grouped into six areas: issues with sequencing, length and sensitivity; problematic response options; inappropriate vocabulary; temporal and spatial confusion; accessing different cognitive domains; and failure to resonate with the respondent’s worldview and reality. Although women tended to provide initial answers to the survey questions, cognitive interviews revealed widespread mismatch between respondent interpretation and question intent. Likert scale response options were generally incomprehensible and questions involving hypothetical scenarios could be interpreted in unexpected ways. Many key terms and concepts from the international RMC literature did not translate well and showed low resonance with respondents, including consent and being involved in decisions about one’s care. This study highlights the threat to data quality and the validity of findings when translating quantitative surveys between languages and cultures and showcases the value of cognitive interviews in identifying question failures. While survey tool revision can address many of these issues, further critical discussion is needed on the use of standardized questions to assess the same domains across contexts.

ObjectivesTo understand factors underpinning the accuracy and timeliness of mobile phone numbers and other health information captured in India’s government registry for pregnant and postpartum women. Accurate and timely registration of mobile phone numbers is necessary for beneficiaries to receive mobile health services.SettingMadhya Pradesh and Rajasthan states in India at the community, clinical, and administrative levels of the health system.ParticipantsInterviews (n=59) with frontline health workers (FLHWs), data entry operators, and higher level officials. Focus group discussions (n=12) with pregnant women to discuss experiences with sharing data in the health system. Observations (n=9) of the process of digitization and of interactions between stakeholders for data collection.Primary and secondary outcome measuresThematic analysis identified how key actors experienced the data collection and digitisation process, reasons for late or inaccurate data, and mechanisms that can bolster timeliness and accuracy.ResultsPregnant women were comfortable sharing mobile numbers with health workers, but many were unaware that their data moved beyond their FLHW. FLHWs valued knowing up-to-date beneficiary mobile numbers, but felt little incentive to ensure accuracy in the digital record system. Delays in registering pregnant women in the online portal were attributed to slow movement of paper records into the digital system and difficulties in gathering required documents from beneficiaries. Data, including women’s phone numbers, were handwritten and copied multiple times by beneficiaries and health workers with variable literacy. Supervision tended to focus on completeness rather than accuracy. Health system actors noted challenges with the digital system but valued the broader project of digitisation.ConclusionsIncreased focus on training, supportive supervision, and user-friendly data processes that prioritise accuracy and timeliness should be considered. These inputs can build on existing positive patient–provider relationships and health system actors’ enthusiasm for digitisation.

IntroductionMobile Academy is a mobile-based training course for India’s accredited social health activist (ASHA) community health workers (CHW). The course, which ASHAs access by dialling a number from their phones, totals 4 hours of audio content. It consists of 11 chapters, each with their own quiz, and provides a cumulative pass or fail score at the end. This qualitative study of Mobile Academy explores how the programme was accessed and experienced by CHWs, and how they perceive it to have influenced their work.MethodsWe conducted in-depth interviews (n=25) and focus group discussions (n=5) with ASHAs and other health system actors. Open-ended questions explored ASHA perspectives on Mobile Academy, the course’s perceived influence on ASHAs and preferences for future training programmes. After applying a priori codes to the transcripts, we identified emergent themes and grouped them according to our CHW mLearning framework.ResultsASHAs reported enjoying Mobile Academy, specifically praising its friendly tone and the ability to repeat content. They, and higher level health systems actors, conceived it to primarily be a test not a training. ASHAs reported that they found the quizzes easy but generally did not consider the course overly simplistic. ASHAs considered Mobile Academy’s content to be a useful knowledge refresher but said its primary benefit was in modelling a positive communications approach, which inspired them to adopt a kinder, more ‘loving’ communication style when speaking to beneficiaries. ASHAs and health system actors wanted follow-on mLearning courses that would continue to compliment but not replace face-to-face training.ConclusionThis mLearning programme for CHWs in India was well received by ASHAs across a wide range of education levels and experience. Dial-in audio training has the potential to reinforce topical knowledge and showcase positive ways to communicate.

No abstract