Evaluating public involvement in research design and grant development: Using a qualitative document analysis method to analyse an award scheme for researchers

Susan Baxter, Delia Muir, Louise Brereton, Christine Allmark, Rosemary Barber, Lydia Harris, Brian Hodges, Samaira Khan, Wendy Baird

The National Institute for Health Research (NIHR) Research Design Service (RDS) for Yorkshire and Humber has been running a public involvement funding scheme since 2008. This scheme awards researchers a small amount of money to help them get involvement from patients and/or the public. Involvement activities take place at the time when researchers are planning studies, and when they are completing application forms to request funding for a proposed research project. After the public involvement activities researchers are asked to write a report for the RDS describing what they did with the public involvement funding. This study analysed those reports using an approach which included members of a public involvement panel in the data analysis process. The aim of the work was to see what the views and experiences of researchers who received funding were, and what might be learned for the future of the scheme. Twenty five reports were analysed. Four main themes were identified, these described: the added value of public involvement; aspects to consider when planning and designing public involvement; different roles of public contributors; and aspects of valuing public member contributions. The group approach to analysis was successful in enabling involvement of a variety of individuals in the process. The findings of the study provide evidence of the value of public involvement during the development of applications for research funding. The results also indicate that researchers recognise the variety in potential roles for the public in research, and acknowledge how involvement adds value to studies. Background A regional Research Design Service, funded by the National Institute for Health Research, introduced a small grant in 2008, to support public involvement (often known as patient and public involvement [PPI]) activities during the development of applications for research funding. Successful applicants are requested to submit a report detailing how the grant money was used, including a description of the aims and outcomes of the public involvement activities. The purpose of this study was to analyse the content of these reports. We aimed to find out what researcher views and experiences of public involvement activities were, and what lessons might be learned. Methods We used an innovative method of data analysis, drawing on group participatory approaches, qualitative content analysis, and Framework Analysis to sort and label the content of the reports. We developed a framework of categories and sub-categories (or themes and sub-themes) from this process. Results Twenty five documents were analysed. Four main themes were identified in the data: the added value of public involvement; planning and designing involvement; the role of public members; and valuing public member contributions. Within these themes, sub-themes related to the timing of involvement (prior to the research study/intended during the research study), and also specific benefits of public involvement such as: validating ideas; ensuring appropriate outcomes; ensuring the acceptability of data collection methods/tools and advice regarding research processes. Other sub-themes related to: finding and approaching public members; timing of events; training/support; the format of sessions; setting up public involvement panels: use of public contributors in analysis and interpretation of data; and using public members to assist with dissemination and translation into practice. Conclusions The analysis of reports submitted by researchers following involvement events provides evidence of the value of public involvement during the development of applications for research funding, and details a method for involving members of the public in data analysis which could be of value to other researchers The findings of the analysis indicate recognition amongst researchers of the variety in potential roles for public members in research, and also an acknowledgement of how involvement adds value to studies.