During the Covid-19 pandemic, the refrain of ‘following the science’ became commonplace. But what is meant by evidence can vary according to who is asked, the context, and other factors. We conducted research to analyse the perceptions of Welsh policy actors towards evidence. These perceptions matter because they will impact why evidence is used or not by different policy actors and ultimately on how policy is formulated.
To undertake this research, we used Q methodology – which is a mixed method developed to study attitudes and perceptions of individuals. It involves participants ranking a set of statements on what evidence is and its role in policy making. These statements were collected from the existing literature, newspapers, and expert interviews. When meeting virtually (because of the Covid-19 pandemic), each participant was asked to rank the statements in an agree-to-disagree pyramid shape (+4 to -4); take a photograph of the final sorted statements; and complete a short questionnaire about their views on evidence.
We conducted interviews with 34 participants from across the Welsh policy community, from Ministers to civil servants, Senedd staff, as well as civil society organisations, and academics, to discuss their perceptions of evidence for policy.
This project has three phases:
Phase 1: What counts as evidence in Wales: interviews with 34 participants from across the Welsh national policy community, from Ministers to civil servants, Senedd staff, as well as civil society organisations and academics, to discuss their perceptions what counts as evidence for policy.
Read more on this LSE blog by WCPP’s Dr Eleanor MacKillop and Professor James Downe: https://blogs.lse.ac.uk/impactofsocialsciences/2023/01/10/researchers-engaging-with-policy-should-take-into-account-policymakers-varied-perceptions-of-evidence/
Our research was also featured in an annual review on Rethinking Research Impact: https://blogs.lse.ac.uk/impactofsocialsciences/2023/12/29/2023-in-review-rethinking-research-impact/
WCPP policy brief: What-counts-as-evidence-for-policy.pdf (wcpp.org.uk)
Phase 2: What counts as evidence in Scotland and Wales: Comparing Scottish and Welsh cultures of evidence.
See more below:
Blog: Understanding evidence in policy making by WCPP’s Grace Piddington, Dr Eleanor Mackillop and Professor James Downe (Policy and Politics): https://policyandpoliticsblog.com/2024/06/05/understanding-evidence-in-policy-making/
Academic journal article: Do policy actors have different views of what constitutes evidence in policymaking? By WCPP’s Grace Piddington, Eleanor MacKillop and James Downe (Policy and Politics): https://bristoluniversitypressdigital.com/view/journals/pp/52/2/article-p239.xml
Phase 3: What counts as evidence: Comparing national and local levels of decision-making in Wales. Outputs forthcoming.”