Home » Research methods
Category Archives: Research methods
Public confidence in the CJS: ending on a high?

2022 has been a turbulent and challenging year for many. Social inequalities and disadvantage are rife, with those in power repeatedly making bad, inhumane decisions and with very little, to no, accountability or consequences (insert your favourite example from the sh** storm that is the Conservative Party here). Union after Union, across sectors, engage in industrial action in response to poor working conditions and pay, amidst a cost-of-living crisis. And although seemingly unconnected, as the year comes to a close, the Sentencing Guidelines (2022) report on Public Confidence in the Criminal Justice System (CJS) has got me feeling frustrated. My previous blog entries have often been ‘moans’. And whilst January is often dubbed the month of new beginnings and change for the year ahead: we’re not quite there yet so true to form here is my latest moan!
The report exists as one of many conducted by Savanta to collate data on public confidence, in terms of effectiveness and fairness, in the CJS and public awareness of the sentencing guidelines. The data collected in March 2022, was via online surveys given to a “nationally representative sample of 2,165 adults in England and Wales” (Archer et al., 2022, p.9). Some of their highlighted ‘Key Findings’ include that confidence levels in CJS remains relatively stable in comparison to 2018, on the whole, respondents viewed sentences as ‘too lenient’ however this varied based on offence, the existence of the sentencing guidelines improves respondent’s confidence in the fairness of sentencing, and that engagement with broadcast news sources was high across respondents (Archer et al., 2022). It is not the findings, per se, that I take umbrage with, but rather the claim it is a “nationally representative sample of adults in England and Wales” (Archer et al., 2022, p.9).
I take issue on two fronts. The first being that the sample size of 2,165 adult respondents is representative when the demographic factors included are: gender (male and female), age (18-34yo, 35-54yo and 55+), region, ethnicity (White, Mixed, Asian, Black and Other) and socio-economic grade. Now considering we are, thankfully, at the end of 2022 we should all be able to recognise that a sample which only includes cis-gendered options, narrows ethnicity down to 4 categories and the charming ‘other’, and does not include disabilities is problematic. There has been a large body of research done on people with disabilities and their experiences within the CJS, the lack of representation, the lack of accessibility to space and decisions, potentially impacting a defendant’s right to a fair trial, and a victim’s right to justice (Equality and Human Rights Commission, 2021; Hyun et al., 2013 ). So I ask, is this not something which needs considering when looking at public confidence in the CJS of a “nationally representative” sample?
In addition to this, I take issue with the requirement that the sample be “nationally representative”. We have research piece upon research piece about how Black men and Black boys experience the CJS and its various agencies disproportionately to their white counterparts (Lammy, 2017; Monteith et al., 2022; Parmar, 2012). Their experiences of stop and search, sentencing, bail, access to programmes within the Secure and Youth estate. There is nothing representative about our CJS in terms of who it processes, how this is done, and by whom. According to Monteith et al., (2022) 1% of Judges in the CJS are Black, and there are NO Black judges on the High Court, Court of Appeal of Supreme Court: this is not representative! Why then, are we concerned with a representative sample when looking at public confidence in CJS and the sentencing guidelines, when it is not experienced in a proportionate manner?
Maybe I’ve missed the point?
The report is clear, accessible, visible to the public: crucial concepts when thinking about justice, and measuring public confidence in the CJS is fraught with difficulties (Bradford and Myhill, 2015; Kautt and Tankebe, 2011). But this just feels like another nail being thumped into the coffin that is 2022. Might be the eagerness I possess to leave 2022 behind, or the impeding dread for the year to follow but the report has angered me rather than reassured me. As a criminologist, I am hopeful for a more inclusive, representative, fair and accountable CJS, but I am not sure how this will be achieved if we do not accept that the system disproportionately impacts (but not exclusively) Black men, women and children. Think it might be time for another mince pie…
Happy New Year to you all!
References:
Archer, N., Butler, M., Avukatu, G. and Williams, E. (2022) Public Knowledge of Confidence in the Criminal Justice System and Sentencing: 2022 Research. London: Sentencing Council.
Bradford, B. and Myhill, A. (2015) Triggers of change to public confidence in the police and criminal justice system: Findings from the crime survey for England and Wales panel experiment, Criminology and Criminal Justice, 15(1), pp.23-43.
Equality and Human Rights Commission (2021) Does the criminal justice system treat disabled people fairly? [Online] Available at: https://www.equalityhumanrights.com/en/inquiries-and-investigations/does-criminal-justice-system-treat-disabled-people-fairly [ Accessed 4th November 2021].
Hyun, E., Hahn, L. and McConnell, D. (2013) Experiences of people with learning disabilities in the criminal justice system, British Journal of Learning Disabilities, 42: 308-314.
Kautt, P. and Tankebe, J. (2011) Confidence in the Criminal Justice System in England and Wales: A Test of Ethnic Effects, International Criminal Justice Review, 21(2),pp. 93-117.
The Lammy Review (2017) The Lammy Review: An independent review into the treatment of, and outcomes for, Black Asian and Minority Ethnic Individuals in the Criminal Justice System, [online] Available at: https://assets.publishing.service.gov.uk/goverment/uploads/system/uploads/attachment_data/file/643001/lammy-review-final-report-pdf [Last Accessed 14th February 2021].
Monteith, K., Quinn, E., Dennis, A., Joseph-Sailsbury, R., Kane, E., Addo, F. and McGourlay, C. (2022) Racial Bias and the Bench: A Response to the Judicial Diversity and Inclusion Strategy (2020-2025), [online] Available at: https://documents.manchester.ac.uk/display.aspax?DOCID=64125 [Accessed 4th November 2022].
Parmar, A. (2012) Racism and ethnicity in the criminal justice process, in: Hucklesby, A. and Wahidin, A. (eds.) Criminal Justice, 2nd ed, Oxford: Oxford University Press, pp.267-296.
Data collection in a pandemic: Discovering what’s up with WhatsApp *or any other instant messaging service

Many of our students will be thinking about or preparing for, their dissertations. Ordinarily this is the fun part of a degree. The part where you have the freedom to research a topic of interest. Two or three years ago, none of us could have predicted we would be in the midst of a global pandemic which limits research opportunities, particularly for undergraduates who have practical and ethical limitations. One thing that I would encourage students – or indeed anyone doing research in the pandemic – to do, is to be innovative and think outside of the box when planning research. Here in the UK we are lucky enough that most of us have access to the internet. The way I communicate with friends, family and colleagues most frequently is using instant messaging services and so I incorporated this technology into my own research. In sharing my own experience of using instant messaging as a data collection tool, I hope to offer some hope that where there are obstacles, there are also ways to overcome them.
I conducted my most recent research prior to the pandemic, however I had other barriers to navigate. I was researching the victimisation of asylum seekers, and wanted to understand if, and how, they coped with these experiences. I was lucky enough to undertake two face to face interviews with most of the participants which helped me to gain an understanding of their life histories and the broader aspects of their experiences but I also wanted to understand the day to day stressors and how they coped with these events. I knew that a diary method would be an appropriate approach to elicit the data I required, however there were some limitations with using traditional written journals. All the asylum seekers who participated in my research spoke some English as a second language and some spoke the language but could not read or write proficiently. In addition to this, traditional journal entries can be time consuming and there were additional practical considerations to consider such as how I would retrieve the journals. To overcome these obstacles I decided to use digital technology to collect diary data, in part because electronic methods have been found to increase response rates, but also because most asylum seekers I have come across own a mobile phone. Mobile phones are essential to enable to contact their family in their country of origin as well as maintaining contact with their solicitor and other agencies working with them.
Once I had decided to use mobile technology, I sent weekly messages to each of the people I interviewed, asking them how they were that day and how their week had gone, what were some of the good and bad things that had happened. I did this for 12 weeks before conducting their follow up interviews. For the purpose of my doctoral thesis, the method provided data that would help me understand the day to day stress of being an asylum seeker, often resulting from structural harms perpetrated by the Home Office. This may be the mother feeling guilty after being late to pick her children up from school because she had to catch three buses to report to the Home Office and fulfil the conditions of her immigration bail; or the feeling of dread in the pit of her stomach when a brown envelope came through the door, fearful that this may be what feels like a death warrant from the Home Office ordering her deportation. Events such as these were often not mentioned during interview, when interviewees would often recall the major life events and forget the moments of everyday life. Using mobile technology meant that participants could write in their first language and either them or I could translate it. It also meant that they could quickly send a message in the moment, while a particular event was fresh in their minds.
Using mobile technology to collect data worked well for me as it helped me to stay in contact with participants and inform my follow up interviews as well as providing the information I required to answer the research questions. As anticipated the response rate was good – even those who could not afford credit were often able to access Wi-Fi and send a message from a public space. The use of mobile technology to collect diary entries overcame more barriers than it presented, and the method proved fit for purpose, gaining the data required to get a fuller picture of those I was researching. For students planning dissertations or other research projects that are to be undertaken soon, I urge you to think creatively about your research methods and modes of data collection. Although a large part of our teaching focuses on traditional methods, I encourage you to be independent thinkers and so solve the problem of doing research in a pandemic.
“Truth” at the age of uncertainty

Research methods taught for undergraduate students is like asking a young person to eat their greens; fraught with difficulties. The prospect of engaging with active research seems distant, and the philosophical concepts underneath it, seem convoluted and far too complex. After all, at some point each of us struggled with inductive/deductive reasoning, whilst appreciating the difference between epistemology over methodology…and don’t get me stated on the ontology and if it is socially proscribed or not…minefield. It is through time, and plenty of trial and error efforts, that a mechanism is developed to deliver complex information in any “palatable” format!
There are pedagogic arguments here, for and against, the development of disentangling theoretical conventions, especially to those who hear these concepts for the first time. I feel a sense of deep history when I ask students “to observe” much like Popper argued in The Logic of Scientific Discovery when he builds up the connection between theory and observational testing.
So, we try to come to terms with the conceptual challenges and piqued their understanding, only to be confronted with the way those concepts correlate to our understanding of reality. This ability to vocalise social reality and conditions around us, is paramount, on demonstrating our understanding of social scientific enquiry. This is quite a difficult process that we acquire slowly, painfully and possibly one of the reasons people find it frustrating. In observational reality, notwithstanding experimentation, the subjectivity of reality makes us nervous as to the contentions we are about to make.
A prime skill at higher education, among all of us who have read or are reading for a degree, is the ability to contextualise personal reality, utilising evidence logically and adapting them to theoretical conventions. In this vein, whether we are talking about the environment, social deprivation, government accountability and so on, the process upon which we explore them follows the same conventions of scholarship and investigation. The arguments constructed are evidence based and focused on the subject rather than the feelings we have on each matter.
This is a position, academics contemplate when talking to an academic audience and then must transfer the same position in conversation or when talking to a lay audience. The language may change ever so slightly, and we are mindful of the jargon that we may use but ultimately we represent the case for whatever issue, using the same processes, regardless of the audience.
Academic opinion is not merely an expert opinion, it is a viewpoint, that if done following all academic conventions, should represent factual knowledge, up to date, with a degree of accuracy. This is not a matter of opinion; it is a way of practice. Which makes non-academic rebuttals problematic. The current prevailing approach is to present everything as a matter of opinion, where each position is presented equally, regardless of the preparation, authority or knowledge embedded to each. This balanced social approach has been exasperated with the onset of social media and the way we consume information. The problem is when an academic who presents a theoretical model is confronted with an opinion that lacks knowledge or evidence. The age-old problem of conflating knowledge with information.
This is aggravated when a climatologist is confronted by a climate change denier, a criminologist is faced with a law and order enthusiast (reminiscing the good-old days) or an economist presenting the argument for remain, shouted down by a journalist with little knowledge of finance. We are at an interesting crossroad, after all the facts and figures at our fingertips, it seems the argument goes to whoever shouts the loudest.
Popper K., (1959/2002), The Logic of Scientific Discovery, tr. from the German Routledge, London