Skip to main content
Log in

Facilitators and Impediments to Designing, Implementing, and Evaluating Risk-Based Policing Strategies Using Risk Terrain Modeling: Insights from a Multi-City Evaluation in the United States

  • Published:
European Journal on Criminal Policy and Research Aims and scope Submit manuscript

Abstract

The contemporary policing literature contains numerous examples of partnerships between academic researchers and police agencies. Such efforts have greatly contributed to evidence-based policing by increasing the knowledge base on effective strategies. However, research has demonstrated that successful collaboration between researchers and practitioners can be a challenge, with various organizational and inter-agency factors presenting difficulties at various stages of the process. Additionally, applied research can oftentimes face implementation challenges when the time comes to convert research into practice. The current study contributes to the literature by discussing researcher/practitioner partnerships and program implementation in the context of a multi-city risk-based policing project in the United States. We conceptualize police interventions as contingent on four distinct phases: 1) problem analysis, 2) project design, 3) project implementation, and 4) project evaluation. In this project, the research partners were able to successfully complete each phase in certain cities while the project experienced difficulty at one or more phases in other cities. We discuss these disparate experiences, identifying factors that facilitate or impede successful completion of each step. Policy implications and recommendations for future risk-based policing interventions are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. These police departments varied in terms of size and the crime type they prioritized for this project. PD-A served a residential population of nearly 400,000 while residential populations were over 1 million for both PD-B and PD-C. Comparing all seven partnering agencies, PB-B and PC-C served the largest populations while PD-A served the third smallest. For the applied intervention portion of the project, PD-B and PD-C planned to focus on violent crimes, targeting shootings and robbery respectively, while PD-A selected residential burglary as their priority crime.

  2. In considering our experiences, we felt that multiple steps highlighted by Welsh and Harris (2016) were accomplished somewhat simultaneously at certain steps. For example, given the nature of the ACTION meetings (discussed subsequently), identifying goals and objectives, program design, and action planning operated concurrently. Thus, we decided to present these activities within a single “project design” phase in our study. Furthermore, Welsh and Harris (2016) conceptualized reassessment and review as the step during which evaluation results of pilot programs are used to make changes prior to full-scale implementation. Given the time constraints associated with the funding period for this project, we did not work with any agency on a full-scale, agency-wide implementation of risk-based policing. Therefore, we only include a discussion of our program evaluation efforts.

  3. See http://www.infogroupdatalicensing.com/why-infogroup-data-licensing/what-we-do; http://www.infogroupdatalicensing.com/why-infogroup-data-licensing/how-we-do

  4. “Packaged liquor stores” refer to businesses whose primary purpose is to sell liquor. “Liquor licensed retailers” are facilities that are in business to sell other items, but also sell liquor, such as convenience stores, grocery stores, etc.

  5. While presentation of the evaluation findings is outside the scope of this study, we should note that in cities where measurement between experimental and control areas was possible, observed crime reductions were generally supportive of the risk-based interventions. Crime reductions in the overall target areas as compared to control areas were as high as 42%. In addition, several of the disaggregate intervention activities were associated with crime decreases at the street segment level. For a much more detailed presentation of the evaluation findings, see Kennedy et al. (2018, forthcoming).

  6. In emphasizing crime analysts in evidence-based policing, we must acknowledge that this observation was made in the context of the United States. This raises the obvious question of how transferable these lessons are to agencies in other parts of the world. On the one hand, the crime analysis field has grown in prominence in many countries. For example, Santos (2013, p. 306-307) noted that many European countries as well as Japan, Australia, Brazil, and South Africa have formal crime analysis functions within their national or state police agencies. Robust crime analysis functions have additionally been documented in research conducted in countries such as Canada (Sanders et al. 2015), the United Kingdom (Innes et al. 2005; Keay and Kirby 2017), and New Zealand (Ratcliffe 2005). However, in countries where crime analysts are not as commonly utilized, a different entity may need to be the driver of the type of data-led practices discussed in this study. In such cases, the outside researchers may need to take a more active role in the day-to-day routines of police agencies, as per the embedded criminologists model that has been recently advocated in policing (Braga 2013). By becoming embedded in the police agency, researchers may be able to drive the research projects in a similar manner as the crime analysts discussed in the current study. Conversely, police pracademics, active police officers who have received academic research training (Huey and Mitchell 2016) can be the driving force of research-driven interventions.

References

  • Ariel, B., & Partridge, H. (2016). Predictable policing: Measuring the crime control benefits of hotspots policing at bus stops. Journal of Quantitative Criminology. https://doi.org/10.1007/s10940-016-9312-y.

  • Ariel, B., Weinborn, C., & Sherman, L. (2016). “Soft” policing at hot spots—Do police community support officers work? A randomized controlled trial. Journal of Experimental Criminology, 12(3), 277–317.

    Article  Google Scholar 

  • Barnum, J., Campbell, W., Trocchio, S., Caplan, J., & Kennedy, L. (2016). Examining the environmental characteristics of drug dealing locations. Crime & Delinquency. https://doi.org/10.1177/0011128716649735.

  • Barnum, J., Caplan, J., Kennedy, L., & Piza, E. (2017). The crime kaleidoscope: A cross-jurisdictional analysis of place features and crime in three urban environments. Applied Geography, 79, 203–211.

    Article  Google Scholar 

  • Berman, G., & Fox, A. (2010). Trial & error in criminal justice reform. Learning from failure. Washington: Urban Institute Press.

    Google Scholar 

  • Bowers, K., & Johnson, S. (2010). Implementation failure and success: Some lessons from England. In J. Knutsson & R. Clarke (Eds.), Putting theory to work. Implementing situational prevention and problem-oriented policing. Crime prevention studies (vol. 20, pp. 163–198). Boulder: Lynne Rienner.

    Google Scholar 

  • Braga, A. (2010). Setting a higher standard for the evaluation of problem-oriented policing initiatives. Criminology & Public Policy, 9(1), 173–182.

    Article  Google Scholar 

  • Braga, A. (2013). Embedded criminologists in police departments. Ideas in American Policing. Washington: Police Foundation.

    Google Scholar 

  • Braga, A. (2016). The value of “pracademics” in enhancing crime analysis in police departments. Policing: A Journal of Policy and Practice, 10(3), 308–314.

    Article  Google Scholar 

  • Brown, R. (2010). The role of project management in implementing communty safety initiatives. In J. Knutsson & R. Clarke (Eds.), Putting theory to work. Implementing situational prevention and problem-oriented policing. Crime prevention studies (vol. 20, pp. 37–64). Boulder: Lynne Rienner.

    Google Scholar 

  • Buerger, M. (2010). Polcing and research: Two cultures separate by an almost-common languague. Police Practice and Research. An International Journal, 11(2), 135–143.

    Google Scholar 

  • Caplan, J., & Kennedy, L. (2013). Risk terrain modeling diagnsotics utility (version 1.0). Newark: Rutgers Center on Public Security.

    Google Scholar 

  • Caplan, J., & Kennedy, L. (2016). Risk terrain modeling. Crime predictions and risk reduction. Oakland: University of California Press.

    Google Scholar 

  • Caplan, J., Kennedy, L., & Miller, J. (2011). Risk terrain modeling: Brokering criminological theory and GIS methods for crime forecasting. Justice Quarterly, 28(2), 360–381.

    Article  Google Scholar 

  • Caplan, J., Kennedy, L., & Baughman, J. (2012). Kansas City’s violent crime initiative: A place-based evaluation of location-specific interventon activites during a fixed time period. Crime Mapping, 4(2), 9–37.

    Google Scholar 

  • Caplan, J., Kennedy, L., Barnum, J., & Piza, E. (2015). Risk terrain modeling for spatial risk assessment. Cityscape: A Journal of Policy Development and Research, 17(1), 7–16.

    Google Scholar 

  • Cissner, A., & Farole, D. (2009). Avoiding failures of implementation. Lessons from process evaluations. New York: Center for Court Innovation. Washington: Bureau of Justice Assistance.

    Google Scholar 

  • Comeau, M., Duda, J., Petitti, N., & Klofas, J. (2011). Analysis of 2010 Rochester-City pawn shop transactions. Working paper: 2011–03. Rochester: Center for Public Safety Initiatives, Rochester Institute of Technology.

    Google Scholar 

  • Drawve, G., & Barnum, J. (2017). Place-based risk factors for aggravated assault across police divisions in little rock, Arkansas. Journal of Crime and Justice. https://doi.org/10.1080/0735648X.2016.1270849.

  • Drawve, G., Moak, S., & Berthelot, E. (2016). Predictability of gun crimes: A comparison of hot spot and risk terrain modelling techniques. Policing and Soceity, 26(3), 312–331.

    Article  Google Scholar 

  • Eck, J., & Spelman, W. (1987). Problem-solving: Problem-oriented policing in Newport News. Washington: Police Executive Research Forum.

    Google Scholar 

  • Goldstein, H. (1979). Improving policing: A problem-oriented approach. Crime and Delinquency, 25, 236–258.

    Article  Google Scholar 

  • Goldstein, H. (1990). Problem-oriented policing. New York: McGraw-Hill.

    Google Scholar 

  • Hagan, J. (1989). Why is there so little criminal justice theory? Neglected macro- and micro-level links between organization and power. Journal of Research in Crime and Delinquency, 26(2), 116–135.

    Article  Google Scholar 

  • Heffner, J. (2013). Statistics of the RTMDx utility. In J. Caplan, L. Kennedy, & E. Piza (Eds.), Risk Terrain Modeling Diagnostics (RTMDx) Utility user manual (version 1) (pp. 26–34). Newark: Rutgers Center on Public Security.

    Google Scholar 

  • Huey, L., & Mitchell, R. J. (2016). Unearthing hidden keys: Why pracademics are an invaluable (if underutilized) resource in policing research. Policing: A Journal of Policy and Practice, 10(3), 300–307.

    Article  Google Scholar 

  • Innes, M., Fielding, N., & Cope, N. (2005). ‘The appliance of science?’ The theory and practice of criminal intelligence analysis. British Journal of Criminology, 45, 39–57.

    Article  Google Scholar 

  • Johnson, S., Tilley, N., & Bowers, K. (2015). Introducing EMMIE: An evidence rating scale to encourage mixed-method crime prevention synthesis reviews. Journal of Experimental Criminology, 11(3), 459–473.

    Article  Google Scholar 

  • Keay, S., & Kirby, S. (2017). The evolution of the police analyst and the influence of evidence-based policing. Policing, A Journal of Policy & Practice. https://doi.org/10.1093/police/pax065.

  • Kelling, G., & Coles, C. (1996). Fixing broken windows: Restoring order and reducing crime in our communities. New York: Simon and Schuster.

    Google Scholar 

  • Kennedy, D. (1997). Pulling levers: Chronic offenders, high-crime settings, and a theory of prevention. Valparaiso University Law Review, 31, 449–484.

    Google Scholar 

  • Kennedy, L., Caplan, J., & Piza, E. (2011). Risk clusters, hotspots, and spatial intelligence: Risk terrain modeling as an algorithm for police resource allocation strategies. Journal of Quantitative Criminology, 27(3), 339–362.

    Article  Google Scholar 

  • Kennedy, L., Caplan, J., Piza, E., & Buccine-Schraeder, H. (2016). Vulnerability and exposure to crime: Applying risk terrain modeling to the study of assault in Chicago. Applied Spatial Analysis and Policy, 9(4), 529–548.

    Article  Google Scholar 

  • Klofas, J., Hipple, N., & McGarrell, E. (Eds.). (2010). The new criminal justice. American communities and the changing world of crime control. New York and London: Routledge.

    Google Scholar 

  • Leigh, A., Read, T., & Tilley, N. (1996). Problem-oriented policing. Paper 75. London: Crime Detection and Prevention Series. Police Research Group, Home Office.

    Google Scholar 

  • Lersch, K. (2017). Risky places: An analysis of carjackings in Detroit. Journal of Criminal Justice. https://doi.org/10.1016/j.jcrimjus.2017.07.011.

  • Lewin, K. (1947). Group decision and social change. In T. Newcomb & E. Hartley (Eds.), Readings in social psychology (pp. 202–203). New York: Holt and Company.

    Google Scholar 

  • Lum, C., & Koper, C. (2017). Evidence-based policing: Translating research into practice. Oxford: Oxford University Press.

    Google Scholar 

  • MacQueen, S., & Bradford, B. (2017). Where did it all go wrong? Implementation failure—And more—In a field experiment of procedural justice policing. Journal of Experimental Criminology, 13(3), 321–345.

    Article  Google Scholar 

  • Mastrofski, S., & Willis, J. (2011). Police organization. In M. Tonry (Ed.), The Oxford handbook of crime and criminal justice (pp. 479–508). Oxford: Oxford University Press.

    Google Scholar 

  • Mock, L. (2010). Action research for crime control and prevention. In J. Klofas, N. Hipple, & E. McGarrell (Eds.), The new criminal justice. American communities and the changing world of crime control. New York and London: Routledge.

    Google Scholar 

  • Moreto, W., Piza, E., & Caplan, J. (2014). A plague on both your houses? Risks, repeats, and reconsiderations of urban residential burglary. Justice Quarterly, 31(6), 1102–1126.

    Article  Google Scholar 

  • Nagin, D., Solow, R., & Lum, C. (2015). Deterrence, criminal opportunities, and police. Criminology, 53(1), 74–100.

    Article  Google Scholar 

  • Papachristos, A. (2011). Too big to fail. The science and politics of violence prevention. Criminology & Public Policy, 10(4), 1053–1061.

    Article  Google Scholar 

  • Piza, E. (2017). The effect of various police enforcement actions on violent crime: Evidence from a saturation foot-patrol intervention. Criminal Justice Policy Review. https://doi.org/10.1177/0887403417725370.

  • Piza, E., & Feng, S. (2017). The current and potential role of crime analysts in evaluations of police interventions: Results from a survey of the International Association of Crime Analysts. Police Quarterly. https://doi.org/10.1177/1098611117697056.

  • Piza, E., Feng, S., Kennedy, L., & Caplan, J. (2016). Place-based correlates of motor vehicle theft and recovery: Measuring spatial influence across neighbourhood context. Urban Studies, 1–24. https://doi.org/10.1177/0042098016664299.

  • Ratcliffe, J. (2005). The effectiveness of police intelligence management: A New Zealand case study. Police Practice and Research, 6(5), 435–451.

    Article  Google Scholar 

  • Read, T., & Tilley, N. (2000). Not rocket science? Problem-solving and crime reduction. In Crime reduction research series, paper 6. London: Home Office, Policing and Reducing Crime Unit.

    Google Scholar 

  • Rengifo, A., Stemen, D., & Amidon, E. (2017). When policy comes to town: Discourse and dilemmas on implementation of a statewide reentry policy in Kansas. Criminology. https://doi.org/10.1111/1745-9125.12146.

  • Sanders, C., Weston, C., & Schott, N. (2015). Police innovations, ‘secret squirrels’ and accountability: Empirically studying intelligence-led polcing in Canada. British Journal of Criminology, 55, 711–729.

    Article  Google Scholar 

  • Santos, R. B. (2013). Crime analysis with crime mapping (3rd ed.). SAGE: Los Angeles.

    Google Scholar 

  • Santos, R. B. (2014). The effectiveness of crime analysis for crime reduction: Cure or diagnosis? Journal of Contemporary Criminal Justice, 30(2), 147–168.

    Article  Google Scholar 

  • Santos, R. B., & Taylor, B. (2014). The integration of crime analysis into police patrol work: Results from a national survey of law enforcement agencies. Policing: An International Journal of Police Strategies & Management Article Information, 37(3), 501–520.

    Article  Google Scholar 

  • Scott, M. (2010). Implementing crime prevention: Lessons learned from problem-oriented policing projects. In J. Knutsson & R. Clarke (Eds.), Putting theory to work. Implementing situational prevention and problem-oriented policing. Crime prevention studies (Vol. 20, pp. 9–36). Boulder: Lynne Rienner.

    Google Scholar 

  • Secret, M., Abell, L., & Berline, T. (2011). The promise and challenge of practice-research collaborations: Guiding principles and strategies for initiating, designing, and implementing program evaluation research. Social Work, 56(1), 9–20.

    Article  Google Scholar 

  • Shane, J. (2007). What every chief executive should know: Using data to measure police performance. Flushing: Looseleaf Publications.

    Google Scholar 

  • Sherman, L., & Weisburd, D. (1995). General deterrent effects of police patrol in crime "hot spots": A randomized controlled trial. Justice Quarterly, 12(4), 625–648.

    Article  Google Scholar 

  • Sorg, E., Wood, J., Groff, E., & Ratcliffe, J. (2014). Boundary adherence during place-based policing evaluations: A research note. Journal of Research in Crime and Delinquency, 51(3), 377–393.

    Article  Google Scholar 

  • Sparrow, M. (2008). The character of harms.Operational challenges in control. New York: Cambridge University Press.

    Book  Google Scholar 

  • Sparrow, M. K. (2011). Governing science. New Perspectives in Policing. Harvard University Executive Session on Policing and Public Safety. Cambridge, MA: Harvard Kennedy School of Government, Program in Criminal Jusitce Policy and Management Executive Session on Policing and Public Safety. Washington, DC: US Department of Justice, Office of Justice Programs, National Institute of Justice.

  • Sparrow, M. (2016). Handcuffed. What holds policing back, and the keys to reform. Washington: Brookings Institution Press.

    Google Scholar 

  • Taylor, B., Kowalyk, A., & Boba, R. (2007). The integration of crime analysis into law enforcement agencies: An exploratory study into the perceptions of crime analysts. Police Quarterly, 10(2), 154–169.

    Article  Google Scholar 

  • Visher, S., & Weisburd, D. (1998). Identifying what works: Recent trends in crime prevention strategies. Crime, Law and Social Change, 28, 2230242.

    Google Scholar 

  • Weisburd, D., Mastrofski, S., McNally, A., Greenspan, R., & Willis, J. (2003). Reforming to preserve: COMPSTAT and strategic problem solving in American policing. Criminology & Public Policy, 2(3), 421–456.

    Article  Google Scholar 

  • Wellford, C. (2009). Criminologists should stop whining about their impact on policy and practice. In N. A. Frost, J. D. Freilich, & T. R. Clear (Eds.), Contemporary issues in criminal justice policy (1st ed., pp. 17–24). Belmont: Wadsworth Cengage.

    Google Scholar 

  • Welsh, W., & Harris, P. (2016). Criminal justice policy and planning. 5th edition. New York: Routledge.

    Book  Google Scholar 

  • Willis, J., Mastrofski, S., & Weisburd, D. (2007). Making sense of COMPSTAT: A theory-based analysis of organizational change in three police departments. Law & Society Review, 41(1), 147–188.

    Article  Google Scholar 

  • Wright, R., & Decker, S. (1994). Burglars on the job. Boston: Northeastern University Press.

    Google Scholar 

Download references

Acknowledgments

This article is based upon the authors’ experiences participating in researcher/practitioner partnerships funded by the National Institute of Justice, grant numbers 2013-IJ-CX-0053 and 2012-IJ-CX-0038. We thank the analysts, officers, and command staff at each of the police agencies referenced in this article for their willingness to partner with us and their hard work on this project. All opinions are those of the authors and do not necessarily reflect those of the National Institute of Justice or any of the mentioned police agencies.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eric L. Piza.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Piza, E.L., Kennedy, L.W. & Caplan, J.M. Facilitators and Impediments to Designing, Implementing, and Evaluating Risk-Based Policing Strategies Using Risk Terrain Modeling: Insights from a Multi-City Evaluation in the United States. Eur J Crim Policy Res 24, 489–513 (2018). https://doi.org/10.1007/s10610-017-9367-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10610-017-9367-9

Keywords

Navigation