Skip to content
1981
image of Understanding journalism impact: A multi-dimensional taxonomy for professional, organizational and societal change

Abstract

How should we measure the impact of investigative journalism? Media scholars and practitioners have turned their attention towards understanding the causal effect of media reports on a range of social, political and economic outcomes. Their interest has been spurred by the increased availability of data, by the emergence of new tools for rigorously assessing causal effects and by pressure from donors interested in understanding the returns on their investments in media and journalism programmes. Drawing on literature from multiple disciplines, we propose a multi-faceted metric which future researchers, journalists and news agencies will be able to use when analysing media impact.

Funding
This study was supported by the:
  • Dean’s research
Loading

Article metrics loading...

/content/journals/10.1386/ajms_00121_1
2023-09-07
2024-12-08
Loading full text...

Full text loading...

References

  1. Aker, J. C., Collier, P. and Vicente, P. C. (2017), ‘Is information power? Using mobile phones and free newspapers during an election in Mozambique’, Review of Economics and Statistics, 99:2, pp. 185200.
    [Google Scholar]
  2. Arrow, K. J., Cropper, M. L., Eads, G. C., Hahn, R. W., Lave, L. B., Noll, R. G., Portney, P. R., Russell, M., Schmalensee, R., Smith, V. K. and Stavins, R. N. (1996), ‘Is there a role for benefit-cost analysis in environmental, health, and safety regulation?’, Science, 272:5259, pp. 22122, https://doi.org/10.1126/science.272.5259.221.
    [Google Scholar]
  3. Baekgaard, M., Jensen, C., Mortensen, P. B. and Serritzlew, S. (2014), ‘Local news media and voter turnout’, Local Government Studies, 40:4, pp. 51832, https://doi.org/10.1080/03003930.2013.834253.
    [Google Scholar]
  4. Banerjee, A., Enevoldsen, N., Pande, R. and Walton, M. (forthcoming 2023), ‘Public information is an incentive for politicians: Experimental evidence from Delhi elections’, American Economic Journal: Applied Economics, https://doi.org/10.1257/app.20220088.
    [Google Scholar]
  5. Banerjee, A. V., Kumar, S., Pande, R. and Su, F. (2011), ‘Do informed voters make better choices? Experimental evidence from urban India’, unpublished manuscript.
  6. Bednar, M. K. (2012), ‘Watchdog or lapdog? A behavioral view of the media as a corporate governance mechanism’, The Academy of Management Journal, 55:1, pp. 13150.
    [Google Scholar]
  7. Berelson, B. R., Lazarsfeld, P. F. and McPhee, W. N. (1954), Voting: A Study of Opinion Formation in a Presidential Campaign, Chicago, IL: University of Chicago Press.
    [Google Scholar]
  8. Besley, T. and Burgess, R. (2002), ‘The political economy of government responsiveness: Theory and evidence from India’, The Quarterly Journal of Economics, 117:4, pp. 141551, https://doi.org/10.1162/003355302320935061.
    [Google Scholar]
  9. Cagé, J. (2020), ‘Asymmetric information, rent extraction and aid efficiency’, working paper, Cambridge, MA: Harvard University, https://scholar.harvard.edu/cage/publications/asymmetric-information-rent-extraction-and-aid-efficiency. Accessed 4 July 2023.
  10. Chattoo, C. B. and Green-Barber, L. (2021), ‘An investigative journalist and a stand-up comic walk into a bar: The role of comedy in public engagement with environmental journalism’, Journalism, 22:1, pp. 196214, https://doi.org/10.1177/1464884918763526.
    [Google Scholar]
  11. Chong, D. and Druckman, J. N. (2007), ‘Framing theory’, Annual Review of Political Science, 10:1, pp. 10326, https://doi.org/10.1146/annurev.polisci.10.072805.103054.
    [Google Scholar]
  12. Conroy-Krutz, J. (2018), ‘Media exposure and political participation in a transitional African context’, World Development, 110, pp. 22442, https://www.sciencedirect.com/science/article/abs/pii/S0305750X18301505?via%3Dihub. Accessed 4 July 2023.
    [Google Scholar]
  13. DellaVigna, S. and Kaplan, E. (2007), ‘The Fox News effect: Media bias and voting’, The Quarterly Journal of Economics, 122:3, pp. 1187234, https://doi.org/10.1162/qjec.122.3.1187.
    [Google Scholar]
  14. Drèze, J. and Sen, A. (eds) (1991), The Political Economy of Hunger: Volume 1: Entitlement and Well-Being, Oxford: Oxford University Press, https://doi.org/10.1093/acprof:oso/9780198286356.001.0001.
    [Google Scholar]
  15. Druckman, J. N. (2004), ‘Priming the vote: Campaign effects in a U.S. Senate election’, Political Psychology, 25:4, pp. 57794, https://doi.org/10.1111/j.1467-9221.2004.00388.x.
    [Google Scholar]
  16. Dyck, A., Moss, D. and Zingales, L. (2013), ‘Media versus special interests’, The Journal of Law and Economics, 56:3, pp. 52153, https://doi.org/10.1086/673216.
    [Google Scholar]
  17. Dyck, A., Volchkova, N. and Zingales L. (2008), ‘The corporate governance role of the media: Evidence from Russia’, The Journal of Finance, 63:3, pp. 1093135, https://doi.org/10.1111/j.1540-6261.2008.01353.x.
    [Google Scholar]
  18. Einwiller, S. A., Carroll, C. E. and Korn, K. (2010), ‘Under what conditions do the news media influence corporate reputation? The roles of media dependency and need for orientation’, Corporate Reputation Review, 12:4, pp. 299315, https://doi.org/10.1057/crr.2009.28.
    [Google Scholar]
  19. Ferraz, C. and Finan, F. (2008), ‘Exposing corrupt politicians: The effects of Brazil’s publicly released audits on electoral outcomes’, The Quarterly Journal of Economics, 123:2, pp. 70345, https://doi.org/10.1162/qjec.2008.123.2.703.
    [Google Scholar]
  20. Ferraz, C. and Finan, F. (2011), ‘Electoral accountability and corruption: Evidence from the audits of local governments’, American Economic Review, 101:4, pp. 1274311, https://doi.org/10.1257/aer.101.4.1274.
    [Google Scholar]
  21. Gentzkow, M., Shapiro, J. and Sinkinson, M. (2011), ‘The effect of newspaper entry and exit on electoral politics’, American Economic Review, 101:7, pp. 29803018.
    [Google Scholar]
  22. Gerber, A. S., Karlan, D. and Bergan, D. (2009), ‘Does the media matter? A field experiment measuring the effect of newspapers on voting behavior and political opinions’, American Economic Journal: Applied Economics, 1:2, pp. 3552.
    [Google Scholar]
  23. Graves, L. and Shabbir, N. (2019), ‘Gauging the global impacts of the “Panama Papers” three years later’, Reuters Institute for the Study of Journalism, March, https://reutersinstitute.politics.ox.ac.uk/sites/default/files/2019-03/Graves_Gauging_the_Global_Impacts_of_the_Panama_Papers_FINAL_0.pdf.
  24. Green, D. P., Groves, D. W., Manda, C., Montano, B. and Rahmani, B. (forthcoming), ‘The effects of public affairs radio on Tanzanians’ knowledge about politics: Evidence from a planned natural experiment’, Journal of Politics.
    [Google Scholar]
  25. Green-Barber, L. (2014), ‘Media impact model’, Impact Architects, https://s3.us-east-2.amazonaws.com/files.theimpactarchitects.com/Impact+Architects+LLC+Media+Impact+Model+(1).pdf. Accessed 4 July 2023.
  26. Green-Barber, L. (2021), ‘Beyond clicks and shares: How and why to measure the impact of data journalism projects’, in J. Gray (ed.), The Data Journalism Handbook 2: Towards a Critical Data Practice, Maastricht: European Journalism Centre and Google News Initiative.
    [Google Scholar]
  27. Green-Barber, L. and Stonbely, S. (2020), Collaborating for Change: Approaches to Measuring the Impact of Collaborative Journalism, Montclair, NJ: Center for Cooperative Media, https://collaborativejournalism.org/wp-content/uploads/2020/07/Collaborating-for-Change-Approaches-to-measuring-the-impact-of-collaborative-journalism-31JUL2020.pdf. Accessed 4 July 2023.
    [Google Scholar]
  28. Groves, D. W. (2023), ‘Essays on media and accountability’, Ph.D. thesis, New York: Columbia University.
    [Google Scholar]
  29. Hamilton, J. T. (2016), Democracy’s Detectives: The Economics of Investigative Journalism, Cambridge, MA: Harvard University Press.
    [Google Scholar]
  30. Jenkins, J. and Nielsen, R. K. (2020), ‘Proximity, public service, and popularity: A comparative study of how local journalists view quality news’, Journalism Studies, 21:2, pp. 23653, https://doi.org/10.1080/1461670X.2019.1636704.
    [Google Scholar]
  31. Katz, E. and Lazarsfeld, P. F. (1955), Personal Influence: The Part Played by People in the Flow of Mass Communications, New York: Free Press.
    [Google Scholar]
  32. Larreguy, H., Marshall, J. and Snyder, J. M. (2020), ‘Publicizing malfeasance: When the local media structure facilitates electoral accountability in Mexico’, The Economic Journal, 130:631, pp. 2291327, https://doi.org/10.1093/ej/ueaa046.
    [Google Scholar]
  33. Lazarsfeld, P. F., Berelson, B. and Gaudet, H. (1968), The People’s Choice: How the Voter Makes Up His Mind in a Presidential Campaign, New York: Columbia University Press.
    [Google Scholar]
  34. Lippmann, W. (1922), Public Opinion, New York: Free Press.
    [Google Scholar]
  35. Lublinski, J. (2023), ‘Tracking success’, DW Akademie, 10 July, https://www.dw.com/en/tracking-success/a-54106121. Accessed 10 July 2023.
    [Google Scholar]
  36. Lublinski, J., Spurk, C., Fleury, J.-M., Labassi, O., Mbarga, G., Nicolas, M. L. and Rizk, T. A. (2016), ‘Triggering change: How investigative journalists in Sub-Saharan Africa contribute to solving problems in society’, Journalism, 17:8, pp. 107494, https://doi.org/10.1177/1464884915597159.
    [Google Scholar]
  37. Martin, G. J. and Yurukoglu, A. (2017), ‘Bias in cable news: Persuasion and polarization’, American Economic Review, 107:9, pp. 256599, https://doi.org/10.1257/aer.20160812.
    [Google Scholar]
  38. McCombs, M. E. and Shaw, D. L. (1972), ‘The agenda-setting function of mass media’, The Public Opinion Quarterly, 36:2, pp. 17687.
    [Google Scholar]
  39. Napoli, P. M. (2014), Measuring Media Impact (Media Impact Project), Los Angeles, CA: The Norman Lear Center.
    [Google Scholar]
  40. Narisetti, R. (2014), ‘In defense of “vanity” metrics: Why page views are still important’, Poynter, 21 March, https://www.poynter.org/reporting-editing/2014/in-defense-of-vanity-metrics-why-page-views-are-still-important/. Accessed 16 June 2023.
  41. Payne, J. M., Boix, C. and Adserà, A. (2000), Are You Being Served? Political Accountability and Quality of Government, Washington, DC: Inter-American Development Bank, https://publications.iadb.org/en/publication/are-you-being-served-political-accountability-and-quality-government. Accessed 4 July 2023.
    [Google Scholar]
  42. Petre, C. (2015), ‘The traffic factories: Metrics at Chartbeat, Gawker Media, and the New York Times’, Columbia Journalism Review, 7 May, https://www.cjr.org/tow_center_reports/the_traffic_factories_metrics_at_chartbeat_gawker_media_and_the_new_york_times.php/. Accessed 10 June 2023.
    [Google Scholar]
  43. Pitt, F. and Green-Barber, L. (2017), The Case for Media Impact: A Case Study of ICIJ’s Radical Collaboration Strategy, New York: Tow Center for Digital Journalism, Columbia University, https://www.cjr.org/tow_center_reports/the-case-for-media-impact.php/. Accessed 10 June 2023.
    [Google Scholar]
  44. Powers, E. (2018), ‘Selecting metrics, reflecting norms’, Digital Journalism, 6:4, pp. 4966, https://doi.org/10.1080/21670811.2018.1445002.
    [Google Scholar]
  45. Protess, D. L. (ed.) (1991), The Journalism of Outrage: Investigative Reporting and Agenda Building in America, 2nd ed., New York: Guilford Press.
    [Google Scholar]
  46. Rubado, M. E. and Jennings, J. T. (2020), ‘Political consequences of the endangered local watchdog: Newspaper decline and mayoral elections in the United States’, Urban Affairs Review, 56:5, pp. 132756, https://doi.org/10.1177/1078087419838058.
    [Google Scholar]
  47. Schiffrin, A. and Lugalambi, G. W. (eds) (2016), African Muckraking: 75 Years of Investigative Journalism from Africa, Johannesburg: Jacana Media.
    [Google Scholar]
  48. Schiffrin, A. and Zuckerman, E. (2015), ‘Can we measure media impact? Surveying the field’, Stanford Social Innovation Review, 13:4, pp. 4851, https://doi.org/10.48558/0V0Q-B165.
    [Google Scholar]
  49. Schulhofer-Wohl and Garrido, M. (2009), ‘Do newspapers matter? Short-run and long run evidence from the closure of The Cincinnati Post’, working paper no. 14817, Cambridge, MA: The National Bureau of Economic Research.
    [Google Scholar]
  50. Sen, A. (1982), ‘Food battles: Conflict in the access to food’, Coromandel Lecture, 13 December.
  51. Snyder, J. M. and Strömberg, D. (2010), ‘Press coverage and political accountability’, Journal of Political Economy, 118:2, pp. 355408, https://doi.org/10.1086/652903.
    [Google Scholar]
  52. Spurk, C. and Koch, C. (2019), The Use of Theories of Change in Media and Governance Programmes (Swiss Agency for Development and Cooperation), Zurich: Institute of Applied Media Studies, https://www.shareweb.ch/site/DDLGN/Documents/Theories%20of%20Change_Media%20Programmes%20and%20Research%20Evidence_2019.pdf. Accessed 4 July 2023.
    [Google Scholar]
  53. Stray, J. (2012), ‘Metrics, metrics everywhere: How do we measure the impact of journalism?’, Nieman Lab, 17 August, https://www.niemanlab.org/2012/08/metrics-metrics-everywhere-how-do-we-measure-the-impact-of-journalism/. Accessed 4 July 2023.
  54. Tofel, R. J. (2013), ‘Issues around impact’, white paper, New York: ProPublica.
    [Google Scholar]
  55. Urbina, I. (2021), ‘This innovative project fuses journalism and music to highlight lawlessness at sea’, World Economic Forum, 4 May, https://www.weforum.org/agenda/2021/05/innovative-project-journalism-music-lawlessness-at-sea/. Accessed 16 June 2023.
/content/journals/10.1386/ajms_00121_1
Loading
/content/journals/10.1386/ajms_00121_1
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error