Telling stories in soundspace: Placement, embodiment and authority in immersive audio journalism | Intellect Skip to content
1981
  1. Home
  2. A-Z Publications
  3. Radio Journal:International Studies in Broadcast & Audio Media
  4. Volume 19, Issue 2
  5. Article
Volume 19, Issue 2
  • ISSN: 1476-4504
  • E-ISSN: 2040-1388

Abstract

There has been an increase in the use of immersive or spatialized audio formats for radio and podcast journalism. Immersion is used to put audiences at the heart of a story, enable richer experiences and encourage empathy with others, but it can disrupt the ‘grammar’ of broadcast formats and the codes that structure the relationship between audience, journalist and story. Immersive journalism research has not tackled the impact on audio-only storytelling, and the lack of research by and for audio journalists means programme-makers have until now lacked a conceptual framework and terminology to describe how space is constructed in immersive audio, the creative and editorial choices available and their effects. This article, based on analysis of immersive output and interviews with those who produce it, critically examines the differences between mono/stereo space and immersive audio space and argues they are not only a matter of aesthetics or comfort, but communicate differential authority over the story and merit further attention when journalists are trained in immersive audio.

© 2021 Intellect Ltd
Loading

Article metrics loading...

/content/journals/10.1386/rjao_00048_1
2021-10-01
2024-04-24
Loading full text...

Full text loading...

References

  1. Agrawal, Sarvesh,, Simon, Adèle,, Bech, Søren,, Bærentsen, Klaus, and Forchhammer, Søren. ( 2019;), ‘ Defining immersion: Literature review and implications for research on immersive audiovisual experiences. ’, Proceedings of the 147th AES Pro Audio International Convention, New York, USA, 16–18 October.
     [Google Scholar]
  2. Altman, Rick. ( 1992), Sound Theory, Sound Practice, New York:: Routledge;.
     [Google Scholar]
  3. Alzamora, Geane, and Tárcia, Lorena. ( 2012;), ‘ Convergence and transmedia: Semantic galaxies and emergent narratives in journalism. ’, Brazilian Journalism Research, 8:1, pp. 22–34.
     [Google Scholar]
  4. Batchelor, Peter. ( 2019;), ‘ Grasping the intimate immensity: Acousmatic compositional techniques in sound art as “something to hold on to”. ’, Organised Sound, 24:3, pp. 307–18.
     [Google Scholar]
  5. Bull, Michael. (ed.) ( 2018), The Routledge Companion to Sound Studies, Abingdon:: Routledge;.
     [Google Scholar]
  6. Chainon, Jean-Yves, and Chainon, Carole. ( 2018), A Pocket Field Guide: 360 Video Storytelling for Editors and Newsroom Managers, The Lookout Station and Global Editors Network;, https://drive.google.com/file/d/1i8cn54PavfNqRCPIOpe7rOJEqW50u1An/view. Accessed 13 November 2021.
     [Google Scholar]
  7. Chion, Michel. ( 1994), Audio-Vision: Sound On Screen (ed. and trans. C. Gorbman.), New York:: Columbia University Press;.
     [Google Scholar]
  8. Chion, Michel. ( 1998;), ‘ The silence of the loudspeakers; or, why with Dolby Sound it is the film that listens to us. ’, in L. Sider,, D. Freeman, and J. Sider. (eds), Soundscape: The School of Sound Lectures, 1998 to 2001, London:: School of Sound;, pp. 150–54.
     [Google Scholar]
  9. Clayman, Steven. ( 1988;), ‘ Displaying neutrality in television news interviews. ’, Social Problems, 35:4, pp. 474–92.
     [Google Scholar]
  10. Clayman, Steven. ( 1991;), ‘ News interview openings: Aspects of sequential organization. ’, in P. Scannell. (ed.), Broadcast Talk, London:: Sage;, pp. 48–75.
     [Google Scholar]
  11. Clayman, Steven, and Heritage, John. ( 2002), The News Interview: Journalists and Public Figures on the Air, Cambridge:: Cambridge University Press;.
     [Google Scholar]
  12. Cobussen, Marcel,, Meelberg, Vincent, and Truax, Barry. ( 2017), The Routledge Companion to Sounding Art, London:: Routledge;.
     [Google Scholar]
  13. Crisell, Andrew. ( 1994), Understanding Radio, , 2nd ed.., London:: Routledge;.
     [Google Scholar]
  14. Crook, Tim. ( 1998), International Radio Journalism: History, Theory and Practice, London and New York:: Routledge;.
     [Google Scholar]
  15. Daugherty, Terry,, Gangadharbatia, Harsha, and Bright, Laura. ( 2010;), ‘ Telepresence and persuasion. ’, in C. Bracken, and D. Skalsi. (eds), Immersed in Media: Telepresence in Everyday Life, New York and Abingdon:: Routledge;, pp. 113–36.
     [Google Scholar]
  16. Dolan, Devon, and Perets, Michael. ( 2016;), ‘ Redefining the axiom of story: The VR and 360 video complex. ’, 19 December, https://medium.com/@devon.michael/redefining-the-axiom-of-storythe-vr-and-360-video-complex-bee3c20d69df#.94ngjcddg. Accessed 17 July 2020.
  17. Dominguez, Eva. ( 2017;), ‘ Going beyond the classic news narrative convention: The background to and challenges of immersion in journalism. ’, Frontiers in Digital Humanities, 4:10, https://doi.org/10.3389/fdigh.2017.00010. Accessed 11 October 2021.
     [Google Scholar]
  18. Douglas, Susan Jeanne. ( 2004), Listening In: Radio and the American Imagination, Minneapolis, MN:: University of Minnesota Press;.
     [Google Scholar]
  19. Dussert, Margaux. ( 2019;), ‘ Le son binaural, la révolution sonore qui va faire chavirer vos oreilles. ’, L’Adn , 9 March, https://www.ladn.eu/mondes-creatifs/son-3d-binaural-revolution-sonore/. Accessed 16 July 2020.
  20. Ekman, Inger, and Kajastila, Raine. ( 2009;), ‘ Localisation cues affect emotional judgements: Results from a user study on scary sound. ’, 35th Audio Engineering Society International Conference on Audio for Games, London, UK, 11–13 February, https://www.aes.org/e-lib/browse.cfm?elib=15177. Accessed 11 October 2021.
     [Google Scholar]
  21. Elmezeny, Ahmed,, Edenhofer, Nina, and Wimmer, Jeffrey. ( 2018;), ‘ Immersive storytelling in 360-degree videos: An analysis of interplay between narrative and technical immersion. ’, Journal of Virtual Worlds Research, 11:1, https://doi.org/10.4101/jvwr.v11i1.7298. Accessed 16 December 2021.
     [Google Scholar]
  22. Floros, Andreas, and Tatlas, Nicolas-Alexander. ( 2011;), ‘ Spatial enhancement for immersive stereo audio applications. ’, 17th International Conference on Digital Signal Processing (DSP), Corfu, Greece, 6–8 July, IEEE;, https://doi.org/10.1109/ICDSP.2011.6005001. Accessed 11 October 2021.
     [Google Scholar]
  23. Francombe, Jon,, Brookes, Tim,, Mason, Russell, and Woodcock, James. ( 2017;), ‘ Evaluation of spatial audio reproduction methods (part 2): Analysis of listener preference. ’, Journal of the Audio Engineering Society, 65:3, pp. 212–25.
     [Google Scholar]
  24. Francombe, Jon,, Woodcock, James,, Hughes, Richard J.,, Mason, Russell,, Franck, Andreas,, Pike, Christopher R.,, Brookes, Tim,, Davies, William J.,, Jackson, Philip J. B.,, Cox, Trevor J.,, Fazi, Filippo M., and Hilton, Adrian. ( 2018;), ‘ Qualitative evaluation of media device orchestration for immersive spatial audio reproduction. ’, Journal of the Audio Engineering Society, 66:6, pp. 414–29.
     [Google Scholar]
  25. Futuresource ( 2019;), ‘ Futuresource headphones market report. ’, 19 October, https://www.futuresource-consulting.com/reports/futuresource-consumer-headphones-market/?locale=en. Accessed 20 August 2020.
  26. Hacıhabiboğlu, Hüseyin,, Sena, Enzo De,, Cvetkovic, Zoran,, Johnston, James, and Smith III, Julius O.. ( 2017;), ‘ Perceptual spatial audio recording, simulation, and rendering: An overview of spatial-audio techniques based on psychoacoustics. ’, IEEE Signal Processing Magazine, 34:3, pp. 36–54.
     [Google Scholar]
  27. Healy, Amber. ( 2018;), ‘ Podcast #308 – How to create interactive, immersive experiences in journalism. ’, It’s All Journalism, 31 May, https://itsalljournalism.com/308-interactive-immersive-experiences-in-journalism/. Accessed 24 November 2021.
     [Google Scholar]
  28. Hearing Homelessness ( 2019), BBC Radio 4, UK, 5 August, 11 a.m. , https://www.bbc.co.uk/programmes/m0007bjl. Accessed 18 June 2020.
  29. Herre, Jurgen,, Hilpert, Johannes,, Kuntz, Achim, and Plogsties, Jan. ( 2015;), ‘ MPEG-H 3D audio-the new standard for coding of immersive spatial audio. ’, IEEE Journal of Selected Topics in Signal Processing, 9:5, pp. 770–79.
     [Google Scholar]
  30. Høier, Svein. ( 2012;), ‘ The relevance of point of audition in television sound: Rethinking a problematic term. ’, Journal of Sonic Studies, 3, https://www.researchcatalogue.net/view/252390/252391. Accessed 11 October 2021.
     [Google Scholar]
  31. Hutchby, Ian. ( 2006), Media Talk: Conversation Analysis and the Study of Broadcasting, Maidenhead:: Open University Press;.
     [Google Scholar]
  32. Ihde, Don. ( 2007), Listening and Voice: Phenomenologies of Sound, , 2nd ed.., Albany, NY:: State University of New York Press;.
     [Google Scholar]
  33. Jones, Sarah. ( 2017;), ‘ Disrupting the narrative: Immersive journalism in virtual reality. ’, Journal of Media Practice, 18:2&3, pp. 171–85.
     [Google Scholar]
  34. ‘Joujouka’ ( 2017), Wireless Nights, BBC Radio 4;, UK:, 13 March, 11 p.m .
     [Google Scholar]
  35. Kerins, Mark. ( 2011), Beyond Dolby (Stereo) Cinema in the Digital Sound Age, Bloomington, IN:: Indiana University Press;.
     [Google Scholar]
  36. Koski, Olivia. ( 2015;), ‘ Step into the story: How virtual reality and other technologies are fostering immersive storytelling. ’, Nieman Reports, 69:1, p. 8.
     [Google Scholar]
  37. Krebs, Stefan. ( 2017;), ‘ The failure of binaural stereo: German sound engineers and the introduction of artificial head microphones. ’, ICON, 23, pp. 113–44.
     [Google Scholar]
  38. Kyriakakis, Chris. ( 1998;), ‘ Fundamental and technological limitations of immersive audio systems. ’, Proceedings of the IEEE, 86:5, pp. 941–51.
     [Google Scholar]
  39. la Peña, Nonny de. ( 2016;), ‘ Step inside the future: Virtual reality will let us understand the world in ways photography never could. ’, MIT Technology Review, 21 June, https://www.technologyreview.com/2016/06/21/108289/step-inside-the-future/. Accessed 13 November 2021.
     [Google Scholar]
  40. la Peña, Nonny de,, Weil, Peggy,, Llobera, Joan,, Giannopoulos, Elias,, Pomés Freixa, Ausiàs,, Spanlang, Bernhard,, Friedman, Doron,, Sánchez-Vives, María Victoria,, and Slater, Mel. ( 2010;), ‘ Immersive journalism: Immersive virtual reality for the first-person experience of news. ’, Presence: Teleoperators and Virtual Environments, 19:4, pp. 291–301.
     [Google Scholar]
  41. ‘L’Accent et la cigale’ ( 2016), Création on Air, France Culture;, France:, 12 October, https://www.franceculture.fr/emissions/creation-air/laccent-et-la-cigale. Accessed 17 July 2020.
     [Google Scholar]
  42. ‘L’Ardèche souterraine’ ( 2015), Si Loin Si Proche, Radio France Internationale;, France:, 5 August, https://www.rfi.fr/fr/emission/20150829-ardeche-grotte-chauvet-speleologie-tourisme-souterrain. Accessed 16 July 2020.
     [Google Scholar]
  43. Lee, Young Woo, and Kim, Sunmin. ( 2013;), ‘ Hybrid immersive audio architecture based on 3D object layer. ’, in IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, USA, 11–14 January, pp. 318–19.
     [Google Scholar]
  44. Licht, Alan. ( 2007), Sound Art: Beyond Music, between Categories, New York:: Rizzoli;.
     [Google Scholar]
  45. Licht, Alan. ( 2019), Sound Art Revisited, New York:: Bloomsbury Academic;.
     [Google Scholar]
  46. Maasø, Arndt. ( 2008;), ‘ The proxemics of the mediated voice. ’, in J. Beck, and T. Grajeda. (eds), Lowering the Boom: Critical Studies in Film Sound, Urbana and Chicago, IL:: University of Illinois Press;, pp. 36–50.
     [Google Scholar]
  47. Mabrook, Radwa, and Singer, Jane B.. ( 2019;), ‘ Virtual reality, 360° video, and journalism studies: Conceptual approaches to immersive technologies. ’, Journalism Studies, 20:14, pp. 2096–112.
     [Google Scholar]
  48. Madsen, Virginia M.. ( 2010;), ‘ A call to listen: The “new” documentary in radio-encountering “wild sound” and the “filme sonore”. ’, Historical Journal of Film, Radio and Television, 30:3, pp. 391–410.
     [Google Scholar]
  49. Mayhew, Freddy. ( 2018;), ‘ BBC world service boosts global audience by 10m after biggest expansion since the 1940s, new figures show. ’, Press Gazette, 22 June, https://www.pressgazette.co.uk/bbc-world-service-boosts-audience-by-10m-after-biggest-expansion-since-the-1940s-new-figures-show/. Accessed 11 October 2021.
     [Google Scholar]
  50. Melchior, Frank,, Churnside, Anthony, and Spors, Sascha. ( 2012;), ‘ Emerging technology trends in spatial audio. ’, SMPTE Motion Imaging Journal, 121:6, pp. 95–100.
     [Google Scholar]
  51. Murray, Janet H.. ( 2016;), ‘ Not a film and not an empathy machine: How necessary failures will help VR designers invent new storyforms. ’, Immerse, 6 October, https://immerse.news/not-a-film-and-not-an-empathy-machine-48b63b0eda93#.xrpd2397t. Accessed 24 November 2021.
     [Google Scholar]
  52. Newton, Katy, and Soukup, Karin. ( 2016;), ‘ The storyteller’s guide to the virtual reality audience. ’, Medium , 6 April, https://medium.com/stanford-d-school/the-storyteller-s-guide-to-the-virtual-reality-audience-19e92da57497. Accessed 11 October 2021.
  53. ‘Omay’ ( 2018), Between the Ears, Phantom for BBC Radio 3;, UK:, 16 June, 9.30 p.m .
     [Google Scholar]
  54. Owen, Taylor,, Pitt, Fergus,, Aronson-Rath, Raney, and Milward, James. ( 2015;), ‘ Virtual reality journalism. ’, Columbia Journalism Review and Tow Center;, 11 November, https://www.cjr.org/tow_center_reports/virtual_reality_journalism.php/. Accessed 12 November 2021.
     [Google Scholar]
  55. Paul, Stephan. ( 2009;), ‘ Binaural recording technology: A historical review and possible future developments. ’, Acta Acustica United with Acustica, 95:5, pp. 767–88.
     [Google Scholar]
  56. Pavlik, John V., and Bridges, Frank. ( 2013;), ‘ The emergence of augmented reality (AR) as a storytelling medium in journalism. ’, Journalism & Mass Communication Monographs, 15:1, pp. 4–59.
     [Google Scholar]
  57. Pike, Christopher William. ( 2019;), ‘ Evaluating the perceived quality of binaural technology. ’, Doctoral thesis, York:: University of York;, http://etheses.whiterose.ac.uk/24022/. Accessed 12 November 2021.
     [Google Scholar]
  58. Pullki, Ville, and Karjalainen, Matti. ( 2015), Communication Acoustics: An Introduction to Speech, Audio and Psychoacoustics, Chichester:: Wiley;.
     [Google Scholar]
  59. Punday, Daniel. ( 2003), Narrative Bodies: Towards a Corporeal Narratology, New York and Basingstoke:: Palgrave Macmillan;.
     [Google Scholar]
  60. RAJAR ( 2019;), ‘ Data release Q3 2019. ’, https://www.rajar.co.uk/docs/news/RAJAR_DataRelease_InfographicQ32019.pdf. Accessed 12 November 2021.
  61. Roginska, Agnieszka. ( 2018;), ‘ Binaural audio through headphones. ’, in A. Roginska, and P. Geluso. (eds), Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio, Abingdon:: Routledge;, pp. 88–123.
     [Google Scholar]
  62. Scannell, Paddy, and Cardiff, David. ( 1991), A Social History of British Broadcasting: Vol. 1, 1922–1939, Serving the Nation, Oxford:: Blackwell;.
     [Google Scholar]
  63. Stefani, Benoît. ( 2020;), ‘ Tournage: RFI: Le Son 3D Dans Tous Ses États. ’, Mediakwest, January, pp. 16–18.
     [Google Scholar]
  64. Théberge, Paul,, Devine, Kyle, and Everrett, Tom. ( 2015), Living Stereo: Histories and Multicultures of Multichannel Sound, London:: Bloomsbury;.
     [Google Scholar]
  65. Tuchman, Gaye. ( 1972;), ‘ Objectivity as strategic ritual: An examination of newsmen’s notions of objectivity. ’, American Journal of Sociology, 77:4, pp. 660–79.
     [Google Scholar]
  66. Tuchman, Gaye. ( 1973;), ‘ Making news by doing work: Routinizing the unexpected. ’, American Journal of Sociology, 79:1, pp. 110–31.
     [Google Scholar]
  67. Tuchman, Gaye. ( 1978), Making News: A Study in the Construction of Reality, New York:: Free Press;.
     [Google Scholar]
  68. Van Damme, Kristin,, All, Anissa,, De Marez, Lieven, and Van Leuven, Sarah. ( 2019;), ‘ 360° video journalism: Experimental study on the effect of immersion on news experience and distant suffering. ’, Journalism Studies, 20:14, pp. 2053–76.
     [Google Scholar]
  69. Verma, Neil. ( 2012), Theater of the Mind: Imagination, Aesthetics and American Radio Drama, Chicago, IL:: The University of Chicago Press;.
     [Google Scholar]
  70. ‘Voodoo in West Africa’ ( 2004), Radio Expeditions, NPR;, USA:, 9–11 February.
     [Google Scholar]
  71. Watson, Zillah. ( 2017), VR for News: The New Reality?, Oxford:: Reuters Institute;.
     [Google Scholar]
  72. Westerkamp, Hildegard. ( 1989), Kits Beach Soundwalk, https://www.hildegardwesterkamp.ca/sound/comp/3/kitsbeach/. Accessed 13 November 2021.
     [Google Scholar]
  73. Wincott, Abigail,, Martin, Jean, and Richards, Ivor. ( 2020;), ‘ Spatial awareness: State of the art and future needs of spatial audio journalism. ’, Falmouth University Repository, September, http://falmouth.eprints-hosting.org/id/eprint/4059. Accessed 11 October 2021.
  74. Winn, Ross. ( 2020;), ‘ Podcast stats & facts (new research from Jan 2020). ’, Podcast Insights , https://www.podcastinsights.com/podcast-statistics/. Accessed 5 February 2020.
  75. Winslow, George. ( 2015;), ‘ Looking to lift the sound bar: New immersive audio systems can offer enhancements for programmers. ’, Multichannel News, 36:21, p. 13.
     [Google Scholar]
  76. Yao, Shu-Nung. ( 2017;), ‘ Headphone-based immersive audio for virtual reality headsets (technical report). ’, IEEE Transactions on Consumer Electronics, 63:3, pp. 300–08.
     [Google Scholar]
  77. Wincott, Abigail,, Martin, Jean, and Richards, Ivor. ( 2021;), ‘ Telling stories in soundspace: Placement, embodiment and authority in immersive audio journalism. ’, Radio Journal: International Studies in Broadcast & Audio Media, 19:2, pp. 253–70, https://doi.org/10.1386/rjao_00048_1
     [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1386/rjao_00048_1
Loading
  • Article Type: Article
Keyword(s): binaural; documentary; immersive journalism; journalism; radio features; spatial audio

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error