Prototyping first-person viewer positions for VR narratives with storyboards and pilot productions | Intellect Skip to content
1981
Virtual Reality: Exploring Technologies, Practices and Paradigms
  • ISSN: 1759-7137
  • E-ISSN: 1759-7145

Abstract

In this article, we present two related approaches to scripting or prototyping VR narratives. We tested storyboarding and pilot production techniques with 40 students over two years, and they were tasked with creating documentary VR narratives characterized by embodied moods and experiences. The aim was to help students tailor a strong first-person viewer relationship with the virtual environment utilizing the ways the body can be centred in story worlds. In particular, the article deals with character positioning and point of view-writing in the first-person, drawing on insights from human–computer interaction (HCI) and postphenomenology. There is an ongoing exploration of new experimental approaches to story world production for immersive media, and prototyping processes from fields such as HCI are becoming increasingly relevant for screenwriters. We provide analyses of how storyboards and pilot productions can situate the user in relation to the virtual environment. Based on the analyses, we evaluate the use value of such prototyping for students and practitioners who need to make first-person viewer positions for VR narratives, and we compare our approach with similar pedagogical projects as represented in the literature.

Funding
This study was supported by the:
  • The Norwegian Research Council, and TekLab
  • The Norwegian Directorate of Higher Education and Skills
Loading

Article metrics loading...

/content/journals/10.1386/josc_00133_1
2024-02-02
2024-04-29
Loading full text...

Full text loading...

References

  1. Ashtari, N., Bunt, A., McGrenere, J., Nebeling, M. and Chilana, P. K. (2020), ‘Creating augmented and virtual reality applications: Current practices, challenges, and opportunities’, in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 113.
    [Google Scholar]
  2. Boyd, L., Wasserman, B., Hayes, G., Day, K., Abdo, K. and Linstead, E. (2019), ‘Paper prototyping comfortable VR play for diverse sensory needs’, in Proceedings of the Conference on Human Factors in Computing Systems, Association for Computing Machinery, CHI 2019, Glascow, Scotland, UK, 4–9 May, pp. 16.
    [Google Scholar]
  3. Buchenau, M. and Suri, J. F. (2000), ‘Experience prototyping’, in Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, ACM, DIS 2000, New York City, USA, 7–9 August, pp. 42433.
    [Google Scholar]
  4. Buckingham, D. (2019), The Media Education Manifesto, Cambridge: Polity Press.
    [Google Scholar]
  5. Darsø, L. (2019), Innovationspædagagogik: Kunsten at fremelske innovationskompetence, Copenhagen: Samfundsliteratur.
    [Google Scholar]
  6. Dooley, K. (2017), ‘Storytelling with virtual reality in 360-degrees: A new screen grammar’, Studies in Australasian Cinema, 11:3, pp. 16171.
    [Google Scholar]
  7. Dooley, K., Stuart, B., Gregory, F., Bettina, F., Alex, M. and Max, S. (2020), ‘Immersive media practices in the classroom: Models of the teaching research nexus in an Australian context’, Media Practice and Education, 21:4, pp. 24160, https://doi.org/10.1080/25741136.2020.1832829.
    [Google Scholar]
  8. Flobak, E., Wake, J. D., Vindenes, J., Kahlon, S., Nordgreen, T. and Guribye, F. (2019), ‘Participatory design of VR scenarios for exposure therapy’, in Proceedings of the 2019 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Association for Computing Machinery, CHI 2019, Glascow, Scotland, UK, 4–9 May, pp. 112, https://doi.org/10.1145/3290605.3300799.
    [Google Scholar]
  9. Gödde, M., Gabler, F., Siegmund, D. and Braun, A. (2018), ‘Cinematic narration in VR: Rethinking film conventions for 360 degrees’, in International Conference on Virtual, Augmented and Mixed Reality, Lecture Notes in Computer Science (LNCS, vol. 10910), Las Vegas, NV, USA, 15–20 July, pp. 184201.
    [Google Scholar]
  10. Hall, S. ([1973] 1991), ‘Encoding, decoding’, in S. During (ed.), The Cultural Studies Reader, London: Routledge, pp. 90103.
    [Google Scholar]
  11. Henrikson, R., Araujo, B. De, Chevalier, F., Singh, K. and Balakrishnan, R. (2016a), ‘Multi-device storyboards for cinematic narratives in VR’, in UIST 2016: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, Association for Computing Machinery, Tokyo, Japan, October, pp. 78796.
    [Google Scholar]
  12. Henrikson, R., Bruno De Araujo, B., Chevalier, F., Singh, K. and Balakrishnan, R. (2016b), ‘Storeoboard: Sketching stereoscopic storyboards’, in Proceedings of Conference on Human Factors in Computing Systems, Association for Computing Machinery, San Jose, CA, USA, 7–12 May, pp. 458798.
    [Google Scholar]
  13. Heyward, M. (2019), ‘VR and screen education: An approach to assist student understanding of narrative emphasis, spatiality and structural elements within narrative VR’, in C. Batty, M. Berry, K. Dooley, B. Frankham and S. Kerrigan (eds), The Palgrave Handbook of Screen Production, Cham: Palgrave Macmillan, pp. 44358, https://doi.org/10.1007/978-3-030-21744-0_34.
    [Google Scholar]
  14. Ho, J. C. F. (2017), ‘Training virtual reality and augmented reality prototyping without coding’, in CHI EA 17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver, CO, USA, 6–11 May, pp. 264651.
    [Google Scholar]
  15. Ihde, D. (2008), The Designer Fallacy and Technological Mediation, Philosophy and Design, Dordrecht: Springer.
    [Google Scholar]
  16. Ihde, D. (2012), Experimental Phenomenology, 2nd ed., Albany, NY: State University of New York Press.
    [Google Scholar]
  17. Ihde, D. (2015), ‘Preface: Positioning postphenomenology’, in R. Rosenberger and P. P. Verbeek (eds), Postphenomenological Investigations: Essays on Human–Technology Relations, Lanham, MD: Lexington Books, p. 282.
    [Google Scholar]
  18. Kettunen, J., Kairisto-Mertanen, L. and Penttilä, T. (2013), ‘Innovation pedagogy and desired learning outcomes in higher education’, On the Horizon, 21:4, pp. 33342.
    [Google Scholar]
  19. Lim, Y., Pangam, A., Periyasami, S. and Aneja, S. (2006), ‘Comparative analysis of high- and low-fidelity prototypes for more valid usability evaluations of mobile devices’, in Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles (NordiCHI '06), New York: Association for Computing Machinery, pp. 291300, https://doi.org/10.1145/1182475.1182506.
    [Google Scholar]
  20. Lim, Y. K., Stolterman, E. and Tenenberg, J. (2008), ‘The anatomy of prototypes: Prototypes as filters, prototypes as manifestations of design ideas’, ACM Transactions on Computer–Human Interaction, 15:2, pp. 127.
    [Google Scholar]
  21. Mateer, J. (2017), ‘Directing for cinematic virtual reality: How the traditional film director’s craft applies to immersive environments and notions of presence’, Journal of Media Practice, 18:1, pp. 1425.
    [Google Scholar]
  22. Merleau-Ponty, M. ([1945] 2002), Phenomenology of Perception, London: Routledge.
    [Google Scholar]
  23. Millard, K. (2014), Screenwriting in a Digital Era, Palgrave Studies in Screenwriting, London: Palgrave Macmillan.
    [Google Scholar]
  24. Moustakas, C. E. (1994), Phenomenological Research Methods, Thousand Oaks, CA: Sage Publications, Inc.
    [Google Scholar]
  25. Murray, J. H. (1997), Hamlet on the Holodeck: The Future of Narrative in Cyberspace, Cambridge, MA: MIT Press.
    [Google Scholar]
  26. Nebeling, M. (2019), ‘Rapid prototyping of augmented reality & virtual reality interfaces’, in CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, Glasgow, Scotland, UK, 4–9 May, Glasgow: ACM, pp. 16.
    [Google Scholar]
  27. Nielsen, J. (1989), Usability Engineering at a Discount, Designing and Using Human–Computer Interfaces and Knowledge Based Systems (eds G. Salvendy and M. J. Smith), Amsterdam: Elsevier Science Publishers B.V.
    [Google Scholar]
  28. Nyre, L., Guribye, F. and Gynnild, A. (2018), Taking Risks with Drones, Responsible Drone Journalism, 1st ed., London: Routledge, https://doi.org/10.4324/9781315163659-6.
    [Google Scholar]
  29. Nyre, L. and Vindenes, J. (2021), Immersive Journalism as Witnessing, Immersive Journalism as Storytelling: Ethics, Production and Design, 1st ed., London: Routledge.
    [Google Scholar]
  30. Pallant, C. and Price, S. (2015), Storyboarding: A Critical History, Palgrave Studies in Screenwriting, London: Palgrave Macmillan.
    [Google Scholar]
  31. Rosenberger, R. and Verbeek, P.-P. (2015), Postphenomenological Investigations: Essays on Human–Technology Relations, Lexington Books.
    [Google Scholar]
  32. Ross, M. and Munt, A. (2018), ‘Cinematic virtual reality: Towards the spatialized screenplay’, Journal of Screenwriting, 9:2, pp. 191209.
    [Google Scholar]
  33. Sánchez Laws, A. L. (2020), Conceptualising Immersive Journalism, London: Routledge Focus.
    [Google Scholar]
  34. Speicher, M. and Nebeling, M. (2018), ‘GestureWiz: A human-powered gesture design environment for user interface prototypes’, in Proceedings of the Conference on Human Factors in Computing Systems, Association for Computing Machinery, Montréal, Canada, April, pp. 111.
    [Google Scholar]
  35. Vindenes, J. and Gynnild, A. (2020), ‘Case euronews’, Immersive Journalism as Storytelling: Ethics, Production and Design, London: Routledge, https://doi.org/10.4324/9780429437748-4.
    [Google Scholar]
  36. Vindenes, J. and Wasson, B. (2021), ‘A postphenomenological framework for studying user experience of immersive virtual reality’, Frontiers in Virtual Reality, 2, pp. 115, https://doi.org/10.3389/frvir.2021.656423.
    [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1386/josc_00133_1
Loading
/content/journals/10.1386/josc_00133_1
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error