Skip to content
1981
AI, Augmentation and Art
  • ISSN: 2633-8793
  • E-ISSN: 2633-8785

Abstract

The use of augmented reality (AR) in literature has predominantly focused on providing instructional tools for educators and learners, emphasizing its capacity of enhancing engagement and supporting immersive learning. Aside from its central literacy purpose, AR in children’s literature appears in the form of digital pop-up books or as add-on games, which are usually located outside of the main narrative. In this sense, AR risks disrupting the flow of a story instead of enriching the continuous imaginative space of the narrative. The Dragon Defenders series, by James Russell, uses AR as a narrative tool in ways previously unseen in children’s literature. Russell puts the reader into the shoes of his main characters, Paddy and Flynn, using AR to show the reader what the boys themselves see. There are moments in these books where the AR system and traditional narrative system fully overlap, integrate and enhance the narrative dimension of the story. While readers navigate through the book by turning physical pages, the addition of AR at specific moments in the story not only provides a more immersive reading experience but, in this case, advances the narrative to great effect. This case study asks how AR can be used to enhance the narrative structure and flow in a text-based novel, using formal gameplay analysis to examine how the AR and narrative systems interact and identifying which examples of this interaction work to the best effect. It analyses the AR moments in the context of the book, deconstructs the unusual first-person perspective from the protagonist’s point of view and explores how these AR experiences help drive and truly augment the core narrative. The larger context of this study seeks to emancipate AR from its predominantly technological ontology and contribute to the development of AR as a genuine narrative device in fiction storytelling.

Loading

Article metrics loading...

/content/journals/10.1386/jpm_00007_1
2023-08-18
2024-12-11
Loading full text...

Full text loading...

References

  1. Aarseth, E.. ( 1997), Cybertext: Perspectives on Ergodic Literature, Baltimore, MD:: Johns Hopkins University Press;.
    [Google Scholar]
  2. Alleyne, B.. ( 2015), Narrative Networks: Storied Approaches in a Digital Age, London:: Sage;.
    [Google Scholar]
  3. Billinghurst, M., and Dünser, A.. ( 2012;), ‘ Augmented reality in the classroom. ’, Computer, 45:7, pp. 5663.
    [Google Scholar]
  4. Billinghurst, M.,, Kato, H., and Poupyrev, I.. ( 2001;), ‘ The MagicBook: Moving seamlessly between reality and virtuality. ’, IEEE Computer Graphics and Applications, 21:3, pp. 68.
    [Google Scholar]
  5. Bissell, T.. ( 2010), Extra Lives: Why Video Games Matter, New York:: Pantheon Books;.
    [Google Scholar]
  6. Chang, C. C.,, Lei, H., and Tseng, J. S.. ( 2011;), ‘ Media presentation mode, English listening comprehension and cognitive load in ubiquitous learning environments: Modality effect or redundancy effect?. ’, Australasian Journal of Educational Technology, 27:4, pp. 63354.
    [Google Scholar]
  7. Chen, Y. C.. ( 2006;), ‘ A study of comparing the use of augmented reality and physical models in chemistry education. ’, in VRCIA06: Proceedings of the 2006 ACM International Conference on Virtual Reality Continuum and Its Applications, Hong Kong, China, 14 June, New York:: Association for Computing Machinery;, pp. 36972.
    [Google Scholar]
  8. Chun, B.. ( 2021;), ‘ A study on ludo-narrative harmony in the video game. ’, Journal of Korea Game Society, 21:5, pp. 87104.
    [Google Scholar]
  9. Clark, R. P.. ( 2006), Writing Tools: 50 Essential Strategies for Every Writer, New York:: Little, Brown and Company;.
    [Google Scholar]
  10. Eskelinen, M.. ( 2001;), ‘ The gaming situation. ’, Game Studies, 1:1, pp. 110, http://www.gamestudies.org/0101/eskelinen. Accessed 16 January 2023.
    [Google Scholar]
  11. Fiusa, M.,, Peres, C., and Marques, A. L.. ( 2022;), ‘ Reading motivation factors through interactive narratives and augmented reality. ’, in N. Martins, and D. Brandão. (eds), Advances in Design and Digital Communication III: DIGICOM 2022, Springer Series in Design and Innovation, vol. 27, Cham:: Springer, Cham;, pp. 80522.
    [Google Scholar]
  12. Golden, J. M.. ( 1990), The Narrative Symbol in Childhood Literature, Approaches to Semiotics. , Berlin:: De Gruyter Mouton;.
    [Google Scholar]
  13. Grasset, R.,, Looser, J., and Billinghurst, M.. ( 2006;), ‘ Transitional interface: Concept, issues and framework. ’, in Proceedings of the 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality, Santa Barbara, CA, 22–25 October, New York:: IEEE;, pp. 23132.
    [Google Scholar]
  14. Hocking, C.. ( 2007;), ‘ Ludonarrative dissonance in Bioshock. ’, Click Nothing , 7 October, https://clicknothing.typepad.com/click_nothing/2007/10/ludonarrative-d.html. Accessed 23 January 2023.
  15. Huizinga, J.. ( 1938), Homo Ludens: A Study of the Play-Element in Culture, London:: Routledge;.
    [Google Scholar]
  16. Izzaty, S.,, Tolle, H.,, Dermawi, R., and Permana, F.. ( 2019;), ‘ Augmented reality objects design in augmented story book mobile application for better engagement. ’, International Journal of Electrical and Computer Engineering (IJECE), 9:1, pp. 57076.
    [Google Scholar]
  17. Järvinen, A.. ( 2008;), ‘ Games without frontiers: Theories and methods for game studies and design. ’, Ph.D. thesis, Tampere:: University of Tampere;.
    [Google Scholar]
  18. Kao, G. Y. M.,, Tsai, C. C.,, Liu, C. Y., and Yang, C. H.. ( 2016;), ‘ The effects of high/low interactive electronic storybooks on elementary school students’ reading motivation, story comprehension and chromatics concepts. ’, Computers and Education, 100, September, pp. 5670.
    [Google Scholar]
  19. Klevjer, R.. ( 2014;), ‘ Cut-scenes. ’, in M. J. P. Wolf, and B. Perron. (eds), The Routledge Companion to Video Game Studies, New York:: Routledge;, pp. 30109.
    [Google Scholar]
  20. Lankoski, P., and Björk, S.. ( 2015;), ‘ Formal analysis of gameplay. ’, in P. Lankoski, and S. Björk. (eds), Game Research Methods: An Overview, Pittsburgh, PA:: ETC Press;, pp. 18.
    [Google Scholar]
  21. Lauricella, A. R.,, Barr, R., and Calvert, S. L.. ( 2014;), ‘ Parent–child interactions during traditional and computer storybook reading for children’s comprehension: Implications for electronic storybook design. ’, International Journal of Child–Computer Interaction, 2:1, pp. 1725.
    [Google Scholar]
  22. Madej, K.. ( 2003;), ‘ Towards digital narrative for children. ’, Computers in Entertainment, 1:1, pp. 117.
    [Google Scholar]
  23. Makedonski, B.. ( 2012;), ‘ Ludonarrative dissonance: The roadblock to realism. ’, Destructoid , 26 September, https://www.destructoid.com/ludonarrative-dissonance-the-roadblock-to-realism/. Accessed 23 January 2023.
  24. McGill, K. M.. ( 2022;), ‘ The digital lineage of narrative: Analyzing interactive fiction to further understand game narrative. ’, in B. Bostan. (ed.), Games and Narrative: Theory and Practice, Los Angeles, CA:: Institute for Education, Research, and Scholarships;, pp. 7790.
    [Google Scholar]
  25. Murray, J. H.. ( 2012), Inventing the Medium: Principles of Interaction Design as a Cultural Practice, Cambridge, MA:: MIT Press;.
    [Google Scholar]
  26. Nikolajeva, M., and Scott, C.. ( 2006), How Picturebooks Work, New York:: Routledge;.
    [Google Scholar]
  27. Pynenburg, T.. ( 2012;), ‘ Games worth a thousand words: Critical approaches and ludonarrative harmony in interactive narratives. ’, honors thesis, Durham, NH:: University of New Hampshire;.
    [Google Scholar]
  28. Russell, J.. ( 2017a), Book One, The Dragon Defenders. , Auckland:: Dragon Brothers Books;.
    [Google Scholar]
  29. Russell, J.. ( 2017b), Book Three: An Unfamiliar Place, The Dragon Defenders. , Auckland:: Dragon Brothers Books;.
    [Google Scholar]
  30. Russell, J.. ( 2017c), Book Two: The Pitbull Returns, The Dragon Defenders. , Auckland:: Dragon Brothers Books;.
    [Google Scholar]
  31. Schur, D.. ( 1998), An Introduction to Close Reading, Cambridge, MA:: Harvard University Press;.
    [Google Scholar]
  32. Sengun, S.. ( 2022;), ‘ Six degrees of videogame narrative. ’, in B. Bostan. (ed.), Games and Narrative: Theory and Practice, Los Angeles, CA:: Institute for Education, Research, and Scholarships;, pp. 320.
    [Google Scholar]
  33. Takacs, Z. K.,, Swart, E. K., and Bus, A. G.. ( 2015;), ‘ Benefits and pitfalls of multimedia and interactive features in technology-enhanced storybooks: A meta-analysis. ’, Review of Educational Research, 85:4, pp. 698739.
    [Google Scholar]
  34. Taketa, N.,, Hayashi, K.,, Kato, H., and Noshida, S.. ( 2007;), ‘ Virtual pop-up book based on augmented reality. ’, in M. J. Smith, and G. Salvendy. (eds), Lecture Notes in Computer Science, vol. 4558, Berlin:: Springer;, pp. 47584.
    [Google Scholar]
  35. Who’s on First. ’ ( 1938), The Kate Smith Hour, NBC;, New York:, 24 March, https://archive.org/details/otr_abbottandcostello/Abbott_and_Costello_-_Whos_On_First_Original_30_Min_Live_Rad.mp3. Accessed 31 January 2023.
    [Google Scholar]
  36. Yuen, S. C.-Y.,, Yaoyuneyong, G., and Johnson, E.. ( 2011;), ‘ Augmented reality: An overview and five directions for AR in education. ’, Journal of Educational Technology Development and Exchange, 4:1, pp. 11840.
    [Google Scholar]
/content/journals/10.1386/jpm_00007_1
Loading
/content/journals/10.1386/jpm_00007_1
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error