Skip to content
1981
  1. Home
  2. A-Z Publications
  3. Journal of Music, Technology & Education
  4. Volume 16, Issue 1
  5. Article
Volume 16, Issue 1-2
  • ISSN: 1752-7066
  • E-ISSN: 1752-7074
file format pdf download PDF

Abstract

This article presents the development and evaluation of HandI, a motion-based digital musical instrument (DMI) mobile app, for the musical engagement and expression of children with sensorimotor impairment. HandI uses the smartphone’s orientation as the input control for musical expression, attempting to remove sensorimotor barriers and empower such children to engage and express themselves through music-making. An evaluation with music practitioners and caretakers ( = 10) yielded positive feedback on the app’s effectiveness in engaging sensorimotor-impaired children with musical games, while also yielding suggestions to improve the control interaction and functionality to better cater to children’s diversified learning needs. The findings of this study shed light on the design of human–computer interaction (HCI) and adaptive technology for the musical enjoyment and empowerment of children with functional diversity, helping to create a more equal, diversified and inclusive (EDI) learning environment.

Funding
This study was supported by the:
  • MedTech SuperConnector (Cohort five)
© 2023 The Author(s). Published by Intellect Ltd.
This article is Open Access under the terms of the Creative Commons Attribution 4.0 International licence (CC-BY 4.0), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited. The CC BY licence permits commercial and noncommercial reuse. To view a copy of the licence, visit https://creativecommons.org/licenses/by/4.0/
Loading

Article metrics loading...

/content/journals/10.1386/jmte_00057_1
2024-12-31
2025-12-12
Loading full text...

Full text loading...

/deliver/fulltext/jmte/16/1-2/jmte.16.1-2.5_Cheng.html?itemId=/content/journals/10.1386/jmte_00057_1&mimeType=html&fmt=ahah

References

  1. AtomoSynth (2017), ‘iAbyssal’, iAbyssal in the App Store, 19 October, https://apps.apple.com/us/app/iabyssal/id1296967350. Accessed 20 December 2022.
  2. Axford, E. C. (2015), Music Apps for Musicians and Music Teachers, Lanham, MD: Rowman and Littlefield.
     [Google Scholar]
  3. Beishuizen, J. (2008), ‘Does a community of learners foster self-regulated learning?’, Technology, Pedagogy and Education, 17:3, pp. 183–93, https://doi.org/10.1080/14759390802383769.
     [Google Scholar]
  4. Bell, A. P. (2015), ‘Can we afford these affordances? GarageBand and the double-edged sword of the digital audio workstation’, Action, Theory, and Criticism for Music Education, 14:1, pp. 44–65, http://act.maydaygroup.org/articles/Bell14_1.pdf. Accessed 11 December 2024.
     [Google Scholar]
  5. Bernard, H. R. and Ryan, G. W. (2010), Analyzing Qualitative Data: Systematic Approaches, Los Angeles, CA: Sage.
     [Google Scholar]
  6. Blamires, M. (2012), ‘Dilemmas of enablement: Inclusive and special technologies’, in J. Cornwall and L. Graham-Matheson (eds), Leading on Inclusion: Dilemmas, Debates and New Perspectives, Abingdon: Routledge, pp. 98–108.
     [Google Scholar]
  7. Brown, A. R. (2015), Music Technology and Education: Amplifying Musicality, 2nd ed., London: Routledge, https://doi.org/10.4324/9781315857862.
     [Google Scholar]
  8. Buzzi, M. C., Paolini, G., Senette, C., Buzzi, M. and Paratore, M. T. (2019), ‘Designing an accessible web app to teach piano to students with autism’, in Proceedings of the 13th Biannual Conference of the Italian SIGCHI Chapter: Designing the Next Interaction, Padova, Italy, 23–25 September, New York: ACM, pp. 1–12, https://doi.org/10.1145/3351995.3352037.
     [Google Scholar]
  9. Carini, R. M., Kuh, G. D. and Klein, S. P. (2006), ‘Student engagement and student learning: Testing the linkages’, Research in Higher Education, 47:1, pp. 1–32, https://doi.org/10.1007/s11162-005-8150-9.
     [Google Scholar]
  10. Chai, Z., Vail, C. O. and Ayres, K. M. (2014), ‘Using an iPad application to promote early literacy development in young children with disabilities’, The Journal of Special Education, 48:4, pp. 268–78, https://doi.org/10.1177/0022466913517554.
     [Google Scholar]
  11. Chen, C. W. J. (2015), ‘Mobile learning: Using application Auralbook to learn aural skills’, International Journal of Music Education, 33:2, pp. 244–59, https://doi.org/10.1177/0255761414533308.
     [Google Scholar]
  12. Chen, C. W. J. (2017), ‘Mobile learning in music education’, in S. A. Ruthmann and R. Mantie (eds), The Oxford Handbook of Technology and Music Education, New York: Oxford University Press, pp. 163–70, https://doi.org/10.1093/oxfordhb/9780199372133.013.16.
     [Google Scholar]
  13. Cheng, L. and Leong, S. (2017), ‘Knowledge management ecological approach: A cross-discipline case study’, Journal of Knowledge Management, 21:4, pp. 839–56, https://doi.org/10.1108/JKM-11-2016-0492.
     [Google Scholar]
  14. Cheung, J. (2004), ‘Mapping music education research in Hong Kong’, Psychology of Music, 32:3, pp. 343–56, https://doi.org/10.1177/0305735604043265.
     [Google Scholar]
  15. Chong, E. K. M. (2019), ‘Teaching and learning music theory in the age of AI and mobile technologies’, International Journal of Digital Society, 10:3, pp. 1505–09, https://doi.org/10.20533/ijds.2040.2570.2019.0186.
     [Google Scholar]
  16. Ciampa, K. (2014), ‘Learning in a mobile age: An investigation of student motivation’, Journal of Computer Assisted Learning, 30:1, pp. 82–96, https://doi.org/10.1111/jcal.12036.
     [Google Scholar]
  17. Cohen, L., Manion, L. and Morrison, K. (2011), Research Methods in Education, 7th ed., London: Routledge.
     [Google Scholar]
  18. Cope, P. and Smith, H. (2008), ‘Cultural context in musical instrument learning’, British Journal of Music Education, 14:3, pp. 283–89, https://doi.org/10.1017/S026505170000125X.
     [Google Scholar]
  19. Cunnungham, S., Brill, M., Whalley, J. H., Read, R., Anderson, G., Edwards, S. and Picking, R. (2019), ‘Assessing wellbeing in people living with dementia using reminiscence music with a mobile app (Memory Tracks): A mixed study’, Journal of Healthcare Engineering, 2019:1, p. 8924273, https://doi.org/10.1155/2019/8924273.
     [Google Scholar]
  20. Curry, C. (2003), ‘Universal design: Accessibility for all learners’, Educational Leadership, 61:2, pp. 55–60.
     [Google Scholar]
  21. Economides, A. A. (2006), ‘Adaptive mobile learning’, in S. His, Kinshuk, T.-W. Chan and D. G. Sampson (eds), Proceedings of the 4th International Workshop on Wireless, Mobile and Ubiquitous Technologies in Education, Athens, Greece, 16–17 November, Los Alamitos, CA: IEEE Computer Society, pp. 26–28, https://doi.org/10.1109/WMTE.2006.261339.
     [Google Scholar]
  22. Fernández-López, A., Rodríguez-Fórtiz, M. J., Rodríguez-Almendros, M. L. and Martínez-Segura, M. J. (2012), ‘Mobile learning technology based on iOS devices to support students with special education needs’, Computers and Education, 61, pp. 77–90, https://doi.org/10.1016/j.compedu.2012.09.014.
     [Google Scholar]
  23. Frid, E. (2018), ‘Accessible digital musical instruments: A survey of inclusive instruments presented at the NIME, SMC and ICMC conferences’, in T. H. Park and D.-J. Ahn (eds), Proceedings of the 44th International Computer Music Conference, Daegu, South Korea, 5–10 August, Ann Arbor, MI: Michigan Publishing, pp. 53–59.
     [Google Scholar]
  24. Garrison, D. R., Cleveland-Innes, M., Koole, M. and Kappelman, J. (2006), ‘Revisiting methodological issues in transcript analysis: Negotiated coding and reliability’, The Internet and Higher Education, 9:1, pp. 1–8, https://doi.org/10.1016/j.iheduc.2005.11.001.
     [Google Scholar]
  25. Gault, B. (2005), ‘Music learning through all the channels: Combining aural, visual, and kinesthetic strategies to develop musical understanding’, Journal of General Music Education, 19:1, pp. 7–9, https://doi.org/10.1177/10483713050190010103.
     [Google Scholar]
  26. Gorbunova, I. B. and Petrova, N. N. (2020), ‘Digital musical instrument as a sociocultural phenomenon’, Universidad y Sociedad, 12:3, pp. 109–15, http://ref.scielo.org/qg2xtk. Accessed 1 December 2022.
     [Google Scholar]
  27. Guétin, S., Falvay, D., Chanques, G., Jaber, S., de Lattre, S., Souche, B., Giniès, P., Picot, M., Hérisson, C., Brun, L., de Diego, E. and Touchon, J. (2014), ‘Evaluation of the standardized MUSIC CARE© app in the treatment of pain: The U-shape composing technique’, Music and Medicine: An Interdisciplinary Journal, 6:2, pp. 46–50, https://doi.org/10.47513/mmd.v6i2.179.
     [Google Scholar]
  28. Hammel, A. M. and Hourigan, R. M. (2017), Teaching Music to Students with Special Needs: A Label-Free Approach, New York: Oxford University Press, https://doi.org/10.1093/oso/9780195395402.001.0001.
     [Google Scholar]
  29. Hammel, A. M. and Rathgeber, J. (2021), ‘Living at the intersection of tablets, music, and disability’, in G. R. Greher and S. L. Burton (eds), Create Music Making at Your Fingertips: A Mobile Technology Guide for Music Educators, pp. 29–42, New York: Oxford University Press, https://doi.org/10.1093/oso/9780190078119.001.0001.
     [Google Scholar]
  30. Hankinson, K., Shaykevich, A., Vallence, A., Rodger, J., Rosenberg, M. and Etherton-Beer, C. (2022), ‘A tailored music-motor therapy and real-time biofeedback mobile phone app (“GotRhythm”) to promote rehabilitation following stroke: A pilot study’, Neuroscience Insights, 17, pp. 1–6, https://doi.org/10.1177/26331055221100587.
     [Google Scholar]
  31. Hides, L., Dingle, G., Quinn, C., Stoyanov, S. R., Zelenko, O., Tjondronegoro, D., Johnson, D., Cockshaw, W. and Kavanagh, D. J. (2019), ‘Efficacy and outcomes of a music-based emotion regulation mobile app in distressed young people: Randomized controlled trial’, JMIR Mhealth and Uhealth, 7:1, p. e11482, https://doi.org/10.2196/11482.
     [Google Scholar]
  32. Hillier, A., Greher, G., Queenan, A., Marshall, S. and Kopec, J. (2017), ‘Music, technology and adolescents with autism spectrum disorders: The effectiveness of the touch screen interface’, Music Education Research, 18:3, pp. 269–82, https://doi.org/10.1080/14613808.2015.1077802.
     [Google Scholar]
  33. Huang, H.-C., Wang, T.-Y. and Hsieh, F.-M. (2012), ‘Constructing an adaptive mobile learning system for the support of personalised learning and device adaption’, Procedia: Social and Behavioral Science, 64, pp. 332–41, https://doi.org/10.1016/j.sbspro.2012.11.040.
     [Google Scholar]
  34. Kılıç, A. O., Sari, E., Yucel, H., Oğuz, M. M., Polat, E., Acoglu, E. A. and Senel, S. (2019), ‘Exposure to and use of mobile devices in children aged 1–60 months’, European Journal of Pediatrics, 178:2, pp. 221–27, https://doi.org/10.1007/s00431-018-3284-x.
     [Google Scholar]
  35. Kirschner, P. A. (2002), ‘Can we support CCSL? Educational, social and technological affordances for learning’, in P. A. Kirschner (ed.), Three Worlds of CSCL: Can We Support CSCL?, Heerlen: Open Universiteit Nederland, pp. 7–47.
     [Google Scholar]
  36. Knight, A. (2013), ‘Uses of iPad® applications in music therapy’, Music Therapy Perspectives, 31:2, pp. 189–96, https://doi.org/10.1093/mtp/31.2.189.
     [Google Scholar]
  37. Kommemo, L. L. C. (2015), ‘Handbell Solo’, Handbell Solo in the App Store, 14 December, https://apps.apple.com/gb/app/handbell-solo/id951246805. Accessed 20 December 2022.
  38. Louhab, F. E., Bahnasse, A. and Talea, M. (2018), ‘Considering mobile device constraints and context-awareness in adaptive mobile learning for flipped classroom’, Education and Information Technologies, 23:6, pp. 2607–32, https://doi.org/10.1007/s10639-018-9733-3.
     [Google Scholar]
  39. Ludi, S., Timbrook, M. and Chester, P. (2014), ‘A tablet-based approach to facilitate the viewing of classroom lecture by low vision students’, in K. Miesenberger, D. Fels, D. Archambault, P. Peňáz and W. Zagler (eds), Proceedings of the 14th International Conference on Computers Helping People with Special Needs, Paris, France, 9–11 July, Cham: Springer, pp. 591–96, https://doi.org/10.1007/978-3-319-08599-9_87.
     [Google Scholar]
  40. Marino, M. T., Sameshima, P. and Beecher, C. C. (2009), ‘Enhancing TPACK with assistive technology: Promoting inclusive practices in preservice teacher education’, Contemporary Issues in Technology and Teacher Education, 9:2, pp. 186–207.
     [Google Scholar]
  41. Moreno, D. and Maia, A. (2021), ‘Accessible music for everyone: Discovering resources’, in A. Mesquita, A. Abreu and J. V. Carvalho (eds), Perspectives and Trends in Education and Technology: Selected Papers from ICITED 2021, Singapore: Springer, pp. 883–93, https://doi.org/10.1007/978-981-16-5063-5_73.
     [Google Scholar]
  42. Myllykoski, M. and Paananen, P. (2009), ‘Towards new social dimensions for children’s music making: JamMo as a collaborative and communal m-learning environment’, in J. Louhivuori, T. Eerola, S. Saarikallio, T. Himberg and P. Eerola (eds), Proceedings of the 7th Triennial Conference of European Society for the Cognitive Sciences of Music, Jyväskylä, Finland, Jyväskylä: Jyväskylän yliopisto Musiikin laitos, 12–16 August, pp. 366–71.
     [Google Scholar]
  43. Niediek, I., Sieger, M. and Gerland, J. (2018), ‘Music apps as inclusive engines? A spotlight into practice’, in K. Miesenberger and G. Kouroupetroglou (eds), Proceedings of the 16th International Conference on Computers Helping People with Special Needs, Linz, Austria, 11–13 July, Cham: Springer, pp. 159–62, https://doi.org/10.1007/978-3-319-94277-3_27.
     [Google Scholar]
  44. O’Niell, S. A. (2012), ‘Becoming a music learner: Toward a theory of transformative music engagement’, in G. E. McPherson and G. F. Welch (eds), The Oxford Handbook of Music Education, vol. I, New York: Oxford University Press, pp. 163–86, https://doi.org/10.1093/oxfordhb/9780199730810.013.0010_update_001.
     [Google Scholar]
  45. Palys, T. (2008), ‘Purposive sampling’, in L. M. Given (ed.), The Sage Encyclopaedia of Qualitative Research Methods, Thousand Oaks, CA: Sage, pp. 697–98.
     [Google Scholar]
  46. Paule-Ruiz, M., Álvarez-García, V., Pérez-Pérez, J. R., Álvarez-Sierra, M. and Trespalacios-Menéndez, F. (2017), ‘Music learning in preschool with mobile devices’, Behaviour and Information Technology, 36:1, pp. 1–17, https://doi.org/10.1080/0144929X.2016.1198421.
     [Google Scholar]
  47. Rose, D. H. and Gravel, J. W. (2010), ‘Universal design for learning’, in B. McGaw, P. Peterson and E. Baker (eds), International Encyclopedia of Education, 3rd ed., Amsterdam: Elsevier, pp. 119–24, https://doi.org/10.1016/B978-0-08-044894-7.00719-3.
     [Google Scholar]
  48. Sabet, S. (2020), ‘Composing with mobile technology: High school students and GarageBand for iPad1’, Journal of Popular Music Education, 4:3, pp. 349–69, https://doi.org/10.1386/jpme_00032_1.
     [Google Scholar]
  49. Segura, E., Grau-Sánchez, J., Sanchez-Pinsach, D., de la Cruz, M., Duarte, E., Arcos, J. L. and Rodríguez-Fornells, A. (2021), ‘Designing an app for home-based enriched music-supported therapy in the rehabilitation of patients with chronic stroke: A pilot feasibility study’, Brain Injury, 35:12–13, pp. 1585–97, https://doi.org/10.1080/02699052.2021.1975819.
     [Google Scholar]
  50. Sirkka, A., Merilampi, S., Koivisto, A., Tommiska, J. and Saarinen, T. (2017), ‘“Design for somebody”: Approach enabling mobile technology development’, Studies in Health Technology and Informatics, 242, pp. 669–75, https://doi.org/10.3233/978-1-61499-798-6-669.
     [Google Scholar]
  51. Stolze, M. and Hlavacs, H. (2017), ‘InvisibleSound: An app enabling blind people to compose music’, in N. Munekata, I. Kunita and J. Hoshino (eds), Proceedings of the 16th International Conference on Entertainment Computing, Tsukuba, Japan, 18–21 September, Cham: Springer pp. 38–43, https://doi.org/10.1007/978-3-319-66715-7_5.
     [Google Scholar]
  52. Tan, Q., Chang, W. and Kinshuk (2015), ‘Location-based augmented reality for mobile learning: Algorithm, system, and implementation’, The Electronic Journal of e-Learning, 13:2, pp. 138–48, https://academic-publishing.org/index.php/ejel/article/view/1721/1684. Accessed 11 December 2024.
     [Google Scholar]
  53. Veloso, A. L., Ferreira, A. I. and Bessa, R. (2019), ‘Adapting a music listening app to engage pupils in personal and social development: A case study’, Bulletin of the Council for Research in Music Education, 220, pp. 63–83, https://doi.org/10.5406/bulcouresmusedu.220.0063.
     [Google Scholar]
  54. van Velsen, L., van der Geest, T., Klaasen, R. and Steehounder, M. (2008), ‘User-centered evaluation of adaptive and adaptable systems: A literature review’, The Knowledge Engineering Review, 23:3, pp. 261–81, https://doi.org/10.1017/S0269888908001379.
     [Google Scholar]
  55. Wallerstedt, C. and Hillman, T. (2015), ‘“Is it okay to use the mobile phone?”: Student use of information technology in pop-band rehearsals in Swedish music education’, Journal of Music, Technology and Education, 8:1, pp. 71–93, https://doi.org/10.1386/jmte.8.1.71_1.
     [Google Scholar]
  56. Wang, G. (2014), ‘Ocarina: Designing the iPhone’s magic flute’, Computer Music Journal, 38:2, pp. 8–21, https://doi.org/10.1162/COMJ_a_00236.
     [Google Scholar]
  57. William, D. A. (2014), ‘Another perspective: The iPad is a REAL musical instrument’, Music Educators Journal, 101:1, pp. 93–98, https://doi.org/10.1177/0027432114540476.
     [Google Scholar]
  58. Zhao, X. and Okamoto, T. (2008), ‘A device-independent system architecture for adaptive mobile learning’, in P. Díaz, Kinshuk, I., AedoI and E. Mora (eds), Proceedings of the 8th IEEE International Conference on Advanced Learning Technologies, Washington, DC, USA, 1–5 July, Los Alamitos, CA: IEEE Computer Society, pp. 23–25, https://doi.org/10.1109/ICALT.2008.21.
     [Google Scholar]
/content/journals/10.1386/jmte_00057_1
Loading
Digital musical instrument mobile app for children with sensorimotor impairment
Journal of Music, Technology & Education 16, 5 (2023); https://doi.org/10.1386/jmte_00057_1
/content/journals/10.1386/jmte_00057_1
/content/journals/10.1386/jmte_00057_1
Loading

Data & Media loading...

  • Article Type: Article
Keyword(s): accessibility; adaptive technology; functional diversity; inclusive education; music education; special needs

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error
Please enter a valid_number test