The NEFFIE project: Technological innovation, artistic co-creation and social augmented experience | Intellect Skip to content
1981
  1. Home
  2. A-Z Publications
  3. Journal of Pervasive Media
  4. Volume 8, Issue 1
  5. Article
AI, Augmentation and Art
  • ISSN: 2633-8793
  • E-ISSN: 2633-8785

Abstract

This article presents the NEFFIE (which stands for ‘Neuroaesthetic Photography’) project, a contemporary reinterpretation of Franco Vaccari’s iconic artwork, presented 50 years ago at the 1972 International Venice Art Biennale and entitled . Thanks to today’s technological innovation, NEFFIE develops Vaccari’s idea from a more contemporary perspective. Vaccari’s original photo booth becomes a technologically revisited booth that uses an algorithm and wearable sensors to reshape the subjective emotional-cognitive responses derived from viewing particular images, thus generating the ‘cognitive photograph’ or ‘COFFIE metapicture’. These metapictures are subsequently minted as NFTs (non-fungible tokens) objects and then displayed on a virtual wall, the ‘COFFIE wall’, generating what can be defined as a , a hypothetical contemporary re-actualization of Vaccari’s artistic proposition. The NEFFIE project could be considered a pervasive media art proposal capable of promoting social cohesion, by encouraging creative participation and co-creation. The project is being developed in Milan, thanks to a fruitful interdisciplinary collaboration between the Research Center in Advanced Technology in Health and Well-Being of San Raffaele Hospital, and ICONE, the European Research Center in History and Theory of the Image of Vita-Salute San Raffaele University. This multidisciplinary approach combines art-historical theoretical thinking with the world of technological innovation. In particular, the NEFFIE project integrates the visual and conceptual tools of photography with the methodologies and knowledge of biomedical engineering and computer science.

© 2023 Intellect Ltd
Loading

Article metrics loading...

/content/journals/10.1386/jpm_00005_1
2023-08-18
2024-04-27
Loading full text...

Full text loading...

References

  1. Advanced Technology in Health and Well-Being ( 2022;), ‘ Showreel NEFFIE 2021–22. ’, YouTube , 31 May, https://www.youtube.com/watch?v=tnzoPZk8py4. Accessed 20 January 2023.
  2. Advanced Technology in Health and Well-Being ( 2023;), ‘ NEFFIE: Venice 2022. ’, YouTube , 17 January, https://www.youtube.com/watch?v=JKbJPtzKk0c. Accessed 20 January 2023.
  3. Ahnert, R.,, Ahnert, S. E.,, Coleman, C. N., and Weingart, S. B.. ( 2020), The Network Turn: Changing Perspectives in the Humanities, Cambridge:: Cambridge University Press;.
     [Google Scholar]
  4. Alharby, M.,, Aldweesh, A., and van Moorsel, A.. ( 2018;), ‘ Blockchain-based smart contracts: A systematic mapping study of academic research. ’, in 2018 International Conference on Cloud Computing, Big Data and Blockchain (ICCBB), Fuzhou, China, 15–17 November, IEEE, pp. 125–40, https://doi.org/10.1109/ICCBB.2018.8756390.
     [Google Scholar]
  5. Appelhans, B. M., and Luecken, L. J.. ( 2006;), ‘ Heart rate variability as an index of regulated emotional responding. ’, Review of General Psychology, 10:3, pp. 229–40, https://doi.org/10.1037/1089-2680.10.3.229.
     [Google Scholar]
  6. Bsteh, S.. ( 2021;), ‘ From painting to pixel: Understanding NFT artworks. ’, MA thesis, Rotterdam:: Erasmus University Rotterdam;, https://www.researchgate.net/publication/351346278_From_Painting_to_Pixel_Understanding_NFT_artworks. Accessed 12 January 2023.
     [Google Scholar]
  7. Buist, K.. ( 2021;), ‘ Chain reaction. ’, Artforum International Magazine, 10 March, https://www.artforum.com/slant/kevin-buist-on-the-nft-boom-85221. Accessed 13 January 2023.
     [Google Scholar]
  8. Cannon, W. B.. ([ 1927] 1987;), ‘ The James-Lange theory of emotions: A critical examination and an alternative theory. ’, The American Journal of Psychology, 100:3&4, pp. 567–86, https://doi.org/10.2307/1422695.
     [Google Scholar]
  9. Clementi, D.. ( 2021;), ‘ Non-fungible tokens in digital art: A case study with Ethereum. ’, MA dissertation, Milan:: Politecnico di Milano;, https://www.politesi.polimi.it/handle/10589/184076. Accessed 25 April 2023.
     [Google Scholar]
  10. Das, P.,, Khasnobish, A., and Tibarewala, D. N.. ( 2016;), ‘ Emotion recognition employing ECG and GSR signals as markers of ANS. ’, in 2016 Conference on Advances in Signal Processing (CASP), Pune, India, 9–11 June, IEEE, pp. 37–42, https://doi.org/10.1109/casp.2016.7746134.
     [Google Scholar]
  11. Dwivedi, K. Y.,, Hughes, L.,, Baabdullah, A. M.,, Ribeiro-Navarrete, S.,, Giannakis, M.,, Al-Debei, M. M.,, Dennehy, D.,, Metri, B.,, Buhalis, D.,, Cheung, C. M. K.,, Conboy, K.,, Doyle, R.,, Dubey, R.,, Dutot, V.,, Felix, R.,, Goyal, D. P.,, Gustafsson, A.,, Hinsch, C.,, Jebabli, I.,, Janssen, M.,, Kim, Y. G.,, Kim, J.,, Koos, S.,, Kreps, D.,, Kshetri, N.,, Kumar, V.,, Ooi, K. B.,, Papagiannidis, S.,, Pappas, I. O.,, Polyviou, A.,, Park, S. M.,, Pandey, N.,, Queiroz, M. M.,, Raman, R.,, Rauschnabel, P. A.,, Shirish, A.,, Sigala, M.,, Spanaki, K.,, Tan, G. W. H.,, Tiwari, M. K.,, Viglia, G., and Wamba, S. F.. ( 2022;), ‘ Metaverse beyond the hype: Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. ’, International Journal of Information Management, 66, pp. 2–55, https://doi.org/10.1016/j.ijinfomgt.2022.102542.
     [Google Scholar]
  12. Eco, U.. ( 1989), The Open Work, Cambridge, MA:: Harvard University Press;.
     [Google Scholar]
  13. Fahmy, S.,, Bock, M. A., and Wayne, W.. ( 2014), Visual Communication Theory and Research: A Mass Communication Perspective, New York:: Palgrave Macmillan;.
     [Google Scholar]
  14. Goldstraw, K.,, McMillan, A.,, Mort, H.,, Pahl, K.,, Pool, S.,, Rafiq, Z., and Rasool, Z.. ( 2020;), ‘ Co-producing artistic approaches to social cohesion. ’, Research for All, 4:2, pp. 257–75, https://doi.org/10.14324/RFA.04.2.09.
     [Google Scholar]
  15. Gunthert, A.. ( 2014;), ‘ The conversational image: New uses of digital photography. ’, OpenEdition Journal, 31, https://journals.openedition.org/etudesphotographiques/3546. Accessed 5 January 2023.
     [Google Scholar]
  16. IBM ( n.d;.), ‘ What are smart contracts on blockchain?. ’, https://www.ibm.com/topics/smart-contracts. Accessed 15 May 2023.
  17. Kanjo, E.,, Al-Husain, L., and Chamberlain, A.. ( 2015;), ‘ Emotions in context: Examining pervasive affective sensing systems, applications, and analyses. ’, Personal and Ubiquitous Computing, 19:7, pp. 1197–212, https://doi.org/10.1007/s00779-015-0842-3.
     [Google Scholar]
  18. Kim, H.,, Lu, X.,, Costa, M.,, Kandemir, B.,, Adams Jr, R. B.,, Li, J.,, Wang, Z. W., and Newman, M. G.. ( 2018;), ‘ Development and validation of Image Stimuli for Emotion Elicitation (ISEE): A novel affective pictorial system with test–retest repeatability. ’, Psychiatry Research, 261, pp. 414–20, https://doi.org/10.1016/j.psychres.2017.12.068.
     [Google Scholar]
  19. Lang, P. J.. ( 1994;), ‘ The varieties of emotional experience: A meditation on James-Lange theory. ’, Psychological Review, 101:2, pp. 211–21, https://doi.org/10.1037/0033-295X.101.2.211.
     [Google Scholar]
  20. Lee, M. S.,, Lee, Y. K.,, Pae, D. S.,, Lim, M. T.,, Kim, D. W., and Kang, T. K.. ( 2019;), ‘ Fast emotion recognition based on single pulse PPG signal with convolutional neural network. ’, Applied Sciences, 9:16, https://doi.org/10.3390/app9163355.
     [Google Scholar]
  21. Mastandrea, S.. ( 2022;), ‘ Early detection of Alzheimer’s disease from aMCI patients: Validation of NAP4A technological platform via biomedical signals acquisition and processing. ’, MA dissertation, Turin:: Politecnico di Torino;, https://webthesis.biblio.polito.it/25783/. Accessed 25 April 2023.
     [Google Scholar]
  22. Microsoft ( 2023;), ‘ Ensuring data integrity with hash codes. ’, 3 January, https://learn.microsoft.com/en-us/dotnet/standard/security/ensuring-data-integrity-with-hash-codes. Accessed 25 April 2023.
  23. Miller, H. N.,, Thornton, C. P.,, Rodney, T.,, Thorpe Jr, R. J., and Allen, J.. ( 2020;), ‘ Social cohesion in health: A concept analysis. ’, ANS Advances in Nursing Science, 43:4, pp. 375–90, https://doi.org/10.1097/ANS.0000000000000327.
     [Google Scholar]
  24. ‘ Mise-en-abîme. ’ ( n.d.), OED Online, Oxford:: Oxford University Press;, https://www.oxfordreference.com/display/10.1093/oi/authority.20110803100201557;jsessionid=DB1AAE18A74AC64BF958B8F5ADD1B47C. Accessed 10 January 2023.
     [Google Scholar]
  25. Mitchell, W. J. T.. ( 2008), Pictorial Turn: Saggi di cultura visuale (Picture Theory: Essays on Verbal and Visual Representation) (trans. A. L. Carbone, F. Mazzara and V. Cammarata), Milan:: Raffaello Cortina Editore;.
     [Google Scholar]
  26. Nie, D.,, Wang, X. W.,, Shi, L. C., and Lu, B. L.. ( 2011;), ‘ EEG-based emotion recognition during watching movies. ’, in 5th International IEEE/EMBS Conference on Neural Engineering, NER 2011, Cancún, Mexico, 27 April–1 May, IEEE, pp. 667–70, https://doi.org/10.1109/ner.2011.5910636.
     [Google Scholar]
  27. Panaro, L.. ( 2007), L’occultamento dell’autore: la ricerca artistica di Franco Vaccari (‘The concealment of the author: Franco Vaccari’s artistic research’), Carpi:: APM;.
     [Google Scholar]
  28. Peña-Ayala, A., and Cárdenas, L.. ( 2016;), ‘ A revision of the literature concerned with mobile, ubiquitous, and pervasive learning: A survey. ’, Advances in Intelligent Systems and Computing, 406:1, pp. 55–100, https://doi.org/10.1007/978-3-319-26518-6_3.
     [Google Scholar]
  29. Pervasive Media Studio ( n.d;.), ‘ What is pervasive media?. ’, https://www.watershed.co.uk/studio/what-pervasive-media/. Accessed 18 January 2023.
  30. Pola, F.. ( 2022;), ‘ L’impatto dei NFT sul sistema dell’arte. ’ (‘ The impact of NFTs on the art system. ’), I Valori della Cultura: Economia and management: la rivista della Scuola di Direzione Aziendale dell’Università L. Bocconi, 1:1, pp. 35–38.
     [Google Scholar]
  31. Rancière, J.. ( 2009), The Emancipated Spectator, London and New York:: Verso;.
     [Google Scholar]
  32. Rodríguez-Martínez, G. A., and Castillo-Parra, H.. ( 2018;), ‘ Bistable perception: Neural bases and usefulness in psychological research. ’, International Journal of Psychological Research, 11:2, pp. 63–76, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7110285/. Accessed 20 December 2022.
     [Google Scholar]
  33. Russell, J. A.. ( 1980;), ‘ A circumplex model of affect. ’, Journal of Personality and Social Psychology, 39:6, pp. 1161–78, https://doi.org/10.1037/h0077714.
     [Google Scholar]
  34. Sanna, A., and Pola, F.. ( 2022;), ‘ UniSR, the NEFFIE neuroaesthetic project and ICONE. ’, UniSR News , 8 November, https://www.unisr.it/news/2022/11/progetto-neuroestetica-neffie-e-icone. Accessed 13 January 2023.
  35. Sheth, B. R., and Pham, T.. ( 2008;), ‘ How emotional arousal and valence influence access to awareness. ’, Vision Research, 48:23&24, pp. 2415–24, https://doi.org/10.1016/j.visres.2008.07.013.
     [Google Scholar]
  36. Simondon, G.. ([ 1982] 2014), Sur la technique, Paris:: Puf;.
     [Google Scholar]
  37. Sweller, J.. ( 2011;), ‘ Cognitive load theory. ’, Psychology of Learning and Motivation, 55, pp. 37–76, https://doi.org/10.1016/B978-0-12-387691-1.00002-8.
     [Google Scholar]
  38. Uhrig, M. K.,, Trautmann, N.,, Baumgärtner, U.,, Treede, R. D.,, Henrich, F.,, Hiller, W., and Marschall, S.. ( 2016;), ‘ Emotion elicitation: A comparison of pictures and films. ’, Frontiers in Psychology, 7:180, https://doi.org/10.3389/fpsyg.2016.00180.
     [Google Scholar]
  39. Vaccari, F.. ( 1973), Esposizione in tempo reale: Exposition en temps reel: Austellung in wirklicher zeit: Exhibition in real time: La fotografia come azione e non come contemplazione (‘Photography as action and not contemplation’), Pollenza:: La Nuova Foglio Editrice;.
     [Google Scholar]
  40. Vaccari, F.. ([ 1979] 2011), Fotografia e inconscio tecnologico (‘Photography and the technological unconscious’), Turin:: Piccola Biblioteca Einaudi;, pp. 6, 84–85.
     [Google Scholar]
  41. Valtorta, R.. ( 2011;), ‘ Introduction. ’, in F. Vaccari. (ed.), Fotografia e inconscio tecnologico (‘Photography and the technological unconscious’), Turin:: Piccola Biblioteca Einaudi;, pp. IX–XXII.
     [Google Scholar]
  42. Wölfel, M.,, Bernhardt, J., and Thiel, S.. ( 2021;), ‘ ArtsIT: International Conference on ArtsIT, Interactivity and Game Creation. ’, Creative Heritage: New Perspectives from Media Arts and Artificial Intelligence: 10th EAI International Conference, ArtsIT 2021, Karlsruhe, Germany, 2–3 December, https://doi.org/10.17613/SE05-2G13.
     [Google Scholar]
  43. World Health Organization (WHO) ( n.d;.), ‘ Health and well-being. ’, https://www.who.int/data/gho/data/major-themes/health-and-well-being. Accessed 18 January 2023.
http://instance.metastore.ingenta.com/content/journals/10.1386/jpm_00005_1
Loading
The NEFFIE project: Technological innovation, artistic co-creation and social augmented experience
Journal of Pervasive Media 8, 65 (2023); https://doi.org/10.1386/jpm_00005_1
/content/journals/10.1386/jpm_00005_1
/content/journals/10.1386/jpm_00005_1
Loading

Data & Media loading...

  • Article Type: Article
Keyword(s): biosensors; neuroaesthetic; NFT; pervasive media; photography; virtual reality; well-being
This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error