Understanding Gardar Sahlberg with neural nets: On algorithmic reuse of the Swedish SF archive | Intellect Skip to content
1981
  1. Home
  2. A-Z Publications
  3. Journal of Scandinavian Cinema
  4. Volume 12, Issue 3
  5. Article
Volume 12, Issue 3
  • ISSN: 2042-7891
  • E-ISSN: 2042-7905

Abstract

In this article, we re-trace the history of the Swedish SF archive and reflect on how this collection of historic newsreels has been reappropriated and remixed throughout more recent media history. In particular, we focus on the work of director and film historian Gardar Sahlberg, who made extensive use of the SF archive, first in a series of documentary films, then in a number of historical TV programmes. We are interested in how historic film footage travels and circulates through time, but foremost we explore how algorithms can help identify instances of audio-visual reuse in large datasets. Hence the article discusses algorithmic ways of examining archival film reuse, introducing a method for mapping video reuse with the help of artificial intelligence or more precisely machine learning that uses so-called convolutional neural nets. The article presents the Video Reuse Detector (VRD), a tool that uses machine learning to identify visual similarities within a given audio-visual database such as the SF archive.

Funding
This study was supported by the:
  • European Union’s Joint Programming Initiative in Cultural Heritage and Global Change, Digital Heritage
© 2022 Intellect Ltd
Loading

Article metrics loading...

/content/journals/10.1386/jsca_00075_1
2022-09-01
2024-04-27
Loading full text...

Full text loading...

References

  1. Anon. ( 1963;), ‘ SF:s journalarkiv guldgruva för TV. ’, Svenska Dagbladet, 21 March, n.pag.
     [Google Scholar]
  2. Anon. ( 1964;), ‘ SF-journaler till TV för tre miljoner. ’, Dagens Nyheter, 4 January, n.pag.
     [Google Scholar]
  3. Anon. ( 1966;), ‘ Punkt för punkt: tv-tablå. ’, Svenska Dagbladet, 16 November, n.pag.
     [Google Scholar]
  4. Arnold, Taylor, and Tilton, Lauren. ( 2020;), ‘ Distant viewing toolkit: A python package for the analysis of visual culture. ’, Journal of Open Source Software, 5:45, pp. 1–6.
     [Google Scholar]
  5. Bazán-Gil, Virginia. ( 2020;), ‘ Artificial intelligence: An object of desire. ’, International Federation of Television Archives, 13 May, https://fiatifta.org/artificial-intelligence-an-object-of-desire/. Accessed 6 October 2022.
     [Google Scholar]
  6. Bonde Thylstrup, Nanna,, Agostinho, Daniela,, Ring, Annie,, D’Ignazio,, Catherine and Veel, Kristin. (eds) ( 2021), Uncertain Archives: Critical Keywords for Big Data, Cambridge, MA:: MIT Press;.
     [Google Scholar]
  7. Brunow, Dagmar. ( 2017;), ‘ Curating access to audiovisual heritage: Cultural memory and diversity in European film archives. ’, Image & Narrative, 18:1, pp. 97–110.
     [Google Scholar]
  8. Brunow, Dagmar, and Stigsdotter, Ingrid. ( 2017;), ‘ Scandinavian cinema culture and archival practices: Collecting, curating and accessing moving image histories. ’, Journal of Scandinavian Cinema, 7:2, pp. 75–78.
     [Google Scholar]
  9. Burghart, Manuel,, Heftberger, Adelheid,, Pause, Johannes,, Walkowski, Niels-Oliver, and Zeppelzauer, Matthias. ( 2020;), ‘ Digital humanities & film studies: Analyzing the modalities of moving images. ’, Digital Humanities Quarterly, 14:4, http://www.digitalhumanities.org/dhq/vol/14/4/index.html. Accessed 6 October 2022.
     [Google Scholar]
  10. Cecchine, Randi. ( 2021a), AI in Audiovisual Archives: What Kinds of Analyses Are Possible, Hilversum NL:: Netherlands Institute for Sound and Vision;, https://beeldengeluid.nl/en/knowledge/blog/ai-audiovisual-archives-what-kinds-analysis-are-possible. Accessed 6 October 2022.
     [Google Scholar]
  11. Cecchine, Randi. ( 2021b), Bringing AI into the Audiovisual Archive, Hilversum, NL:: Netherlands Institute for Sound and Vision;, https://beeldengeluid.nl/en/knowledge/blog/bringing-ai-audiovisual-archive. Accessed 6 October 2022.
     [Google Scholar]
  12. Cecchine, Randi. ( 2021c), The Potential for AI in Audiovisual Archives, Hilversum, NL:: Netherlands Institute for Sound and Vision;, https://beeldengeluid.nl/en/knowledge/blog/potential-ai-audiovisual-archives. Accessed 6 October 2022.
     [Google Scholar]
  13. Champion, Erik Malcolm. ( 2017;), ‘ Digital humanities is text heavy, visualization light, and simulation poor. ’, Digital Scholarship in the Humanities, 32:1, pp. 25–32.
     [Google Scholar]
  14. Edström, Mauritz. ( 1964;), ‘ Vår hufvudstad: så olik sig och ändå lik. ’, Dagens Nyheter, 21 June, n.pag.
     [Google Scholar]
  15. Facebook AI Similarity Search (FAISS) ( 2021), https://ai.facebook.com/tools/faiss/. Accessed 6 October 2022.
  16. Fant, Kenne. ( 1963;), letter to Harry Schein. , 9 May, Stockholm:: Swedish Labour Movement’s Archives and Library;, Harry Schein Archive, vol. 4/33, ‘Handlingar rörande filmpolitik, Filmutredningar 1963–1974’.
     [Google Scholar]
  17. Fickers, Andreas,, Snickars, Pelle, and Williams, Mark. (eds) ( 2018;), ‘ Editorial. ’, VIEW Journal of European Television History and Culture, Special Issue: ‘Audiovisual Data in Digital Humanities’, 7:14, pp. 1–4.
     [Google Scholar]
  18. Fossati, Giovanna,, Masson, Eef,, Gosvig Olesen, Christian, and van Noord, Nanne. ( 2020;), ‘ Exploring digitised moving image collections: The SEMIA project, visual analysis and the turn to abstraction. ’, Digital Humanities Quarterly, 14:4, http://www.digitalhumanities.org/dhq/vol/14/4/000497/000497.html. Accessed 6 October 2022.
     [Google Scholar]
  19. Gunning, Tom. ( 1997;), ‘ Before documentary: Early nonfiction films and the “view” aesthetic. ’, in D. Hertogs, and N. de Klerk. (eds), Uncharted Territory: Essays on Early Nonfiction Film, Amsterdam:: Nederlands Filmmuseum;, pp. 9–24.
     [Google Scholar]
  20. ImageNet ( 2021), https://image-net.org. Accessed 6 October 2022.
  21. Jan Bot ( 2021;), ‘ Jan Bot. ’, https://www.jan.bot/about. Accessed 6 October 2022.
  22. ‘Jerome’ ( 1961;), ‘ När seklet var ungt. ’, Dagens Nyheter, 10 January, n.pag.
     [Google Scholar]
  23. Jofre, Ana,, Cole, Josh,, Berardi, Vincent,, Bennett, Carl, and Reale, Michael. ( 2020;), ‘ What’s in a face? Gender representation of faces in time, 1940s–1990s. ’, Journal of Cultural Analytics, 5:1, 19 March, https://culturalanalytics.org/article/12266-what-s-in-a-face-gender-representation-of-faces-in-time-1940s-1990s. Accessed 6 October 2022.
     [Google Scholar]
  24. Kosnik, Abigail de. ( 2016), Rogue Archives: Digital Cultural Memory and Media Fandom, Cambridge, MA:: MIT Press;.
     [Google Scholar]
  25. Manovich, Lev. ( 2020), Cultural Analytics, Cambridge, MA:: MIT Press;.
     [Google Scholar]
  26. Methods for Managing Audiovisual Data (MeMAD) ( 2021), https://memad.eu/about/. Accessed 6 October 2022.
  27. Norén, Fredrik, and Snickars, Pelle. ( 2017;), ‘ Distant reading the history of Swedish film politics in 4500 governmental SOU reports. ’, Journal of Scandinavian Cinema, 7:2, pp. 155–75.
     [Google Scholar]
  28. Peirce, Charles Sanders. ( 1935), The Collected Papers of Charles S. Peirce, vol. 2, Cambridge, MA:: Harvard University Press;.
     [Google Scholar]
  29. Prelinger, Rick. ( 2021;), ‘ NFTs and AI are unsettling the very concept of history. ’, Wired, 20 April, n.pag.
     [Google Scholar]
  30. Pustu-Iren, Kader,, Sittel, Julian,, Mauer, Roman,, Bulgakowa, Oksana, and Ewerth, Ralph. ( 2020;), ‘ Automated Visual Content Analysis for film studies: Current status and challenges. ’, Digital Humanities Quarterly, 14:4, http://www.digitalhumanities.org/dhq/vol/14/4/000518/000518.html. Accessed 6 October 2022.
     [Google Scholar]
  31. Quantiphi ( 2021;), ‘ Finding gold in your media archives: Leveraging AI for content monetization. ’, webinar, https://pages.awscloud.com/apn-tv-641.html?trk=apn-tv-carousel. Accessed 6 October 2022.
     [Google Scholar]
  32. Sahlberg, Gardar. ( 1959;), ‘ Från filmens barndom. ’, Svenska Dagbladet, 19 December, n.pag.
     [Google Scholar]
  33. Sahlberg, Gardar. ( 1961;), ‘ När seklet var ungt. ’, Chaplin, 17 February, pp. 38–39.
     [Google Scholar]
  34. Sahlberg, Gardar. ( 1962a;), ‘ PM angående Svensk Filmindustris journalarkiv 1962. ’, Radio Sweden, Stockholm:: Förvaltnings- och dokumentarkiv ‘F2:3 Sahlberg’;.
     [Google Scholar]
  35. Sayers, Jenterey. ( 2019;), ‘ Bringing Trouvé to light: Speculative computer vision and media history. ’, in K. Kee, and T. Compeau. (eds), Seeing the Past with Computers, Ann Arbor, MI:: University of Michigan Press;, pp. 32–59.
     [Google Scholar]
  36. Simon, Matt. ( 2020;), ‘ AI magic makes century-old films look new. ’, Wired, 8 December, n.pag.
     [Google Scholar]
  37. Snickars, Pelle. ( 2001), Svensk film och visuell masskultur 1900, Stockholm:: Aura förlag;.
     [Google Scholar]
  38. Snickars, Pelle. ( 2003;), ‘ Digitalt filmarkiv under uppbyggnad. ’, Svenska Dagbladet, 25 March, n.pag.
     [Google Scholar]
  39. Snickars, Pelle. ( 2006;), ‘ Om utställningen som mediearkiv. ’, in A. Ekström,, S. Jülich, and P. Snickars. (eds), 1897: Mediehistorier från Stockholmsutställningen, Stockholm:: Mediehistoriskt arkiv;, pp. 127–66.
     [Google Scholar]
  40. Snickars, Pelle. ( 2008;), ‘ Televisionen som arkiv: om webb–tv. ’, in A. Edin, and P. Vesterlund. (eds), Svensk Television: en mediehistoria, Stockholm:: Mediehistoriskt arkiv;, pp. 309–35.
     [Google Scholar]
  41. Svensk filmdatabas ( n.d.), https://www.svenskfilmdatabas.se. Accessed 7 October 2022.
  42. Szeliski, Richard. ( 2011), Computer Vision: Algorithms and Applications, London:: Springer;.
     [Google Scholar]
  43. Tjerneld, Staffan. ( 1961;), ‘ Sensationell svensk filmkrönika från seklets början. ’, Expressen, 10 January, n.pag.
     [Google Scholar]
  44. Unger, Gunnar. ( 1964;), ‘ Sommarnattens grimaser. ’, Svenska Dagbladet, 16 June, n.pag.
     [Google Scholar]
  45. Vesterlund, Per. ( 2012;), ‘ Arkivvärde, programvärde, marknadsvärde. ’, in M. Jönsson, and P. Snickars. (eds), ‘Skosmörja eller arkivdokument?’ Om filmarkivet.se och den digitala filmhistorien, Stockholm:: Mediehistoriskt arkiv;, pp. 49–66.
     [Google Scholar]
  46. Vesterlund, Per. ( 2019), Ur Harry Scheins arkiv, Lund:: Mediehistoriskt arkiv;.
     [Google Scholar]
  47. Visual Information Retrieval in Video Archives (VIVA) ( 2021), https://projects.tib.eu/en/viva/projekt/. Accessed 6 October 2022.
  48. Waysdorf, Abby. ( 2021;), ‘ Remix in the age of ubiquitous remix. ’, Convergence, 27:4, 3 March, pp. 1129–44, https://doi.org/10.1177/1354856521994454. Accessed 6 October 2022.
     [Google Scholar]
  49. Wevers, Melvin, and Smits, Thomas. ( 2020;), ‘ The visual digital turn: Using neural networks to study historical images. ’, Digital Scholarship in the Humanities, 35:1, pp. 194–207.
     [Google Scholar]
  50. Wevers, Melvin, and Smits, Thomas. ( 2021;), ‘ The agency of computer vision models as optical instruments. ’, Visual Communication, 21:2, pp. 329–49.
     [Google Scholar]
  51. Williams, Mark. ( 2016;), ‘ Networking moving image history: Archives, scholars and the media ecology project. ’, in C. Acland, and E. Hoyt. (eds), The Arclight Guidebook to Media History and the Digital Humanities, Falmer:: Reframe Books;, pp. 335–46.
     [Google Scholar]
  52. Anon. ( 1897), Konungens af Siam landstigning vid Logårdstrappan, Sweden:.
     [Google Scholar]
  53. Anon. ( 1907), Visite à Stockholm, France:.
     [Google Scholar]
  54. Anon. ( 1909a), SF2061A, Sweden:.
     [Google Scholar]
  55. Anon. ( 1909b), SF2061B, Sweden:.
     [Google Scholar]
  56. Anon. ( 1909c), SF2063, Sweden:.
     [Google Scholar]
  57. Anon. ( 1909d), SF2066, Sweden:.
     [Google Scholar]
  58. Bergman, Ingmar. ( 1963), Tystnaden, Sweden:.
     [Google Scholar]
  59. Bergman, Ingmar. ( 1964), För att inte tala om alla dessa kvinnor, Sweden:.
     [Google Scholar]
  60. Engdahl, Carl. ( 1910), Bröllopet på Ulfåsa, Sweden:.
     [Google Scholar]
  61. Gad, Urban. ( 1910), Afgrunden, Denmark:.
     [Google Scholar]
  62. Kjellin, Alf. ( 1962), Siska, Sweden:.
     [Google Scholar]
  63. Sahlberg, Gardar. ( 1962b), Hotad idyll: En film om hösten 1914, Sweden:.
     [Google Scholar]
  64. Sahlberg, Gardar. ( 1962c), Kungen i närbild, Sweden:.
     [Google Scholar]
  65. Sahlberg, Gardar. ( 1963), Fåfängans marknad, Sweden:.
     [Google Scholar]
  66. Sahlberg, Gardar. ( 1964), Brefven från Stockholm: En film om sommaren 1909, Sweden:.
     [Google Scholar]
  67. Sahlberg, Gardar. ( 1965), Klassiska svenska filmer, Sweden:.
     [Google Scholar]
  68. Sahlberg, Gardar. ( 1966), Med ångbåt och ångtåg mot Östergyllen, Sweden:: Sveriges Radio;.
     [Google Scholar]
  69. Sahlberg, Gardar. ( 1967), Bergslagsbygd och norrlandskust, Sweden:: Sveriges Radio;.
     [Google Scholar]
  70. Sahlberg, Gardar. ( 1968), Stockholm under 20-talet, Sweden:: Sveriges Radio;.
     [Google Scholar]
  71. Shiryaev, Denis. ( 2021), A Trip through New York City in 1911, USA:, https://www.youtube.com/watch?v=hZ1OgQL9_Cw. Accessed 6 October 2022.
     [Google Scholar]
  72. Sjöström, Victor. ( 1913), Ingeborg Holm, Sweden:.
     [Google Scholar]
  73. Eriksson, Maria,, Skotare, Tomas, and Snickars, Pelle. ( 2022;), ‘ Understanding Gardar Sahlberg with neural nets: On algorithmic reuse of the Swedish SF archive. ’, Journal of Scandinavian Cinema, 12:3, pp. 225–47, https://doi.org/10.1386/jsca_00075_1
     [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1386/jsca_00075_1
Loading
Understanding Gardar Sahlberg with neural nets: On algorithmic reuse of the Swedish SF archive
Journal of Scandinavian Cinema 12, 225 (2022); https://doi.org/10.1386/jsca_00075_1
/content/journals/10.1386/jsca_00075_1
/content/journals/10.1386/jsca_00075_1
Loading

Data & Media loading...

  • Article Type: Article
Keyword(s): AI; archival reuse; computational film studies; convolutional neural nets; film archives; Video Reuse Detector

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error