Skip to content
1981
The Human and the Machine: AI Hopes and Fears in Media & Society
  • ISSN: 1757-2681
  • E-ISSN: 1757-269X

Abstract

The artificial general intelligence (AGI) narrative, which posits that artificial intelligence (AI) has the potential to benefit while threatening to destroy , is an apocalyptic narrative that has become increasingly dominant in debates around AI ethics. This article (1) constructs an analogy between the transhumanist AGI narrative and Christian apocalypticism through which we can (2) constitute the transhumanist AGI narrative as a rhetorical strategy that invokes a state of exception to (3) endow AI with , an intangible form of power that grants the legitimacy to decide on exceptional situations. The article concludes with reflections on the implications of this rhetorical transfer of power’s coupling with transhumanist eugenic goals on human rights and AI ethics.

© 2022 Intellect Ltd
Loading

Article metrics loading...

/content/journals/10.1386/iscc_00062_1
2024-10-17
2026-04-14

Metrics

Loading full text...

Full text loading...

References

  1. Agamben, Giorgio (1998), Homo Sacer: Sovereign Power and Bare Life, Stanford, CA: Stanford University Press.
     [Google Scholar]
  2. Agamben, Giorgio (2005), State of Exception, Chicago, IL: University of Chicago Press.
     [Google Scholar]
  3. Agamben, Giorgio (2010), The Signature of All Things: On Method, New York: Zone Books.
     [Google Scholar]
  4. Agamben, Giorgio (2011), The Kingdom and the Glory: For a Theological Genealogy of Economy and Government, Stanford, CA: Stanford University Press.
     [Google Scholar]
  5. Ahmed, Shazeda, Jaźwińska, Klaudia, Ahlawat, Archana, Winecoff, Amy and Wang, Mona (2024), ‘Field-building and the epistemic culture of AI safety’, First Monday, 29:4, https://doi.org/10.5210/fm.v29i4.13626. Accessed 20 April 2024.
     [Google Scholar]
  6. Ali, Syed (2017), ‘Transhumanism and/as whiteness’, in Proceedings of the IS4SI 2017 Summit Digitalisation for a Sustainable Society, Gothenburg, Sweden, 12–16 June, Basel: MDPI, p. 244.
     [Google Scholar]
  7. Ali, Syed Mustafa (2019), ‘“White crisis” and/as “existential risk”, or the entangled apocalypticism of artificial intelligence’, Zygon®, 54:1, pp. 207–24.
     [Google Scholar]
  8. Ames, Morgan G. (2019), The Charisma Machine: The Life, Death, and Legacy of One Laptop per Child, Cambridge, MA: MIT Press.
     [Google Scholar]
  9. ‘apocalypse, n.’ (n.d.a), Oxford English Dictionary, online 2nd ed., Oxford: Oxford University Press, https://www.oed.com/dictionary/apocalypse_n. Accessed 24 September 2024.
     [Google Scholar]
  10. ‘authority, n.’ (n.d.b), Oxford English Dictionary, online 2nd ed., Oxford: Oxford University Press, https://www.oed.com/dictionary/authority_n. Accessed 24 September 2024.
     [Google Scholar]
  11. Bender, Emily M., Gebru, Timnit, McMillan-Major, Angelina and Shmitchell, Shmargaret (2021), ‘On the dangers of stochastic parrots: Can language models be too big?’, Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Association for Computing Machinery, New York, USA, 1 March, pp. 610–23.
     [Google Scholar]
  12. Bendersky, Joseph (1979), ‘The expendable Kronjurist: Carl Schmitt and national socialism, 1933–36’, Journal of Contemporary History, 14:2, pp. 309–28.
     [Google Scholar]
  13. Benedikt, Michael (ed.) (1994b), ‘Introduction’, Cyberspace: First Steps, 7th ed., Cambridge, MA: MIT Press, pp. 1–26.
     [Google Scholar]
  14. Benjamin, Walter (1986), ‘Theses on the philosophy of history’, in H. Arendt (ed.), Illuminations, New York: Schocken Books, pp. 253–64.
     [Google Scholar]
  15. Benjamin, Walter (2003), The Origin of German Tragic Drama, London and New York: Verso.
     [Google Scholar]
  16. Bostrom, Nick (2001), ‘What is transhumanism?’, September, https://nickbostrom.com/old/transhumanism. Accessed 23 June 2024.
  17. Bostrom, Nick (2002), ‘Existential risks: Analyzing human scenarios and related hazards’, Journal of Evolution and Technology, 9:1, pp. 1–30, https://nickbostrom.com/existential/risks.pdf. Accessed 26 February 2024.
     [Google Scholar]
  18. Bostrom, Nick (2003), ‘Astronomical waste: The opportunity cost of delayed technological development’, Utilitas, 15:3, pp. 308–14.
     [Google Scholar]
  19. Bostrom, Nick (2005), ‘A history of transhumanist thought’, Journal of Evolution and Technology, 14:1, pp. 1–25.
     [Google Scholar]
  20. Bostrom, Nick (2014), Superintelligence: Paths, Dangers, Strategies, Oxford: Oxford University Press.
     [Google Scholar]
  21. Buck v. Bell (1927), No. 292, p. 274 U.S. 200.
  22. Burrell, Jenna and Metcalf, Jacob (2024), ‘Introduction for the Special Issue of “Ideologies of AI and the Consolidation of Power”: Naming power’, First Monday, 29:4, https://doi.org/10.5210/fm.v29i4.13643. Accessed 20 April 2024.
     [Google Scholar]
  23. Cave, Stephen, Dihal, Kanta and Dillon, Sarah (2020), ‘Introduction: Imagining AI’, in S. Cave, K. S. M. Dihal and S. Dillon (eds), AI Narratives: A History of Imaginative Thinking about Intelligent Machines, Oxford: Oxford University Press, pp. 1–25.
     [Google Scholar]
  24. Cetina, Karin Knorr (2009), Epistemic Cultures: How the Sciences Make Knowledge, Cambridge, MA: Harvard University Press.
     [Google Scholar]
  25. Cho, Renée (2023), ‘AI’s growing carbon footprint: State of the planet’, AI’s Growing Carbon Footprint, 9 June, https://news.climate.columbia.edu/2023/06/09/ais-growing-carbon-footprint/. Accessed 9 June 2023.
  26. Christiaens, Tim (2021), ‘Agamben’s theories of the state of exception: From political to economic theology’, Cultural Critique, 110:1, pp. 49–74.
     [Google Scholar]
  27. Cohen, Alexander Emil (2024), ‘Challenging transhumanist apocalyptic AI narratives through speculative fabulation’, in Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, 11 May, Honolulu, HI: ACM, pp. 1–8.
     [Google Scholar]
  28. Conn, Ariel (2015), ‘Benefits & risks of artificial intelligence’, Future of Life Institute, 14 November, https://futureoflife.org/ai/benefits-risks-of-artificial-intelligence/. Accessed 14 November 2015.
  29. Davis, Erik (1998), Techgnosis: Myth, Magic, Mysticism in the Age of Information, New York: Harmony Books.
     [Google Scholar]
  30. ‘eschatology, n.’ (n.d.c), Oxford English Dictionary, online 2nd ed., Oxford: Oxford University Press, https://www.oed.com/dictionary/eschatology_n. Accessed 24 September 2024.
     [Google Scholar]
  31. ‘eugenic, adj.’ (n.d.d), Oxford English Dictionary, online 2nd ed., Oxford: Oxford University Press, https://www.oed.com/dictionary/eugenic_adj2. Accessed 24 September 2024.
     [Google Scholar]
  32. Future of Life Institute (n.d.), ‘Our mission’, 12 June, https://futureoflife.org/our-mission/. Accessed 25 June 2024.
  33. Gebru, Timnit and Torres, Émile P. (2024), ‘The TESCREAL bundle: Eugenics and the promise of utopia through artificial general intelligence’, First Monday, 29:4, https://doi.org/10.5210/fm.v29i4.13636.
     [Google Scholar]
  34. Geraci, Robert M. (2008), ‘Apocalyptic AI: Religion and the promise of artificial intelligence’, Journal of the American Academy of Religion, 76:1, pp. 138–66.
     [Google Scholar]
  35. Geraci, Robert M. (2010), Apocalyptic AI: Visions of Heaven in Robotics, Artificial Intelligence, and Virtual Reality, New York: Oxford University Press.
     [Google Scholar]
  36. Goertzel, Ben (2010), A Cosmist Manifesto, Humanity+ Press, pp. 1–360, https://goertzel.org/CosmistManifesto_July2010.pdf. Accessed 29 April 2024.
     [Google Scholar]
  37. Goertzel, Ben and Pennachin, Cassio (eds) (2007), Artificial General Intelligence, Berlin and New York: Springer.
     [Google Scholar]
  38. Google Deepmind (n.d.), ‘Responsibility & safety’, https://deepmind.google/about/responsibility-safety/. Accessed 20 April 2024.
  39. Halper, Evan and O’Donovan, Caroline (2024), ‘AI is exhausting the power grid: Tech firms are seeking a miracle solution’, The Washington Post, 21 June, https://www.washingtonpost.com/business/2024/06/21/artificial-intelligence-nuclear-fusion-climate/. Accessed 21 June 2024.
     [Google Scholar]
  40. Haraway, Donna Jeanne (2016), Staying with the Trouble: Making Kin in the Chthulucene, Durham, NC: Duke University Press.
     [Google Scholar]
  41. Hill, Mike and Montag, Warren (2015), The Other Adam Smith, Stanford, CA: Stanford University Press.
     [Google Scholar]
  42. Huxley, Julian (1957), New Bottles for New Wine, London: Chatto and Windus, Ltd.
     [Google Scholar]
  43. Jasanoff, Sheila and Kim, Sang-Hyun (eds) (2015), Dreamscapes of Modernity: Sociotechnical Imaginaries and the Fabrication of Power, Chicago, IL and London: University of Chicago Press.
     [Google Scholar]
  44. Kilgore, Georgette (2024), ‘Carbon footprint of data centers & data storage per country (calculator)’, 16 May, https://8billiontrees.com/carbon-offsets-credits/carbon-ecological-footprint-calculators/carbon-footprint-of-data-centers/. Accessed 25 June 2024.
  45. Kimmerer, Robin Wall (2013), Braiding Sweetgrass: Indigenous Wisdom, Scientific Knowledge and the Teachings of Plants, 1st paperback ed., Minneapolis, MN: Milkweed Editions.
     [Google Scholar]
  46. Kurzweil, Ray (1999), The Age of Spiritual Machines: When Computers Exceed Human Intelligence, New York: Viking.
     [Google Scholar]
  47. Kurzweil, Ray (2005), The Singularity Is Near: When Humans Transcend Biology, New York: Viking.
     [Google Scholar]
  48. Latour, Bruno (1993), We Have Never Been Modern, Cambridge, MA: Harvard University Press.
     [Google Scholar]
  49. Latour, Bruno (2017b), ‘The states (of nature) between war and peace’, in C. Porter (trans.), Facing Gaia: Eight Lectures on the New Climatic Regime, Cambridge and Medford, MA: Polity Press, pp. 220–55.
     [Google Scholar]
  50. Lerner, Robert E. (1985), ‘Antichrists and antichrist in Joachim of Fiore’, Speculum, 60:3, pp. 553–70.
     [Google Scholar]
  51. Lewis, Jason Edward, Arista, Noelani, Pechawis, Archer and Kite, Suzanne (2018), ‘Making kin with the machines’, Journal of Design and Science, 3&5, https://doi.org/10.21428/bfafd97b.
     [Google Scholar]
  52. Lowrie, Michèle (2009b), Writing, Performance, and Authority in Augustan Rome, Oxford and New York: Oxford University Press.
     [Google Scholar]
  53. Meeks, Wayne A. (2000), ‘Apocalyptic discourse and strategies of goodness’, The Journal of Religion, 80:3, pp. 461–75.
     [Google Scholar]
  54. Milan, Stefania and Treré, Emiliano (2019), ‘Big data from the South(s): Beyond data universalism’, Television & New Media, Special Issue: ‘Big Data from the South(s): Beyond Data Universalism’, 20:4, pp. 319–35.
     [Google Scholar]
  55. Minsky, Marvin (1986), The Society of Mind, New York: Simon and Schuster.
     [Google Scholar]
  56. Moravec, Hans (1988), Mind Children: The Future of Robot and Human Intelligence, Cambridge, MA: Harvard University Press.
     [Google Scholar]
  57. Muashekele, Chris, Rodil, Kasper, Winschiers-Theophilus, Heike and Magoath, Christof (2023a), ‘Futuring from an Indigenous community stance: Projecting temporal duality from the past into the future’, in Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany, 19 April, Hamburg: ACM, pp. 1–7.
     [Google Scholar]
  58. Muashekele, Chris, Winschiers-Theophilus, Heike, Rodil, Kasper and Koruhama, Alphons (2023b), ‘Ancestral and cultural futuring: Speculative design in an Indigenous ovaHimba context’, in The 11th International Conference on Communities and Technologies (C&T), Lahti, Finland, 29 May, Lahti: ACM, pp. 85–95.
     [Google Scholar]
  59. National Human Genome Research Institute (2022), ‘Eugenics and scientific racism’, 18 May, https://www.genome.gov/about-genomics/fact-sheets/Eugenics-and-Scientific-Racism. Accessed 12 June 2024.
  60. Newman, Carla M. (2018), ‘Essay: Bartering from the bench: A Tennessee judge prevents reproduction of social undesirables; historical analysis of involuntarily sterilization of African American women’, Georgetown Journal Law & Modern Critical Race Perspectives, 10:1, pp. 53–62.
     [Google Scholar]
  61. Noble, David F. (1999), The Religion of Technology: The Divinity of Man and the Spirit of Invention, New York: Penguin Books.
     [Google Scholar]
  62. Open Philanthropy (2021), ‘Potential risks from advanced artificial intelligence’, 24 July, https://www.openphilanthropy.org/focus/potential-risks-advanced-ai/. Accessed 12 June 2024.
  63. Open Philanthropy (n.d.), ‘Home’, https://www.openphilanthropy.org/. Accessed 12 June 2024.
  64. OpenAI (n.d.), ‘OpenAI charter’, https://openai.com/charter. Accessed 17 April 2024.
  65. Riedl, Matthias (2012), ‘A collective messiah: Joachim of Fiore’s constitution of future society O Messias Coletivo: A Constituição Da Sociedade Futura Em Joaquim de Fiore’, Mirabilia, 14, https://www.revistamirabilia.com/issues/mirabilia-14-2012-1/article/collective-messiah-joachim-fiores-constitution-future-society. Accessed 3 October 2024.
     [Google Scholar]
  66. Ruby, Raemon, Robert, M. and habryka (n.d.), ‘Welcome to LessWrong!’, LessWrong, 14 June, https://www.lesswrong.com/posts/bJ2haLkcGeLtTWaD5/welcome-to-lesswrong. Accessed 20 April 2024.
  67. Schmitt, Carl (2005), Political Theology: Four Chapters on the Concept of Sovereignty, University of Chicago Press ed., Chicago, IL: University of Chicago Press.
     [Google Scholar]
  68. Smith, Adam (2009), The Theory of Moral Sentiments, 5th ed., Cambridge: Cambridge University Press.
     [Google Scholar]
  69. Smith, Brad and Nakagawa, Melanie (2023), ‘Accelerating sustainability with AI: A playbook’, https://blogs.microsoft.com/on-the-issues/2023/11/16/accelerating-sustainability-ai-playbook/. Accessed 16 November 2023.
  70. Søndergaard, Marie Louise Juul, Campo Woytuk, Nadia, Howell, Noura, Tsaknaki, Vasiliki, Helms, Karey, Jenkins, Tom and Sanches, Pedro (2023), ‘Fabulation as an approach for design futuring’, in Proceedings of the 2023 ACM Designing Interactive Systems Conference, Pittsburgh, PA, 10 July, Pittsburgh, PA: ACM, pp. 1693–709.
     [Google Scholar]
  71. ‘sovereignty, n.’ (n.d.e), Oxford English Dictionary, online 2nd ed., Oxford: Oxford University Press, https://www.oed.com/dictionary/sovereignty_n. Accessed 24 September 2024.
     [Google Scholar]
  72. Taubes, Jacob (2009), Occidental Eschatology, Stanford, CA: Stanford University Press.
     [Google Scholar]
  73. Tegmark, Max (2017), Life 3.0: Being Human in the Age of Artificial Intelligence, New York: Alfred A. Knopf.
     [Google Scholar]
  74. Virginia State General Assembly (1924), An ACT to Provide for the Sexual Sterilization of Inmates of State in Certain Cases, Richmond, VA: David Bottom, Superintendent of Public Printing, pp. 569–71, https://babel.hathitrust.org/cgi/pt?id=njp.32101073363507&seq=575. Accessed 29 June 2024.
     [Google Scholar]
  75. Watkin, William (2014), Agamben and Indifference: A Critical Overview, London and New York: Rowman & Littlefield International.
     [Google Scholar]
  76. Weber, Max (1947), The Theory of Social and Economic Organization, New York: Oxford University Press.
     [Google Scholar]
  77. Weizenbaum, Joseph (2008), ‘Social and political impact of the long-term history of computing’, IEEE Annals of the History of Computing, 30:3, pp. 40–42.
     [Google Scholar]
  78. Benedikt, Michael (ed.) (1994a), Cyberspace: First Steps, Cambridge, MA: MIT Press.
     [Google Scholar]
  79. Dickinson, Colby and Kotsko, Adam (eds) (2015), Agamben’s Coming Philosophy: Finding a New Use for Theology, New York: Rowman & Littlefield International, Ltd.
     [Google Scholar]
  80. Guerrero Millan, Carlos, Nissen, Bettina and Pschetz, Larissa (2024), ‘Cosmovision of data: An Indigenous approach to technologies for self-determination’, in Proceedings of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, 11 May, Honolulu, HI: ACM, pp. 1–13.
     [Google Scholar]
  81. Kotsko, Adam (2015), ‘The theology of neoliberalism’, in C. Dickinson and A. Kotsko (eds), Agamben’s Coming Philosophy: Finding a New Use for Theology, New York: Rowman & Littlefield International, Ltd., pp. 207–27.
     [Google Scholar]
  82. Latour, Bruno (2017a), Facing Gaia: Eight Lectures on the New Climatic Regime, Cambridge and Medford, MA: Polity Press.
     [Google Scholar]
  83. Lowrie, Michèle (2009a), ‘Auctoritas and representation: Augustus’s Res gestae’, in Writing, Performance, and Authority in Augustan Rome, Oxford and New York: Oxford University Press, pp. 279–308.
     [Google Scholar]
/content/journals/10.1386/iscc_00062_1
Loading
  • Article Type: Article
Keyword(s): AI narratives; apocalypticism; artificial general intelligence; artificial intelligence; eugenics; human rights; political theology

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a success
Invalid data
An error occurred
Approval was partially successful, following selected items could not be processed due to error
Please enter a valid_number test