© »hanuman flies over the himalayas«, generated by Debashis Sinha using CLIP, 2021

Algorithmic mythologies

Failure as a cultural tool

Abstract

Cultural practice in general is a slippery but deeply felt affair, where practitioners are often tasked with communicating the »underside of meaning« (Barthes, 1976). In algorithmic times, focusing on this task when working with machine learning outputs can offer an alternative to the pressure to consider quantifiable and easily machine-readable datasets as complete repositories of human knowledge. The multimodal knowledge held in sound and human experience is difficult to parse with data tools, e.g. machine learning, but the failures and messiness of these outputs add to our toolsets of constructing and reconstructing the worlds we offer in our stories. Through a presentation of some of Sinha’s discoveries navigating the worlds of theatre and machine learning-based audio research-creation, this audio paper offers examples of the possibilities of engaging with algorithmic failure as a deliberate strategy of discovery, to uplift the exploration of cultural possibilities and engage alternative models of community building and connection.

A note on »machine learning checkpoints« (referred to starting at 4m37s):

In machine learning, checkpoints refer to saved snapshots of a model's state at specific points during training. These checkpoints typically include:

  • Model weights/parameters
  • Optimizer state (for resuming training)
  • Training metadata (e.g., epoch number, loss value)

Checkpoints allow you to:

  1. Resume training from the last saved state in case of interruption.
  2. Avoid loss of progress during long training runs.
  3. Evaluate performance at different stages to select the best-performing model.
  4. Prevent overfitting by early stopping when validation loss stops improving.

Example: Sound Model Training

Suppose you're training a neural network to generate or classify sound (e.g., speech or music). During training:

  • The model learns patterns from sound waveforms or spectrograms.
  • Every few epochs (e.g., every 5 or 10), the training script saves a checkpoint.
  • If a validation loss decreases significantly, that particular checkpoint might be marked as the »best model«.

Disclosure
ChatGPT, 2025. Response to a question about checkpoints in machine learning with sound model example. [Chatbot] OpenAI ChatGPT, 16 May. Available at: https://chat.openai.com/ [Accessed 16 May 2025].

 

Bibliography

 

Anantrasirichai, N. and Bull, D. (2020). »Artificial Intelligence in the Creative Industries: A Review«. Bristol Vision Institute, University of Bristol, arXiv:2007.12391. Available at: https://doi.org/10.48550/arXiv.2007.12391 (Accessed: 16 May 2025).

Chowdhry, P., 2023. Is Web Scraping Stealing? [online] Hacker Noon. Available at: https://hackernoon.com/is-web-scraping-stealing [Accessed 6 October 2024].

Coleman, B., 2021. »Technology of the Surround«. Catalyst, 7(2), pp. 2–3. Special Section: Probing the System: Feminist Complications of Automated Technologies, Flows, and Practices of Everyday Life.

Elias, L. (2012). »Judith Halberstam, The Queer Art of Failure«. International Journal of Communication, 6, p. 3. Available at: https://ijoc.org/index.php/ijoc/article/view/1678 (Accessed: 16 May 2025).

Ganesh, M.I., 2024. »Memory Palace«. In: The AI Anarchies Book, pp. 25–33. Berlin: Akademie der Künste.

Garcia, M. (2024). »The Paradox of Artificial Creativity: Challenges and Opportunities of Generative AI Artistry«. Creativity Research Journal, pp. 1-14. doi: 10.1080/10400419.2024.2354622.

Goatley, W., 2024. »Newly Forgotten Technologies: Stories from AI Futures«. Independent, 22 October 2024. Available at: https://wesleygoatley.bandcamp.com/album/newly-forgotten-technologies-stories-from-ai-free-futures [Accessed 4 December 2024]. Used with permission.

Google, 2021. Google Colaboratory. Available at: https://colab.research.google.com [Accessed 4 December 2024].

Harper, J., 2024. The Creative Process: Debashis Sinha – Sound Design. YouTube, 21 May 2024. Available at: https://www.youtube.com/watch?v=LoNjcwkW0Ng [Accessed 4 December 2024].

HEXORCISMOS, n.d. Semilla AI. Available at: https://semilla.ai [Accessed 4 December 2024].

Kee, J. and Sharma, S., 2024. »Wildflowers and Broken Machines: A Tech Check for Feminist Philosophies and Politics«. In: The AI Anarchies Book, pp. 36–53. Berlin: Akademie der Künste.

Milmo, D., 2024. »Impossible’ to create AI tools like ChatGPT without copyrighted material, OpenAI says«. The Guardian, 8 January 2024.

Mittal, P., n.d. Time-Domain Neural Audio Style Transfer [Computer software. Google Colab. Available at: https://colab.research.google.com/drive/18_DckMGM-fsSthIqZI9sOAlY6I3plDLD [Accessed Feb 18, 2020].

Neutone, n.d. Neutone: Next Generation AI Tools for Musicians and Artists. Available at: https://neutone.ai [Accessed 4 December 2024].

Russell, L. (2020). Glitch feminism: A manifesto. New York: Verso Books.

Sinha, D. 2022. Akademie der Künste residence audio sketch [AI-Generated Electronic Music]. Composed using Google Colab (notebook unknown). 

Sinha, D. 2024. Cinematic Horror [AI-Generated Electronic Music]. Composed using Beatoven AI (https://www.beatoven.ai/).

Sinha, D. 2021. Machine learning training checkpoints [AI-Generated checkpoints from training]. Created using Google Colab notebook at https://colab.research.google.com/drive/18_DckMGM-fsSthIqZI9sOAlY6I3plDLD

Sinha, D. 2018. Priest chanting during prayer service during Durga Puja. Audio field recording. Kolkata. Author’s personal sound library.

Sinha, D. 2018. Drumming during prayer service during Durga Puja. Audio field recording. Kolkata. Author’s personal sound library.

Sinha, D. 2024. Purple Flower Picnic  [AI-Generated Electronic Music]. Composed using Beatoven AI (https://www.beatoven.ai/).

Sinha, D. 2024. Soundtrack to h. Performed by Debashis Sinha. Unreleased video by Lyla Rye.

Sinha, D. 2018. Street sounds in South Kolkata. Audio field recording. Kolkata. Author’s personal sound library.

Sinha, D. 2024. Sunshine Marimba [AI-Generated Electronic Music]. Composed using Beatoven AI (https://www.beatoven.ai/).

Sinha, D., 2021. X Avant XVI: Process (excerpt). Music Gallery, Toronto, 16 October 2021.

Various Artists, 2024. MUTUALISMX. Other People Records, 15 February 2024. Available at: https://otherpeople.bandcamp.com/album/mutualismx [Accessed 4 December 2024].

Voegelin, S., 2014. Sonic Possible Worlds: Hearing the Continuum of Sound. New York: Bloomsbury Academic.

Keywords

Sound
AI
storytelling
archives
Algorithmic Failure

Fokusartikler