|
Persistent Identifier
|
doi:10.18710/4FBT38 |
|
Publication Date
|
2025-06-15 |
|
Title
| Extended Data for: Quality-Diversity Search in Sound Generation: Investigating Innovation Engines for Audio Exploration |
|
Author
| Jónsson, Björn Þór (University of Oslo) - ORCID: 0000-0003-1304-5913
Erdem, Çağrı (University of Oslo) - ORCID: 0000-0003-2632-6829
Fasciani, Stefano (University of Oslo) - ORCID: 0000-0001-5555-3225
Glette, Kyrre (University of Oslo) - ORCID: 0000-0003-3550-3225 |
|
Point of Contact
|
Use email button above to contact.
Jónsson, Björn Þór (University of Oslo) |
|
Description
| Data accompanying the article Quality-Diversity Search in Sound Generation: Investigating Innovation Engines for Audio Exploration. The Innovation Engine algorithm is used to evolve sounds, where Quality Diversity search is guided by the YAMNet classifier to discover sounds. (2024-08-15)
This study draws on the challenges that composers and sound designers face in creating and refining new tools to achieve their musical goals. Utilising evolution- ary processes to promote diversity and foster serendipitous discoveries, we propose to automate the search through uncharted sonic spaces for sound discovery. We argue that such diversity promoting algorithms can bridge a technological gap between the theoretical realisation and practical accessibility of sounds. Specif- ically, in this paper we describe a system for generative sound synthesis using a combination of Quality Diversity (QD) algorithms and a supervised discrimi- native model, inspired by the Innovation Engine algorithm. The study explores different configurations of the generative system and investigates the interplay between the chosen sound synthesis approach and the discriminative model. We further examine the interaction between Compositional Pattern Producing Net- works (CPPNs) and Digital Signal Processing (DSP) graphs, introducing a novel approach with multiple specialized CPPNs for different frequency ranges. This configuration results in simpler CPPN networks while maintaining comparable performance to single-CPPN setups. The research also investigates evolution- ary stepping stones by analyzing goal switches between musical and non-musical contexts, revealing how lineages traverse unlikely paths to current elites. Addi- tionally, we explore the temporal dimension of sound generation by expanding the behavior space from a previous study to include various sound durations, uncovering specialization within temporal niches. The results indicate that a combination of CPPN + Digital Signal Processing (DSP) graphs coupled with Multi-dimensional Archive of Phenotypic Elites (MAP-Elites) and a deep learn- ing classifier can generate a substantial variety of synthetic sounds. Our expanded experiments demonstrate the system’s ability to produce diverse and innovative sound objects across different temporal and contextual dimensions. The study concludes by presenting the generated sound objects through an online explorer and as rendered sound files. Furthermore, in the context of music composition, we present an experimental application that showcases the creative potential of our discovered sounds, highlighting the system’s capacity for generating versatile sonic material across various durations and contexts. (2024-08-15) |
|
Subject
| Arts and Humanities; Computer and Information Science |
|
Keyword
| Sound Synthesis
Quality Diversity Search
Innovation Engines |
|
Related Publication
| Quality-Diversity Search in Sound Generation: Investigating Innovation Engines for Audio Exploration Forthcoming in Evolutionary Computation and Applications in SN Computer Science. |
|
Language
| English |
|
Producer
| University of Oslo (UiO) https://www.uio.no/english/ |
|
Contributor
| Hosting Institution : RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion |
|
Funding Information
| The Research Council of Norway: 262762 |
|
Distributor
| University of Oslo (UiO) https://dataverse.no/dataverse/uio |
|
Depositor
| Jónsson, Björn Thor |
|
Deposit Date
| 2024-08-15 |
|
Date of Collection
| Start Date: 2023-11-01 ; End Date: 2024-08-18 |
|
Data Type
| Generation data, genomes and elite maps, from evolutionary simulations.; Analysis results and software used for the analysis.; Rendered sound objects from genomes discovered during evolutionary simulations. |
|
Software
| kromosynth-cli, Version: 2023-11-30
kromosynth-evaluate, Version: 2023-11-30
kromosynth, Version: 2023-11-30 |
|
Related Dataset
| https://doi.org/10.18710/BAX9N5 |
