Machine Learning, AI, Sound Signal Analyses, Music Instrument Recognition
University studies
I studied computer science and musicology at the Julius-Maximilians-Universität of Würzburg. I was majoring in theoretical computer science. The classification of problems into complexity classes was one of the most interesting topics of my studies.
In my Studienarbeit – the former bachelor’s thesis – I developed an ear training program for special intervals that arise with other tunings. And during my diploma thesis, I used the logical programming language Prolog to analyze Bach chorales (in the MusicXML format) for chords, keys and Co. .
Doctorate
In my doctoral thesis at the international Audio Laboratories Erlangen (a joint institution of the Friedrich-Alexander University Erlangen-Nuremberg and the Fraunhofer IIS), I worked on musical instrument recognition in audio signals conducted research on the optimization of artificial neural networks.
recent research projects
I have been leading the first year of the Artificial Intelligence in Culture and Arts (AICA) group at the University of Music and Performing Arts Munich (HMTM) from April 2023-April 2024, where I am additionally a lecturer for my course application-oriented programming at the chair: Master’s program in Digital Communication.
Doctoral Thesis: Single Musical Instrument Recognition – a solved Problem?
Abstract:
Single instrument recognition is a research topic that is worked on for many years. After the AI winter the approaches switched from feature based methods to artificial neural networks. When the recognition rates increased the community moved on to harder problems, at the latest when the community announced that the single instrument recognition is solved.
In this thesis I am going to show that the assumptions that are the basis for this statement are erroneous. The main reason is the misbelief of the comparability of accuracies. To approach this problem I will introduce an evaluation method that is less prone to external factors and a well obtainable data base that enables a better comparison of algorithms.
To evaluate the actual level of the resolving of single instrument recognition and to push this frontier, I refined, combined, and evaluated the feature and the artificial neural network based approach. During this process a new feature was developed and well known features were improved, and artificial neural network architectures were optimized and compared by applying evolutionary programming.
The full thesis: https://open.fau.de/items/f3ff2ed3-3b7a-4222-a69a-8019f23cbce7
Article: A Comparison of Human Creativity and Generative Music Production
Recent Activities
Discussion panels:
- 28. June 24 – Expert Panel at „Festival der Zukunft“ in Munic
- May 15, 2023 – AI_vs: Art – Episode 1 (online)
- 28.06.2023 – Podiumsdiskussion bei Artistic Intelligence im Leonardo Zentrum Nürnberg
- 6.Juli 2023 – Podiumsdiskussion bei der DIALOG 2023 in München: https://www.infinit.cx/veranstaltung/dialog-2023-konferenz-hot-summer-edition/
- 8.11.2023 – Vernissage und Podiumsdiskussion – In der Repräsentanz des Freistaats Bayern in der Tschechischen Republik https://www.goethe.de/ins/cz/de/ver.cfm?event_id=25181198
- Oktober 2023 und Januar 2024 Kipppunkt KI (online) https://www.linkedin.com/events/kipppunktki-2-interdisziplin-re7150513276009824256/theater/
Moderation:
- 29. Juni. 2023 – Moderation der Veranstaltung: RUFFINI ON TOUR: Ersetzt Generative KI die Kreativität? https://www.youtube.com/watch?v=kR3U1datBKA
Keynotes:
- 24. April 24 – „Unleashing Creativity with AI & Sound“ 🎨 at the Data and AI Leaders Forum Munic
- 18.10.2023 – Keynote bei “Empowering Tomorrow Gen AI” an der University of Kent in England: https://www.kent.ac.uk/conferences-and-events/empowering-tomorrow-gen-ai/programme
- 12.1.2024 – Keynote beim “Kent and Medway Business Summit”
Interviews and Potcasts:
- Die Zukunft der Kreativität Folge 16: https://www.calliesundschewe.de/blog/k-o-durch-ki-die-zukunft-der-kreativitaet-folge-16/
- human Magazin Newsletter:
https://human-magazin.de/?na=v&nk=540-8bbdfee331&id=23
- XPLR Media:
- Radio Interview für WDR COSMO