Generative AI on the edge: Real-time symbolic music accompaniment
Loading...
Author
Vuagniaux, R.
Fragnère, G.
Dia, M.
Türetken, E.
Maamari, N.
DOI
Abstract
This work presents a real-time system for generating symbolic music accompaniments from an input lead melody in Musical Instrument Digital Interface (MIDI) format. A new tokenization scheme, REMIBlock, is introduced to better synchronize melody and accompaniment at the bar level. Using a lightweight GPT-2-based architecture optimized for edge deployment, the system produces rhythmically and harmonically coherent accompaniments. Experiments on jazz piano datasets show strong groove and scale consistency, along with low perplexity, confirming the model’s understanding of musical structure. The approach runs efficiently on devices such as the NVIDIA Jetson Orin, enabling real-time use in live performance scenarios. REMIBlock Tokenizer
Publication Reference
CSEM Scientific and Technical Report 2025, p. 15–16
Year
2025