Princeton University and Goldsmiths University of London
An example of a distributed, synchronized musical instrument. The instrument is composed of various parts that exist in different locations. It uses prediction in order to synthesize the same audio in each location at the same moment. It capitalizes on the predictable path of a percussion mallet in order to accomplish this goal.
In this paper, we demonstrate that it is possible to create a distributed, synchronized musical instrument that allows performers to play together over long distances, despite latency. We describe one such instrument, MalLo, which combats latency by predicting a musician's action before it is completed. MalLo sends information about a predicted musical note over the Internet before it is played, and synthesizes this note at a collaborator's location at nearly the same moment it is played by the performer. MalLo also protects against latency spikes by sending the prediction data across multiple network paths, with the intention of routing around latency.
Zeyu Jin, Reid Oda, Adam Finkelstein, and Rebecca Fiebrink.
"MalLo: A Distributed, Synchronized Instrumentfor Internet Music Performance."
15th International Conference on New Interfaces for Musical Expression (NIME), May 2015.
@inproceedings{Jin:2015:MAD, author = "Zeyu Jin and Reid Oda and Adam Finkelstein and Rebecca Fiebrink", title = "{MalLo}: A Distributed, Synchronized Instrumentfor Internet Music Performance", booktitle = "15th International Conference on New Interfaces for Musical Expression (NIME)", year = "2015", month = may }