v.4MP

Image-Based Visual Music for Improvisational Performance

v.4MP

v.4MP is a software tool designed to help musicians seamlessly create visual accompaniments to their performances without needing extensive knowledge of graphics software. It integrates with Ableton Live or runs as a standalone Max patch, allowing users to map real-time audio analysis to dynamic image blending, creating expressive and unique visual narratives. The creation of v.4MP involved an intensive, iterative UX research, design, and development process aimed at meeting the specific needs of free improvising performers, filling a gap in existing tools and leveraging the latest technological capabilities.

Max for Live Audiovisual Performance Interface

Final UI

The Problem

Creating visual music systems typically requires expertise in complex software like MaxMSP or TouchDesigner, and can disrupt creative flow when requiring artists to work across differing mediums and mindsets. While many visual music tools exist, they often lack the artistic flexibility and personalization artists want. v.4MP is a Max for Live device designed to empower musicians, especially free improvisers, to intuitively build custom audio-visual systems that authentically represent their music and artistic vision.

Solution Description

v.4MP achieves this through intuitive, flexible mapping between audio features and visual parameters, including options to train ML models for more complex mappings—all within the familiar Max or Ableton Live UI. By using artist-imported media files as graphic elements, v.4MP supports high variability in visual output and personalization. Additionally, through a machine listening algorithm and variable audio analysis mappings, the system is able to learn and adapt to a performer’s unique musical style and help develop a distinctive visual language.

V.4MP Demo

Details on the user-research and design process are explored in depth in the research report, which can be viewed here. Additionally, device documentation with descriptions and instructions for each feature is available here. v.4MP is free to use and available for download on my GitHub. Enjoy!