Live input as creative material
A responsive visual field can follow a performance, but the deeper possibility is that the performer begins responding to the field in return.
Live audiovisual work is a feedback loop. A microphone supplies energy, frequency, and transient information. A camera supplies color, luminance, and motion. MIDI can provide direct performance control. A captured browser tab or supported system-audio source can let existing media drive the instrument. Once the visual response becomes visible, the performer adjusts timing, intensity, articulation, or movement—and the loop continues.
Choose an input for its behavior
A microphone is useful for vocals, acoustic instruments, percussion, room sound, and audience response. Camera input can make physical movement or changing light part of the composition. Tab capture is useful for rehearsing with an existing audio source, while MIDI is helpful when repeatable hands-on control matters.
Browser capabilities vary by operating system, device, permissions, and media support. A good performance plan includes a preflight: confirm the exact input, test permission prompts, check latency, verify recording format, and know what fallback will be used if a capability is unavailable.
Calibrate for the room
Input sensitivity should match the environment. A quiet room and a loud venue produce very different ranges. Begin with moderate intensity and watch how often the field reaches its extremes. If every moment appears maximal, lower the response. If the world barely moves, increase sensitivity or choose a world whose motion fits the source.
Decide what the visual should follow
The obvious mapping is impact to impact: loud sound creates bright motion. Try a more deliberate rule. Let low frequencies control scale while high frequencies control fine detail. Use a slow visual world for a fast source. Allow the image to provide continuity while the music changes rapidly. The performance becomes clearer when every visual property has a job.
Build transitions, not just reactions
A sustained performance needs larger form. Journey mode can move between worlds on an interval, optionally cycling saved Visions. Manual reimagining can mark a section change. Performance mode removes interface chrome so the field can occupy the screen. Rehearse transitions with the same care as musical cues; a powerful reactive effect can still feel arbitrary if it never develops.
Record with the limitation visible
Supported browsers may record MP4, while others use WebM. System audio may not be available on every platform. Treat those limits as production requirements, not last-minute surprises. Test the exported file on the device and software that will receive it.
Live input turns an audiovisual instrument into a partner. The most memorable performance is not the one with the most reactions. It is the one where sound, motion, image, and attention appear to be listening to each other.