SAM Audio: the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts

SAM-Audio is a foundation model for isolating any sound in audio using text, visual, or temporal prompts. It can separate specific sounds from complex audio mixtures based on natural language descriptions, visual cues from video, or time spans.

https://ai.meta.com/samaudio/

https://huggingface.co/collections/facebook/sam-audio

https://github.com/facebookresearch/sam-audio