Categories: Image

Nava – A 6.3B audio-video model .

Page: https://ernie-research.github.io/NAVA/
Model: https://huggingface.co/ernie-research/NAVA
Github: https://github.com/ernie-research/NAVA

NAVA is a 6.3 B-parameter joint audio-video generator that synthesizes synchronized video and audio from a single prompt — including multi-speaker speech with reference-timbre control and image-conditioned continuations.

Instead of post-hoc-aligned dual towers or fully unified tri-modal stacks, NAVA uses an Align-then-Fuse MMDiT: a dedicated alignment space first establishes audio-video correspondence, then context (text, speaker embeddings) is fused via cross-attention. On Verse-Bench it sets new SOTA on Sync-C / Sync-D / video quality / audio WER while using 2× to 5× fewer parameters than open-source baselines.

submitted by /u/AgeNo5351
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Introducing Claude apps gateway for AWS

Enterprises deploying Claude Code and Claude Desktop across development teams need centralized control over access,…

21 hours ago

NVIDIA Nemotron Achieves Benchmark-Leading Performance With LangChain Deep Agents Harness

NVIDIA Nemotron 3 Ultra is offering leading performance at lower cost than top closed models…

21 hours ago

One of Meta’s Offices Was Briefly Overtaken by a Rogue Squirrel

The animal escaped after apparently arriving inside a package at Meta's Bangkok office, injuring one…

22 hours ago

AI memory bottleneck may ease as ultrathin chip stacks quadruple high-bandwidth memory density

A Korean research team has developed a technology that enables the stable stacking of more…

22 hours ago

Intelligence is Free, Now What? Data Systems for, of, and by Agents

... government of the people, by the people, for the people ...     — Abraham Lincoln,…

2 days ago