| | Page: https://ernie-research.github.io/NAVA/ NAVA is a 6.3 B-parameter joint audio-video generator that synthesizes synchronized video and audio from a single prompt — including multi-speaker speech with reference-timbre control and image-conditioned continuations. Instead of post-hoc-aligned dual towers or fully unified tri-modal stacks, NAVA uses an Align-then-Fuse MMDiT: a dedicated alignment space first establishes audio-video correspondence, then context (text, speaker embeddings) is fused via cross-attention. On Verse-Bench it sets new SOTA on Sync-C / Sync-D / video quality / audio WER while using 2× to 5× fewer parameters than open-source baselines. submitted by /u/AgeNo5351 |
You need Python 3.
This paper was accepted at the Can We Trust AI Evaluation? Workshop at NeurIPS 2026.…
Java teams have established JVM tooling, continuous integration and continuous delivery (CI/CD) pipelines, and operational…
Transactional databases store vast amounts of unstructured text — clinical notes, customer reviews, support tickets,…
Don’t let cold weather stop you from getting your steps in. These under-desk treadmills are…
A new neural network component, developed at University of Michigan Engineering, challenges a common assumption…