| | Page: https://ernie-research.github.io/NAVA/ NAVA is a 6.3 B-parameter joint audio-video generator that synthesizes synchronized video and audio from a single prompt — including multi-speaker speech with reference-timbre control and image-conditioned continuations. Instead of post-hoc-aligned dual towers or fully unified tri-modal stacks, NAVA uses an Align-then-Fuse MMDiT: a dedicated alignment space first establishes audio-video correspondence, then context (text, speaker embeddings) is fused via cross-attention. On Verse-Bench it sets new SOTA on Sync-C / Sync-D / video quality / audio WER while using 2× to 5× fewer parameters than open-source baselines. submitted by /u/AgeNo5351 |
Large language models (LLMs) exhibit a wide range of human-like behaviors, from expressing thoughts and…
When an AI agent uses Web Search to ground its answers on behalf of a…
Rob Strechay, until recently managing director and principal analyst at theCUBE Research, has joined VentureBeat…
Sources tell WIRED that Elon Musk is expected to spend up to $200 million in…
New research published in Proceedings of the National Academy of Sciences suggests that when artificial…