| | Page: https://ernie-research.github.io/NAVA/ NAVA is a 6.3 B-parameter joint audio-video generator that synthesizes synchronized video and audio from a single prompt — including multi-speaker speech with reference-timbre control and image-conditioned continuations. Instead of post-hoc-aligned dual towers or fully unified tri-modal stacks, NAVA uses an Align-then-Fuse MMDiT: a dedicated alignment space first establishes audio-video correspondence, then context (text, speaker embeddings) is fused via cross-attention. On Verse-Bench it sets new SOTA on Sync-C / Sync-D / video quality / audio WER while using 2× to 5× fewer parameters than open-source baselines. submitted by /u/AgeNo5351 |
submitted by /u/NewEconomy55 [link] [comments]
Controlling the output of Large Language Models (LLMs) is a central challenge for their reliable…
Claim answers are scattered across adjuster diary entries, repair estimates, police reports, payment ledgers, and…
President Donald Trump still thinks Republicans have a shot. His aides are less convinced.
In the production of video games and animated movies, directors and animators are constantly fine-tuning…