Categories: AI/ML News

Realistic talking faces created from only an audio clip and a person’s photo

A team of researchers has developed a computer program that creates realistic videos that reflect the facial expressions and head movements of the person speaking, only requiring an audio clip and a face photo. DIverse yet Realistic Facial Animations, or DIRFA, is an artificial intelligence-based program that takes audio and a photo and produces a 3D video showing the person demonstrating realistic and consistent facial animations synchronised with the spoken audio (see videos).

E-Commerce Video Mockups with Hedra

July 5, 2024

In "FAANG"

Microsoft’s AI app VASA-1 makes photographs talk and sing with believable facial expressions

A team of AI researchers at Microsoft Research Asia has developed an AI application that converts a still image of a person and an audio track into an animation that accurately portrays the individual speaking or singing the audio track with appropriate facial expressions.

April 20, 2024

In "AI/ML News"

The breakthrough that makes robot faces feel less creepy

Humans pay enormous attention to lips during conversation, and robots have struggled badly to keep up. A new robot developed at Columbia Engineering learned realistic lip movements by watching its own reflection and studying human videos online. This allowed it to speak and sing with synchronized facial motion, without being…

January 18, 2026

In "AI/ML News"

AI Generated Robotic Content