AI headphones let wearer listen to a single person in a crowd by looking at them just once
Noise-canceling headphones have gotten very good at creating an auditory blank slate. But allowing certain sounds from a wearer’s environment through the erasure still challenges researchers. The latest edition of Apple’s AirPods Pro, for instance, automatically adjusts sound levels for wearers—sensing when they’re in conversation, for instance—but the user has little control over whom to listen to or when this happens.
Engineers have developed an artificial intelligence system that lets someone wearing headphones look at a person speaking for three to five seconds to 'enroll' them. The system then plays just the enrolled speaker's voice in real time, even as the pair move around in noisy environments.
Noise-canceling headphones are a godsend for living and working in loud environments. They automatically identify background sounds and cancel them out for much-needed peace and quiet. However, typical noise-canceling fails to distinguish between unwanted background sounds and crucial information, leaving headphone users unaware of their surroundings.