Categories: AI/ML News

Energy and memory: A new neural network paradigm

Listen to the first notes of an old, beloved song. Can you name that tune? If you can, congratulations — it’s a triumph of your associative memory, in which one piece of information (the first few notes) triggers the memory of the entire pattern (the song), without you actually having to hear the rest of the song again. We use this handy neural mechanism to learn, remember, solve problems and generally navigate our reality.

Energy and memory: A new neural network paradigm

Listen to the first notes of an old, beloved song. Can you name that tune? If you can, congratulations—it's a triumph of your associative memory, in which one piece of information (the first few notes) triggers the memory of the entire pattern (the song), without you actually having to hear…

May 15, 2025

In "AI/ML News"

Neural Transducer Training: Reduced Memory Consumption with Sample-wise Computation

The neural transducer is an end-to-end model for automatic speech recognition (ASR). While the model is well-suited for streaming ASR, the training process remains challenging. During training, the memory requirements may quickly exceed the capacity of state-of-the-art GPUs, limiting batch size and sequence lengths. In this work, we analyze the…

March 28, 2023

In "FAANG"

New chip design to provide greatest precision in memory to date

Everyone is talking about the newest AI and the power of neural networks, forgetting that software is limited by the hardware on which it runs. But it is hardware, says USC Professor of Electrical and Computer Engineering Joshua Yang, that has become "the bottleneck." Now, Yang's new research with collaborators…

March 30, 2023

In "AI/ML News"

AI Generated Robotic Content