Categories: FAANG

A Treatise On FST Lattice Based MMI Training

Maximum mutual information (MMI) has become one of the two de facto methods for sequence-level training of speech recognition acoustic models. This paper aims to isolate, identify and bring forward the implicit modelling decisions induced by the design implementation of standard finite state transducer (FST) lattice based MMI training framework. The paper particularly investigates the necessity to maintain a preselected numerator alignment and raises the importance of determinizing FST denominator lattices on the fly. The efficacy of employing on the fly FST lattice determinization is…
AI Generated Robotic Content

Recent Posts

Fast Attention Kernels and Operator Fusion

Overview This post is divided into four parts; they are: • Operator Fusion • FlashAttention-Style…

26 mins ago

Getting Reliable Structured Outputs from LLMs: Validation, Retries and Constrained Decoding

The fixture suite turns the sentences above into fourteen test cases, from a missing required…

26 mins ago

Theoretical Limits of Language Model Alignment

Language model (LM) alignment improves model outputs to reflect human preferences while preserving the capabilities…

26 mins ago

Deploy frontier AI models on AWS Trainium with SGLang-Neuron

Today, Amazon announced that SGLang-Neuron is publicly available and can be accessed through an AWS…

26 mins ago

‘Bring Back THE Boss’: Nvidia Employees Petition for Jensen Huang’s Return

An internal post urging the board to consider employee sentiment about Nvidia’s former CEO has…

1 hour ago

Inside this quantum computer, memory vibrates like a guitar string

Researchers have created a quantum computer that stores information in microscopic vibrations, potentially making quantum…

1 hour ago