FAANG

Scaling MoE reinforcement learning on Amazon EKS with EFA and DeepEP with 40% more throughput

When you post-train a Mixture-of-Experts (MoE) model with Reinforcement Learning from Human Feedback (RLHF) or Group Relative Policy Optimization (GRPO)…

1 month ago

Best practices guide for customizing Gemini models via Reinforcement Learning (RL)

Reinforcement learning (RL) has been a keystone of modern LLM post-training, but it demands large training clusters and access to…

1 month ago

Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

System-wide Dictation on Apple devices runs entirely on-device, and the speech it transcribes reaches the foundation model through a tokenizer:…

1 month ago

Speaker-labeled transcription with WhisperX on SageMaker AI

Any team working with spoken audio hits the same wall with generic speech-to-text. Think contact-center calls, all-hands meetings, podcasts, depositions,…

1 month ago

Power your agents: Gemini 3.8 Live with Live Avatar is now generally available

Following our announcement of Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking last week, we are thrilled to share…

1 month ago

How to Guide Your Language Flow

We introduce a new method to guide flow matching models. Our approach, which we call probe guidance, uses the frozen…

1 month ago

From portal-hopping to instant answers: HEMA’s journey with MCP and Amazon Bedrock

This post is co-written with Mauro Rallo and Patrick van der Plas from HEMA. When engineers at HEMA needed an…

1 month ago

Bring more intelligence to everyday work with GPT-6 Sol and GPT-6 Luna on Amazon Bedrock

GPT-6 Sol and GPT-6 Luna are now generally available on Amazon Bedrock, giving you more options to match intelligence and…

1 month ago

xAI’s Grok 4.6 is now available in Amazon Bedrock

Today, we are announcing that xAI’s Grok 4.6 is available in Amazon Bedrock, adding a frontier model built for long-running…

1 month ago

Dynamically Scaled Activation Steering

Activation steering has emerged as a powerful method for guiding the behavior of generative models towards desired outcomes such as…

1 month ago