Blog

Companies across various scales and industries are using large language models (LLMs) to develop generative AI applications that provide innovative experiences for customers and employees. However, building or fine-tuning these pre-trained LLMs on extensive datasets demands substantial computational resources and engineering effort. With the increase in sizes of these pre-trained LLMs, the model customization process …

Read more “Accelerating Mixtral MoE fine-tuning on Amazon SageMaker with QLoRA”

In the domain of software development, AI-driven assistance is emerging as a transformative force to enhance developer experience and productivity and ultimately optimize overall software delivery performance. Many organizations started to leverage AI-based assistants, such as Gemini Code Assist, in developer IDEs to support them in solving more difficult problems, understanding unfamiliar code, generating test …

Read more “Boost your Continuous Delivery pipeline with Generative AI”

Swiss Re & Palantir Scaling Data Operations with Foundry Editor’s note: This guest post is authored by our customer, Swiss Re. Authors Lukasz Lewandowski, Marco Lotz, and Jarek Sobanski lead the core technical team responsible for the implementation of Palantir Foundry at the Swiss reinsurer. They have been managing overall platform operations, core architectural principles, site reliability, …

Read more “Swiss Re & Palantir: Scaling Data Operations with Foundry”

As generative AI models advance in creating multimedia content, the difference between good and great output often lies in the details that only human feedback can capture. Audio and video segmentation provides a structured way to gather this detailed feedback, allowing models to learn through reinforcement learning from human feedback (RLHF) and supervised fine-tuning (SFT). …

Read more “Enhance speech synthesis and video generation models with RLHF using audio and video segmentation in Amazon SageMaker”

Large language models (LLMs) give developers immense power and scalability, but managing resource consumption is key to delivering a smooth user experience. LLMs demand significant computational resources, which means it’s essential to anticipate and handle potential resource exhaustion. If not, you might encounter 429 “resource exhaustion” errors, which can disrupt how users interact with your …

Read more “Don’t let resource exhaustion leave your users hanging: A guide to handling 429 errors”