Category: FAANG

Amazon SageMaker Serverless Inference allows you to serve model inference requests in real time without having to explicitly provision compute instances or configure scaling policies to handle traffic variations. You can let AWS handle the undifferentiated heavy lifting of managing the underlying infrastructure and save costs in the process. A Serverless Inference endpoint spins up …

Read more “Announcing provisioned concurrency for Amazon SageMaker Serverless Inference”

With Amazon SageMaker, you can manage the whole end-to-end machine learning (ML) lifecycle. It offers many native capabilities to help manage ML workflows aspects, such as experiment tracking, and model governance via the model registry. This post provides a solution tailored to customers that are already using MLflow, an open-source platform for managing ML workflows. …

Read more “Securing MLflow in AWS: Fine-grained access control with AWS native services”

“In my opinion, AutoGPT / babyAGI / AgentGPT is the real disruption point for the use of AI for complex problem-solving. Keep an eye out for these terms popping up in the news in the coming months.” That’s what Lars said, and rightfully so! Autonomous AI agents will introduce a new world of research and finding …

Read more “Dawn of the Auto Pilot GPT Bots”

In this post, we discuss a machine learning (ML) solution for complex image searches using Amazon Kendra and Amazon Rekognition. Specifically, we use the example of architecture diagrams for complex images due to their incorporation of numerous different visual icons and text. With the internet, searching and obtaining an image has never been easier. Most …

Read more “Build an image search engine with Amazon Kendra and Amazon Rekognition”

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala, Javier Fernandez-Ivern, Anup Rokkam Pratap, Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. Behind the scenes, a myriad of systems and services are involved in orchestrating the product experience. These backend systems are consistently being …

Read more “Migrating Critical Traffic At Scale with No Downtime — Part 1”