RIP Bard

2023.04.10 – 2024.02.08 You were not very good and we didn’t use you very much – no wonder you were less than 1 year old when you went to AI-heaven. In the ever-evolving landscape of artificial intelligence, we bid farewell to Bard, a pioneering AI companion that has been a source of creativity, learning, and …

Streamlining supply chain management: Strategies for the future

In today’s complex global business environment, effective supply chain management (SCM) is crucial for maintaining a competitive advantage. The pandemic and its aftermath highlighted the importance of having a robust supply chain strategy, with many companies facing disruptions due to shortages in raw materials and fluctuations in customer demand. The challenges continue: one 2023 survey …

ml15023 mme one

Run ML inference on unplanned and spiky traffic using Amazon SageMaker multi-model endpoints

Amazon SageMaker multi-model endpoints (MMEs) are a fully managed capability of SageMaker inference that allows you to deploy thousands of models on a single endpoint. Previously, MMEs pre-determinedly allocated CPU computing power to models statically regardless the model traffic load, using Multi Model Server (MMS) as its model server. In this post, we discuss a …

compound ai systems

The Shift from Models to Compound AI Systems

AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development, with everyone wondering what capabilities new LLMs will bring. As more …