Tag: ai/ml

Large Language Models have emerged as the central component of modern chatbots and conversational AI in the fast-paced world of technology. Just imagine conversing with a machine that is as intelligent as a human. The use cases of LLM for chatbots and LLM for conversational AI can be seen across all industries like FinTech, eCommerce, healthcare, …

Read more “LLMs for Chatbots and Conversational AI: Building Engaging User Experiences”

Let’s face it: Serving AI foundation models such as large language models (LLMs) can be expensive. Between the need for hardware accelerators to achieve lower latency and the fact that these accelerators are typically not efficiently utilized, organizations need an AI platform that can serve LLMs at scale while minimizing the cost per token. Through …

Read more “Maximize your LLM serving throughput for GPUs on GKE — a practical guide”

A deep technology conference for processor and system architects from industry and academia has become a key forum for the trillion-dollar data center computing market. At Hot Chips 2024 next week, senior NVIDIA engineers will present the latest advancements powering the NVIDIA Blackwell platform, plus research on liquid cooling for data centers and AI agents …

Read more “NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency”

In the effort to automate as many processes as possible, companies resort to various solutions powered by modern technology. We’ve written about Enterprise Resource Planning systems and automated contact centers lately. Internet bots, or simply bots, may be the best-known form of automation in customer communications. Gartner once predicted that by 2020, more than 50% …

Read more “Types of Chatbots: An Overview for Business People”

Amazon Q Business is a conversational assistant powered by generative artificial intelligence (AI) that enhances workforce productivity by answering questions and completing tasks based on information in your enterprise systems, which each user is authorized to access. In an earlier post, we discussed how you can build private and secure enterprise generative AI applications with …

Read more “Build private and secure enterprise generative AI applications with Amazon Q Business using IAM Federation”

Today, we’re announcing the launch of the Jamba 1.5 Model Family  — AI21 Labs’ new family of open models — in public preview on Vertex AI Model Garden. The model family includes two models designed for scaled enterprise applications:   Jamba 1.5 Mini: AI21’s most efficient and lightweight model, engineered for speed and efficiency in tasks …

Read more “Announcing the Jamba 1.5 Model Family from AI21 Labs on Vertex AI”

Today, we are excited to announce general availability of batch inference for Amazon Bedrock. This new feature enables organizations to process large volumes of data when interacting with foundation models (FMs), addressing a critical need in various industries, including call center operations. Call center transcript summarization has become an essential task for businesses seeking to …

Read more “Enhance call center efficiency using batch inference for transcript summarization with Amazon Bedrock”