Tag: ai/ml

By Aurélien Bibaut, Winston Chou, Simon Ejdemyr, and Nathan Kallus We are excited to share our work on how to learn good proxy metrics from historical experiments at KDD 2024. This work addresses a fundamental question for technology companies and academic researchers alike: how do we establish that a treatment that improves short-term (statistically sensitive) outcomes …

Read more “Improve Your Next Experiment by Learning Better Proxy Metrics From Past Experiments”

The proliferation of large language models (LLMs) in enterprise IT environments presents new challenges and opportunities in security, responsible artificial intelligence (AI), privacy, and prompt engineering. The risks associated with LLM use, such as biased outputs, privacy breaches, and security vulnerabilities, must be mitigated. To address these challenges, organizations must proactively ensure that their use …

Read more “Secure RAG applications using prompt engineering on Amazon Bedrock”

Today’s digital landscape offers a vast sea of information, encompassing not only text, but also images and videos. Traditional enterprise search engines were primarily designed for text-based queries, and often fall short when it comes to analyzing visual content. However, with a combination of natural language processing (NLP) and multimodal embeddings, a new era of …

Read more “A multimodal search solution using NLP, BigQuery and embeddings”

In today’s technology landscape, building or modernizing applications demands a clear understanding of your business goals and use cases. This insight is crucial for leveraging emerging tools effectively, especially generative AI foundation models such as large language models (LLMs). LLMs offer significant competitive advantages, but implementing them successfully hinges on a thorough grasp of your …

Read more “Choosing between self-hosted GKE and managed Vertex AI to host AI models”

Large Language Models have emerged as the central component of modern chatbots and conversational AI in the fast-paced world of technology. Just imagine conversing with a machine that is as intelligent as a human. The use cases of LLM for chatbots and LLM for conversational AI can be seen across all industries like FinTech, eCommerce, healthcare, …

Read more “LLMs for Chatbots and Conversational AI: Building Engaging User Experiences”

Let’s face it: Serving AI foundation models such as large language models (LLMs) can be expensive. Between the need for hardware accelerators to achieve lower latency and the fact that these accelerators are typically not efficiently utilized, organizations need an AI platform that can serve LLMs at scale while minimizing the cost per token. Through …

Read more “Maximize your LLM serving throughput for GPUs on GKE — a practical guide”

A deep technology conference for processor and system architects from industry and academia has become a key forum for the trillion-dollar data center computing market. At Hot Chips 2024 next week, senior NVIDIA engineers will present the latest advancements powering the NVIDIA Blackwell platform, plus research on liquid cooling for data centers and AI agents …

Read more “NVIDIA to Present Innovations at Hot Chips That Boost Data Center Performance and Energy Efficiency”

In the effort to automate as many processes as possible, companies resort to various solutions powered by modern technology. We’ve written about Enterprise Resource Planning systems and automated contact centers lately. Internet bots, or simply bots, may be the best-known form of automation in customer communications. Gartner once predicted that by 2020, more than 50% …

Read more “Types of Chatbots: An Overview for Business People”