NVIDIA’s AI Podcast gives listeners the inside scoop on the ways AI is transforming nearly every industry. Since the show’s debut in 2016, it’s garnered more than 6 million listens across 200-plus episodes, covering how generative AI is used to power applications including assistive technology for the visually impaired, wildfire alert systems and the Roblox …
Read more “Have You Heard? 5 AI Podcast Episodes Listeners Loved in 2024”
The report The economic potential of generative AI: The next productivity frontier, published by McKinsey & Company, estimates that generative AI could add an equivalent of $2.6 trillion to $4.4 trillion in value to the global economy. The largest value will be added across four areas: customer operations, marketing and sales, software engineering, and R&D. …
Read more “Optimizing costs of generative AI applications on AWS”
Training large language models (LLMs) models has become a significant expense for businesses. For many use cases, companies are looking to use LLM foundation models (FM) with their domain-specific data. However, companies are discovering that performing full fine tuning for these models with their data isn’t cost effective. To reduce costs while continuing to use the …
Read more “PEFT fine tuning of Llama 3 on SageMaker HyperPod with AWS Trainium”
When building voice-enabled chatbots with Amazon Lex, one of the biggest challenges is accurately capturing user speech input for slot values. For example, when a user needs to provide their account number or confirmation code, speech recognition accuracy becomes crucial. This is where transcription confidence scores come in to help ensure reliable slot filling. What …
Read more “Using transcription confidence scores to improve slot filling in Amazon Lex”
TL;DR A conversation with 4o about the potential demise of companies like Anthropic. As artificial intelligence (AI) continues to advance, the landscape is becoming increasingly competitive and ethically fraught. Companies like Anthropic, which have missions centered on developing “safe AI,” face unique challenges in an ecosystem where speed, innovation, and unconstrained power are often prioritized …
Read more “Can “Safe AI” Companies Survive in an Unrestrained AI Landscape?”
Editor’s note: This is the second post in a series that explores a range of topics about upcoming AI regulation, including an overview of the the EU AI Act and Palantir solutions that foster and support regulatory compliance when using AI. This blog post provides an overview on how Palantir AIP empowers organizations to meet …
Read more “AI Systems Governance through the Palantir Platform”
David J. Berg*, David Casler^, Romain Cledat*, Qian Huang*, Rui Lin*, Nissan Pow*, Nurcan Sonmez*, Shashank Srikanth*, Chaoying Wang*, Regina Wang*, Darin Yu**: Model Development Team, Machine Learning Platform^: Content Demand Modeling Team A month ago at QConSF, we showcased how Netflix utilizes Metaflow to power a diverse set of ML and AI use cases, managing …
Generative AI offers many benefits for both you, as a software provider, and your end-users. AI assistants can help users generate insights, get help, and find information that may be hard to surface using traditional means. In addition, they can help your employees reduce repetitive tasks and focus on high-value work. However, adding generative AI …
Read more “Add a generative AI experience to your website or web application with Amazon Q embedded”
Today, generative AI is giving organizations new ways to process and analyze data, discover hidden insights, increase productivity and build new applications. However, data sovereignty, regulatory compliance, and low-latency requirements can be a challenge. The need to keep sensitive data in certain locations, adhere to strict regulations, and respond swiftly can make it difficult to …
Accelerating LLM inference is an important ML research problem, as auto-regressive token generation is computationally expensive and relatively slow, and improving inference efficiency can reduce latency for users. In addition to ongoing efforts to accelerate inference on Apple silicon, we have recently made significant progress in accelerating LLM inference for the NVIDIA GPUs widely used …
Read more “Accelerating LLM Inference on NVIDIA GPUs with ReDrafter”