Anthropic’s Claude 3 Sonnet and Claude 3 Haiku are now generally available on Vertex AI

Earlier this month, we shared the news that Anthropic’s Claude 3 family of models would soon be available to Google Cloud customers on Vertex AI Model Garden. Today, we’re announcing that Claude 3 Sonnet and Claude 3 Haiku are generally available to all customers on Vertex AI. Claude 3 Opus, Anthropic’s most capable and intelligent model to date, will also be available on Vertex AI in the coming weeks. 

Claude 3 Sonnet can help save time writing code or parsing text from images, excels at data-processing tasks like search and retrieval, and supports use cases like product recommendations, forecasting, and targeted marketing. 

Claude 3 Haiku is a great option for building quick and accurate customer interactions, applying content moderation, optimizing logistics, managing inventory, extracting knowledge from unstructured data, and more.

In this blog post, we’ll share how Google Cloud simplifies working with Anthropic’s newest models, highlight what our customers are saying, and provide a guide for getting started with Claude 3 on Vertex AI.

Why use Claude 3 models on Google Cloud

Vertex AI Model Garden includes over 130 models, from cutting-edge frontier models like Claude 3 and Google’s Gemini model family, to open models such as Llama 2 from Meta, Mixtral 8x7B from Mistral AI, and many more. This variety of leading models, in addition to a deep set of model development and deployment tools, makes Vertex AI the comprehensive, enterprise-ready destination for working at scale with generative foundation models like Claude 3:

• Flexibility and choice: Experimentation and optionality are crucial when balancing generative AI capabilities against budgetary constraints. Through Vertex AI, we are committed to providing customers a range of models and tools to enable greater flexibility and choice. Whether customers need large models for complex analysis, lighter models for powering conversational experiences at scale, or anything in between, Vertex AI allows customers to test, compare, and build with generative AI applications for their specific use case.
• Built-in data privacy, security, and governance: With Vertex AI, data privacy and security are built-in. Customers control their data — which Google Cloud has committed to not use for model training, and is not shared with model providers. Google Cloud offers robust regional availability to meet various data residency requirements, Identity and Access Management (IAM) tools to create and manage permissions for access to foundational models, and a host of other enterprise-grade features. Customers interact with Claude 3 API endpoints on Vertex AI the same way they interact with other Vertex AI endpoints, making Anthropic’s newest offerings simple for customers to integrate.
• Ease of use: Claude 3 is offered as a serverless, managed API on Vertex AI, meaning customers don’t have to worry about managing the underlying infrastructure. The pay-as-you-go pricing model and auto-scaling abilities help organizations optimize costs and easily go from experimentation to deploying production-grade generative AI applications at speed.

Hear what customers are saying

Enterprises are excited to adopt Claude 3 on Vertex AI for a wide range of use cases, including enhancing customer chats, automating task handling, generating code, and much more: 

• GitLab: “GitLab’s AI-powered DevSecOps platform embeds AI throughout the entire software development lifecycle with a privacy- and transparency-first approach,” said Hillary Benson, senior director, product management at GitLab. “By leveraging Anthropic’s Claude models on Vertex AI, we look forward to helping customers harness the benefits of AI to deliver secure software faster.”
• Poe by Quora: “At Poe, we’re helping shape how people interact with AI, providing millions of global users with one place to chat, explore and build with a wide variety of AI-powered bots,” said Spencer Chan, Product Lead at Poe by Quora. “Claude has become very popular on Poe due to its strengths in multiple areas, including creative writing and image understanding. Our users describe Claude’s answers as detailed and easily understood, and they like that exchanges feel like natural conversations. With millions of messages exchanged between our users and Anthropic’s Claude-based bots daily, we’re excited to work with Anthropic’s Claude 3 models on Vertex AI.”

How to get started with Claude 3 on Vertex AI

Get access to the Claude 3 Sonnet and Claude 3 Haiku models by following these simple steps: 

1. Visit the Vertex AI Model Garden console and select the model tile for Claude 3 Sonnet or Claude 3 Haiku.
2. Click on the “Enable” button and follow the proceeding instructions.
3. That’s it – you now have immediate access to the selected Claude 3 model. Click the “View code” button to obtain sample code or use the built-in colab notebook to start  querying Claude 3 models on Vertex AI.

To learn more about Anthropic’s Claude 3 models on Google Cloud, explore the Claude 3 on Vertex AI documentation. Customers can also find the Claude 3 Sonnet and Claude 3 Haiku models on Google Cloud Marketplace.