Category: FAANG

This post is cowritten with Ming (Melvin) Qin, David Bericat and Brad Genereaux from NVIDIA. Medical imaging AI researchers and developers need a scalable, enterprise framework to build, deploy, and integrate their AI applications. AWS and NVIDIA have come together to make this vision a reality. AWS, NVIDIA, and other partners build applications and solutions …

Read more “Build a medical imaging AI inference pipeline with MONAI Deploy on AWS”

AI models continue to get bigger, requiring larger compute clusters with exa-FLOPs (10^18 FLOPs) of computing. While large-scale models continue to unlock new capabilities, driving down the cost of training and serving these models is the key to sustaining the pace of this innovation. Typically, the tensor operations (ops)1 are the most compute-intensive part of …

Read more “Introducing Accurate Quantized Training (AQT) for accelerated ML training on TPU v5e”

Posted by Xin Wang, Software Engineer, and Nishanth Dikkala, Research Scientist, Google Research Contemporary deep learning models have been remarkably successful in many domains, ranging from natural language to computer vision. Transformer neural networks (transformers) are a popular deep learning architecture that today comprise the foundation for most tasks in natural language processing and also …

Read more “Alternating updates for efficient transformers”

Posted by Xin Wang, Software Engineer, and Nishanth Dikkala, Research Scientist, Google Research Contemporary deep learning models have been remarkably successful in many domains, ranging from natural language to computer vision. Transformer neural networks (transformers) are a popular deep learning architecture that today comprise the foundation for most tasks in natural language processing and also …

Read more “Alternating updates for efficient transformers”

Large language models (LLMs) with their broad knowledge, can generate human-like text on almost any topic. However, their training on massive datasets also limits their usefulness for specialized tasks. Without continued learning, these models remain oblivious to new data and trends that emerge after their initial training. Furthermore, the cost to train new LLMs can …

Read more “Harnessing the power of enterprise data with generative AI: Insights from Amazon Kendra, LangChain, and large language models”

Google Cloud Speech-to-Text is a fully managed service that converts speech to text in real time. It can be used to transcribe audio and video files, create subtitles for videos, and build voice-activated applications. The service supports a wide range of audio formats, including WAV, MP3, and AAC. It can also transcribe audio in a …

Read more “Using FFmpeg with Google Cloud Speech-to-Text”