FAANG - Robotic Content

Mixed-input matrix multiplication performance optimizations

by AI Generated Robotic ContentFAANG January 30, 2024Comments are Disabled

Posted by Manish Gupta, Staff Software Engineer, Google Research AI-driven technologies are weaving themselves into the fabric of our daily routines, with the potential to enhance our access to knowledge and boost our overall productivity. The backbone of these applications lies in large language models (LLMs). LLMs are memory-intensive and typically require specialized hardware accelerators …

Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices

by AI Generated Robotic ContentFAANG January 30, 2024Comments are Disabled

Machine learning (ML) models are fundamentally shaped by data, and building inclusive ML systems requires significant considerations around how to design representative datasets. Yet, few novice-oriented ML modeling tools are designed to foster hands-on learning of dataset design practices, including how to design for data diversity and inspect for data quality. To this end, we …

How does data deduplication work?

by AI Generated Robotic ContentFAANG January 30, 2024Comments are Disabled

Recent years have witnessed an explosion in the proliferation of self-storage units. These large, warehouse units have sprung up nationally as a booming industry because of one reason—the average person now has more possessions than they know what to do with. The same basic situation also plagues the world of IT. We’re in the midst …

Benchmark and optimize endpoint deployment in Amazon SageMaker JumpStart

by AI Generated Robotic ContentFAANG January 30, 2024Comments are Disabled

When deploying a large language model (LLM), machine learning (ML) practitioners typically care about two measurements for model serving performance: latency, defined by the time it takes to generate a single token, and throughput, defined by the number of tokens generated per second. Although a single request to the deployed endpoint would exhibit a throughput …

Building enterprise-quality AI applications requires much more than a model

by AI Generated Robotic ContentFAANG January 30, 2024Comments are Disabled

User-Centered Machine Learning

by AI Generated Robotic ContentFAANG January 27, 2024Comments are Disabled

A New Paradigm for Computer Vision Workflows Massive investments are being made across the DoD to develop and field Machine Learning (ML) based capabilities for intelligence and operational data sources. In particular, the application of Computer Vision (CV) models on top of overhead aerial imagery has become a key focus area for teams looking to …

Networks unchained: the shift toward intent-based autonomous operations

by AI Generated Robotic ContentFAANG January 27, 2024Comments are Disabled

Telecommunications industry, a cornerstone of global connectivity, has been going through a technological renaissance for some time, driven by innovations such as 5G, IoT, cloud computing and AI. As a result, networks have become increasingly hard to manage. There is a need for automation to handle routine tasks, monitor network health and respond to issues in …

Mixed-input matrix multiplication performance optimizations

by AI Generated Robotic ContentFAANG January 27, 2024Comments are Disabled

Architect defense-in-depth security for generative AI applications using the OWASP Top 10 for LLMs

by AI Generated Robotic ContentFAANG January 27, 2024Comments are Disabled

Generative artificial intelligence (AI) applications built around large language models (LLMs) have demonstrated the potential to create and accelerate economic value for businesses. Examples of applications include conversational search, customer support agent assistance, customer support analytics, self-service virtual assistants, chatbots, rich media generation, content moderation, coding companions to accelerate secure, high-performance software development, deeper insights …

New embedding models and API updates

by AI Generated Robotic ContentFAANG January 26, 2024Comments are Disabled

We are launching a new generation of embedding models, new GPT-4 Turbo and moderation models, new API usage management tools, and soon, lower pricing on GPT-3.5 Turbo.