faang - Robotic Content

Accelerating LLM Inference on NVIDIA GPUs with ReDrafter

by AI Generated Robotic ContentFAANG December 19, 2024Comments are Disabled

Accelerating LLM inference is an important ML research problem, as auto-regressive token generation is computationally expensive and relatively slow, and improving inference efficiency can reduce latency for users. In addition to ongoing efforts to accelerate inference on Apple silicon, we have recently made significant progress in accelerating LLM inference for the NVIDIA GPUs widely used …

How Fastweb fine-tuned the Mistral model using Amazon SageMaker HyperPod as a first step to build an Italian large language model

by AI Generated Robotic ContentFAANG December 19, 2024Comments are Disabled

This post is co-written with Marta Cavalleri and Giovanni Germani from Fastweb, and Claudia Sacco and Andrea Policarpi from BIP xTech. AI’s transformative impact extends throughout the modern business landscape, with telecommunications emerging as a key area of innovation. Fastweb, one of Italy’s leading telecommunications operators, recognized the immense potential of AI technologies early on …

Optimizing RAG retrieval Test tune succee.max 1000x1000 1

Optimizing RAG retrieval: Test, tune, succeed

by AI Generated Robotic ContentFAANG December 19, 2024Comments are Disabled

Retrieval-augmented generation (RAG) supercharges large language models (LLMs) by connecting them to real-time, proprietary, and specialized data. This helps LLMs deliver more accurate, relevant, and contextually aware responses, minimizing hallucinations and building trust in AI applications. But RAG can be a double-edged sword: while the concept is straightforward – find relevant information and feed it …

FACTS Grounding: A new benchmark for evaluating the factuality of large language models

by AI Generated Robotic ContentFAANG December 18, 2024Comments are Disabled

Our comprehensive benchmark and online leaderboard offer a much-needed measure of how accurately LLMs ground their responses in provided source material and avoid hallucinations

ARMADA: Augmented Reality for Robot Manipulation and Robot-Free Data Acquisition

by AI Generated Robotic ContentFAANG December 18, 2024Comments are Disabled

Teleoperation for robot imitation learning is bottlenecked by hardware availability. Can high-quality robot data be collected without a physical robot? We present a system for augmenting Apple Vision Pro with real-time virtual robot feedback. By providing users with an intuitive understanding of how their actions translate to robot motions, we enable the collection of natural …

Part 1: A Survey of Analytics Engineering Work at Netflix

by AI Generated Robotic ContentFAANG December 18, 2024Comments are Disabled

This article is the first in a multi-part series sharing a breadth of Analytics Engineering work at Netflix, recently presented as part of our annual internal Analytics Engineering conference. We kick off with a few topics focused on how we’re empowering Netflix to efficiently produce and effectively deliver high quality, actionable analytic insights across the …

Simplify multimodal generative AI with Amazon Bedrock Data Automation

by AI Generated Robotic ContentFAANG December 18, 2024Comments are Disabled

Developers face significant challenges when using foundation models (FMs) to extract data from unstructured assets. This data extraction process requires carefully identifying models that meet the developer’s specific accuracy, cost, and feature requirements. Additionally, developers must invest considerable time optimizing price performance through fine-tuning and extensive prompt engineering. Managing multiple models, implementing safety guardrails, and …

Reach beyond the IDE with tools for Gemini Code Assist

by AI Generated Robotic ContentFAANG December 18, 2024Comments are Disabled

One of the biggest areas of promise for generative AI is coding assistance — leveraging the power of large language models to help developers create or update application code with amazing speed and accuracy, dramatically boosting productivity. For Gemini Code Assist, 2024 has been a year of tremendous growth and innovation, as we help companies …

State-of-the-art video and image generation with Veo 2 and Imagen 3

by AI Generated Robotic ContentFAANG December 17, 2024Comments are Disabled

We’re rolling out a new, state-of-the-art video model, Veo 2, and updates to Imagen 3. Plus, check out our new experiment, Whisk.

The Baseline Team and Forward-Deployed Infrastructure Engineering at Palantir

by AI Generated Robotic ContentFAANG December 17, 2024Comments are Disabled

Inside Look: The Baseline Team and Forward-Deployed Infrastructure Engineering at Palantir At Palantir, our customers rely on our applications operating seamlessly across a variety of cloud providers, on-premises hardware, and both commercial and government networks. They need our platforms to function reliably in these diverse environments. This is where we, the Forward Deployed Infrastructure Engineering team — known …