Accelerating LLM Inference on NVIDIA GPUs with ReDrafter

2 years ago

Accelerating LLM inference is an important ML research problem, as auto-regressive token generation is computationally expensive and relatively slow, and…

How Fastweb fine-tuned the Mistral model using Amazon SageMaker HyperPod as a first step to build an Italian large language model

2 years ago

This post is co-written with Marta Cavalleri and Giovanni Germani from Fastweb, and Claudia Sacco and Andrea Policarpi from BIP…

Optimizing RAG retrieval: Test, tune, succeed

2 years ago

Retrieval-augmented generation (RAG) supercharges large language models (LLMs) by connecting them to real-time, proprietary, and specialized data. This helps LLMs…

NASA Postpones Return of Stranded Starliner Astronauts to March

2 years ago

Barry Wilmore and Suni Williams will now come home in March at the earliest, to allow SpaceX and NASA engineers…

Swarms of ‘ant-like’ robots lift heavy objects and hurl themselves over obstacles

2 years ago

Scientists have developed swarms of tiny magnetic robots that work together like ants to achieve Herculean feats, including traversing and…

Human-like artificial intelligence may face greater blame for moral violations

2 years ago

In a new study, participants tended to assign greater blame to artificial intelligences (AIs) involved in real-world moral transgressions when…

7 Machine Learning Projects For Beginners

2 years ago

The adoption of machine learning (ML) continues at a rapid pace, as it has proven itself a powerful tool for…

FACTS Grounding: A new benchmark for evaluating the factuality of large language models

2 years ago

Our comprehensive benchmark and online leaderboard offer a much-needed measure of how accurately LLMs ground their responses in provided source…

ARMADA: Augmented Reality for Robot Manipulation and Robot-Free Data Acquisition

2 years ago

Teleoperation for robot imitation learning is bottlenecked by hardware availability. Can high-quality robot data be collected without a physical robot?…

Part 1: A Survey of Analytics Engineering Work at Netflix

2 years ago

This article is the first in a multi-part series sharing a breadth of Analytics Engineering work at Netflix, recently presented…