Scaling Smart: Accelerating Large Language Model Pre-training with Small Model Initialization

This paper was accepted at the Efficient Natural Language and Speech Processing (ENLSP) Workshop at NeurIPS 2024. The pre-training phase of language models often begins with randomly initialized parameters. With the current trends in scaling models, training their large number of parameters can be extremely slow and costly. In contrast, small language models are less …

12AyH2tlJ3IT5jZlbguZ6t2rw

How Palantir Enables a Secure, Rapid Software Development Environment

How Palantir Enables a Secure, Rapid Software Development Environment (Software Supply Chain Security, #1) Editor’s Note: This is the first post in a series that shares insights from our journey to enhance our software supply chain security story at Palantir. This post provides background on why and how we initiated our Software Supply Chain Security …

12A Mx2WRBWOfASpK e2xgoVw

Netflix’s Distributed Counter Abstraction

By: Rajiv Shringi, Oleksii Tkachuk, Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction, a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction. This counting service, built on top of the TimeSeries Abstraction, …

ML 16797 Agmatix Leafy AI new

Generative AI for agriculture: How Agmatix is improving agriculture with Amazon Bedrock

This post is co-written with Etzik Bega from Agmatix. Agmatix is an Agtech company pioneering data-driven solutions for the agriculture industry that harnesses advanced AI technologies, including generative AI, to expedite R&D processes, enhance crop yields, and advance sustainable agriculture. Focused on addressing the challenge of agricultural data standardization, Agmatix has developed proprietary patented technology …

Efficiency engine: How three startups deliver results faster with Vertex AI

Have you heard of the monkey and the pedestal? Astro Teller, the head of Google’s X “moonshot factory,” likes to use this metaphor to describe tackling the biggest challenge first, despite being tempted by the endorphin boost of completing more familiar tasks. It’s a challenge startups know well. When you’re re-inventing the industry standard, it’s …

Graph-based AI model finds hidden links between science and art to suggest novel materials

Imagine using artificial intelligence to compare two seemingly unrelated creations—biological tissue and Beethoven’s “Symphony No. 9.” At first glance, a living system and a musical masterpiece might appear to have no connection. However, a novel AI method developed by Markus J. Buehler, the McAfee Professor of Engineering and professor of civil and environmental engineering and …