Categories: FAANG

Angler: Helping Machine Translation Practitioners Prioritize Model Improvements

*=Authors contributed equally
Machine learning (ML) models can fail in unexpected ways in the real world, but not all model failures are equal. With finite time and resources, ML practitioners are forced to prioritize their model debugging and improvement efforts. Through interviews with 13 ML practitioners at Apple, we found that practitioners construct small targeted test sets to estimate an error’s nature, scope, and impact on users. We built on this insight in a case study with machine translation models, and developed Angler, an interactive visual analytics tool to help practitioners…
AI Generated Robotic Content

Recent Posts

3 Nuclear Startups Hit a Big Milestone. Why It Matters—and Why It Doesn’t

The companies’ Fourth of July plans include celebrating new reactor designs coming online. But there’s…

13 hours ago

Context vs. Memory Engineering in Agentic AI Systems

Compression on Arrival Tool outputs should be compressed after a call returns, not after the…

1 day ago

Why I disappeared for 3 Months & What’s Next

I’ve been quiet since November because I’ve been building.Over the past few months, AI has…

1 day ago

Multi-Agent Teams Hold Experts Back

Multi-agent LLM systems are increasingly deployed as autonomous collaborators, where agents interact freely rather than…

1 day ago

Managing Elasticsearch Reindex at Scale: Performance, Reliability, and Observability

Editor’s Note: This is the fourth post in a series exploring how Palantir customizes infrastructure…

1 day ago

GenPage: Towards End-to-End Generative Homepage Construction at Netflix

Authors: Lequn Wang, Jiangwei Pan, and Linas BaltrunasFigure 1. Autoregressive homepage generation. GenPage builds a…

1 day ago