Categories: FAANG

Referring to Screen Texts with Voice Assistants

Voice assistants help users make phone calls, send messages, create events, navigate, and do a lot more. However, assistants have limited capacity to understand their users’ context. In this work, we aim to take a step in this direction. Our work dives into a new experience for users to refer to phone numbers, addresses, email addresses, URLs, and dates on their phone screens. Our focus lies in reference understanding, which becomes particularly interesting when multiple similar texts are present on screen, similar to visual grounding. We collect a dataset and propose a lightweight…
AI Generated Robotic Content

Recent Posts

Full Fine-Tuning (FFT) on SageMaker AI Serverless Model Customization

Fine-tuning is the process of continuing to train a pretrained large language model (LLM) on…

4 mins ago

Sashiko: Lessons from building an agentic code review system for Linux

The speed of development in large open-source projects has always been limited by code review,…

4 mins ago

The Best Early Black Friday Deals On Laptops I’ve Tested Myself (2026)

Some of the best deals on my favorite laptops of the year have already dropped…

1 hour ago

How AI can identify the magnetic structures behind high-frequency energy loss

From electric vehicles to renewable energy systems and data centers, modern technologies depend on efficient…

1 hour ago

Activation and Floating-Point Quantization

Overview This post is divided into three parts; they are: • Why Activations Are Hard…

1 day ago