Author: AI Generated Robotic Content

Posted by Yang Li, Research Scientist, and Gang Li, Software Engineer, Google Research The computational understanding of user interfaces (UI) is a key step towards achieving intelligent UI behaviors. Previously, we investigated various UI modeling tasks, including widget captioning, screen summarization, and command grounding, that address diverse interaction scenarios such as automation and accessibility. We …

Read more “A vision-language approach for foundational UI understanding”

In recent years, advances in computer vision have enabled researchers, first responders, and governments to tackle the challenging problem of processing global satellite imagery to understand our planet and our impact on it. AWS recently released Amazon SageMaker geospatial capabilities to provide you with satellite imagery and geospatial state-of-the-art machine learning (ML) models, reducing barriers …

Read more “Accelerate disaster response with computer vision for satellite imagery using Amazon SageMaker and Amazon Augmented AI”

Advancements in whole genome sequencing have ignited a revolution in digital biology. Genomics programs across the world are gaining momentum as the cost of high-throughput, next-generation sequencing has declined. Whether used for sequencing critical-care patients with rare diseases or in population-scale genetics research, whole genome sequencing is becoming a fundamental step in clinical workflows and …

Read more “How AI Is Transforming Genomics”

Posted by Aviral Kumar, Student Researcher, and Sergey Levine, Research Scientist, Google Research Reinforcement learning (RL) algorithms can learn skills to solve decision-making tasks like playing games, enabling robots to pick up objects, or even optimizing microchip designs. However, running RL algorithms in the real world requires expensive active data collection. Pre-training on diverse datasets …

Read more “Pre-training generalist agents using offline reinforcement learning”