ML 16072 HF TGI Streaming

Inference Llama 2 models with real-time response streaming using Amazon SageMaker

With the rapid adoption of generative AI applications, there is a need for these applications to respond in time to reduce the perceived latency with higher throughput. Foundation models (FMs) are often pre-trained on vast corpora of data with parameters ranging in scale of millions to billions and beyond. Large language models (LLMs) are a …

1 GCP IAP.max 1000x1000 1

Getting started with AI notebooks and Jupyterhub on GKE

The recent growth in distributed, compute-intensive ML applications has prompted data scientists and ML practitioners to find easy ways to prototype and develop their ML models. Running your Jupyter notebooks and JupyterHub on Google Kubernetes Engine (GKE) can provide a way to run your solution with security and scalability built-in as core elements of the …

New soft robots roll like tires, spin like tops and orbit like moons

Researchers have developed a new soft robot design that engages in three simultaneous behaviors: rolling forward, spinning like a record, and following a path that orbits around a central point. The device, which operates without human or computer control, holds promise for developing soft robotic devices that can be used to navigate and map unknown …

hero 1

Responsible AI at Google Research: User Experience Team

Posted by Ayça Çakmakli, UX Lead, Google Research, Responsible AI and Human Centered Technology Team Google’s Responsible AI User Experience (Responsible AI UX) team is a product-minded team embedded within Google Research. This unique positioning requires us to apply responsible AI development practices to our user-centered user experience (UX) design process. In this post, we …

How to create a robust digital transformation strategy

Organizations are increasingly investing in digital transformation as a way to maintain or grow a competitive advantage. Organizations implementing successful business transformations are more likely to grow their existing businesses, eliminate silos, create revenue growth and business models and reinvent how they handle their operations. A tried-and-true way to approach digital transformation is to understand …

hero

Responsible AI at Google Research: User Experience Team

Posted by Ayça Çakmakli, UX Lead, Google Research, Responsible AI and Human Centered Technology Team Google’s Responsible AI User Experience (Responsible AI UX) team is a product-minded team embedded within Google Research. This unique positioning requires us to apply responsible AI development practices to our user-centered user experience (UX) design process. In this post, we …