Categories: Image

Read to Save Your GPU!

I can confirm this is happening with the latest driver. Fans weren‘t spinning at all under 100% load. Luckily, I discovered it quite quickly. Don‘t want to imagine what would have happened, if I had been afk. Temperatures rose over what is considered safe for my GPU (Rtx 4060 Ti 16gb), which makes me doubt that thermal throttling kicked in as it should.

submitted by /u/EtienneDosSantos
[link] [comments]

Sharing is caring: How NVIDIA GPU sharing on GKE saves you money

Developers and data scientists are increasingly turning to Google Kubernetes Engine (GKE) to run demanding workloads like machine learning, visualization/rendering and high-performance computing, leveraging GKE’s support for NVIDIA GPUs. In the current economic climate, customers are under pressure to do more with fewer resources, and cost savings are top of…

September 1, 2022

In "FAANG"

🧠💥 My HomeLab GPU Cluster – 12× RTX 5090, AI / K8s / Self-Hosted Everything

After months of planning, wiring, airflow tuning, and too many late nights this is my home lab GPU cluster finally up and running. This setup is built mainly for: • AI / LLM inference & training • Image & video generation pipelines • Kubernetes + GPU scheduling • Self-hosted APIs…

January 20, 2026

In "Image"

Parallel Track Transformers: Enabling Fast GPU Inference with Reduced Synchronization

Efficient large-scale inference of transformer-based large language models (LLMs) remains a fundamental systems challenge, frequently requiring multi-GPU parallelism to meet stringent latency and throughput targets. Conventional tensor parallelism decomposes matrix operations across devices but introduces substantial inter-GPU synchronization, leading to communication bottlenecks and degraded scalability. We propose the Parallel Track…

February 11, 2026

In "FAANG"

AI Generated Robotic Content