Categories: Image

🧠💥 My HomeLab GPU Cluster – 12× RTX 5090, AI / K8s / Self-Hosted Everything

After months of planning, wiring, airflow tuning, and too many late nights this is my home lab GPU cluster finally up and running.

This setup is built mainly for:

• AI / LLM inference & training • Image & video generation pipelines • Kubernetes + GPU scheduling • Self-hosted APIs & experiments 

🔧 Hardware Overview

• Total GPUs: 12 × RTX 5090 • Layout: 6 machines × 2 GPUs each • Gpu Machine Memory: 128 GB per Machne • Total VRAM: 1.5 TB+ • CPU: 88 cores / 176 threads per server • System RAM: 256 GB per machine 

🖥️ Infrastructure

• Dedicated rack with managed switches • Clean airflow-focused cases (no open mining frames) • GPU nodes exposed via Kubernetes • Separate workstation + monitoring setup • Everything self-hosted (no cloud dependency) 

🌡️ Cooling & Power

• Tuned fan curves + optimized case airflow • Stable thermals even under sustained load • Power isolation per node (learned this the hard way 😅) 

🚀 What I’m Running

• Kubernetes with GPU-aware scheduling • Multiple AI workloads (LLMs, diffusion, video) • Custom API layer for routing GPU jobs • NAS-backed storage + backups 

This is 100% a learning + building lab, not a mining rig.

submitted by /u/Murky-Classroom810
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Anima – Sharing Some Prompts and Results

Been experimenting with Anima lately and ended up spending way too much time refining prompts.…

12 hours ago

Keychron K2 HE Concrete Edition Review: Rock-Solid Typing

Keychron's K2 HE Concrete Edition sounds like a cute gimmick, but as I discovered, there's…

13 hours ago

AI generates full battery electrolyte recipes, matching top lithium metal battery performance

Battery electrolytes aren't just one chemical, but a complex mixture of salts, solvents, and additives…

13 hours ago

Nava – A 6.3B audio-video model .

Page: https://ernie-research.github.io/NAVA/ Model: https://huggingface.co/ernie-research/NAVA Github: https://github.com/ernie-research/NAVA NAVA is a 6.3 B-parameter joint audio-video generator that…

1 day ago

Enterprise Business Software and the Mixed-Up Chameleon Problem

Editor’s Note: This blog post was written by Greg Little, Senior Counselor at Palantir, with…

1 day ago

High-Throughput Graph Abstraction at Netflix: Part I

By Oleksii Tkachuk, Kartik Sathyanarayanan, Rajiv ShringiIntroductionNetflix has a diverse range of graph use cases, each…

1 day ago