The biggest change: we integrated model layer streaming across all local inference pipelines, cutting peak VRAM usage enough to run on 16 GB VRAM machines. This has been one of the most requested changes since launch, and it’s live now.
What else is in 1.0.3:
The VRAM reduction is the one we’re most excited about. The higher VRAM requirement locked out a lot of capable desktop hardware. If your GPU kept you on the sideline, try it now and let us know how it works for you on GitHub.
Already using Desktop? The update downloads automatically.
New here? Download
submitted by /u/ltx_model
[link] [comments]
Today, we’re announcing that spend caps on Google Cloud Budgets are generally available. With this…
From marble runs to advent calendars, these are the best Star Wars gifts for fans…
Named “Volta-Autodoxer,” the recently uncovered malware uses AI tools to collect troves of data about…
In this article, you will learn seven common token-waste patterns in production AI agent systems,…
Cost management for generative AI is a shared responsibility between the teams that build applications…
Google’s latest smartwatch packs great new health and fitness features, and it’s already on sale…