Categories: Image

Flux.2-Klein pipeline for real-time webcam stream processing in 30 FPS

I have built a pipeline based on the Flux.2-Klein-4B model that allows processing of a video stream with low latency (about 0.2 seconds) on a single RTX5090 GPU.
It is free and open-source, you can try it locally:
https://github.com/tensorforger/FluxRT

Under the hood, it uses a custom spatial-aware KV-cache, so it only recomputes a small number of image tokens per frame, specifically where something is moving or changing.
It also uses frame interpolation with the RIFE model, which can multiply FPS by a factor of 2, 4, 8, etc. I have found that 4 is the most appropriate for my setup.

Depending on scene dynamics, the output stream achieves up to 50 FPS in mostly static scenes and around 20 FPS when the entire input image is changing rapidly. Benchmark results are in the repo.

There is also a Gradio demo, several minimal cv2 examples, and a simple paint-style app with real-time canvas updates.

submitted by /u/TensorForger
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

8 Best Computer Speakers (2026) After Testing 30 Pairs

After testing 30 pairs of computer speakers, these are the best computer speakers—from stereo speakers…

30 mins ago

A hidden limit of space and time could unlock electronics 100,000 times faster

Scientists have discovered a surprising quantum limit that prevents electrons from being tracked with unlimited…

30 mins ago

Viggle Remake is a beast

https://huggingface.co/Viggle/Viggle-Remake For this video I used their included MCP. However, it's currently set up to…

24 hours ago

Floating-Point Precision and Its Effects to Model Inference

Overview This post is divided into five parts; they are: • How Floating-Point Numbers Work…

24 hours ago

The Fridge-Hacking Spree Is an Internet-of-Things Wake-Up Call

Escalating hacks affecting blood labs and grocery stores show the very real risks to critical…

1 day ago

Changing a character across an ~hour long TV episode

I've been working on a repeatable process to do character swaps (& other types of…

2 days ago