Categories: Image

Flux.2-Klein pipeline for real-time webcam stream processing in 30 FPS

I have built a pipeline based on the Flux.2-Klein-4B model that allows processing of a video stream with low latency (about 0.2 seconds) on a single RTX5090 GPU.
It is free and open-source, you can try it locally:
https://github.com/tensorforger/FluxRT

Under the hood, it uses a custom spatial-aware KV-cache, so it only recomputes a small number of image tokens per frame, specifically where something is moving or changing.
It also uses frame interpolation with the RIFE model, which can multiply FPS by a factor of 2, 4, 8, etc. I have found that 4 is the most appropriate for my setup.

Depending on scene dynamics, the output stream achieves up to 50 FPS in mostly static scenes and around 20 FPS when the entire input image is changing rapidly. Benchmark results are in the repo.

There is also a Gradio demo, several minimal cv2 examples, and a simple paint-style app with real-time canvas updates.

submitted by /u/TensorForger
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Take on your most ambitious work with GPT-6 Astra on Amazon Bedrock

GPT-6 Astra from OpenAI brings greater depth and judgment to your most demanding tasks and…

8 hours ago

How KDDI built Buffmee, a faster, reliable consumer RAG app

When building consumer-facing generative AI applications,  balancing high generation quality with fast response times across…

8 hours ago

Cockroach Milk, How to Blow Your Nose, and Mosquito Printers: The Ig Nobels of 2026

Every year, the prizes recognize the weirdest research that often raises some very serious scientific…

9 hours ago

Memristor chip breaks the capacity limit of brain-inspired associative memory

Researchers in the Department of Electrical and Computer Engineering of the Faculty of Engineering and…

9 hours ago

Le Creuset x Star Trek Collection: Prices, availability, release date

Vulcan oven mitts, spaceship baking dishes, and an out-of-this-world communicator grater—you'll need warp speed to…

1 day ago

Denzel explains why he uses AI.

A quick experiment exploring Minimax H3 in ComfyUI using my nodes and inpainting methods. submitted…

2 days ago