Categories: Image

Flux.2-Klein pipeline for real-time webcam stream processing in 30 FPS

I have built a pipeline based on the Flux.2-Klein-4B model that allows processing of a video stream with low latency (about 0.2 seconds) on a single RTX5090 GPU.
It is free and open-source, you can try it locally:
https://github.com/tensorforger/FluxRT

Under the hood, it uses a custom spatial-aware KV-cache, so it only recomputes a small number of image tokens per frame, specifically where something is moving or changing.
It also uses frame interpolation with the RIFE model, which can multiply FPS by a factor of 2, 4, 8, etc. I have found that 4 is the most appropriate for my setup.

Depending on scene dynamics, the output stream achieves up to 50 FPS in mostly static scenes and around 20 FPS when the entire input image is changing rapidly. Benchmark results are in the repo.

There is also a Gradio demo, several minimal cv2 examples, and a simple paint-style app with real-time canvas updates.

submitted by /u/TensorForger
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

20 Best Gifts for Men, Manly Men, and Manly Man Men (2026)

When you need something that’s as mannishly masculinized as you can get for the Man™…

21 hours ago

Switching languages can change a chatbot’s personality test results

Ask an AI chatbot to complete a personality questionnaire in English, then give it the…

21 hours ago

Hey guys! I’m one of the core developers of MOSS-Image. AMA!

Hey r/StableDiffusion! I'm one of the core developers of MOSS-Image, the 5B DiT image generation…

2 days ago

Encryption Is Getting Squeezed From All Sides

Canada’s planned surveillance law is the latest grim step in a series of threats to…

2 days ago

One AI model, trillions of variants: Breaking mass attacks on voice assistants

Imagine sitting in your home, listening to what you think is a run-of-the-mill advertisement or…

2 days ago

Allright, which one of you is this?

submitted by /u/DigiDigiDongxx [link] [comments]

3 days ago