Categories: Image

Flux.2-Klein pipeline for real-time webcam stream processing in 30 FPS

I have built a pipeline based on the Flux.2-Klein-4B model that allows processing of a video stream with low latency (about 0.2 seconds) on a single RTX5090 GPU.
It is free and open-source, you can try it locally:
https://github.com/tensorforger/FluxRT

Under the hood, it uses a custom spatial-aware KV-cache, so it only recomputes a small number of image tokens per frame, specifically where something is moving or changing.
It also uses frame interpolation with the RIFE model, which can multiply FPS by a factor of 2, 4, 8, etc. I have found that 4 is the most appropriate for my setup.

Depending on scene dynamics, the output stream achieves up to 50 FPS in mostly static scenes and around 20 FPS when the entire input image is changing rapidly. Benchmark results are in the repo.

There is also a Gradio demo, several minimal cv2 examples, and a simple paint-style app with real-time canvas updates.

submitted by /u/TensorForger
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Steve Jobs reviews the Magic Mouse

submitted by /u/ctrl-shift-face [link] [comments]

22 hours ago

Managing Small Context Windows in Language Models

In this article, you will learn three practical strategies for managing small context windows in…

22 hours ago

GRPO Beyond English: A Large-Scale Study of GRPO in Non-English and Multilingual Settings

Reinforcement Learning with Verifiable Rewards (RLVR), often optimized with Group Relative Policy Optimization (GRPO), has…

22 hours ago

Amazon Bedrock AgentCore payments is now generally available: Enabling agents to transact safely and autonomously at scale

Agents have evolved from simple chat applications to autonomous, long-running systems that dynamically discover and…

22 hours ago

Building cost-effective, high-throughput gen AI workflows in Google Dataflow

Real-time streaming pipelines are the operational backbone of modern enterprises, continuously processing everything from customer…

22 hours ago

Squeeze More Juice Out of Your Dead Batteries—Using Physics

How the joule thief circuit “steals” energy from seemingly depleted power cells.

23 hours ago