Categories: Image

A lot of major updates on Flux Real-Time pipeline

Hello! Just a week ago I have posted here announce of my real-time streaming pipeline based of Flux.2-Klein. Here is the original post.

And first of all, thanks a lot for your support! In comment you have asked for many features to add. Thank for effort of github contributors, the community and me most of them have been implemented.

I decided to make one more post with list of all updates:

– int8 mode was added. It allows to smoothly run pipeline on 24 GB cards like 4090 and 3090.

– Lora support was added.

– u/BuffMcBigHuge has implemented a plugin for Daydream Scope.

– Automated installation scripts for Windows and Linux from environment to model download.

– We made a GUI app that allows to take input both from webcam and spout and stream result into spout and virtual webcam. This can be used to connect to TouchDesigner, OBS, browsers and almost any app using webcam.

– Github contributor m-bo-one has added support of LivePortrait that transfers lip motions and facial expression more precise and with less latency. It is optional but sometimes useful.

At this point no major features are planned, but feel free to create issues if you find some bugs. Support of <=16 GB cards is not planned because it is impractical: they are too slow to run this in “real-time”. Same reason for 9B Flux.2-Klein variant.

The repository (free and oss):

https://github.com/tensorforger/FluxRT

submitted by /u/TensorForger
[link] [comments]

AI Generated Robotic Content

Share
Published by
AI Generated Robotic Content
Tags: ai images

Recent Posts

Combatting adversarial distillation

OpenAI’s layered approach to adversarial distillation combines model training, safeguards, detection, and enforcement to protect…

12 hours ago

7 Ways AI Agents Fail in Production (and How to Catch Each One)

Three events that look alike need separate names.

12 hours ago

Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth

We present Depth Pro 2, an approach to estimating dense metric depth for images and…

12 hours ago

New in AWS Quick: More capable flows, an updated web experience, and agents that work together

Turn one person’s process into your team’s process, get more done in the Quick web…

12 hours ago

Ultimate guide for fixing your team’s API keys

Most Gemini prototypes start the same way. You grab an API key from Google AI…

12 hours ago

Cops Are Pushing Extremely Corny ‘Grand Theft Auto 6’ Slop

The blockbuster game makes no secret of its contempt for law enforcement. Real police departments…

13 hours ago