A lot of major updates on Flux Real-Time pipeline

Hello! Just a week ago I have posted here announce of my real-time streaming pipeline based of Flux.2-Klein. Here is the original post.

And first of all, thanks a lot for your support! In comment you have asked for many features to add. Thank for effort of github contributors, the community and me most of them have been implemented.

I decided to make one more post with list of all updates:

– int8 mode was added. It allows to smoothly run pipeline on 24 GB cards like 4090 and 3090.

– Lora support was added.

– u/BuffMcBigHuge has implemented a plugin for Daydream Scope.

– Automated installation scripts for Windows and Linux from environment to model download.

– We made a GUI app that allows to take input both from webcam and spout and stream result into spout and virtual webcam. This can be used to connect to TouchDesigner, OBS, browsers and almost any app using webcam.

– Github contributor m-bo-one has added support of LivePortrait that transfers lip motions and facial expression more precise and with less latency. It is optional but sometimes useful.

At this point no major features are planned, but feel free to create issues if you find some bugs. Support of <=16 GB cards is not planned because it is impractical: they are too slow to run this in “real-time”. Same reason for 9B Flux.2-Klein variant.

The repository (free and oss):

https://github.com/tensorforger/FluxRT