For anyone wondering how I manage to do this, here’s a quick explanation with a small tutorial

First, in Minimax, I use a prompt like this: “The character remains completely frozen in place, perfectly still like a statue. The camera smoothly orbits 360 degrees around the character in one continuous shot. No character movement, no pose change, no cuts.” Then I use COLMAP: Create a new database and import the frames extracted …

I trained the missing encoder for YuE2, so we can all bring our own music into it

YuE2 is an impressive open music model. Give it a style prompt and lyrics, and it can make a complete song. Under the hood, it generates “semantic tokens” that are then turned into audio. The trouble is, the encoder that converts existing recordings into those same tokens was never released. That leaves you without a …

TaoMate – H3 3 steps lora used as a refiner

The lora itself at 3 steps is nothing to write home about. If the scene isn’t mostly static, you can expect slowmo jerky motion, smearing and straight broken output with butchered sound. HOWEVER, it has VERY good visual quality without obvious overcooking plaguing the turbo loras. You add as much steps of non accelerated generation …

Testing MiniMax-H3 Physics knowledge Pt2

Some weeks ago, I posted a set of experiments to “understand” the physical knowledge of MiniMax H3 (original post here). The idea was simple: get an open video of somebody pouring water and replace the water with various liquids. No external references were used. In this set of experiments, I switched from liquid-to-liquid replacement to …

[Experiment] I trained a model on childhood photos to simulate memory recall

I fine-tuned the good-old SDXL on 60 photographs from my childhood, using a limited family archive as the dataset through which to revisit that period of my life. Rather than reconstructing those images faithfully, the model produces unstable variations: spaces, faces and fragments that feel familiar without necessarily having existed. This speculative study treats generative …