I mainly used I2V. Used several models for the images.
Some thoughts after working on this – The acting i got from ltx blew my mind. No need for super long prompts, i just describe the overall action and put dialogue inside quotation marks.
I used the fast model mainly – with a lot of motion you sometimes get smudges, but overall worked pretty good. Some of the shots in the final video were one-shot results. i think the most difficult one was the final shot, because the guy kept entering the frame.
In general models are not good with post processing like film grain, so i’ve added some glitches and grain in post, but no color correction. The model is not super good with text, so try and avoid showing any.
You can generate 20 seconds continuous videos which is game changer for film-making (currently 20 sec available only on the fast version). Without 20 sec, i probably couldn’t get the results i wanted to make this.
Audio is pretty good, though sometimes during long silent parts it glitches.
Overall, i had tons of fun working on this. I think that this is one of the first times that i could work on something bigger than a trailer and maintain impressive realism. I can see someone who is not ‘trained’ on spotting ai thinking this is a real live-action short. Fun times ahead.
submitted by /u/theNivda
[link] [comments]
It is far more likely that a woman underwater is wearing at least a bikini…
TL;DR AI is already raising unemployment in knowledge industries, and if AI continues progressing toward…
The canonical approach in generative modeling is to split model fitting into two blocks: define…
As organizations increasingly adopt AI capabilities across their applications, the need for centralized management, security,…
From uncovering new insights in multimodal data to personalizing customer experiences, AI is emerging as…
OpenAI has sent out emails notifying API customers that its chatgpt-4o-latest model will be retired…