I trained the missing encoder for YuE2, so we can all bring our own music into it
YuE2 is an impressive open music model. Give it a style prompt and lyrics, and it can make a complete song. Under the hood, it generates “semantic tokens” that are then turned into audio. The trouble is, the encoder that converts existing recordings into those same tokens was never released. That leaves you without a …
Read more “I trained the missing encoder for YuE2, so we can all bring our own music into it”