Voice Driven Avatar Animation by Ken1171_Designs
Members remain the original copyright holder in all their materials here at Renderosity. Use of any of their material inconsistent with the terms and conditions set forth is prohibited and is considered an infringement of the copyrights of the respective holders unless specially stated otherwise.
No AI - This artwork was created entirely by hand or with traditional digital tools.
Description
~Voice Driven Avatar Animation~
Today I have been playing with talking avatar video generation with Wan 2.1 AI. I first generated the voice using another AI called T5-TTS out of a text prompt and then created the character with Stable Diffusion SDXL AI. We then feed the resulting image and audio files into Wan 2.1 to generate the speaking character animation. I have kept parameters to very low values, like a third of the recommended values to speed up the process at the cost of lower image quality. Used 512p image, taking 20 minutes to produce 15 seconds of animation on an RTX 3090 24GB using only 12 steps (instead of the recommended 30@720p).
Not bad for free tools locally installed! ^^
Comments (6)
Good animation voice work well
Thank you! Cool thing is that this was done with 3 different tools (voice, image and animation), and they are all free. ^^
She's cute. I like this.
Thank you! This was my 1st try with this tool, and I am eager to see what I can do with it. I just wish I had a bigger GPU. ^^
I'd say, it's a little bit more than 'not bad'. LOL I'm not sure, what she's talking about, but it sounds great and she's very cute!
She's talking about her mom's absurd recipe, mixing chocolate, tuna and ketchup 😋
Not sure I'd care to partake of that, but she sure is a cutie! LOL Really fun and well done animation!
Thank you! Yup, that recipe was the joke. 😁 Made a new animation with this character, now about cat insulation. __
Time to throw the pan away I think...lol This is cool and very funny, love the character and the voice is perfect :)
Thank you! Making these animations is a lot of fun, though it's still very computationally expensive. ^^
PERFECT
Thank you! This was a lot of fun to make. ^^