knrz
The redditor was using img2img to do style transfer frame by frame, which is why we have the jumping faces all the time (“instability”).

This isn’t a limitation of neural nets, as early as 2018 we’ve had stable style transfer for videos, see https://medium.com/element-ai-research-lab/stabilizing-neura...

mynegation
In the next five years all high cost productions are going to be replaced by a neural style transfer from the child scribbles. I am only half-joking.
socialismisok
Ghibli style is a real stretch. Even discounting "style" means more than just the colors on the frame (what shot compositions, what's in frame, where does the camera linger, etc) the redditor didn't really succeed in capturing even one frame that had the visual style of a Ghibli frame.

Praying stuff like this feels... Not crass, exactly, but like... Unrefined and ersatz in a way. It's like buying a mall katana and displaying it like it's something of cultural value.

dirtyid
If I didn't know context, looks almost stylistically intentional. Crazy to think a few years ago this would have taken untold tens of thousands of man hours to plan and animate, would have probably gone viral and won a bunch of awards. Now it's just an interesting accident from fucking around.
hericium
Those morphing faces gave me a disturbing flashback of looking into a mirror after LSD macrodose.
pushedx
The random face style each frame is oddly captivating
6510
The future will need some bug fixes.
superchroma
Not even close to right or stable, falls apart in the tighter shot on geralt when it no longer recognizes him as human, and AI of course has no idea about 3D context so can never do cell shading in the way it is being trained.

This was honestly a great waste of compute power.

To the downvoters, do what you want, but it doesn't change the apparent reality of what we're seeing. AI image generation is an exciting and growing technology but this isn't a remarkable or successful application of it in any measurable dimension. The system lacks temporal and spatial context and that is going to be a hard blocker for this application.

davidkuennen
Crazy. Just imagine what you could do with it. You could basically just do some amateur scenes in your garden and have SD make an anime masterpiece of it.
jesperlang
Very dream like, trippy results! Reminds me alot of Waking Life movie
aaron695
mrtree
sr.ht