Sounds to me like the art of collage isn't quite over yet then, assuming you want "real" people interacting in situations with "real" (bigger) people and their body parts in your own chosen real backgrounds. From what I've seen so far it's all a bit simplistic in terms of what you can do with physical interaction, though the facial expressions achieved are impressive and quite believable.foreverlurk wrote: ↑Mon Dec 05, 2022 10:59 pmYeah, that technology is still evolving, after having a fun weekend of messing around with it (not even SW-related), just taking pictures with different prompts, reading and understanding the denoising, samplers, etc. It's really fun.
But I've also come across some of the current limitations, like the 512x512 render and sampling (sampling is actually 64x64, compressed), so anything higher res gets really weird because it can only rendy the first 512 block correctly. There's this "high resolution fix", but it also brings it own problems, like repeated faces (very hard to make a scene with two characters from scratch).
Don't get me wrong, this is pure magic and super fun to mess with, but so far I haven't been able to train it to understand the notion of "size difference". I'm sure it'll be able to, eventually. The inpainting mask is a nice workaround in the meantime. Oh and I've read that they are working on voice sythesis and video tech next! Imagine, being able to produce our own animations...
Edit: forgot about the hands... you know, like in hand-helds, or grabbing a SW, etc... Stable Diffusion gets fingers, limbs, arms, sooo messed up and crank out... **shudders** man-made horrors beyond my comprehension / I've seen things you people wouldn't believe, all that jazz. The horror. Apparently the 2.x releases are better with fingers and limbs, we'll see.
But as far as CGI imagery is concerned (rendering etc), this has to be quite a leap forward where it can be adapted to that medium.
No doubt in time to come it wil be commonplace to do whatever we like with this new technology, and everyone will be their own artist.
But I'll hopefully have retired by then lol!