I’ve been diving into AI assisted workflows and found an extreme font for creativity. My recent efforts have been towards RPG-style characters like you’d see in a D&D game, and this guy came from the idea of a royal guard of an ancient city, Egyptian/African-esque. The AI gave me a variation with just the shield and I really liked the aspect of not killing but defending. If anyone is curious about the workflow I’d be happy to share :)
Looks nice & cool concept. What’s the workflow? :)
Thank you! Essentially I’ll come in with a visual idea, some sketches already or I’ll do one with AI in mind (keep the lines simple so it doesn’t get confused). Generate a batch of images with img-2-img and cherry pick the ones that fit closest to the idea or are surprising and wonderful. Rework those for anatomical errors or other things I want to fix or omit -> send it back through img-2-img if it needs it or to inject detail -> upscale and put it as my desktop/phone wallpaper :P
(I’m using Automatic 1111 which is a webui for Stable Diffusion btw)
Oh img2img sounds awesome. Never heard about it before. How do you rework the anatomical errors and stuff? By hand? Or all within Automatic 1111?
Img2img is one of many ways to constrain the AIs efforts to your compositional desires, it’s rad. You can control the amount of “dreaming” the AI does on the base image to get subtle changes, or a radically different image based on the elements of the previous (sometimes to trippy cool results, often to horrendous mutations if the desired image is supposed to be humanoid xD).
Inpainting is another tool, it’s like a precise img2img on an area you mask. Hands are often the most garbled thing from the AI, so a brute force technique is to img2img the hands - but the process works a lot better if you help the AI out and manually fix the hands. So I’ll throw the image into photoshop, make a list (if I remember :P) of everything I need to fix, address them directly and then toss it back into Automatic 1111. Often the shading and overall style are hard things for me to get right so I’ll inpaint over my edits to get the style and shading back.
I’m a little bit conflicted honestly, because I’m not a fan of the idea of A.I. art, in general. But I also have to admit this result looks really good. Very cool character and perspective! I also like your take with him being a defender/carrying no weapon.
I think maybe it needs some more work in the surroundings, because some of the buildings don’t make sense (missing walls e.g. around his shield).
I hear you, when this stuff was blowing up I couldn’t shake that it was trained off artists’ work that they didn’t consent to having in the datasets. Sure it’s similar to how human artists work (for music and art the prevailing recommendations for me, or any artist, was to consume material relevant to your art. For visual art they really just wanted you to constantly keep your head open for shapes and form) but it felt closer to plagiarism than inspiration. Some generations can be very close to an individual style (especially if the model was trained specifically off that) but I found that generations that omitted an artist ended up creating something compelling but not tied to one artist specifically - still undoubtedly a conglomeration of the multitudes it was trained on (including photography). It’s muddy water for sure, and the angle of AI replacing workers in general is still relevant - but I also think it empowers people like me who have the visual ideas but can use the help making them fully fleshed out.
The crux, for me, feels like “when you can see whatever you want, what do you want to see?” A lot of our AI woes are reflections of questionable human behavior (racist chat models, AI for war, deepfakes and dishonesty).
How do you feel about it?
but I also think it empowers people like me who have the visual ideas but can use the help making them fully fleshed out
I totally get that. In fact, I feel similar because I often have ideas or concepts for visual art, but then I lack the drawing/painting skill to actually realize them (I try to improve, but I rarely find the time to practice). In that way, AI assistance could be seen as a tool to make expression via art more accessible to the masses (especially since not everybody can afford or has the resources to visit an art school).
I think my conflict comes mainly from the immense respect and admiration I have for people who are able to create powerful, realistic images from scratch (e.g. people like Martina Fačková). Maybe I just need to get used to it, I mean calculators exist and that’s not a bad thing, because they make our lives easier.
A lot of our AI woes are reflections of questionable human behavior (racist chat models, AI for war, deepfakes and dishonesty).
I find it very interesting, because it poses the question of how much of this behavior is unintentionally woven into AI assisted images. When you look at artists like Martina Fačková, every little detail in her art is intentional and thereby it is also an expression of herself and her views on the world. But with AI art, while the broader composition and concept is intentional, a lot of the details are generated based on how the model is trained (of course you can decide whether you want to go with it or do another pass, in that sense it’s maybe a little bit of self-expression still).
Interestingly, looking at your picture I can see bits and pieces of a war/apocalypse sceneries, e.g. the bird in the sky almost looks like a plane, the ruined buildings in the background (please note that this is not meant as criticism, just an observation). Now that I think of it, I’m also reminded of this captain america movie poster. Maybe the AI had some marvel movie posters in its training data ;-).
