feddit.org

2 points

3 months ago

Hi, person here who’s drawn extensively with pencil as a kid but then slowed down. AI has reignited my passion for art, because unlike pencil or even digital drawing, you can iterate much more quickly, which allows me to do so while working a demanding job and having a life besides it. You are severely underestimating the amount of micro-decisions that go into AI art, and more importantly AI assisted art. If you’ll allow me, let me explain.

Lets break it down into levels of effort and creative input, I like to refer back to photography since it has some comparison:

Empty canvas prompting.

spoiler

To me that is essentially the equivalent of taking a selfie or a random shot. On the scale of effort this is none to very little. But a prompt can be unique if you put an extreme amount of effort into specifying the exact details, just like a random shot can in fact be a very informed random shot.

You can put a rather massive amount of tokens into your prompt that all further specify this. At this point you can reasonably say you imagined at least the general look of the image before it was created. But you can’t say you had any part in actually drawing it or significantly determined how it was drawn. It’s basically impossible to get any kind of copyright protection over this unless you can back up your prompt very well, and only then would you get protection over your prompt, not what the AI drew.

Image to image

spoiler

You can feed an image into the AI, you add noise to the image, and let the AI try to remove that noise (After all, this is the exact same as it does on an empty canvas, but that is completely random noise). This means that a large part of your original image specifies how the AI will further try to denoise the image. As such, you are guiding a large part of how the AI moves forward. No other artist would likely use the same input image as you, so human decision making plays a bigger part here.

To me this is the equivalent of choosing a location you want to take a picture, and then scouting several locations to see which one works best. That’s the micro-decisions sneaking in. You are giving the AI an existing image, either created by yourself, or from previous iterations.

At this point, you are essentially evolving an image. You are selecting attributes and design choices in the image you want to enhance and amplify. These are decisions the artists makes based on their view of how the final image will look like. Every iteration adds more decisions that no other artist would take the same way.

Collaboration.

spoiler

The point where AI starts becoming a tool. You don’t start with point 1, or at least only use point 1 for brainstorming. You imagine the image beforehand, just like you would do with pencil. You can develop the image as much as you would like before going to the AI. You are making the exact micro decisions you are with drawing by hand, since it’s essentially the same up to this point. A photographer at this point would work out every fine detail before snapping the picture.

Except for the fact that you know you are going to be using an AI, so certain aspects need more or less refinement to properly be enhanced by the use of AI. Just like you don’t start the same if you’re going to make a painting, or a silhouette, or any other kind of technique. At some point, you return the image to the AI and mostly perform step #2, perhaps returning to brainstorming with step #1 if you want to add or remove from your existing design.

AI truly as a tool.

spoiler

Now to make something actually with #3, you start doing this process in iterations. Constantly going back and forth between photoshop and the AI, sometimes you spend days in photoshop, other times you spend days refining a part of the image with AI. There are also additional techniques like ControlNet, LoRAs, different models, different services, that can drastically enhance how well you get to what you want. A photographer at this point would take as many shots as they would need using their creatively controlled setup, and find the best on among them. Different lenses, different vocal lengths, different lighting (if applicable), different actions in the shot.

Sadly, most people that talk confidently about how much they hate AI just know point #1 and maybe point #2. But I see point #3 and #4. And when I talk to artists that haven’t yet picked up on AI, but if they are aware (or made aware) of #3 and #4, suddenly their perspective also changes in regards to AI. But the hostility and the blind anger makes it quite hard to get through to people that not all art with AI is made equally. We should encourage people that want to use AI to reach the point of #3 and #4 so that their creative input is significant to the point it’s actually something produced by their human creativity. And this is also where an existing artist switching to using AI will most likely start off from.

Also, in terms of time. #1 might take seconds, #2 might take minutes to hours, but #3 and #4 can take days or weeks. Still not as long as drawing those same pieces by hand, but sometimes I wish it was as easy as people would make it out to be.

report

[ - ]

Hobthrob@lemmy.world

2 points

3 months ago

I’m glad you’ve found value in it. I’ve played around with a similar workflow you describe in step 3 and 4, but I just find that it always produces the blandest version. Sometimes you get a surprising iteration, but I think being used to seeing visual patterns makes it much more obvious just how predictable the image details get. It just ends up looking like a compilation of techniques.

report

[ - ]

1 point

3 months ago

I’m sure it won’t bring the same results for everyone, and that’s fine. I’m glad it’s that way and not just so easy it would consume all other ways of making things, as it would cease to be a tool at that point and just become the entire process. I really just try to make what I am already imagining since before I even put anything to paper, and so I know what I want the AI to help me with ahead of time. I get surprisingly close to the idea in my mind because of that. Much closer than I reasonably could get in other ways with the finite time I have.

report

[ - ]

Hobthrob@lemmy.world

2 points

3 months ago

That sounds like a good tool for you then. I do art as my day to day, and there are definitely aspects of my work that I would love to have a bit of AI injection to help speed the process up, but that is much more as a tool directly integrated into the softwares I already use, like a beefed up content aware transform tool that allows me to move parts of a finished image around just a little bit, and having the AI fill in the small gaps that creates.

I see so many small ways to make the art process less painful or introduce more non-destructive editing tools, if only the AI was built into the software and actively training on the art you were doing, as you did it, rather than having it take over whole parts of the process as it is currently used.

report

[ - ]

1 point

3 months ago

Yes, I want it to go that way too. But that does take time. Which is why I think it’s a shame some people are really hostile to it indiscriminately. I get that the big corporations are absolutely wielding the worst aspects of it, and I hate that too. But once you go to grassroots and small corporations, suddenly there is a whole different view of it. AI is a product of humanity’s collective efforts, and as such all of humanity should be it’s benefactor, not a small group of people that just happened to have the most money and influence at the time. Especially if they had nothing to do with actually creating the technology behind it. And by making the story about them rather than the people using it as it should, it will inevitably lead to people falling behind to corporations, and widening the gap even further. Making artists even less valued than they already are. Which is something I’ve always fought against even before AI.

report

[ - ]

Hobthrob@lemmy.world

2 points

3 months ago

I mean, the hostility is entirely understandable. The current form of generative art is meant to replace artists. It is part of what is currently devastating peoples livelihoods, although I think some companies and clients are already learning that it currently leads to lower overall quality, due to how much harder it is to implement changes based on feedback. It lowers the overall quality bar, although it does have the potential to raise the floor a little. The larger models that are causing this hype are quite literally trained on the work of unwilling artists.

It is the most disrespectful and clearly ethically wrong basis to build it on, and it really begs the question of whether the ends justify the means. Beyond that, art is just not an area where we need AI. It largely hurts artists, is super energy demanding so it actively hurts the environment for no real benefit.

The energy would be so much better used solving actual problems, so more people could spend time doing things they enjoy. If some people enjoy AI generation, then that’s fine but I think it shouldn’t replace a passionate, skill-based workforce.

report

[ - ]

1 point

3 months ago

It is understandable. But what is not understandable is turning a blind eye to the nuance and choosing hate over understanding. I’m glad you have not done so and done your own research, and I happily applaud you for that. But I meet plenty of people that blindly take some art social media influencer’s misguided (sometimes suspiciously conveniently so) ideas on how AI works. Big companies aren’t all that exists, and they are not the only ones making advancements. Or the majority of it, really. It just looks that way because they get all the attention and have all the means.

Pretending it is so is gives them far more unwarranted power than is healthy, as it creates a situation where people think they’re destroying the big corporations, but in fact are destroying the means for smaller creatives that operate in the shadows to keep up and compete. AI technology will never be restricted in a way that will just harm the corporations as it currently is. Stricter copyright laws are a common proposal but I’m sure Disney et al are just downright content if that what ends up with it, as they have enough data to their own to easily train their own AI. And banning the technology as a whole would open up cans of worms that it won’t be banned everywhere, leading to economic losses to the countries that do ban it.

I’m working day to day with professional artists from smaller companies that are using it for the right jobs to speed up their work. But their voices are unheard because if they speak up they get showered with hate and people calling them fake or frauds. Again, people that have created wonderful things without AI and deserve the title of artist multiple times over. They don’t have millions of followers to back them up, so they just don’t bother with and do what artists do, which is to create. Ironically, it’s also in part artists that are silencing other artists over AI, not the big corporations.

is super energy demanding so it actively hurts the environment for no real benefit.

While I agree with that, it should be mentioned that it’s mostly LLMs that require massively out of proportion energy. Generating images is about as expensive as playing a video game on high settings. Modeling software and 3D software also drain energy and producing art is just generally more expensive than consuming it. I think just saying ‘it hurts the environment’ is slightly misguided, since you can say that about literally everything. Humans existing at all is bad for the environment, but the balance of it is what matters. I do think LLMs go over the edge and big company’s insistence to shove it into literally everything is despicable, and not proportional to the benefit.

The energy would be so much better used solving actual problems

So one thing I want to mention there is that AI is downright revolutionary in medicine. You can’t look at technology as something that takes linear paths from improvement to improvements. The lessons learned in one area can also become applicable to other areas. AI can be used to detect cancers early, solve protein folding, find tumors on medical scans. And that’s from just the relatively little knowledge I have of it. So yes, image generation doesn’t solve such issue, but the technology that allowed them to exist does solve real tangible issues, and it’s popularity and spread is inherently linked.

If some people enjoy AI generation, then that’s fine but I think it shouldn’t replace a passionate, skill-based workforce.

100% agree. No AI should ever replace humans. I would rather see people get excited to make something because of AI, and once they have some success and secure funding, switch over to competent human artists. That’s how humans should replace AI in my eyes, not the other way around.

report