113 points
*

How many of these books will just be totally garbage nonsense just so they could fulfill a prearranged quota.

Now the LLM are filled with a good amount of nonsense.

permalink
report
reply
59 points

Just use the llm to make the books that the llm then uses, what could go wrong?

permalink
report
parent
reply
31 points

Someone’s probably already coined the term, but I’m going to call it LLM inbreeding.

permalink
report
parent
reply
18 points

I suggested this term in academic circles, as a joke.

I also suggested hallucinations ~3-6 years ago only to find out it was ALSO suggested in the 1970s.

Inbreeding, lol

permalink
report
parent
reply
4 points

The real term is synthetic data

permalink
report
parent
reply
4 points

In computer science, garbage in, garbage out (GIGO) is the concept that flawed, biased or poor quality (“garbage”) information or input produces a result or output of similar (“garbage”) quality. The adage points to the need to improve data quality in, for example, programming.

There was some research article applying this 70s computer science concept to LLMs. It was published in Nature and hit major news outlets. Basically they further trained GPT on its output for a couple generations, until the model degraded terribly. Sounded obvious to me, but seeing it happen on the www is painful nonetheless…

permalink
report
parent
reply
3 points

Soylent AI? Auto-infocannibalism

permalink
report
parent
reply
3 points

It’s quite similar to another situation known as data incest

permalink
report
parent
reply
3 points

It can only go right because corporations must be punished for trying to replace people with machines.

permalink
report
parent
reply
4 points

That would be terrible because they are both some of the best academic publishers in the humanities.

permalink
report
parent
reply
48 points

And they expect you to do this for free?

permalink
report
reply
24 points

Do they not have to pay for the privilege? Or is this not referring to academic publishing? (It’s not super clear, but context indicates academic?)

permalink
report
parent
reply
25 points

If it is that makes it even worse. Academic publishers need to be abolished.

permalink
report
parent
reply
11 points

Nah, they get “Exposure”!

/s

permalink
report
parent
reply
7 points

Anyone who reviews for the major publishers is part of the problem.

permalink
report
parent
reply
7 points

For profit corporations don’t deserve your volunteer work.

permalink
report
parent
reply
2 points

And yet if you aren’t a reviewer it makes your CV look worse.

permalink
report
parent
reply
2 points

Agreed that you should have some kind of “service” on your CV, but reviewing is pretty low impact. And if you want to review, you can choose something other than the predatory publishers.

permalink
report
parent
reply
4 points
*
Deleted by creator
permalink
report
parent
reply
1 point

Maybe check the other comments.

permalink
report
parent
reply
47 points

Feed the LLM with LLM generated books. No resentment at all!

permalink
report
reply
44 points

Jfc that’s gross

permalink
report
reply
17 points

So what you’re saying is, don’t beat the targets because fuck those guys. Understood.

permalink
report
reply

Science Memes

!science_memes@mander.xyz

Create post

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don’t throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.



Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

Community stats

  • 13K

    Monthly active users

  • 2.8K

    Posts

  • 40K

    Comments