AI is bad compression. Every time you run training material through it, you get a lossy summary of that material back, along with some noise.

You quickly run out of *quality* training material and start dog-fooding the output back in. Then you end up with lossy summaries of lossy summaries, and eventually all your pizza sauce recipes are dog food.

#AI #LLM

#AI #llm
โ‡ง