Google says its AI image-generator would sometimes ‘overcompensate’ for diversity::Google apologized Friday for its faulty rollout of a new artificial intelligence image-generator, acknowledging that in some cases the tool would “overcompensate” in seeking a diverse range of people even when such a range didn’t make sense.
The SALAMI situation is so bad.
Problem: Our training data is super racist, so it always generates white people!
Solution: Modify the prompts so that when a user asks for “a picture of a man” 10% of the time it is changed to “a picture of a BLACK man”.
New problem: When the user says “A picture of a Nazi” 10% of the time our fix interprets that as “A picture of a BLACK Nazi”
So it’s a glorified chat database.
The input to an LLM is effectively a huge quantity of text including chats. What the generative LLM does is nothing more than fancy auto-complete, finding the next word, then the next word, then the next word…