- cross-posted to:
- [email protected]
- cross-posted to:
- [email protected]
Software engineer Vishnu Mohandas decided he would quit Google in more ways than one when he learned that the tech giant had briefly helped the US military develop AI to study drone footage. In 2020 he left his job working on Google Assistant and also stopped backing up all of his images to Google Photos. He feared that his content could be used to train AI systems, even if they weren’t specifically ones tied to the Pentagon project. “I don’t control any of the future outcomes that this will enable,” Mohandas thought. “So now, shouldn’t I be more responsible?”
The site (TheySeeYourPhotos) returns what Google Vision is able to decern from photos. You can test with any image you want or there are some sample images available.
I gave it a picture of houseplants and it said they looked healthy and well cared for which actually made me feel pretty happy and validated.
Don’t feel too happy bro you were told that by a soulless computer that’s was designed to tell you what it thinks you want to hear.
It’s not designed to tell you what you want to hear.
That’s literally all AI is designed to do. Given an input, it just tries to output an expected response.
Yeah, no. LLMs predict what comes next, not what someone wants to hear.
Try to ask if it likes you.
Claude nails it again.
That… isn’t telling you what you want to hear.
LLMs are literally just complex autocorrect. They don’t weight their responses based on what a user wants to hear (unless explicitly instructed to) they simply return the most algorithmically generic response it can find.
Tell it to talk like a pirate, it will pattern match to pirate talk. It’s not doing it because you want it to, but because you gave it a “pre prompt” to talk like a pirate, and it did the most likely thing that would happen.
Yes, this can seem like telling you what you want, but go ask it to tell you what shape the world is. Then tell it you want the earth to be flat, and to answer the question again. Both times the answer will be an oblate spheroid, because it doesn’t know nor care what you want.
Now, if you say “Imagine the world is flat” first, yeah it’ll tell you it’s flat. Not because you want it to, but because you’re explicitly handing it “new information” that you want it to incorporate into its response.
Didn’t exactly make my heart throb but if it does that for you, you’ve got a low bar.
Not really wants as much as expects, but that’s what AI is designed to do.
What you’re saying is not factual. LLMs predict what comes next based on the parameters set during learning process. It might at times say what you’re expecting, but then try contradicting information that it knows to be factual. See how far that gets you.
I think you’re confusing agreeableness for a validation buddy. For a product like this to work, it has to be inviting.
Now you’re just splitting hairs.