tired_n_bored@lemmy.world to Fuck AI@lemmy.world · 2 months agoHey we solved software development, no need to learn programming anymore (Claude's source code leak)lemmy.worldimagemessage-square41linkfedilinkarrow-up1459arrow-down16
arrow-up1453arrow-down1imageHey we solved software development, no need to learn programming anymore (Claude's source code leak)lemmy.worldtired_n_bored@lemmy.world to Fuck AI@lemmy.world · 2 months agomessage-square41linkfedilink
minus-squareMadrigal@lemmy.worldlinkfedilinkEnglisharrow-up88·2 months agoI’ve literally seen someone include “Don’t hallucinate” in an agent’s instructions.
minus-squarerozodru@piefed.worldlinkfedilinkEnglisharrow-up41·2 months agoAsking Claude to not hallucinate is like telling a person to not breathe. it’s gonna happen, and happen conistently.
minus-squareFrederikNJS@piefed.ziplinkfedilinkEnglisharrow-up53·2 months agoI think the important bit to understand here is that LLMs are never not hallucinating. But they sometimes happens to hallucinate something correct.
minus-squareJames R Kirk@startrek.websitelinkfedilinkEnglisharrow-up35·2 months agoThis fact of how LLMs work is not at all widespread enough IMO.
I’ve literally seen someone include “Don’t hallucinate” in an agent’s instructions.
Asking Claude to not hallucinate is like telling a person to not breathe. it’s gonna happen, and happen conistently.
I think the important bit to understand here is that LLMs are never not hallucinating. But they sometimes happens to hallucinate something correct.
This fact of how LLMs work is not at all widespread enough IMO.