tired_n_bored@lemmy.world to Fuck AI@lemmy.world · 8 days agoHey we solved software development, no need to learn programming anymore (Claude's source code leak)lemmy.worldimagemessage-square41linkfedilinkarrow-up1457arrow-down16
arrow-up1451arrow-down1imageHey we solved software development, no need to learn programming anymore (Claude's source code leak)lemmy.worldtired_n_bored@lemmy.world to Fuck AI@lemmy.world · 8 days agomessage-square41linkfedilink
minus-squarerenzhexiangjiao@piefed.blahaj.zonelinkfedilinkEnglisharrow-up158arrow-down2·8 days ago“make no mistakes”
minus-squareMadrigal@lemmy.worldlinkfedilinkEnglisharrow-up88·8 days agoI’ve literally seen someone include “Don’t hallucinate” in an agent’s instructions.
minus-squarerozodru@piefed.worldlinkfedilinkEnglisharrow-up40·8 days agoAsking Claude to not hallucinate is like telling a person to not breathe. it’s gonna happen, and happen conistently.
minus-squareFrederikNJS@piefed.ziplinkfedilinkEnglisharrow-up52·8 days agoI think the important bit to understand here is that LLMs are never not hallucinating. But they sometimes happens to hallucinate something correct.
minus-squareJames R Kirk@startrek.websitelinkfedilinkEnglisharrow-up35·8 days agoThis fact of how LLMs work is not at all widespread enough IMO.
“make no mistakes”
I’ve literally seen someone include “Don’t hallucinate” in an agent’s instructions.
Asking Claude to not hallucinate is like telling a person to not breathe. it’s gonna happen, and happen conistently.
I think the important bit to understand here is that LLMs are never not hallucinating. But they sometimes happens to hallucinate something correct.
This fact of how LLMs work is not at all widespread enough IMO.
“Include no bugs”