ekZepp@lemmy.world to Technology@lemmy.mlEnglish · 2 months agoStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comexternal-linkmessage-square9fedilinkarrow-up13arrow-down10
arrow-up13arrow-down1external-linkStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comekZepp@lemmy.world to Technology@lemmy.mlEnglish · 2 months agomessage-square9fedilink
minus-squareDowncount@lemmy.worldlinkfedilinkarrow-up0·2 months ago The funny thing is, if you point out its mistakes, it often does better on subsequent attempts. Or it get stuck in an endless loop of two different but wrong solutions. Me: This is my system, version x. I want to achieve this. ChatGpt: Here’s the solution. Me: But this only works with Version y of given system, not x ChatGpt: <Apology> Try this. Me: This is using a method that never existed in the framework. ChatGpt: <Apology> <Gives first solution again>
minus-squaremozz@mbin.grits.devlinkfedilinkarrow-up1·2 months ago “Oh, I see the problem. In order to correct (what went wrong with the last implementation), we can (complete code re-implementation which also doesn’t work)” Goto 1
Or it get stuck in an endless loop of two different but wrong solutions.
Me: This is my system, version x. I want to achieve this.
ChatGpt: Here’s the solution.
Me: But this only works with Version y of given system, not x
ChatGpt: <Apology> Try this.
Me: This is using a method that never existed in the framework.
ChatGpt: <Apology> <Gives first solution again>