Researchers found that 52 percent of answers to programming questions generated by ChatGPT were incorrect.
  • slacktoid@lemmy.mlEnglish
    24·
    1 年前

    We need a comparison against an average coder. Some fucking baseline ffs.

    • anachronist@midwest.socialEnglish
      9·
      1 年前

      “Self driving cars will make the roads safer. They won’t be drunk or tired or make a mistake.”

      Self driving cars start killing people.

      “Yeah but how do they compare to the average human driver?”

      Goal post moving.

      • slacktoid@lemmy.mlEnglish
        1·
        1 年前

        The issue is the powers that be arent comparing chatgpt to a reference manual. Rather another human being.

    • hayes_@sh.itjust.works
      6·
      1 年前

      Why would we compare it against an average coder?

      ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.