Communications of the ACM
ChatGPT Finding, Fixing Bugs in Code
The ability to chat with ChatGPT after receiving the initial answer made the difference, ultimately leading to ChatGPT solving 31 questions and easily outperforming the others programs.
Credit: Bloomberg/Contributor/Getty Images
Computer science researchers from Germany's Johannes Gutenberg University and the U.K.'s University College London found the ChatGPT chatbot can detect and correct buggy code better than existing programs.
The researchers gave 40 pieces of bug-embedded software to ChatGPT, and to three other code-fixing systems for comparison.
ChatGPT's performance on the first pass was similar to that of the other systems, but the ability to dialogue with the bot after receiving the initial answer ultimately helped it overtake the others.
The researchers explained, "We see that for most of our requests, ChatGPT asks for more information about the problem and the bug. By providing such hints to ChatGPT, its success rate can be further increased, fixing 31 out of 40 bugs, outperforming state-of-the-art."
From PC Magazine
View Full Article
Abstracts Copyright © 2023 SmithBucklin, Washington, DC, USA
No entries found