Communications of the ACM
Replacing a SQL Analyst With 26 Recursive GPT Prompts
LLMs are "shockingly close to replacing an entire role at companies with only a few hours of effort."
Ken Van Haren describes exploring replacing a dreaded "analytics on-call" rotation with GPT-3.
"The idea that something like analytics on-call could be entirely replaced by a next-token optimizer like GPT-3 has been an idea I've been excited to try for a long time now," Van Haren writes.
To test the idea, Van Haren built CrunchBot, a free-form question answering analytics bot on top of a fundraising-related Crunchbase data set of investors, companies, and fundraising rounds.
He presents examples of CrunchBot "getting a simple thing exactly right," "getting something more complex exactly right," and "getting something complex terrifically wrong."
"It seems like there's almost no limit to how good GPT could get at this," Van Haren says.
From Patterns
View Full Article
No entries found