In early 2023, researchers from Microsoft, GitHub, and MIT released a study called
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot (PDF).
The overall study and methods are described in detail in the 19-page document, but the abstract succinctly explains the results (which aren't going to surprise anyone!):
"This paper presents results from a controlled experiment with GitHub Copilot, an AI pair programmer. Recruited software developers were asked to implement an HTTP server in JavaScript as quickly as possible. The treatment group, with access to the AI pair programmer, completed the task 55.8% faster than the control group."
That's a significant speed increase, which is what we want to see – putting aside any possible drawbacks like failure to understand the code, inability to remember syntax, etc.
Another relevant quote from the results:
"Developers with less programming experience, older programmers, and those who program more hours per day benefited the most."
I should also point out that the total number of developers involved in the study was 95, which is a fairly small sample. Of course, the sample size probably isn't as relevant in a study like this but it's possible a larger sample may have yielded a similar but smaller increase for AI group.
Now on to this week's hand-picked productivity links!