Is AI Coming for Coders First? By John Herrman

by admin Saturday, April 1, 2023 10:01 am

MAR. 31, 2023

Is AI Coming for Coders First?
By John Herrman

Photo-Illustration: Intelligencer; Photo: Getty Images
Lots of industries are speculating about what AI means for their futures. It could be an “especially big deal” for the legal profession and may “reinvent” market research. It could change what it means to be a graphic designer. It could empty out call centers. Will it make white-collar office workers around the world massively more productive, or redundant, or neither, or both? An open letter calling for a “pause” on “giant AI experiments,” signed by an unusual assortment of public figures including Elon Musk, Yuval Noah Harari, and Andrew Yang, frames the question as hopelessly as possible: “Should we automate away all the jobs, including the fulfilling ones?”

These are mostly predictions, made from afar, about one industry’s plans for all the others. Inside the tech industry, though, there is a bit more confidence about where AI automation will matter the most, the soonest. The future may as well be on auto-complete: AI is obviously coming for software first. Where else would it start?

Enter your email
As a feeling, this is understandable. Capital is draining from the rest of the start-up scene and flooding into AI. Big tech firms are announcing major AI investments at the same time that they’re shedding thousands of other workers. It’s all anyone in the industry can talk about, and true believers are everywhere; if you’re already the sort of person who is anxious that you’re not working on the next big thing, it only follows — emotionally, to you, the staff software engineer at a company that has nothing to do with AI — that the next big thing may just crush you underfoot, or at least change your job in unpredictable ways.

But the idea that software development will discover the consequences of LLM-based AI is based on more than a nervous vibe. While the public was playing with experimental chatbots such as ChatGPT and image generators like DALL-E and Midjourney for the first time, coders were using AI assistants — some based on the same underlying technology — at work. GitHub Copilot, a coding assistant developed by Microsoft and OpenAI, “analyzes the context in the file you are editing, as well as related files, and offers suggestions” about what may come next with the intention of speeding up programming. Recently, it has become more ambitious and assertive and will attempt a wider range of programming tasks, including debugging and code commenting.

Reviews of Copilot have ranged from rapturous to mixed; at the very least, it’s a pretty good auto-complete for a lot of coding tasks, suggesting that its underlying model has done an impressive amount of “learning” about how basic software works. Game developer Tyler Glaiel found that GPT-4 was unable to solve tricky and novel programming test problems and that, like its content-generating cousins, it has a tendency to “make shit up” anyway, which “can waste a lot of time.” Still, on the question of whether GPT-4 can “actually write code,” he gave it some credit:

Given a description of an algorithm or a description of a well-known problem with plenty of existing examples on the web, yeah GPT-4 can absolutely write code. It’s mostly just assembling and remixing stuff it’s seen, but TO BE FAIR … a lot of programming is just that.

Former Twitter VP and Googler Jason Goldman assessed the technology from the perspective of a common industry type: a manager who can’t really code.

OpenAI was early to release usable AI coding tools, but this week, Google announced that it was partnering with Replit, a popular software development environment, on a general-purpose coding assistant. In an interview with Semafor, Replit’s CEO, a rather excited Amjad Masad, described coding as “almost the perfect use case for LLMs,” and said that, eventually, his company’s goal was for its assistant to become “completely autonomous,” such that it can be treated like an extra employee.

This month, Paul Kedrosky and Eric Norlin of SK Ventures published a more extensive bull case for AI software development:

The current generation of AI models are a missile aimed, however unintentionally, directly at software production itself. Sure, chat AIs can perform swimmingly at producing undergraduate essays, or spinning up marketing materials and blog posts (like we need more of either), but such technologies are terrific to the point of dark magic at producing, debugging, and accelerating software production quickly and almost costlessly.

This, they say, is in part because “[s]oftware is even more rule-based and grammatical than conversational English, or any other conversational language,” and “programming is a good example of a predictable domain.” In their view — fairly optimistic, but also, you know, they’re investors — this will let people make and use software where they previously never would have been able to, quickly relieving “society’s technical debt” before triggering waves of unpredictable innovation.

And hey — maybe! It’s clear, in any case, that the software industry is highly exposed to the effects, whatever they may be, of its newest creations and that its workers and employers have been quick to test and adopt them. It makes some sense that the effects of LLM automation on labor — fewer jobs, more jobs, different jobs, wage pressure, displacement — will manifest early, if not first, somewhere in the industry where it’s first and most thoroughly deployed and where it seems especially capable.

One such somewhere is within the companies creating the AI tools. Google is a software company that hopes to provide AI-based software to its users and customers at other firms; it’s also an employer with more than 150,000 employees that just slashed 6% of its workforce. In his layoff announcement, Google CEO Sundar Pichai directly cited the company’s investment in AI. “Being constrained in some areas allows us to bet big on others,” he wrote. “Pivoting the company to be AI-first years ago led to groundbreaking advances across our businesses and the whole industry,” he continued, emphasizing “substantial opportunity in front of us with AI.” This can be read two ways. Google is certainly in an enviable position to sell and provide AI products to others. It’s also, perhaps, the ideal customer for its own allegedly productivity-enhancing tools: dozens of offices full of coders and product managers and emailers and deck-makers and meeting-holders — not to mention countless lower-paid contractors spread around the world — testing out tools, en masse, in a single corporate environment. Before Google really finds out what its products will do for and to its customers, and their workers, it’ll probably start to find out what those products will do for itself. In the event that LLM tools turn out to be massively overhyped and don’t produce much utility or change, well, Google would be among the first to know that, too, although they might not be terrible eager to share their findings.

In its own analysis, OpenAI suggested that certain tech jobs would be highly exposed to LLM-based tools. “We discover that roles heavily reliant on science and critical-thinking skills show a negative correlation with exposure,” the company claimed, “while programming and writing skills are positively associated with LLM exposure,” and that “around 80 percent of the U.S. workforce could have at least 10 percent of their work tasks affected by the introduction of LLMs, while approximately 19 percent of workers may see at least 50 percent of their tasks impacted.”

Now, one of the leading LLM companies in the world would say that, and it’s easy for a company with fewer than 400 employees to speculate wildly about what will happen to everyone else. (OpenAI does, however, utilize thousands of foreign contract laborers to help clean up its models, doing work that is potentially quite “exposed” to near-term automation.) It’s also the sort of prediction that may interest Microsoft, OpenAI’s biggest funder by far and its partner on a bunch of AI-powered features in popular software such as Windows, Office, and, of course, GitHub. Like Google, Microsoft has been cutting costs, mostly by eliminating thousands of jobs, including some from GitHub’s overseas teams. Its investment in AI can likewise be interpreted in two ways: as a bet on a new sort of product from which it may make money and, more immediately, as an investment in automation that simply saves it some money on labor, like a new machine on a factory floor.

SIGN UP FOR THE INTELLIGENCER NEWSLETTER
Daily news about the politics, business, and technology shaping our world.
Email
Enter your email

TAGS: SCREEN TIME AI ARTIFICIAL INTELLIGENCE GOOGLE MORE
LEAVE A COMMENT
3/31/2023 WHAT WE KNOW

Donald Trump Has Finally Been Indicted: Updates
By Nia Prater, Chas Danner, And Intelligencer Staff
Now he’s really paying for hush money.
3/31/2023 TREMENDOUS CONTENT

Ivanka Trump Declares Neutrality on Father’s Indictment
By Margaret Hartmann
She issued a statement that is 27 words long and somehow says absolutely nothing — though her broader message was crystal clear.
3/31/2023 EARLY AND OFTEN

The Case(s) Against Donald Trump
By Nia Prater
It’s hard to keep track, so we made a guide.
MOST POPULAR
Ivanka Trump Declares Neutrality on Father’s Indictment
By MARGARET HARTMANN
Donald Trump Has Finally Been Indicted: Updates
By NIA PRATER, CHAS DANNER, AND INTELLIGENCER STAFF
The Meltdown of a Gay Bank
By JEN WIECZNER
Michael Cohen Is Already Undermining the Trump Prosecution
By ANKUSH KHARDORI
Ron DeSantis Got Played by Disney
By MATT STIEB
3/31/2023 EARLY AND OFTEN

Trump in Handcuffs? How His Indictment Is Likely to Play Out
By Nia Prater
The former president will be photographed and fingerprinted, for starters.
3/31/2023 THE DOMINION LAWSUIT

All the Texts Fox News Didn’t Want You to Read
By Nia Prater, Matt Stieb, And Benjamin Hart
A new court filing reveals messages from Rupert Murdoch saying the network went “too far” and Tucker Carlson saying he hates Trump “passionately.”
3/31/2023 EARLY AND OFTEN

Trump’s Indictment Could Ruin DeSantis’s 2024 Candidacy
By Ed Kilgore
If the indictments give Trump another polling surge, his GOP rivals will be forced into an impossible position. Will the governor rethink his plans?
3/31/2023 EXHIBIT A

Michael Cohen Is Already Undermining the Trump Prosecution
By Ankush Khardori
Immediately after the indictment, he says he didn’t really mean his guilty plea. Good luck on the witness stand.
3/31/2023 POSTING

The #Resistance Is Back and Super-Psyched About Trump’s Indictment
By Matt Stieb
After years out of the spotlight, the very online liberals who love to hate Trump are ready to celebrate.
3/31/2023 THE MONEY GAME

The Meltdown of a Gay Bank
By Jen Wieczner
What went wrong when an LGBTQ+ start-up set out to disrupt finance.
3/30/2023 EARLY AND OFTEN

How Trump’s Allies and GOP Rivals Are Reacting to His Indictment
By Benjamin Hart
“This is stuff that would make Mao, Stalin, Pol Pot blush.”
3/30/2023 EARLY AND OFTEN

Trump’s Indictment: The Immediate Political Fallout
By Ed Kilgore
The big question is whether this and other indictments alienate general-election voters enough to undermine Trump’s electability.
3/30/2023 THE NATIONAL INTEREST

The Strange Trials of Our First Criminal President
By Jonathan Chait
The awesome task of restoring faith in a legal system Trump has spent his life discrediting.
3/30/2023 TREMENDOUS CONTENT

Trump Still Plotting Not-So-Secret Attack on Mexico
By Margaret Hartmann
He’s still asking advisers to draw up “battle plans” to attack drug cartels with or without Mexico’s consent. But now he can’t feign ignorance.
3/30/2023 FLORIDA

Ron DeSantis Got Played by Disney
By Matt Stieb
The board in charge of the Florida park sabotaged his hostile takeover.
3/30/2023 EARLY AND OFTEN

Now It’s Republicans Who Are Divided on Iraq War Authorization
By Ed Kilgore
Senate Democrats split on the original Iraq War authorization while Republicans were united. Twenty years later, a repeal vote divided GOP senators.
3/30/2023 THE NATIONAL INTEREST

The Republican Debt-Ceiling Hostage Scheme Is Collapsing
By Jonathan Chait
Step one is to name a demand. The House can’t even do that!
3/30/2023 FOREIGN INTERESTS

Russia Detains Wall Street Journal Reporter, Alleging He Is a Spy
By Matt Stieb
Evan Gershkovich is the first foreign journalist to be detained there since the war in Ukraine began.
3/30/2023 THE NATIONAL INTEREST

How Trump Can Use Social Security and Medicare to Destroy DeSantis
By Jonathan Chait
Forget Ukraine. Retirement programs are the real killer.
3/30/2023 THE MEDIA

Millennials Aren’t Killing ‘Objective’ News — the Market Is
By Eric Levitz
The modern attention economy is an enemy of conscientious reporting and intellectual humility.
3/30/2023 RABBIT HOLES

There’s Something Off About LED Bulbs
By Tom Scocca
Have you started to notice, too?
3/30/2023 GAMES

The Year March Madness Went Too Mad
By Will Leitch
With a surfeit of Cinderella stories in the men’s tournament, look to the women’s Final Four for excitement.
3/29/2023 EARLY AND OFTEN

Voters Can’t Even Name Many Democratic Presidential Prospects
By Ed Kilgore
If Biden doesn’t run for a second term, Democrats are in big trouble: A poll found voters can identify only a handful of potential 2024 candidates.
3/29/2023 EARLY AND OFTEN

Possible Trump Indictment Pushed Back by a Month
By Nia Prater
The Manhattan grand jury’s planned break likely pushes any possible decision on an indictment of Donald Trump into late April.
3/29/2023 FTX FALLOUT

SBF’s Dad Is Paying for His Son’s Lawyers: Report
By Matt Stieb
As the legal bills pile up, Joseph Bankman is reportedly paying his son’s attorneys with money that SBF gave him from an Alameda account.
SIGN IN TO COMMENT
Like Us Follow Us
ABOUT INTELLIGENCER
ABOUT NEW YORK MAGAZINE
NEWSLETTERS
HELP
CONTACT
PRESS
MEDIA KIT
WE’RE HIRING
PRIVACY
TERMS
AD CHOICES
DO NOT SELL OR SHARE MY PERSONAL INFORMATION
ACCESSIBILITY
INTELLIGENCER IS A VOX MEDIA NETWORK.
© 2023 VOX MEDIA, LLC. ALL RIGHTS RESERVED.