How Engineering Teams at Fortune 1000 Companies Code with AI
What Google, Microsoft, JPMorgan, Uber, Airbnb and others report about AI coding, agents and measured impact, from 17 sources, and what to copy for your own team.
by Patrick Kamtchueng Kom · Published
Big companies don’t just “use Copilot” any more. They mandate tools, build their own, run agents that open thousands of pull requests a week, and report the results on earnings calls. They also run into the same trust, quality and measurement problems as everyone else, just at scale.
This report pulls together what large engineering organizations have said in public: engineering blogs, executive statements, and the big surveys. Every number below links to a source I read, listed at the bottom. Company figures are self-reported and rarely use the same definitions, so treat them as signals, not benchmarks.
Key findings
- Adoption is near universal; trust is not. DORA’s 2025 survey of nearly 5,000 technology professionals found 90% use AI at work, with a median of about two hours a day [2][3]. Stack Overflow found more developers distrust AI accuracy (46%) than trust it (33%) [1].
- The share of AI-written code is now an executive talking point. Satya Nadella put it at 20% to 30% of code in Microsoft’s repositories in April 2025 [6]. A year later, Sundar Pichai said 75% of new code at Google is AI-generated and approved by engineers, up from 50% the previous fall [5].
- The clearest wins are big, boring, well-tested jobs. Airbnb migrated about 3,500 test files in six weeks instead of an estimated 1.5 years [10]. Amazon reports over 4,500 developer-years saved on Java upgrades [11].
- Agents are in production, behind human review. Stripe says its in-house agents produce over 1,000 merged pull requests a week, each reviewed by a person [14]. Goldman Sachs is piloting an autonomous coding agent alongside its 12,000 developers, under human supervision [8].
- Speed and stability move together, not always in the right direction. DORA links higher AI adoption to both higher delivery throughput and higher instability [4].
🃏 Myth or reality? Flip each card
Tap a card to flip it
How adoption actually happens
Public accounts show three recurring patterns. They’re not exclusive; most large organizations run all three at once.
1. Buy and mandate. Coinbase gave every engineer enterprise licences for GitHub Copilot and Cursor, set a one-week deadline to onboard, and CEO Brian Armstrong says some of those who didn’t were let go. He also admits the approach was “heavy-handed” and followed up with monthly sessions where teams share how they use AI [9]. Heavy mandates buy speed of adoption, not skill.
2. Build in-house. JPMorgan built its own coding assistant; CIO Lori Beer said it lifted productivity by 10% to 20% for tens of thousands of engineers [7]. Morgan Stanley built DevGen.AI on OpenAI models because commercial tools handled its legacy languages poorly. It reviewed 9 million lines of legacy code and saved an estimated 280,000 hours by turning old code into plain-English specs that developers then rewrite [12].
3. Platform first, then agents. Stripe’s agents run on the same isolated “devboxes” humans use, with the same tests and rule files [14]. DORA’s data points the same way: 90% of organizations have at least one internal platform, and platform quality correlates with getting value from AI [3].
- 1
Weeks 1–4
Pilot with volunteers
One or two curious teams, enterprise licences, written data rules. Capture a baseline: cycle time, change failure rate, review load.
- 2
Months 2–3
Team rollout with enablement
Expand team by team. Pair each rollout with a demo session and a shared prompt or rules file. Coinbase's monthly show-and-tell is a cheap model [9].
- 3
Months 3–6
Target one boring, big job
Pick a migration or upgrade with clear pass/fail tests. This is where Airbnb, Amazon and Morgan Stanley saw their largest gains [10][11][12].
- 4
Months 6–9
Add review and agents behind gates
AI review as a second reviewer, agents in sandboxes, human approval on every merge [13][14].
- 5
Ongoing
Measure and tune
Track delivery stability next to throughput, plus acceptance and dismissal rates for AI comments [4][13].
AI-assisted development in practice
Four uses show up again and again. They differ a lot in how easy they are to verify.
🧭 What large teams actually did
8 shown · 0 / 8 done
Airbnb: test framework migration
[10]Migration
About 3,500 React test files moved from Enzyme to React Testing Library in six weeks versus an estimated 1.5 years by hand. 75% were done in the first four hours; 97% were automated in the end.
▸ Details
- Each file goes through a pipeline of validation steps: tests, lint, type checks.
- On failure, retry with the error and the latest file in the prompt.
- Give rich context: related tests, migration guidelines, common fixes.
- Tune on 5 to 10 sample files, then re-run the whole batch.
Amazon: Java upgrades at scale
[11]Migration
Amazon Q Developer upgraded tens of thousands of production apps from Java 8 or 11 to 17. Amazon estimates over 4,500 developer-years saved and $260 million in annual cost savings.
Morgan Stanley: legacy code to specs
[12]Migration · Build in-house
An in-house tool translated 9 million lines of legacy code into plain-English specs for 15,000 developers, saving an estimated 280,000 hours. It explains old code; humans still write the new one.
Uber: AI code review on every diff
[13]Code review
uReview analyzes over 90% of about 65,000 weekly diffs, in a median of 4 minutes. Engineers rate 75% of its comments useful and address 65% of them.
JPMorgan: in-house coding assistant
[7]Assistant · Build in-house
A coding assistant built by the bank lifted efficiency 10% to 20% for tens of thousands of engineers, according to its CIO.
Stripe: one-shot coding agents
[14]Agents
Engineers kick off agents from Slack, a CLI or internal tools. Over 1,000 agent-written PRs are merged each week after human review. Stripe is private, so not on the Fortune list, but its setup is the most detailed public example.
Goldman Sachs: supervised agent pilot
[8]Agents
Piloting Cognition's Devin alongside 12,000 developers. Tech chief Marco Argenti expects engineers to describe problems clearly and supervise the agents' work.
Accenture: Copilot randomized trial
[15]Assistant
In a 2024 trial with GitHub, developers with Copilot opened 8.69% more PRs, with a 15% higher merge rate and 84% more successful builds.
What the successful cases share: a crisp definition of done (tests pass, types check, the build is green), automatic retries with feedback, and a human at the gate. Airbnb’s post is the best public recipe: validation steps, retry loops and large context windows beat clever prompting [10].
Agents in production
“Agent” here means a system that takes a task, changes code across files, runs tests and proposes a pull request without step-by-step prompting. Adoption is real but narrow: in the Stack Overflow survey, about 14% of developers use agents daily at work [1].
- TaskFrom Slack, a ticket, or a flaky-test alert
- SandboxIsolated devbox, no production or internet access
- Local checksLint and targeted tests, fast
- Capped CIAt most two CI rounds, then hand back
- Human reviewA person approves every merge
The guardrails that recur across the public accounts:
- Isolation. Stripe’s agents run in devboxes cut off from production and the internet [14].
- Scoped context and tools. Rule files applied per subdirectory, and a curated set of internal tools exposed through MCP [14].
- Bounded effort. A hard cap on retries, so a stuck agent hands back instead of burning compute [14].
- Human approval. Every example here keeps a person on the merge button [5][8][14].
Measuring impact
This is where public claims are weakest. Company numbers use different definitions, and the best controlled research is humbling.
Two caveats keep this honest. METR itself says the result may not generalize beyond experienced developers in mature codebases they know well [16]. And in February 2026 METR changed its study design, after finding that many developers no longer wanted to work without AI and avoided submitting tasks where AI helps most, which biases results toward slowdown [17]. The durable lesson isn’t “AI makes you slower”. It’s that self-reported speedups are unreliable, and gut feel is not a metric.
What companies actually report, from weakest to strongest evidence:
| Metric | Example | Watch out for |
|---|---|---|
| Share of code written by AI | Microsoft 20–30% [6], Google 75% [5] | No shared definition; says nothing about value |
| Self-reported productivity | Over 80% of DORA respondents [2] | Perception gap [16] |
| Efficiency estimates | JPMorgan 10–20% [7] | Methodology rarely published |
| Time or cost saved on a scoped job | Airbnb [10], Amazon [11], Morgan Stanley [12] | Compared with an estimate, not a real control |
| Comment usefulness and adoption | Uber: 75% useful, 65% addressed [13] | Measures the tool, not the outcome |
| Controlled trial | Accenture [15], METR [16] | Small or specific populations |
🧠 Check your reading
Score: 0 / 5
1. Which pairing did DORA 2025 associate with higher AI adoption?
2. What did Airbnb's test migration take, versus the manual estimate?
3. In METR's 2025 trial, what did developers believe after using AI?
4. Which technique did Uber use to keep AI review from becoming noise?
5. What is the most common guardrail across public agent deployments?
What this means for your team
You’re probably not Google. You don’t need a 1,000-PR-a-week agent fleet. But the pattern behind the public successes transfers well to a team of 10 or 200: fix the foundations, aim AI at verifiable work, keep a human at the gate, and measure stability alongside speed. DORA calls AI an amplifier: it magnifies strong and weak practices alike [3].
Here’s where I’d push most teams, in order:
- Get tests and CI solid before scaling AI. Every big win above relied on an automatic definition of done. Without it, AI just produces more unverified code faster.
- Pick one migration. A framework upgrade, a deprecated API, a test-library switch. It’s where the ROI is clearest and the risk is contained.
- Mandate learning, not tools. Coinbase’s lesson is that the sharing sessions matter more than the deadline [9].
- Treat review load as the real bottleneck. If AI doubles PR volume and reviewers stay the same, you’ve moved the queue, not removed it [4].
- Protect junior learning. DORA warns that AI can skip the productive struggle that builds expertise, and recommends active mentoring [4].
📊 How does your team compare?
1. Most of our developers use an AI assistant weekly, with licences and written data rules.
Not yetFully true2. Our test suite and CI give a reliable pass or fail within minutes.
Not yetFully true3. We have used AI for at least one scoped migration or upgrade with clear success criteria.
Not yetFully true4. AI review or agents run behind a human approval gate, in sandboxed environments.
Not yetFully true5. We track stability (change failure rate, rollbacks) alongside throughput since adopting AI.
Not yetFully true6. We run regular sessions where people share AI workflows and what failed.
Not yetFully true
✅ Your next 30 days
0 / 6 completed
Sources
- Stack Overflow 2025 Developer Survey: AI
- How are developers using AI? Inside Google's 2025 DORA report (Google Blog)
- Announcing the 2025 DORA Report (Google Cloud Blog)
- Balancing AI tensions: Moving from AI adoption to effective SDLC use (DORA)
- Sundar Pichai shares news from Google Cloud Next 2026 (Google Blog)
- Microsoft CEO says up to 30% of the company's code was written by AI (TechCrunch)
- JPMorgan engineers' efficiency jumps as much as 20% from using coding assistant (Reuters via Yahoo Finance)
- Meet Devin the AI Software Engineer, Employee #1 in Goldman Sachs' Hybrid Workforce (IBM Think)
- Coinbase CEO explains why he fired engineers who didn't try AI immediately (TechCrunch)
- Accelerating Large-Scale Test Migration with LLMs (Airbnb Engineering)
- Amazon Q Developer just reached a $260 million dollar milestone (AWS DevOps Blog)
- Morgan Stanley created an AI tool to fix the most annoying part of coding (Entrepreneur)
- uReview: Scalable, Trustworthy GenAI for Code Review at Uber (Uber Blog)
- Minions: Stripe's one-shot, end-to-end coding agents (Stripe Dev Blog)
- Research: Quantifying GitHub Copilot's impact in the enterprise with Accenture (GitHub Blog)
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (METR)
- We are Changing our Developer Productivity Experiment Design (METR)