Skip to content
PKResources
Reports

How Engineering Teams at Fortune 1000 Companies Code with AI

What Google, Microsoft, JPMorgan, Uber, Airbnb and others report about AI coding, agents and measured impact, from 17 sources, and what to copy for your own team.

by Patrick Kamtchueng Kom · Published

Big companies don’t just “use Copilot” any more. They mandate tools, build their own, run agents that open thousands of pull requests a week, and report the results on earnings calls. They also run into the same trust, quality and measurement problems as everyone else, just at scale.

This report pulls together what large engineering organizations have said in public: engineering blogs, executive statements, and the big surveys. Every number below links to a source I read, listed at the bottom. Company figures are self-reported and rarely use the same definitions, so treat them as signals, not benchmarks.

Key findings

Use AI at work [2]Use or plan to use AI tools [1]Say AI increased their productivity [2]See a positive effect on code quality [2]Pro developers using AI daily [1]Distrust the accuracy of AI output [1]Little or no trust in AI code [2]Use AI agents daily at work [1]90%84%80%+59%51%46%30%14%0%50%100%
Survey snapshot, 2025. Blue bars: adoption and sentiment. Grey bars: trust and agent use. Sources: DORA 2025 [2], Stack Overflow 2025 [1].
  • Adoption is near universal; trust is not. DORA’s 2025 survey of nearly 5,000 technology professionals found 90% use AI at work, with a median of about two hours a day [2][3]. Stack Overflow found more developers distrust AI accuracy (46%) than trust it (33%) [1].
  • The share of AI-written code is now an executive talking point. Satya Nadella put it at 20% to 30% of code in Microsoft’s repositories in April 2025 [6]. A year later, Sundar Pichai said 75% of new code at Google is AI-generated and approved by engineers, up from 50% the previous fall [5].
  • The clearest wins are big, boring, well-tested jobs. Airbnb migrated about 3,500 test files in six weeks instead of an estimated 1.5 years [10]. Amazon reports over 4,500 developer-years saved on Java upgrades [11].
  • Agents are in production, behind human review. Stripe says its in-house agents produce over 1,000 merged pull requests a week, each reviewed by a person [14]. Goldman Sachs is piloting an autonomous coding agent alongside its 12,000 developers, under human supervision [8].
  • Speed and stability move together, not always in the right direction. DORA links higher AI adoption to both higher delivery throughput and higher instability [4].

🃏 Myth or reality? Flip each card

Tap a card to flip it

How adoption actually happens

Public accounts show three recurring patterns. They’re not exclusive; most large organizations run all three at once.

1. Buy and mandate. Coinbase gave every engineer enterprise licences for GitHub Copilot and Cursor, set a one-week deadline to onboard, and CEO Brian Armstrong says some of those who didn’t were let go. He also admits the approach was “heavy-handed” and followed up with monthly sessions where teams share how they use AI [9]. Heavy mandates buy speed of adoption, not skill.

2. Build in-house. JPMorgan built its own coding assistant; CIO Lori Beer said it lifted productivity by 10% to 20% for tens of thousands of engineers [7]. Morgan Stanley built DevGen.AI on OpenAI models because commercial tools handled its legacy languages poorly. It reviewed 9 million lines of legacy code and saved an estimated 280,000 hours by turning old code into plain-English specs that developers then rewrite [12].

3. Platform first, then agents. Stripe’s agents run on the same isolated “devboxes” humans use, with the same tests and rule files [14]. DORA’s data points the same way: 90% of organizations have at least one internal platform, and platform quality correlates with getting value from AI [3].

  1. 1

    Weeks 1–4

    Pilot with volunteers

    One or two curious teams, enterprise licences, written data rules. Capture a baseline: cycle time, change failure rate, review load.

  2. 2

    Months 2–3

    Team rollout with enablement

    Expand team by team. Pair each rollout with a demo session and a shared prompt or rules file. Coinbase's monthly show-and-tell is a cheap model [9].

  3. 3

    Months 3–6

    Target one boring, big job

    Pick a migration or upgrade with clear pass/fail tests. This is where Airbnb, Amazon and Morgan Stanley saw their largest gains [10][11][12].

  4. 4

    Months 6–9

    Add review and agents behind gates

    AI review as a second reviewer, agents in sandboxes, human approval on every merge [13][14].

  5. 5

    Ongoing

    Measure and tune

    Track delivery stability next to throughput, plus acceptance and dismissal rates for AI comments [4][13].

AI-assisted development in practice

Four uses show up again and again. They differ a lot in how easy they are to verify.

🧭 What large teams actually did

8 shown · 0 / 8 done

  • Airbnb: test framework migration

    [10]Migration

    About 3,500 React test files moved from Enzyme to React Testing Library in six weeks versus an estimated 1.5 years by hand. 75% were done in the first four hours; 97% were automated in the end.

    ▸ Details
    1. Each file goes through a pipeline of validation steps: tests, lint, type checks.
    2. On failure, retry with the error and the latest file in the prompt.
    3. Give rich context: related tests, migration guidelines, common fixes.
    4. Tune on 5 to 10 sample files, then re-run the whole batch.
  • Amazon: Java upgrades at scale

    [11]Migration

    Amazon Q Developer upgraded tens of thousands of production apps from Java 8 or 11 to 17. Amazon estimates over 4,500 developer-years saved and $260 million in annual cost savings.

  • Morgan Stanley: legacy code to specs

    [12]Migration · Build in-house

    An in-house tool translated 9 million lines of legacy code into plain-English specs for 15,000 developers, saving an estimated 280,000 hours. It explains old code; humans still write the new one.

  • Uber: AI code review on every diff

    [13]Code review

    uReview analyzes over 90% of about 65,000 weekly diffs, in a median of 4 minutes. Engineers rate 75% of its comments useful and address 65% of them.

  • JPMorgan: in-house coding assistant

    [7]Assistant · Build in-house

    A coding assistant built by the bank lifted efficiency 10% to 20% for tens of thousands of engineers, according to its CIO.

  • Stripe: one-shot coding agents

    [14]Agents

    Engineers kick off agents from Slack, a CLI or internal tools. Over 1,000 agent-written PRs are merged each week after human review. Stripe is private, so not on the Fortune list, but its setup is the most detailed public example.

  • Goldman Sachs: supervised agent pilot

    [8]Agents

    Piloting Cognition's Devin alongside 12,000 developers. Tech chief Marco Argenti expects engineers to describe problems clearly and supervise the agents' work.

  • Accenture: Copilot randomized trial

    [15]Assistant

    In a 2024 trial with GitHub, developers with Copilot opened 8.69% more PRs, with a 15% higher merge rate and 84% more successful builds.

What the successful cases share: a crisp definition of done (tests pass, types check, the build is green), automatic retries with feedback, and a human at the gate. Airbnb’s post is the best public recipe: validation steps, retry loops and large context windows beat clever prompting [10].

Agents in production

“Agent” here means a system that takes a task, changes code across files, runs tests and proposes a pull request without step-by-step prompting. Adoption is real but narrow: in the Stack Overflow survey, about 14% of developers use agents daily at work [1].

  1. TaskFrom Slack, a ticket, or a flaky-test alert
  2. SandboxIsolated devbox, no production or internet access
  3. Local checksLint and targeted tests, fast
  4. Capped CIAt most two CI rounds, then hand back
  5. Human reviewA person approves every merge
The guardrail pattern in Stripe's public write-up [14]. Goldman describes the same principle: humans supervise the agent's work [8].

The guardrails that recur across the public accounts:

  • Isolation. Stripe’s agents run in devboxes cut off from production and the internet [14].
  • Scoped context and tools. Rule files applied per subdirectory, and a curated set of internal tools exposed through MCP [14].
  • Bounded effort. A hard cap on retries, so a stuck agent hands back instead of burning compute [14].
  • Human approval. Every example here keeps a person on the merge button [5][8][14].

Measuring impact

This is where public claims are weakest. Company numbers use different definitions, and the best controlled research is humbling.

24% faster20% faster19% slowerForecast before the studyBelief after the studyMeasured with AIslowerno changefaster
The perception gap. In METR's 2025 randomized trial, 16 experienced open-source developers worked on 246 real tasks with and without AI [16].

Two caveats keep this honest. METR itself says the result may not generalize beyond experienced developers in mature codebases they know well [16]. And in February 2026 METR changed its study design, after finding that many developers no longer wanted to work without AI and avoided submitting tasks where AI helps most, which biases results toward slowdown [17]. The durable lesson isn’t “AI makes you slower”. It’s that self-reported speedups are unreliable, and gut feel is not a metric.

What companies actually report, from weakest to strongest evidence:

Metric Example Watch out for
Share of code written by AI Microsoft 20–30% [6], Google 75% [5] No shared definition; says nothing about value
Self-reported productivity Over 80% of DORA respondents [2] Perception gap [16]
Efficiency estimates JPMorgan 10–20% [7] Methodology rarely published
Time or cost saved on a scoped job Airbnb [10], Amazon [11], Morgan Stanley [12] Compared with an estimate, not a real control
Comment usefulness and adoption Uber: 75% useful, 65% addressed [13] Measures the tool, not the outcome
Controlled trial Accenture [15], METR [16] Small or specific populations

🧠 Check your reading

Score: 0 / 5

  1. 1. Which pairing did DORA 2025 associate with higher AI adoption?

  2. 2. What did Airbnb's test migration take, versus the manual estimate?

  3. 3. In METR's 2025 trial, what did developers believe after using AI?

  4. 4. Which technique did Uber use to keep AI review from becoming noise?

  5. 5. What is the most common guardrail across public agent deployments?

What this means for your team

You’re probably not Google. You don’t need a 1,000-PR-a-week agent fleet. But the pattern behind the public successes transfers well to a team of 10 or 200: fix the foundations, aim AI at verifiable work, keep a human at the gate, and measure stability alongside speed. DORA calls AI an amplifier: it magnifies strong and weak practices alike [3].

Here’s where I’d push most teams, in order:

  1. Get tests and CI solid before scaling AI. Every big win above relied on an automatic definition of done. Without it, AI just produces more unverified code faster.
  2. Pick one migration. A framework upgrade, a deprecated API, a test-library switch. It’s where the ROI is clearest and the risk is contained.
  3. Mandate learning, not tools. Coinbase’s lesson is that the sharing sessions matter more than the deadline [9].
  4. Treat review load as the real bottleneck. If AI doubles PR volume and reviewers stay the same, you’ve moved the queue, not removed it [4].
  5. Protect junior learning. DORA warns that AI can skip the productive struggle that builds expertise, and recommends active mentoring [4].

📊 How does your team compare?

  1. 1. Most of our developers use an AI assistant weekly, with licences and written data rules.

  2. 2. Our test suite and CI give a reliable pass or fail within minutes.

  3. 3. We have used AI for at least one scoped migration or upgrade with clear success criteria.

  4. 4. AI review or agents run behind a human approval gate, in sandboxed environments.

  5. 5. We track stability (change failure rate, rollbacks) alongside throughput since adopting AI.

  6. 6. We run regular sessions where people share AI workflows and what failed.

Answer every question to see your result

✅ Your next 30 days

0 / 6 completed

Sources

  1. Stack Overflow 2025 Developer Survey: AI
  2. How are developers using AI? Inside Google's 2025 DORA report (Google Blog)
  3. Announcing the 2025 DORA Report (Google Cloud Blog)
  4. Balancing AI tensions: Moving from AI adoption to effective SDLC use (DORA)
  5. Sundar Pichai shares news from Google Cloud Next 2026 (Google Blog)
  6. Microsoft CEO says up to 30% of the company's code was written by AI (TechCrunch)
  7. JPMorgan engineers' efficiency jumps as much as 20% from using coding assistant (Reuters via Yahoo Finance)
  8. Meet Devin the AI Software Engineer, Employee #1 in Goldman Sachs' Hybrid Workforce (IBM Think)
  9. Coinbase CEO explains why he fired engineers who didn't try AI immediately (TechCrunch)
  10. Accelerating Large-Scale Test Migration with LLMs (Airbnb Engineering)
  11. Amazon Q Developer just reached a $260 million dollar milestone (AWS DevOps Blog)
  12. Morgan Stanley created an AI tool to fix the most annoying part of coding (Entrepreneur)
  13. uReview: Scalable, Trustworthy GenAI for Code Review at Uber (Uber Blog)
  14. Minions: Stripe's one-shot, end-to-end coding agents (Stripe Dev Blog)
  15. Research: Quantifying GitHub Copilot's impact in the enterprise with Accenture (GitHub Blog)
  16. Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity (METR)
  17. We are Changing our Developer Productivity Experiment Design (METR)