How AI-native is your technical organization?

By Tim Vasil • September 2026Updated Sep 19 with bottlenecks and codebase readiness

Designed to replace hype and FOMO with empirical rigor, this calculator provides technical leaders with a holistic framework for estimating GenAI-enabled productivity gains across the PDLC.

The interactive profile needs JavaScript. In short: at every stage humans keep intent, judgment, and the consequential gates, and agents take the volume work as far as it can be verified.

Platform construct	Provided centrally
Models & interfaces	Approved models; chat, IDE, and API access; model routing where it pays; enterprise data and privacy controls
Coding & agent runtime	Interactive coding agents plus asynchronous cloud agents that can run code and tests and open pull requests
Context layer	Source, architecture, product docs, tickets, APIs, runbooks, and internal knowledge reachable by agents through repo context, MCP, and other controlled connectors
Instructions & skills	Version-controlled `AGENTS.md`, coding standards, architectural rules, reusable agent skills, and shared prompts and workflows
Execution environments	Sandboxed development environments; reproducible builds; scoped network and tool access; ephemeral credentials
Verification & evals	CI, automated tests, type and lint checks, security scanning, agent evals, acceptance criteria, and regression suites
Identity & permissions	Least-privilege agent identities; explicit tool permissions; protected environments; human approval for consequential actions
Observability & governance	Agent and action logs, traceability to a human owner, usage and cost visibility, quality metrics, and auditability
Orchestration defaults	The simplest thing that works: predictable workflows first, agents where adaptive decisions pay, and several agents only when the work genuinely separates, since parallelism buys speed at a real cost in tokens and coordination
Memory & feedback loops	Decisions, post-mortems, and review outcomes written back into the context layer, so agents and new hires inherit what the team learned

Sources

The strongest theme across firsthand accounts from SaaS operators and AI engineering teams: automate execution aggressively, while humans own intent, boundaries, and evidence of success. The disagreement is over how much implementation and review can already be delegated. Highlights mark each source’s key take-away, and the last column records what it actually measured, or what to do about it where it measured nothing.

Source	What it says	Impact / Implications
AnthropicAgent evaluationsDemystifying evals, Jan 2026	Evaluate actual outcomes and state changes. Automated checks, production monitoring, and human assessment catch different failures.	Give teams ownership of representative evals and continuously improve them from failures.
AnthropicInternal engineering studyHow AI is transforming work, 2025	Engineers report broader output and capability, while most still fully delegate only a minority of their work.	+50% self-reported productivity, ≈1.5×, averaged across surveyed engineers and researchers. Internal survey; not experimentally established.
AnthropicOrchestrationEffective agents, Dec 2024 Multi-agent research, Jun 2025	Use simple workflows where possible; parallel agents help when work genuinely separates, with additional cost and coordination.	Up to 90% less research time, from parallelizing previously sequential agent execution on complex queries. Not versus human-only work.
Anthropic & OpenAIOversight and permissionsAutonomy research, Feb 2026 Agent guide, 2025	Effective oversight combines visibility, intervention, bounded permissions, and escalation for failures or consequential actions.	Grant authority per workflow and risk level; make agents inspectable and interruptible.
Cui et al.Three developer field experimentsResearch paper, 2025	Randomized access to a coding assistant across 4,867 developers increased completed tasks; gains varied across developers.	+26.08% completed tasks, ≈1.26× throughput; standard error 10.3 percentage points. Coding assistance, not an AI-native organization.
Demirer, Musolff & YangWriting versus shippingWorking paper, 2026	Across successive tool generations, coding gains attenuate substantially before release. The study uses GitHub activity and AI telemetry.	+240% commits, ≈3.4×, cumulative adoption through autonomous agents. +30% releases, ≈1.3×: the same adoption, measured at what ships. Observational estimates, not randomized results or team-wide speed measurements.
DetailAgent-ready codebasesSelf-driving codebases, Sep 2026	The limiting factor for coding agents is the environment they work in, not the model. Where agents cannot exercise integrations end to end, drive the frontend, see the shape of the data, or reproduce a race, they ship bugs there.	Track where agents are blind, and close those gaps in the development environment rather than waiting for better models.
DORAROI of AI-assisted software developmentFramework and calculator, 2026	A framework for evaluating AI investment, including the initial productivity dip and the economics of adoption.	Use its framework and companion calculator to structure costs, benefits, and assumptions.
DORAOrganizational conditions2025 report	AI amplifies existing organizational strengths and weaknesses. Platforms, workflows, and team alignment influence outcomes.	Use readiness and delivery constraints to qualify the calculator’s estimates.
GitClearCode quality and productivity researchCode-quality report, 2025 Productivity research, 2026	Churn, duplication, and moved-code trends are maintainability signals. They do not establish that AI caused deterioration or directly measure software shipped. The 2026 study separately examines AI-use cohorts.	4–10× output differences between usage cohorts in the 2026 study, which explicitly questions how much reflects who adopts AI.
JellyfishState of engineering managementSurvey of 636 leaders and practitioners, 2026	Only 10% reported strong enablement and high adoption. AI use varied substantially by activity: writing code 53%, review 49%, specifications 24%.	Adoption rates, not a speedup: 10% with strong enablement and high adoption.
Justin McCarthyStrongDMSoftware factory, Feb 2026	Specifications and independently held scenarios drive implementation without human code review. Simulated services enable extensive validation.	Explore autonomous delivery where independent validation is strong enough to support it.
Kief MorrisThoughtworksHumans and agents, 2026	Humans build and manage the delivery loop, defining outcomes and improving how agents produce software.	Move engineering effort toward architecture, verification, and intervention where judgment matters.
METRTechnical-worker surveySurvey, May 2026	Technical workers report substantial gains, but perceived speed and value differ, and estimates may be overstated.	Median 3× self-reported speed. 1.4–2× self-reported value, depending on the question. Convenience sample of 349 technical workers; not causal evidence.
METRExperimental productivity evidenceStudy, Jul 2025 2026 update	Early-2025 tools slowed experienced developers on familiar repositories. Later measurement became compromised by selection effects and concurrent agent work.	19% longer task completion in early 2025, ≈0.84× speed.
OpenAI engineeringHarness engineeringAccount, Feb 2026	One team built a new product with agent-written code and predominantly agent-based review. Humans supplied intent and the execution environment.	≈10× development speed; ≈90% less time. The team’s estimate against writing the code manually; one greenfield product, not a controlled comparison.
Tobi Lütke & Farhan ThawarShopifyInterview, 2025	AI adoption needs organizational support: broad access, shared integrations, reusable workflows, and leadership participation.	Provide common infrastructure while enabling teams to develop their own applications.