---
id: ai-coding-assistants
title: 'AI Coding Assistants: Copilot, SWE-bench, and Agentic Tools'
schema_type: TechArticle
category: ai
language: en
confidence: medium
last_verified: '2026-05-28'
created_date: '2026-05-24'
generation_method: ai_assisted
derived_from_human_seed: true
conflict_of_interest: none_declared
is_live_document: false
data_period: static
atomic_facts:
  - id: fact-ai-ai-coding-assistants-1
    statement: >-
      A Microsoft Research controlled experiment reported that developers with access to GitHub
      Copilot completed an HTTP-server task 55.8% faster than the control group.
    source_title: 'The Impact of AI on Developer Productivity: Evidence from GitHub Copilot'
    source_url: >-
      https://www.microsoft.com/en-us/research/publication/the-impact-of-ai-on-developer-productivity-evidence-from-github-copilot/
    confidence: medium
  - id: fact-ai-ai-coding-assistants-2
    statement: >-
      SWE-bench is a benchmark for evaluating whether language models can resolve real-world GitHub
      issues.
    source_title: 'SWE-bench: Can Language Models Resolve Real-World GitHub Issues?'
    source_url: https://arxiv.org/abs/2310.06770
    confidence: medium
  - id: fact-ai-ai-coding-assistants-3
    statement: >-
      Claude Code documentation describes Claude Code as an AI-powered coding assistant for building
      features, fixing bugs, and automating development tasks across a codebase.
    source_title: Claude Code Overview
    source_url: https://code.claude.com/docs/en/overview
    confidence: medium
completeness: 0.82
known_gaps:
  - >-
    Specialized edge cases and platform-specific implementation details are outside this
    source-mapped public slice.
disputed_statements: []
primary_sources:
  - title: 'The Impact of AI on Developer Productivity: Evidence from GitHub Copilot'
    authors:
      - Sida Peng
      - Eirini Kalliamvakou
      - Peter Cihon
      - Mert Demirer
    type: research_page
    year: 2023
    url: >-
      https://www.microsoft.com/en-us/research/publication/the-impact-of-ai-on-developer-productivity-evidence-from-github-copilot/
    institution: Microsoft Research
  - title: 'SWE-bench: Can Language Models Resolve Real-World GitHub Issues?'
    authors:
      - Carlos E. Jimenez
      - John Yang
      - Alexander Wettig
      - Shunyu Yao
      - Kexin Pei
      - Ofir Press
      - Karthik Narasimhan
    type: academic_paper
    year: 2023
    url: https://arxiv.org/abs/2310.06770
    institution: arXiv
  - title: Claude Code Overview
    type: documentation
    year: 2026
    url: https://code.claude.com/docs/en/overview
    institution: Anthropic
secondary_sources: []
updated: '2026-05-28'
ai_models:
  - claude-opus
---

## TL;DR

AI coding assistants range from completion tools to agentic systems that modify codebases, while benchmarks and controlled studies measure practical software tasks.

## Core Explanation

The field can be read through three lenses: controlled productivity studies, benchmarks that test issue-resolution ability, and agentic tools that operate across a local codebase.

## Source-Mapped Facts

- A Microsoft Research controlled experiment reported that developers with access to GitHub Copilot completed an HTTP-server task 55.8% faster than the control group. ([source](https://www.microsoft.com/en-us/research/publication/the-impact-of-ai-on-developer-productivity-evidence-from-github-copilot/))
- SWE-bench is a benchmark for evaluating whether language models can resolve real-world GitHub issues. ([source](https://arxiv.org/abs/2310.06770))
- Claude Code documentation describes Claude Code as an AI-powered coding assistant for building features, fixing bugs, and automating development tasks across a codebase. ([source](https://code.claude.com/docs/en/overview))

## Further Reading

- [The Impact of AI on Developer Productivity: Evidence from GitHub Copilot](https://www.microsoft.com/en-us/research/publication/the-impact-of-ai-on-developer-productivity-evidence-from-github-copilot/)
- [SWE-bench: Can Language Models Resolve Real-World GitHub Issues?](https://arxiv.org/abs/2310.06770)
- [Claude Code Overview](https://code.claude.com/docs/en/overview)