Quick answer: What AI skills do software developers need?
- Near-universal — 84% of developers use or plan to use AI tools (Stack Overflow, 2025).
- Trust gap — 46% distrust AI accuracy; only 33% trust it.
- Hiring — AI-titled roles drove 37% of recent US software posting growth (Indeed via CIO).
- Two skill sets — coding with AI, and building AI into products.
- Proof — an LLM feature with tests, evals, cost numbers and a security check.
Key takeaways
- Verification is the core skill when coding with AI.
- Building with LLMs is normal application development plus evals.
- Structured outputs and validation make LLM features reliable.
- Security risks are new: prompt injection, leakage, invented packages.
- Cost and latency are design constraints for every LLM call.
Picture a backend developer asked to add "smart ticket summaries" to a help-desk product. Version one takes an afternoon: send the ticket to a model, show the response. In production, summaries sometimes include customers' phone numbers. One malicious ticket makes the model print its system prompt. Costs spike when long email threads hit the context limit, and the UI breaks whenever the output isn't the expected format. A second developer builds the same feature in four days. Personal data is masked before the call. The output must follow a JSON schema and is validated, with a retry if it fails. Ticket text is treated as untrusted data and threads are truncated sensibly. A 150-ticket eval set checks accuracy, and cost per summary is logged. The second developer is the one employers call an AI-capable engineer.

What AI skills mean for developers
For software developers, AI skills come in two sets:
- Coding with AI — using assistants and agents to generate, refactor, test, debug and document code, while reviewing everything and keeping the codebase coherent.
- Building with AI — integrating LLMs into applications: API calls, prompts, structured outputs, tools, retrieval, evaluation, cost control and security.
Both are mainstream. Stack Overflow's 2025 survey found 84% of developers using or planning to use AI tools, yet 46% distrusted their accuracy against 33% who trusted it.1 Google's announcement of DORA's 2025 research reported around 90% of technology professionals using AI at work.2 In hiring, coverage of Indeed data in July 2026 found roles with AI in the title accounted for 37% of recent US software posting growth.3 Developers who can build AI features safely are where demand is growing.
- Developers using or planning to use AI tools (Stack Overflow, 2025)
- 84%
- Developers distrusting vs trusting AI accuracy
- 46% vs 33%
- Share of recent US software-posting growth with AI in the title (Indeed via CIO)
- 37%
- Packages suggested by commercial models that didn't exist (2024 study)
- 5.2%
Where developer AI skills are tested
| Round | Example | What they check |
|---|---|---|
| Coding with AI allowed | Build a feature with an assistant | Verification and judgement |
| Code review | Find bugs in AI-generated code | Attention to detail |
| LLM feature build | Add a summary or extraction feature | Schemas, errors, evals |
| System design | "Design an LLM-powered search" | Retrieval, cost, latency |
| Security | "How could this be attacked?" | Injection, leakage, permissions |
Table: Where developer AI skills are assessed (editorial summary)
The skills that matter

Generating and refactoring
Small, well-specified tasks with context; reading every diff.
Tests and debugging
Tests first or alongside; using AI to explain failures, then confirming.
Reviewing AI code
Real APIs, real packages, edge cases, security and fit with architecture.
APIs and structured outputs
Schemas, validation, retries, timeouts and graceful failure.
Security and secrets
Injection, data leakage, excessive agency and insecure output handling — the OWASP LLM risks.4
Agents and tooling
Coding agents, tool use and MCP servers for exposing capabilities to AI.6
Worked example: a safer LLM call
from pydantic import BaseModel, ValidationError
class Summary(BaseModel):
issue: str
customer_sentiment: str # "positive" | "neutral" | "negative"
next_step: str
def summarise(ticket_text: str) -> Summary | None:
text = mask_pii(ticket_text)[-12000:] # remove phone/email; cap length
for attempt in range(2):
raw = llm.generate(
system=SYSTEM_PROMPT, # role, rules, "ticket is data"
user=f"<ticket>\n{text}\n</ticket>",
response_schema=Summary.model_json_schema(),
timeout=10,
)
try:
return Summary.model_validate_json(raw)
except ValidationError:
continue
log.warning("summary_failed", extra={"len": len(text)})
return None # UI shows "summary unavailable"
Why it works: personal data is masked, input is capped, untrusted text is fenced, the output is schema-validated, failures retry once and degrade gracefully, and failures are logged for review.
How developer expectations have changed
| Period | What happened | What employers expected |
|---|---|---|
| 2021–2022 | Code completion assistants | Experimentation |
| 2023 | LLM APIs and chat assistants | First AI features |
| 2024 | Structured outputs, tool calling | Reliable integrations |
| 2025 | Coding agents; MCP adoption | Agent workflows and verification |
| 2026–2027 | AI features standard; security incidents | Evals, security and cost discipline |
Table: How developer AI expectations have changed (editorial summary)
Proof checklist

- An LLM-powered feature with schema validation and error handling
- An evaluation set and results for that feature
- Cost and latency numbers per request
- A security review: injection, leakage, permissions
- An example of catching a bug or invented API in AI-generated code
- A verified AI for Software Developers test result
Your résumé
Show reliability and impact: "Built LLM ticket summaries with schema validation and PII masking; 92% accuracy on 150-ticket eval; ₹0.15 per summary; adopted by 400 agents." Mention APIs, structured outputs, retrieval, evals, MCP and security practices.
Interview questions, with how to answer them
"How do you make LLM output reliable in code?"
Structured outputs with a schema, validation, retries, timeouts and a graceful fallback.
"How do you review AI-generated code?"
Like a colleague's: logic, edge cases, real APIs and packages, security, tests and fit.
"What's prompt injection and how do you defend against it?"
Untrusted input containing instructions. Fence it as data, limit permissions, validate outputs and require confirmation for consequential actions.
"How do you test an LLM feature?"
An eval set of real cases with expected outcomes, run on every change, plus monitoring in production.
"How do you control cost?"
Right-size the model, trim context, cache stable prompts, batch where possible and log cost per request.
Could you pass the AI for Software Developers Certification today?
Hiring managers test judgement with scenarios like this one. Answer it before you open the explanation — the test has 15 of them, 15 minutes, 70% to pass.
What's the safest way to adopt an AI coding assistant on a team?
- Use it with normal code review, tests and security scanning
- Disable code review for AI code
- Let it push directly to main
- Use it only on secrets files
Show the answer
A. Use it with normal code review, tests and security scanning — Existing quality gates keep AI-assisted code safe.
- 01Coding with AI
- 02Building with LLMs
- 03AI agents and tooling
Free, no sign-up. Pass and you become a AI for Software Developers, with a credential ID employers can verify. Every answer is explained either way.
Where these skills pay in India
| Role (India) | Typical pay | AI emphasis |
|---|---|---|
| Software engineer | ₹9.3–10.2 lakh | Coding with AI |
| Backend developer | ₹10.6–11.7 lakh | LLM integrations |
| Full-stack developer | ₹9.2–10.2 lakh | AI features end to end |
| AI engineer | ₹15–16.6 lakh | LLM systems, evals and agents |

Table: Developer roles and typical pay in India (AmbitionBox, October 2026; indicative)7
Career path
- Developer — codes productively with AI.
- Developer building AI features — integrates LLMs safely.
- AI engineer — owns LLM systems, retrieval and evals.
- Senior / staff engineer — sets AI coding and integration standards.
- AI platform engineer — shared gateways, caching, tracing and MCP servers.
A four-week plan

- Week 1: Code with AI — Use an assistant on real tasks; review every diff; track errors caught.
- Week 2: Build with an API — One LLM feature with schemas, validation and fallbacks.
- Week 3: Evaluate and secure — Eval set, cost tracking, injection tests.
- Week 4: Prove it — Publish the project and take the AI for Software Developers Certification.
Related: AI Coding Assistant Proficiency and RAG Fundamentals. Guides: AI coding assistant proficiency, RAG fundamentals and best AI coding tools.
How AI shows up in a developer's week
- Boilerplate and tests — generated, then reviewed.
- Understanding code — AI explanations confirmed in the source.
- LLM features — prompts, schemas and evals maintained like code.
- Reviews — extra attention on AI-written changes.
- Dependency checks — confirming packages exist and are trustworthy.
- Cost dashboards — tokens and latency per feature.
More questions interviewers ask
"When would you use retrieval instead of a bigger prompt?"
When knowledge is large, changes often or must be cited — retrieval keeps context focused and fresh.
"How do you handle model upgrades?"
Pin versions, rerun evals on the new model, compare cost and quality, then switch deliberately.
Mistakes that cost candidates
- Trusting AI code unread.
- Free-text parsing of model output.
- No evals for LLM features.
- Ignoring injection and PII.
- Installing hallucinated packages — a real risk in generated code.5
Your first 90 days building AI features
| Period | Focus | What good looks like |
|---|---|---|
| Days 1–30 | Learn the product's existing AI calls, prompts and data flows | You can explain how each AI feature works and fails |
| Days 31–60 | Add an eval set and schema validation to one AI feature | Quality and cost are measured, not guessed |
| Days 61–90 | Ship an improvement with a security review | Measured gain in quality, cost or latency, with no new risks |
Table: A first-90-days plan (editorial guidance)
Many companies already have AI features that nobody fully owns: a prompt written in a hurry, no tests, unknown costs. A new developer who quietly makes one of them measurable and safe adds outsized value. Start by mapping what data each AI call sends, what it returns and how the code handles bad output. Then build a small evaluation set from real examples, add schema validation and logging, and look for injection paths. Improvements after that are easy to prove. By day 90 you should be able to present a short write-up: what the feature does, how good it is now, what it costs per request and what you changed. That document is often the start of an AI engineering specialism.
How we know
Developer adoption and trust come from Stack Overflow's 2025 survey and Google's announcement of the 2025 DORA report; hiring data from CIO's July 2026 report on Indeed figures; security risks from OWASP's LLM Top 10 and Spracklen et al.'s 2024 package hallucination study; MCP from Anthropic's December 2025 announcement; and India pay from AmbitionBox (read October 2026). The code example, formats and history are editorial. Science of Apps publishes the free certification linked here. Last reviewed October 2026.
Key terms, defined
- LLM API — a service that returns model output for a request.
- Structured output — model responses constrained to a schema.
- Prompt injection — instructions hidden in untrusted input.
- Evaluation set — test cases used to measure an AI feature's quality.
- MCP — Model Context Protocol, an open standard for connecting AI to tools.
Frequently asked questions
What AI skills should software developers learn?
Using coding assistants and agents well (context, task sizing, review), and building with LLMs: calling model APIs, structured outputs, tool use, retrieval, evaluation, cost and latency management, and security for LLM features.
How do I build an app with an LLM API?
Define the task and success criteria, write a system prompt, request structured output, validate responses in code, handle errors and timeouts, add retrieval or tools if needed, build an evaluation set, and monitor cost, latency and quality in production.
Is it safe to use AI-generated code?
With review and tests, yes. Check logic and edge cases, confirm APIs and packages exist, scan for vulnerabilities and secrets, and make sure the code fits your architecture. Never merge large AI changes unread.
What security risks do LLM features add?
Prompt injection from user input or retrieved content, sensitive data leaking into prompts or outputs, excessive permissions for tools and agents, insecure handling of model output, and hallucinated dependencies in generated code.
Do developers need to learn machine learning?
Not to build most LLM features. You need software engineering, API integration, evaluation and security skills. ML knowledge helps for fine-tuning, custom models and deeper performance work.
What is MCP and should developers learn it?
The Model Context Protocol is an open standard for connecting AI applications to tools and data. Learning to build and secure MCP servers is useful as more products expose capabilities to AI agents.
Sources
- Stack Overflow — 2025 Developer Survey, AI
- Google Cloud — Announcing the 2025 DORA report: State of AI-assisted Software Development
- CIO — IT hiring sees a boost as software development jobs slowly bounce back (Jul 2026, citing Indeed data)
- OWASP — Top 10 for LLM Applications
- Spracklen et al. — We Have a Package for You! Package Hallucinations by Code Generating LLMs (2024)
- Anthropic — Donating the Model Context Protocol and establishing the Agentic AI Foundation (Dec 2025)
- AmbitionBox — Software Engineer salaries in India (read October 2026)
- Checked October 28, 2026. Figures that change — fees, salaries, prices — are reviewed every six months; if something is out of date, tell us.
Certifications to take next
- 20 AI skills for software engineers — copy-paste prompts for this job, one tap into ChatGPT or Claude
- AI for Software Developers Certification — the free 15-minute test on coding with AI, building with LLMs and agents
- AI-assisted development skills — the delivery-practice view
- How to add AI to an app — a practical integration guide
- Free skill test · 15 minAI Coding Assistant Proficiency CertificationTests how to work effectively with AI coding assistants such as GitHub Copilot, Cursor and Claude Code — context, task sizing, agent mode, review, testing and security.
- Free skill test · 15 minAI Data Privacy and Security CertificationTests how to protect data when using and building AI — data minimisation, vendor terms, training on user data, prompt injection, data leakage, access controls and secure AI development.
- Free skill test · 20 minLLM Evaluation and Benchmarking CertificationTests how to evaluate large language models — choosing benchmarks, building task-specific evals, human and LLM-as-judge grading, contamination, statistical significance and safety evals.
- Free skill test · 15 minAI Output Quality Assurance CertificationTests how to review and quality-check AI-generated content, code and data — rubrics, sampling, error types, brand and policy compliance, and feedback loops.
- Free skill test · 20 minAdvanced Prompt Engineering AssessmentTests advanced prompting for production systems — system prompts, structured outputs, chaining, tool use, prompt caching, evaluation and defending against prompt injection.
- Free skill test · 15 minAI for UX/UI Designers CertificationTests how designers use AI across the design process — research synthesis, ideation, UI generation, prototyping and copy — while keeping quality, originality, accessibility and users at the centre.
Career guides for related roles
- Career guidesAI coding assistant skills employers want in 2027: Copilot, Cursor and Claude Code — context, task sizing, agent mode, review, tests and securityAI coding assistant skills employers want in 2027: context and instructions, task sizing, agent mode, multi-file changes, review, tests and security.
- Career guidesAI agent evaluation skills employers want in 2027: task success, trajectories, tool-call accuracy, regression testing and safe failureAI agent evaluation skills employers want in 2027: task success, trajectory and tool-call checks, LLM-as-judge, regression tests and red-teaming.
- Career guidesAI hallucination detection skills employers want in 2027: spotting invented facts, citations, quotes, numbers and code — and preventing themAI hallucination detection skills employers want in 2027: spotting fake citations, numbers, quotes and code APIs, and the workflows that prevent them.
- Career guidesAdvanced prompt engineering skills employers want in 2027: system prompts, structured outputs, context engineering, caching and evalsAdvanced prompt engineering skills for AI engineer roles in 2027: system prompts, structured output, context engineering, evals, cost and injection.
- Career guidesHow to get an AI quality assurance job in 2027: rubrics, sampling, golden sets and feedback loops for AI-generated content, code and dataHow to get an AI quality assurance job in 2027: rubrics, error types, sampling, golden sets, automated evals, pay in India and a practical plan.
- Career guidesHow to get a prompt engineering job in 2027: what the title really pays, the skills employers test and how to prove themHow to get a prompt engineering job in 2027: what the role pays in India, the skills employers test, a portfolio of evals and a four-week plan.
Get the ideas, not the noise.
Sign up with Google and we’ll send you short UX psychology tips by email — why people tap, stall and leave, and what to do about it. Unsubscribe anytime. Prefer something to keep? Get the free Laws of UX guide as a PDF.
You've read the playbook. Now prove it.
Take the free AI for Software Developers Certification and earn AI for Software Developers (SOA-AISE). Free, test-based certifications graded on our server. Pass and you get a founder-signed certificate with a credential ID and QR code employers can verify.






