A/B Testing and Experimentation Certification
Tests rigorous online experimentation — hypotheses, randomisation, sample size and power, significance, guardrails, peeking, SRM, novelty effects and interpreting results. Pass to earn A/B Testing and Experimentation SOA-ABT.
- Advanced difficulty.Assumes years in the role or deep specialist knowledge.
- 20 scenario questions
- 20 minutes, timed
- 70% to pass · 90% for distinction
- Free no sign-up needed
- LinkedIn-ready · add it to your profile in one clickSee how ↓
What is the A/B Testing and Experimentation Certification?
The A/B Testing and Experimentation Certification is a free 20-minute skill test from Science of Apps. It tests rigorous online experimentation — hypotheses, randomisation, sample size and power, significance, guardrails, peeking, SRM, novelty effects and interpreting results. Score 70% or more on its 20 questions to earn a verifiable A/B Testing and Experimentation certificate (SOA-ABT). Every question is based on published standards and research — including Trustworthy Online Controlled Experiments (Kohavi, Tang & Xu), How Not To Run an A/B Test (Evan Miller) — and each answer is explained with its source.
Built for your job title
Data scientist, Product analyst, Growth marketer, CRO specialist and Product manager — and anyone who wants quick, verifiable proof of A/B Testing and Experimentation skills for a CV or LinkedIn.
- Data scientist
- Product analyst
- Growth marketer
- CRO specialist
- Product manager
Land the job, not just the certificate
Career guide · 9 min readA/B testing interview questions and jobs in 2027: experiment design, the pitfalls interviewers probe and who hires for it
A/B testing interview questions and jobs in 2027: hypotheses, sample size, SRM, peeking, guardrails and CUPED, with answers, the roles that hire and a plan.
Read the hiring playbook →What the test covers
Four skill areas with 5 questions each, drawn from a bank of 10 per area, so a retake brings questions you haven't seen.
- 01
Designing experiments
25%- Hypotheses and metrics
- Randomisation
- Sample size and power
- 02
Analysing experiments
25%- Significance and intervals
- Pitfalls: peeking, SRM
- Decisions and guardrails
- 03
Advanced experiment design
25%- Variance reduction (CUPED)
- Sequential testing
- Multi-armed bandits
- 04
Experimentation programmes
25%- Experiment culture
- Interference and network effects
- Ethics and trust
Based on published standards
The questions are original scenarios, and each one names the public standard, official guide or research it draws on — shown under the question while you answer, and linked in your review. These are the sources behind this test:
Try a sample question
What's an A/A test used for?
- Comparing two winners
- Nothing useful
- Checking that the experimentation setup produces no false differences
- Testing two identical copies to increase traffic
Show the answer
C. Checking that the experimentation setup produces no false differences — A/A tests validate the system. The real test has 20 questions like this.
How the test works
20 minutes, 20 questions
One question per screen, with a progress bar and a countdown. Your progress is saved on this device if you need to pause.
Graded on our server
Answers reach the page only after you submit, so the certificate can only be earned by passing.
Every answer explained
Pass or not, you see every question with the right answer, why, and the source behind it. Pass mark 70%, distinction 90%.
Your certificate
Founder-signed, with a QR code and credential ID. Download PDF or PNG, add to LinkedIn, and it's emailed to you.
What you earn

Pass, then add it to LinkedIn in one click
No typing. The Add to LinkedIn button opens your profile’s Licenses & certifications form already filled in: the certificate name, Science of Apps as the issuer, the issue date, your credential ID and a link recruiters can use to verify it.
- 1Take the 20-minute test
- 2Score 70% or more
- 3Click Add to LinkedIn

A/B Testing and Experimentation
Science of Apps
Show credential ↗Try another skill test
- ProfessionalSOA-PA
Product Analytics Certification
Certifies that you can turn product data into decisions — metrics and instrumentation, funnels and conversion, retention and cohorts, and A/B testing and statistics.
Difficulty: AdvancedEarn Certified Product Analyst → - 10 minSOA-DLIT
Data Literacy Certification
Tests the everyday ability to read, question and communicate with data — chart reading, averages and percentages, data sources, bias and drawing sound conclusions.
Difficulty: BeginnerTake the 10-minute test → - 10 minSOA-XLF
Microsoft Excel Fundamentals Certification
Tests core Excel skills — cell references, essential formulas, sorting and filtering, tables, basic charts, conditional formatting and PivotTables.
Difficulty: BeginnerTake the 10-minute test →
Frequently asked questions
What is the A/B Testing and Experimentation Certification?
The A/B Testing and Experimentation Certification is a free 20-minute skill test from Science of Apps. It tests rigorous online experimentation — hypotheses, randomisation, sample size and power, significance, guardrails, peeking, SRM, novelty effects and interpreting results. Score 70% or more on its 20 questions to earn a verifiable A/B Testing and Experimentation certificate (SOA-ABT). Every question is based on published standards and research — including Trustworthy Online Controlled Experiments (Kohavi, Tang & Xu), How Not To Run an A/B Test (Evan Miller) — and each answer is explained with its source.
How do I take the A/B Testing and Experimentation Certification for free?
Read the four skill areas on this page, then take the 20-minute test online — no fee, course or sign-up. You see every answer explained when you finish. Score 70% or more and you get a A/B Testing and Experimentation certificate straight away, on screen, as a PDF and by email, with a credential ID anyone can verify.
Are the A/B Testing and Experimentation Certification questions based on real standards?
Yes. The questions are original scenarios written by Science of Apps, and each one is based on a public source you can read: Trustworthy Online Controlled Experiments (Kohavi, Tang & Xu); How Not To Run an A/B Test (Evan Miller). The source is shown under each question and linked in the answer review. Science of Apps doesn't copy questions from other tests.
What does the A/B Testing and Experimentation Certification cover?
Four skill areas with five questions each, drawn from a bank of 10 per area so a retake brings new questions: Designing experiments (Hypotheses and metrics, Randomisation and Sample size and power); Analysing experiments (Significance and intervals, Pitfalls: peeking, SRM and Decisions and guardrails); Advanced experiment design (Variance reduction (CUPED), Sequential testing and Multi-armed bandits); Experimentation programmes (Experiment culture, Interference and network effects and Ethics and trust). Every question is an original scenario based on a published standard, official documentation or research, named under the question.
Who should take the A/B Testing and Experimentation Certification?
Data scientist, Product analyst, Growth marketer, CRO specialist and Product manager. It suits anyone who wants a quick, verifiable way to show A/B Testing and Experimentation skills, from students and career switchers to experienced professionals.
Can I take the A/B Testing and Experimentation Certification from any country?
Yes. The test is online, in English and free everywhere — people take it from India, the US, the UK, Europe, Africa, Latin America and Asia-Pacific. Your certificate is dated with your own local date and can be verified from anywhere at scienceofapps.com/certification/verify/.
How long is the A/B Testing and Experimentation Certification?
20 questions — 5 from each of 4 skill areas — with a 20-minute limit. You need 70% (14 of 20) to pass and 90% for distinction.
How hard is the A/B Testing and Experimentation Certification?
We rate it Advanced: assumes years in the role or deep specialist knowledge. It has 20 scenario questions — 5 from each of 4 skill areas — and a 20-minute limit. You need 70% (14 of 20) to pass and 90% for distinction.
How do I prepare for a Data scientist job?
A/B testing interviews in 2027 test whether you can run experiments that don't fool the company: a clear hypothesis and metric, correct randomisation, sample size and power, guardrail metrics, and the pitfalls — peeking, sample ratio mismatch, novelty effects and interference. Product analysts, data scientists, growth and CRO roles all test it. Learn the design checklist, practise interpreting messy results, and prove it with a verified test and one written-up experiment. Our full career guide covers the hiring process, interview loop, pay and a prep plan: scienceofapps.com/blog/ab-testing-career-guide/
How much do Science of Apps certifications cost?
Nothing. There is no fee to take a test, to receive the certificate, to have it emailed or to verify it, and no sign-up.
How are the tests graded?
On our server, not in your browser. The answers never reach the page until you submit, so a certificate can only be earned by passing. Each certificate gets a unique credential ID stored by Science of Apps.
What happens if I don't pass?
You see your score for each area and every question with the correct answer and why, with the published source behind it. You can retake after 30 minutes, and the retake draws questions you haven't seen yet.
Do the certificates expire?
No. Every certificate is dated, so it always shows when you passed. Retake a test any time for a newer date or a higher score.
Can I add the certificate to LinkedIn?
Yes. After you pass, Add to LinkedIn opens the Licenses & certifications form with the certificate name, Science of Apps as the issuer, the issue date, your credential ID and the verification link filled in. You can also download it as a PDF or PNG, and it's emailed to you as a PDF.
How can an employer verify my certificate?
Every certificate has a credential ID and a QR code. Scanning it, or entering the ID at scienceofapps.com/certification/verify/, shows the holder's name, the certification, the score and the issue date from our records.
Are these accredited qualifications?
No. They are Science of Apps' own assessments of applied skill. They aren't issued by a university or standards body, and they work best alongside a portfolio that shows the skills in real work.
621 more certifications to collect
Data Analytics & Business Intelligence
- Product Analytics Certification30 min · Advanced
- Data Literacy Certification10 min · Beginner
- Microsoft Excel Fundamentals Certification10 min · Beginner
- Advanced Excel and Formulas Certification15 min · Intermediate
- Excel for Business Analysis Certification15 min · Intermediate
- SQL Fundamentals Certification10 min · Beginner
- Advanced SQL Assessment20 min · Advanced
- Data Cleaning and Preparation Certification15 min · Intermediate
- Data Visualization Fundamentals Certification10 min · Beginner
- Power BI Analyst Assessment15 min · Intermediate
- Tableau Data Visualization Certification15 min · Intermediate
- Google Sheets for Professionals Certification10 min · Beginner
- Python for Data Analysis Certification15 min · Intermediate
- Statistics for Data Analysts Certification15 min · Intermediate
- Business Intelligence Fundamentals Certification10 min · Beginner
- Business Analyst Certification15 min · Intermediate
- Data Storytelling and Presentation Certification10 min · Beginner
- Dashboard Design and KPI Selection Certification15 min · Intermediate
- A/B Testing and Experimentation CertificationYou're here
- Customer and Marketing Analytics Certification15 min · Intermediate
- Data Quality and Governance Certification15 min · Intermediate
- Data Engineering Fundamentals Certification15 min · Intermediate
- Machine Learning Fundamentals Certification15 min · Intermediate
- AI and Machine Learning Model Evaluation Certification20 min · Advanced
- Statistical Reasoning Assessment15 min · Intermediate
- Data-Driven Decision-Making Test10 min · Beginner
- Operations Research Certification20 min · Advanced
- Decision Science & Optimization Certification15 min · Intermediate
Foundation
AI & Generative AI
- AI UX Design Certification30 min · Advanced
- Prompt Engineering Certification30 min · Intermediate
- AI Product Manager Certification30 min · Advanced
Software Engineering & Web Development
- HTML and CSS Fundamentals Certification10 min · Beginner
- JavaScript Fundamentals Certification10 min · Beginner
- TypeScript Fundamentals Certification15 min · Intermediate
Digital Marketing, SEO, AEO & Growth
- Conversion Rate Optimization (CRO) Certification30 min · Advanced
- App Store Optimization (ASO) Certification30 min · Intermediate
- Growth Marketing Certification30 min · Intermediate
UX/UI, Design, Research & Creative
- UX Design Certification30 min · Intermediate
- UI Design Certification30 min · Intermediate
- Product Design Certification30 min · Intermediate
Product, Project Management & Business Analysis
- Product Manager Certification30 min · Intermediate
- Design Leadership Certification30 min · Advanced
- Agile Product Owner Certification30 min · Intermediate
Cybersecurity, IT, Cloud & DevOps
- Cybersecurity Fundamentals Certification10 min · Beginner
- Security Awareness and Phishing Detection Certification10 min · Beginner
- Network Security Fundamentals Certification15 min · Intermediate
Sales, Customer Success & Support
- Sales Fundamentals Certification10 min · Beginner
- Consultative Selling Certification15 min · Intermediate
- B2B Sales Development Representative Certification10 min · Beginner
Human Resources & People Management
- Human Resources Fundamentals Certification10 min · Beginner
- Talent Acquisition and Recruitment Certification10 min · Beginner
- Technical Recruitment Certification15 min · Intermediate
Finance, Accounting, Operations & Entrepreneurship
- Financial Literacy for Professionals Certification10 min · Beginner
- Accounting Fundamentals Certification10 min · Beginner
- Bookkeeping Fundamentals Certification10 min · Beginner
Communication, Leadership & Transferable Skills
- Critical Thinking Test10 min · Beginner
- Attention to Detail Test10 min · Beginner
- Cognitive Bias Test10 min · Beginner
Languages
- English Level Test30 min · Beginner
- American Sign Language (ASL) Foundations Test25 min · Intermediate
- App & Software Localization Test25 min · Intermediate
Healthcare, Education, Legal Operations & Sustainability
- Healthcare Administration Fundamentals Certification10 min · Beginner
- Medical Office Administration Certification10 min · Beginner
- Healthcare Data Privacy Awareness Certification10 min · Beginner
Test Prep, Academics & Aptitude
- SAT Math Practice Test20 min · Advanced
- SAT Reading and Writing Practice Test20 min · Advanced
- ACT Practice Test (English, Math, Reading & Science)20 min · Advanced
Language Exam Prep
- IELTS Academic Practice Test with Band Score20 min · Advanced
- IELTS General Training Practice Test20 min · Advanced
- TOEFL iBT Practice Test20 min · Advanced
Office & Productivity Software
- Microsoft Word Skills Certification15 min · Intermediate
- Microsoft PowerPoint Skills Certification15 min · Intermediate
- Microsoft Outlook Skills Certification10 min · Beginner
Engineering, Architecture, Construction & Safety
- Mechanical Engineering Practice Test (FE-Style)20 min · Advanced
- Electrical Engineering Practice Test (FE-Style)20 min · Advanced
- Civil Engineering Practice Test (FE-Style)20 min · Advanced
Hospitality, Travel & Retail
- Hospitality Management Certification10 min · Beginner
- Food Safety Certification10 min · Beginner
- Hotel Revenue Management Certification15 min · Intermediate
Read before you test
- Career guidesA/B testing interview questions and jobs in 2027: experiment design, the pitfalls interviewers probe and who hires for itA/B testing interview questions and jobs in 2027: hypotheses, sample size, SRM, peeking, guardrails and CUPED, with answers, the roles that hire and a plan.
- Career guidesHow to get a conversion rate optimization job in 2027: research, hypotheses, experiments and the evidence hiring managers wantHow to get a CRO specialist job in 2027: research methods, hypotheses, A/B test design, analysis, the portfolio that proves it, pay and a plan.
- Career guidesGrowth experimentation skills employers want in 2027: hypotheses, test design, statistics, guardrails, velocity and building an experimentation cultureGrowth experimentation skills employers want in 2027: hypotheses, prioritisation, test design, statistics, guardrails, experiment velocity and culture.
- Career guidesResearch literacy for 2027 careers: reading studies and reports critically, study designs, sample size and bias, correlation vs causation, statistical significance, replication, and using research to make decisionsResearch literacy for 2027 careers: reading studies critically, study designs, samples and bias, correlation vs causation, significance and replication.
- Career guidesHow to get an app store optimization job in 2027: keywords, store listings, creative testing, ratings and the metrics mobile growth teams hire forHow to get an ASO specialist job in 2027: App Store and Google Play keywords, listings, creative tests, ratings, metrics, pay and a 5-week plan.
- Career guidesHow to get a marketing analyst job in 2027: attribution, incrementality and the numbers marketers actually trustHow to get a marketing analyst job in 2027: the attribution, CLV, GA4 and experiment skills employers test, the interview loop, pay and a 12-week plan.
Get the ideas, not the noise.
Sign up with Google and we’ll send you short UX psychology tips by email — why people tap, stall and leave, and what to do about it. Unsubscribe anytime. Prefer something to keep? Get the free Laws of UX guide as a PDF.
Founder, Science of Apps




