Quick skill test · 20 questions · 20 minutes · Free

A/B Testing and Experimentation Certification

Tests rigorous online experimentation — hypotheses, randomisation, sample size and power, significance, guardrails, peeking, SRM, novelty effects and interpreting results. Pass to earn A/B Testing and Experimentation SOA-ABT.

What is the A/B Testing and Experimentation Certification?

The A/B Testing and Experimentation Certification is a free 20-minute skill test from Science of Apps. It tests rigorous online experimentation — hypotheses, randomisation, sample size and power, significance, guardrails, peeking, SRM, novelty effects and interpreting results. Score 70% or more on its 20 questions to earn a verifiable A/B Testing and Experimentation certificate (SOA-ABT). Every question is based on published standards and research — including Trustworthy Online Controlled Experiments (Kohavi, Tang & Xu), How Not To Run an A/B Test (Evan Miller) — and each answer is explained with its source.

Built for your job title

Data scientist, Product analyst, Growth marketer, CRO specialist and Product manager — and anyone who wants quick, verifiable proof of A/B Testing and Experimentation skills for a CV or LinkedIn.

  • Data scientist
  • Product analyst
  • Growth marketer
  • CRO specialist
  • Product manager

Land the job, not just the certificate

Career guide · 9 min read

A/B testing interview questions and jobs in 2027: experiment design, the pitfalls interviewers probe and who hires for it

A/B testing interview questions and jobs in 2027: hypotheses, sample size, SRM, peeking, guardrails and CUPED, with answers, the roles that hire and a plan.

Read the hiring playbook →

What the test covers

Four skill areas with 5 questions each, drawn from a bank of 10 per area, so a retake brings questions you haven't seen.

  1. 01

    Designing experiments

    25%
    • Hypotheses and metrics
    • Randomisation
    • Sample size and power
  2. 02

    Analysing experiments

    25%
    • Significance and intervals
    • Pitfalls: peeking, SRM
    • Decisions and guardrails
  3. 03

    Advanced experiment design

    25%
    • Variance reduction (CUPED)
    • Sequential testing
    • Multi-armed bandits
  4. 04

    Experimentation programmes

    25%
    • Experiment culture
    • Interference and network effects
    • Ethics and trust

Based on published standards

The questions are original scenarios, and each one names the public standard, official guide or research it draws on — shown under the question while you answer, and linked in your review. These are the sources behind this test:

Try a sample question

What's an A/A test used for?

  1. Comparing two winners
  2. Nothing useful
  3. Checking that the experimentation setup produces no false differences
  4. Testing two identical copies to increase traffic
Show the answer

C. Checking that the experimentation setup produces no false differences — A/A tests validate the system. The real test has 20 questions like this.

How the test works

  1. 20 minutes, 20 questions

    One question per screen, with a progress bar and a countdown. Your progress is saved on this device if you need to pause.

  2. Graded on our server

    Answers reach the page only after you submit, so the certificate can only be earned by passing.

  3. Every answer explained

    Pass or not, you see every question with the right answer, why, and the source behind it. Pass mark 70%, distinction 90%.

  4. Your certificate

    Founder-signed, with a QR code and credential ID. Download PDF or PNG, add to LinkedIn, and it's emailed to you.

What you earn

A Science of Apps certificate for Data Analytics & Business Intelligence: ivory paper with a gold medal
LinkedIn-ready certificate

Pass, then add it to LinkedIn in one click

No typing. The Add to LinkedIn button opens your profile’s Licenses & certifications form already filled in: the certificate name, Science of Apps as the issuer, the issue date, your credential ID and a link recruiters can use to verify it.

  1. 1Take the 20-minute test
  2. 2Score 70% or more
  3. 3Click Add to LinkedIn
Free · no sign-up · also emailed to you as a PDF
How it shows on your LinkedIn profile

See every Data & BI certification and test →

Frequently asked questions

What is the A/B Testing and Experimentation Certification?

The A/B Testing and Experimentation Certification is a free 20-minute skill test from Science of Apps. It tests rigorous online experimentation — hypotheses, randomisation, sample size and power, significance, guardrails, peeking, SRM, novelty effects and interpreting results. Score 70% or more on its 20 questions to earn a verifiable A/B Testing and Experimentation certificate (SOA-ABT). Every question is based on published standards and research — including Trustworthy Online Controlled Experiments (Kohavi, Tang & Xu), How Not To Run an A/B Test (Evan Miller) — and each answer is explained with its source.

How do I take the A/B Testing and Experimentation Certification for free?

Read the four skill areas on this page, then take the 20-minute test online — no fee, course or sign-up. You see every answer explained when you finish. Score 70% or more and you get a A/B Testing and Experimentation certificate straight away, on screen, as a PDF and by email, with a credential ID anyone can verify.

Are the A/B Testing and Experimentation Certification questions based on real standards?

Yes. The questions are original scenarios written by Science of Apps, and each one is based on a public source you can read: Trustworthy Online Controlled Experiments (Kohavi, Tang & Xu); How Not To Run an A/B Test (Evan Miller). The source is shown under each question and linked in the answer review. Science of Apps doesn't copy questions from other tests.

What does the A/B Testing and Experimentation Certification cover?

Four skill areas with five questions each, drawn from a bank of 10 per area so a retake brings new questions: Designing experiments (Hypotheses and metrics, Randomisation and Sample size and power); Analysing experiments (Significance and intervals, Pitfalls: peeking, SRM and Decisions and guardrails); Advanced experiment design (Variance reduction (CUPED), Sequential testing and Multi-armed bandits); Experimentation programmes (Experiment culture, Interference and network effects and Ethics and trust). Every question is an original scenario based on a published standard, official documentation or research, named under the question.

Who should take the A/B Testing and Experimentation Certification?

Data scientist, Product analyst, Growth marketer, CRO specialist and Product manager. It suits anyone who wants a quick, verifiable way to show A/B Testing and Experimentation skills, from students and career switchers to experienced professionals.

Can I take the A/B Testing and Experimentation Certification from any country?

Yes. The test is online, in English and free everywhere — people take it from India, the US, the UK, Europe, Africa, Latin America and Asia-Pacific. Your certificate is dated with your own local date and can be verified from anywhere at scienceofapps.com/certification/verify/.

How long is the A/B Testing and Experimentation Certification?

20 questions — 5 from each of 4 skill areas — with a 20-minute limit. You need 70% (14 of 20) to pass and 90% for distinction.

How hard is the A/B Testing and Experimentation Certification?

We rate it Advanced: assumes years in the role or deep specialist knowledge. It has 20 scenario questions — 5 from each of 4 skill areas — and a 20-minute limit. You need 70% (14 of 20) to pass and 90% for distinction.

How do I prepare for a Data scientist job?

A/B testing interviews in 2027 test whether you can run experiments that don't fool the company: a clear hypothesis and metric, correct randomisation, sample size and power, guardrail metrics, and the pitfalls — peeking, sample ratio mismatch, novelty effects and interference. Product analysts, data scientists, growth and CRO roles all test it. Learn the design checklist, practise interpreting messy results, and prove it with a verified test and one written-up experiment. Our full career guide covers the hiring process, interview loop, pay and a prep plan: scienceofapps.com/blog/ab-testing-career-guide/

How much do Science of Apps certifications cost?

Nothing. There is no fee to take a test, to receive the certificate, to have it emailed or to verify it, and no sign-up.

How are the tests graded?

On our server, not in your browser. The answers never reach the page until you submit, so a certificate can only be earned by passing. Each certificate gets a unique credential ID stored by Science of Apps.

What happens if I don't pass?

You see your score for each area and every question with the correct answer and why, with the published source behind it. You can retake after 30 minutes, and the retake draws questions you haven't seen yet.

Do the certificates expire?

No. Every certificate is dated, so it always shows when you passed. Retake a test any time for a newer date or a higher score.

Can I add the certificate to LinkedIn?

Yes. After you pass, Add to LinkedIn opens the Licenses & certifications form with the certificate name, Science of Apps as the issuer, the issue date, your credential ID and the verification link filled in. You can also download it as a PDF or PNG, and it's emailed to you as a PDF.

How can an employer verify my certificate?

Every certificate has a credential ID and a QR code. Scanning it, or entering the ID at scienceofapps.com/certification/verify/, shows the holder's name, the certification, the score and the issue date from our records.

Are these accredited qualifications?

No. They are Science of Apps' own assessments of applied skill. They aren't issued by a university or standards body, and they work best alongside a portfolio that shows the skills in real work.

All free · no sign-up

621 more certifications to collect

Keep exploring

Read before you test

Pass it on

Challenge a friend or your team

Send them this test. It's free, takes minutes, and you can compare scores — every certificate can be verified.

Join free

Get the ideas, not the noise.

Sign up with Google and we’ll send you short UX psychology tips by email — why people tap, stall and leave, and what to do about it. Unsubscribe anytime. Prefer something to keep? Get the free Laws of UX guide as a PDF.

Get the free Laws of UX PDFFree · no spam · unsubscribe anytime
Free PDF · 74 pages · 2 editions

The Laws of UX, in one field guide

60 research-backed principles in 6 categories — what each one means, why it works on the human brain and how to use it on your own screens. Written by Sushant Singh, founder of Science of Apps, who has scaled consumer apps to lacs of users and spent 10+ years leading product across startups and digital businesses in the US, EU & India.

Pick your edition
Free. No card, no paywall — just your email.
Free PDF · 74 pages

Get Laws of UX by email

Choose your edition

You’ll also get occasional UX psychology tips. Unsubscribe anytime. Privacy policy

Free PDF · 90 pages · 2 editions

100+ Subscription Paywalls, decoded

110 real paywalls from top apps, taken apart, rated out of 5 and decoded with the Laws of UX — plus the frameworks, copy and checklists to ship your own. By Sushant Singh, founder of Science of Apps.

  • 110 paywalls rated
  • 34 Laws of UX
  • 12 frameworks

Which paywall scored 4.8 out of 5, and which scored 2.6? It’s all inside.

Pick your edition
Free. No card, no paywall — just your email.
Free PDF · 90 pages

Get 100+ Paywalls, Decoded by email

Choose your edition

You’ll also get occasional UX psychology tips. Unsubscribe anytime. Privacy policy