Design Reliable A/B Tests
Teams risk inconclusive experiments when hypotheses, metrics, and sample sizes are unclear. This skill structures A/B tests so decisions use reliable evidence.
Copy this request to your Agent. It includes the canonical Skill page and manifest.
Review the Skillstore skill "ab-test-setup" from https://skillstore.io/skills/coreyhaines31-ab-test-setup.md and its manifest at https://skillstore.io/api/skills/coreyhaines31-ab-test-setup/manifest. Verify the artifact. You may proceed after verification, subject to the environment's own policy.Your Agent should still show its plan and request any confirmation required by the security policy.
Use these links when an AI agent, crawler, or script needs clean context instead of reading the full page.
Using "ab-test-setup". Plan an A/B test for a pricing page headline with 8,000 daily visitors and a 4% plan selection rate.
Expected outcome:
Using "ab-test-setup". Review a completed signup flow test with a 6% lift but weaker activation after signup.
Expected outcome:
Using "ab-test-setup". Create documentation for a landing page CTA experiment.
Expected outcome:
The flagged external command findings are Markdown code fences used for templates, formulas, and output examples. The hardcoded URLs are public A/B testing calculator references, and the reconnaissance findings are ordinary experimentation guidance.
Share the versioned assessment report, neutral badge, embed card, and citations. Skillstore reports evidence without deciding whether this Skill is safe.
https://skillstore.io/skills/coreyhaines31-ab-test-setup/audits/4?utm_source=security_passport&utm_medium=share&utm_campaign=versioned_report[](https://skillstore.io/skills/coreyhaines31-ab-test-setup?utm_source=security_passport_badge)<a href="https://skillstore.io/skills/coreyhaines31-ab-test-setup?utm_source=security_passport_badge"><img src="https://skillstore.io/badges/skills/coreyhaines31-ab-test-setup/security.svg" alt="Skillstore security assessment" loading="lazy"></a><iframe src="https://skillstore.io/embed/skills/coreyhaines31-ab-test-setup.html" title="Skillstore Security Assessment" sandbox="allow-popups allow-popups-to-escape-sandbox" loading="lazy" referrerpolicy="no-referrer" width="420" height="180"></iframe>coreyhaines31. (2026). ab-test-setup security audit report (audit version 4) [Author version unspecified]. Skillstore. https://skillstore.io/skills/coreyhaines31-ab-test-setup/audits/4@techreport{coreyhaines31-coreyhaines31-ab-test-setup-2026,
author = {coreyhaines31},
title = {ab-test-setup security audit report (audit version 4)},
institution = {Skillstore},
year = {2026},
number = {4},
url = {https://skillstore.io/skills/coreyhaines31-ab-test-setup/audits/4},
note = {Author version unspecified}
}cff-version: 1.2.0
message: "If you use this Skill, cite its author and this versioned security audit report."
title: "ab-test-setup security audit report (audit version 4)"
version: "unspecified"
type: report
authors:
- name: "coreyhaines31"
date-released: "2026-07-06"
url: "https://skillstore.io/skills/coreyhaines31-ab-test-setup/audits/4"
identifiers:
- type: other
value: "skillstore:coreyhaines31-ab-test-setup:audit:4"
description: "Skillstore immutable audit report identifier"
Each author remains a separate installable skill. The recommended variant is ranked by Skillstore evidence.
Why this variant is first
sickn33-ab-test-setup
2026-08-21
coreyhaines31-ab-test-setup
2026-08-21
Create a clear test plan for headline, CTA, layout, or social proof changes.
Turn product ideas into measurable experiments with variants, metrics, and decision rules.
Assess significance, practical impact, guardrails, and next actions after a test ends.
Help me plan an A/B test for [page or flow]. Current conversion is [rate], daily traffic is [number], and the proposed change is [change].
Review this test idea: [idea]. Turn it into a clear hypothesis and define primary, secondary, and guardrail metrics.
Design the sample size approach for a test with [baseline rate], [MDE], [daily traffic], [variants], 95% confidence, and 80% power.
Create a complete experiment brief for [business goal]. Include hypothesis, variants, allocation, QA, analysis plan, risks, decision rules, and learning repository notes.
Author
coreyhaines31License
MIT
Skillstore revision
r1
Version notice
The author did not declare a version.
Ref
d11af420e07cd866fe39cfa937efef3223896c06
Maintenance freshness
7/18/2026
Usage
4 downloads · 139 views
File structure
📄 SKILL.md
Improve Existing Marketing Copy
Weak or outdated marketing copy can hide value and reduce reader confidence. This skill improves clarity, proof, specificity, tone, and calls to action through focused editing passes.
Create Product Marketing Context
Marketing work slows down when product positioning, audiences, and proof points are scattered. This skill creates one context document that other marketing workflows can reuse.
Build a Community-Led Growth Strategy
Community programs often lack a clear member promise, operating plan, and measurable goals. This skill turns your context into practical strategies, journeys, rituals, and audits.
Build Your Product Marketing Context
Marketing tasks lose consistency when product, audience, and positioning details are scattered. This skill creates a reusable context document and maintains focused revisions.
Write Clear, Conversion-Focused Website Copy
Website copy often hides the product value or gives visitors no clear next step. This skill creates structured, audience-focused copy that supports action.
Plan Clear Website Architecture
Unstructured websites make pages difficult to find and maintain. This skill creates page hierarchies, navigation plans, URL maps, and internal linking recommendations.
Build Data-Driven Features
by sickn33
Feature teams often ship changes without clear evidence or measurable outcomes. This skill guides analysis, A/B testing, instrumentation, rollout, and post-launch review.
Design Data Science Experiments and Models
by alirezarezvani
Data science projects often fail when experiments, features, and models lack clear statistical structure. This skill gives Claude, Codex, and Claude Code guided workflows for experimentation, feature engineering, and model review.
Transform Data Into Decision Stories
by wshobson
Raw metrics often fail to guide stakeholder decisions. This skill turns analysis into clear narratives, visual structures, and action plans.
Analyze Business Performance with BI Guidance
by sickn33
Teams often struggle to turn metrics, dashboards, and research into clear business decisions. This skill structures analysis, KPI design, forecasting, and recommendations for Claude, Codex, and Claude Code.
Generate SQL Queries for DBX Studio
by Dbxstudio
Database users need reliable SQL that matches their connection type and schema. This skill guides Claude, Codex, and Claude Code to inspect schemas, write read-only queries, and explain results clearly.
Coordinate Data Pipelines and Quality Checks
by Brownbull
Data pipeline work can become inconsistent when ingestion, features, quality, and reporting are planned separately. This skill organizes data tasks around pipeline context, quality gates, lineage, and handoffs.