抗体测试
- 作者仓库星标 0
- 作者仓库 skills-registry
- 领域
- 工程开发
- 作者声明的智能体
- 未找到明确声明;不据此推断已兼容或已测试
- 静态检查
- 88 / 100 · 启发式扫描,不代表运行安全
- 运行环境证据
- 未执行;当前没有隔离运行测试证据
- 作者 / 版本 / 许可证
- @tomevault-io · 未声明许可证
- 上下文用量评级
- 低消耗
- 接入复杂程度
- 即装即用
- 是否需要外部接口密钥
- 不需要
- 兼容的系统
- 未声明(默认跨平台)
- 运行环境要求
- Python
- 检测到的文件与系统行为
-
- 只读
- 允许写入 / 修改
- 网络行为
- 仅限本地
- 安装命令数
- 无(仅作为资料)
需要注意: 未声明工具权限范围;实际权限由运行环境决定。
// middleware.ts - Server-side assignment (no flicker)
import { NextResponse, type NextRequest } from 'next/server'
export function middleware(request: NextRequest) {
const response = NextResponse.next()
if (!request.cookies.get('exp_hero')) {
const variant = Math.random() < 0.5 ? 'A' : 'B'
response.cookies.set('exp_hero', variant, { maxAge: 60*60*24*30, path: '/' })
}
return response
}
# A/B Testing Platform for SaaS
> **Stack**: Next.js 16 + Edge Middleware + GA4/GTM + Supabase + Rust-WASM (for stats)
> **Why DIY?**: Google Optimize sunset Sept 2023. GA4 has no native A/B testing.
## Quick Start
```tsx
// middleware.ts - Server-side assignment (no flicker)
import { NextResponse, type NextRequest } from 'next/server'
export function middleware(request: NextRequest) {
const response = NextResponse.next()
if (!request.cookies.get('exp_hero')) {
const variant = Math.random() < 0.5 ? 'A' : 'B'
response.cookies.set('exp_hero', variant, { maxAge: 60*60*24*30, path: '/' })
}
return response
}
```
```tsx
// Track with GA4
window.dataLayer?.push({
event: 'experiment_view',
experiment_name: 'hero_test',
experiment_variant: variant
})
```
---
## Architecture
```
┌─────────────────────────────────────────────────────────────────────┐
│ A/B TESTING FLOW │
├─────────────────────────────────────────────────────────────────────┤
│ │
│ 1. ASSIGN (Edge Middleware) │
│ ══════════════════════════ │
│ Request → Check cookie → Random assign → Set cookie → Response │
│ ✓ No flicker (server-side) ✓ Consistent (cookie-based) │
│ │
│ 2. RENDER │
│ ═════════ │
│ Server/Client Component → Read cookie → Show variant │
│ │
│ 3. TRACK (GTM + GA4) │
│ ════════════════════ │
│ dataLayer.push → GTM triggers → GA4 events with variant param │
│ │
│ 4. ANALYZE │
│ ═════════ │
│ GA4 Explorations OR Supabase + Rust-WASM Bayesian analysis │
│ │
│ 5. PERSONALIZE (Advanced) │
│ ═════════════════════════ │
│ Contextual bandit → Best variant per user segment │
│ │
└─────────────────────────────────────────────────────────────────────┘
```
---
## Workflow
- [ ] 1. Define experiment config (name, variants, weight, segment rules)
- [ ] 2. Implement middleware assignment (see [VARIANT-ASSIGNMENT.md](references/VARIANT-ASSIGNMENT.md))
- [ ] 3. Wire up GTM tracking (experiment_view, conversions with variant param)
- [ ] 4. Register `experiment_variant` as Custom Dimension in GA4
- [ ] 5. Collect data (minimum 2 weeks for weekly patterns)
- [ ] 6. Analyze significance (see [STATISTICAL-ANALYSIS.md](references/STATISTICAL-ANALYSIS.md))
- [ ] 7. Roll out winner or iterate
---
## Statistical Methods (Choose One)
| Method | Best For | Decision Output |
|--------|----------|-----------------|
| **Frequentist** | Fixed sample, strict control | p-value < 0.05 → significant |
| **Bayesian** | Continuous monitoring, intuitive | P(B > A) = 96% → B likely better |
| **Multi-Armed Bandit** | Optimize during test | Auto-shift traffic to winner |
| **Contextual Bandit** | Personalization | Best variant per user segment |
**Quick Bayesian (Beta-Binomial)**:
```python
# A: 50/1000 conversions, B: 72/1000
import scipy.stats as stats
a_samples = stats.beta(51, 951).rvs(100000) # Beta(1+50, 1+950)
b_samples = stats.beta(73, 929).rvs(100000) # Beta(1+72, 1+928)
p_b_wins = (b_samples > a_samples).mean() # → ~0.96 (96%)
```
**Full analysis guide**: [STATISTICAL-ANALYSIS.md](references/STATISTICAL-ANALYSIS.md)
---
## Key Patterns
### Multiple Concurrent Experiments
```tsx
// middleware.ts
const EXPERIMENTS = {
hero_cta: { weight: 0.5 },
pricing_layout: { weight: 0.5 },
signup_flow: { weight: 0.2 }, // 20% on new variant
}
for (const [name, config] of Object.entries(EXPERIMENTS)) {
if (!request.cookies.get(`exp_${name}`)) {
const variant = Math.random() < config.weight ? 'B' : 'A'
response.cookies.set(`exp_${name}`, variant, { maxAge: 2592000, path: '/' })
}
}
```
### Phased Rollout
```tsx
// Config stored in Supabase or Vercel Edge Config
const rolloutPhases = {
early_access: 0.1, // 10% new
public_beta: 0.5, // 50% new
general: 1.0 // 100% new (winner)
}
```
### Tracking Conversions
```tsx
// Include variant in ALL relevant events
window.dataLayer?.push({
event: 'sign_up',
method: 'google',
experiment_name: 'hero_cta',
experiment_variant: getCookie('exp_hero_cta'),
eventId: crypto.randomUUID() // De-duplication
})
```
---
## When to Use Rust-WASM
| Use Case | Why Rust |
|----------|----------|
| Monte Carlo simulation (100k+ draws) | 10-100x faster than JS |
| Bayesian posterior computation | Numerical precision |
| Contextual bandit inference | Real-time ML at edge |
| Cross-platform consistency | Same logic in browser + server |
**WASM is NOT needed for**: Simple random assignment, cookie handling, event tracking
See: [RUST-WASM.md](references/RUST-WASM.md)
---
## Anti-Patterns
| Don't | Why |
|-------|-----|
| Client-side variant assignment | Causes flicker, inconsistent |
| End test early ("B winning after 2 days!") | Random noise, not signal |
| Multiple changes in one variant | Can't isolate what worked |
| Overlapping tests on same element | Interaction effects confound |
| Skip sample size calculation | Under-powered = false negatives |
| Ignore segments | Winner overall may lose for key segment |
---
## Validation Checklist
- [ ] No flicker on page load (verify in slow 3G)
- [ ] Cookie persists across sessions (check 30-day expiry)
- [ ] GTM Preview shows correct variant in dataLayer
- [ ] GA4 DebugView receives events with variant param
- [ ] Custom dimension `experiment_variant` registered in GA4
- [ ] ~50/50 split verified (check GA4 Realtime)
- [ ] Conversion events include variant attribution
---
## Reference Index
### By Task
| I need to... | Read |
|--------------|------|
| **Implement variant assignment** | [VARIANT-ASSIGNMENT.md](references/VARIANT-ASSIGNMENT.md) |
| **Choose a statistical method** | [STATISTICAL-ANALYSIS.md](references/STATISTICAL-ANALYSIS.md) |
| **Set up GTM/GA4 tracking** | [GA4-GTM-TRACKING.md](references/GA4-GTM-TRACKING.md) |
| **Build admin dashboard** | [ADMIN-DASHBOARD.md](references/ADMIN-DASHBOARD.md) |
| **Add personalization/bandits** | [PERSONALIZATION.md](references/PERSONALIZATION.md) |
| **Optimize with Rust-WASM** | [RUST-WASM.md](references/RUST-WASM.md) |
| **Quick lookup (tools, formulas)** | [QUICK-REFERENCE.md](references/QUICK-REFERENCE.md) |
### By Topic
| Topic | Reference |
|-------|-----------|
| Server-side assignment, multiple experiments, weighted splits | [VARIANT-ASSIGNMENT.md](references/VARIANT-ASSIGNMENT.md) |
| Frequentist vs Bayesian vs Bandits, sample size, pitfalls | [STATISTICAL-ANALYSIS.md](references/STATISTICAL-ANALYSIS.md) |
| GTM variables, GA4 events, BigQuery queries, debugging | [GA4-GTM-TRACKING.md](references/GA4-GTM-TRACKING.md) |
| Database schema, API routes, UI components, real-time updates | [ADMIN-DASHBOARD.md](references/ADMIN-DASHBOARD.md) |
| Segments, rules-based, Thompson sampling, contextual bandits | [PERSONALIZATION.md](references/PERSONALIZATION.md) |
| Rust setup, beta sampling, bandit implementation, Next.js integration | [RUST-WASM.md](references/RUST-WASM.md) |
| Tool recommendations, decision guide, formulas, cheat sheet | [QUICK-REFERENCE.md](references/QUICK-REFERENCE.md) |
---
> Source: [danzam98/claude-skills-toolkit](https://github.com/danzam98/claude-skills-toolkit) — distributed by [TomeVault](https://tomevault.io).
<!-- tomevault:4.0:skill_md:2026-05-23 -->
章节与文件索引
按说明文件中的顺序排列。
工作流程
统计方法(选择一项)
何时使用 Rust-WASM
反模式
验证清单
文件/命令 -> experiment_variant · exp_${name} · A/B · Next.js · GA4/GTM · middleware.ts · next/server · Server/Client
内容校验值 -> 7512d8f6e928
当前原文的自动摘译,尚未人工审校。
工作流程
[ ] 1. 定义实验配置(名称、变体、权重、分段规则) [ ] 2. 实施中间件分配(参见 VARIANT-ASSIGNMENT.md) [ ] 3. 连接 GTM 跟踪(experiment_view、带变体参数的转换) [ ] 4. 在 GA4 中将
experiment_variant注册为自定义维度 [ ] 5. 收集数据(每周模式至少 2 周)统计方法(选择一项)
方法 · 最佳 · 决策输出频率论 · 固定样本,严格控制 · p 值 < 0.05 → 显着贝叶斯 · 连续监控,直观 · P(B > A) = 96% → B 可能更好 Multi-Armed Bandit · 测试期间优化 · 自动将流量转移到获胜者 Contextual Bandit · 个性化 · 每个用户细分的最佳变体
何时使用 Rust-WASM
使用案例 · 为什么选择 Rust 蒙特卡洛模拟(100k+ 绘图) · 比 JS 贝叶斯后验计算快 10-100 倍 · 数值精度 上下文强盗推理 · 边缘实时 ML 跨平台一致性 · 浏览器 + 服务器中的相同逻辑
反模式
不这样做 · 为什么 客户端变体分配 · 导致闪烁、不一致 提前结束测试(“2 天后 B 获胜!”) · 随机噪音,无信号 一个变体中存在多个变化 · 无法隔离有效的内容 对同一元素进行重叠测试 · 交互效果令人困惑
验证清单
[ ] 页面加载时无闪烁(在慢速 3G 中验证) [ ] Cookie 在会话中持续存在(检查 30 天有效期) [ ] GTM 预览在 dataLayer 中显示正确的变体 [ ] GA4 DebugView 接收带有变体参数的事件 [ ] 在 GA4 中注册的自定义维度
experiment_variant