AITM · Module 1.3
M1.3
AITM-ECI — AI Experimentation Associate
18 articles · Stages: Calibrate
Articles in this module
- 1What an AI Experiment IsAPP · M1.3-Art01
- 2Hypothesis Formulation and Metric DesignAPP · M1.3-Art02
- 3Offline EvaluationAPP · M1.3-Art03
- 4Online EvaluationAPP · M1.3-Art04
- 5Hyperparameter Search and Model SelectionAPP · M1.3-Art05
- 6Experiment Tracking, Reproducibility, and ReplicabilityAPP · M1.3-Art06
- 7Pipelines and OrchestrationAPP · M1.3-Art07
- 8Continuous Integration for MLAPP · M1.3-Art08
- 9Continuous Delivery and Governed PromotionAPP · M1.3-Art09
- 10Evaluating LLMsAPP · M1.3-Art10
- 11Red-Team Experimentation for SafetyAPP · M1.3-Art11
- 12Experiment Cost and Compute BudgetAPP · M1.3-Art12
- 13Regulatory Documentation for ExperimentsAPP · M1.3-Art13
- 14Experiment Brief and Experiment ReportAPP · M1.3-Art14
- 51Lab 01: Design and Execute an Offline Evaluation HarnessAPP · M1.3-Art51
- 52Lab 02: Design an Online A/B Test with Sample-Size Calculation and Rollback CriteriaAPP · M1.3-Art52
- 61Case Study: Zillow Offers and the Missing Shadow EvaluationAPP · M1.3-Art61
- 71Artifact Template: Experiment BriefAPP · M1.3-Art71