Problem framing and data
Syllabus
Detailed content
Translate a question into a learning task
Decide what the model should predict, for whom, and at what point the prediction will be used. Identify the unit of prediction, available features, target label, and cost of errors. A model is useful only if its output changes a decision better than a simple rule or existing process.
Prepare and split a dataset
Inspect types, missing values, duplicates, class balance, and label quality before training. Split examples into training, validation, and test sets in a way that reflects deployment: time-based for future prediction, grouped when entities repeat, and stratified when class balance matters. Keep the final test set untouched until evaluation.
Build a baseline and feature pipeline
A baseline establishes the performance a model must beat. Use simple rules or a basic estimator first. Fit preprocessing only on training data, then apply the learned transform to validation and test data. Package feature steps with the model so inference uses the same transformations as training.