Batch and Online Inference at Scale - Eustad