Phase 714 DaysAdvanced

Phase 7 β€” System Design & MLOps

Deploy, monitor, and continuously improve AI systems in production β€” covering serving APIs, containers, CI/CD, drift detection, and cost governance.

  • Ship a production-grade FastAPI service with validation, Docker, and health checks.
  • Set up MLflow experiment tracking and post-deployment monitoring.
  • Build CI/CD pipelines that lint, test, and deploy on every commit.

⚑ Must Know

  • FastAPI β€” async endpoints, Pydantic validation
  • Docker β€” Dockerfile, images, containers
  • Model Serialization β€” ONNX, safetensors, joblib
  • MLflow β€” experiment tracking, model registry
  • GitHub Actions β€” CI/CD pipelines
  • Model Monitoring β€” data drift, concept drift
  • Data Versioning β€” DVC
  • Cloud Basics β€” AWS/GCP (S3, EC2, Cloud Run)
  • Latency + Throughput optimization
  • A/B Testing for models

✨ Good to Know

  • Kubernetes basics
  • Prometheus + Grafana monitoring
  • Weights & Biases β€” W&B Sweeps
  • Serverless β€” Lambda, Cloud Run
  • Apache Airflow β€” data orchestration
  • Cost optimization β€” batching, caching, quantization

πŸ“š Resources

FastAPI Tutorial
Docsby SebastiΓ‘n RamΓ­rez

Official tutorial β€” the fastest way to learn production API patterns.

fastapi.tiangolo.com β†—
MLflow Docs
Docsby Databricks

End-to-end ML lifecycle: tracking, registry, and serving.

mlflow.org β†—
Docker Get Started
Docsby Docker

Official guide from Dockerfile basics to compose.

docs.docker.com β†—
Full Stack Deep Learning
Courseby FSDL Team

Best end-to-end coverage of production ML engineering.

fullstackdeeplearning.com β†—

πŸ—οΈ Projects

ML REST API (Deployed)

Model-serving API with validation, containerization, and guardrails.

FastAPIDockerPydantic

LLM App + Monitoring

LLM app with MLflow traces, latency metrics, and quality drift tracking.

MLflowLLMMonitoring