Get in Touch

Course Outline

Introduction to Apache Airflow for Machine Learning

  • Overview of Apache Airflow and its relevance to data science.
  • Key features for automating machine learning workflows.
  • Setting up Airflow for data science projects.

Building Machine Learning Pipelines with Airflow

  • Designing DAGs for end-to-end machine learning workflows.
  • Using operators for data ingestion, preprocessing, and feature engineering.
  • Scheduling and managing pipeline dependencies.

Model Training and Validation

  • Automating model training tasks with Airflow.
  • Integrating Airflow with ML frameworks (e.g., TensorFlow, PyTorch).
  • Validating models and storing evaluation metrics.

Model Deployment and Monitoring

  • Deploying machine learning models using automated pipelines.
  • Monitoring deployed models with Airflow tasks.
  • Handling retraining and model updates.

Advanced Customisation and Integration

  • Developing custom operators for machine learning-specific tasks.
  • Integrating Airflow with cloud platforms and machine learning services.
  • Extending Airflow workflows with plugins and sensors.

Optimising and Scaling Machine Learning Pipelines

  • Improving workflow performance for large-scale data.
  • Scaling Airflow deployments with Celery and Kubernetes.
  • Best practices for production-grade machine learning workflows.

Case Studies and Practical Applications

  • Real-world examples of machine learning automation using Airflow.
  • Practical exercise: Building an end-to-end machine learning pipeline.
  • Discussion of challenges and solutions in machine learning workflow management.

Summary and Next Steps

Requirements

  • Familiarity with machine learning workflows and concepts.
  • A foundational understanding of Apache Airflow, including Directed Acyclic Graphs (DAGs) and operators.
  • Proficiency in Python programming.

Audience

  • Data scientists.
  • Machine learning engineers.
  • AI developers.
 21 Hours

Custom Corporate Training

Training solutions designed exclusively for businesses.

  • Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
  • Flexible Schedule: Dates and times adapted to your team's agenda.
  • Format: Online (live), In-company (at your offices), or Hybrid.
Investment

Price per private group, online live training, starting from 3900 € + VAT*

Contact us for an exact quote and to hear our latest promotions

Provisional Upcoming Courses (Contact Us For More Information)

Related Categories