Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Performance Fundamentals and Key Metrics
- Analyzing latency, throughput, power consumption, and resource utilization
- Distinguishing between system and model-level bottlenecks
- Profiling strategies for inference versus training phases
Profiling on Huawei Ascend
- Leveraging CANN Profiler and MindInsight
- Diagnosing kernel and operator performance
- Managing offload patterns and memory mapping
Profiling on Biren GPU
- Utilizing Biren SDK performance monitoring capabilities
- Addressing kernel fusion, memory alignment, and execution queues
- Conducting power and temperature-aware profiling
Profiling on Cambricon MLU
- Employing BANGPy and Neuware performance tools
- Interpreting kernel-level visibility and logs
- Integrating the MLU profiler with deployment frameworks
Graph and Model-Level Optimization
- Strategies for graph pruning and quantization
- Operator fusion and restructuring computational graphs
- Standardizing input sizes and tuning batch parameters
Memory and Kernel Optimization
- Optimizing memory layouts and data reuse
- Managing buffers efficiently across different chipsets
- Applying kernel-level tuning techniques specific to each platform
Cross-Platform Best Practices
- Ensuring performance portability through abstraction strategies
- Developing shared tuning pipelines for multi-chip environments
- Case study: tuning an object detection model across Ascend, Biren, and MLU
Conclusions and Recommended Next Steps
Requirements
- Hands-on experience with AI model training or deployment pipelines
- A solid grasp of GPU/MLU computational principles and model optimization techniques
- Familiarity with standard performance profiling tools and key metrics
Target Audience
- Performance engineers
- Machine learning infrastructure teams
- AI system architects
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 3900 € + VAT*
Contact us for an exact quote and to hear our latest promotions
