Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Foundations of Custom Operator Development
- Rationale for building custom operators: use cases and system constraints.
- Architecture of the CANN runtime and key operator integration points.
- Contextual overview of TBE, TIK, and TVM within the Huawei AI ecosystem.
Low-Level Operator Programming with TIK
- Exploring the TIK programming model and its supported APIs.
- Managing memory and implementing tiling strategies within TIK.
- The process of creating, compiling, and registering a custom operation with CANN.
Testing and Validation of Custom Operations
- Conducting unit and integration tests for operations within the execution graph.
- Diagnosing and resolving kernel-level performance bottlenecks.
- Visualizing operation execution flows and buffer dynamics.
Scheduling and Optimization using TVM
- Understanding TVM as a compiler framework for tensor operations.
- Constructing schedules for custom operations within TVM.
- Performing TVM-based tuning, benchmarking, and code generation for Ascend targets.
Framework and Model Integration
- Registering custom operations for compatibility with MindSpore and ONNX.
- Ensuring model integrity and managing fallback behaviors.
- Handling multi-operator graphs that utilize mixed precision.
Case Studies and Specialized Optimization Techniques
- Analyzing high-efficiency convolution implementations for small input shapes.
- Optimizing memory-aware attention operators.
- Adopting best practices for deploying custom operations across various devices.
Conclusion and Future Directions
Requirements
- In-depth understanding of AI model internals and operator-level computation.
- Proficiency in Python and Linux development environments.
- Familiarity with neural network compilers or graph-level optimization tools.
Audience
- Compiler engineers involved in AI toolchain development.
- Systems developers specializing in low-level AI performance optimization.
- Developers creating custom operations or targeting emerging AI workloads.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 2600 € + VAT*
Contact us for an exact quote and to hear our latest promotions
