Preface

Describes how to develop CANN AICPU Custom operators , With a AICPU Operator as an example , analysis + Realization + Test and verify an end-to-end complete development process .

summary

AI CPU operator , Is running in shengteng AI In the processor AI CPU The operation of expressing a complete computational logic on a computing unit , In the following cases , Developers need to customize AI CPU operator .

stay NN In the process of model training or reasoning , Transform the third-party open source framework into adaptive shengteng AI The processor model encountered rising AI Operators not supported by the processor . here , In order to quickly get through the model execution process , Users can customize AI CPU Operator for function adjustment , Improve the debugging efficiency . After the function is adjusted , In the subsequent performance testing process AI CPU The custom operator is converted to TBE Operator implementation .

In some cases , Can't be realized in AI Core Custom operators running on （ For example, some operators need Complex32、Complex64 type , but AI Core Command does not support ; Another example is the operator that contains a large number of scalar calculations , and AI Core Not good at scalar processing ）, At this time, you can develop AI CPU Custom operator to achieve ascension AI Processor support for this operator .

The goal is

Can be based on AI CPU People who develop simple operators , It can be achieved ：

1. Study AI CPU Basic implementation principle and method of operator .

2. Can be based on examples in the course , Extension for other customization AI CPU Operator development .

If you have the following skills , Can better complete learning ：

1. Have C++ Program development ability

2. Understand mathematical expressions

3. Machine learning 、 Deep learning has a certain understanding

4. understand Ascend Platform operation process and principle

5. understand Ascend Platform TBE Custom operator development process

The basic concept of operator

Ascend 310 Processor architecture logic

AI CPU Operator development process

Operator analysis

Introduction to directory structure