PcDuino9 AI visual edge computing development kit
- 1 Introduction
- 2 Basic Framework
- 3 Package List
- 4 Hardware Introduction
- 5 How To Develop
- 6 Resources
pcDuino9 AI computer vision edge computing development kit is for AI based security application.
The kit includes general IPC using hi3516D solution and pcDuino9 embedded AI edge computing module. The kit mainly uses the pcDuino9 embedded module to process the video stream acquired from hi3516D, and carries out a series of analysis and processing of the video stream. The kit builds a basic development environment for developers. It provides video frames obtained from hi3516D by pcDuino9, developers can freely develop on the raw frame, such as face detection, license plate detection, object detection and other AI functions. At the same time, it provides an open API interface. Developers can return the information which were processed on pcDuino9 to hi3516D, and the detected image can be optimized select on hi3516D, and then output them via FTP.
Moreover, if RK3288 processing not enough, Movidius module can be added to the pcDuino9 to extend the processing power.
The development environment has been provided:
1. pcDuino9 Gets Video Frames from hi3516D
2. Return the information analyzed and processed by the developer to hi3516D
3. Select high quality pictures which has been analyzed on hi3516D and output them via FTP
Examples of development functions
1. Developing Frame maps on pcDuino9，such as face detection, license plate detection, object detection and other AI image analysis and processing functions.
2. Output of the analyzed pictures via FTP for other application requirements
• General IPC with Hi3516D
The introduction of pcDuino9 embedded AI visual edge computing module
RK3288 CPU Benchmark
Specifications of Hi3516D IPC
How To Develop
How To Get Video Frames from Hi3516D
Hi3516 transfers BT1120 data to pcDuino 9. pcDuino 9 converts BT1120 data into MIPI signal through LT8918, and then receives it. At present, it supports 640x480 60FPS frame data transmission. We encapsulate the protocol layer and make it similar to OpenCV style. While reading the frame data, we will return the frame number, which is transmitted by 3516 and is the synchronous frame number for data interaction.
How To Optimize Your Network and Run Object Detect
pcDuino9 has a CPU with Quad-Core Cortex-A17 up to 1.8GHz and GPU with ARM Mali-T764. if you would like to run your Network on CPU,you can refer to NCNN.or if you would like to run your Network on GPU,you can refer to MACE.
How To Communicate With IPC
We provide an open API interface. Developers can return the information which were processed on pcDuino9 to hi3516D, and the detected image can be optimized select on hi3516D, and then output them via FTP.