qqc1989 commited on
Commit
a2fbf49
·
verified ·
1 Parent(s): 40cfd9d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +127 -3
README.md CHANGED
@@ -1,3 +1,127 @@
1
- ---
2
- license: bsd-3-clause
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Ultralytics/YOLO11
7
+ pipeline_tag: object-detection
8
+ tags:
9
+ - Ultralytics
10
+ - YOLO11
11
+ - YOLO11-Seg
12
+ ---
13
+
14
+ # YOLO11-Seg
15
+
16
+ This version of YOLO11-Seg has been converted to run on the Axera NPU using **w8a16** quantization.
17
+
18
+ This model has been optimized with the following LoRA:
19
+
20
+ Compatible with Pulsar2 version: 3.4
21
+
22
+ ## Convert tools links:
23
+
24
+ For those who are interested in model conversion, you can try to export axmodel through
25
+
26
+ - [The repo of AXera Platform](https://github.com/AXERA-TECH/ax-samples), which you can get the detial of guide
27
+
28
+ - [Pulsar2 Link, How to Convert ONNX to axmodel](https://pulsar2-docs.readthedocs.io/en/latest/pulsar2/introduction.html)
29
+
30
+
31
+ ## Support Platform
32
+
33
+ - AX650
34
+ - [M4N-Dock(爱芯派Pro)](https://wiki.sipeed.com/hardware/zh/maixIV/m4ndock/m4ndock.html)
35
+ - [M.2 Accelerator card](https://axcl-docs.readthedocs.io/zh-cn/latest/doc_guide_hardware.html)
36
+ - AX630C
37
+ - [爱芯派2](https://axera-pi-2-docs-cn.readthedocs.io/zh-cn/latest/index.html)
38
+ - [Module-LLM](https://docs.m5stack.com/zh_CN/module/Module-LLM)
39
+ - [LLM630 Compute Kit](https://docs.m5stack.com/zh_CN/core/LLM630%20Compute%20Kit)
40
+
41
+ |Chips|YOLO11x-Seg|
42
+ |--|--|
43
+ |AX650| 34 ms |
44
+ |AX630C| TBD ms |
45
+
46
+ ## How to use
47
+
48
+ Download all files from this repository to the device
49
+
50
+ ```
51
+
52
+ root@ax650:~/YOLO11-Pose# tree
53
+ .
54
+ |-- ax650
55
+ | `-- yolo11x-seg.axmodel
56
+ |-- ax_yolo11_seg
57
+ |-- football.jpg
58
+ `-- yolo11_seg_out.jpg
59
+ ```
60
+
61
+ ### Inference
62
+
63
+ Input image:
64
+ ![](./football.jpg)
65
+
66
+ #### Inference with AX650 Host, such as M4N-Dock(爱芯派Pro)
67
+
68
+ ```
69
+ root@ax650:~/samples/AXERA-TECH/YOLO11-Seg# ./ax_yolo11_seg -m ax650/yolo11x-seg.axmodel -i football.jpg
70
+ --------------------------------------
71
+ model file : ax650/yolo11x-seg.axmodel
72
+ image file : football.jpg
73
+ img_h, img_w : 640 640
74
+ --------------------------------------
75
+ Engine creating handle is done.
76
+ Engine creating context is done.
77
+ Engine get io info is done.
78
+ Engine alloc io is done.
79
+ Engine push input is done.
80
+ --------------------------------------
81
+
82
+ input size: 1
83
+ name: images [UINT8] [BGR]
84
+ 1 x 640 x 640 x 3
85
+
86
+
87
+ output size: 7
88
+ name: /model.23/Concat_1_output_0 [FLOAT32]
89
+ 1 x 80 x 80 x 144
90
+
91
+ name: /model.23/Concat_2_output_0 [FLOAT32]
92
+ 1 x 40 x 40 x 144
93
+
94
+ name: /model.23/Concat_3_output_0 [FLOAT32]
95
+ 1 x 20 x 20 x 144
96
+
97
+ name: /model.23/cv4.0/cv4.0.2/Conv_output_0 [FLOAT32]
98
+ 1 x 80 x 80 x 32
99
+
100
+ name: /model.23/cv4.1/cv4.1.2/Conv_output_0 [FLOAT32]
101
+ 1 x 40 x 40 x 32
102
+
103
+ name: /model.23/cv4.2/cv4.2.2/Conv_output_0 [FLOAT32]
104
+ 1 x 20 x 20 x 32
105
+
106
+ name: output1 [FLOAT32]
107
+ 1 x 32 x 160 x 160
108
+
109
+ post process cost time:16.90 ms
110
+ --------------------------------------
111
+ Repeat 1 times, avg time 34.59 ms, max_time 34.59 ms, min_time 34.59 ms
112
+ --------------------------------------
113
+ detection num: 9
114
+ 0: 94%, [ 757, 220, 1127, 1154], person
115
+ 0: 94%, [ 0, 357, 314, 1112], person
116
+ 0: 93%, [1353, 339, 1629, 1037], person
117
+ 0: 91%, [ 494, 476, 659, 1001], person
118
+ 32: 86%, [1231, 877, 1281, 922], sports ball
119
+ 32: 73%, [ 774, 887, 828, 938], sports ball
120
+ 32: 66%, [1012, 882, 1051, 927], sports ball
121
+ 0: 54%, [ 0, 543, 83, 1000], person
122
+ 0: 46%, [1837, 696, 1877, 814], person
123
+ --------------------------------------
124
+ ```
125
+
126
+ Output image:
127
+ ![](./yolo11_seg_out.jpg)