The benchmark tests will be continuously updated.
Pikachu_Apple(ANE, Apple Neural Engine)
Device: Mac mini 2023 , Apple M2[FP32]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
553 ms |
0.53 ms |
| Face Detect@320 |
1000 |
1635ms |
1.64ms |
| Face Detect@640 |
1000 |
5903ms |
5.90ms |
| Face Comparison |
1000 |
1ms |
0.001ms |
Note: The above data inference backend uses CoreML.
Megatron_Apple(ANE, Apple Neural Engine)
Device: iPhone13, Apple A15[FP32]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
711 ms |
0.71 ms |
| Face Detect@192 |
1000 |
832ms |
0.83ms |
| Face Detect@256 |
1000 |
931ms |
0.92ms |
| Face Detect@320 |
1000 |
1324ms |
1.32ms |
| Face Detect@640 |
1000 |
3881ms |
3.88ms |
| Face Extract(MNet) |
1000 |
853ms |
0.85ms |
| Face Extract(R50) |
1000 |
3856ms |
3.86ms |
Device: Mac mini 2023 , Apple M2[FP32]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
414 ms |
0.45 ms |
| Face Detect@192 |
1000 |
574ms |
0.57ms |
| Face Detect@256 |
1000 |
769ms |
0.77ms |
| Face Detect@320 |
1000 |
1073ms |
1.07ms |
| Face Detect@640 |
1000 |
3743ms |
3.74ms |
| Face Extract(MNet) |
1000 |
573ms |
0.57ms |
| Face Extract(R50) |
1000 |
3527ms |
3.53ms |
Note: The above data inference backend uses CoreML.
Pikachu(CPU)
Device: Macbook pro 16-inch, 2019 2.6 GHz Intel Core i7[FP32]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
4170.91578 ms |
4.1709 ms |
| Face Detect@320 |
1000 |
8493.06583 ms |
8.4893 ms |
| Face Detect@640 |
1000 |
25808.39749 ms |
25.808 ms |
| Face Light-Track |
1000 |
1957.73 ms |
1.9577 ms |
| Face alignment & Extract |
1000 |
6139.67 ms |
6.1397 ms |
| Face Comparison |
1000 |
0.24ms |
0.0002ms |
| Search Face from 1k |
1000 |
72.39ms |
0.07ms |
| Search Face from 5k |
1000 |
364.21ms |
0.36ms |
| Search Face from 10k |
1000 |
1193.26ms |
1.19ms |
Gundam_RV1109(RKNPU)
Device: RV1126[INT8]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
17342.88616ms |
17.34289ms |
| Face Detect@320 |
1000 |
22638.11865ms |
22.63812ms |
| Face Detect@640 |
1000 |
39745.28562ms |
39.74529ms |
| Face Light-Track |
1000 |
8858.03802ms |
8.85804ms |
| Face alignment & Extract |
1000 |
42352.03367ms |
42.35203ms |
| Face Comparison |
1000 |
1.30754ms |
0.00131ms |
| Search Face from 1k |
1000 |
3198.13874ms |
3.19814ms |
| Search Face from 5k |
1000 |
15745.00533ms |
15.74501ms |
| Search Face from 10k |
1000 |
31267.2301ms |
31.26723ms |
Gundam_RV1106(RKNPU2)
Device: RV1106[INT8]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
23776ms |
23.78ms |
| Face Detect@320 |
1000 |
33310ms |
33.31ms |
| Face Detect@640 |
1000 |
58631ms |
58.63ms |
| Face Light-Track |
1000 |
15642ms |
15.64ms |
| Face alignment & Extract |
1000 |
15178ms |
15.18ms |
| Face Comparison |
1000 |
23ms |
0.023us |
Gundam_RK356X(RKNPU2)
Device: RK3568[INT8]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
16946ms |
16.95ms |
| Face Detect@320 |
1000 |
25108ms |
25.11ms |
| Face Detect@640 |
1000 |
68778ms |
68.78ms |
| Face Light-Track |
1000 |
11215ms |
11.22ms |
| Face alignment & Extract |
1000 |
9070ms |
9.07ms |
| Face Comparison |
1000 |
9ms |
0.009ms |
Megatron_TRT(CUDA)
Device: NVIDIA RTX3060 12G[FP16]
| Benchmark |
Loops |
Total Time |
Average Time |
| Face Detect@160 |
1000 |
911ms |
0.91ms |
| Face Detect@320 |
1000 |
2374ms |
2.37ms |
| Face Detect@640 |
1000 |
8685ms |
8.685ms |
| Face Light-Track |
1000 |
621ms |
0.62ms |
| Face alignment & Extract |
1000 |
1009ms |
1.01ms |
| Face Comparison |
1000 |
1ms |
0.001ms |
Note: The test results are all calculated by the test programs in the 'cpp/test' subproject.
