Imagine launching a website that works perfectly in testing, only to watch it struggle or crash the moment real users arrive.
CPU loadaverage is too high with ncnn. When inference the neural network with ncnn, the cpu occupancy is very high even all CPU cores occupancy close to 100%. If there are other threads or processes ...