https://ai-benchmark.com/ranking.html 手机GPU和CPU 评测
ONNX/MNN/NCNN/TVM/Coreml/tensorflow lite/OpenVINO//paddle lite/MindSpore lite/ArmNN/Tengine/neoml/

pytorch/MindSpore/tensorflow/keras/mxnet/xgboos/paddle/Jittor

ONNXruntime、Core ML、Caffe、Caffe2、Darknet, TorchScript、BigDL、Chainer、CNTK、Deeplearning4j、MediaPipe、ML.NET、Scikit-learn、TensorFlow.js、xgboost，catboost

mobile

frame device ops
pytorch CPU
GPU ,需要自定义编译		 https://pytorch.org/mobile/home/
paddle-lite CPU
GPU		 https://paddlelite.paddlepaddle.org.cn/quick_start/release_lib.html#android-toolchain-gcc https://paddlelite.paddlepaddle.org.cn/quick_start/release_lib.html#android-toolchain-gcc
TNN
MNN
tensorflow-lite https://tensorflow.google.cn/lite/guide/op_select_allowlist?hl=zh_cn
MindSpore lite CPU/GPU https://www.mindspore.cn/lite/docs/zh-CN/r1.3/use/downloads.html https://paddlelite.paddlepaddle.org.cn/introduction/support_operation_list.html
onnxruntime