Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

75

Base only

Active filters: arm-optimized

Arm/deit-tiny-int8-xnnpack-executorch

Image Classification • Updated 13 days ago • 307

Arm/resnet-50-int8-xnnpack-executorch

Image Classification • Updated 13 days ago • 542

Arm/resnet-18-int8-xnnpack-executorch

Image Classification • Updated 13 days ago • 394

Arm/squeezenet-1-1-int8-xnnpack-executorch

Image Classification • Updated 12 days ago • 166

Arm/shufflenet-v2-x1-0-int8-xnnpack-executorch

Image Classification • Updated 13 days ago • 163

Arm/googlenet-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 12 days ago • 321

Arm/vit-base-int8-xnnpack-executorch

Image Classification • Updated 5 days ago • 1.35k

Arm/swin-tiny-int8-xnnpack-executorch

Image Classification • Updated 13 days ago • 528

Arm/inception-v3-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 13 days ago • 523

Arm/llama-3-2-1b-base-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 13 days ago • 29

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 13 days ago • 32

Arm/yolov8s-int8-xnnpack-executorch

Object Detection • Updated 5 days ago • 41

Arm/whisper-tiny-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 13 days ago • 49

Arm/whisper-small-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 12 days ago • 79

Arm/whisper-base-int8-litert

Automatic Speech Recognition • Updated 13 days ago • 30

Arm/whisper-medium-int8-litert

Automatic Speech Recognition • Updated 13 days ago • 16

Arm/whisper-large-v3-int8-litert

Automatic Speech Recognition • Updated 12 days ago • 20

Arm/efficient-sam-s-int8-xnnpack-executorch

Image Segmentation • Updated 13 days ago • 58

Arm/yolov8s-seg-int8-xnnpack-executorch

Image Segmentation • Updated 12 days ago • 55

Arm/yolov7-seg-int8-xnnpack-executorch

Image Segmentation • Updated 12 days ago • 73

Arm/mobile-sam-int8-xnnpack-executorch

Image Segmentation • Updated 12 days ago • 60

Arm/minilm-l6-v2-int8-litert

Feature Extraction • Updated 13 days ago • 11

Arm/bge-base-en-v1.5-int8-litert

Feature Extraction • Updated 13 days ago • 23

Arm/nomic-embed-text-v1-int8-litert

Feature Extraction • Updated 13 days ago • 12

Arm/mobilenet-v3-small-int8-xnnpack-executorch

Image Classification • Updated 12 days ago • 181

Arm/qwen3-0-6b-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 13 days ago • 53

Arm/llama-3-2-3b-instruct-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 13 days ago • 39

Arm/gemma-3-1b-base-onnx-genai-int4-emb-int8

Text Generation • Updated 13 days ago • 34

Arm/gemma-3-1b-instruct-onnx-genai-int4-emb-int8

Text Generation • Updated 13 days ago • 40

Arm/qwen2-5-1-5b-instruct-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 13 days ago • 42