Toolverse
All tools
Nexa SDK

Nexa SDK

Nexa SDK is an on-device inference framework that runs any model on any device, across any backend. It runs on CPUs, GPUs, NPUs with backend support for CUDA, Metal, Vulkan, and Qualcomm NPU. It handles multiple input modalities including text ๐Ÿ“, image ๐Ÿ–ผ๏ธ, and audio ๐ŸŽง. The...

Quick info

Pricing
Unknown
Last updated
Apr 21, 2026

Description

Nexa SDK is an on-device inference framework that runs any model on any device, across any backend. It runs on CPUs, GPUs, NPUs with backend support for CUDA, Metal, Vulkan, and Qualcomm NPU. It handles multiple input modalities including text ๐Ÿ“, image ๐Ÿ–ผ๏ธ, and audio ๐ŸŽง. The SDK includes an OpenAI-compatible API server with support for JSON schema-based function calling and streaming. It supports model formats such as GGUF, MLX, Nexa AI's own .nexa format, enabling efficient quantized inference across diverse platforms.

Alternatives