ExLlamaV2

Fast local inference kernels.

ai-libraryfreeoss

inferencegpu

Kindai-library

Accessoss

Pricingfree

Free tier—

Caps2

GitHub ★4,651as of 2026-11-12

MACHINE-READABLE

GET /api/v1/resources/exllamav2