ExLlamaV2

Fast local inference kernels.

ai-libraryfreeoss

inferencegpu

Kindai-library

Accessoss

Pricingfree

Free tier—

Caps2

MACHINE-READABLE

GET /api/v1/resources/exllamav2