Run LLMs, voice, vision, and image models locally with an OpenAI-compatible API. MIT licensed, no GPU required.
Open source alternatives to Groq
1 free, self-hostable tool you can use instead of Groq.
1 free, self-hostable tool you can use instead of Groq.
Run LLMs, voice, vision, and image models locally with an OpenAI-compatible API. MIT licensed, no GPU required.