Run multi-agent swarm intelligence simulations that forecast future outcomes from seed data including news events, policy drafts, and financial signals.
LMCache
Open source alternative to Amazon SageMaker
Optimize LLM inference with a self-hosted KV cache layer that reuses context across vLLM deployments.
About LMCache
LMCache is an open source tool in AI & Machine Learning. Use it as a free, self-hostable alternative to Amazon SageMaker.
Optimize LLM inference with a self-hosted KV cache layer that reuses context across vLLM deployments.
Licensed under Apache-2.0 with 12,100 stars on GitHub.
More open source ai & machine learning tools
See all →
Connect 352 AI providers through one OpenAI-compatible endpoint, with automatic fallback, 19 routing strategies, and 15-95% token compression. MIT licensed.
Run local LLM training and inference with an open-source Studio UI and optimized Python library.
Build AI agents that learn over time using Hindsight, a self-hosted MIT-licensed memory system with multi-strategy retrieval and knowledge consolidation.