Run local LLM training and inference with an open-source Studio UI and optimized Python library.
Open source alternatives to Google Cloud Vertex AI
4 free, self-hostable tools you can use instead of Google Cloud Vertex AI, sorted by GitHub stars.
Alternatives to Google Cloud Vertex AI 4
accelerate
Replaces Google Cloud Vertex AI
Run PyTorch training scripts across any distributed hardware configuration with minimal code changes, adding support for multi-GPU, TPU, and mixed precision.
ODS
Replaces Google Cloud Vertex AI
Transform your PC into a private AI server. Bundles local LLM inference, Open WebUI, agents, workflows, RAG, and voice in one Apache-2.0 stack.
Ploomber
Replaces Google Cloud Vertex AI
Build reproducible Python data pipelines from notebooks and scripts. Apache-2.0 licensed, with cached DAG runs and self-hosted deployment options.