Chroma

Development512MB+ RAM

Open-source AI-native vector database for embeddings

Download Server Compass Install Chroma to VPS

aivector-databaseembeddingsrag

Deploy Chroma in 3 Steps

Connect Your VPS

Add your server credentials to Server Compass

Select Chroma

Choose from our template library

Deploy & Configure

Fill in settings and click Deploy

No Docker knowledge required

Step-by-step deployment guide

Deploy Chroma on a VPS with Server Compass

Use the Chroma template in Server Compass to deploy a self-hosted vector database API on your VPS, then verify the API heartbeat/auth response in a browser.

About 10 minutesBrowser verified

Step 1

Open the server Apps tab

Select the tutorial-vps VPS, open the Apps tab, and start a new app deployment. Keep sensitive server details hidden before capturing or sharing screenshots.

Server Compass Apps tab before creating an Chroma app

Step 2

Choose an app template

Click New App and choose the template deployment path so Server Compass can load the built-in catalog.

Choosing to deploy an app from a Server Compass template

Step 3

Search for Chroma

Use the template picker search to find Chroma in the Server Compass template catalog.

Searching for Chroma in the Server Compass template picker

Step 4

Select the Chroma template

Choose the Chroma template. Server Compass fills the Chroma service, persistent vector database volume, generated auth token, and API port.

Chroma template selected in Server Compass

Step 5

Review the Chroma settings

Confirm the app name and compose services. In this run, the app was named chromadb-demo and used host port 8000.

Reviewing Chroma project settings and compose services

Step 6

Deploy Chroma

Review the generated compose settings, confirm the API port is available, and click Deploy Now.

Reviewing Chroma environment variables and port before deployment

Step 7

Watch the deployment progress

Keep the deployment modal open while Server Compass uploads the compose file, pulls the Chroma image, starts the container, and verifies the stack.

Server Compass deploying the Chroma template on the VPS

Step 8

Confirm Chroma is running

After deployment finishes, return to the Apps tab and confirm the Chroma app is marked Running with its application URL available.

Chroma template running in the Server Compass Apps tab

Step 9

Open the Chroma API in the browser

Click Open Application or open the application URL in a browser. The Chroma API heartbeat/auth response confirms the vector database API is reachable.

The deployed Chroma API heartbeat/auth response loaded in a browser

After Chroma Opens

Do not expose Chroma directly to the public internet without a firewall, VPN, or authenticated reverse proxy.
Use a VPN, IP allowlist, or authenticated reverse proxy for production vector database API access.
Store only intended embeddings and monitor disk usage as collections grow.
Keep the Chroma image updated for database and security fixes.
Restrict API access to trusted applications and networks before storing private embeddings or metadata.

Verified Result

The Chroma API heartbeat/auth endpoint loaded successfully in a browser.

Download Server Compass Docs

Chroma deployment questions

What does the Chroma template deploy?

It deploys the Chroma container with a persistent `/chroma/chroma` data volume and token-authenticated Chroma API port.

Which port did the tutorial use?

The tutorial used host port 8000, which maps to the Chroma API on container port 8000.

Why does the browser verification stop at the first API response?

A fresh Chroma deployment is considered reachable when the HTTP API returns a heartbeat response or an expected auth challenge.

Should this become a blog post?

No. The deployment guide should live on the Chroma template detail page and be linked from the reusable template deployment docs page.

Why Self-Host Chroma?

Chroma is an AI-native vector database designed for storing and querying embeddings. Self-hosting your vector database is critical because embeddings can be reverse-engineered to reveal the source documents. Keeping Chroma on your own server ensures your proprietary knowledge base stays private and eliminates per-query costs from hosted vector DB services.

Your embeddings and source documents never leave your infrastructure

Zero per-query costs — unlimited vector searches on your hardware

Sub-millisecond similarity search for real-time RAG applications

Simple API that integrates with LangChain, LlamaIndex, and any LLM framework

Persistent storage for embeddings that survive restarts

Chroma vs Alternatives

Chroma vs Pinecone

Pinecone is a managed service with per-query pricing. Self-hosted Chroma has zero usage fees and full data control.

Chroma vs Weaviate

Weaviate is more feature-rich but heavier. Chroma is lightweight, easy to deploy, and ideal for most RAG use cases.

Chroma vs Qdrant

Both are excellent vector DBs. Chroma has a simpler API and lower resource requirements, making it easier for smaller deployments.

Why Deploy Chroma with Server Compass?

Server Compass deploys Chroma with persistent volume storage so your vector collections survive container updates. It pre-configures the REST API port and sets up the data directory automatically.

Download Server Compass

After Deployment

After deploying Chroma with Server Compass, complete these steps to finish setup

Test the API endpoint

Create collections

Start indexing embeddings

Need help? Check out our documentation for detailed guides.

Chroma FAQ

Common questions about self-hosting Chroma

How do I deploy Chroma with Server Compass?

Simply download Server Compass, connect to your VPS, and select Chroma from the templates list. Fill in the required configuration and click Deploy. The entire process takes under 3 minutes.

What are the system requirements for Chroma?

Chroma requires a minimum of 512MB RAM. We recommend a VPS with at least 1024MB RAM for optimal performance. Any modern Linux server with Docker support will work.

Can I migrate my existing Chroma data?

Yes! Server Compass provides volume mapping that allows you to import existing data. You can also use standard Chroma backup and restore procedures.

How do I update Chroma to the latest version?

Server Compass makes updates easy. Simply click the Update button in your deployment dashboard, and the latest Chroma image will be pulled and deployed with zero downtime.

Is Chroma free to self-host?

Chroma is open-source software. You only pay for your VPS hosting (typically $5-20/month) and optionally Server Compass ($29 one-time). No subscription fees or per-seat pricing.

Related Templates

View all Development

PocketBase

Open-source backend in a single file with realtime database, auth, and file storage

Appwrite

Open-source backend-as-a-service - self-hosted Firebase alternative

Parse Server

Open-source backend framework with dashboard

Supabase

Full Supabase self-hosted with Kong, GoTrue Auth, Realtime, and Studio

Ready to Self-Host Chroma?

Download Server Compass and deploy Chroma to your VPS in under 3 minutes. No Docker expertise required.

Download Server Compass