Argilla

Development2048MB+ RAM

Data curation platform for LLMs - feedback, RLHF, and evaluation

Download Server Compass Install Argilla to VPS

aillmrlhfdata-curationevaluation

Deploy Argilla in 3 Steps

Connect Your VPS

Add your server credentials to Server Compass

Select Argilla

Choose from our template library

Deploy & Configure

Fill in settings and click Deploy

No Docker knowledge required

Step-by-step deployment guide

Deploy Argilla on a VPS with Server Compass

Use the Argilla template in Server Compass to deploy a web-based data curation, feedback, and evaluation platform for LLM workflows on your VPS, then verify the login screen in a browser.

About 10 minutesBrowser verified

Step 1

Open the server Apps tab

Select the tutorial-vps VPS, open the Apps tab, and start a new app deployment. Keep sensitive server details hidden before capturing or sharing screenshots.

Server Compass Apps tab before creating a Argilla app

Step 2

Choose an app template

Click New App and choose the template deployment path so Server Compass can load the built-in catalog.

Choosing to deploy an app from a Server Compass template

Step 3

Search for Argilla

Use the template picker search to find Argilla in the Server Compass template catalog.

Searching for Argilla in the Server Compass template picker

Step 4

Select the Argilla template

Choose the Argilla template. Server Compass fills the Argilla service, PostgreSQL database, Elasticsearch service, generated auth secret, generated admin password, generated API key, and web port.

Argilla template selected in Server Compass

Step 5

Review the Argilla settings

Confirm the app name and compose services. In this run, the app was named argilla-demo and used host port 6900.

Reviewing Argilla project settings and compose services

Step 6

Deploy Argilla

Review the generated compose settings, confirm the web port is available, and click Deploy Now.

Reviewing Argilla environment variables and port before deployment

Step 7

Watch the deployment progress

Keep the deployment modal open while Server Compass uploads the compose file, pulls the Argilla image, starts the container, and verifies the stack.

Server Compass deploying the Argilla template on the VPS

Step 8

Confirm Argilla is running

After deployment finishes, return to the Apps tab and confirm the Argilla app is marked Running with its application URL available.

Argilla template running in the Server Compass Apps tab

Step 9

Open Argilla in the browser

Click Open Application or open the application URL in a browser. The Argilla login screen confirms the data curation UI is reachable.

The deployed Argilla login screen loaded in a browser

After Argilla Opens

Do not expose Argilla directly to the public internet without HTTPS, strong admin credentials, and an additional access-control layer.
Use a VPN, IP allowlist, or authenticated reverse proxy for production feedback and annotation access.
Change the generated default user password after first login and rotate the generated API key if it is shared outside the deployment team.
Back up both PostgreSQL and Elasticsearch data before upgrades because Argilla stores metadata and search/index data across both services.
Keep the Argilla and Elasticsearch images updated for security and compatibility fixes.
Restrict dataset, feedback, and evaluation access to trusted users before uploading private data.

Verified Result

The Argilla web UI loaded successfully in a browser.

Download Server Compass Docs

Argilla deployment questions

What does the Argilla template deploy?

It deploys the Argilla server with PostgreSQL for application data, Elasticsearch for search/indexing, generated auth/API secrets, and persistent volumes for both backing services.

Which port did the tutorial use?

The tutorial used host port 6900, which maps to the Argilla web UI on container port 6900.

Why does the browser verification stop at the first web UI screen?

A fresh Argilla deployment is considered reachable when the login screen loads. The tutorial does not log in or publish the generated admin password, API key, database password, or auth secret.

Should this become a blog post?

No. The deployment guide should live on the Argilla template detail page and be linked from the reusable template deployment docs page.

Why Self-Host Argilla?

Argilla is a data curation platform purpose-built for LLM development — RLHF, evaluation, and feedback collection. Self-hosting ensures your model evaluation data, human feedback, and fine-tuning datasets remain on your infrastructure. This is essential when working with proprietary models or data subject to regulation.

Purpose-built for LLM data curation, RLHF, and evaluation

Keep human feedback and evaluation data on your own server

Integrate with Hugging Face, OpenAI, and any model provider

Collaborative annotation with team workspaces

Export datasets in standard formats for model fine-tuning

Argilla vs Alternatives

Argilla vs Scale RLHF

Scale charges per annotation. Self-hosted Argilla provides unlimited RLHF data collection with no platform fees.

Argilla vs Label Studio

Label Studio is general-purpose. Argilla is specifically designed for LLM data curation with native NLP-focused interfaces.

Argilla vs Humanloop

Humanloop is a hosted service. Argilla gives you the same LLM evaluation workflow self-hosted with full data ownership.

Why Deploy Argilla with Server Compass?

Server Compass deploys Argilla with Elasticsearch backend pre-configured for storing and searching annotation data. The entire stack — Argilla, Elasticsearch, and persistent storage — deploys in one click.

Download Server Compass

After Deployment

After deploying Argilla with Server Compass, complete these steps to finish setup

Create datasets

Configure annotation guidelines

Need help? Check out our documentation for detailed guides.

Argilla FAQ

Common questions about self-hosting Argilla

How do I deploy Argilla with Server Compass?

Simply download Server Compass, connect to your VPS, and select Argilla from the templates list. Fill in the required configuration and click Deploy. The entire process takes under 3 minutes.

What are the system requirements for Argilla?

Argilla requires a minimum of 2048MB RAM. We recommend a VPS with at least 4096MB RAM for optimal performance. Any modern Linux server with Docker support will work.

Can I migrate my existing Argilla data?

Yes! Server Compass provides volume mapping that allows you to import existing data. You can also use standard Argilla backup and restore procedures.

How do I update Argilla to the latest version?

Server Compass makes updates easy. Simply click the Update button in your deployment dashboard, and the latest Argilla image will be pulled and deployed with zero downtime.

Is Argilla free to self-host?

Argilla is open-source software. You only pay for your VPS hosting (typically $5-20/month) and optionally Server Compass ($29 one-time). No subscription fees or per-seat pricing.

Related Templates

View all Development

PocketBase

Open-source backend in a single file with realtime database, auth, and file storage

Appwrite

Open-source backend-as-a-service - self-hosted Firebase alternative

Parse Server

Open-source backend framework with dashboard

Supabase

Full Supabase self-hosted with Kong, GoTrue Auth, Realtime, and Studio

Ready to Self-Host Argilla?

Download Server Compass and deploy Argilla to your VPS in under 3 minutes. No Docker expertise required.

Download Server Compass