Argilla

Development2048MB+ RAM

Data curation platform for LLMs - feedback, RLHF, and evaluation

Download Server Compass View Documentation

aillmrlhfdata-curationevaluation

Deploy Argilla in 3 Steps

Connect Your VPS

Add your server credentials to Server Compass

Select Argilla

Choose from our template library

Deploy & Configure

Fill in settings and click Deploy

No Docker knowledge required

Why Self-Host Argilla?

Argilla is a data curation platform purpose-built for LLM development — RLHF, evaluation, and feedback collection. Self-hosting ensures your model evaluation data, human feedback, and fine-tuning datasets remain on your infrastructure. This is essential when working with proprietary models or data subject to regulation.

Purpose-built for LLM data curation, RLHF, and evaluation

Keep human feedback and evaluation data on your own server

Integrate with Hugging Face, OpenAI, and any model provider

Collaborative annotation with team workspaces

Export datasets in standard formats for model fine-tuning

Argilla vs Alternatives

Argilla vs Scale RLHF

Scale charges per annotation. Self-hosted Argilla provides unlimited RLHF data collection with no platform fees.

Argilla vs Label Studio

Label Studio is general-purpose. Argilla is specifically designed for LLM data curation with native NLP-focused interfaces.

Argilla vs Humanloop

Humanloop is a hosted service. Argilla gives you the same LLM evaluation workflow self-hosted with full data ownership.

Why Deploy Argilla with Server Compass?

Server Compass deploys Argilla with Elasticsearch backend pre-configured for storing and searching annotation data. The entire stack — Argilla, Elasticsearch, and persistent storage — deploys in one click.

Download Server Compass

After Deployment

After deploying Argilla with Server Compass, complete these steps to finish setup

Create datasets

Configure annotation guidelines

Need help? Check out our documentation for detailed guides.

Argilla FAQ

Common questions about self-hosting Argilla

How do I deploy Argilla with Server Compass?

Simply download Server Compass, connect to your VPS, and select Argilla from the templates list. Fill in the required configuration and click Deploy. The entire process takes under 3 minutes.

What are the system requirements for Argilla?

Argilla requires a minimum of 2048MB RAM. We recommend a VPS with at least 4096MB RAM for optimal performance. Any modern Linux server with Docker support will work.

Can I migrate my existing Argilla data?

Yes! Server Compass provides volume mapping that allows you to import existing data. You can also use standard Argilla backup and restore procedures.

How do I update Argilla to the latest version?

Server Compass makes updates easy. Simply click the Update button in your deployment dashboard, and the latest Argilla image will be pulled and deployed with zero downtime.

Is Argilla free to self-host?

Argilla is open-source software. You only pay for your VPS hosting (typically $5-20/month) and optionally Server Compass ($29 one-time). No subscription fees or per-seat pricing.