1
Step 1Open the server Apps tab
Select the tutorial-vps VPS, open the Apps tab, and start a new app deployment. Keep sensitive server details hidden before capturing or sharing screenshots.
Back to all templates
Crawl4AI
Development1024MB+ RAM
Open-source, LLM-friendly web crawler and scraper — async, fast, and built for RAG pipelines
developmentaicrawl4aiopen-sourceself-hosteddocker
Deploy Crawl4AI in 3 Steps
1
Connect Your VPS
Add your server credentials to Server Compass
2
Select Crawl4AI
Choose from our template library
3
Deploy & Configure
Fill in settings and click Deploy
No Docker knowledge required
Step-by-step deployment guide
Deploy Crawl4AI on a VPS with Server Compass
Use the Crawl4AI template in Server Compass to deploy a self-hosted LLM-friendly crawler API docs UI on your VPS, then verify the setup screen.
About 10 minutesBrowser verified
2
Step 2Choose an app template
Click New App and choose the template deployment path so Server Compass can load the built-in catalog.
3
Step 3Search for Crawl4AI
Use the template picker search to find Crawl4AI in the Server Compass template catalog.
4
Step 4Select the Crawl4AI template
Choose the Crawl4AI template. Server Compass fills the Crawl4AI API service, optional bearer token, headless browser shared memory, and public API port.
5
Step 5Review the Crawl4AI settings
Confirm the app name and compose service. In this run, the app was named crawl4ai-demo and used host port 4236.
6
Step 6Deploy Crawl4AI
Review the generated compose settings, confirm the Crawl4AI web port is available, and click Deploy.
7
Step 7Watch the deployment progress
Keep the deployment modal open while Server Compass uploads the compose file, pulls the Crawl4AI image, starts the container, and verifies the stack.
8
Step 8Confirm Crawl4AI is running
After deployment finishes, return to the Apps tab and confirm the Crawl4AI app is marked Running with its application URL available.
9
Step 9Open Crawl4AI in the browser
Open the application URL in a browser. The Crawl4AI setup or main page confirms the LLM-friendly crawler API docs UI is reachable.
After Crawl4AI Opens
- Place Crawl4AI behind HTTPS before storing or sharing real files.
- Change the generated admin password immediately after first login.
- Set a bearer token or firewall rule before exposing the crawler API.
- Back up the Crawl4AI config volume because it stores provider settings and the database.
- Put Crawl4AI behind HTTPS before exposing it to remote clients.
- Test a small public crawl before wiring it into a RAG pipeline.
- Keep the Crawl4AI image updated for dependency and security fixes.
Verified Result
The Crawl4AI web interface loaded successfully from the deployed container.
Crawl4AI deployment questions
What does the Crawl4AI template deploy?
It deploys the Crawl4AI LLM-friendly crawler API docs UI with API service configuration.
Which port did the tutorial use?
The tutorial used host port 4236, which maps to the Crawl4AI web UI on container port 11235.
Does Crawl4AI need setup after deployment?
Yes. Open the API docs, then test a small crawl request before production use.
Should this become a blog post?
No. The deployment guide should live on the Crawl4AI template detail page and be linked from the reusable template deployment docs page.
After Deployment
After deploying Crawl4AI with Server Compass, complete these steps to finish setup
1
Open http://YOUR_SERVER_IP:{{PORT}}/docs to see the OpenAPI playground
2
Test a crawl against a public URL with curl or the playground
3
(Optional) Set CRAWL4AI_API_TOKEN to require Bearer auth on every request
4
Wire it into your RAG / LLM pipeline as a markdown-extraction backend
Need help? Check out our documentation for detailed guides.
Crawl4AI FAQ
Common questions about self-hosting Crawl4AI
How do I deploy Crawl4AI with Server Compass?
Simply download Server Compass, connect to your VPS, and select Crawl4AI from the templates list. Fill in the required configuration and click Deploy. The entire process takes under 3 minutes.
What are the system requirements for Crawl4AI?
Crawl4AI requires a minimum of 1024MB RAM. We recommend a VPS with at least 2048MB RAM for optimal performance. Any modern Linux server with Docker support will work.
Can I migrate my existing Crawl4AI data?
Yes! Server Compass provides volume mapping that allows you to import existing data. You can also use standard Crawl4AI backup and restore procedures.
How do I update Crawl4AI to the latest version?
Server Compass makes updates easy. Simply click the Update button in your deployment dashboard, and the latest Crawl4AI image will be pulled and deployed with zero downtime.
Is Crawl4AI free to self-host?
Crawl4AI is open-source software. You only pay for your VPS hosting (typically $5-20/month) and optionally Server Compass ($29 one-time). No subscription fees or per-seat pricing.
Related Templates
View all Development
PocketBase
Open-source backend in a single file with realtime database, auth, and file storage
Appwrite
Open-source backend-as-a-service - self-hosted Firebase alternative
Parse Server
Open-source backend framework with dashboard
Supabase
Full Supabase self-hosted with Kong, GoTrue Auth, Realtime, and Studio
Ready to Self-Host Crawl4AI?
Download Server Compass and deploy Crawl4AI to your VPS in under 3 minutes. No Docker expertise required.
Download Server Compass