🚀 Advanced Automation Stack - Automated Installer

Overview

This comprehensive installer deploys a complete AI-powered automation infrastructure with workflow automation, vector search, backend services, and object storage - all with automatic SSL certificates and secure password generation.

🎯 What Gets Installed

Core Services (Always Installed)

1. n8n - Workflow Automation

Visual workflow builder
400+ integrations
Webhook support
Scheduled workflows
URL: https://n8n.yourdomain.com

2. PostgreSQL - Database

Shared database for all services
pgvector extension enabled
Optimized for AI workloads
Internal: Port 5432

3. Redis - Cache & Queue

High-performance caching
Job queue management
Session storage
Internal: Port 6379

4. Qdrant - Vector Database

AI embeddings storage
Semantic search
RAG (Retrieval Augmented Generation)
URL: https://qdrant.yourdomain.com

5. MinIO - Object Storage

S3-compatible API
File uploads & storage
Bucket management
API: https://s3.yourdomain.com
Console: https://minio.yourdomain.com

6. Traefik - Reverse Proxy

Automatic SSL certificates
HTTP to HTTPS redirect
Load balancing
Dashboard: http://server-ip:8080

Optional Services (Choose During Installation)

7. Ollama - Local LLM 🤖

Run AI models locally
No API costs (GPT-like capabilities)
Privacy-first
Generate embeddings for Qdrant
URL: https://ollama.yourdomain.com

8. Open WebUI - AI Chat Interface 🤖

Beautiful chat interface for Ollama
Multiple model support
Chat history
RAG functionality
URL: https://ai.yourdomain.com
Requires: Ollama

9. Grafana + Prometheus - Monitoring Stack 📊

Monitor all services
Custom dashboards
Metrics collection
Performance insights
Grafana: https://grafana.yourdomain.com
Prometheus: https://prometheus.yourdomain.com

10. Uptime Kuma - Service Monitoring 📈

Monitor service uptime
SMS/Email/Webhook alerts
Beautiful status page
Response time tracking
URL: https://uptime.yourdomain.com

11. Portainer - Container Management 🐳

Visual Docker management
Container logs & stats
Easy updates
Stack management
URL: https://portainer.yourdomain.com

📋 Prerequisites

Server Requirements

OS: Ubuntu 20.04+ or Debian 11+
RAM: 4GB minimum (8GB+ recommended)
CPU: 2+ cores (4+ recommended for AI)
Disk: 50GB+ free space
Ports: 80, 443, 8080 must be available

Software Requirements

Docker 20.10+
Docker Compose v2.0+
OpenSSL
curl

Install Docker (if needed)

curl -fsSL https://get.docker.com | sh
sudo usermod -aG docker $USER

🚀 Quick Start

Step 1: Configure DNS (CRITICAL!)

Before running the installer, configure these DNS A records:

Core Services:

n8n.yourdomain.com        A    YOUR_SERVER_IP
qdrant.yourdomain.com     A    YOUR_SERVER_IP
supabase.yourdomain.com   A    YOUR_SERVER_IP
minio.yourdomain.com      A    YOUR_SERVER_IP
s3.yourdomain.com         A    YOUR_SERVER_IP

Optional Services (if you plan to install them):

ollama.yourdomain.com     A    YOUR_SERVER_IP
ai.yourdomain.com         A    YOUR_SERVER_IP
grafana.yourdomain.com    A    YOUR_SERVER_IP
prometheus.yourdomain.com A    YOUR_SERVER_IP
uptime.yourdomain.com     A    YOUR_SERVER_IP
portainer.yourdomain.com  A    YOUR_SERVER_IP

Step 2: Download & Run Installer

# Download the installer
git clone https://github.com/makhatib/AI-stack.git

# Enter folder 
cd AI-stack

# Make executable
chmod +x install-advanced.sh

# Run installer
./install-advanced.sh

Step 3: Answer Prompts

The installer will ask you:

Domain name (e.g., yourdomain.com)
n8n subdomain (default: n8n)
SSL email (for Let's Encrypt)
Timezone (choose from list)
Optional services (Y/n for each):
- Ollama (Local LLM)
- Open WebUI (Chat interface)
- Grafana + Prometheus (Monitoring)
- Uptime Kuma (Service monitoring)
- Portainer (Container management)

Step 4: Wait for Installation

Prerequisites check: ~30 seconds
Docker image download: 5-10 minutes
Service startup: ~2 minutes
SSL certificate generation: 2-5 minutes

Total time: 10-20 minutes

🔐 Security Features

Auto-Generated Secrets

Every installation generates unique, cryptographically secure passwords:

PostgreSQL Password: 64 characters (128-bit entropy)
Redis Password: 64 characters
Qdrant API Key: 64 characters
MinIO Credentials: 32 characters
Grafana Password: 32 characters (if installed)

No two installations share the same credentials!

Additional Security

✅ HTTPS enforced (HTTP redirects to HTTPS)
✅ Let's Encrypt automatic SSL certificates
✅ Secure file permissions (.env = 600)
✅ Password-protected services
✅ Isolated Docker network
✅ No hardcoded defaults

📊 Architecture

Service Dependencies

Internet
   ↓
Traefik (SSL/Reverse Proxy)
   ├─→ n8n → PostgreSQL
   ├─→ Qdrant (Vector Search)
   │    ├─→ Auth
   │    ├─→ REST API
   │    ├─→ Realtime
   │    └─→ Storage
   ├─→ MinIO (S3 Storage)
   ├─→ Ollama (if installed)
   ├─→ Open WebUI → Ollama (if installed)
   ├─→ Grafana → Prometheus (if installed)
   ├─→ Uptime Kuma (if installed)
   └─→ Portainer (if installed)

Shared Infrastructure:
   • PostgreSQL (shared DB)
   • Redis (shared cache)

📝 Useful Commands

Service Management

# Navigate to installation
cd automation-stack

# View all logs
docker compose logs -f

# View specific service
docker compose logs -f n8n
docker compose logs -f qdrant
docker compose logs -f ollama

# Restart all services
docker compose restart

# Restart specific service
docker compose restart n8n

# Stop all services
docker compose down

# Start all services
docker compose up -d

# Check service status
docker compose ps

# View resource usage
docker stats

Ollama Management

# List installed models
docker compose exec ollama ollama list

# Pull new model
docker compose exec ollama ollama pull llama2

# Remove model
docker compose exec ollama ollama rm llama2

# Run model interactively
docker compose exec ollama ollama run llama2

Database Operations

# Access PostgreSQL
docker compose exec postgres psql -U postgres

# List databases
docker compose exec postgres psql -U postgres -c "\l"

# Connect to n8n database
docker compose exec postgres psql -U postgres -d n8n

# Backup database
docker compose exec postgres pg_dump -U postgres n8n > backup-n8n.sql

# Restore database
cat backup-n8n.sql | docker compose exec -T postgres psql -U postgres -d n8n

MinIO Operations

# Access MinIO Client
docker compose exec minio mc alias set local http://localhost:9000 $MINIO_ROOT_USER $MINIO_ROOT_PASSWORD

# List buckets
docker compose exec minio mc ls local

# Create bucket
docker compose exec minio mc mb local/my-bucket

# Upload file
docker compose exec minio mc cp /path/to/file local/my-bucket/

🔧 Troubleshooting

Services Won't Start

# Check logs for errors
docker compose logs --tail=100

# Check specific service
docker compose logs rails --tail=50

# Verify ports aren't in use
netstat -tulpn | grep -E ':80|:443'

# Restart Docker
sudo systemctl restart docker
docker compose up -d

SSL Certificates Not Generating

# Check Traefik logs
docker compose logs traefik

# Verify DNS
nslookup n8n.yourdomain.com

# Manual certificate check
curl -I https://n8n.yourdomain.com

# Wait 5-10 minutes - Let's Encrypt can be slow

Ollama Not Responding

# Check if Ollama is running
docker compose ps ollama

# Check logs
docker compose logs ollama

# Restart Ollama
docker compose restart ollama

# Check if models are pulled
docker compose exec ollama ollama list

Out of Memory

# Check memory usage
free -h
docker stats

# Increase swap (temporary fix)
sudo dd if=/dev/zero of=/swapfile bs=1M count=4096
sudo mkswap /swapfile
sudo swapon /swapfile

# Long-term: Upgrade server RAM to 8GB+

💾 Backup & Restore

Quick Backup

# Backup everything
tar czf backup-$(date +%Y%m%d).tar.gz \
  docker-compose.yml \
  .env \
  init-scripts/ \
  supabase/ \
  monitoring/

# Backup databases
docker compose exec postgres pg_dumpall -U postgres > backup-databases.sql

# Backup volumes
docker run --rm \
  -v automation-stack_n8n_data:/data \
  -v $(pwd):/backup \
  alpine tar czf /backup/n8n-backup.tar.gz -C /data .

Restore

# Restore configuration
tar xzf backup-YYYYMMDD.tar.gz

# Restore databases
cat backup-databases.sql | docker compose exec -T postgres psql -U postgres

# Restore volumes
docker run --rm \
  -v automation-stack_n8n_data:/data \
  -v $(pwd):/backup \
  alpine tar xzf /backup/n8n-backup.tar.gz -C /data

Automated Backups

Create /root/backup.sh:

#!/bin/bash
BACKUP_DIR="/root/backups"
DATE=$(date +%Y%m%d_%H%M%S)

mkdir -p $BACKUP_DIR

# Backup databases
docker compose -f /root/automation-stack/docker-compose.yml \
  exec -T postgres pg_dumpall -U postgres > $BACKUP_DIR/db-$DATE.sql

# Backup configuration
tar czf $BACKUP_DIR/config-$DATE.tar.gz \
  -C /root/automation-stack \
  docker-compose.yml .env

# Keep only last 7 days
find $BACKUP_DIR -name "*.sql" -mtime +7 -delete
find $BACKUP_DIR -name "*.tar.gz" -mtime +7 -delete

Add to crontab:

# Daily backup at 2 AM
0 2 * * * /root/backup.sh

🔄 Updating Services

Update All Services

cd automation-stack

# Pull latest images
docker compose pull

# Recreate containers
docker compose up -d

# Check logs
docker compose logs -f

Update Specific Service

# Update just n8n
docker compose pull n8n
docker compose up -d n8n

# Update Ollama
docker compose pull ollama
docker compose up -d ollama

📞 Support & Resources

Documentation

n8n: https://docs.n8n.io
Qdrant: https://qdrant.tech/documentation/
MinIO: https://min.io/docs/
Ollama: https://ollama.ai/
Grafana: https://grafana.com/docs/
Prometheus: https://prometheus.io/docs/

Community

👉 website: https://malkhatib.com/

👉 linkedin: malkhatib1

👉 discord: https://discord.com/invite/KTdDJrVDgV

👉 telegram: https://t.me/+YAHmKBLoLWoxNWQ0

👉 x: @malkhateeb

⚠️ Important Notes

First Run: SSL certificates take 2-5 minutes to generate
DNS: Must be configured BEFORE installation
Backups: Set up automated backups immediately
Security: Keep .env file secure
Updates: Check for updates monthly
Monitoring: Use Grafana to track resource usage

🎉 Next Steps

After installation:

✅ Access each service and verify it works
✅ Configure n8n with your first workflow
✅ Pull Ollama models (if installed)
✅ Set up Grafana dashboards (if installed)
✅ Create Supabase database tables
✅ Configure MinIO buckets
✅ Set up automated backups
✅ Monitor services with Uptime Kuma (if installed)

Enjoy your advanced automation infrastructure! 🚀

Name		Name	Last commit message	Last commit date
Latest commit History 28 Commits
README.md		README.md
install-advanced.sh		install-advanced.sh

blackghostorg/ai-stack

Folders and files

Latest commit

History

Repository files navigation

🚀 Advanced Automation Stack - Automated Installer

Overview

🎯 What Gets Installed

Core Services (Always Installed)

1. n8n - Workflow Automation

2. PostgreSQL - Database

3. Redis - Cache & Queue

4. Qdrant - Vector Database

5. MinIO - Object Storage

6. Traefik - Reverse Proxy

Optional Services (Choose During Installation)

7. Ollama - Local LLM 🤖

8. Open WebUI - AI Chat Interface 🤖

9. Grafana + Prometheus - Monitoring Stack 📊

10. Uptime Kuma - Service Monitoring 📈

11. Portainer - Container Management 🐳

📋 Prerequisites

Server Requirements

Software Requirements

Install Docker (if needed)

🚀 Quick Start

Step 1: Configure DNS (CRITICAL!)

Step 2: Download & Run Installer

Step 3: Answer Prompts

Step 4: Wait for Installation

🔐 Security Features

Auto-Generated Secrets

Additional Security

📊 Architecture

Service Dependencies

📝 Useful Commands

Service Management

Ollama Management

Database Operations

MinIO Operations

🔧 Troubleshooting

Services Won't Start

SSL Certificates Not Generating

Ollama Not Responding

Out of Memory

💾 Backup & Restore

Quick Backup

Restore

Automated Backups

🔄 Updating Services

Update All Services

Update Specific Service

📞 Support & Resources

Documentation

Community

⚠️ Important Notes

🎉 Next Steps

About

Resources

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

Packages