Skip to content

tech-stack.md

Latest commit

 

History

History
107 lines (71 loc) · 3.93 KB

tech-stack.md

File metadata and controls

107 lines (71 loc) · 3.93 KB

Technology Stack — Agentic Orchestration Builder (Microservices, B2B)

This document lists the recommended technology choices for the microservices-based, multi-tenant orchestration builder with graph/vector memory, agentic workflows, and enterprise SaaS features.

Core Application & Microservices

  • Language: TypeScript (Node.js 20+)
  • Service Framework: Fastify or Express.js (REST APIs); gRPC (high-performance backend calls, if needed)
  • Monorepo Management: Turborepo

Messaging & Event Streaming

  • Event Bus: Redis Streams (central event-driven workflow spine)
  • Job Queue: BullMQ (distributed workflow/task/job execution, backed by Redis)

Databases & Storage

  • Relational Database: PostgreSQL 15+ (state, events, tenant, user, config)
  • Knowledge Graph: Neo4j 5.x or ArangoDB 3.x (relationships, context, temporal patterns)
  • Vector Database: Qdrant 1.7+ or Weaviate 1.24+ (semantic embeddings, similarity search, memory)

Agent System

  • Agent Registry & Execution: Node.js Worker Threads and BullMQ runners (for concurrent, isolated execution)

Embeddings & ML

  • Embedding Generation: OpenAI API (text-embedding-ada-002);
    Alternatives: Cohere, HuggingFace Sentence Transformers

Authentication, Tenancy & Security

  • Authentication: JWT (with tenant_id claims)
  • OAuth2/SAML SSO: Passport.js (for enterprise logins)
  • Rate Limiting: API Gateway, Redis-backed counters

Observability & Monitoring

  • Logging: Winston (per-service logging)
  • Distributed Tracing: OpenTelemetry (spans/traces across services)
  • Metrics & Dashboard: Prometheus (service metrics), Grafana (dashboards)
  • Health Checks: /health endpoint for all microservices

Deployment & DevOps

  • Containerization: Docker (all services/dbs), Docker Compose (dev/local orchestration)
  • Orchestration: Kubernetes (prod, for scaling/multi-cloud)
  • CI/CD: GitHub Actions (build/test/deploy pipeline)
  • Config: dotenv (.env) per service; secrets management in deployment

Frontend (Optional for MVP/Editor/Demo)

  • Frontend Library: React.js (or Next.js)
  • UI Components: Chakra UI or Material UI

Dev Tools & Quality

  • ORM & DB Migrations: Prisma (with TypeScript)
  • Testing: Jest (unit/integration/API test)
  • Linting/Formatting: ESLint, Prettier

Summary Table

Service/Layer Technology Choices
APIs/Microservices TypeScript, Node.js, Express, Turborepo
Event Bus Redis Streams
Job Queue BullMQ (Redis)
Relational DB PostgreSQL
Knowledge Graph Neo4j or ArangoDB
Vector DB Qdrant or Weaviate
Agent Execution Node.js worker threads, BullMQ
Auth & Tenancy JWT, Passport.js (OAuth2/SAML)
Observability Winston, OpenTelemetry, Prometheus, Grafana
Container/Orchestration Docker, Docker Compose, Kubernetes
CI/CD GitHub Actions
Frontend (Demo/Editor) React.js, Chakra UI/Material UI
ORM/Models Prisma
Testing Jest, Supertest
Lint/Format ESLint, Prettier
Embeddings OpenAI, Cohere, HuggingFace

This technology stack ensures modern cloud-readiness, modular microservices, multi-tenancy, and extensibility for your B2B SaaS orchestration platform.