Skip to content

docs: update Performance section with two-host benchmark numbers #49

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
levleontiev merged 3 commits into from
Mar 18, 2026
Merged

docs: update Performance section with two-host benchmark numbers #49

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
4c700af
docs: update Performance section with two-host benchmark numbers (clo…
levleontiev Mar 18, 2026
d00c8e8
docs: update Performance section with two-host benchmark numbers (clo…
levleontiev Mar 18, 2026
0f7a3d8
fix: remove double-asterisk markdown inside HTML bold tag in tagline
levleontiev Mar 18, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 14 additions & 15 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@
</p>

<p align="center">
<b>Latency: median 112 μs, p99 &lt; 1 ms · No external state (no Redis / DB)</b>
<b>Latency: &lt; 70 µs enforcement overhead · 195k RPS max throughput · No external state (no Redis / DB)</b>
</p>

---
Expand Down Expand Up @@ -272,39 +272,38 @@ Policies are versioned JSON — commit them to Git, review changes in PRs, roll

## Performance

### Benchmark methodology (March 4, 2026)
### Benchmark methodology (March 2026)

- **Host:** AWS `c7i.2xlarge` (8 vCPU, 16 GiB RAM)
- **OS:** Ubuntu 24.04.3 LTS
- **Hosts:** 2 × AWS `c7i.xlarge` (4 vCPU, 8 GiB each), cluster placement group, eu-central-1
- **OS:** Ubuntu 24.04 LTS
- **Runtime:** OpenResty 1.29.2.1, Fairvisor latest `main` (no Docker)
- **Load tool:** `k6` v0.54.0, `constant-arrival-rate`, 10,000 RPS for 60s, 10s warmup
- **Benchmark script:** `run-all.sh` from `fairvisor/benchmark`
- **CPU isolation (single-host run):** `taskset` split
- OpenResty/backend on cores `0-3`
- k6 on cores `4-7`
- **Topology:** two-host — Fairvisor and k6 on separate machines (VPC private network)
- **Decision endpoint contract:** `POST /v1/decision` with `X-Original-Method` and `X-Original-URI`
- **Note:** reverse proxy numbers include policy evaluation and upstream proxy hop to backend nginx.

### Latest measured latency @ 10,000 RPS

| Percentile | Decision service | Reverse proxy | Raw nginx (baseline) |
|---|---|---|---|
| p50 | 112 μs | 241 μs | 71 μs |
| p90 | 191 μs | 376 μs | 190 μs |
| p99 | 426 μs | 822 μs | 446 μs |
| p99.9 | 2.99 ms | 2.98 ms | 1.61 ms |
| p50 | 304 μs | 302 μs | 235 μs |
| p90 | 543 μs | 593 μs | 409 μs |
| p99 | 2.00 ms | 1.79 ms | 1.95 ms |
| p99.9 | 4.00 ms | 5.12 ms | 3.62 ms |

**Enforcement overhead over raw nginx baseline: p50 +69 µs / p90 +134 µs.**

### Latest max sustained throughput (single instance)

| Configuration | Max RPS |
|---|---|
| Simple rate limit (1 rule) | 110,500 |
| Complex policy (5 rules, JWT parsing, loop detection) | 67,600 |
| With token estimation | 49,400 |
| Simple rate limit (1 rule) | 195,000 |
| Complex policy (5 rules, JWT parsing, loop detection) | 195,000 |

**No external datastore.** All enforcement state lives in in-process shared memory (`ngx.shared.dict`). No Redis, no Postgres, no network round-trips in the decision path.

> Reproduce: `git clone https://github.com/fairvisor/benchmark && cd benchmark && ./run-all.sh`
> Reproduce: `git clone https://github.com/fairvisor/benchmark && cd benchmark && bash run-all.sh`

## Deployment

Expand Down
Loading