Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 8, 2025

This PR contains the following updates:

Update Change
lockFileMaintenance All locks refreshed

🔧 This Pull Request updates lock files to use the latest dependency versions.


Configuration

📅 Schedule: Branch creation - "before 4am on monday" (UTC), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 8, 2025
Copy link

github-actions bot commented Sep 8, 2025

💻 Website Preview

The latest changes are available as preview in: https://8c16577f.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Sep 8, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1973 122919 total, 0 failed avg: 113ms, p95: 281ms
grafbase 1668 105355 total, 0 failed avg: 132ms, p95: 320ms
cosmo 681 43500 total, 0 failed avg: 323ms, p95: 707ms
apollo-router 398 26808 total, 0 failed avg: 526ms, p95: 1203ms ❌ 22 unexpected GraphQL errors
hive-gateway 268 18544 total, 0 failed avg: 758ms, p95: 1667ms
hive-gateway-bun 254 17773 total, 0 failed avg: 789ms, p95: 1685ms
apollo-gateway 157 10748 total, 0 failed avg: 1216ms, p95: 2594ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 365757      ✗ 0     
     data_received..................: 11 GB   173 MB/s
     data_sent......................: 143 MB  2.3 MB/s
     http_req_blocked...............: avg=364.67µs min=1.09µs  med=2.51µs   max=327.51ms p(90)=3.94µs   p(95)=4.82µs   p(99.9)=135.45ms
     http_req_connecting............: avg=361.37µs min=0s      med=0s       max=327.35ms p(90)=0s       p(95)=0s       p(99.9)=135.36ms
     http_req_duration..............: avg=113.34ms min=1.85ms  med=101.03ms max=417.88ms p(90)=231.96ms p(95)=280.73ms p(99.9)=367.66ms
       { expected_response:true }...: avg=113.34ms min=1.85ms  med=101.03ms max=417.88ms p(90)=231.96ms p(95)=280.73ms p(99.9)=367.66ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 122919
     http_req_receiving.............: avg=449.25µs min=22.75µs med=40.79µs  max=125.57ms p(90)=124.32µs p(95)=377.03µs p(99.9)=66.36ms 
     http_req_sending...............: avg=334.88µs min=5.02µs  med=9.98µs   max=125.27ms p(90)=23.96µs  p(95)=122.28µs p(99.9)=63.01ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=112.56ms min=1.81ms  med=100.23ms max=396.71ms p(90)=230.27ms p(95)=279.38ms p(99.9)=363.71ms
     http_reqs......................: 122919  1973.289521/s
     iteration_duration.............: avg=114.89ms min=1.95ms  med=102.32ms max=687.05ms p(90)=234.2ms  p(95)=282.56ms p(99.9)=382.97ms
     iterations.....................: 121919  1957.235945/s
     success_rate...................: 100.00% ✓ 121919      ✗ 0     
     vus............................: 73      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 313065      ✗ 0     
     data_received..................: 9.3 GB  147 MB/s
     data_sent......................: 123 MB  1.9 MB/s
     http_req_blocked...............: avg=534.76µs min=1.15µs  med=3.01µs   max=533.04ms p(90)=4.41µs   p(95)=5.4µs    p(99.9)=181.63ms
     http_req_connecting............: avg=530.58µs min=0s      med=0s       max=532.98ms p(90)=0s       p(95)=0s       p(99.9)=181.5ms 
     http_req_duration..............: avg=132.15ms min=2.52ms  med=119.13ms max=494.21ms p(90)=267.72ms p(95)=319.75ms p(99.9)=407.9ms 
       { expected_response:true }...: avg=132.15ms min=2.52ms  med=119.13ms max=494.21ms p(90)=267.72ms p(95)=319.75ms p(99.9)=407.9ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 105355
     http_req_receiving.............: avg=577.89µs min=24.42µs med=47.4µs   max=216.85ms p(90)=184.63µs p(95)=438.82µs p(99.9)=82.44ms 
     http_req_sending...............: avg=462.88µs min=5.14µs  med=11.82µs  max=152.83ms p(90)=32.72µs  p(95)=140.23µs p(99.9)=76.45ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=131.11ms min=2.48ms  med=118.22ms max=432.86ms p(90)=265.39ms p(95)=317.89ms p(99.9)=402.11ms
     http_reqs......................: 105355  1668.830106/s
     iteration_duration.............: avg=134.27ms min=2.78ms  med=120.65ms max=797.78ms p(90)=270.51ms p(95)=322.59ms p(99.9)=465.31ms
     iterations.....................: 104355  1652.99004/s
     success_rate...................: 100.00% ✓ 104355      ✗ 0     
     vus............................: 65      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 127500     ✗ 0    
     data_received..................: 3.8 GB  60 MB/s
     data_sent......................: 51 MB   793 kB/s
     http_req_blocked...............: avg=104.05µs min=1.29µs  med=2.87µs   max=145.79ms p(90)=4.43µs   p(95)=6.29µs   p(99.9)=32.11ms
     http_req_connecting............: avg=99.15µs  min=0s      med=0s       max=145.58ms p(90)=0s       p(95)=0s       p(99.9)=32.05ms
     http_req_duration..............: avg=323ms    min=2.83ms  med=308.07ms max=1.27s    p(90)=631.68ms p(95)=707.48ms p(99.9)=1.01s  
       { expected_response:true }...: avg=323ms    min=2.83ms  med=308.07ms max=1.27s    p(90)=631.68ms p(95)=707.48ms p(99.9)=1.01s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 43500
     http_req_receiving.............: avg=673.2µs  min=28.78µs med=63.45µs  max=169.67ms p(90)=212.38µs p(95)=506.85µs p(99.9)=80.17ms
     http_req_sending...............: avg=144.35µs min=5.81µs  med=11.5µs   max=137.75ms p(90)=30.54µs  p(95)=128.56µs p(99.9)=28.54ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=322.19ms min=2.76ms  med=307.28ms max=1.27s    p(90)=630.92ms p(95)=704.49ms p(99.9)=1s     
     http_reqs......................: 43500   681.07437/s
     iteration_duration.............: avg=331.08ms min=3.18ms  med=316.89ms max=1.27s    p(90)=634.77ms p(95)=710.03ms p(99.9)=1.01s  
     iterations.....................: 42500   665.417488/s
     success_rate...................: 100.00% ✓ 42500      ✗ 0    
     vus............................: 55      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25786 / ✗ 22
     ✓ valid response structure

     checks.........................: 99.97% ✓ 77402      ✗ 22   
     data_received..................: 2.4 GB 35 MB/s
     data_sent......................: 31 MB  465 kB/s
     http_req_blocked...............: avg=57.02µs  min=1.63µs  med=2.89µs   max=89.04ms p(90)=4.71µs   p(95)=6.75µs   p(99.9)=13.61ms
     http_req_connecting............: avg=51.31µs  min=0s      med=0s       max=88.9ms  p(90)=0s       p(95)=0s       p(99.9)=13.54ms
     http_req_duration..............: avg=525.86ms min=6.07ms  med=488.83ms max=2.22s   p(90)=1.06s    p(95)=1.2s     p(99.9)=1.64s  
       { expected_response:true }...: avg=525.86ms min=6.07ms  med=488.83ms max=2.22s   p(90)=1.06s    p(95)=1.2s     p(99.9)=1.64s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26808
     http_req_receiving.............: avg=106.16µs min=29.03µs med=51.55µs  max=76ms    p(90)=101.73µs p(95)=174.22µs p(99.9)=6.96ms 
     http_req_sending...............: avg=84.61µs  min=6.07µs  med=11.33µs  max=79.66ms p(90)=29.27µs  p(95)=112.5µs  p(99.9)=13.28ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=525.67ms min=6.02ms  med=488.71ms max=2.22s   p(90)=1.06s    p(95)=1.2s     p(99.9)=1.64s  
     http_reqs......................: 26808  398.692172/s
     iteration_duration.............: avg=546.55ms min=6.32ms  med=513.83ms max=2.22s   p(90)=1.07s    p(95)=1.21s    p(99.9)=1.66s  
     iterations.....................: 25808  383.820038/s
     success_rate...................: 99.91% ✓ 25786      ✗ 22   
     vus............................: 73     min=0        max=496
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52632      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 22 MB   315 kB/s
     http_req_blocked...............: avg=95.15µs  min=1.25µs  med=2.93µs   max=82.23ms p(90)=4.91µs  p(95)=7.39µs   p(99.9)=26.92ms
     http_req_connecting............: avg=89.52µs  min=0s      med=0s       max=82.05ms p(90)=0s      p(95)=0s       p(99.9)=26.85ms
     http_req_duration..............: avg=757.56ms min=6.59ms  med=699.83ms max=4.85s   p(90)=1.49s   p(95)=1.66s    p(99.9)=3.94s  
       { expected_response:true }...: avg=757.56ms min=6.59ms  med=699.83ms max=4.85s   p(90)=1.49s   p(95)=1.66s    p(99.9)=3.94s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18544
     http_req_receiving.............: avg=178.55µs min=26.72µs med=44.31µs  max=67.09ms p(90)=92.1µs  p(95)=170.08µs p(99.9)=25.61ms
     http_req_sending...............: avg=141.24µs min=5.95µs  med=11.13µs  max=66.42ms p(90)=31.32µs p(95)=108.03µs p(99.9)=21.93ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=757.24ms min=6.54ms  med=699.56ms max=4.85s   p(90)=1.49s   p(95)=1.66s    p(99.9)=3.94s  
     http_reqs......................: 18544   268.741245/s
     iteration_duration.............: avg=801ms    min=8.21ms  med=736.58ms max=4.92s   p(90)=1.5s    p(95)=1.67s    p(99.9)=4.01s  
     iterations.....................: 17544   254.249159/s
     success_rate...................: 100.00% ✓ 17544      ✗ 0    
     vus............................: 66      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50319      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   298 kB/s
     http_req_blocked...............: avg=113.73µs min=1.25µs  med=2.97µs   max=89.15ms p(90)=5.61µs   p(95)=8.69µs   p(99.9)=30.54ms
     http_req_connecting............: avg=106µs    min=0s      med=0s       max=88.96ms p(90)=0s       p(95)=0s       p(99.9)=30.48ms
     http_req_duration..............: avg=788.84ms min=6.84ms  med=751.61ms max=5.53s   p(90)=1.53s    p(95)=1.68s    p(99.9)=4.29s  
       { expected_response:true }...: avg=788.84ms min=6.84ms  med=751.61ms max=5.53s   p(90)=1.53s    p(95)=1.68s    p(99.9)=4.29s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17773
     http_req_receiving.............: avg=159.97µs min=29.48µs med=47.98µs  max=74.46ms p(90)=102.35µs p(95)=156.28µs p(99.9)=24.39ms
     http_req_sending...............: avg=154.44µs min=6.27µs  med=11.64µs  max=81.91ms p(90)=31.41µs  p(95)=88.88µs  p(99.9)=28.35ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=788.53ms min=6.73ms  med=751.56ms max=5.53s   p(90)=1.53s    p(95)=1.68s    p(99.9)=4.29s  
     http_reqs......................: 17773   254.470801/s
     iteration_duration.............: avg=836.12ms min=9.2ms   med=812.69ms max=5.57s   p(90)=1.55s    p(95)=1.71s    p(99.9)=4.33s  
     iterations.....................: 16773   240.15297/s
     success_rate...................: 100.00% ✓ 16773      ✗ 0    
     vus............................: 60      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29244      ✗ 0    
     data_received..................: 944 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=42.4µs  min=1.3µs  med=3.1µs   max=64.14ms p(90)=4.67µs  p(95)=9.81µs   p(99.9)=11.05ms
     http_req_connecting............: avg=36.63µs min=0s     med=0s      max=64ms    p(90)=0s      p(95)=0s       p(99.9)=10.99ms
     http_req_duration..............: avg=1.21s   min=7.28ms med=1.14s   max=15.76s  p(90)=2.19s   p(95)=2.59s    p(99.9)=14.6s  
       { expected_response:true }...: avg=1.21s   min=7.28ms med=1.14s   max=15.76s  p(90)=2.19s   p(95)=2.59s    p(99.9)=14.6s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 10748
     http_req_receiving.............: avg=69.3µs  min=27µs   med=49.99µs max=13.78ms p(90)=91.1µs  p(95)=112.15µs p(99.9)=1.23ms 
     http_req_sending...............: avg=44.19µs min=6.01µs med=12.2µs  max=31.71ms p(90)=24.08µs p(95)=42.86µs  p(99.9)=7.92ms 
     http_req_tls_handshaking.......: avg=0s      min=0s     med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.21s   min=7.23ms med=1.14s   max=15.76s  p(90)=2.19s   p(95)=2.59s    p(99.9)=14.6s  
     http_reqs......................: 10748   157.411831/s
     iteration_duration.............: avg=1.34s   min=7.79ms med=1.29s   max=15.77s  p(90)=2.24s   p(95)=2.63s    p(99.9)=14.68s 
     iterations.....................: 9748    142.766145/s
     success_rate...................: 100.00% ✓ 9748       ✗ 0    
     vus............................: 84      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 8, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1901 114584 total, 0 failed avg: 26ms, p95: 47ms
grafbase 1652 99774 total, 0 failed avg: 30ms, p95: 52ms
cosmo 687 41527 total, 0 failed avg: 72ms, p95: 105ms
apollo-router 362 22029 total, 0 failed avg: 136ms, p95: 177ms
hive-gateway 310 18951 total, 0 failed avg: 158ms, p95: 221ms
hive-gateway-bun 303 18498 total, 0 failed avg: 162ms, p95: 229ms
apollo-gateway 122 7480 total, 0 failed avg: 402ms, p95: 474ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 343452      ✗ 0     
     data_received..................: 10 GB   167 MB/s
     data_sent......................: 133 MB  2.2 MB/s
     http_req_blocked...............: avg=4.82µs   min=1.1µs  med=2.4µs   max=8.74ms   p(90)=3.5µs    p(95)=4.11µs   p(99.9)=91.23µs
     http_req_connecting............: avg=1.93µs   min=0s     med=0s      max=8.71ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=25.99ms  min=1.88ms med=23.63ms max=434.76ms p(90)=40.3ms   p(95)=46.58ms  p(99.9)=83.15ms
       { expected_response:true }...: avg=25.99ms  min=1.88ms med=23.63ms max=434.76ms p(90)=40.3ms   p(95)=46.58ms  p(99.9)=83.15ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 114584
     http_req_receiving.............: avg=108.78µs min=22µs   med=41.57µs max=49.73ms  p(90)=102.61µs p(95)=319.47µs p(99.9)=11.14ms
     http_req_sending...............: avg=90.84µs  min=4.95µs med=9.83µs  max=409.45ms p(90)=28.7µs   p(95)=116.42µs p(99.9)=11.72ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=25.79ms  min=1.83ms med=23.49ms max=434.04ms p(90)=39.94ms  p(95)=46.14ms  p(99.9)=79.5ms 
     http_reqs......................: 114584  1901.303226/s
     iteration_duration.............: avg=26.2ms   min=4.16ms med=23.82ms max=455.93ms p(90)=40.49ms  p(95)=46.78ms  p(99.9)=83.49ms
     iterations.....................: 114484  1899.643916/s
     success_rate...................: 100.00% ✓ 114484      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 299022      ✗ 0    
     data_received..................: 8.8 GB  145 MB/s
     data_sent......................: 116 MB  1.9 MB/s
     http_req_blocked...............: avg=6.67µs   min=1.21µs  med=3.03µs  max=10.74ms  p(90)=4.32µs  p(95)=5.38µs   p(99.9)=120.15µs
     http_req_connecting............: avg=2.82µs   min=0s      med=0s      max=10.7ms   p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.83ms  min=2.95ms  med=26.76ms max=483.41ms p(90)=45.55ms p(95)=52.31ms  p(99.9)=85.59ms 
       { expected_response:true }...: avg=29.83ms  min=2.95ms  med=26.76ms max=483.41ms p(90)=45.55ms p(95)=52.31ms  p(99.9)=85.59ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 99774
     http_req_receiving.............: avg=147.52µs min=26.58µs med=49.24µs max=384.94ms p(90)=148µs   p(95)=394.96µs p(99.9)=15.93ms 
     http_req_sending...............: avg=96.17µs  min=5.19µs  med=11.91µs max=291.95ms p(90)=36.88µs p(95)=137.15µs p(99.9)=13.54ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.59ms  min=2.88ms  med=26.6ms  max=468.56ms p(90)=45.07ms p(95)=51.8ms   p(99.9)=83.69ms 
     http_reqs......................: 99774   1652.054876/s
     iteration_duration.............: avg=30.08ms  min=7.66ms  med=26.98ms max=501.44ms p(90)=45.78ms p(95)=52.54ms  p(99.9)=86.25ms 
     iterations.....................: 99674   1650.399079/s
     success_rate...................: 100.00% ✓ 99674       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124281     ✗ 0    
     data_received..................: 3.6 GB  60 MB/s
     data_sent......................: 48 MB   800 kB/s
     http_req_blocked...............: avg=13.93µs  min=1.25µs  med=2.71µs  max=19.45ms  p(90)=3.79µs   p(95)=4.42µs   p(99.9)=3.79ms  
     http_req_connecting............: avg=10.59µs  min=0s      med=0s      max=19.4ms   p(90)=0s       p(95)=0s       p(99.9)=3.77ms  
     http_req_duration..............: avg=71.98ms  min=2.87ms  med=70.93ms max=482.57ms p(90)=97.32ms  p(95)=105.1ms  p(99.9)=264.46ms
       { expected_response:true }...: avg=71.98ms  min=2.87ms  med=70.93ms max=482.57ms p(90)=97.32ms  p(95)=105.1ms  p(99.9)=264.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41527
     http_req_receiving.............: avg=168.67µs min=29.58µs med=69.76µs max=39.19ms  p(90)=146.01µs p(95)=372.88µs p(99.9)=18.86ms 
     http_req_sending...............: avg=62.62µs  min=5.93µs  med=11.18µs max=363.15ms p(90)=28.62µs  p(95)=119µs    p(99.9)=7.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.75ms  min=2.8ms   med=70.71ms max=473.71ms p(90)=97.05ms  p(95)=104.84ms p(99.9)=253.16ms
     http_reqs......................: 41527   687.602544/s
     iteration_duration.............: avg=72.41ms  min=8.08ms  med=71.19ms max=510.47ms p(90)=97.57ms  p(95)=105.37ms p(99.9)=286.66ms
     iterations.....................: 41427   685.946748/s
     success_rate...................: 100.00% ✓ 41427      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 65787      ✗ 0    
     data_received..................: 1.9 GB  32 MB/s
     data_sent......................: 26 MB   421 kB/s
     http_req_blocked...............: avg=14.56µs  min=1.92µs  med=3.08µs   max=9.61ms   p(90)=4.73µs   p(95)=5.42µs   p(99.9)=5.13ms  
     http_req_connecting............: avg=10.71µs  min=0s      med=0s       max=9.57ms   p(90)=0s       p(95)=0s       p(99.9)=5.12ms  
     http_req_duration..............: avg=135.98ms min=6.51ms  med=135.11ms max=618.29ms p(90)=166.63ms p(95)=176.96ms p(99.9)=446.56ms
       { expected_response:true }...: avg=135.98ms min=6.51ms  med=135.11ms max=618.29ms p(90)=166.63ms p(95)=176.96ms p(99.9)=446.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22029
     http_req_receiving.............: avg=100.7µs  min=36.63µs med=57.78µs  max=379.85ms p(90)=111.96µs p(95)=144.44µs p(99.9)=1.66ms  
     http_req_sending...............: avg=61.89µs  min=8.56µs  med=12.34µs  max=393.55ms p(90)=21.06µs  p(95)=36.85µs  p(99.9)=1.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=135.82ms min=6.42ms  med=135ms    max=601.09ms p(90)=166.48ms p(95)=176.82ms p(99.9)=427.25ms
     http_reqs......................: 22029   362.197708/s
     iteration_duration.............: avg=136.86ms min=30.31ms med=135.45ms max=651.22ms p(90)=166.9ms  p(95)=177.27ms p(99.9)=456.28ms
     iterations.....................: 21929   360.553523/s
     success_rate...................: 100.00% ✓ 21929      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56553      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   361 kB/s
     http_req_blocked...............: avg=36.79µs  min=1.18µs  med=2.69µs   max=46.55ms  p(90)=4.47µs   p(95)=5.59µs   p(99.9)=13.66ms 
     http_req_connecting............: avg=32.58µs  min=0s      med=0s       max=39.05ms  p(90)=0s       p(95)=0s       p(99.9)=13.63ms 
     http_req_duration..............: avg=158.17ms min=6.91ms  med=147.15ms max=553.36ms p(90)=175.35ms p(95)=221.02ms p(99.9)=458.55ms
       { expected_response:true }...: avg=158.17ms min=6.91ms  med=147.15ms max=553.36ms p(90)=175.35ms p(95)=221.02ms p(99.9)=458.55ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18951
     http_req_receiving.............: avg=90.97µs  min=26.77µs med=47.23µs  max=12.52ms  p(90)=110.49µs p(95)=171.01µs p(99.9)=3.45ms  
     http_req_sending...............: avg=92.7µs   min=5.33µs  med=11.04µs  max=226.13ms p(90)=31.36µs  p(95)=116.49µs p(99.9)=9.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=157.99ms min=6.85ms  med=147.03ms max=544.04ms p(90)=175.1ms  p(95)=220.17ms p(99.9)=458.5ms 
     http_reqs......................: 18951   310.721459/s
     iteration_duration.............: avg=159.29ms min=29.38ms med=147.53ms max=610.62ms p(90)=175.75ms p(95)=235.11ms p(99.9)=459.89ms
     iterations.....................: 18851   309.081854/s
     success_rate...................: 100.00% ✓ 18851      ✗ 0    
     vus............................: 9       min=9        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55194      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   353 kB/s
     http_req_blocked...............: avg=34.11µs  min=1.2µs   med=2.89µs   max=20.27ms  p(90)=4.65µs   p(95)=5.8µs    p(99.9)=13.69ms 
     http_req_connecting............: avg=29.88µs  min=0s      med=0s       max=20.24ms  p(90)=0s       p(95)=0s       p(99.9)=13.65ms 
     http_req_duration..............: avg=162.05ms min=7.06ms  med=151.17ms max=549.71ms p(90)=181.99ms p(95)=229.39ms p(99.9)=532.48ms
       { expected_response:true }...: avg=162.05ms min=7.06ms  med=151.17ms max=549.71ms p(90)=181.99ms p(95)=229.39ms p(99.9)=532.48ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18498
     http_req_receiving.............: avg=92.5µs   min=26.31µs med=47.04µs  max=17.88ms  p(90)=101.39µs p(95)=163.43µs p(99.9)=3.39ms  
     http_req_sending...............: avg=107.71µs min=5.6µs   med=11.51µs  max=230.42ms p(90)=32.5µs   p(95)=121.41µs p(99.9)=10.16ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=161.85ms min=7ms     med=151.06ms max=539.38ms p(90)=181.75ms p(95)=228.97ms p(99.9)=532.1ms 
     http_reqs......................: 18498   303.387677/s
     iteration_duration.............: avg=163.2ms  min=27.52ms med=151.54ms max=607.11ms p(90)=182.37ms p(95)=230.63ms p(99.9)=533.87ms
     iterations.....................: 18398   301.747566/s
     success_rate...................: 100.00% ✓ 18398      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 22140      ✗ 0   
     data_received..................: 657 MB  11 MB/s
     data_sent......................: 8.7 MB  142 kB/s
     http_req_blocked...............: avg=42.36µs  min=1.38µs  med=2.98µs   max=11.52ms  p(90)=4.61µs   p(95)=5.24µs   p(99.9)=9.87ms  
     http_req_connecting............: avg=37.81µs  min=0s      med=0s       max=11.49ms  p(90)=0s       p(95)=0s       p(99.9)=9.84ms  
     http_req_duration..............: avg=401.58ms min=7.24ms  med=401.06ms max=912.28ms p(90)=454.95ms p(95)=474.22ms p(99.9)=833.16ms
       { expected_response:true }...: avg=401.58ms min=7.24ms  med=401.06ms max=912.28ms p(90)=454.95ms p(95)=474.22ms p(99.9)=833.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7480
     http_req_receiving.............: avg=105.46µs min=29.07µs med=50.16µs  max=320.75ms p(90)=93.75µs  p(95)=108.44µs p(99.9)=727.98µs
     http_req_sending...............: avg=145.07µs min=6.38µs  med=12.18µs  max=341.55ms p(90)=19.63µs  p(95)=23.23µs  p(99.9)=4.34ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=401.33ms min=7.19ms  med=400.97ms max=911.49ms p(90)=454.77ms p(95)=473.74ms p(99.9)=820.06ms
     http_reqs......................: 7480    122.383656/s
     iteration_duration.............: avg=407.64ms min=87.86ms med=401.73ms max=1s       p(90)=455.68ms p(95)=475.02ms p(99.9)=917.95ms
     iterations.....................: 7380    120.747511/s
     success_rate...................: 100.00% ✓ 7380       ✗ 0   
     vus............................: 33      min=33       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 8, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14073 total, 0 failed avg: 215ms, p95: 226ms
hive-router 169 13694 total, 0 failed avg: 220ms, p95: 230ms
hive-gateway 168 12882 total, 0 failed avg: 234ms, p95: 263ms
cosmo 165 13441 total, 0 failed avg: 225ms, p95: 250ms
hive-gateway-bun 162 12488 total, 0 failed avg: 242ms, p95: 281ms
apollo-router 138 11311 total, 0 failed avg: 268ms, p95: 312ms
apollo-gateway 122 10031 total, 0 failed avg: 301ms, p95: 336ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41919      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=43.12µs  min=1.15µs   med=1.92µs   max=15.27ms  p(90)=3.43µs   p(95)=5µs      p(99.9)=13.03ms 
     http_req_connecting............: avg=40.29µs  min=0s       med=0s       max=15.14ms  p(90)=0s       p(95)=0s       p(99.9)=13.01ms 
     http_req_duration..............: avg=214.98ms min=156.71ms med=214.3ms  max=573.77ms p(90)=223.03ms p(95)=225.54ms p(99.9)=489.56ms
       { expected_response:true }...: avg=214.98ms min=156.71ms med=214.3ms  max=573.77ms p(90)=223.03ms p(95)=225.54ms p(99.9)=489.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14073
     http_req_receiving.............: avg=79.16µs  min=24.41µs  med=45.24µs  max=14.3ms   p(90)=90.43µs  p(95)=253.58µs p(99.9)=3.74ms  
     http_req_sending...............: avg=138.12µs min=5.61µs   med=8.53µs   max=343.26ms p(90)=28.6µs   p(95)=91.54µs  p(99.9)=7.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=214.77ms min=156.66ms med=214.21ms max=570.18ms p(90)=222.89ms p(95)=225.36ms p(99.9)=466.32ms
     http_reqs......................: 14073   173.651667/s
     iteration_duration.............: avg=215.27ms min=156.87ms med=214.52ms max=595.97ms p(90)=223.21ms p(95)=225.75ms p(99.9)=519.53ms
     iterations.....................: 13973   172.417732/s
     success_rate...................: 100.00% ✓ 13973      ✗ 0    
     vus............................: 41      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40782      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=19.51µs  min=1.23µs   med=2.08µs   max=9.07ms   p(90)=3.23µs   p(95)=4.56µs   p(99.9)=6.75ms  
     http_req_connecting............: avg=16.83µs  min=0s       med=0s       max=9.03ms   p(90)=0s       p(95)=0s       p(99.9)=6.74ms  
     http_req_duration..............: avg=220.41ms min=120.07ms med=219.39ms max=619.14ms p(90)=227.68ms p(95)=230.16ms p(99.9)=527.4ms 
       { expected_response:true }...: avg=220.41ms min=120.07ms med=219.39ms max=619.14ms p(90)=227.68ms p(95)=230.16ms p(99.9)=527.4ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13694
     http_req_receiving.............: avg=73.92µs  min=24.47µs  med=41.98µs  max=13.87ms  p(90)=87.7µs   p(95)=249.3µs  p(99.9)=1.56ms  
     http_req_sending...............: avg=143.07µs min=5.56µs   med=8.73µs   max=386.9ms  p(90)=29.45µs  p(95)=96.54µs  p(99.9)=6.35ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.19ms min=116.04ms med=219.3ms  max=618.37ms p(90)=227.53ms p(95)=229.98ms p(99.9)=511.03ms
     http_reqs......................: 13694   169.396205/s
     iteration_duration.............: avg=220.7ms  min=120.34ms med=219.6ms  max=627.44ms p(90)=227.85ms p(95)=230.34ms p(99.9)=534.89ms
     iterations.....................: 13594   168.159194/s
     success_rate...................: 100.00% ✓ 13594      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38346      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   196 kB/s
     http_req_blocked...............: avg=20.74µs  min=1.08µs   med=2.57µs   max=9.12ms   p(90)=4.18µs   p(95)=5.47µs   p(99.9)=6.66ms  
     http_req_connecting............: avg=17.38µs  min=0s       med=0s       max=9.09ms   p(90)=0s       p(95)=0s       p(99.9)=6.64ms  
     http_req_duration..............: avg=234.06ms min=159.8ms  med=226.03ms max=705.27ms p(90)=247.88ms p(95)=262.69ms p(99.9)=590.29ms
       { expected_response:true }...: avg=234.06ms min=159.8ms  med=226.03ms max=705.27ms p(90)=247.88ms p(95)=262.69ms p(99.9)=590.29ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12882
     http_req_receiving.............: avg=85.28µs  min=24.26µs  med=44.51µs  max=10.59ms  p(90)=102.9µs  p(95)=208.9µs  p(99.9)=3.19ms  
     http_req_sending...............: avg=81.9µs   min=5.42µs   med=10.75µs  max=111.48ms p(90)=33.5µs   p(95)=121.29µs p(99.9)=5.37ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=233.89ms min=159.74ms med=225.92ms max=704.58ms p(90)=247.53ms p(95)=262.36ms p(99.9)=588.87ms
     http_reqs......................: 12882   168.745504/s
     iteration_duration.............: avg=234.97ms min=166.25ms med=226.37ms max=738.7ms  p(90)=248.32ms p(95)=263.42ms p(99.9)=634.41ms
     iterations.....................: 12782   167.435572/s
     success_rate...................: 100.00% ✓ 12782      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40023      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=47.91µs  min=1.31µs   med=2.66µs   max=22.64ms  p(90)=3.86µs   p(95)=4.83µs   p(99.9)=14.1ms  
     http_req_connecting............: avg=44.43µs  min=0s       med=0s       max=22.61ms  p(90)=0s       p(95)=0s       p(99.9)=13.9ms  
     http_req_duration..............: avg=225ms    min=159.49ms med=223.74ms max=630.09ms p(90)=244.21ms p(95)=249.74ms p(99.9)=513.96ms
       { expected_response:true }...: avg=225ms    min=159.49ms med=223.74ms max=630.09ms p(90)=244.21ms p(95)=249.74ms p(99.9)=513.96ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13441
     http_req_receiving.............: avg=565.95µs min=30.47µs  med=63.82µs  max=340.27ms p(90)=365.01µs p(95)=893.66µs p(99.9)=26.19ms 
     http_req_sending...............: avg=93.58µs  min=6.45µs   med=10.83µs  max=202.69ms p(90)=31.37µs  p(95)=122.03µs p(99.9)=7.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.34ms min=159.43ms med=223.2ms  max=614.02ms p(90)=243.35ms p(95)=249.18ms p(99.9)=501.66ms
     http_reqs......................: 13441   165.817103/s
     iteration_duration.............: avg=225.43ms min=159.69ms med=224.08ms max=641.43ms p(90)=244.46ms p(95)=250.02ms p(99.9)=542.52ms
     iterations.....................: 13341   164.583436/s
     success_rate...................: 100.00% ✓ 13341      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37164      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   189 kB/s
     http_req_blocked...............: avg=27.25µs  min=1.15µs   med=2.62µs   max=11.56ms  p(90)=4.24µs   p(95)=5.5µs    p(99.9)=8.84ms  
     http_req_connecting............: avg=23.8µs   min=0s       med=0s       max=11.21ms  p(90)=0s       p(95)=0s       p(99.9)=8.82ms  
     http_req_duration..............: avg=241.5ms  min=146.56ms med=235.1ms  max=691.2ms  p(90)=267.06ms p(95)=281.01ms p(99.9)=616.39ms
       { expected_response:true }...: avg=241.5ms  min=146.56ms med=235.1ms  max=691.2ms  p(90)=267.06ms p(95)=281.01ms p(99.9)=616.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12488
     http_req_receiving.............: avg=85.25µs  min=26.07µs  med=45.21µs  max=14.73ms  p(90)=107.63µs p(95)=271.7µs  p(99.9)=2.42ms  
     http_req_sending...............: avg=140.82µs min=5.43µs   med=10.95µs  max=168.47ms p(90)=34.67µs  p(95)=127.64µs p(99.9)=13.68ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=241.27ms min=146.51ms med=234.99ms max=682.36ms p(90)=266.81ms p(95)=280.56ms p(99.9)=616.33ms
     http_reqs......................: 12488   162.895194/s
     iteration_duration.............: avg=242.42ms min=146.74ms med=235.56ms max=716.55ms p(90)=267.39ms p(95)=281.6ms  p(99.9)=617.1ms 
     iterations.....................: 12388   161.59078/s
     success_rate...................: 100.00% ✓ 12388      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33633      ✗ 0    
     data_received..................: 993 MB  12 MB/s
     data_sent......................: 13 MB   162 kB/s
     http_req_blocked...............: avg=54.21µs  min=1.37µs   med=2.71µs   max=16.18ms  p(90)=4.11µs   p(95)=4.91µs   p(99.9)=13.63ms 
     http_req_connecting............: avg=50.3µs   min=0s       med=0s       max=16.14ms  p(90)=0s       p(95)=0s       p(99.9)=13.59ms 
     http_req_duration..............: avg=267.58ms min=158.46ms med=265.87ms max=681.93ms p(90)=302.84ms p(95)=312.15ms p(99.9)=568.94ms
       { expected_response:true }...: avg=267.58ms min=158.46ms med=265.87ms max=681.93ms p(90)=302.84ms p(95)=312.15ms p(99.9)=568.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11311
     http_req_receiving.............: avg=129.72µs min=30.43µs  med=52.69µs  max=150.34ms p(90)=150.49µs p(95)=415.28µs p(99.9)=4.86ms  
     http_req_sending...............: avg=116.19µs min=6.07µs   med=11.22µs  max=186.85ms p(90)=39.99µs  p(95)=141.87µs p(99.9)=6.08ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=267.33ms min=158.33ms med=265.68ms max=661.93ms p(90)=302.59ms p(95)=311.94ms p(99.9)=557.64ms
     http_reqs......................: 11311   138.869432/s
     iteration_duration.............: avg=268.45ms min=158.72ms med=266.43ms max=703.98ms p(90)=303.26ms p(95)=312.61ms p(99.9)=617.18ms
     iterations.....................: 11211   137.641694/s
     success_rate...................: 100.00% ✓ 11211      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29793      ✗ 0    
     data_received..................: 881 MB  11 MB/s
     data_sent......................: 12 MB   143 kB/s
     http_req_blocked...............: avg=29.53µs  min=1.4µs    med=3.41µs   max=10.23ms  p(90)=5.45µs   p(95)=6.49µs   p(99.9)=8.04ms  
     http_req_connecting............: avg=24.8µs   min=0s       med=0s       max=10.19ms  p(90)=0s       p(95)=0s       p(99.9)=8.02ms  
     http_req_duration..............: avg=301.31ms min=211.59ms med=298.85ms max=775.96ms p(90)=325.48ms p(95)=336.17ms p(99.9)=701.03ms
       { expected_response:true }...: avg=301.31ms min=211.59ms med=298.85ms max=775.96ms p(90)=325.48ms p(95)=336.17ms p(99.9)=701.03ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10031
     http_req_receiving.............: avg=89.09µs  min=32.18µs  med=70.33µs  max=3.31ms   p(90)=125.59µs p(95)=160.19µs p(99.9)=1.93ms  
     http_req_sending...............: avg=91.31µs  min=6.38µs   med=13.84µs  max=282.36ms p(90)=25.66µs  p(95)=43.77µs  p(99.9)=3.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=301.13ms min=211.34ms med=298.71ms max=774.77ms p(90)=325.32ms p(95)=335.99ms p(99.9)=699.25ms
     http_reqs......................: 10031   122.830653/s
     iteration_duration.............: avg=302.64ms min=223.29ms med=299.31ms max=819.27ms p(90)=325.96ms p(95)=336.63ms p(99.9)=739.49ms
     iterations.....................: 9931    121.606143/s
     success_rate...................: 100.00% ✓ 9931       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 8, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13989 total, 0 failed avg: 216ms, p95: 227ms
hive-router 167 13533 total, 0 failed avg: 223ms, p95: 234ms
cosmo 161 13101 total, 0 failed avg: 231ms, p95: 251ms
hive-gateway 152 11691 total, 0 failed avg: 258ms, p95: 325ms
hive-gateway-bun 148 11370 total, 0 failed avg: 265ms, p95: 318ms
apollo-router 124 10164 total, 0 failed avg: 297ms, p95: 343ms
apollo-gateway 84 6867 total, 0 failed avg: 441ms, p95: 488ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41667      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.64µs  min=1.25µs   med=2.11µs   max=9.36ms   p(90)=3.56µs   p(95)=4.89µs   p(99.9)=6.83ms  
     http_req_connecting............: avg=16.71µs  min=0s       med=0s       max=9.32ms   p(90)=0s       p(95)=0s       p(99.9)=6.77ms  
     http_req_duration..............: avg=215.83ms min=158.84ms med=214.97ms max=602.72ms p(90)=224.41ms p(95)=227.03ms p(99.9)=507.16ms
       { expected_response:true }...: avg=215.83ms min=158.84ms med=214.97ms max=602.72ms p(90)=224.41ms p(95)=227.03ms p(99.9)=507.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13989
     http_req_receiving.............: avg=79.9µs   min=26.01µs  med=45.62µs  max=12.86ms  p(90)=93.27µs  p(95)=267.89µs p(99.9)=1.92ms  
     http_req_sending...............: avg=138.34µs min=5.8µs    med=8.8µs    max=368.93ms p(90)=32.08µs  p(95)=95.33µs  p(99.9)=5.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.62ms min=158.8ms  med=214.87ms max=602.05ms p(90)=224.25ms p(95)=226.86ms p(99.9)=494.13ms
     http_reqs......................: 13989   172.980862/s
     iteration_duration.............: avg=216.12ms min=159.01ms med=215.19ms max=624.66ms p(90)=224.59ms p(95)=227.27ms p(99.9)=521.9ms 
     iterations.....................: 13889   171.744312/s
     success_rate...................: 100.00% ✓ 13889      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40299      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=46.29µs  min=1.12µs   med=2.21µs   max=18.03ms  p(90)=3.15µs   p(95)=4.34µs   p(99.9)=14.93ms 
     http_req_connecting............: avg=42.94µs  min=0s       med=0s       max=17.82ms  p(90)=0s       p(95)=0s       p(99.9)=14.89ms 
     http_req_duration..............: avg=223.28ms min=161.83ms med=222.6ms  max=582.42ms p(90)=231.07ms p(95)=233.57ms p(99.9)=502.33ms
       { expected_response:true }...: avg=223.28ms min=161.83ms med=222.6ms  max=582.42ms p(90)=231.07ms p(95)=233.57ms p(99.9)=502.33ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13533
     http_req_receiving.............: avg=75.57µs  min=25.61µs  med=42.82µs  max=13.76ms  p(90)=91.18µs  p(95)=268.56µs p(99.9)=1.89ms  
     http_req_sending...............: avg=132.91µs min=5.37µs   med=9.43µs   max=342.92ms p(90)=30.42µs  p(95)=96.63µs  p(99.9)=5.24ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.07ms min=161.79ms med=222.5ms  max=581.28ms p(90)=230.93ms p(95)=233.43ms p(99.9)=483.43ms
     http_reqs......................: 13533   167.242735/s
     iteration_duration.............: avg=223.63ms min=162.04ms med=222.83ms max=616.89ms p(90)=231.25ms p(95)=233.75ms p(99.9)=529.76ms
     iterations.....................: 13433   166.006921/s
     success_rate...................: 100.00% ✓ 13433      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 39003      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   188 kB/s
     http_req_blocked...............: avg=22.46µs  min=1.27µs   med=2.59µs   max=9.98ms   p(90)=3.81µs   p(95)=4.58µs   p(99.9)=7.56ms  
     http_req_connecting............: avg=19.29µs  min=0s       med=0s       max=9.94ms   p(90)=0s       p(95)=0s       p(99.9)=7.53ms  
     http_req_duration..............: avg=230.63ms min=161.54ms med=230.5ms  max=618.29ms p(90)=245.55ms p(95)=250.67ms p(99.9)=531.27ms
       { expected_response:true }...: avg=230.63ms min=161.54ms med=230.5ms  max=618.29ms p(90)=245.55ms p(95)=250.67ms p(99.9)=531.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13101
     http_req_receiving.............: avg=284.5µs  min=31.19µs  med=69.03µs  max=129.19ms p(90)=204.22µs p(95)=462.38µs p(99.9)=25.29ms 
     http_req_sending...............: avg=63.91µs  min=6.08µs   med=10.84µs  max=349.54ms p(90)=28.06µs  p(95)=114.95µs p(99.9)=2.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=230.28ms min=161.48ms med=230.2ms  max=617.22ms p(90)=245.06ms p(95)=250.23ms p(99.9)=501.16ms
     http_reqs......................: 13101   161.625419/s
     iteration_duration.............: avg=231.09ms min=161.74ms med=230.81ms max=659.09ms p(90)=245.81ms p(95)=250.95ms p(99.9)=563.19ms
     iterations.....................: 13001   160.391731/s
     success_rate...................: 100.00% ✓ 13001      ✗ 0    
     vus............................: 49      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34773      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   178 kB/s
     http_req_blocked...............: avg=34.09µs  min=1.19µs   med=2.64µs   max=13.96ms  p(90)=4.09µs   p(95)=5.45µs   p(99.9)=10.36ms 
     http_req_connecting............: avg=30.7µs   min=0s       med=0s       max=13.93ms  p(90)=0s       p(95)=0s       p(99.9)=10.32ms 
     http_req_duration..............: avg=258.3ms  min=140.67ms med=249.1ms  max=701.63ms p(90)=267.46ms p(95)=324.74ms p(99.9)=582.56ms
       { expected_response:true }...: avg=258.3ms  min=140.67ms med=249.1ms  max=701.63ms p(90)=267.46ms p(95)=324.74ms p(99.9)=582.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11691
     http_req_receiving.............: avg=97.2µs   min=26.21µs  med=45.08µs  max=62.23ms  p(90)=108.21µs p(95)=371.23µs p(99.9)=3.38ms  
     http_req_sending...............: avg=178.28µs min=5.65µs   med=10.99µs  max=242.72ms p(90)=36.6µs   p(95)=133.87µs p(99.9)=13.1ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=258.03ms min=136.95ms med=248.96ms max=689.09ms p(90)=267.18ms p(95)=292.12ms p(99.9)=578.38ms
     http_reqs......................: 11691   152.976407/s
     iteration_duration.............: avg=259.45ms min=140.86ms med=249.41ms max=717.9ms  p(90)=267.9ms  p(95)=347.67ms p(99.9)=604.86ms
     iterations.....................: 11591   151.66791/s
     success_rate...................: 100.00% ✓ 11591      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33810      ✗ 0    
     data_received..................: 999 MB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=28.8µs   min=1.1µs    med=2.67µs   max=10.91ms  p(90)=4.22µs   p(95)=5.84µs   p(99.9)=8.75ms  
     http_req_connecting............: avg=25.27µs  min=0s       med=0s       max=10.86ms  p(90)=0s       p(95)=0s       p(99.9)=8.72ms  
     http_req_duration..............: avg=265.25ms min=136.97ms med=256.08ms max=735.03ms p(90)=275.93ms p(95)=318.39ms p(99.9)=638.76ms
       { expected_response:true }...: avg=265.25ms min=136.97ms med=256.08ms max=735.03ms p(90)=275.93ms p(95)=318.39ms p(99.9)=638.76ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11370
     http_req_receiving.............: avg=98.95µs  min=26.23µs  med=48.33µs  max=19.55ms  p(90)=118.43µs p(95)=387.04µs p(99.9)=3.29ms  
     http_req_sending...............: avg=100.8µs  min=5.57µs   med=11.32µs  max=217.4ms  p(90)=37.39µs  p(95)=138.06µs p(99.9)=4.59ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.05ms min=136.92ms med=255.93ms max=733.65ms p(90)=275.71ms p(95)=317.6ms  p(99.9)=637.51ms
     http_reqs......................: 11370   148.801662/s
     iteration_duration.............: avg=266.5ms  min=137.15ms med=256.42ms max=756.83ms p(90)=276.37ms p(95)=319.93ms p(99.9)=668.63ms
     iterations.....................: 11270   147.492941/s
     success_rate...................: 100.00% ✓ 11270      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30192      ✗ 0    
     data_received..................: 892 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=63.33µs  min=1.69µs   med=2.74µs   max=18.86ms  p(90)=4.03µs   p(95)=4.81µs   p(99.9)=16.03ms 
     http_req_connecting............: avg=59.18µs  min=0s       med=0s       max=18.81ms  p(90)=0s       p(95)=0s       p(99.9)=16.01ms 
     http_req_duration..............: avg=297.16ms min=137.58ms med=298.98ms max=721.26ms p(90)=333.42ms p(95)=342.93ms p(99.9)=636.74ms
       { expected_response:true }...: avg=297.16ms min=137.58ms med=298.98ms max=721.26ms p(90)=333.42ms p(95)=342.93ms p(99.9)=636.74ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10164
     http_req_receiving.............: avg=87.58µs  min=35.82µs  med=53.32µs  max=12.62ms  p(90)=102.86µs p(95)=188.42µs p(99.9)=1.55ms  
     http_req_sending...............: avg=141µs    min=7.75µs   med=11.14µs  max=229.52ms p(90)=27.23µs  p(95)=129.68µs p(99.9)=3.96ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.93ms min=137.51ms med=298.84ms max=720.61ms p(90)=333.23ms p(95)=342.67ms p(99.9)=634.25ms
     http_reqs......................: 10164   124.883874/s
     iteration_duration.............: avg=298.36ms min=137.77ms med=299.44ms max=763.53ms p(90)=333.77ms p(95)=343.29ms p(99.9)=661.2ms 
     iterations.....................: 10064   123.655186/s
     success_rate...................: 100.00% ✓ 10064      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20301     ✗ 0   
     data_received..................: 603 MB  7.4 MB/s
     data_sent......................: 8.0 MB  98 kB/s
     http_req_blocked...............: avg=46.58µs  min=1.51µs   med=3.62µs   max=11.3ms   p(90)=5.49µs   p(95)=6.17µs   p(99.9)=9.82ms  
     http_req_connecting............: avg=42.24µs  min=0s       med=0s       max=11.27ms  p(90)=0s       p(95)=0s       p(99.9)=9.78ms  
     http_req_duration..............: avg=440.72ms min=212.35ms med=445.13ms max=840.4ms  p(90)=475.26ms p(95)=487.86ms p(99.9)=768.09ms
       { expected_response:true }...: avg=440.72ms min=212.35ms med=445.13ms max=840.4ms  p(90)=475.26ms p(95)=487.86ms p(99.9)=768.09ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6867
     http_req_receiving.............: avg=79.91µs  min=32.86µs  med=71.53µs  max=9.24ms   p(90)=113.21µs p(95)=129.31µs p(99.9)=630.48µs
     http_req_sending...............: avg=121.48µs min=6.85µs   med=15.02µs  max=262.25ms p(90)=22.26µs  p(95)=33.87µs  p(99.9)=4.12ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=440.52ms min=212.14ms med=445.03ms max=840.08ms p(90)=475.12ms p(95)=487.44ms p(99.9)=766.87ms
     http_reqs......................: 6867    84.07601/s
     iteration_duration.............: avg=444.53ms min=268.15ms med=445.63ms max=869.97ms p(90)=475.78ms p(95)=488.59ms p(99.9)=807.04ms
     iterations.....................: 6767    82.851662/s
     success_rate...................: 100.00% ✓ 6767      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 1715b0c into main Sep 10, 2025
34 checks passed
@ardatan ardatan deleted the renovate/lock-file-maintenance branch September 10, 2025 08:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant