Skip to content

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Sep 8, 2025

This PR contains the following updates:

Package Change Age Confidence
@graphql-hive/gateway (source) 2.1.0 -> 2.1.2 age confidence

Release Notes

graphql-hive/gateway (@​graphql-hive/gateway)

v2.1.2

Compare Source

Patch Changes

v2.1.1

Compare Source

Patch Changes

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Sep 8, 2025
Copy link

github-actions bot commented Sep 8, 2025

💻 Website Preview

The latest changes are available as preview in: https://8ba332b2.federation-gateway-benchmark.pages.dev

Copy link

github-actions bot commented Sep 8, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1821 109741 total, 0 failed avg: 27ms, p95: 49ms
grafbase 1667 100658 total, 0 failed avg: 30ms, p95: 52ms
cosmo 615 37210 total, 0 failed avg: 80ms, p95: 118ms
apollo-router 379 23040 total, 0 failed avg: 130ms, p95: 170ms
hive-gateway-bun 313 19133 total, 0 failed avg: 157ms, p95: 255ms
hive-gateway 309 18894 total, 0 failed avg: 159ms, p95: 211ms
apollo-gateway 120 7401 total, 0 failed avg: 407ms, p95: 478ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 328923      ✗ 0     
     data_received..................: 9.6 GB  160 MB/s
     data_sent......................: 128 MB  2.1 MB/s
     http_req_blocked...............: avg=5.18µs   min=1.09µs  med=2.53µs  max=9.35ms   p(90)=3.72µs   p(95)=4.49µs   p(99.9)=103.91µs
     http_req_connecting............: avg=2.13µs   min=0s      med=0s      max=9.31ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=27.12ms  min=1.99ms  med=24.57ms max=445.86ms p(90)=42.15ms  p(95)=48.97ms  p(99.9)=87.92ms 
       { expected_response:true }...: avg=27.12ms  min=1.99ms  med=24.57ms max=445.86ms p(90)=42.15ms  p(95)=48.97ms  p(99.9)=87.92ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 109741
     http_req_receiving.............: avg=119.88µs min=23.07µs med=45.19µs max=153.92ms p(90)=119.68µs p(95)=349.51µs p(99.9)=11.58ms 
     http_req_sending...............: avg=85.39µs  min=5.29µs  med=10.23µs max=158.96ms p(90)=31.08µs  p(95)=127.83µs p(99.9)=12.79ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=26.92ms  min=1.94ms  med=24.42ms max=418.11ms p(90)=41.78ms  p(95)=48.55ms  p(99.9)=86.51ms 
     http_reqs......................: 109741  1821.470523/s
     iteration_duration.............: avg=27.35ms  min=5.42ms  med=24.76ms max=487.46ms p(90)=42.36ms  p(95)=49.17ms  p(99.9)=88.26ms 
     iterations.....................: 109641  1819.810733/s
     success_rate...................: 100.00% ✓ 109641      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 301674      ✗ 0     
     data_received..................: 8.8 GB  147 MB/s
     data_sent......................: 117 MB  1.9 MB/s
     http_req_blocked...............: avg=8.19µs   min=1.16µs  med=3.04µs  max=16.33ms  p(90)=4.28µs  p(95)=5.45µs   p(99.9)=114.67µs
     http_req_connecting............: avg=4.48µs   min=0s      med=0s      max=16.28ms  p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=29.57ms  min=2.71ms  med=26.55ms max=435.99ms p(90)=45.02ms p(95)=51.85ms  p(99.9)=90.97ms 
       { expected_response:true }...: avg=29.57ms  min=2.71ms  med=26.55ms max=435.99ms p(90)=45.02ms p(95)=51.85ms  p(99.9)=90.97ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 100658
     http_req_receiving.............: avg=147.2µs  min=26.39µs med=48.85µs max=355.26ms p(90)=160.1µs p(95)=387.43µs p(99.9)=15.84ms 
     http_req_sending...............: avg=114.13µs min=5.57µs  med=11.75µs max=379.52ms p(90)=39.09µs p(95)=136.56µs p(99.9)=15.18ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.31ms  min=2.67ms  med=26.38ms max=421.08ms p(90)=44.55ms p(95)=51.27ms  p(99.9)=89.16ms 
     http_reqs......................: 100658  1667.479169/s
     iteration_duration.............: avg=29.82ms  min=7.93ms  med=26.78ms max=475.36ms p(90)=45.25ms p(95)=52.08ms  p(99.9)=91.45ms 
     iterations.....................: 100558  1665.82259/s
     success_rate...................: 100.00% ✓ 100558      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 111330     ✗ 0    
     data_received..................: 3.3 GB  54 MB/s
     data_sent......................: 43 MB   716 kB/s
     http_req_blocked...............: avg=17.02µs  min=1.36µs  med=3.11µs  max=17.82ms  p(90)=4.92µs   p(95)=5.94µs   p(99.9)=5.18ms  
     http_req_connecting............: avg=13.08µs  min=0s      med=0s      max=17.77ms  p(90)=0s       p(95)=0s       p(99.9)=5.15ms  
     http_req_duration..............: avg=80.34ms  min=2.92ms  med=79.18ms max=525.02ms p(90)=108.67ms p(95)=117.7ms  p(99.9)=300.45ms
       { expected_response:true }...: avg=80.34ms  min=2.92ms  med=79.18ms max=525.02ms p(90)=108.67ms p(95)=117.7ms  p(99.9)=300.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 37210
     http_req_receiving.............: avg=180.95µs min=31.04µs med=81.32µs max=34.7ms   p(90)=160.26µs p(95)=377.92µs p(99.9)=18.05ms 
     http_req_sending...............: avg=72.77µs  min=6.51µs  med=12.09µs max=258.02ms p(90)=30.45µs  p(95)=125.01µs p(99.9)=9.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=80.09ms  min=2.77ms  med=78.96ms max=516.72ms p(90)=108.37ms p(95)=117.4ms  p(99.9)=289.8ms 
     http_reqs......................: 37210   615.770778/s
     iteration_duration.............: avg=80.84ms  min=7.11ms  med=79.46ms max=575.39ms p(90)=108.94ms p(95)=117.96ms p(99.9)=315.9ms 
     iterations.....................: 37110   614.115925/s
     success_rate...................: 100.00% ✓ 37110      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 68820      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 27 MB   441 kB/s
     http_req_blocked...............: avg=13.32µs  min=1.88µs  med=2.85µs   max=9.06ms   p(90)=4.24µs   p(95)=4.93µs   p(99.9)=4.88ms  
     http_req_connecting............: avg=9.87µs   min=0s      med=0s       max=9.03ms   p(90)=0s       p(95)=0s       p(99.9)=4.86ms  
     http_req_duration..............: avg=130.04ms min=5.9ms   med=129.08ms max=611.34ms p(90)=160.64ms p(95)=170.3ms  p(99.9)=433.57ms
       { expected_response:true }...: avg=130.04ms min=5.9ms   med=129.08ms max=611.34ms p(90)=160.64ms p(95)=170.3ms  p(99.9)=433.57ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23040
     http_req_receiving.............: avg=84.65µs  min=30.71µs med=52.06µs  max=209.34ms p(90)=99.5µs   p(95)=127.36µs p(99.9)=1.57ms  
     http_req_sending...............: avg=79.27µs  min=7.39µs  med=11.51µs  max=392.97ms p(90)=19.57µs  p(95)=33.6µs   p(99.9)=1.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=129.87ms min=5.82ms  med=128.97ms max=590.58ms p(90)=160.52ms p(95)=170.18ms p(99.9)=423.68ms
     http_reqs......................: 23040   379.194041/s
     iteration_duration.............: avg=130.89ms min=30ms    med=129.39ms max=659.13ms p(90)=160.96ms p(95)=170.56ms p(99.9)=449.58ms
     iterations.....................: 22940   377.548234/s
     success_rate...................: 100.00% ✓ 22940      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 57099      ✗ 0    
     data_received..................: 1.7 GB  28 MB/s
     data_sent......................: 22 MB   365 kB/s
     http_req_blocked...............: avg=31.57µs  min=1.26µs  med=2.75µs   max=16.47ms  p(90)=4.47µs   p(95)=5.49µs   p(99.9)=12.41ms 
     http_req_connecting............: avg=27.45µs  min=0s      med=0s       max=16.44ms  p(90)=0s       p(95)=0s       p(99.9)=12.36ms 
     http_req_duration..............: avg=156.65ms min=7.21ms  med=145.34ms max=612.7ms  p(90)=173.69ms p(95)=254.81ms p(99.9)=487.01ms
       { expected_response:true }...: avg=156.65ms min=7.21ms  med=145.34ms max=612.7ms  p(90)=173.69ms p(95)=254.81ms p(99.9)=487.01ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 19133
     http_req_receiving.............: avg=96.15µs  min=26.51µs med=45.79µs  max=15.26ms  p(90)=108.78µs p(95)=205.51µs p(99.9)=4.99ms  
     http_req_sending...............: avg=80.94µs  min=5.55µs  med=11.23µs  max=348.15ms p(90)=32.49µs  p(95)=120.84µs p(99.9)=7.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=156.47ms min=7.16ms  med=145.21ms max=606.58ms p(90)=173.55ms p(95)=248.21ms p(99.9)=484.16ms
     http_reqs......................: 19133   313.677737/s
     iteration_duration.............: avg=157.78ms min=32.01ms med=145.66ms max=650.67ms p(90)=174.02ms p(95)=311.02ms p(99.9)=504.87ms
     iterations.....................: 19033   312.038277/s
     success_rate...................: 100.00% ✓ 19033      ✗ 0    
     vus............................: 12      min=12       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56382      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   360 kB/s
     http_req_blocked...............: avg=19.94µs  min=1.21µs  med=2.72µs   max=11.85ms  p(90)=4.43µs   p(95)=5.4µs    p(99.9)=7.36ms  
     http_req_connecting............: avg=16.17µs  min=0s      med=0s       max=11.81ms  p(90)=0s       p(95)=0s       p(99.9)=7.31ms  
     http_req_duration..............: avg=158.8ms  min=7.13ms  med=146.56ms max=653.55ms p(90)=176.89ms p(95)=210.82ms p(99.9)=523.49ms
       { expected_response:true }...: avg=158.8ms  min=7.13ms  med=146.56ms max=653.55ms p(90)=176.89ms p(95)=210.82ms p(99.9)=523.49ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18894
     http_req_receiving.............: avg=89.83µs  min=25.87µs med=45.64µs  max=16.03ms  p(90)=102.03µs p(95)=175.52µs p(99.9)=3.71ms  
     http_req_sending...............: avg=95.38µs  min=5.5µs   med=11.17µs  max=409.58ms p(90)=31.58µs  p(95)=117.63µs p(99.9)=3.7ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=158.61ms min=7.07ms  med=146.38ms max=652.52ms p(90)=176.69ms p(95)=209.54ms p(99.9)=522.95ms
     http_reqs......................: 18894   309.319002/s
     iteration_duration.............: avg=159.95ms min=29.44ms med=146.9ms  max=692.71ms p(90)=177.25ms p(95)=212.67ms p(99.9)=525.38ms
     iterations.....................: 18794   307.681874/s
     success_rate...................: 100.00% ✓ 18794      ✗ 0    
     vus............................: 25      min=25       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21903      ✗ 0   
     data_received..................: 650 MB  11 MB/s
     data_sent......................: 8.6 MB  141 kB/s
     http_req_blocked...............: avg=60.06µs  min=1.35µs  med=2.91µs   max=15.99ms  p(90)=4.29µs   p(95)=5µs      p(99.9)=13.84ms 
     http_req_connecting............: avg=55.41µs  min=0s      med=0s       max=15.95ms  p(90)=0s       p(95)=0s       p(99.9)=13.51ms 
     http_req_duration..............: avg=406.63ms min=7.37ms  med=406.43ms max=746.18ms p(90)=460.84ms p(95)=478.18ms p(99.9)=671.46ms
       { expected_response:true }...: avg=406.63ms min=7.37ms  med=406.43ms max=746.18ms p(90)=460.84ms p(95)=478.18ms p(99.9)=671.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7401
     http_req_receiving.............: avg=58.88µs  min=28.49µs med=50.41µs  max=4.1ms    p(90)=87.23µs  p(95)=100.81µs p(99.9)=288.83µs
     http_req_sending...............: avg=93.4µs   min=6.26µs  med=11.94µs  max=127.14ms p(90)=17.91µs  p(95)=22.92µs  p(99.9)=8.09ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=406.47ms min=7.33ms  med=406.35ms max=738.59ms p(90)=460.76ms p(95)=478.13ms p(99.9)=663.53ms
     http_reqs......................: 7401    120.957623/s
     iteration_duration.............: avg=412.48ms min=92.9ms  med=406.97ms max=785.15ms p(90)=461.42ms p(95)=479.08ms p(99.9)=724.76ms
     iterations.....................: 7301    119.323281/s
     success_rate...................: 100.00% ✓ 7301       ✗ 0   
     vus............................: 38      min=38       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 8, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1882 117358 total, 0 failed avg: 119ms, p95: 293ms
grafbase 1690 106721 total, 0 failed avg: 131ms, p95: 309ms
cosmo 714 45638 total, 0 failed avg: 308ms, p95: 676ms
apollo-router 386 26089 total, 0 failed avg: 540ms, p95: 1209ms ❌ 17 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 278 19258 total, 0 failed avg: 730ms, p95: 1572ms
hive-gateway-bun 271 18811 total, 0 failed avg: 747ms, p95: 1669ms
apollo-gateway 156 10741 total, 0 failed avg: 1215ms, p95: 2597ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 349074      ✗ 0     
     data_received..................: 10 GB   165 MB/s
     data_sent......................: 137 MB  2.2 MB/s
     http_req_blocked...............: avg=388.57µs min=1.15µs  med=2.56µs   max=303.27ms p(90)=4.11µs   p(95)=5.3µs    p(99.9)=144.53ms
     http_req_connecting............: avg=384.54µs min=0s      med=0s       max=303.23ms p(90)=0s       p(95)=0s       p(99.9)=144.48ms
     http_req_duration..............: avg=118.73ms min=1.82ms  med=105.54ms max=461.57ms p(90)=245.23ms p(95)=292.7ms  p(99.9)=398.05ms
       { expected_response:true }...: avg=118.73ms min=1.82ms  med=105.54ms max=461.57ms p(90)=245.23ms p(95)=292.7ms  p(99.9)=398.05ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 117358
     http_req_receiving.............: avg=487.34µs min=24.07µs med=43.24µs  max=125.2ms  p(90)=190.85µs p(95)=411.1µs  p(99.9)=72.44ms 
     http_req_sending...............: avg=378.16µs min=5.47µs  med=10.33µs  max=130.71ms p(90)=30.15µs  p(95)=132.8µs  p(99.9)=67.89ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=117.86ms min=1.75ms  med=104.81ms max=439.7ms  p(90)=243.14ms p(95)=290.72ms p(99.9)=396.76ms
     http_reqs......................: 117358  1882.762554/s
     iteration_duration.............: avg=120.4ms  min=1.97ms  med=106.94ms max=719.18ms p(90)=247.59ms p(95)=295.2ms  p(99.9)=416.35ms
     iterations.....................: 116358  1866.719655/s
     success_rate...................: 100.00% ✓ 116358      ✗ 0     
     vus............................: 75      min=0         max=494 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 317163      ✗ 0     
     data_received..................: 9.4 GB  149 MB/s
     data_sent......................: 124 MB  2.0 MB/s
     http_req_blocked...............: avg=511.47µs min=1.18µs  med=2.88µs   max=356.11ms p(90)=4.14µs   p(95)=5.09µs   p(99.9)=175.81ms
     http_req_connecting............: avg=504.73µs min=0s      med=0s       max=356.05ms p(90)=0s       p(95)=0s       p(99.9)=175.26ms
     http_req_duration..............: avg=130.5ms  min=2.52ms  med=118.87ms max=467.21ms p(90)=263.04ms p(95)=309.31ms p(99.9)=391.78ms
       { expected_response:true }...: avg=130.5ms  min=2.52ms  med=118.87ms max=467.21ms p(90)=263.04ms p(95)=309.31ms p(99.9)=391.78ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 106721
     http_req_receiving.............: avg=573.72µs min=23.65µs med=46.13µs  max=149.29ms p(90)=179.5µs  p(95)=419.51µs p(99.9)=81.72ms 
     http_req_sending...............: avg=426.02µs min=4.94µs  med=11.48µs  max=142.85ms p(90)=32.47µs  p(95)=133.57µs p(99.9)=70.52ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=129.5ms  min=2.48ms  med=117.87ms max=423.58ms p(90)=260.66ms p(95)=307.28ms p(99.9)=386.98ms
     http_reqs......................: 106721  1690.815832/s
     iteration_duration.............: avg=132.56ms min=2.92ms  med=120.85ms max=808.64ms p(90)=265.69ms p(95)=312.23ms p(99.9)=446.96ms
     iterations.....................: 105721  1674.972504/s
     success_rate...................: 100.00% ✓ 105721      ✗ 0     
     vus............................: 67      min=0         max=497 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 133914     ✗ 0    
     data_received..................: 4.0 GB  63 MB/s
     data_sent......................: 53 MB   832 kB/s
     http_req_blocked...............: avg=90.91µs  min=1.18µs  med=2.75µs   max=148.08ms p(90)=4µs      p(95)=5.28µs   p(99.9)=24.03ms 
     http_req_connecting............: avg=86.02µs  min=0s      med=0s       max=147.93ms p(90)=0s       p(95)=0s       p(99.9)=23.99ms 
     http_req_duration..............: avg=307.65ms min=2.76ms  med=292.68ms max=1.11s    p(90)=604.58ms p(95)=675.53ms p(99.9)=931.8ms 
       { expected_response:true }...: avg=307.65ms min=2.76ms  med=292.68ms max=1.11s    p(90)=604.58ms p(95)=675.53ms p(99.9)=931.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 45638
     http_req_receiving.............: avg=371.17µs min=26.93µs med=57.92µs  max=193.73ms p(90)=163.3µs  p(95)=432.39µs p(99.9)=53.95ms 
     http_req_sending...............: avg=141.26µs min=5.87µs  med=11.14µs  max=98.25ms  p(90)=28.54µs  p(95)=121.97µs p(99.9)=30.71ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=307.14ms min=2.69ms  med=292.29ms max=1.11s    p(90)=603.97ms p(95)=674.54ms p(99.9)=931.68ms
     http_reqs......................: 45638   714.715732/s
     iteration_duration.............: avg=314.99ms min=2.97ms  med=301.11ms max=1.11s    p(90)=607.72ms p(95)=678.52ms p(99.9)=935.85ms
     iterations.....................: 44638   699.055192/s
     success_rate...................: 100.00% ✓ 44638      ✗ 0    
     vus............................: 55      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25072 / ✗ 17
     ✗ valid response structure
      ↳  99% — ✓ 25088 / ✗ 1

     checks.........................: 99.97% ✓ 75249      ✗ 18   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 30 MB  451 kB/s
     http_req_blocked...............: avg=80.67µs  min=1.51µs  med=3.03µs   max=108.74ms p(90)=5.37µs   p(95)=8.14µs   p(99.9)=23.57ms
     http_req_connecting............: avg=75.37µs  min=0s      med=0s       max=108.25ms p(90)=0s       p(95)=0s       p(99.9)=23.49ms
     http_req_duration..............: avg=540.32ms min=6.11ms  med=505.84ms max=1.88s    p(90)=1.07s    p(95)=1.2s     p(99.9)=1.67s  
       { expected_response:true }...: avg=540.32ms min=6.11ms  med=505.84ms max=1.88s    p(90)=1.07s    p(95)=1.2s     p(99.9)=1.67s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26089
     http_req_receiving.............: avg=119.48µs min=32.96µs med=56.13µs  max=68.86ms  p(90)=115.61µs p(95)=213.37µs p(99.9)=10.02ms
     http_req_sending...............: avg=97.68µs  min=6.92µs  med=12µs     max=67.55ms  p(90)=30.87µs  p(95)=118.74µs p(99.9)=15.72ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=540.1ms  min=6ms     med=505.75ms max=1.88s    p(90)=1.07s    p(95)=1.2s     p(99.9)=1.67s  
     http_reqs......................: 26089  386.792008/s
     iteration_duration.............: avg=562.22ms min=6.82ms  med=529.08ms max=1.88s    p(90)=1.09s    p(95)=1.21s    p(99.9)=1.67s  
     iterations.....................: 25089  371.966142/s
     success_rate...................: 99.93% ✓ 25072      ✗ 17   
     vus............................: 86     min=0        max=499
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54774      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 23 MB   326 kB/s
     http_req_blocked...............: avg=118.74µs min=1.27µs  med=2.87µs   max=106.1ms  p(90)=4.84µs  p(95)=7.45µs   p(99.9)=30.84ms
     http_req_connecting............: avg=112.75µs min=0s      med=0s       max=106.06ms p(90)=0s      p(95)=0s       p(99.9)=30.77ms
     http_req_duration..............: avg=729.81ms min=6.67ms  med=665.07ms max=4.32s    p(90)=1.45s   p(95)=1.57s    p(99.9)=3.56s  
       { expected_response:true }...: avg=729.81ms min=6.67ms  med=665.07ms max=4.32s    p(90)=1.45s   p(95)=1.57s    p(99.9)=3.56s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19258
     http_req_receiving.............: avg=191.95µs min=25.56µs med=44.59µs  max=111.85ms p(90)=92.99µs p(95)=239.46µs p(99.9)=25.32ms
     http_req_sending...............: avg=219.91µs min=5.59µs  med=11.13µs  max=130.78ms p(90)=31.02µs p(95)=119.19µs p(99.9)=42.34ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=729.4ms  min=6.62ms  med=664.95ms max=4.32s    p(90)=1.45s   p(95)=1.57s    p(99.9)=3.55s  
     http_reqs......................: 19258   278.151698/s
     iteration_duration.............: avg=770.13ms min=7.26ms  med=708.43ms max=4.34s    p(90)=1.46s   p(95)=1.58s    p(99.9)=3.67s  
     iterations.....................: 18258   263.708262/s
     success_rate...................: 100.00% ✓ 18258      ✗ 0    
     vus............................: 73      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53433      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   318 kB/s
     http_req_blocked...............: avg=113.7µs  min=1.25µs  med=2.89µs   max=159.09ms p(90)=4.87µs  p(95)=7.37µs   p(99.9)=30.97ms
     http_req_connecting............: avg=107.09µs min=0s      med=0s       max=159.03ms p(90)=0s      p(95)=0s       p(99.9)=29.05ms
     http_req_duration..............: avg=747ms    min=6.84ms  med=669.76ms max=4.29s    p(90)=1.48s   p(95)=1.66s    p(99.9)=3.31s  
       { expected_response:true }...: avg=747ms    min=6.84ms  med=669.76ms max=4.29s    p(90)=1.48s   p(95)=1.66s    p(99.9)=3.31s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18811
     http_req_receiving.............: avg=163.89µs min=24.16µs med=44.7µs   max=103.7ms  p(90)=92.1µs  p(95)=153.84µs p(99.9)=24.86ms
     http_req_sending...............: avg=186.11µs min=5.54µs  med=11µs     max=153.07ms p(90)=29.38µs p(95)=107.15µs p(99.9)=32.45ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=746.65ms min=6.77ms  med=669.45ms max=4.29s    p(90)=1.47s   p(95)=1.66s    p(99.9)=3.31s  
     http_reqs......................: 18811   271.050398/s
     iteration_duration.............: avg=789.23ms min=7.51ms  med=736.01ms max=4.3s     p(90)=1.5s    p(95)=1.67s    p(99.9)=3.46s  
     iterations.....................: 17811   256.641254/s
     success_rate...................: 100.00% ✓ 17811      ✗ 0    
     vus............................: 86      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29223      ✗ 0    
     data_received..................: 943 MB  14 MB/s
     data_sent......................: 13 MB   187 kB/s
     http_req_blocked...............: avg=30.64µs min=1.3µs   med=3.44µs  max=22.07ms p(90)=5.91µs   p(95)=17.05µs  p(99.9)=3.99ms
     http_req_connecting............: avg=24.04µs min=0s      med=0s      max=21.99ms p(90)=0s       p(95)=0s       p(99.9)=3.94ms
     http_req_duration..............: avg=1.21s   min=7.49ms  med=1.19s   max=15.96s  p(90)=2.22s    p(95)=2.59s    p(99.9)=14.14s
       { expected_response:true }...: avg=1.21s   min=7.49ms  med=1.19s   max=15.96s  p(90)=2.22s    p(95)=2.59s    p(99.9)=14.14s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10741
     http_req_receiving.............: avg=84.64µs min=27.65µs med=63.91µs max=14.73ms p(90)=114.33µs p(95)=147.46µs p(99.9)=1.26ms
     http_req_sending...............: avg=45.16µs min=6.04µs  med=14.1µs  max=21.08ms p(90)=32.86µs  p(95)=51.94µs  p(99.9)=6.89ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.21s   min=7.42ms  med=1.19s   max=15.96s  p(90)=2.22s    p(95)=2.59s    p(99.9)=14.14s
     http_reqs......................: 10741   156.242061/s
     iteration_duration.............: avg=1.33s   min=7.97ms  med=1.31s   max=15.99s  p(90)=2.26s    p(95)=2.66s    p(99.9)=14.23s
     iterations.....................: 9741    141.695737/s
     success_rate...................: 100.00% ✓ 9741       ✗ 0    
     vus............................: 112     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 8, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14035 total, 0 failed avg: 215ms, p95: 226ms
hive-router 169 13689 total, 0 failed avg: 221ms, p95: 231ms
hive-gateway-bun 167 12777 total, 0 failed avg: 236ms, p95: 261ms
cosmo 166 13491 total, 0 failed avg: 224ms, p95: 247ms
hive-gateway 163 12554 total, 0 failed avg: 241ms, p95: 263ms
apollo-router 136 11135 total, 0 failed avg: 271ms, p95: 311ms ❌ 1 unexpected GraphQL errors
apollo-gateway 121 9921 total, 0 failed avg: 305ms, p95: 339ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41805      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=44.58µs  min=1.18µs   med=2.01µs   max=16.06ms  p(90)=3.48µs   p(95)=5.16µs   p(99.9)=13.43ms 
     http_req_connecting............: avg=41.47µs  min=0s       med=0s       max=15.82ms  p(90)=0s       p(95)=0s       p(99.9)=13.19ms 
     http_req_duration..............: avg=215.18ms min=113.25ms med=214.59ms max=578.96ms p(90)=223.18ms p(95)=225.64ms p(99.9)=480.39ms
       { expected_response:true }...: avg=215.18ms min=113.25ms med=214.59ms max=578.96ms p(90)=223.18ms p(95)=225.64ms p(99.9)=480.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14035
     http_req_receiving.............: avg=79.69µs  min=25.69µs  med=45.93µs  max=11.4ms   p(90)=95.95µs  p(95)=262.48µs p(99.9)=3.12ms  
     http_req_sending...............: avg=100.41µs min=5.54µs   med=8.59µs   max=334.83ms p(90)=30.14µs  p(95)=93.54µs  p(99.9)=5.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215ms    min=113.17ms med=214.48ms max=577.7ms  p(90)=223.06ms p(95)=225.45ms p(99.9)=476.94ms
     http_reqs......................: 14035   173.438538/s
     iteration_duration.............: avg=215.46ms min=113.48ms med=214.81ms max=598.83ms p(90)=223.37ms p(95)=225.83ms p(99.9)=495ms   
     iterations.....................: 13935   172.202781/s
     success_rate...................: 100.00% ✓ 13935      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40767      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=40.27µs  min=1.13µs   med=2.07µs   max=18.26ms  p(90)=3.33µs   p(95)=4.64µs   p(99.9)=13.3ms  
     http_req_connecting............: avg=37.29µs  min=0s       med=0s       max=18.14ms  p(90)=0s       p(95)=0s       p(99.9)=13.22ms 
     http_req_duration..............: avg=220.68ms min=158.89ms med=219.85ms max=579.58ms p(90)=228.45ms p(95)=231.08ms p(99.9)=482.58ms
       { expected_response:true }...: avg=220.68ms min=158.89ms med=219.85ms max=579.58ms p(90)=228.45ms p(95)=231.08ms p(99.9)=482.58ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13689
     http_req_receiving.............: avg=76.77µs  min=25.87µs  med=42.88µs  max=10.84ms  p(90)=92.4µs   p(95)=261.84µs p(99.9)=2.37ms  
     http_req_sending...............: avg=84.52µs  min=5.48µs   med=8.88µs   max=326.56ms p(90)=30.32µs  p(95)=99.63µs  p(99.9)=5.26ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.52ms min=158.85ms med=219.76ms max=578.81ms p(90)=228.29ms p(95)=230.88ms p(99.9)=474.85ms
     http_reqs......................: 13689   169.221904/s
     iteration_duration.............: avg=221.01ms min=159.06ms med=220.06ms max=601.25ms p(90)=228.63ms p(95)=231.28ms p(99.9)=506ms   
     iterations.....................: 13589   167.985715/s
     success_rate...................: 100.00% ✓ 13589      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38031      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   195 kB/s
     http_req_blocked...............: avg=27.47µs  min=1.11µs   med=2.51µs   max=11.55ms  p(90)=4.12µs   p(95)=5.33µs   p(99.9)=9.23ms  
     http_req_connecting............: avg=23.46µs  min=0s       med=0s       max=11.51ms  p(90)=0s       p(95)=0s       p(99.9)=9ms     
     http_req_duration..............: avg=235.91ms min=140.73ms med=227.45ms max=801.7ms  p(90)=249.31ms p(95)=261.34ms p(99.9)=675.49ms
       { expected_response:true }...: avg=235.91ms min=140.73ms med=227.45ms max=801.7ms  p(90)=249.31ms p(95)=261.34ms p(99.9)=675.49ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12777
     http_req_receiving.............: avg=84.04µs  min=25.79µs  med=44.08µs  max=14.77ms  p(90)=101.68µs p(95)=199.95µs p(99.9)=2.81ms  
     http_req_sending...............: avg=102.66µs min=5.29µs   med=10.39µs  max=153.37ms p(90)=31.77µs  p(95)=117.67µs p(99.9)=6.44ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.72ms min=140.63ms med=227.32ms max=801ms    p(90)=249.15ms p(95)=260.89ms p(99.9)=674.78ms
     http_reqs......................: 12777   167.486737/s
     iteration_duration.............: avg=236.76ms min=140.98ms med=227.77ms max=817.2ms  p(90)=249.6ms  p(95)=261.81ms p(99.9)=695.54ms
     iterations.....................: 12677   166.175892/s
     success_rate...................: 100.00% ✓ 12677      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40173      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=52.69µs  min=1.24µs   med=2.79µs   max=17.78ms  p(90)=4.28µs   p(95)=5.33µs   p(99.9)=15.38ms 
     http_req_connecting............: avg=48.45µs  min=0s       med=0s       max=17.73ms  p(90)=0s       p(95)=0s       p(99.9)=15.25ms 
     http_req_duration..............: avg=223.7ms  min=134.93ms med=222.46ms max=612.87ms p(90)=241.59ms p(95)=247.04ms p(99.9)=516.09ms
       { expected_response:true }...: avg=223.7ms  min=134.93ms med=222.46ms max=612.87ms p(90)=241.59ms p(95)=247.04ms p(99.9)=516.09ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13491
     http_req_receiving.............: avg=525.2µs  min=30.04µs  med=64.91µs  max=385.42ms p(90)=356.76µs p(95)=802.12µs p(99.9)=24.92ms 
     http_req_sending...............: avg=131.79µs min=5.67µs   med=11.36µs  max=334.08ms p(90)=32.41µs  p(95)=124.51µs p(99.9)=5.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.05ms min=134.27ms med=221.96ms max=604.02ms p(90)=240.93ms p(95)=246.4ms  p(99.9)=485.59ms
     http_reqs......................: 13491   166.236636/s
     iteration_duration.............: avg=224.13ms min=135.23ms med=222.77ms max=636.83ms p(90)=241.85ms p(95)=247.33ms p(99.9)=540.74ms
     iterations.....................: 13391   165.004432/s
     success_rate...................: 100.00% ✓ 13391      ✗ 0    
     vus............................: 11      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37362      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   191 kB/s
     http_req_blocked...............: avg=21.87µs  min=1.1µs    med=2.57µs   max=9.38ms   p(90)=4.16µs   p(95)=5.47µs   p(99.9)=6.97ms  
     http_req_connecting............: avg=18.47µs  min=0s       med=0s       max=9.35ms   p(90)=0s       p(95)=0s       p(99.9)=6.95ms  
     http_req_duration..............: avg=240.55ms min=142.02ms med=232ms    max=785.31ms p(90)=253.2ms  p(95)=263.24ms p(99.9)=781.08ms
       { expected_response:true }...: avg=240.55ms min=142.02ms med=232ms    max=785.31ms p(90)=253.2ms  p(95)=263.24ms p(99.9)=781.08ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12554
     http_req_receiving.............: avg=83.9µs   min=25.42µs  med=44.71µs  max=9.91ms   p(90)=98.06µs  p(95)=190.5µs  p(99.9)=3.12ms  
     http_req_sending...............: avg=99.14µs  min=5.4µs    med=10.75µs  max=136.59ms p(90)=32.44µs  p(95)=120.99µs p(99.9)=5.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=240.36ms min=137.75ms med=231.86ms max=785.24ms p(90)=253.01ms p(95)=263.06ms p(99.9)=781.04ms
     http_reqs......................: 12554   163.85747/s
     iteration_duration.............: avg=241.45ms min=142.25ms med=232.32ms max=785.49ms p(90)=253.46ms p(95)=263.49ms p(99.9)=781.31ms
     iterations.....................: 12454   162.552248/s
     success_rate...................: 100.00% ✓ 12454      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11034 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 33104      ✗ 1    
     data_received..................: 977 MB 12 MB/s
     data_sent......................: 13 MB  159 kB/s
     http_req_blocked...............: avg=54.03µs  min=1.51µs   med=2.76µs   max=16.35ms  p(90)=4.04µs   p(95)=4.95µs   p(99.9)=13.02ms 
     http_req_connecting............: avg=49.75µs  min=0s       med=0s       max=16.33ms  p(90)=0s       p(95)=0s       p(99.9)=12.91ms 
     http_req_duration..............: avg=271.32ms min=157.68ms med=272.3ms  max=652.7ms  p(90)=302.59ms p(95)=310.83ms p(99.9)=579.24ms
       { expected_response:true }...: avg=271.32ms min=157.68ms med=272.3ms  max=652.7ms  p(90)=302.59ms p(95)=310.83ms p(99.9)=579.24ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11135
     http_req_receiving.............: avg=143.45µs min=32.3µs   med=50.75µs  max=125.9ms  p(90)=166.35µs p(95)=467.09µs p(99.9)=6.44ms  
     http_req_sending...............: avg=129.98µs min=6.62µs   med=11.08µs  max=219.94ms p(90)=88.17µs  p(95)=133.85µs p(99.9)=5.27ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=271.05ms min=157.6ms  med=272.09ms max=645.2ms  p(90)=302.24ms p(95)=310.53ms p(99.9)=556.61ms
     http_reqs......................: 11135  136.986919/s
     iteration_duration.............: avg=272.21ms min=157.9ms  med=272.83ms max=675.96ms p(90)=303ms    p(95)=311.17ms p(99.9)=603.75ms
     iterations.....................: 11035  135.756682/s
     success_rate...................: 99.99% ✓ 11034      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29463      ✗ 0   
     data_received..................: 871 MB  11 MB/s
     data_sent......................: 12 MB   141 kB/s
     http_req_blocked...............: avg=31.77µs  min=1.37µs   med=3.7µs    max=10.32ms  p(90)=5.76µs   p(95)=6.93µs   p(99.9)=8.32ms  
     http_req_connecting............: avg=26.39µs  min=0s       med=0s       max=10.29ms  p(90)=0s       p(95)=0s       p(99.9)=8.3ms   
     http_req_duration..............: avg=304.63ms min=211.58ms med=301.92ms max=836.21ms p(90)=327.88ms p(95)=338.59ms p(99.9)=720.44ms
       { expected_response:true }...: avg=304.63ms min=211.58ms med=301.92ms max=836.21ms p(90)=327.88ms p(95)=338.59ms p(99.9)=720.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9921
     http_req_receiving.............: avg=91.91µs  min=27.89µs  med=73.29µs  max=4.93ms   p(90)=124.68µs p(95)=159.15µs p(99.9)=2.13ms  
     http_req_sending...............: avg=118.42µs min=5.98µs   med=14.8µs   max=251.88ms p(90)=28.88µs  p(95)=44.88µs  p(99.9)=3.35ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=304.42ms min=211.48ms med=301.8ms  max=834.59ms p(90)=327.73ms p(95)=338.32ms p(99.9)=719.03ms
     http_reqs......................: 9921    121.479866/s
     iteration_duration.............: avg=306.01ms min=216.11ms med=302.37ms max=860.63ms p(90)=328.21ms p(95)=339.04ms p(99.9)=786.29ms
     iterations.....................: 9821    120.255394/s
     success_rate...................: 100.00% ✓ 9821       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

Copy link

github-actions bot commented Sep 8, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13952 total, 0 failed avg: 216ms, p95: 228ms
hive-router 167 13594 total, 0 failed avg: 223ms, p95: 233ms
cosmo 155 12645 total, 0 failed avg: 239ms, p95: 266ms
hive-gateway 151 11583 total, 0 failed avg: 260ms, p95: 356ms
hive-gateway-bun 150 11527 total, 0 failed avg: 262ms, p95: 380ms
apollo-router 127 10362 total, 0 failed avg: 291ms, p95: 342ms
apollo-gateway 89 7282 total, 0 failed avg: 416ms, p95: 457ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41556      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=22.08µs  min=1.27µs   med=2.17µs   max=10.7ms   p(90)=4.1µs    p(95)=5.62µs   p(99.9)=7.81ms  
     http_req_connecting............: avg=18.94µs  min=0s       med=0s       max=10.66ms  p(90)=0s       p(95)=0s       p(99.9)=7.78ms  
     http_req_duration..............: avg=216.27ms min=117.72ms med=215.1ms  max=611.32ms p(90)=224.8ms  p(95)=227.82ms p(99.9)=514.65ms
       { expected_response:true }...: avg=216.27ms min=117.72ms med=215.1ms  max=611.32ms p(90)=224.8ms  p(95)=227.82ms p(99.9)=514.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13952
     http_req_receiving.............: avg=102.34µs min=25.87µs  med=49.83µs  max=217.54ms p(90)=108.94µs p(95)=300.8µs  p(99.9)=2.33ms  
     http_req_sending...............: avg=82.4µs   min=5.95µs   med=9.43µs   max=359.35ms p(90)=35.39µs  p(95)=106.22µs p(99.9)=5.25ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.08ms min=117.68ms med=214.99ms max=604.37ms p(90)=224.65ms p(95)=227.61ms p(99.9)=490.31ms
     http_reqs......................: 13952   172.379137/s
     iteration_duration.............: avg=216.59ms min=117.91ms med=215.34ms max=625.49ms p(90)=225.02ms p(95)=228.01ms p(99.9)=550.02ms
     iterations.....................: 13852   171.143621/s
     success_rate...................: 100.00% ✓ 13852      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40482      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=18.49µs  min=1.13µs   med=2.23µs   max=8.72ms   p(90)=3.13µs   p(95)=4.13µs   p(99.9)=6.34ms  
     http_req_connecting............: avg=15.82µs  min=0s       med=0s       max=8.68ms   p(90)=0s       p(95)=0s       p(99.9)=6.31ms  
     http_req_duration..............: avg=222.58ms min=160.04ms med=221.7ms  max=600.01ms p(90)=230.5ms  p(95)=233.07ms p(99.9)=509.16ms
       { expected_response:true }...: avg=222.58ms min=160.04ms med=221.7ms  max=600.01ms p(90)=230.5ms  p(95)=233.07ms p(99.9)=509.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13594
     http_req_receiving.............: avg=86.82µs  min=23.03µs  med=42.35µs  max=217.17ms p(90)=80.24µs  p(95)=245.68µs p(99.9)=1.06ms  
     http_req_sending...............: avg=119.27µs min=5.79µs   med=9.41µs   max=335.7ms  p(90)=28.19µs  p(95)=96.97µs  p(99.9)=5.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.38ms min=159.99ms med=221.6ms  max=584.73ms p(90)=230.36ms p(95)=232.89ms p(99.9)=478.45ms
     http_reqs......................: 13594   167.962916/s
     iteration_duration.............: avg=222.91ms min=160.2ms  med=221.94ms max=609ms    p(90)=230.68ms p(95)=233.23ms p(99.9)=518ms   
     iterations.....................: 13494   166.72735/s
     success_rate...................: 100.00% ✓ 13494      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37635      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   181 kB/s
     http_req_blocked...............: avg=22.78µs  min=1.64µs   med=2.83µs   max=9.39ms   p(90)=4.19µs   p(95)=5.29µs   p(99.9)=7.14ms  
     http_req_connecting............: avg=18.47µs  min=0s       med=0s       max=9.35ms   p(90)=0s       p(95)=0s       p(99.9)=7.12ms  
     http_req_duration..............: avg=238.59ms min=162.7ms  med=238.05ms max=652.28ms p(90)=260.02ms p(95)=265.72ms p(99.9)=544.33ms
       { expected_response:true }...: avg=238.59ms min=162.7ms  med=238.05ms max=652.28ms p(90)=260.02ms p(95)=265.72ms p(99.9)=544.33ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12645
     http_req_receiving.............: avg=359.44µs min=34.96µs  med=66.62µs  max=85.34ms  p(90)=206.67µs p(95)=474.85µs p(99.9)=27.38ms 
     http_req_sending...............: avg=68.69µs  min=6.91µs   med=11.37µs  max=169.16ms p(90)=29.35µs  p(95)=122.02µs p(99.9)=3.23ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.17ms min=161.69ms med=237.67ms max=650.95ms p(90)=259.52ms p(95)=265.27ms p(99.9)=543.24ms
     http_reqs......................: 12645   155.812481/s
     iteration_duration.............: avg=239.17ms min=162.87ms med=238.49ms max=671.36ms p(90)=260.31ms p(95)=266.07ms p(99.9)=566.84ms
     iterations.....................: 12545   154.580275/s
     success_rate...................: 100.00% ✓ 12545      ✗ 0    
     vus............................: 1       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34449      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   176 kB/s
     http_req_blocked...............: avg=29.98µs  min=1.18µs   med=2.61µs   max=12.04ms  p(90)=4.1µs    p(95)=5.4µs    p(99.9)=9.32ms  
     http_req_connecting............: avg=26.55µs  min=0s       med=0s       max=12ms     p(90)=0s       p(95)=0s       p(99.9)=9.3ms   
     http_req_duration..............: avg=260.2ms  min=160.52ms med=251.01ms max=822.36ms p(90)=271.62ms p(95)=355.82ms p(99.9)=705.39ms
       { expected_response:true }...: avg=260.2ms  min=160.52ms med=251.01ms max=822.36ms p(90)=271.62ms p(95)=355.82ms p(99.9)=705.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11583
     http_req_receiving.............: avg=115.89µs min=25.32µs  med=46.18µs  max=193.66ms p(90)=115.2µs  p(95)=373.57µs p(99.9)=3.98ms  
     http_req_sending...............: avg=116.76µs min=5.26µs   med=10.94µs  max=236.41ms p(90)=36.73µs  p(95)=138.07µs p(99.9)=7.23ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=259.97ms min=158.32ms med=250.87ms max=821.34ms p(90)=271.3ms  p(95)=354.09ms p(99.9)=704.03ms
     http_reqs......................: 11583   151.375661/s
     iteration_duration.............: avg=261.41ms min=162.14ms med=251.35ms max=844.65ms p(90)=271.96ms p(95)=384.97ms p(99.9)=720.53ms
     iterations.....................: 11483   150.068783/s
     success_rate...................: 100.00% ✓ 11483      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34281      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   175 kB/s
     http_req_blocked...............: avg=29.89µs  min=1.1µs    med=2.6µs    max=13.16ms  p(90)=4.14µs   p(95)=5.54µs   p(99.9)=9.42ms  
     http_req_connecting............: avg=26.46µs  min=0s       med=0s       max=13.12ms  p(90)=0s       p(95)=0s       p(99.9)=9.4ms   
     http_req_duration..............: avg=262.12ms min=144.16ms med=252.43ms max=723.76ms p(90)=271.6ms  p(95)=379.78ms p(99.9)=616.03ms
       { expected_response:true }...: avg=262.12ms min=144.16ms med=252.43ms max=723.76ms p(90)=271.6ms  p(95)=379.78ms p(99.9)=616.03ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11527
     http_req_receiving.............: avg=92.69µs  min=25.52µs  med=46.23µs  max=11.2ms   p(90)=107.44µs p(95)=358.26µs p(99.9)=3.37ms  
     http_req_sending...............: avg=148.47µs min=5.32µs   med=11.06µs  max=216.79ms p(90)=36.64µs  p(95)=134.66µs p(99.9)=13.04ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=261.88ms min=139.52ms med=252.31ms max=721.26ms p(90)=271.42ms p(95)=377.64ms p(99.9)=606.91ms
     http_reqs......................: 11527   150.600402/s
     iteration_duration.............: avg=263.33ms min=144.38ms med=252.74ms max=743.71ms p(90)=271.95ms p(95)=392.25ms p(99.9)=664.36ms
     iterations.....................: 11427   149.2939/s
     success_rate...................: 100.00% ✓ 11427      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30786      ✗ 0    
     data_received..................: 909 MB  11 MB/s
     data_sent......................: 12 MB   148 kB/s
     http_req_blocked...............: avg=27.27µs  min=1.77µs   med=2.88µs   max=9.79ms   p(90)=4.38µs   p(95)=5.36µs   p(99.9)=7.93ms  
     http_req_connecting............: avg=23.51µs  min=0s       med=0s       max=9.72ms   p(90)=0s       p(95)=0s       p(99.9)=7.9ms   
     http_req_duration..............: avg=291.49ms min=156.66ms med=289.8ms  max=699.5ms  p(90)=331.86ms p(95)=342.2ms  p(99.9)=614.36ms
       { expected_response:true }...: avg=291.49ms min=156.66ms med=289.8ms  max=699.5ms  p(90)=331.86ms p(95)=342.2ms  p(99.9)=614.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10362
     http_req_receiving.............: avg=88.19µs  min=34.01µs  med=53.8µs   max=22.73ms  p(90)=105.55µs p(95)=195.22µs p(99.9)=1.41ms  
     http_req_sending...............: avg=100.76µs min=7.63µs   med=11.43µs  max=243.77ms p(90)=23.64µs  p(95)=127.18µs p(99.9)=4.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=291.3ms  min=156.59ms med=289.66ms max=684.82ms p(90)=331.73ms p(95)=341.81ms p(99.9)=613.04ms
     http_reqs......................: 10362   127.024573/s
     iteration_duration.............: avg=292.56ms min=156.89ms med=290.4ms  max=720.86ms p(90)=332.25ms p(95)=342.64ms p(99.9)=652.49ms
     iterations.....................: 10262   125.798703/s
     success_rate...................: 100.00% ✓ 10262      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21546     ✗ 0   
     data_received..................: 640 MB  7.8 MB/s
     data_sent......................: 8.5 MB  104 kB/s
     http_req_blocked...............: avg=40.53µs  min=1.29µs   med=2.96µs   max=11ms     p(90)=4.01µs   p(95)=4.86µs   p(99.9)=9.49ms  
     http_req_connecting............: avg=37.16µs  min=0s       med=0s       max=10.97ms  p(90)=0s       p(95)=0s       p(99.9)=9.43ms  
     http_req_duration..............: avg=415.67ms min=209.38ms med=416.99ms max=889.77ms p(90)=444.51ms p(95)=456.88ms p(99.9)=811.98ms
       { expected_response:true }...: avg=415.67ms min=209.38ms med=416.99ms max=889.77ms p(90)=444.51ms p(95)=456.88ms p(99.9)=811.98ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7282
     http_req_receiving.............: avg=57.78µs  min=24.93µs  med=49.83µs  max=1.58ms   p(90)=83.02µs  p(95)=98.41µs  p(99.9)=595.94µs
     http_req_sending...............: avg=87.55µs  min=6.16µs   med=12.11µs  max=183.71ms p(90)=16.51µs  p(95)=22.03µs  p(99.9)=5.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=415.53ms min=209.31ms med=416.9ms  max=888.42ms p(90)=444.4ms  p(95)=456.74ms p(99.9)=810.51ms
     http_reqs......................: 7282    89.28682/s
     iteration_duration.............: avg=418.88ms min=263.85ms med=417.44ms max=907.49ms p(90)=445.03ms p(95)=457.3ms  p(99.9)=832.57ms
     iterations.....................: 7182    88.060689/s
     success_rate...................: 100.00% ✓ 7182      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@renovate renovate bot force-pushed the renovate/graphql-hive-gateway-monorepo branch from 2a2aa9e to 8c85cbc Compare September 9, 2025 14:00
@renovate renovate bot changed the title Update dependency @graphql-hive/gateway to v2.1.1 Update dependency @graphql-hive/gateway to v2.1.2 Sep 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants