Populate entity's external fields in inventory subgraph #894
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
💻 Website PreviewThe latest changes are available as preview in: https://712c0679.federation-gateway-benchmark.pages.dev |
Overview for:
|
| Gateway | RPS ⬇️ | Requests | Duration | Notes |
|---|---|---|---|---|
| hive-router | 1662 | 103941 total, 0 failed | avg: 134ms, p95: 326ms | ✅ |
| grafbase | 1404 | 91636 total, 0 failed | avg: 152ms, p95: 352ms | ✅ |
| cosmo | 666 | 42623 total, 0 failed | avg: 329ms, p95: 736ms | ✅ |
| hive-gateway-router-runtime | 564 | 37160 total, 0 failed | avg: 377ms, p95: 875ms | ❌ 105 unexpected GraphQL errors, non-compatible response structure (2) |
| apollo-router | 252 | 17264 total, 0 failed | avg: 776ms, p95: 1643ms | ❌ 16258 unexpected GraphQL errors, non-compatible response structure (474) |
| hive-gateway | 162 | 11315 total, 0 failed | avg: 1178ms, p95: 3213ms | ❌ 1983 unexpected GraphQL errors, non-compatible response structure (87) |
| apollo-gateway | 116 | 8327 total, 0 failed | avg: 1485ms, p95: 3021ms | ❌ 7327 unexpected GraphQL errors, non-compatible response structure (332) |
Summary for: hive-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 308823 ✗ 0
data_received..................: 9.1 GB 145 MB/s
data_sent......................: 121 MB 1.9 MB/s
http_req_blocked...............: avg=508.12µs min=1.23µs med=2.82µs max=352.11ms p(90)=4.49µs p(95)=5.44µs p(99.9)=175.26ms
http_req_connecting............: avg=504.15µs min=0s med=0s max=352ms p(90)=0s p(95)=0s p(99.9)=175.21ms
http_req_duration..............: avg=133.99ms min=1.78ms med=119.4ms max=504.16ms p(90)=272.74ms p(95)=326.02ms p(99.9)=440.07ms
{ expected_response:true }...: avg=133.99ms min=1.78ms med=119.4ms max=504.16ms p(90)=272.74ms p(95)=326.02ms p(99.9)=440.07ms
http_req_failed................: 0.00% ✓ 0 ✗ 103941
http_req_receiving.............: avg=573.38µs min=25.52µs med=44.83µs max=152.27ms p(90)=165.37µs p(95)=435.43µs p(99.9)=82.77ms
http_req_sending...............: avg=469.08µs min=5.51µs med=10.73µs max=153.18ms p(90)=30.78µs p(95)=140.03µs p(99.9)=76.87ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=132.94ms min=1.72ms med=118.44ms max=493.99ms p(90)=270.53ms p(95)=324.07ms p(99.9)=436.52ms
http_reqs......................: 103941 1662.397636/s
iteration_duration.............: avg=136.13ms min=2.04ms med=121.2ms max=790.74ms p(90)=275.11ms p(95)=328.5ms p(99.9)=465.27ms
iterations.....................: 102941 1646.40397/s
success_rate...................: 100.00% ✓ 102941 ✗ 0
vus............................: 84 min=0 max=498
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: grafbase
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 271908 ✗ 0
data_received..................: 8.0 GB 123 MB/s
data_sent......................: 107 MB 1.6 MB/s
http_req_blocked...............: avg=717.53µs min=1.2µs med=2.91µs max=411.48ms p(90)=4.56µs p(95)=5.83µs p(99.9)=230.82ms
http_req_connecting............: avg=713.39µs min=0s med=0s max=411.42ms p(90)=0s p(95)=0s p(99.9)=230.71ms
http_req_duration..............: avg=151.84ms min=2.5ms med=140.64ms max=716.11ms p(90)=300.5ms p(95)=352.11ms p(99.9)=462.04ms
{ expected_response:true }...: avg=151.84ms min=2.5ms med=140.64ms max=716.11ms p(90)=300.5ms p(95)=352.11ms p(99.9)=462.04ms
http_req_failed................: 0.00% ✓ 0 ✗ 91636
http_req_receiving.............: avg=663.73µs min=25.47µs med=48.15µs max=154.43ms p(90)=150.37µs p(95)=459.32µs p(99.9)=89.37ms
http_req_sending...............: avg=614.84µs min=5.34µs med=11.6µs max=150.58ms p(90)=33.58µs p(95)=148.29µs p(99.9)=86.08ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=150.56ms min=2.46ms med=139.33ms max=716.05ms p(90)=298ms p(95)=349.49ms p(99.9)=458.9ms
http_reqs......................: 91636 1404.594743/s
iteration_duration.............: avg=154.65ms min=3.47ms med=142.85ms max=1s p(90)=303.3ms p(95)=356.6ms p(99.9)=544.07ms
iterations.....................: 90636 1389.266763/s
success_rate...................: 100.00% ✓ 90636 ✗ 0
vus............................: 73 min=0 max=494
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: cosmo
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 124869 ✗ 0
data_received..................: 3.7 GB 58 MB/s
data_sent......................: 50 MB 777 kB/s
http_req_blocked...............: avg=132.24µs min=1.27µs med=2.95µs max=168.93ms p(90)=4.84µs p(95)=6.96µs p(99.9)=38.36ms
http_req_connecting............: avg=125.43µs min=0s med=0s max=168.72ms p(90)=0s p(95)=0s p(99.9)=37.81ms
http_req_duration..............: avg=329.45ms min=2.86ms med=311.71ms max=1.29s p(90)=645.67ms p(95)=736.17ms p(99.9)=1.11s
{ expected_response:true }...: avg=329.45ms min=2.86ms med=311.71ms max=1.29s p(90)=645.67ms p(95)=736.17ms p(99.9)=1.11s
http_req_failed................: 0.00% ✓ 0 ✗ 42623
http_req_receiving.............: avg=453.7µs min=29.29µs med=63.49µs max=195.08ms p(90)=198.41µs p(95)=512.06µs p(99.9)=64.19ms
http_req_sending...............: avg=187.57µs min=5.8µs med=11.56µs max=123.11ms p(90)=33.84µs p(95)=139.38µs p(99.9)=36.7ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=328.81ms min=2.8ms med=310.95ms max=1.29s p(90)=644.56ms p(95)=735.17ms p(99.9)=1.1s
http_reqs......................: 42623 666.822207/s
iteration_duration.............: avg=337.96ms min=3.24ms med=321.64ms max=1.29s p(90)=650.02ms p(95)=740.95ms p(99.9)=1.11s
iterations.....................: 41623 651.17755/s
success_rate...................: 100.00% ✓ 41623 ✗ 0
vus............................: 58 min=0 max=498
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway-router-runtime
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 99% — ✓ 36055 / ✗ 105
✗ valid response structure
↳ 99% — ✓ 36156 / ✗ 2
checks.........................: 99.90% ✓ 108371 ✗ 107
data_received..................: 3.3 GB 49 MB/s
data_sent......................: 43 MB 658 kB/s
http_req_blocked...............: avg=362.35µs min=1.31µs med=2.75µs max=478.4ms p(90)=4.33µs p(95)=6.13µs p(99.9)=96.5ms
http_req_connecting............: avg=357.69µs min=0s med=0s max=478.34ms p(90)=0s p(95)=0s p(99.9)=96.42ms
http_req_duration..............: avg=376.89ms min=4.69ms med=330.54ms max=1.35s p(90)=770.06ms p(95)=874.56ms p(99.9)=1.18s
{ expected_response:true }...: avg=376.89ms min=4.69ms med=330.54ms max=1.35s p(90)=770.06ms p(95)=874.56ms p(99.9)=1.18s
http_req_failed................: 0.00% ✓ 0 ✗ 37160
http_req_receiving.............: avg=334.23µs min=26.34µs med=44.76µs max=227.8ms p(90)=101.56µs p(95)=397.76µs p(99.9)=55.91ms
http_req_sending...............: avg=367.84µs min=5.71µs med=11.03µs max=198.51ms p(90)=31.03µs p(95)=134.06µs p(99.9)=63.72ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=376.19ms min=4.64ms med=329.96ms max=1.31s p(90)=768.88ms p(95)=872.03ms p(99.9)=1.18s
http_reqs......................: 37160 564.71325/s
iteration_duration.............: avg=389.19ms min=5.03ms med=339.11ms max=1.57s p(90)=776.75ms p(95)=888.05ms p(99.9)=1.29s
iterations.....................: 36158 549.486052/s
success_rate...................: 99.70% ✓ 36051 ✗ 107
vus............................: 31 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-router
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 0% — ✓ 0 / ✗ 16258
✗ valid response structure
↳ 97% — ✓ 15783 / ✗ 474
checks.........................: 65.69% ✓ 32047 ✗ 16732
data_received..................: 1.8 GB 26 MB/s
data_sent......................: 20 MB 295 kB/s
http_req_blocked...............: avg=17.22ms min=1.74µs med=3.39µs max=1.59s p(90)=6.15µs p(95)=10.58µs p(99.9)=1.29s
http_req_connecting............: avg=17.19ms min=0s med=0s max=1.48s p(90)=0s p(95)=0s p(99.9)=1.29s
http_req_duration..............: avg=776.35ms min=6.7ms med=759.16ms max=2.12s p(90)=1.51s p(95)=1.64s p(99.9)=2.01s
{ expected_response:true }...: avg=776.35ms min=6.7ms med=759.16ms max=2.12s p(90)=1.51s p(95)=1.64s p(99.9)=2.01s
http_req_failed................: 0.00% ✓ 0 ✗ 17264
http_req_receiving.............: avg=2.94ms min=30.97µs med=56.3µs max=660.91ms p(90)=113.51µs p(95)=543.98µs p(99.9)=415.36ms
http_req_sending...............: avg=16.61ms min=7.41µs med=13.6µs max=643.75ms p(90)=6.69ms p(95)=134.06ms p(99.9)=555.05ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=756.79ms min=6.63ms med=723.78ms max=2.01s p(90)=1.48s p(95)=1.6s p(99.9)=1.92s
http_reqs......................: 17264 252.290473/s
iteration_duration.............: avg=865.46ms min=8.26ms med=835.01ms max=6.71s p(90)=1.55s p(95)=1.71s p(99.9)=4.97s
iterations.....................: 16257 237.574503/s
success_rate...................: 0.00% ✓ 0 ✗ 16257
vus............................: 88 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: hive-gateway
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 80% — ✓ 8332 / ✗ 1983
✗ valid response structure
↳ 99% — ✓ 10227 / ✗ 87
checks.........................: 93.31% ✓ 28874 ✗ 2070
data_received..................: 1.0 GB 15 MB/s
data_sent......................: 14 MB 194 kB/s
http_req_blocked...............: avg=1.19ms min=1.64µs med=3.2µs max=541ms p(90)=6.4µs p(95)=12.6µs p(99.9)=229.57ms
http_req_connecting............: avg=1.15ms min=0s med=0s max=540.92ms p(90)=0s p(95)=0s p(99.9)=218.77ms
http_req_duration..............: avg=1.17s min=6.24ms med=914.97ms max=11.81s p(90)=2.77s p(95)=3.21s p(99.9)=10.9s
{ expected_response:true }...: avg=1.17s min=6.24ms med=914.97ms max=11.81s p(90)=2.77s p(95)=3.21s p(99.9)=10.9s
http_req_failed................: 0.00% ✓ 0 ✗ 11315
http_req_receiving.............: avg=603.72µs min=32µs med=55.16µs max=497.07ms p(90)=152.22µs p(95)=583.69µs p(99.9)=100.64ms
http_req_sending...............: avg=1.82ms min=7.23µs med=12.56µs max=536.96ms p(90)=111.37µs p(95)=391.55µs p(99.9)=192.16ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=1.17s min=6.18ms med=912.44ms max=11.81s p(90)=2.77s p(95)=3.19s p(99.9)=10.9s
http_reqs......................: 11315 162.312799/s
iteration_duration.............: avg=1.29s min=8.23ms med=1.07s max=11.99s p(90)=2.91s p(95)=3.31s p(99.9)=11.01s
iterations.....................: 10314 147.953531/s
success_rate...................: 80.77% ✓ 8331 ✗ 1983
vus............................: 74 min=0 max=499
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Summary for: apollo-gateway
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 0% — ✓ 0 / ✗ 7327
✗ valid response structure
↳ 95% — ✓ 6995 / ✗ 332
checks.........................: 65.15% ✓ 14322 ✗ 7659
data_received..................: 732 MB 10 MB/s
data_sent......................: 10 MB 141 kB/s
http_req_blocked...............: avg=238.88µs min=2µs med=4.15µs max=96.93ms p(90)=7.08µs p(95)=26.02µs p(99.9)=50.81ms
http_req_connecting............: avg=230.68µs min=0s med=0s max=94.28ms p(90)=0s p(95)=0s p(99.9)=50.75ms
http_req_duration..............: avg=1.48s min=8.26ms med=1.46s max=19.51s p(90)=2.55s p(95)=3.02s p(99.9)=18.16s
{ expected_response:true }...: avg=1.48s min=8.26ms med=1.46s max=19.51s p(90)=2.55s p(95)=3.02s p(99.9)=18.16s
http_req_failed................: 0.00% ✓ 0 ✗ 8327
http_req_receiving.............: avg=131.64µs min=34.64µs med=66.7µs max=22.77ms p(90)=125.4µs p(95)=186.11µs p(99.9)=10.26ms
http_req_sending...............: avg=452.67µs min=8.62µs med=17.33µs max=65.57ms p(90)=121.75µs p(95)=1.29ms p(99.9)=38.92ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=1.48s min=8.2ms med=1.46s max=19.51s p(90)=2.55s p(95)=3.02s p(99.9)=18.16s
http_reqs......................: 8327 116.288024/s
iteration_duration.............: avg=1.68s min=10.18ms med=1.61s max=19.53s p(90)=2.62s p(95)=3.11s p(99.9)=18.32s
iterations.....................: 7327 102.322848/s
success_rate...................: 0.00% ✓ 0 ✗ 7327
vus............................: 112 min=0 max=500
vus_max........................: 500 min=500 max=500
Performance Overview
HTTP Overview
Overview for:
|
| Gateway | RPS ⬇️ | Requests | Duration | Notes |
|---|---|---|---|---|
| hive-router | 1685 | 101548 total, 0 failed | avg: 29ms, p95: 51ms | ✅ |
| grafbase | 1475 | 89159 total, 0 failed | avg: 33ms, p95: 57ms | ✅ |
| cosmo | 605 | 36647 total, 0 failed | avg: 82ms, p95: 121ms | ✅ |
| hive-gateway-router-runtime | 580 | 35286 total, 0 failed | avg: 85ms, p95: 114ms | ❌ 1 unexpected GraphQL errors |
| apollo-router | 272 | 16618 total, 0 failed | avg: 177ms, p95: 288ms | ❌ 16518 unexpected GraphQL errors, non-compatible response structure (50) |
| hive-gateway | 209 | 12842 total, 0 failed | avg: 233ms, p95: 526ms | ❌ 1422 unexpected GraphQL errors |
| apollo-gateway | 114 | 7014 total, 0 failed | avg: 427ms, p95: 526ms | ❌ 6914 unexpected GraphQL errors, non-compatible response structure (50) |
Summary for: hive-router
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 304344 ✗ 0
data_received..................: 8.9 GB 147 MB/s
data_sent......................: 118 MB 2.0 MB/s
http_req_blocked...............: avg=5.33µs min=1.18µs med=2.57µs max=9.51ms p(90)=3.73µs p(95)=4.47µs p(99.9)=93.96µs
http_req_connecting............: avg=2.27µs min=0s med=0s max=9.48ms p(90)=0s p(95)=0s p(99.9)=0s
http_req_duration..............: avg=29.28ms min=1.91ms med=26.9ms max=434.04ms p(90)=44.6ms p(95)=51.09ms p(99.9)=90.41ms
{ expected_response:true }...: avg=29.28ms min=1.91ms med=26.9ms max=434.04ms p(90)=44.6ms p(95)=51.09ms p(99.9)=90.41ms
http_req_failed................: 0.00% ✓ 0 ✗ 101548
http_req_receiving.............: avg=118.24µs min=24.6µs med=43.71µs max=174.65ms p(90)=104.75µs p(95)=337.18µs p(99.9)=12.26ms
http_req_sending...............: avg=102.69µs min=5.2µs med=10.33µs max=236.75ms p(90)=31.42µs p(95)=126.02µs p(99.9)=13.62ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=29.06ms min=1.87ms med=26.74ms max=416.78ms p(90)=44.22ms p(95)=50.68ms p(99.9)=89.43ms
http_reqs......................: 101548 1685.460024/s
iteration_duration.............: avg=29.56ms min=3.64ms med=27.15ms max=448.89ms p(90)=44.86ms p(95)=51.35ms p(99.9)=91.09ms
iterations.....................: 101448 1683.800258/s
success_rate...................: 100.00% ✓ 101448 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: grafbase
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 267177 ✗ 0
data_received..................: 7.8 GB 129 MB/s
data_sent......................: 104 MB 1.7 MB/s
http_req_blocked...............: avg=11.2µs min=1.21µs med=2.96µs max=18.77ms p(90)=4.25µs p(95)=5.2µs p(99.9)=122.7µs
http_req_connecting............: avg=7.49µs min=0s med=0s max=18.74ms p(90)=0s p(95)=0s p(99.9)=0s
http_req_duration..............: avg=33.33ms min=3.03ms med=30.29ms max=534.19ms p(90)=50.53ms p(95)=57.26ms p(99.9)=94.38ms
{ expected_response:true }...: avg=33.33ms min=3.03ms med=30.29ms max=534.19ms p(90)=50.53ms p(95)=57.26ms p(99.9)=94.38ms
http_req_failed................: 0.00% ✓ 0 ✗ 89159
http_req_receiving.............: avg=157.6µs min=26.9µs med=48.98µs max=302.49ms p(90)=158.55µs p(95)=406.2µs p(99.9)=16.5ms
http_req_sending...............: avg=139.46µs min=5.62µs med=11.81µs max=468.52ms p(90)=49.68µs p(95)=143.98µs p(99.9)=18.3ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=33.04ms min=2.97ms med=30.08ms max=511.4ms p(90)=50.03ms p(95)=56.8ms p(99.9)=90.64ms
http_reqs......................: 89159 1475.488736/s
iteration_duration.............: avg=33.68ms min=6.4ms med=30.58ms max=596.41ms p(90)=50.82ms p(95)=57.56ms p(99.9)=96.43ms
iterations.....................: 89059 1473.83384/s
success_rate...................: 100.00% ✓ 89059 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: cosmo
K6 Output
✓ response code was 200
✓ no graphql errors
✓ valid response structure
checks.........................: 100.00% ✓ 109641 ✗ 0
data_received..................: 3.2 GB 53 MB/s
data_sent......................: 43 MB 704 kB/s
http_req_blocked...............: avg=20.81µs min=1.45µs med=2.88µs max=23.04ms p(90)=4.42µs p(95)=5.52µs p(99.9)=7.65ms
http_req_connecting............: avg=16.38µs min=0s med=0s max=23.02ms p(90)=0s p(95)=0s p(99.9)=7.4ms
http_req_duration..............: avg=81.53ms min=3.04ms med=79.95ms max=605.83ms p(90)=110.99ms p(95)=121ms p(99.9)=361.55ms
{ expected_response:true }...: avg=81.53ms min=3.04ms med=79.95ms max=605.83ms p(90)=110.99ms p(95)=121ms p(99.9)=361.55ms
http_req_failed................: 0.00% ✓ 0 ✗ 36647
http_req_receiving.............: avg=185.28µs min=33.22µs med=78.28µs max=378.27ms p(90)=161.88µs p(95)=421.01µs p(99.9)=16.34ms
http_req_sending...............: avg=67.19µs min=6.73µs med=11.67µs max=369.89ms p(90)=32.14µs p(95)=135.62µs p(99.9)=4.07ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=81.28ms min=2.96ms med=79.68ms max=594.45ms p(90)=110.74ms p(95)=120.77ms p(99.9)=354.23ms
http_reqs......................: 36647 605.138558/s
iteration_duration.............: avg=82.08ms min=5.32ms med=80.31ms max=638.1ms p(90)=111.34ms p(95)=121.41ms p(99.9)=389.73ms
iterations.....................: 36547 603.487295/s
success_rate...................: 100.00% ✓ 36547 ✗ 0
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: hive-gateway-router-runtime
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 99% — ✓ 35185 / ✗ 1
✓ valid response structure
checks.........................: 99.99% ✓ 105557 ✗ 1
data_received..................: 3.1 GB 51 MB/s
data_sent......................: 41 MB 675 kB/s
http_req_blocked...............: avg=25.23µs min=1.24µs med=3.01µs max=21.62ms p(90)=4.64µs p(95)=5.91µs p(99.9)=12.97ms
http_req_connecting............: avg=20.56µs min=0s med=0s max=21.06ms p(90)=0s p(95)=0s p(99.9)=12.53ms
http_req_duration..............: avg=84.72ms min=5.21ms med=82.35ms max=600.11ms p(90)=104.79ms p(95)=113.51ms p(99.9)=385.54ms
{ expected_response:true }...: avg=84.72ms min=5.21ms med=82.35ms max=600.11ms p(90)=104.79ms p(95)=113.51ms p(99.9)=385.54ms
http_req_failed................: 0.00% ✓ 0 ✗ 35286
http_req_receiving.............: avg=114.54µs min=26.96µs med=55.85µs max=19.8ms p(90)=122.67µs p(95)=318.62µs p(99.9)=6.89ms
http_req_sending...............: avg=112.12µs min=5.7µs med=11.71µs max=462.63ms p(90)=32.91µs p(95)=135.22µs p(99.9)=7.29ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=84.49ms min=5.16ms med=82.2ms max=599.18ms p(90)=104.54ms p(95)=113.27ms p(99.9)=358.23ms
http_reqs......................: 35286 580.782168/s
iteration_duration.............: avg=85.32ms min=13.45ms med=82.68ms max=658.6ms p(90)=105.16ms p(95)=113.91ms p(99.9)=405.86ms
iterations.....................: 35186 579.13624/s
success_rate...................: 99.99% ✓ 35185 ✗ 1
vus............................: 50 min=50 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: apollo-router
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 0% — ✓ 0 / ✗ 16518
✗ valid response structure
↳ 99% — ✓ 16468 / ✗ 50
checks.........................: 66.56% ✓ 32986 ✗ 16568
data_received..................: 1.7 GB 28 MB/s
data_sent......................: 19 MB 317 kB/s
http_req_blocked...............: avg=20.2µs min=1.88µs med=3.79µs max=10.15ms p(90)=6.32µs p(95)=7.78µs p(99.9)=6.81ms
http_req_connecting............: avg=15.13µs min=0s med=0s max=10.11ms p(90)=0s p(95)=0s p(99.9)=6.76ms
http_req_duration..............: avg=177.17ms min=6.86ms med=168.7ms max=557.38ms p(90)=248.36ms p(95)=287.94ms p(99.9)=462.5ms
{ expected_response:true }...: avg=177.17ms min=6.86ms med=168.7ms max=557.38ms p(90)=248.36ms p(95)=287.94ms p(99.9)=462.5ms
http_req_failed................: 0.00% ✓ 0 ✗ 16618
http_req_receiving.............: avg=289.36µs min=29.53µs med=60.29µs max=99.96ms p(90)=118.08µs p(95)=332.28µs p(99.9)=37.57ms
http_req_sending...............: avg=1.41ms min=8.07µs med=15.1µs max=154.82ms p(90)=1.84ms p(95)=6.44ms p(99.9)=80.61ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=175.46ms min=6.81ms med=167.39ms max=556.98ms p(90)=245.62ms p(95)=285.62ms p(99.9)=461.84ms
http_reqs......................: 16618 272.229403/s
iteration_duration.............: avg=181.82ms min=64.31ms med=171.59ms max=864.13ms p(90)=252.54ms p(95)=292.68ms p(99.9)=738.13ms
iterations.....................: 16518 270.591243/s
success_rate...................: 0.00% ✓ 0 ✗ 16518
vus............................: 25 min=25 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: hive-gateway
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 88% — ✓ 11320 / ✗ 1422
✓ valid response structure
checks.........................: 96.28% ✓ 36804 ✗ 1422
data_received..................: 1.2 GB 19 MB/s
data_sent......................: 15 MB 244 kB/s
http_req_blocked...............: avg=66.23µs min=1.23µs med=3.03µs max=22.89ms p(90)=5.21µs p(95)=6.71µs p(99.9)=20.29ms
http_req_connecting............: avg=61.01µs min=0s med=0s max=22.83ms p(90)=0s p(95)=0s p(99.9)=20.21ms
http_req_duration..............: avg=232.95ms min=7.22ms med=170.22ms max=2.08s p(90)=408.04ms p(95)=525.92ms p(99.9)=2.05s
{ expected_response:true }...: avg=232.95ms min=7.22ms med=170.22ms max=2.08s p(90)=408.04ms p(95)=525.92ms p(99.9)=2.05s
http_req_failed................: 0.00% ✓ 0 ✗ 12842
http_req_receiving.............: avg=147.07µs min=29.23µs med=66.88µs max=51.48ms p(90)=149.75µs p(95)=364.13µs p(99.9)=8.51ms
http_req_sending...............: avg=306.31µs min=5.45µs med=12.18µs max=389.12ms p(90)=45.07µs p(95)=240.57µs p(99.9)=40.21ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=232.5ms min=7.1ms med=169.91ms max=2.08s p(90)=407.32ms p(95)=525.48ms p(99.9)=2.05s
http_reqs......................: 12842 209.651245/s
iteration_duration.............: avg=235.93ms min=35.72ms med=171.1ms max=2.08s p(90)=411.65ms p(95)=533.93ms p(99.9)=2.05s
iterations.....................: 12742 208.018701/s
success_rate...................: 88.84% ✓ 11320 ✗ 1422
vus............................: 50 min=0 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Summary for: apollo-gateway
K6 Output
✓ response code was 200
✗ no graphql errors
↳ 0% — ✓ 0 / ✗ 6914
✗ valid response structure
↳ 99% — ✓ 6864 / ✗ 50
checks.........................: 66.42% ✓ 13778 ✗ 6964
data_received..................: 617 MB 10 MB/s
data_sent......................: 8.2 MB 133 kB/s
http_req_blocked...............: avg=37.43µs min=1.34µs med=4.12µs max=9.23ms p(90)=6.23µs p(95)=7.07µs p(99.9)=7.72ms
http_req_connecting............: avg=32.65µs min=0s med=0s max=9.19ms p(90)=0s p(95)=0s p(99.9)=7.69ms
http_req_duration..............: avg=426.62ms min=7.44ms med=423.29ms max=915.77ms p(90)=499.31ms p(95)=525.59ms p(99.9)=815.85ms
{ expected_response:true }...: avg=426.62ms min=7.44ms med=423.29ms max=915.77ms p(90)=499.31ms p(95)=525.59ms p(99.9)=815.85ms
http_req_failed................: 0.00% ✓ 0 ✗ 7014
http_req_receiving.............: avg=75.61µs min=32.33µs med=64.35µs max=6.95ms p(90)=104.67µs p(95)=120.73µs p(99.9)=1.06ms
http_req_sending...............: avg=164.68µs min=6.39µs med=15.99µs max=209.01ms p(90)=37.24µs p(95)=694.26µs p(99.9)=5.14ms
http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s p(99.9)=0s
http_req_waiting...............: avg=426.38ms min=7.32ms med=422.99ms max=914.65ms p(90)=499.1ms p(95)=525.2ms p(99.9)=814.64ms
http_reqs......................: 7014 114.656608/s
iteration_duration.............: avg=435.07ms min=97.7ms med=425.74ms max=992.26ms p(90)=502.51ms p(95)=530.54ms p(99.9)=834.3ms
iterations.....................: 6914 113.021926/s
success_rate...................: 0.00% ✓ 0 ✗ 6914
vus............................: 38 min=38 max=50
vus_max........................: 50 min=50 max=50
Performance Overview
HTTP Overview
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The shippingEstimate was always returning null even though it should not. Could lead to false-negatives in tests.
https://async-graphql.github.io/async-graphql/en/apollo_federation.html#requires
Also
Changed the CI to leave comments on PRs also when running the benchmarks on the hosted runnerNot working ATM.