Skip to content

ci: add automated benchmark data push after merge#1683

Open
AKonnyaku wants to merge 2 commits intoapache:masterfrom
AKonnyaku:yml-pr
Open

ci: add automated benchmark data push after merge#1683
AKonnyaku wants to merge 2 commits intoapache:masterfrom
AKonnyaku:yml-pr

Conversation

@AKonnyaku
Copy link
Contributor

This PR implements a workflow to update performance data automatically.

  • Workflow trigger: the system triggers this workflow after code merges into the master branch.
  • Benchmark execution: it executes go test -bench to collect standard performance metrics.
  • Data formatting: a python script processes the benchmark output into a structured json file.
  • Data synchronization: The workflow pushes this j json data to the designated dashboard repository.

Closes #1682

@github-actions
Copy link

github-actions bot commented Jan 11, 2026

Benchmark Comparison

Comparing base branch (6cfc463)
vs PR branch (810ba42)

goos: linux
goarch: amd64
pkg: github.com/casbin/casbin/v3
cpu: AMD EPYC 7763 64-Core Processor                
                                                 │ base-bench.txt │             pr-bench.txt             │
                                                 │     sec/op     │    sec/op     vs base                      Diff          │
CachedRaw                                          15.42n ± ∞ ¹   15.41n ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.06% ➡️
CachedBasicModel                                   167.1n ± ∞ ¹   169.9n ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.68% ➡️
CachedRBACModel                                    169.1n ± ∞ ¹   171.5n ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.42% ➡️
CachedRBACModelSmall                               172.8n ± ∞ ¹   175.4n ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.50% ➡️
CachedRBACModelMedium                              178.1n ± ∞ ¹   184.2n ± ∞ ¹       ~ (p=1.000 n=1) ²         +3.43% ➡️
CachedRBACModelLarge                               155.2n ± ∞ ¹   154.2n ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.64% ➡️
CachedRBACModelWithResourceRoles                   171.7n ± ∞ ¹   169.2n ± ∞ ¹       ~ (p=1.000 n=1) ²         -1.46% ➡️
CachedRBACModelWithDomains                         176.5n ± ∞ ¹   178.8n ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.30% ➡️
CachedABACModel                                    2.736µ ± ∞ ¹   2.837µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +3.69% ➡️
CachedKeyMatchModel                                180.9n ± ∞ ¹   183.4n ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.38% ➡️
CachedRBACModelWithDeny                            167.0n ± ∞ ¹   168.3n ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.78% ➡️
CachedPriorityModel                                168.0n ± ∞ ¹   168.9n ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.54% ➡️
CachedWithEnforceContext                           229.7n ± ∞ ¹   231.8n ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.91% ➡️
CachedRBACModelMediumParallel                      166.3n ± ∞ ¹   163.1n ± ∞ ¹       ~ (p=1.000 n=1) ²         -1.92% ➡️
HasPolicySmall                                     409.2n ± ∞ ¹   422.1n ± ∞ ¹       ~ (p=1.000 n=1) ²         +3.15% ➡️
HasPolicyMedium                                    430.5n ± ∞ ¹   439.3n ± ∞ ¹       ~ (p=1.000 n=1) ²         +2.04% ➡️
HasPolicyLarge                                     449.2n ± ∞ ¹   464.5n ± ∞ ¹       ~ (p=1.000 n=1) ²         +3.41% ➡️
AddPolicySmall                                     512.1n ± ∞ ¹   517.3n ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.02% ➡️
AddPolicyMedium                                    640.3n ± ∞ ¹   644.1n ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.59% ➡️
AddPolicyLarge                                     1.150µ ± ∞ ¹   1.115µ ± ∞ ¹       ~ (p=1.000 n=1) ²         -3.04% ➡️
RemovePolicySmall                                  491.9n ± ∞ ¹   492.1n ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.04% ➡️
RemovePolicyMedium                                 522.0n ± ∞ ¹   529.3n ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.40% ➡️
RemovePolicyLarge                                  568.0n ± ∞ ¹   556.5n ± ∞ ¹       ~ (p=1.000 n=1) ²         -2.02% ➡️
Raw                                                15.59n ± ∞ ¹   15.57n ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.13% ➡️
BasicModel                                         3.574µ ± ∞ ¹   3.619µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.26% ➡️
RBACModel                                          5.277µ ± ∞ ¹   5.271µ ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.11% ➡️
RBACModelSizes/small                               48.86µ ± ∞ ¹   48.38µ ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.98% ➡️
RBACModelSizes/medium                              510.6µ ± ∞ ¹   495.0µ ± ∞ ¹       ~ (p=1.000 n=1) ²         -3.06% ➡️
RBACModelSizes/large                               5.770m ± ∞ ¹   5.520m ± ∞ ¹       ~ (p=1.000 n=1) ²         -4.33% ➡️
RBACModelSmall                                     57.48µ ± ∞ ¹   57.98µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.87% ➡️
RBACModelMedium                                    567.5µ ± ∞ ¹   564.9µ ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.46% ➡️
RBACModelLarge                                     5.976m ± ∞ ¹   5.918m ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.97% ➡️
RBACModelWithResourceRoles                         4.352µ ± ∞ ¹   4.430µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.79% ➡️
RBACModelWithDomains                               4.978µ ± ∞ ¹   4.996µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.36% ➡️
ABACModel                                          2.686µ ± ∞ ¹   2.751µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +2.42% ➡️
ABACRuleModel                                      3.975m ± ∞ ¹   4.071m ± ∞ ¹       ~ (p=1.000 n=1) ²         +2.42% ➡️
KeyMatchModel                                      5.853µ ± ∞ ¹   6.042µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +3.23% ➡️
RBACModelWithDeny                                  6.691µ ± ∞ ¹   6.769µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.17% ➡️
PriorityModel                                      4.001µ ± ∞ ¹   4.104µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +2.57% ➡️
RBACModelWithDomainPatternLarge                    13.10µ ± ∞ ¹   13.09µ ± ∞ ¹       ~ (p=1.000 n=1) ²         -0.08% ➡️
RoleManagerSmall                                   47.66µ ± ∞ ¹   48.33µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.41% ➡️
RoleManagerMedium                                  538.4µ ± ∞ ¹   541.7µ ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.61% ➡️
RoleManagerLarge                                   6.467m ± ∞ ¹   6.024m ± ∞ ¹       ~ (p=1.000 n=1) ²         -6.85% ➡️
BuildRoleLinksWithPatternLarge                     293.8m ± ∞ ¹   302.0m ± ∞ ¹       ~ (p=1.000 n=1) ²         +2.79% ➡️
BuildRoleLinksWithDomainPatternLarge               9.709m ± ∞ ¹   9.811m ± ∞ ¹       ~ (p=1.000 n=1) ²         +1.05% ➡️
BuildRoleLinksWithPatternAndDomainPatternLarge     298.9m ± ∞ ¹   308.3m ± ∞ ¹       ~ (p=1.000 n=1) ²         +3.14% ➡️
HasLinkWithPatternLarge                            971.4n ± ∞ ¹   991.5n ± ∞ ¹       ~ (p=1.000 n=1) ²         +2.07% ➡️
HasLinkWithDomainPatternLarge                      342.5n ± ∞ ¹   336.8n ± ∞ ¹       ~ (p=1.000 n=1) ²         -1.66% ➡️
HasLinkWithPatternAndDomainPatternLarge            967.9n ± ∞ ¹   994.4n ± ∞ ¹       ~ (p=1.000 n=1) ²         +2.74% ➡️
ConcurrentHasLinkWithMatching                      1.273µ ± ∞ ¹   1.180µ ± ∞ ¹       ~ (p=1.000 n=1) ²         -7.31% ➡️
geomean                                              4.902µ         4.923µ                                     +0.43% ➡️
¹ need >= 6 samples for confidence interval at level 0.95
² need >= 4 samples to detect a difference at alpha level 0.05

                                                 │ base-bench.txt │             pr-bench.txt              │
                                                 │      B/op      │     B/op       vs base                     Diff          │
CachedRaw                                           0.000 ± ∞ ¹     0.000 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedBasicModel                                    104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModel                                     104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModelSmall                                104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModelMedium                               104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModelLarge                                96.00 ± ∞ ¹     96.00 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModelWithResourceRoles                    104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModelWithDomains                          120.0 ± ∞ ¹     120.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedABACModel                                   1.508Ki ± ∞ ¹   1.513Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.33% ➡️
CachedKeyMatchModel                                 152.0 ± ∞ ¹     152.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModelWithDeny                             104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedPriorityModel                                 104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedWithEnforceContext                            176.0 ± ∞ ¹     176.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
CachedRBACModelMediumParallel                       104.0 ± ∞ ¹     104.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
HasPolicySmall                                      102.0 ± ∞ ¹     102.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
HasPolicyMedium                                     109.0 ± ∞ ¹     109.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
HasPolicyLarge                                      117.0 ± ∞ ¹     117.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
AddPolicySmall                                      152.0 ± ∞ ¹     152.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
AddPolicyMedium                                     166.0 ± ∞ ¹     166.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
AddPolicyLarge                                      417.0 ± ∞ ¹     410.0 ± ∞ ¹       ~ (p=1.000 n=1) ³        -1.68% ➡️
RemovePolicySmall                                   166.0 ± ∞ ¹     166.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
RemovePolicyMedium                                  174.0 ± ∞ ¹     174.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
RemovePolicyLarge                                   181.0 ± ∞ ¹     181.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
Raw                                                 0.000 ± ∞ ¹     0.000 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
BasicModel                                        1.487Ki ± ∞ ¹   1.488Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.07% ➡️
RBACModel                                         2.029Ki ± ∞ ¹   2.033Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.20% ➡️
RBACModelSizes/small                              19.82Ki ± ∞ ¹   19.80Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        -0.10% ➡️
RBACModelSizes/medium                             187.3Ki ± ∞ ¹   187.2Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        -0.05% ➡️
RBACModelSizes/large                              1.815Mi ± ∞ ¹   1.811Mi ± ∞ ¹       ~ (p=1.000 n=1) ³        -0.22% ➡️
RBACModelSmall                                    19.78Ki ± ∞ ¹   19.91Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.66% ➡️
RBACModelMedium                                   189.6Ki ± ∞ ¹   190.0Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.21% ➡️
RBACModelLarge                                    1.840Mi ± ∞ ¹   1.841Mi ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.05% ➡️
RBACModelWithResourceRoles                        1.805Ki ± ∞ ¹   1.810Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.28% ➡️
RBACModelWithDomains                              1.796Ki ± ∞ ¹   1.800Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.22% ➡️
ABACModel                                         1.503Ki ± ∞ ¹   1.507Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.27% ➡️
ABACRuleModel                                     1.245Mi ± ∞ ¹   1.250Mi ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.40% ➡️
KeyMatchModel                                     3.009Ki ± ∞ ¹   3.015Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.20% ➡️
RBACModelWithDeny                                 2.433Ki ± ∞ ¹   2.442Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.37% ➡️
PriorityModel                                     1.731Ki ± ∞ ¹   1.740Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.52% ➡️
RBACModelWithDomainPatternLarge                   8.680Ki ± ∞ ¹   8.688Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.09% ➡️
RoleManagerSmall                                    800.0 ± ∞ ¹     800.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
RoleManagerMedium                                 13.63Ki ± ∞ ¹   13.63Ki ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
RoleManagerLarge                                  224.6Ki ± ∞ ¹   224.6Ki ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.00% ➡️
BuildRoleLinksWithPatternLarge                    60.81Mi ± ∞ ¹   60.84Mi ± ∞ ¹       ~ (p=1.000 n=1) ³        +0.05% ➡️
BuildRoleLinksWithDomainPatternLarge              3.950Mi ± ∞ ¹   3.946Mi ± ∞ ¹       ~ (p=1.000 n=1) ³        -0.10% ➡️
BuildRoleLinksWithPatternAndDomainPatternLarge    62.46Mi ± ∞ ¹   62.43Mi ± ∞ ¹       ~ (p=1.000 n=1) ³        -0.05% ➡️
HasLinkWithPatternLarge                             112.0 ± ∞ ¹     112.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
HasLinkWithDomainPatternLarge                       16.00 ± ∞ ¹     16.00 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
HasLinkWithPatternAndDomainPatternLarge             112.0 ± ∞ ¹     112.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
ConcurrentHasLinkWithMatching                       736.0 ± ∞ ¹     736.0 ± ∞ ¹       ~ (p=1.000 n=1) ²        +0.00% ➡️
geomean                                                         ⁴                                              +0.03% ➡️               ⁴
¹ need >= 6 samples for confidence interval at level 0.95
² all samples are equal
³ need >= 4 samples to detect a difference at alpha level 0.05
⁴ summaries must be >0 to compute geomean

                                                 │ base-bench.txt │             pr-bench.txt             │
                                                 │   allocs/op    │  allocs/op    vs base                      Diff          │
CachedRaw                                           0.000 ± ∞ ¹    0.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedBasicModel                                    4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModel                                     4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModelSmall                                4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModelMedium                               4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModelLarge                                3.000 ± ∞ ¹    3.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModelWithResourceRoles                    4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModelWithDomains                          4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedABACModel                                     18.00 ± ∞ ¹    18.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedKeyMatchModel                                 4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModelWithDeny                             4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedPriorityModel                                 4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedWithEnforceContext                            4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
CachedRBACModelMediumParallel                       4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
HasPolicySmall                                      4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
HasPolicyMedium                                     4.000 ± ∞ ¹    4.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
HasPolicyLarge                                      5.000 ± ∞ ¹    5.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
AddPolicySmall                                      6.000 ± ∞ ¹    6.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
AddPolicyMedium                                     7.000 ± ∞ ¹    7.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
AddPolicyLarge                                      9.000 ± ∞ ¹    9.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RemovePolicySmall                                   7.000 ± ∞ ¹    7.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RemovePolicyMedium                                  7.000 ± ∞ ¹    7.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RemovePolicyLarge                                   8.000 ± ∞ ¹    8.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
Raw                                                 0.000 ± ∞ ¹    0.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
BasicModel                                          18.00 ± ∞ ¹    18.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModel                                           36.00 ± ∞ ¹    36.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelSizes/small                                481.0 ± ∞ ¹    481.0 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelSizes/medium                              4.829k ± ∞ ¹   4.829k ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelSizes/large                               48.27k ± ∞ ¹   48.14k ± ∞ ¹       ~ (p=1.000 n=1) ³         -0.27% ➡️
RBACModelSmall                                      616.0 ± ∞ ¹    616.0 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelMedium                                    6.016k ± ∞ ¹   6.016k ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelLarge                                     60.08k ± ∞ ¹   60.08k ± ∞ ¹       ~ (p=1.000 n=1) ³         +0.00% ➡️
RBACModelWithResourceRoles                          28.00 ± ∞ ¹    28.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelWithDomains                                26.00 ± ∞ ¹    26.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
ABACModel                                           17.00 ± ∞ ¹    17.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
ABACRuleModel                                      37.09k ± ∞ ¹   37.09k ± ∞ ¹       ~ (p=1.000 n=1) ³         +0.00% ➡️
KeyMatchModel                                       38.00 ± ∞ ¹    38.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelWithDeny                                   50.00 ± ∞ ¹    50.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
PriorityModel                                       23.00 ± ∞ ¹    23.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RBACModelWithDomainPatternLarge                     73.00 ± ∞ ¹    73.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RoleManagerSmall                                    100.0 ± ∞ ¹    100.0 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RoleManagerMedium                                  1.744k ± ∞ ¹   1.744k ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
RoleManagerLarge                                   19.74k ± ∞ ¹   19.74k ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
BuildRoleLinksWithPatternLarge                     3.560M ± ∞ ¹   3.560M ± ∞ ¹       ~ (p=1.000 n=1) ³         +0.00% ➡️
BuildRoleLinksWithDomainPatternLarge               120.2k ± ∞ ¹   120.2k ± ∞ ¹       ~ (p=1.000 n=1) ³         +0.00% ➡️
BuildRoleLinksWithPatternAndDomainPatternLarge     3.637M ± ∞ ¹   3.637M ± ∞ ¹       ~ (p=1.000 n=1) ³         +0.00% ➡️
HasLinkWithPatternLarge                             9.000 ± ∞ ¹    9.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
HasLinkWithDomainPatternLarge                       1.000 ± ∞ ¹    1.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
HasLinkWithPatternAndDomainPatternLarge             9.000 ± ∞ ¹    9.000 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
ConcurrentHasLinkWithMatching                       11.00 ± ∞ ¹    11.00 ± ∞ ¹       ~ (p=1.000 n=1) ²         +0.00% ➡️
geomean                                                         ⁴                                              -0.01% ➡️               ⁴
¹ need >= 6 samples for confidence interval at level 0.95
² all samples are equal
³ need >= 4 samples to detect a difference at alpha level 0.05
⁴ summaries must be >0 to compute geomean

🤖 This comment will be automatically updated with the latest benchmark results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ci: add automated performance benchmark workflow and data sync

1 participant