Skip to content

Lint example in OpenAPI schema objects - #1163

Merged
jviotti merged 5 commits into
mainfrom
example-validate
Oct 29, 2026
Merged

jviotti merged 5 commits into
mainfrom
example-validate

Conversation

@jviotti

@jviotti jviotti commented Oct 29, 2026 •

Copy link
Copy Markdown
Member

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

View guided diff

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@augmentcode

augmentcode Bot commented Oct 29, 2026

Copy link
Copy Markdown
🤖 Augment PR Summary

Summary: Adds schema-level example linting for OpenAPI 3.0, 3.1, and 3.2.
Changes:

  • Registers the new `ValidExample` rule in linter mode.
  • Checks each `example` against its containing schema.
  • Removes invalid examples when applying fixes.
  • Reports validation messages and instance/evaluation locations.
  • Skips ignored `$ref` siblings in OpenAPI 3.0.
  • Reuses standalone and non-standalone schema compilation paths.
  • Tests invalid, valid, and reference-sibling examples.
  • Expands OpenAPI 3.1/3.2 coverage for `examples` validation, duplicates, and top-level requirements.

🤖 Was this summary useful? React with 👍 or 👎

@augmentcode augmentcode Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 2 suggestions posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

ONLY_CONTINUE_IF(!schema.defines("$ref"));
}

const auto &instance{schema.at("example")};

@augmentcode augmentcode Bot Oct 29, 2026 •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you check serialized non-JSON examples at src/alterschema/linter/valid_example.h:30? The OpenAPI Schema Object specification explicitly permits strings containing examples not naturally representable in JSON/YAML, so an object schema with an XML-string example is now rejected for being a string and deleted by lint/fix despite being permitted.

Severity: medium

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

Comment on lines +74 to +75
const auto result{evaluator.validate(schema_template.value(), instance,
std::ref(output))};

@augmentcode augmentcode Bot Oct 29, 2026 •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you check an OpenAPI 3.0 request-body schema with required: [id], a readOnly: true id property, and example: {} at src/alterschema/linter/valid_example.h:74–75? OpenAPI makes id required only in responses, but the default compiler ignores readOnly/writeOnly while enforcing required, so lint/fix deletes this valid request example (likewise for response examples omitting required writeOnly properties).

Other locations where this applies: src/alterschema/linter/valid_example.h:48–49

Severity: medium

Other Locations
  • src/alterschema/linter/valid_example.h:48

Fix This in Augment

🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
@jviotti
jviotti merged commit 607d122 into main Oct 29, 2026
14 checks passed
@jviotti
jviotti deleted the example-validate branch October 29, 2026 14:13

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: e3fafdc Previous: ad08d10 Ratio
E2E_Compiler_adaptivecard 24745537.625 ns 31949435 ns 0.77
E2E_Compiler_ansible_meta 7449328.333333333 ns 10070153.375 ns 0.74
E2E_Compiler_aws_cdk 118009.07741935484 ns 181308.60816012317 ns 0.65
E2E_Compiler_babelrc 718535.7371601209 ns 1048631.298245614 ns 0.69
E2E_Compiler_clang_format 5050944.608695652 ns 6692361.694444444 ns 0.75
E2E_Compiler_cmake_presets 11785572.85 ns 15187435 ns 0.78
E2E_Compiler_code_climate 532560.8859060403 ns 786490.5033333333 ns 0.68
E2E_Compiler_cql2 5705192.928571428 ns 7315397.7272727275 ns 0.78
E2E_Compiler_cspell 8896417.25925926 ns 11532628.523809524 ns 0.77
E2E_Compiler_cypress 1355381.7657142857 ns 1843556.1085271318 ns 0.74
E2E_Compiler_deno 2543046.4565217393 ns 3368633.714285714 ns 0.75
E2E_Compiler_dependabot 1040753.2763157894 ns 1427311.9457831325 ns 0.73
E2E_Compiler_draft_04 924168.1411764706 ns 1246748.253968254 ns 0.74
E2E_Compiler_fabric_mod 1610536.3401360544 ns 2117540.8125 ns 0.76
E2E_Compiler_geojson 8152044.655172414 ns 10317332.695652174 ns 0.79
E2E_Compiler_gitpod_configuration 1588952.16 ns 2120363.1981981983 ns 0.75
E2E_Compiler_helm_chart_lock 218045.76774193547 ns 334765.8991477273 ns 0.65
E2E_Compiler_importmap 93981.20371835443 ns 144716.6043956044 ns 0.65
E2E_Compiler_jasmine 368224.61145510833 ns 552746.103286385 ns 0.67
E2E_Compiler_jshintrc 1236963.4814814816 ns 1734543.6204379562 ns 0.71
E2E_Compiler_jsconfig 6883829.742857143 ns 9254262.615384616 ns 0.74
E2E_Compiler_krakend 47840595.6 ns 64158631 ns 0.75
E2E_Compiler_lazygit 10811192.090909092 ns 14194203.647058824 ns 0.76
E2E_Compiler_lerna 461423.21470019344 ns 685062.6994219653 ns 0.67
E2E_Compiler_nest_cli 2446536.855670103 ns 3252607.9315068494 ns 0.75
E2E_Compiler_omc 58819339.75 ns 80000583.66666667 ns 0.74
E2E_Compiler_omnisharp 2139055.009009009 ns 2894911.487804878 ns 0.74
E2E_Compiler_openapi 9901834.416666666 ns 12759255.05263158 ns 0.78
E2E_Compiler_pre_commit_hooks 1066337.5112107624 ns 1445050.9515151514 ns 0.74
E2E_Compiler_pulumi 1317333.2833333334 ns 1751313.5111111111 ns 0.75
E2E_Compiler_semantic_release 427887.7684021544 ns 632759.1413333333 ns 0.68
E2E_Compiler_stale 384207.1260096931 ns 565753.9976076555 ns 0.68
E2E_Compiler_stylecop 1642326.2551724138 ns 2357113.1717171716 ns 0.70
E2E_Compiler_tmuxinator 576900.2711864407 ns 852390.5519713261 ns 0.68
E2E_Compiler_ui5 22168354.222222224 ns 28524858.85714286 ns 0.78
E2E_Compiler_ui5_manifest 114150077.5 ns 169261762.5 ns 0.67
E2E_Compiler_unreal_engine_uproject 1365886.485549133 ns 1816098.2923076923 ns 0.75
E2E_Compiler_users_array 250834.62276080085 ns 377738.04769475356 ns 0.66
E2E_Compiler_vercel 4884777.142857143 ns 6315084.189189189 ns 0.77
E2E_Compiler_yamllint 77352.16276041667 ns 121985.31030927836 ns 0.63
E2E_Evaluator_adaptivecard 17709.600999179776 ns 26958.007159904533 ns 0.66
E2E_Evaluator_ansible_meta 157026.30561056104 ns 260760.61956521738 ns 0.60
E2E_Evaluator_aws_cdk 35243.53432527991 ns 49684.23939458538 ns 0.71
E2E_Evaluator_babelrc 83917.53591749644 ns 125565.32886984467 ns 0.67
E2E_Evaluator_cerebrum_criminal_case 915066.019379845 ns 1151352.4449760765 ns 0.79
E2E_Evaluator_clang_format 87237.77471517824 ns 113244.74689589303 ns 0.77
E2E_Evaluator_cmake_presets 3787630.709677419 ns 4768189.405405405 ns 0.79
E2E_Evaluator_code_climate 144560.24403669726 ns 186821.35275339187 ns 0.77
E2E_Evaluator_cql2 141353.88644470868 ns 242611.75228426396 ns 0.58
E2E_Evaluator_cspell 520649.5109649123 ns 669357.7408450705 ns 0.78
E2E_Evaluator_cypress 145630.14452644528 ns 207513.60558464224 ns 0.70
E2E_Evaluator_deno 271684.85419058555 ns 340749.85942028987 ns 0.80
E2E_Evaluator_dependabot 260771.57888888888 ns 360489.15045592707 ns 0.72
E2E_Evaluator_draft_04 5644849.414634147 ns 10997634.782608695 ns 0.51
E2E_Evaluator_fabric_mod 550093.0558139535 ns 758333.9158576052 ns 0.73
E2E_Evaluator_geojson 7798238 ns 11824581.6 ns 0.66
E2E_Evaluator_gitpod_configuration 174034.8996309963 ns 251115.27582534612 ns 0.69
E2E_Evaluator_helm_chart_lock 409803.5094991364 ns 370482.93270735524 ns 1.11
E2E_Evaluator_importmap 29715.07111556279 ns 51171.4949339207 ns 0.58
E2E_Evaluator_jasmine 89812.58987915408 ns 114131.57012487992 ns 0.79
E2E_Evaluator_jshintrc 1030178.6506550219 ns 1230958.243523316 ns 0.84
E2E_Evaluator_jsconfig 312017.20502645505 ns 450892.7423664122 ns 0.69
E2E_Evaluator_krakend 144074.31829268293 ns 226258.81339712918 ns 0.64
E2E_Evaluator_lazygit 99464.27817644576 ns 164002.1176046176 ns 0.61
E2E_Evaluator_lerna 134392.17954545454 ns 152921.261208577 ns 0.88
E2E_Evaluator_nest_cli 138978.26448215332 ns 201679.96995708154 ns 0.69
E2E_Evaluator_omc 13973.32702338393 ns 25132.882669537135 ns 0.56
E2E_Evaluator_omnisharp 481121.4928425358 ns 645734.8174386921 ns 0.75
E2E_Evaluator_openapi 7570448.677419355 ns 11556124.25 ns 0.66
E2E_Evaluator_pre_commit_hooks 411538.8359511344 ns 504771.13291139243 ns 0.82
E2E_Evaluator_pulumi 625103.1349206349 ns 718948.7835365854 ns 0.87
E2E_Evaluator_semantic_release 69043.15532286213 ns 107191.2641509434 ns 0.64
E2E_Evaluator_stale 117367.33663366336 ns 160964.81966101695 ns 0.73
E2E_Evaluator_stylecop 201072.90956072352 ns 310706.9225721785 ns 0.65
E2E_Evaluator_tmuxinator 69953.27283476204 ns 98781.03644742354 ns 0.71
E2E_Evaluator_ui5 357457.1161387632 ns 578596.1014492754 ns 0.62
E2E_Evaluator_ui5_manifest 2057698.0267857143 ns 2799781.2592592593 ns 0.73
E2E_Evaluator_unreal_engine_uproject 364660.54224270355 ns 492226.79625779623 ns 0.74
E2E_Evaluator_users_array 494976.2916666667 ns 620440.3691099477 ns 0.80
E2E_Evaluator_vercel 254949.94143167028 ns 336014.51904090267 ns 0.76
E2E_Evaluator_yamllint 5664.537313432836 ns 8585.413574361983 ns 0.66
JSONLD_Catalog_Simple 14028243.357142856 ns 21210613 ns 0.66
JSONLD_Catalog_Override_Agreeing 14435534.125 ns 22371373.545454547 ns 0.65
JSONLD_Catalog_Override_Shadowing 22648134.4 ns 33998351 ns 0.67
Micro_Draft4_Meta_1_No_Callback 140.2482529430407 ns 215.42932932169086 ns 0.65
Micro_Draft4_Required_Properties 668.4865978221109 ns 880.6139393984338 ns 0.76
Micro_Draft4_Many_Optional_Properties_Minimal_Match 17.893871624484486 ns 23.705274870849095 ns 0.75
Micro_Draft4_Few_Optional_Properties_Minimal_Match 8.724477569984902 ns 13.386666269278816 ns 0.65
Micro_Draft4_Items_Schema 270.10230137199375 ns 324.45421810496634 ns 0.83
Micro_Draft4_Nested_Object 1.7737648089951195 ns 2.8041152943367393 ns 0.63
Micro_Draft4_Properties_Triad_Optional 237.9679044773725 ns 331.0131489486542 ns 0.72
Micro_Draft4_Properties_Triad_Required 258.0672660087226 ns 343.18504800681916 ns 0.75
Micro_Draft4_Properties_Triad_Closed 196.18683933822925 ns 273.82310177239185 ns 0.72
Micro_Draft4_Properties_Closed 42.84632866680901 ns 57.659020999550705 ns 0.74
Micro_Draft4_Non_Recursive_Ref 11.973761636276826 ns 16.531405560847922 ns 0.72
Micro_Draft4_Pattern_Properties_Empty 117.61119898641154 ns 153.37560234943683 ns 0.77
Micro_Draft4_Ref_To_Single_Property 8.764181346765527 ns 13.081604057495722 ns 0.67
Micro_Draft4_Additional_Properties_Type 31.910612089885444 ns 37.64025119233509 ns 0.85
Micro_Draft4_Nested_Oneof 46.72226965720499 ns 61.971950579083895 ns 0.75
Micro_Draft4_Short_Enum 9.054588792367309 ns 10.628298779246245 ns 0.85
Micro_Draft4_Long_Enum 11.763765882140634 ns 16.515408764004235 ns 0.71
Micro_Draft4_Long_Enum_Short_Strings 9.0368709261365 ns 10.61565770353729 ns 0.85
Micro_Draft4_Type_Object 3.3225260957916363 ns 4.982438792630435 ns 0.67
Micro_Draft4_Ref_Single_100 1002286.2542372881 ns 1388233.9825581396 ns 0.72
Micro_Draft4_Compile_Ref_Many_Nested 627295.3052631579 ns 902109.6147859922 ns 0.70
Micro_Draft4_Compile_Wrap 777272.5163398692 ns 1115422.7710280374 ns 0.70
Micro_Draft6_Property_Names 112.69152180186082 ns 127.64577792472762 ns 0.88
Micro_Draft6_Compile_FHIR 2928958065 ns 3867995016 ns 0.76
Micro_Draft7_If_Then_Else 20.010219071729956 ns 22.10718136082448 ns 0.91
Micro_2019_09_Unevaluated_Properties 27.134603921092445 ns 28.735501817994198 ns 0.94
Micro_2019_09_Compile_Wrap 62876343.666666664 ns 93114549.5 ns 0.68
Micro_2020_12_Dynamic_Ref 498.5765520937799 ns 705.6470429060373 ns 0.71
Micro_2020_12_Dynamic_Ref_Single 3.4085682044426897 ns 4.985420470131362 ns 0.68
Micro_2020_12_Simple_Output_Mask 736.5284338344161 ns 1069.4024266708686 ns 0.69
Micro_2020_12_Simple_Output_Annotations 34129.774309551205 ns 44781.27052414052 ns 0.76
Micro_2020_12_Simple_Output_Annotation_Dropping 987939.325 ns 1354586.8806818181 ns 0.73
Micro_2020_12_Compile_NonCircular_Shared_Refs 341734.6311953353 ns 510213.7916666667 ns 0.67
Micro_2020_12_Exhaustive_Deep_Numeric 4688.594281985883 ns 6884.8618563236605 ns 0.68
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 26610.279753224902 ns 36592.68454113682 ns 0.73
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 12322.005594115819 ns 18340.81744500193 ns 0.67
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 81.72624761031658 ns 123.9468450475896 ns 0.66
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 1764.423478980221 ns 2436.9667838538876 ns 0.72
TestSuite_Parse_WoT 3933827.25 ns 5282727.333333333 ns 0.74
Alterschema_Check_Readibility_ISO_Language_Set_3 191367805 ns 272484550 ns 0.70
Alterschema_Check_Readibility_OMC 38193784.333333336 ns 48754169.6 ns 0.78
Alterschema_Check_Readibility_KrakenD 467057518 ns 566879282 ns 0.82
Alterschema_Apply_Readibility_KrakenD 47745515131 ns 58378399737 ns 0.82
Alterschema_Check_Invalid_External_Refs 158558722 ns 273027273 ns 0.58
Alterschema_Check_Resolvable_External_Refs 148586.93530150753 ns 233440.61721068248 ns 0.64
Convert_Draft3_To_2020_12 2338097.1515151514 ns 3140664.5285714287 ns 0.74
Convert_201909_To_2020_12_Unevaluated 282480.1985731272 ns 436701.6896551724 ns 0.65

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: e3fafdc Previous: ad08d10 Ratio
E2E_Evaluator_adaptivecard 89209 ns 121338 ns 0.74
E2E_Evaluator_ansible-meta 365352 ns 543720 ns 0.67
E2E_Evaluator_aws-cdk 108654 ns 151335 ns 0.72
E2E_Evaluator_babelrc 291066 ns 364058 ns 0.80
E2E_Evaluator_cerebrum-criminal-case 1761910 ns 2555778 ns 0.69
E2E_Evaluator_clang-format 197455 ns 281639 ns 0.70
E2E_Evaluator_cmake-presets 12963600 ns 18531687 ns 0.70
E2E_Evaluator_code-climate 393828 ns 533525 ns 0.74
E2E_Evaluator_cql2 841853 ns 1219119 ns 0.69
E2E_Evaluator_cspell 1198623 ns 1598616 ns 0.75
E2E_Evaluator_cypress 696419 ns 790884 ns 0.88
E2E_Evaluator_deno 844869 ns 1070951 ns 0.79
E2E_Evaluator_dependabot 818134 ns 1141234 ns 0.72
E2E_Evaluator_draft-04 15232684 ns 21205461 ns 0.72
E2E_Evaluator_fabric-mod 1770856 ns 2505163 ns 0.71
E2E_Evaluator_geojson 14353282 ns 26950285 ns 0.53
E2E_Evaluator_gitpod-configuration 529971 ns 746141 ns 0.71
E2E_Evaluator_helm-chart-lock 895841 ns 1097189 ns 0.82
E2E_Evaluator_importmap 255617 ns 270300 ns 0.95
E2E_Evaluator_jasmine 211391 ns 302433 ns 0.70
E2E_Evaluator_jsconfig 1070559 ns 1317557 ns 0.81
E2E_Evaluator_jshintrc 2312428 ns 2847737 ns 0.81
E2E_Evaluator_krakend 465691 ns 683197 ns 0.68
E2E_Evaluator_lazygit 328347 ns 536284 ns 0.61
E2E_Evaluator_lerna 370878 ns 475809 ns 0.78
E2E_Evaluator_nest-cli 444771 ns 609942 ns 0.73
E2E_Evaluator_omc 89715 ns 120204 ns 0.75
E2E_Evaluator_omnisharp 1127546 ns 1457092 ns 0.77
E2E_Evaluator_openapi 30148913 ns 47811867 ns 0.63
E2E_Evaluator_pre-commit-hooks 1517377 ns 2079031 ns 0.73
E2E_Evaluator_pulumi 1533280 ns 1968182 ns 0.78
E2E_Evaluator_semantic-release 194799 ns 266739 ns 0.73
E2E_Evaluator_stale 295481 ns 417166 ns 0.71
E2E_Evaluator_stylecop 960278 ns 1212797 ns 0.79
E2E_Evaluator_tmuxinator 197935 ns 242731 ns 0.82
E2E_Evaluator_ui5 1576510 ns 2264152 ns 0.70
E2E_Evaluator_ui5-manifest 7897948 ns 12171891 ns 0.65
E2E_Evaluator_unreal-engine-uproject 1200972 ns 1533791 ns 0.78
E2E_Evaluator_users-array 2397202 ns 2942820 ns 0.81
E2E_Evaluator_vercel 774233 ns 1035044 ns 0.75
E2E_Evaluator_yamllint 18542 ns 26355 ns 0.70

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: e3fafdc Previous: ad08d10 Ratio
E2E_Compiler_adaptivecard 32865890.625 ns 36412273.85714286 ns 0.90
E2E_Compiler_ansible_meta 9707421.64 ns 10392741.210526315 ns 0.93
E2E_Compiler_aws_cdk 198213.86946386946 ns 188303.62454873646 ns 1.05
E2E_Compiler_babelrc 1138779.3824701195 ns 1216370.9329268292 ns 0.94
E2E_Compiler_clang_format 6009876.976190476 ns 6801233.108108108 ns 0.88
E2E_Compiler_cmake_presets 16063000 ns 18833465.90909091 ns 0.85
E2E_Compiler_code_climate 717375.8222222222 ns 625822.5083798883 ns 1.15
E2E_Compiler_cql2 6338212.121212121 ns 6561392.441860465 ns 0.97
E2E_Compiler_cspell 10876850.409090908 ns 11052479.166666666 ns 0.98
E2E_Compiler_cypress 1655519.16 ns 1644475.83 ns 1.01
E2E_Compiler_deno 2945242.1875 ns 3085766.2337662335 ns 0.95
E2E_Compiler_dependabot 1144040.0717703348 ns 1287023.2639593908 ns 0.89
E2E_Compiler_draft_04 950456.1491935484 ns 1029154.4401544401 ns 0.92
E2E_Compiler_fabric_mod 1614427 ns 1984525.42 ns 0.81
E2E_Compiler_geojson 9826428.32 ns 11317876.909090908 ns 0.87
E2E_Compiler_gitpod_configuration 1672333.9416058394 ns 1816298.3008849558 ns 0.92
E2E_Compiler_helm_chart_lock 223088.3620689655 ns 289429.23728813557 ns 0.77
E2E_Compiler_importmap 97580.65476190476 ns 157617.458 ns 0.62
E2E_Compiler_jasmine 397630.80431177444 ns 701197.2891566266 ns 0.57
E2E_Compiler_jshintrc 1233518.5647668394 ns 1801351.1359223302 ns 0.68
E2E_Compiler_jsconfig 7902478.571428572 ns 10169967.818181818 ns 0.78
E2E_Compiler_krakend 59902916.666666664 ns 86654958.33333333 ns 0.69
E2E_Compiler_lazygit 13865879.368421054 ns 17312220.8 ns 0.80
E2E_Compiler_lerna 568802.4042553192 ns 617673.8981132075 ns 0.92
E2E_Compiler_nest_cli 2662702.902173913 ns 3516816.4556962023 ns 0.76
E2E_Compiler_omc 90168097 ns 109076187.5 ns 0.83
E2E_Compiler_omnisharp 2756247.1264367816 ns 3838019.397260274 ns 0.72
E2E_Compiler_openapi 12060349.652173912 ns 14101048.076923076 ns 0.86
E2E_Compiler_pre_commit_hooks 1071548.2183406113 ns 1367422.8275862068 ns 0.78
E2E_Compiler_pulumi 1371303.2051282052 ns 1641563.6283783785 ns 0.84
E2E_Compiler_semantic_release 483862.60780669143 ns 523164.11479591834 ns 0.92
E2E_Compiler_stale 414831.6115702479 ns 519245.4680851064 ns 0.80
E2E_Compiler_stylecop 1966197.1544715448 ns 3095221.0823529414 ns 0.64
E2E_Compiler_tmuxinator 623503.3828306264 ns 709485.5324074074 ns 0.88
E2E_Compiler_ui5 28284684.42857143 ns 33581166.571428575 ns 0.84
E2E_Compiler_ui5_manifest 170110708 ns 244180542 ns 0.70
E2E_Compiler_unreal_engine_uproject 1518124.5146198831 ns 1497494.6691729324 ns 1.01
E2E_Compiler_users_array 327520.65095986036 ns 361871.9225181598 ns 0.91
E2E_Compiler_vercel 5547428.571428572 ns 6278445.184210527 ns 0.88
E2E_Compiler_yamllint 80834.9666061706 ns 86690.61656551232 ns 0.93
E2E_Evaluator_adaptivecard 22952.844572225127 ns 23285.649229332088 ns 0.99
E2E_Evaluator_ansible_meta 207318.24181626187 ns 220679.18441558443 ns 0.94
E2E_Evaluator_aws_cdk 44602.81146637266 ns 51198.42131324004 ns 0.87
E2E_Evaluator_babelrc 94639.75038520801 ns 102670.11511789182 ns 0.92
E2E_Evaluator_cerebrum_criminal_case 921071.8915254237 ns 1046463.663507109 ns 0.88
E2E_Evaluator_clang_format 95067.15982972136 ns 132782.27092974336 ns 0.72
E2E_Evaluator_cmake_presets 3800682.296875 ns 4887071.625 ns 0.78
E2E_Evaluator_code_climate 157000.1600512164 ns 179927.833 ns 0.87
E2E_Evaluator_cql2 169330.92837273993 ns 179490.459 ns 0.94
E2E_Evaluator_cspell 727594.0909090909 ns 605614.5411522634 ns 1.20
E2E_Evaluator_cypress 193102 ns 159731.76143560873 ns 1.21
E2E_Evaluator_deno 297503.95467422093 ns 292554.98594847776 ns 1.02
E2E_Evaluator_dependabot 315374.048 ns 345748.38262476894 ns 0.91
E2E_Evaluator_draft_04 5936242.857142857 ns 6483416.685714286 ns 0.92
E2E_Evaluator_fabric_mod 572022.0588235294 ns 610560.2467532468 ns 0.94
E2E_Evaluator_geojson 10695027.80952381 ns 10250768.75 ns 1.04
E2E_Evaluator_gitpod_configuration 195498.08016032065 ns 264197.9969183359 ns 0.74
E2E_Evaluator_helm_chart_lock 271306.4032258064 ns 377719.1176470588 ns 0.72
E2E_Evaluator_importmap 44426.847793845016 ns 52144.9110259685 ns 0.85
E2E_Evaluator_jasmine 100951.38568129331 ns 116225.12701100761 ns 0.87
E2E_Evaluator_jshintrc 1028178.5475113122 ns 1094892.454954955 ns 0.94
E2E_Evaluator_jsconfig 334399.12053571426 ns 383023.1794158554 ns 0.87
E2E_Evaluator_krakend 148774.5068314899 ns 193443.0728667306 ns 0.77
E2E_Evaluator_lazygit 108551.31887401939 ns 132933.43964562568 ns 0.82
E2E_Evaluator_lerna 150544.67960023516 ns 161659.16197623513 ns 0.93
E2E_Evaluator_nest_cli 154202.33854166666 ns 178725.9882108183 ns 0.86
E2E_Evaluator_omc 17507.21163460082 ns 18638.44757989161 ns 0.94
E2E_Evaluator_omnisharp 521789.0625 ns 579449.5656370657 ns 0.90
E2E_Evaluator_openapi 10011246.541666666 ns 10141866.64 ns 0.99
E2E_Evaluator_pre_commit_hooks 541981.5011441647 ns 478896.7470119522 ns 1.13
E2E_Evaluator_pulumi 641530.7788944724 ns 591475.3223140496 ns 1.08
E2E_Evaluator_semantic_release 85709.46574818216 ns 81978.72369819341 ns 1.05
E2E_Evaluator_stale 138957.01204819276 ns 137136.57793345008 ns 1.01
E2E_Evaluator_stylecop 226866.026289181 ns 238843.09021113242 ns 0.95
E2E_Evaluator_tmuxinator 78157.61408730158 ns 83119.09670164918 ns 0.94
E2E_Evaluator_ui5 442408.8407871199 ns 445149.0354609929 ns 0.99
E2E_Evaluator_ui5_manifest 1796410.2142857143 ns 2411081.848214286 ns 0.75
E2E_Evaluator_unreal_engine_uproject 379988.92674616695 ns 434357.18823529413 ns 0.87
E2E_Evaluator_users_array 491946.489626556 ns 568630.41 ns 0.87
E2E_Evaluator_vercel 269321.1206896552 ns 295041.57502738223 ns 0.91
E2E_Evaluator_yamllint 9314.47963800905 ns 11024.685860123578 ns 0.84
JSONLD_Catalog_Simple 19760274.333333332 ns 20868148.85714286 ns 0.95
JSONLD_Catalog_Override_Agreeing 20621541.666666668 ns 23552391.7 ns 0.88
JSONLD_Catalog_Override_Shadowing 24944369.875 ns 33292315.42857143 ns 0.75
Micro_Draft4_Meta_1_No_Callback 162.9746364518414 ns 187.8297908678214 ns 0.87
Micro_Draft4_Required_Properties 762.9705720985219 ns 1016.6915063999897 ns 0.75
Micro_Draft4_Many_Optional_Properties_Minimal_Match 18.49684972794407 ns 22.549126884510134 ns 0.82
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.852903440156743 ns 13.498875258613666 ns 0.80
Micro_Draft4_Items_Schema 268.075272225941 ns 300.77374219631076 ns 0.89
Micro_Draft4_Nested_Object 1.700905840006768 ns 2.114853366396933 ns 0.80
Micro_Draft4_Properties_Triad_Optional 247.17298599026174 ns 300.6581552686278 ns 0.82
Micro_Draft4_Properties_Triad_Required 278.7752734488888 ns 412.5827916496111 ns 0.68
Micro_Draft4_Properties_Triad_Closed 216.22118919959257 ns 281.52519228625573 ns 0.77
Micro_Draft4_Properties_Closed 53.69882583060418 ns 68.65450755574342 ns 0.78
Micro_Draft4_Non_Recursive_Ref 13.2721 ns 15.255140738466654 ns 0.87
Micro_Draft4_Pattern_Properties_Empty 176.55998549675883 ns 209.11297600029638 ns 0.84
Micro_Draft4_Ref_To_Single_Property 11.918480519408018 ns 12.622486570664204 ns 0.94
Micro_Draft4_Additional_Properties_Type 27.98450880551665 ns 30.087846476455862 ns 0.93
Micro_Draft4_Nested_Oneof 38.78358387614172 ns 43.80511759342173 ns 0.89
Micro_Draft4_Short_Enum 6.2557315025817575 ns 7.8494871707084215 ns 0.80
Micro_Draft4_Long_Enum 11.078599651710663 ns 13.395754271294956 ns 0.83
Micro_Draft4_Long_Enum_Short_Strings 7.589602078138532 ns 9.257828560146667 ns 0.82
Micro_Draft4_Type_Object 3.7069643698417583 ns 4.449003743895215 ns 0.83
Micro_Draft4_Ref_Single_100 950354.4641148326 ns 1403004.8713450292 ns 0.68
Micro_Draft4_Compile_Ref_Many_Nested 590044.8151041666 ns 869180.1470588235 ns 0.68
Micro_Draft4_Compile_Wrap 804500.1413793104 ns 1014200.6203703703 ns 0.79
Micro_Draft6_Property_Names 94.04487256753593 ns 133.40823446444455 ns 0.70
Micro_Draft6_Compile_FHIR 5016645416 ns 5739280250 ns 0.87
Micro_Draft7_If_Then_Else 18.56288082454532 ns 20.874742879135454 ns 0.89
Micro_2019_09_Unevaluated_Properties 33.56031361470842 ns 37.97370758846548 ns 0.88
Micro_2019_09_Compile_Wrap 81983000 ns 95207167 ns 0.86
Micro_2020_12_Dynamic_Ref 642.3018654680898 ns 735.2519348698221 ns 0.87
Micro_2020_12_Dynamic_Ref_Single 3.589776002333814 ns 4.2750259558637085 ns 0.84
Micro_2020_12_Simple_Output_Mask 824.8693757010408 ns 934.2626732773449 ns 0.88
Micro_2020_12_Simple_Output_Annotations 54723.14126394052 ns 62116.14049826188 ns 0.88
Micro_2020_12_Simple_Output_Annotation_Dropping 1254966.9689119172 ns 1278611.2180451127 ns 0.98
Micro_2020_12_Compile_NonCircular_Shared_Refs 373037.20701754384 ns 362769.62295081967 ns 1.03
Micro_2020_12_Exhaustive_Deep_Numeric 5259.610757011179 ns 5160.727094365097 ns 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 32013.319673265956 ns 32363.226484833034 ns 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 13430.207648886915 ns 16073.771562058155 ns 0.84
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 86.98160360960578 ns 107.31058774393087 ns 0.81
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 2443.354828388919 ns 2890.4624794710912 ns 0.85
TestSuite_Parse_WoT 4287850.763636364 ns 5310346.9387755105 ns 0.81
Alterschema_Check_Readibility_ISO_Language_Set_3 173873209 ns 186716125 ns 0.93
Alterschema_Check_Readibility_OMC 33733916.571428575 ns 42337013.833333336 ns 0.80
Alterschema_Check_Readibility_KrakenD 426549042 ns 530188834 ns 0.80
Alterschema_Apply_Readibility_KrakenD 46844426291 ns 48703766625 ns 0.96
Alterschema_Check_Invalid_External_Refs 141602666.5 ns 145066521 ns 0.98
Alterschema_Check_Resolvable_External_Refs 148944.89503816795 ns 152231.6172917991 ns 0.98
Convert_Draft3_To_2020_12 2261781.4363636365 ns 2012997.767857143 ns 1.12
Convert_201909_To_2020_12_Unevaluated 288629.69836956525 ns 260028.78103837473 ns 1.11

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: e3fafdc Previous: ad08d10 Ratio
E2E_Evaluator_adaptivecard 123457 ns 130856 ns 0.94
E2E_Evaluator_ansible-meta 389687 ns 487376 ns 0.80
E2E_Evaluator_aws-cdk 116239 ns 134079 ns 0.87
E2E_Evaluator_babelrc 269913 ns 304614 ns 0.89
E2E_Evaluator_cerebrum-criminal-case 2079917 ns 2123131 ns 0.98
E2E_Evaluator_clang-format 248797 ns 220040 ns 1.13
E2E_Evaluator_cmake-presets 16877331 ns 18588044 ns 0.91
E2E_Evaluator_code-climate 376966 ns 506089 ns 0.74
E2E_Evaluator_cql2 1072791 ns 1143433 ns 0.94
E2E_Evaluator_cspell 1161558 ns 1645521 ns 0.71
E2E_Evaluator_cypress 727352 ns 805270 ns 0.90
E2E_Evaluator_deno 897693 ns 1094752 ns 0.82
E2E_Evaluator_dependabot 952689 ns 1165108 ns 0.82
E2E_Evaluator_draft-04 17926847 ns 25063741 ns 0.72
E2E_Evaluator_fabric-mod 1989310 ns 2024451 ns 0.98
E2E_Evaluator_geojson 18882457 ns 17483580 ns 1.08
E2E_Evaluator_gitpod-configuration 560938 ns 684564 ns 0.82
E2E_Evaluator_helm-chart-lock 972473 ns 1272788 ns 0.76
E2E_Evaluator_importmap 248773 ns 292720 ns 0.85
E2E_Evaluator_jasmine 216502 ns 264880 ns 0.82
E2E_Evaluator_jsconfig 912474 ns 1110556 ns 0.82
E2E_Evaluator_jshintrc 2609238 ns 2843123 ns 0.92
E2E_Evaluator_krakend 467758 ns 622958 ns 0.75
E2E_Evaluator_lazygit 374319 ns 400706 ns 0.93
E2E_Evaluator_lerna 352559 ns 415514 ns 0.85
E2E_Evaluator_nest-cli 434042 ns 512306 ns 0.85
E2E_Evaluator_omc 106132 ns 126245 ns 0.84
E2E_Evaluator_omnisharp 1079358 ns 1735571 ns 0.62
E2E_Evaluator_openapi 34738453 ns 44248089 ns 0.79
E2E_Evaluator_pre-commit-hooks 1932878 ns 1770823 ns 1.09
E2E_Evaluator_pulumi 1975505 ns 2049239 ns 0.96
E2E_Evaluator_semantic-release 226766 ns 252334 ns 0.90
E2E_Evaluator_stale 337089 ns 388110 ns 0.87
E2E_Evaluator_stylecop 843286 ns 1308408 ns 0.64
E2E_Evaluator_tmuxinator 178946 ns 233708 ns 0.77
E2E_Evaluator_ui5 1774866 ns 2742558 ns 0.65
E2E_Evaluator_ui5-manifest 12323979 ns 12876548 ns 0.96
E2E_Evaluator_unreal-engine-uproject 1271671 ns 1530815 ns 0.83
E2E_Evaluator_users-array 2577678 ns 3884693 ns 0.66
E2E_Evaluator_vercel 852282 ns 1306130 ns 0.65
E2E_Evaluator_yamllint 24421 ns 32535 ns 0.75

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: e3fafdc Previous: ad08d10 Ratio
Convert_Draft3_To_2020_12 3491679.3174603176 ns 3303114.411764706 ns 1.06
Convert_201909_To_2020_12_Unevaluated 481825.64170040487 ns 432402.66910420475 ns 1.11
Alterschema_Check_Readibility_ISO_Language_Set_3 270555980 ns 255749337 ns 1.06
Alterschema_Check_Readibility_OMC 48042954.6 ns 49635091.6 ns 0.97
Alterschema_Check_Readibility_KrakenD 553843461 ns 598236545 ns 0.93
Alterschema_Apply_Readibility_KrakenD 57176995606 ns 60653408291 ns 0.94
Alterschema_Check_Invalid_External_Refs 262693349 ns 227732557 ns 1.15
Alterschema_Check_Resolvable_External_Refs 269898.05136986304 ns 251190.77765957447 ns 1.07
TestSuite_Parse_WoT 5490313.511627907 ns 5390173.046511628 ns 1.02
Micro_2020_12_Dynamic_Ref 791.4599805918167 ns 825.7081259337285 ns 0.96
Micro_2020_12_Dynamic_Ref_Single 4.054613236753445 ns 4.220522351110306 ns 0.96
Micro_2020_12_Simple_Output_Mask 1052.0577463543968 ns 1045.7824413715452 ns 1.01
Micro_2020_12_Simple_Output_Annotations 52221.30667547918 ns 47035.97832140016 ns 1.11
Micro_2020_12_Simple_Output_Annotation_Dropping 1404553.4 ns 1311070.6243093922 ns 1.07
Micro_2020_12_Compile_NonCircular_Shared_Refs 548623.9559164733 ns 525671.9135254989 ns 1.04
Micro_2020_12_Exhaustive_Deep_Numeric 8145.431246120957 ns 8383.535295349811 ns 0.97
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 40901.471804511275 ns 42317.57983641536 ns 0.97
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 27923.066477742355 ns 26985.05164372654 ns 1.03
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 143.61848251153754 ns 142.08161534001 ns 1.01
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 2752.573590144839 ns 2512.5399228543874 ns 1.10
Micro_2019_09_Unevaluated_Properties 27.106243485006008 ns 26.410122286924828 ns 1.03
Micro_2019_09_Compile_Wrap 87921690 ns 89525419 ns 0.98
Micro_Draft7_If_Then_Else 23.936247108199037 ns 25.96618539692213 ns 0.92
Micro_Draft6_Property_Names 149.48979636663043 ns 142.610836925225 ns 1.05
Micro_Draft6_Compile_FHIR 3966085720 ns 4231806331 ns 0.94
Micro_Draft4_Meta_1_No_Callback 162.09901820643415 ns 165.98255318632334 ns 0.98
Micro_Draft4_Required_Properties 689.4003612787993 ns 707.9784325592627 ns 0.97
Micro_Draft4_Many_Optional_Properties_Minimal_Match 18.44630703763338 ns 19.351990073725652 ns 0.95
Micro_Draft4_Few_Optional_Properties_Minimal_Match 11.860211619826096 ns 12.308121320591583 ns 0.96
Micro_Draft4_Items_Schema 332.33988031053764 ns 294.20087494672913 ns 1.13
Micro_Draft4_Nested_Object 1.5595575949561074 ns 1.7579844926591013 ns 0.89
Micro_Draft4_Properties_Triad_Optional 367.4946370843444 ns 520.759309470031 ns 0.71
Micro_Draft4_Properties_Triad_Required 396.8464605685591 ns 582.5229063716574 ns 0.68
Micro_Draft4_Properties_Triad_Closed 300.316843504135 ns 419.75295746353856 ns 0.72
Micro_Draft4_Properties_Closed 54.55221687788124 ns 54.78283616346243 ns 1.00
Micro_Draft4_Non_Recursive_Ref 9.043575209564116 ns 8.462993285690771 ns 1.07
Micro_Draft4_Pattern_Properties_Empty 186.31362981209378 ns 173.84533034483795 ns 1.07
Micro_Draft4_Ref_To_Single_Property 12.481207614990481 ns 12.666634494904306 ns 0.99
Micro_Draft4_Additional_Properties_Type 14.04892343624424 ns 14.41823367423173 ns 0.97
Micro_Draft4_Nested_Oneof 62.05764760734871 ns 64.70768113111787 ns 0.96
Micro_Draft4_Short_Enum 14.648307638112746 ns 14.49704846213594 ns 1.01
Micro_Draft4_Long_Enum 13.106575422519443 ns 14.329468000584312 ns 0.91
Micro_Draft4_Long_Enum_Short_Strings 14.640712391212189 ns 14.425455324913784 ns 1.01
Micro_Draft4_Type_Object 4.055315071100568 ns 4.572886178466123 ns 0.89
Micro_Draft4_Ref_Single_100 1425938.251497006 ns 1401887.0414201184 ns 1.02
Micro_Draft4_Compile_Ref_Many_Nested 928723.7354085603 ns 887909.2293233082 ns 1.05
Micro_Draft4_Compile_Wrap 1190601.98 ns 1161049.6715686275 ns 1.03
JSONLD_Catalog_Simple 20682892.875 ns 21669841.888888888 ns 0.95
JSONLD_Catalog_Override_Agreeing 20830394.545454547 ns 21627756.636363637 ns 0.96
JSONLD_Catalog_Override_Shadowing 30840431.85714286 ns 33019732 ns 0.93
E2E_Compiler_adaptivecard 34079297.428571425 ns 35817435.333333336 ns 0.95
E2E_Compiler_ansible_meta 10582241.454545455 ns 10850428.714285715 ns 0.98
E2E_Compiler_aws_cdk 194465.2688172043 ns 177961.81592787377 ns 1.09
E2E_Compiler_babelrc 1049787.9955752213 ns 1021736.9141630902 ns 1.03
E2E_Compiler_clang_format 6706776.828571429 ns 6759808.485714286 ns 0.99
E2E_Compiler_cmake_presets 15504910.733333332 ns 15684298.57142857 ns 0.99
E2E_Compiler_code_climate 795206.6476510067 ns 761857.0384615385 ns 1.04
E2E_Compiler_cql2 7727633.466666667 ns 7648532.322580645 ns 1.01
E2E_Compiler_cspell 11388164.761904761 ns 11393084.904761905 ns 1.00
E2E_Compiler_cypress 1814270.9160305343 ns 1811678.6615384615 ns 1.00
E2E_Compiler_deno 3520523.9545454546 ns 3559836.378787879 ns 0.99
E2E_Compiler_dependabot 1446386.8353658537 ns 1420472.0357142857 ns 1.02
E2E_Compiler_draft_04 1344665.3125 ns 1306985.2087912087 ns 1.03
E2E_Compiler_fabric_mod 2153004.5727272728 ns 2146307.871559633 ns 1.00
E2E_Compiler_geojson 10735136.818181818 ns 10861687.454545455 ns 0.99
E2E_Compiler_gitpod_configuration 2190970.981651376 ns 2150048.981651376 ns 1.02
E2E_Compiler_helm_chart_lock 317254.9546666667 ns 299822.56313131313 ns 1.06
E2E_Compiler_importmap 150790.01458465442 ns 135380.10649202735 ns 1.11
E2E_Compiler_jasmine 563674.7488151658 ns 530953.1521252797 ns 1.06
E2E_Compiler_jshintrc 1723048.2296296295 ns 1654789.147887324 ns 1.04
E2E_Compiler_jsconfig 9277512.72 ns 9260173.5 ns 1.00
E2E_Compiler_krakend 67798302.33333333 ns 66762641 ns 1.02
E2E_Compiler_lazygit 14136396.235294119 ns 14292212.470588235 ns 0.99
E2E_Compiler_lerna 696089.0266272189 ns 664983.6123595505 ns 1.05
E2E_Compiler_nest_cli 3292259.671232877 ns 3237326.0555555555 ns 1.02
E2E_Compiler_omc 86382017.5 ns 85672968 ns 1.01
E2E_Compiler_omnisharp 2938202.234567901 ns 2922592.4078947366 ns 1.01
E2E_Compiler_openapi 13965088.352941176 ns 13963418.411764706 ns 1.00
E2E_Compiler_pre_commit_hooks 1482200.84375 ns 1524520.606451613 ns 0.97
E2E_Compiler_pulumi 1802535.5114503817 ns 1759141.030075188 ns 1.02
E2E_Compiler_semantic_release 649687.9287671233 ns 621704.5625 ns 1.05
E2E_Compiler_stale 549617.1524249422 ns 524639.0355555556 ns 1.05
E2E_Compiler_stylecop 2363580 ns 2394847.888888889 ns 0.99
E2E_Compiler_tmuxinator 872946.875 ns 830250.3291139241 ns 1.05
E2E_Compiler_ui5 29598654.285714287 ns 30507241.14285714 ns 0.97
E2E_Compiler_ui5_manifest 166990062 ns 165912471 ns 1.01
E2E_Compiler_unreal_engine_uproject 1826488.6141732284 ns 1782967.893939394 ns 1.02
E2E_Compiler_users_array 419206.21830985916 ns 382456.7775974026 ns 1.10
E2E_Compiler_vercel 6315537.131578947 ns 6363316.432432433 ns 0.99
E2E_Compiler_yamllint 126771.91152815013 ns 113395.02150023889 ns 1.12
E2E_Evaluator_adaptivecard 23374.809840293623 ns 23708.461368874636 ns 0.99
E2E_Evaluator_ansible_meta 269825.8784090909 ns 250131.1889596603 ns 1.08
E2E_Evaluator_aws_cdk 49318.675058672925 ns 45314.12685274302 ns 1.09
E2E_Evaluator_babelrc 107929.72698412699 ns 93040.05898331392 ns 1.16
E2E_Evaluator_cerebrum_criminal_case 1056211.763392857 ns 1129327.0142857144 ns 0.94
E2E_Evaluator_clang_format 99160.94588926174 ns 88288.18185212846 ns 1.12
E2E_Evaluator_cmake_presets 4655343.588235294 ns 4791603.040816327 ns 0.97
E2E_Evaluator_code_climate 190125.17865804365 ns 163802.49515905947 ns 1.16
E2E_Evaluator_cql2 222020.49099526065 ns 210499.91308243727 ns 1.05
E2E_Evaluator_cspell 618656.6119791666 ns 579590.3144963145 ns 1.07
E2E_Evaluator_cypress 173250.73279052554 ns 141655.3371054199 ns 1.22
E2E_Evaluator_deno 383204.27516778524 ns 299381.5205298013 ns 1.28
E2E_Evaluator_dependabot 379977.64500792394 ns 361414.3734567901 ns 1.05
E2E_Evaluator_draft_04 7801760.7 ns 7583478.129032258 ns 1.03
E2E_Evaluator_fabric_mod 765949.9032258064 ns 712077.4390243902 ns 1.08
E2E_Evaluator_geojson 12950953.611111112 ns 13465894.388888888 ns 0.96
E2E_Evaluator_gitpod_configuration 265745.4587973274 ns 236978.45388601036 ns 1.12
E2E_Evaluator_helm_chart_lock 365080.99696509866 ns 276187.15745192306 ns 1.32
E2E_Evaluator_importmap 43907.795522949586 ns 38519.03181595693 ns 1.14
E2E_Evaluator_jasmine 116015.47178988328 ns 100857.4844878878 ns 1.15
E2E_Evaluator_jshintrc 1033084.1652173913 ns 987277.2416666667 ns 1.05
E2E_Evaluator_jsconfig 428743.2867383513 ns 394021.7606837607 ns 1.09
E2E_Evaluator_krakend 213447.46046511628 ns 190947.45952782463 ns 1.12
E2E_Evaluator_lazygit 154071.49277266755 ns 131013.25620767495 ns 1.18
E2E_Evaluator_lerna 161424.58946657664 ns 125978.27475516866 ns 1.28
E2E_Evaluator_nest_cli 194871.43080724878 ns 178426.84526558893 ns 1.09
E2E_Evaluator_omc 21640.112228407255 ns 21816.419617788244 ns 0.99
E2E_Evaluator_omnisharp 530229.8660508083 ns 485462.0981210856 ns 1.09
E2E_Evaluator_openapi 12124079.555555556 ns 15104024.3125 ns 0.80
E2E_Evaluator_pre_commit_hooks 511856.4761904762 ns 466215.3064833006 ns 1.10
E2E_Evaluator_pulumi 759094.6698717949 ns 761038.160130719 ns 1.00
E2E_Evaluator_semantic_release 98699.52343425964 ns 82886.24647887323 ns 1.19
E2E_Evaluator_stale 156352.2439502943 ns 148560.05834378922 ns 1.05
E2E_Evaluator_stylecop 309445.38163001294 ns 295685.3188405797 ns 1.05
E2E_Evaluator_tmuxinator 96736.48350305499 ns 81427.2476907287 ns 1.19
E2E_Evaluator_ui5 577317.071942446 ns 558006.6959619953 ns 1.03
E2E_Evaluator_ui5_manifest 2831527.898734177 ns 2739904.487804878 ns 1.03
E2E_Evaluator_unreal_engine_uproject 477236.8120805369 ns 460769.2826086957 ns 1.04
E2E_Evaluator_users_array 631200.3946666666 ns 657749.4725274725 ns 0.96
E2E_Evaluator_vercel 344359.62716763007 ns 287032.077020202 ns 1.20
E2E_Evaluator_yamllint 10313.665764664804 ns 9123.869894041769 ns 1.13

This comment was automatically generated by workflow using github-action-benchmark.

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: e3fafdc Previous: ad08d10 Ratio
E2E_Evaluator_adaptivecard 121025 ns 119867 ns 1.01
E2E_Evaluator_ansible-meta 527682 ns 539072 ns 0.98
E2E_Evaluator_aws-cdk 147204 ns 128540 ns 1.15
E2E_Evaluator_babelrc 346054 ns 353922 ns 0.98
E2E_Evaluator_cerebrum-criminal-case 2512268 ns 2622136 ns 0.96
E2E_Evaluator_clang-format 256525 ns 261553 ns 0.98
E2E_Evaluator_cmake-presets 17674750 ns 17896820 ns 0.99
E2E_Evaluator_code-climate 510747 ns 505312 ns 1.01
E2E_Evaluator_cql2 1227983 ns 1222353 ns 1.00
E2E_Evaluator_cspell 1452699 ns 1576795 ns 0.92
E2E_Evaluator_cypress 763800 ns 825447 ns 0.93
E2E_Evaluator_deno 1047405 ns 1078058 ns 0.97
E2E_Evaluator_dependabot 1125227 ns 1070083 ns 1.05
E2E_Evaluator_draft-04 20601242 ns 21499303 ns 0.96
E2E_Evaluator_fabric-mod 2304853 ns 2461296 ns 0.94
E2E_Evaluator_geojson 23133433 ns 24984364 ns 0.93
E2E_Evaluator_gitpod-configuration 707263 ns 732711 ns 0.97
E2E_Evaluator_helm-chart-lock 1048730 ns 1059255 ns 0.99
E2E_Evaluator_importmap 265080 ns 263454 ns 1.01
E2E_Evaluator_jasmine 288982 ns 278116 ns 1.04
E2E_Evaluator_jsconfig 1217637 ns 1375340 ns 0.89
E2E_Evaluator_jshintrc 2722479 ns 2825027 ns 0.96
E2E_Evaluator_krakend 675334 ns 642448 ns 1.05
E2E_Evaluator_lazygit 495566 ns 460114 ns 1.08
E2E_Evaluator_lerna 472878 ns 446607 ns 1.06
E2E_Evaluator_nest-cli 589951 ns 600932 ns 0.98
E2E_Evaluator_omc 118815 ns 119116 ns 1.00
E2E_Evaluator_omnisharp 1398508 ns 1450966 ns 0.96
E2E_Evaluator_openapi 42987215 ns 42111772 ns 1.02
E2E_Evaluator_pre-commit-hooks 1986353 ns 2028683 ns 0.98
E2E_Evaluator_pulumi 1904318 ns 1990560 ns 0.96
E2E_Evaluator_semantic-release 253397 ns 236091 ns 1.07
E2E_Evaluator_stale 394456 ns 388762 ns 1.01
E2E_Evaluator_stylecop 1197549 ns 1200761 ns 1.00
E2E_Evaluator_tmuxinator 235179 ns 225681 ns 1.04
E2E_Evaluator_ui5 2200125 ns 2237211 ns 0.98
E2E_Evaluator_ui5-manifest 10358088 ns 10419315 ns 0.99
E2E_Evaluator_unreal-engine-uproject 1504725 ns 1639765 ns 0.92
E2E_Evaluator_users-array 3426537 ns 2838645 ns 1.21
E2E_Evaluator_vercel 978021 ns 1019390 ns 0.96
E2E_Evaluator_yamllint 25671 ns 23855 ns 1.08

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant