Repository navigation
Lint example in OpenAPI schema objects - #1163
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: Adds schema-level
🤖 Was this summary useful? React with 👍 or 👎 |
| ONLY_CONTINUE_IF(!schema.defines("$ref")); | ||
| } | ||
|
|
||
| const auto &instance{schema.at("example")}; |
There was a problem hiding this comment.
Could you check serialized non-JSON examples at src/alterschema/linter/valid_example.h:30? The OpenAPI Schema Object specification explicitly permits strings containing examples not naturally representable in JSON/YAML, so an object schema with an XML-string example is now rejected for being a string and deleted by lint/fix despite being permitted.
Severity: medium
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| const auto result{evaluator.validate(schema_template.value(), instance, | ||
| std::ref(output))}; |
There was a problem hiding this comment.
Could you check an OpenAPI 3.0 request-body schema with required: [id], a readOnly: true id property, and example: {} at src/alterschema/linter/valid_example.h:74–75? OpenAPI makes id required only in responses, but the default compiler ignores readOnly/writeOnly while enforcing required, so lint/fix deletes this valid request example (likewise for response examples omitting required writeOnly properties).
Other locations where this applies: src/alterschema/linter/valid_example.h:48–49
Severity: medium
Other Locations
src/alterschema/linter/valid_example.h:48
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: e3fafdc | Previous: ad08d10 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
24745537.625 ns |
31949435 ns |
0.77 |
E2E_Compiler_ansible_meta |
7449328.333333333 ns |
10070153.375 ns |
0.74 |
E2E_Compiler_aws_cdk |
118009.07741935484 ns |
181308.60816012317 ns |
0.65 |
E2E_Compiler_babelrc |
718535.7371601209 ns |
1048631.298245614 ns |
0.69 |
E2E_Compiler_clang_format |
5050944.608695652 ns |
6692361.694444444 ns |
0.75 |
E2E_Compiler_cmake_presets |
11785572.85 ns |
15187435 ns |
0.78 |
E2E_Compiler_code_climate |
532560.8859060403 ns |
786490.5033333333 ns |
0.68 |
E2E_Compiler_cql2 |
5705192.928571428 ns |
7315397.7272727275 ns |
0.78 |
E2E_Compiler_cspell |
8896417.25925926 ns |
11532628.523809524 ns |
0.77 |
E2E_Compiler_cypress |
1355381.7657142857 ns |
1843556.1085271318 ns |
0.74 |
E2E_Compiler_deno |
2543046.4565217393 ns |
3368633.714285714 ns |
0.75 |
E2E_Compiler_dependabot |
1040753.2763157894 ns |
1427311.9457831325 ns |
0.73 |
E2E_Compiler_draft_04 |
924168.1411764706 ns |
1246748.253968254 ns |
0.74 |
E2E_Compiler_fabric_mod |
1610536.3401360544 ns |
2117540.8125 ns |
0.76 |
E2E_Compiler_geojson |
8152044.655172414 ns |
10317332.695652174 ns |
0.79 |
E2E_Compiler_gitpod_configuration |
1588952.16 ns |
2120363.1981981983 ns |
0.75 |
E2E_Compiler_helm_chart_lock |
218045.76774193547 ns |
334765.8991477273 ns |
0.65 |
E2E_Compiler_importmap |
93981.20371835443 ns |
144716.6043956044 ns |
0.65 |
E2E_Compiler_jasmine |
368224.61145510833 ns |
552746.103286385 ns |
0.67 |
E2E_Compiler_jshintrc |
1236963.4814814816 ns |
1734543.6204379562 ns |
0.71 |
E2E_Compiler_jsconfig |
6883829.742857143 ns |
9254262.615384616 ns |
0.74 |
E2E_Compiler_krakend |
47840595.6 ns |
64158631 ns |
0.75 |
E2E_Compiler_lazygit |
10811192.090909092 ns |
14194203.647058824 ns |
0.76 |
E2E_Compiler_lerna |
461423.21470019344 ns |
685062.6994219653 ns |
0.67 |
E2E_Compiler_nest_cli |
2446536.855670103 ns |
3252607.9315068494 ns |
0.75 |
E2E_Compiler_omc |
58819339.75 ns |
80000583.66666667 ns |
0.74 |
E2E_Compiler_omnisharp |
2139055.009009009 ns |
2894911.487804878 ns |
0.74 |
E2E_Compiler_openapi |
9901834.416666666 ns |
12759255.05263158 ns |
0.78 |
E2E_Compiler_pre_commit_hooks |
1066337.5112107624 ns |
1445050.9515151514 ns |
0.74 |
E2E_Compiler_pulumi |
1317333.2833333334 ns |
1751313.5111111111 ns |
0.75 |
E2E_Compiler_semantic_release |
427887.7684021544 ns |
632759.1413333333 ns |
0.68 |
E2E_Compiler_stale |
384207.1260096931 ns |
565753.9976076555 ns |
0.68 |
E2E_Compiler_stylecop |
1642326.2551724138 ns |
2357113.1717171716 ns |
0.70 |
E2E_Compiler_tmuxinator |
576900.2711864407 ns |
852390.5519713261 ns |
0.68 |
E2E_Compiler_ui5 |
22168354.222222224 ns |
28524858.85714286 ns |
0.78 |
E2E_Compiler_ui5_manifest |
114150077.5 ns |
169261762.5 ns |
0.67 |
E2E_Compiler_unreal_engine_uproject |
1365886.485549133 ns |
1816098.2923076923 ns |
0.75 |
E2E_Compiler_users_array |
250834.62276080085 ns |
377738.04769475356 ns |
0.66 |
E2E_Compiler_vercel |
4884777.142857143 ns |
6315084.189189189 ns |
0.77 |
E2E_Compiler_yamllint |
77352.16276041667 ns |
121985.31030927836 ns |
0.63 |
E2E_Evaluator_adaptivecard |
17709.600999179776 ns |
26958.007159904533 ns |
0.66 |
E2E_Evaluator_ansible_meta |
157026.30561056104 ns |
260760.61956521738 ns |
0.60 |
E2E_Evaluator_aws_cdk |
35243.53432527991 ns |
49684.23939458538 ns |
0.71 |
E2E_Evaluator_babelrc |
83917.53591749644 ns |
125565.32886984467 ns |
0.67 |
E2E_Evaluator_cerebrum_criminal_case |
915066.019379845 ns |
1151352.4449760765 ns |
0.79 |
E2E_Evaluator_clang_format |
87237.77471517824 ns |
113244.74689589303 ns |
0.77 |
E2E_Evaluator_cmake_presets |
3787630.709677419 ns |
4768189.405405405 ns |
0.79 |
E2E_Evaluator_code_climate |
144560.24403669726 ns |
186821.35275339187 ns |
0.77 |
E2E_Evaluator_cql2 |
141353.88644470868 ns |
242611.75228426396 ns |
0.58 |
E2E_Evaluator_cspell |
520649.5109649123 ns |
669357.7408450705 ns |
0.78 |
E2E_Evaluator_cypress |
145630.14452644528 ns |
207513.60558464224 ns |
0.70 |
E2E_Evaluator_deno |
271684.85419058555 ns |
340749.85942028987 ns |
0.80 |
E2E_Evaluator_dependabot |
260771.57888888888 ns |
360489.15045592707 ns |
0.72 |
E2E_Evaluator_draft_04 |
5644849.414634147 ns |
10997634.782608695 ns |
0.51 |
E2E_Evaluator_fabric_mod |
550093.0558139535 ns |
758333.9158576052 ns |
0.73 |
E2E_Evaluator_geojson |
7798238 ns |
11824581.6 ns |
0.66 |
E2E_Evaluator_gitpod_configuration |
174034.8996309963 ns |
251115.27582534612 ns |
0.69 |
E2E_Evaluator_helm_chart_lock |
409803.5094991364 ns |
370482.93270735524 ns |
1.11 |
E2E_Evaluator_importmap |
29715.07111556279 ns |
51171.4949339207 ns |
0.58 |
E2E_Evaluator_jasmine |
89812.58987915408 ns |
114131.57012487992 ns |
0.79 |
E2E_Evaluator_jshintrc |
1030178.6506550219 ns |
1230958.243523316 ns |
0.84 |
E2E_Evaluator_jsconfig |
312017.20502645505 ns |
450892.7423664122 ns |
0.69 |
E2E_Evaluator_krakend |
144074.31829268293 ns |
226258.81339712918 ns |
0.64 |
E2E_Evaluator_lazygit |
99464.27817644576 ns |
164002.1176046176 ns |
0.61 |
E2E_Evaluator_lerna |
134392.17954545454 ns |
152921.261208577 ns |
0.88 |
E2E_Evaluator_nest_cli |
138978.26448215332 ns |
201679.96995708154 ns |
0.69 |
E2E_Evaluator_omc |
13973.32702338393 ns |
25132.882669537135 ns |
0.56 |
E2E_Evaluator_omnisharp |
481121.4928425358 ns |
645734.8174386921 ns |
0.75 |
E2E_Evaluator_openapi |
7570448.677419355 ns |
11556124.25 ns |
0.66 |
E2E_Evaluator_pre_commit_hooks |
411538.8359511344 ns |
504771.13291139243 ns |
0.82 |
E2E_Evaluator_pulumi |
625103.1349206349 ns |
718948.7835365854 ns |
0.87 |
E2E_Evaluator_semantic_release |
69043.15532286213 ns |
107191.2641509434 ns |
0.64 |
E2E_Evaluator_stale |
117367.33663366336 ns |
160964.81966101695 ns |
0.73 |
E2E_Evaluator_stylecop |
201072.90956072352 ns |
310706.9225721785 ns |
0.65 |
E2E_Evaluator_tmuxinator |
69953.27283476204 ns |
98781.03644742354 ns |
0.71 |
E2E_Evaluator_ui5 |
357457.1161387632 ns |
578596.1014492754 ns |
0.62 |
E2E_Evaluator_ui5_manifest |
2057698.0267857143 ns |
2799781.2592592593 ns |
0.73 |
E2E_Evaluator_unreal_engine_uproject |
364660.54224270355 ns |
492226.79625779623 ns |
0.74 |
E2E_Evaluator_users_array |
494976.2916666667 ns |
620440.3691099477 ns |
0.80 |
E2E_Evaluator_vercel |
254949.94143167028 ns |
336014.51904090267 ns |
0.76 |
E2E_Evaluator_yamllint |
5664.537313432836 ns |
8585.413574361983 ns |
0.66 |
JSONLD_Catalog_Simple |
14028243.357142856 ns |
21210613 ns |
0.66 |
JSONLD_Catalog_Override_Agreeing |
14435534.125 ns |
22371373.545454547 ns |
0.65 |
JSONLD_Catalog_Override_Shadowing |
22648134.4 ns |
33998351 ns |
0.67 |
Micro_Draft4_Meta_1_No_Callback |
140.2482529430407 ns |
215.42932932169086 ns |
0.65 |
Micro_Draft4_Required_Properties |
668.4865978221109 ns |
880.6139393984338 ns |
0.76 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
17.893871624484486 ns |
23.705274870849095 ns |
0.75 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
8.724477569984902 ns |
13.386666269278816 ns |
0.65 |
Micro_Draft4_Items_Schema |
270.10230137199375 ns |
324.45421810496634 ns |
0.83 |
Micro_Draft4_Nested_Object |
1.7737648089951195 ns |
2.8041152943367393 ns |
0.63 |
Micro_Draft4_Properties_Triad_Optional |
237.9679044773725 ns |
331.0131489486542 ns |
0.72 |
Micro_Draft4_Properties_Triad_Required |
258.0672660087226 ns |
343.18504800681916 ns |
0.75 |
Micro_Draft4_Properties_Triad_Closed |
196.18683933822925 ns |
273.82310177239185 ns |
0.72 |
Micro_Draft4_Properties_Closed |
42.84632866680901 ns |
57.659020999550705 ns |
0.74 |
Micro_Draft4_Non_Recursive_Ref |
11.973761636276826 ns |
16.531405560847922 ns |
0.72 |
Micro_Draft4_Pattern_Properties_Empty |
117.61119898641154 ns |
153.37560234943683 ns |
0.77 |
Micro_Draft4_Ref_To_Single_Property |
8.764181346765527 ns |
13.081604057495722 ns |
0.67 |
Micro_Draft4_Additional_Properties_Type |
31.910612089885444 ns |
37.64025119233509 ns |
0.85 |
Micro_Draft4_Nested_Oneof |
46.72226965720499 ns |
61.971950579083895 ns |
0.75 |
Micro_Draft4_Short_Enum |
9.054588792367309 ns |
10.628298779246245 ns |
0.85 |
Micro_Draft4_Long_Enum |
11.763765882140634 ns |
16.515408764004235 ns |
0.71 |
Micro_Draft4_Long_Enum_Short_Strings |
9.0368709261365 ns |
10.61565770353729 ns |
0.85 |
Micro_Draft4_Type_Object |
3.3225260957916363 ns |
4.982438792630435 ns |
0.67 |
Micro_Draft4_Ref_Single_100 |
1002286.2542372881 ns |
1388233.9825581396 ns |
0.72 |
Micro_Draft4_Compile_Ref_Many_Nested |
627295.3052631579 ns |
902109.6147859922 ns |
0.70 |
Micro_Draft4_Compile_Wrap |
777272.5163398692 ns |
1115422.7710280374 ns |
0.70 |
Micro_Draft6_Property_Names |
112.69152180186082 ns |
127.64577792472762 ns |
0.88 |
Micro_Draft6_Compile_FHIR |
2928958065 ns |
3867995016 ns |
0.76 |
Micro_Draft7_If_Then_Else |
20.010219071729956 ns |
22.10718136082448 ns |
0.91 |
Micro_2019_09_Unevaluated_Properties |
27.134603921092445 ns |
28.735501817994198 ns |
0.94 |
Micro_2019_09_Compile_Wrap |
62876343.666666664 ns |
93114549.5 ns |
0.68 |
Micro_2020_12_Dynamic_Ref |
498.5765520937799 ns |
705.6470429060373 ns |
0.71 |
Micro_2020_12_Dynamic_Ref_Single |
3.4085682044426897 ns |
4.985420470131362 ns |
0.68 |
Micro_2020_12_Simple_Output_Mask |
736.5284338344161 ns |
1069.4024266708686 ns |
0.69 |
Micro_2020_12_Simple_Output_Annotations |
34129.774309551205 ns |
44781.27052414052 ns |
0.76 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
987939.325 ns |
1354586.8806818181 ns |
0.73 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
341734.6311953353 ns |
510213.7916666667 ns |
0.67 |
Micro_2020_12_Exhaustive_Deep_Numeric |
4688.594281985883 ns |
6884.8618563236605 ns |
0.68 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
26610.279753224902 ns |
36592.68454113682 ns |
0.73 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
12322.005594115819 ns |
18340.81744500193 ns |
0.67 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
81.72624761031658 ns |
123.9468450475896 ns |
0.66 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
1764.423478980221 ns |
2436.9667838538876 ns |
0.72 |
TestSuite_Parse_WoT |
3933827.25 ns |
5282727.333333333 ns |
0.74 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
191367805 ns |
272484550 ns |
0.70 |
Alterschema_Check_Readibility_OMC |
38193784.333333336 ns |
48754169.6 ns |
0.78 |
Alterschema_Check_Readibility_KrakenD |
467057518 ns |
566879282 ns |
0.82 |
Alterschema_Apply_Readibility_KrakenD |
47745515131 ns |
58378399737 ns |
0.82 |
Alterschema_Check_Invalid_External_Refs |
158558722 ns |
273027273 ns |
0.58 |
Alterschema_Check_Resolvable_External_Refs |
148586.93530150753 ns |
233440.61721068248 ns |
0.64 |
Convert_Draft3_To_2020_12 |
2338097.1515151514 ns |
3140664.5285714287 ns |
0.74 |
Convert_201909_To_2020_12_Unevaluated |
282480.1985731272 ns |
436701.6896551724 ns |
0.65 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: e3fafdc | Previous: ad08d10 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
89209 ns |
121338 ns |
0.74 |
E2E_Evaluator_ansible-meta |
365352 ns |
543720 ns |
0.67 |
E2E_Evaluator_aws-cdk |
108654 ns |
151335 ns |
0.72 |
E2E_Evaluator_babelrc |
291066 ns |
364058 ns |
0.80 |
E2E_Evaluator_cerebrum-criminal-case |
1761910 ns |
2555778 ns |
0.69 |
E2E_Evaluator_clang-format |
197455 ns |
281639 ns |
0.70 |
E2E_Evaluator_cmake-presets |
12963600 ns |
18531687 ns |
0.70 |
E2E_Evaluator_code-climate |
393828 ns |
533525 ns |
0.74 |
E2E_Evaluator_cql2 |
841853 ns |
1219119 ns |
0.69 |
E2E_Evaluator_cspell |
1198623 ns |
1598616 ns |
0.75 |
E2E_Evaluator_cypress |
696419 ns |
790884 ns |
0.88 |
E2E_Evaluator_deno |
844869 ns |
1070951 ns |
0.79 |
E2E_Evaluator_dependabot |
818134 ns |
1141234 ns |
0.72 |
E2E_Evaluator_draft-04 |
15232684 ns |
21205461 ns |
0.72 |
E2E_Evaluator_fabric-mod |
1770856 ns |
2505163 ns |
0.71 |
E2E_Evaluator_geojson |
14353282 ns |
26950285 ns |
0.53 |
E2E_Evaluator_gitpod-configuration |
529971 ns |
746141 ns |
0.71 |
E2E_Evaluator_helm-chart-lock |
895841 ns |
1097189 ns |
0.82 |
E2E_Evaluator_importmap |
255617 ns |
270300 ns |
0.95 |
E2E_Evaluator_jasmine |
211391 ns |
302433 ns |
0.70 |
E2E_Evaluator_jsconfig |
1070559 ns |
1317557 ns |
0.81 |
E2E_Evaluator_jshintrc |
2312428 ns |
2847737 ns |
0.81 |
E2E_Evaluator_krakend |
465691 ns |
683197 ns |
0.68 |
E2E_Evaluator_lazygit |
328347 ns |
536284 ns |
0.61 |
E2E_Evaluator_lerna |
370878 ns |
475809 ns |
0.78 |
E2E_Evaluator_nest-cli |
444771 ns |
609942 ns |
0.73 |
E2E_Evaluator_omc |
89715 ns |
120204 ns |
0.75 |
E2E_Evaluator_omnisharp |
1127546 ns |
1457092 ns |
0.77 |
E2E_Evaluator_openapi |
30148913 ns |
47811867 ns |
0.63 |
E2E_Evaluator_pre-commit-hooks |
1517377 ns |
2079031 ns |
0.73 |
E2E_Evaluator_pulumi |
1533280 ns |
1968182 ns |
0.78 |
E2E_Evaluator_semantic-release |
194799 ns |
266739 ns |
0.73 |
E2E_Evaluator_stale |
295481 ns |
417166 ns |
0.71 |
E2E_Evaluator_stylecop |
960278 ns |
1212797 ns |
0.79 |
E2E_Evaluator_tmuxinator |
197935 ns |
242731 ns |
0.82 |
E2E_Evaluator_ui5 |
1576510 ns |
2264152 ns |
0.70 |
E2E_Evaluator_ui5-manifest |
7897948 ns |
12171891 ns |
0.65 |
E2E_Evaluator_unreal-engine-uproject |
1200972 ns |
1533791 ns |
0.78 |
E2E_Evaluator_users-array |
2397202 ns |
2942820 ns |
0.81 |
E2E_Evaluator_vercel |
774233 ns |
1035044 ns |
0.75 |
E2E_Evaluator_yamllint |
18542 ns |
26355 ns |
0.70 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: e3fafdc | Previous: ad08d10 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
32865890.625 ns |
36412273.85714286 ns |
0.90 |
E2E_Compiler_ansible_meta |
9707421.64 ns |
10392741.210526315 ns |
0.93 |
E2E_Compiler_aws_cdk |
198213.86946386946 ns |
188303.62454873646 ns |
1.05 |
E2E_Compiler_babelrc |
1138779.3824701195 ns |
1216370.9329268292 ns |
0.94 |
E2E_Compiler_clang_format |
6009876.976190476 ns |
6801233.108108108 ns |
0.88 |
E2E_Compiler_cmake_presets |
16063000 ns |
18833465.90909091 ns |
0.85 |
E2E_Compiler_code_climate |
717375.8222222222 ns |
625822.5083798883 ns |
1.15 |
E2E_Compiler_cql2 |
6338212.121212121 ns |
6561392.441860465 ns |
0.97 |
E2E_Compiler_cspell |
10876850.409090908 ns |
11052479.166666666 ns |
0.98 |
E2E_Compiler_cypress |
1655519.16 ns |
1644475.83 ns |
1.01 |
E2E_Compiler_deno |
2945242.1875 ns |
3085766.2337662335 ns |
0.95 |
E2E_Compiler_dependabot |
1144040.0717703348 ns |
1287023.2639593908 ns |
0.89 |
E2E_Compiler_draft_04 |
950456.1491935484 ns |
1029154.4401544401 ns |
0.92 |
E2E_Compiler_fabric_mod |
1614427 ns |
1984525.42 ns |
0.81 |
E2E_Compiler_geojson |
9826428.32 ns |
11317876.909090908 ns |
0.87 |
E2E_Compiler_gitpod_configuration |
1672333.9416058394 ns |
1816298.3008849558 ns |
0.92 |
E2E_Compiler_helm_chart_lock |
223088.3620689655 ns |
289429.23728813557 ns |
0.77 |
E2E_Compiler_importmap |
97580.65476190476 ns |
157617.458 ns |
0.62 |
E2E_Compiler_jasmine |
397630.80431177444 ns |
701197.2891566266 ns |
0.57 |
E2E_Compiler_jshintrc |
1233518.5647668394 ns |
1801351.1359223302 ns |
0.68 |
E2E_Compiler_jsconfig |
7902478.571428572 ns |
10169967.818181818 ns |
0.78 |
E2E_Compiler_krakend |
59902916.666666664 ns |
86654958.33333333 ns |
0.69 |
E2E_Compiler_lazygit |
13865879.368421054 ns |
17312220.8 ns |
0.80 |
E2E_Compiler_lerna |
568802.4042553192 ns |
617673.8981132075 ns |
0.92 |
E2E_Compiler_nest_cli |
2662702.902173913 ns |
3516816.4556962023 ns |
0.76 |
E2E_Compiler_omc |
90168097 ns |
109076187.5 ns |
0.83 |
E2E_Compiler_omnisharp |
2756247.1264367816 ns |
3838019.397260274 ns |
0.72 |
E2E_Compiler_openapi |
12060349.652173912 ns |
14101048.076923076 ns |
0.86 |
E2E_Compiler_pre_commit_hooks |
1071548.2183406113 ns |
1367422.8275862068 ns |
0.78 |
E2E_Compiler_pulumi |
1371303.2051282052 ns |
1641563.6283783785 ns |
0.84 |
E2E_Compiler_semantic_release |
483862.60780669143 ns |
523164.11479591834 ns |
0.92 |
E2E_Compiler_stale |
414831.6115702479 ns |
519245.4680851064 ns |
0.80 |
E2E_Compiler_stylecop |
1966197.1544715448 ns |
3095221.0823529414 ns |
0.64 |
E2E_Compiler_tmuxinator |
623503.3828306264 ns |
709485.5324074074 ns |
0.88 |
E2E_Compiler_ui5 |
28284684.42857143 ns |
33581166.571428575 ns |
0.84 |
E2E_Compiler_ui5_manifest |
170110708 ns |
244180542 ns |
0.70 |
E2E_Compiler_unreal_engine_uproject |
1518124.5146198831 ns |
1497494.6691729324 ns |
1.01 |
E2E_Compiler_users_array |
327520.65095986036 ns |
361871.9225181598 ns |
0.91 |
E2E_Compiler_vercel |
5547428.571428572 ns |
6278445.184210527 ns |
0.88 |
E2E_Compiler_yamllint |
80834.9666061706 ns |
86690.61656551232 ns |
0.93 |
E2E_Evaluator_adaptivecard |
22952.844572225127 ns |
23285.649229332088 ns |
0.99 |
E2E_Evaluator_ansible_meta |
207318.24181626187 ns |
220679.18441558443 ns |
0.94 |
E2E_Evaluator_aws_cdk |
44602.81146637266 ns |
51198.42131324004 ns |
0.87 |
E2E_Evaluator_babelrc |
94639.75038520801 ns |
102670.11511789182 ns |
0.92 |
E2E_Evaluator_cerebrum_criminal_case |
921071.8915254237 ns |
1046463.663507109 ns |
0.88 |
E2E_Evaluator_clang_format |
95067.15982972136 ns |
132782.27092974336 ns |
0.72 |
E2E_Evaluator_cmake_presets |
3800682.296875 ns |
4887071.625 ns |
0.78 |
E2E_Evaluator_code_climate |
157000.1600512164 ns |
179927.833 ns |
0.87 |
E2E_Evaluator_cql2 |
169330.92837273993 ns |
179490.459 ns |
0.94 |
E2E_Evaluator_cspell |
727594.0909090909 ns |
605614.5411522634 ns |
1.20 |
E2E_Evaluator_cypress |
193102 ns |
159731.76143560873 ns |
1.21 |
E2E_Evaluator_deno |
297503.95467422093 ns |
292554.98594847776 ns |
1.02 |
E2E_Evaluator_dependabot |
315374.048 ns |
345748.38262476894 ns |
0.91 |
E2E_Evaluator_draft_04 |
5936242.857142857 ns |
6483416.685714286 ns |
0.92 |
E2E_Evaluator_fabric_mod |
572022.0588235294 ns |
610560.2467532468 ns |
0.94 |
E2E_Evaluator_geojson |
10695027.80952381 ns |
10250768.75 ns |
1.04 |
E2E_Evaluator_gitpod_configuration |
195498.08016032065 ns |
264197.9969183359 ns |
0.74 |
E2E_Evaluator_helm_chart_lock |
271306.4032258064 ns |
377719.1176470588 ns |
0.72 |
E2E_Evaluator_importmap |
44426.847793845016 ns |
52144.9110259685 ns |
0.85 |
E2E_Evaluator_jasmine |
100951.38568129331 ns |
116225.12701100761 ns |
0.87 |
E2E_Evaluator_jshintrc |
1028178.5475113122 ns |
1094892.454954955 ns |
0.94 |
E2E_Evaluator_jsconfig |
334399.12053571426 ns |
383023.1794158554 ns |
0.87 |
E2E_Evaluator_krakend |
148774.5068314899 ns |
193443.0728667306 ns |
0.77 |
E2E_Evaluator_lazygit |
108551.31887401939 ns |
132933.43964562568 ns |
0.82 |
E2E_Evaluator_lerna |
150544.67960023516 ns |
161659.16197623513 ns |
0.93 |
E2E_Evaluator_nest_cli |
154202.33854166666 ns |
178725.9882108183 ns |
0.86 |
E2E_Evaluator_omc |
17507.21163460082 ns |
18638.44757989161 ns |
0.94 |
E2E_Evaluator_omnisharp |
521789.0625 ns |
579449.5656370657 ns |
0.90 |
E2E_Evaluator_openapi |
10011246.541666666 ns |
10141866.64 ns |
0.99 |
E2E_Evaluator_pre_commit_hooks |
541981.5011441647 ns |
478896.7470119522 ns |
1.13 |
E2E_Evaluator_pulumi |
641530.7788944724 ns |
591475.3223140496 ns |
1.08 |
E2E_Evaluator_semantic_release |
85709.46574818216 ns |
81978.72369819341 ns |
1.05 |
E2E_Evaluator_stale |
138957.01204819276 ns |
137136.57793345008 ns |
1.01 |
E2E_Evaluator_stylecop |
226866.026289181 ns |
238843.09021113242 ns |
0.95 |
E2E_Evaluator_tmuxinator |
78157.61408730158 ns |
83119.09670164918 ns |
0.94 |
E2E_Evaluator_ui5 |
442408.8407871199 ns |
445149.0354609929 ns |
0.99 |
E2E_Evaluator_ui5_manifest |
1796410.2142857143 ns |
2411081.848214286 ns |
0.75 |
E2E_Evaluator_unreal_engine_uproject |
379988.92674616695 ns |
434357.18823529413 ns |
0.87 |
E2E_Evaluator_users_array |
491946.489626556 ns |
568630.41 ns |
0.87 |
E2E_Evaluator_vercel |
269321.1206896552 ns |
295041.57502738223 ns |
0.91 |
E2E_Evaluator_yamllint |
9314.47963800905 ns |
11024.685860123578 ns |
0.84 |
JSONLD_Catalog_Simple |
19760274.333333332 ns |
20868148.85714286 ns |
0.95 |
JSONLD_Catalog_Override_Agreeing |
20621541.666666668 ns |
23552391.7 ns |
0.88 |
JSONLD_Catalog_Override_Shadowing |
24944369.875 ns |
33292315.42857143 ns |
0.75 |
Micro_Draft4_Meta_1_No_Callback |
162.9746364518414 ns |
187.8297908678214 ns |
0.87 |
Micro_Draft4_Required_Properties |
762.9705720985219 ns |
1016.6915063999897 ns |
0.75 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
18.49684972794407 ns |
22.549126884510134 ns |
0.82 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
10.852903440156743 ns |
13.498875258613666 ns |
0.80 |
Micro_Draft4_Items_Schema |
268.075272225941 ns |
300.77374219631076 ns |
0.89 |
Micro_Draft4_Nested_Object |
1.700905840006768 ns |
2.114853366396933 ns |
0.80 |
Micro_Draft4_Properties_Triad_Optional |
247.17298599026174 ns |
300.6581552686278 ns |
0.82 |
Micro_Draft4_Properties_Triad_Required |
278.7752734488888 ns |
412.5827916496111 ns |
0.68 |
Micro_Draft4_Properties_Triad_Closed |
216.22118919959257 ns |
281.52519228625573 ns |
0.77 |
Micro_Draft4_Properties_Closed |
53.69882583060418 ns |
68.65450755574342 ns |
0.78 |
Micro_Draft4_Non_Recursive_Ref |
13.2721 ns |
15.255140738466654 ns |
0.87 |
Micro_Draft4_Pattern_Properties_Empty |
176.55998549675883 ns |
209.11297600029638 ns |
0.84 |
Micro_Draft4_Ref_To_Single_Property |
11.918480519408018 ns |
12.622486570664204 ns |
0.94 |
Micro_Draft4_Additional_Properties_Type |
27.98450880551665 ns |
30.087846476455862 ns |
0.93 |
Micro_Draft4_Nested_Oneof |
38.78358387614172 ns |
43.80511759342173 ns |
0.89 |
Micro_Draft4_Short_Enum |
6.2557315025817575 ns |
7.8494871707084215 ns |
0.80 |
Micro_Draft4_Long_Enum |
11.078599651710663 ns |
13.395754271294956 ns |
0.83 |
Micro_Draft4_Long_Enum_Short_Strings |
7.589602078138532 ns |
9.257828560146667 ns |
0.82 |
Micro_Draft4_Type_Object |
3.7069643698417583 ns |
4.449003743895215 ns |
0.83 |
Micro_Draft4_Ref_Single_100 |
950354.4641148326 ns |
1403004.8713450292 ns |
0.68 |
Micro_Draft4_Compile_Ref_Many_Nested |
590044.8151041666 ns |
869180.1470588235 ns |
0.68 |
Micro_Draft4_Compile_Wrap |
804500.1413793104 ns |
1014200.6203703703 ns |
0.79 |
Micro_Draft6_Property_Names |
94.04487256753593 ns |
133.40823446444455 ns |
0.70 |
Micro_Draft6_Compile_FHIR |
5016645416 ns |
5739280250 ns |
0.87 |
Micro_Draft7_If_Then_Else |
18.56288082454532 ns |
20.874742879135454 ns |
0.89 |
Micro_2019_09_Unevaluated_Properties |
33.56031361470842 ns |
37.97370758846548 ns |
0.88 |
Micro_2019_09_Compile_Wrap |
81983000 ns |
95207167 ns |
0.86 |
Micro_2020_12_Dynamic_Ref |
642.3018654680898 ns |
735.2519348698221 ns |
0.87 |
Micro_2020_12_Dynamic_Ref_Single |
3.589776002333814 ns |
4.2750259558637085 ns |
0.84 |
Micro_2020_12_Simple_Output_Mask |
824.8693757010408 ns |
934.2626732773449 ns |
0.88 |
Micro_2020_12_Simple_Output_Annotations |
54723.14126394052 ns |
62116.14049826188 ns |
0.88 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
1254966.9689119172 ns |
1278611.2180451127 ns |
0.98 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
373037.20701754384 ns |
362769.62295081967 ns |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric |
5259.610757011179 ns |
5160.727094365097 ns |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
32013.319673265956 ns |
32363.226484833034 ns |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
13430.207648886915 ns |
16073.771562058155 ns |
0.84 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
86.98160360960578 ns |
107.31058774393087 ns |
0.81 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
2443.354828388919 ns |
2890.4624794710912 ns |
0.85 |
TestSuite_Parse_WoT |
4287850.763636364 ns |
5310346.9387755105 ns |
0.81 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
173873209 ns |
186716125 ns |
0.93 |
Alterschema_Check_Readibility_OMC |
33733916.571428575 ns |
42337013.833333336 ns |
0.80 |
Alterschema_Check_Readibility_KrakenD |
426549042 ns |
530188834 ns |
0.80 |
Alterschema_Apply_Readibility_KrakenD |
46844426291 ns |
48703766625 ns |
0.96 |
Alterschema_Check_Invalid_External_Refs |
141602666.5 ns |
145066521 ns |
0.98 |
Alterschema_Check_Resolvable_External_Refs |
148944.89503816795 ns |
152231.6172917991 ns |
0.98 |
Convert_Draft3_To_2020_12 |
2261781.4363636365 ns |
2012997.767857143 ns |
1.12 |
Convert_201909_To_2020_12_Unevaluated |
288629.69836956525 ns |
260028.78103837473 ns |
1.11 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: e3fafdc | Previous: ad08d10 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
123457 ns |
130856 ns |
0.94 |
E2E_Evaluator_ansible-meta |
389687 ns |
487376 ns |
0.80 |
E2E_Evaluator_aws-cdk |
116239 ns |
134079 ns |
0.87 |
E2E_Evaluator_babelrc |
269913 ns |
304614 ns |
0.89 |
E2E_Evaluator_cerebrum-criminal-case |
2079917 ns |
2123131 ns |
0.98 |
E2E_Evaluator_clang-format |
248797 ns |
220040 ns |
1.13 |
E2E_Evaluator_cmake-presets |
16877331 ns |
18588044 ns |
0.91 |
E2E_Evaluator_code-climate |
376966 ns |
506089 ns |
0.74 |
E2E_Evaluator_cql2 |
1072791 ns |
1143433 ns |
0.94 |
E2E_Evaluator_cspell |
1161558 ns |
1645521 ns |
0.71 |
E2E_Evaluator_cypress |
727352 ns |
805270 ns |
0.90 |
E2E_Evaluator_deno |
897693 ns |
1094752 ns |
0.82 |
E2E_Evaluator_dependabot |
952689 ns |
1165108 ns |
0.82 |
E2E_Evaluator_draft-04 |
17926847 ns |
25063741 ns |
0.72 |
E2E_Evaluator_fabric-mod |
1989310 ns |
2024451 ns |
0.98 |
E2E_Evaluator_geojson |
18882457 ns |
17483580 ns |
1.08 |
E2E_Evaluator_gitpod-configuration |
560938 ns |
684564 ns |
0.82 |
E2E_Evaluator_helm-chart-lock |
972473 ns |
1272788 ns |
0.76 |
E2E_Evaluator_importmap |
248773 ns |
292720 ns |
0.85 |
E2E_Evaluator_jasmine |
216502 ns |
264880 ns |
0.82 |
E2E_Evaluator_jsconfig |
912474 ns |
1110556 ns |
0.82 |
E2E_Evaluator_jshintrc |
2609238 ns |
2843123 ns |
0.92 |
E2E_Evaluator_krakend |
467758 ns |
622958 ns |
0.75 |
E2E_Evaluator_lazygit |
374319 ns |
400706 ns |
0.93 |
E2E_Evaluator_lerna |
352559 ns |
415514 ns |
0.85 |
E2E_Evaluator_nest-cli |
434042 ns |
512306 ns |
0.85 |
E2E_Evaluator_omc |
106132 ns |
126245 ns |
0.84 |
E2E_Evaluator_omnisharp |
1079358 ns |
1735571 ns |
0.62 |
E2E_Evaluator_openapi |
34738453 ns |
44248089 ns |
0.79 |
E2E_Evaluator_pre-commit-hooks |
1932878 ns |
1770823 ns |
1.09 |
E2E_Evaluator_pulumi |
1975505 ns |
2049239 ns |
0.96 |
E2E_Evaluator_semantic-release |
226766 ns |
252334 ns |
0.90 |
E2E_Evaluator_stale |
337089 ns |
388110 ns |
0.87 |
E2E_Evaluator_stylecop |
843286 ns |
1308408 ns |
0.64 |
E2E_Evaluator_tmuxinator |
178946 ns |
233708 ns |
0.77 |
E2E_Evaluator_ui5 |
1774866 ns |
2742558 ns |
0.65 |
E2E_Evaluator_ui5-manifest |
12323979 ns |
12876548 ns |
0.96 |
E2E_Evaluator_unreal-engine-uproject |
1271671 ns |
1530815 ns |
0.83 |
E2E_Evaluator_users-array |
2577678 ns |
3884693 ns |
0.66 |
E2E_Evaluator_vercel |
852282 ns |
1306130 ns |
0.65 |
E2E_Evaluator_yamllint |
24421 ns |
32535 ns |
0.75 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: e3fafdc | Previous: ad08d10 | Ratio |
|---|---|---|---|
Convert_Draft3_To_2020_12 |
3491679.3174603176 ns |
3303114.411764706 ns |
1.06 |
Convert_201909_To_2020_12_Unevaluated |
481825.64170040487 ns |
432402.66910420475 ns |
1.11 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
270555980 ns |
255749337 ns |
1.06 |
Alterschema_Check_Readibility_OMC |
48042954.6 ns |
49635091.6 ns |
0.97 |
Alterschema_Check_Readibility_KrakenD |
553843461 ns |
598236545 ns |
0.93 |
Alterschema_Apply_Readibility_KrakenD |
57176995606 ns |
60653408291 ns |
0.94 |
Alterschema_Check_Invalid_External_Refs |
262693349 ns |
227732557 ns |
1.15 |
Alterschema_Check_Resolvable_External_Refs |
269898.05136986304 ns |
251190.77765957447 ns |
1.07 |
TestSuite_Parse_WoT |
5490313.511627907 ns |
5390173.046511628 ns |
1.02 |
Micro_2020_12_Dynamic_Ref |
791.4599805918167 ns |
825.7081259337285 ns |
0.96 |
Micro_2020_12_Dynamic_Ref_Single |
4.054613236753445 ns |
4.220522351110306 ns |
0.96 |
Micro_2020_12_Simple_Output_Mask |
1052.0577463543968 ns |
1045.7824413715452 ns |
1.01 |
Micro_2020_12_Simple_Output_Annotations |
52221.30667547918 ns |
47035.97832140016 ns |
1.11 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
1404553.4 ns |
1311070.6243093922 ns |
1.07 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
548623.9559164733 ns |
525671.9135254989 ns |
1.04 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8145.431246120957 ns |
8383.535295349811 ns |
0.97 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
40901.471804511275 ns |
42317.57983641536 ns |
0.97 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
27923.066477742355 ns |
26985.05164372654 ns |
1.03 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
143.61848251153754 ns |
142.08161534001 ns |
1.01 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
2752.573590144839 ns |
2512.5399228543874 ns |
1.10 |
Micro_2019_09_Unevaluated_Properties |
27.106243485006008 ns |
26.410122286924828 ns |
1.03 |
Micro_2019_09_Compile_Wrap |
87921690 ns |
89525419 ns |
0.98 |
Micro_Draft7_If_Then_Else |
23.936247108199037 ns |
25.96618539692213 ns |
0.92 |
Micro_Draft6_Property_Names |
149.48979636663043 ns |
142.610836925225 ns |
1.05 |
Micro_Draft6_Compile_FHIR |
3966085720 ns |
4231806331 ns |
0.94 |
Micro_Draft4_Meta_1_No_Callback |
162.09901820643415 ns |
165.98255318632334 ns |
0.98 |
Micro_Draft4_Required_Properties |
689.4003612787993 ns |
707.9784325592627 ns |
0.97 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
18.44630703763338 ns |
19.351990073725652 ns |
0.95 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
11.860211619826096 ns |
12.308121320591583 ns |
0.96 |
Micro_Draft4_Items_Schema |
332.33988031053764 ns |
294.20087494672913 ns |
1.13 |
Micro_Draft4_Nested_Object |
1.5595575949561074 ns |
1.7579844926591013 ns |
0.89 |
Micro_Draft4_Properties_Triad_Optional |
367.4946370843444 ns |
520.759309470031 ns |
0.71 |
Micro_Draft4_Properties_Triad_Required |
396.8464605685591 ns |
582.5229063716574 ns |
0.68 |
Micro_Draft4_Properties_Triad_Closed |
300.316843504135 ns |
419.75295746353856 ns |
0.72 |
Micro_Draft4_Properties_Closed |
54.55221687788124 ns |
54.78283616346243 ns |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
9.043575209564116 ns |
8.462993285690771 ns |
1.07 |
Micro_Draft4_Pattern_Properties_Empty |
186.31362981209378 ns |
173.84533034483795 ns |
1.07 |
Micro_Draft4_Ref_To_Single_Property |
12.481207614990481 ns |
12.666634494904306 ns |
0.99 |
Micro_Draft4_Additional_Properties_Type |
14.04892343624424 ns |
14.41823367423173 ns |
0.97 |
Micro_Draft4_Nested_Oneof |
62.05764760734871 ns |
64.70768113111787 ns |
0.96 |
Micro_Draft4_Short_Enum |
14.648307638112746 ns |
14.49704846213594 ns |
1.01 |
Micro_Draft4_Long_Enum |
13.106575422519443 ns |
14.329468000584312 ns |
0.91 |
Micro_Draft4_Long_Enum_Short_Strings |
14.640712391212189 ns |
14.425455324913784 ns |
1.01 |
Micro_Draft4_Type_Object |
4.055315071100568 ns |
4.572886178466123 ns |
0.89 |
Micro_Draft4_Ref_Single_100 |
1425938.251497006 ns |
1401887.0414201184 ns |
1.02 |
Micro_Draft4_Compile_Ref_Many_Nested |
928723.7354085603 ns |
887909.2293233082 ns |
1.05 |
Micro_Draft4_Compile_Wrap |
1190601.98 ns |
1161049.6715686275 ns |
1.03 |
JSONLD_Catalog_Simple |
20682892.875 ns |
21669841.888888888 ns |
0.95 |
JSONLD_Catalog_Override_Agreeing |
20830394.545454547 ns |
21627756.636363637 ns |
0.96 |
JSONLD_Catalog_Override_Shadowing |
30840431.85714286 ns |
33019732 ns |
0.93 |
E2E_Compiler_adaptivecard |
34079297.428571425 ns |
35817435.333333336 ns |
0.95 |
E2E_Compiler_ansible_meta |
10582241.454545455 ns |
10850428.714285715 ns |
0.98 |
E2E_Compiler_aws_cdk |
194465.2688172043 ns |
177961.81592787377 ns |
1.09 |
E2E_Compiler_babelrc |
1049787.9955752213 ns |
1021736.9141630902 ns |
1.03 |
E2E_Compiler_clang_format |
6706776.828571429 ns |
6759808.485714286 ns |
0.99 |
E2E_Compiler_cmake_presets |
15504910.733333332 ns |
15684298.57142857 ns |
0.99 |
E2E_Compiler_code_climate |
795206.6476510067 ns |
761857.0384615385 ns |
1.04 |
E2E_Compiler_cql2 |
7727633.466666667 ns |
7648532.322580645 ns |
1.01 |
E2E_Compiler_cspell |
11388164.761904761 ns |
11393084.904761905 ns |
1.00 |
E2E_Compiler_cypress |
1814270.9160305343 ns |
1811678.6615384615 ns |
1.00 |
E2E_Compiler_deno |
3520523.9545454546 ns |
3559836.378787879 ns |
0.99 |
E2E_Compiler_dependabot |
1446386.8353658537 ns |
1420472.0357142857 ns |
1.02 |
E2E_Compiler_draft_04 |
1344665.3125 ns |
1306985.2087912087 ns |
1.03 |
E2E_Compiler_fabric_mod |
2153004.5727272728 ns |
2146307.871559633 ns |
1.00 |
E2E_Compiler_geojson |
10735136.818181818 ns |
10861687.454545455 ns |
0.99 |
E2E_Compiler_gitpod_configuration |
2190970.981651376 ns |
2150048.981651376 ns |
1.02 |
E2E_Compiler_helm_chart_lock |
317254.9546666667 ns |
299822.56313131313 ns |
1.06 |
E2E_Compiler_importmap |
150790.01458465442 ns |
135380.10649202735 ns |
1.11 |
E2E_Compiler_jasmine |
563674.7488151658 ns |
530953.1521252797 ns |
1.06 |
E2E_Compiler_jshintrc |
1723048.2296296295 ns |
1654789.147887324 ns |
1.04 |
E2E_Compiler_jsconfig |
9277512.72 ns |
9260173.5 ns |
1.00 |
E2E_Compiler_krakend |
67798302.33333333 ns |
66762641 ns |
1.02 |
E2E_Compiler_lazygit |
14136396.235294119 ns |
14292212.470588235 ns |
0.99 |
E2E_Compiler_lerna |
696089.0266272189 ns |
664983.6123595505 ns |
1.05 |
E2E_Compiler_nest_cli |
3292259.671232877 ns |
3237326.0555555555 ns |
1.02 |
E2E_Compiler_omc |
86382017.5 ns |
85672968 ns |
1.01 |
E2E_Compiler_omnisharp |
2938202.234567901 ns |
2922592.4078947366 ns |
1.01 |
E2E_Compiler_openapi |
13965088.352941176 ns |
13963418.411764706 ns |
1.00 |
E2E_Compiler_pre_commit_hooks |
1482200.84375 ns |
1524520.606451613 ns |
0.97 |
E2E_Compiler_pulumi |
1802535.5114503817 ns |
1759141.030075188 ns |
1.02 |
E2E_Compiler_semantic_release |
649687.9287671233 ns |
621704.5625 ns |
1.05 |
E2E_Compiler_stale |
549617.1524249422 ns |
524639.0355555556 ns |
1.05 |
E2E_Compiler_stylecop |
2363580 ns |
2394847.888888889 ns |
0.99 |
E2E_Compiler_tmuxinator |
872946.875 ns |
830250.3291139241 ns |
1.05 |
E2E_Compiler_ui5 |
29598654.285714287 ns |
30507241.14285714 ns |
0.97 |
E2E_Compiler_ui5_manifest |
166990062 ns |
165912471 ns |
1.01 |
E2E_Compiler_unreal_engine_uproject |
1826488.6141732284 ns |
1782967.893939394 ns |
1.02 |
E2E_Compiler_users_array |
419206.21830985916 ns |
382456.7775974026 ns |
1.10 |
E2E_Compiler_vercel |
6315537.131578947 ns |
6363316.432432433 ns |
0.99 |
E2E_Compiler_yamllint |
126771.91152815013 ns |
113395.02150023889 ns |
1.12 |
E2E_Evaluator_adaptivecard |
23374.809840293623 ns |
23708.461368874636 ns |
0.99 |
E2E_Evaluator_ansible_meta |
269825.8784090909 ns |
250131.1889596603 ns |
1.08 |
E2E_Evaluator_aws_cdk |
49318.675058672925 ns |
45314.12685274302 ns |
1.09 |
E2E_Evaluator_babelrc |
107929.72698412699 ns |
93040.05898331392 ns |
1.16 |
E2E_Evaluator_cerebrum_criminal_case |
1056211.763392857 ns |
1129327.0142857144 ns |
0.94 |
E2E_Evaluator_clang_format |
99160.94588926174 ns |
88288.18185212846 ns |
1.12 |
E2E_Evaluator_cmake_presets |
4655343.588235294 ns |
4791603.040816327 ns |
0.97 |
E2E_Evaluator_code_climate |
190125.17865804365 ns |
163802.49515905947 ns |
1.16 |
E2E_Evaluator_cql2 |
222020.49099526065 ns |
210499.91308243727 ns |
1.05 |
E2E_Evaluator_cspell |
618656.6119791666 ns |
579590.3144963145 ns |
1.07 |
E2E_Evaluator_cypress |
173250.73279052554 ns |
141655.3371054199 ns |
1.22 |
E2E_Evaluator_deno |
383204.27516778524 ns |
299381.5205298013 ns |
1.28 |
E2E_Evaluator_dependabot |
379977.64500792394 ns |
361414.3734567901 ns |
1.05 |
E2E_Evaluator_draft_04 |
7801760.7 ns |
7583478.129032258 ns |
1.03 |
E2E_Evaluator_fabric_mod |
765949.9032258064 ns |
712077.4390243902 ns |
1.08 |
E2E_Evaluator_geojson |
12950953.611111112 ns |
13465894.388888888 ns |
0.96 |
E2E_Evaluator_gitpod_configuration |
265745.4587973274 ns |
236978.45388601036 ns |
1.12 |
E2E_Evaluator_helm_chart_lock |
365080.99696509866 ns |
276187.15745192306 ns |
1.32 |
E2E_Evaluator_importmap |
43907.795522949586 ns |
38519.03181595693 ns |
1.14 |
E2E_Evaluator_jasmine |
116015.47178988328 ns |
100857.4844878878 ns |
1.15 |
E2E_Evaluator_jshintrc |
1033084.1652173913 ns |
987277.2416666667 ns |
1.05 |
E2E_Evaluator_jsconfig |
428743.2867383513 ns |
394021.7606837607 ns |
1.09 |
E2E_Evaluator_krakend |
213447.46046511628 ns |
190947.45952782463 ns |
1.12 |
E2E_Evaluator_lazygit |
154071.49277266755 ns |
131013.25620767495 ns |
1.18 |
E2E_Evaluator_lerna |
161424.58946657664 ns |
125978.27475516866 ns |
1.28 |
E2E_Evaluator_nest_cli |
194871.43080724878 ns |
178426.84526558893 ns |
1.09 |
E2E_Evaluator_omc |
21640.112228407255 ns |
21816.419617788244 ns |
0.99 |
E2E_Evaluator_omnisharp |
530229.8660508083 ns |
485462.0981210856 ns |
1.09 |
E2E_Evaluator_openapi |
12124079.555555556 ns |
15104024.3125 ns |
0.80 |
E2E_Evaluator_pre_commit_hooks |
511856.4761904762 ns |
466215.3064833006 ns |
1.10 |
E2E_Evaluator_pulumi |
759094.6698717949 ns |
761038.160130719 ns |
1.00 |
E2E_Evaluator_semantic_release |
98699.52343425964 ns |
82886.24647887323 ns |
1.19 |
E2E_Evaluator_stale |
156352.2439502943 ns |
148560.05834378922 ns |
1.05 |
E2E_Evaluator_stylecop |
309445.38163001294 ns |
295685.3188405797 ns |
1.05 |
E2E_Evaluator_tmuxinator |
96736.48350305499 ns |
81427.2476907287 ns |
1.19 |
E2E_Evaluator_ui5 |
577317.071942446 ns |
558006.6959619953 ns |
1.03 |
E2E_Evaluator_ui5_manifest |
2831527.898734177 ns |
2739904.487804878 ns |
1.03 |
E2E_Evaluator_unreal_engine_uproject |
477236.8120805369 ns |
460769.2826086957 ns |
1.04 |
E2E_Evaluator_users_array |
631200.3946666666 ns |
657749.4725274725 ns |
0.96 |
E2E_Evaluator_vercel |
344359.62716763007 ns |
287032.077020202 ns |
1.20 |
E2E_Evaluator_yamllint |
10313.665764664804 ns |
9123.869894041769 ns |
1.13 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: e3fafdc | Previous: ad08d10 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
121025 ns |
119867 ns |
1.01 |
E2E_Evaluator_ansible-meta |
527682 ns |
539072 ns |
0.98 |
E2E_Evaluator_aws-cdk |
147204 ns |
128540 ns |
1.15 |
E2E_Evaluator_babelrc |
346054 ns |
353922 ns |
0.98 |
E2E_Evaluator_cerebrum-criminal-case |
2512268 ns |
2622136 ns |
0.96 |
E2E_Evaluator_clang-format |
256525 ns |
261553 ns |
0.98 |
E2E_Evaluator_cmake-presets |
17674750 ns |
17896820 ns |
0.99 |
E2E_Evaluator_code-climate |
510747 ns |
505312 ns |
1.01 |
E2E_Evaluator_cql2 |
1227983 ns |
1222353 ns |
1.00 |
E2E_Evaluator_cspell |
1452699 ns |
1576795 ns |
0.92 |
E2E_Evaluator_cypress |
763800 ns |
825447 ns |
0.93 |
E2E_Evaluator_deno |
1047405 ns |
1078058 ns |
0.97 |
E2E_Evaluator_dependabot |
1125227 ns |
1070083 ns |
1.05 |
E2E_Evaluator_draft-04 |
20601242 ns |
21499303 ns |
0.96 |
E2E_Evaluator_fabric-mod |
2304853 ns |
2461296 ns |
0.94 |
E2E_Evaluator_geojson |
23133433 ns |
24984364 ns |
0.93 |
E2E_Evaluator_gitpod-configuration |
707263 ns |
732711 ns |
0.97 |
E2E_Evaluator_helm-chart-lock |
1048730 ns |
1059255 ns |
0.99 |
E2E_Evaluator_importmap |
265080 ns |
263454 ns |
1.01 |
E2E_Evaluator_jasmine |
288982 ns |
278116 ns |
1.04 |
E2E_Evaluator_jsconfig |
1217637 ns |
1375340 ns |
0.89 |
E2E_Evaluator_jshintrc |
2722479 ns |
2825027 ns |
0.96 |
E2E_Evaluator_krakend |
675334 ns |
642448 ns |
1.05 |
E2E_Evaluator_lazygit |
495566 ns |
460114 ns |
1.08 |
E2E_Evaluator_lerna |
472878 ns |
446607 ns |
1.06 |
E2E_Evaluator_nest-cli |
589951 ns |
600932 ns |
0.98 |
E2E_Evaluator_omc |
118815 ns |
119116 ns |
1.00 |
E2E_Evaluator_omnisharp |
1398508 ns |
1450966 ns |
0.96 |
E2E_Evaluator_openapi |
42987215 ns |
42111772 ns |
1.02 |
E2E_Evaluator_pre-commit-hooks |
1986353 ns |
2028683 ns |
0.98 |
E2E_Evaluator_pulumi |
1904318 ns |
1990560 ns |
0.96 |
E2E_Evaluator_semantic-release |
253397 ns |
236091 ns |
1.07 |
E2E_Evaluator_stale |
394456 ns |
388762 ns |
1.01 |
E2E_Evaluator_stylecop |
1197549 ns |
1200761 ns |
1.00 |
E2E_Evaluator_tmuxinator |
235179 ns |
225681 ns |
1.04 |
E2E_Evaluator_ui5 |
2200125 ns |
2237211 ns |
0.98 |
E2E_Evaluator_ui5-manifest |
10358088 ns |
10419315 ns |
0.99 |
E2E_Evaluator_unreal-engine-uproject |
1504725 ns |
1639765 ns |
0.92 |
E2E_Evaluator_users-array |
3426537 ns |
2838645 ns |
1.21 |
E2E_Evaluator_vercel |
978021 ns |
1019390 ns |
0.96 |
E2E_Evaluator_yamllint |
25671 ns |
23855 ns |
1.08 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com