Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

H-4007: Fix benchmark CI #6338

Merged
merged 1 commit into from
Feb 3, 2025
Merged

H-4007: Fix benchmark CI #6338

merged 1 commit into from
Feb 3, 2025

Conversation

TimDiekmann
Copy link
Member

🌟 What is the purpose of this PR?

The matrix names were changed but two lines were forgotten to be adjusted.

@TimDiekmann TimDiekmann self-assigned this Feb 3, 2025
@github-actions github-actions bot added the area/infra Relates to version control, CI, CD or IaC (area) label Feb 3, 2025
@TimDiekmann TimDiekmann enabled auto-merge February 3, 2025 16:24
@TimDiekmann TimDiekmann removed the request for review from indietyp February 3, 2025 16:25
Copy link

codecov bot commented Feb 3, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 21.22%. Comparing base (105bda9) to head (fbfa5e7).
Report is 2 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #6338      +/-   ##
==========================================
+ Coverage   21.05%   21.22%   +0.17%     
==========================================
  Files         580      580              
  Lines       19817    19841      +24     
  Branches     2929     2943      +14     
==========================================
+ Hits         4173     4212      +39     
+ Misses      15592    15572      -20     
- Partials       52       57       +5     
Flag Coverage Δ
apps.hash-ai-worker-ts 1.34% <ø> (ø)
apps.hash-api 1.14% <ø> (ø)
blockprotocol.type-system 46.42% <ø> (ø)
local.harpc-client 50.93% <ø> (+1.81%) ⬆️
local.hash-backend-utils 8.81% <ø> (ø)
local.hash-graph-sdk 58.62% <ø> (ø)
local.hash-isomorphic-utils 0.91% <ø> (ø)
local.hash-subgraph 24.54% <ø> (ø)
rust.deer 6.66% <ø> (ø)
rust.error-stack 72.53% <ø> (ø)
rust.sarif 88.81% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

github-actions bot commented Feb 3, 2025

Benchmark results

@rust/hash-graph-benches – Integrations

scaling_read_entity_complete_zero_depth

Function Value Mean Flame graphs
entity_by_id 25 entities $$3.38 \mathrm{ms} \pm 16.1 \mathrm{μs}\left({\color{gray}-0.139 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 1 entities $$1.99 \mathrm{ms} \pm 5.09 \mathrm{μs}\left({\color{gray}-0.032 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 5 entities $$2.00 \mathrm{ms} \pm 6.13 \mathrm{μs}\left({\color{gray}-1.067 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 10 entities $$2.21 \mathrm{ms} \pm 19.4 \mathrm{μs}\left({\color{gray}-0.639 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 50 entities $$4.10 \mathrm{ms} \pm 34.5 \mathrm{μs}\left({\color{gray}0.029 \mathrm{\%}}\right) $$ Flame Graph

representative_read_entity

Function Value Mean Flame graphs
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/block/v/1 $$16.3 \mathrm{ms} \pm 162 \mathrm{μs}\left({\color{lightgreen}-29.199 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/person/v/1 $$16.8 \mathrm{ms} \pm 167 \mathrm{μs}\left({\color{lightgreen}-27.156 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/page/v/2 $$16.8 \mathrm{ms} \pm 178 \mathrm{μs}\left({\color{gray}2.88 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/organization/v/1 $$17.2 \mathrm{ms} \pm 192 \mathrm{μs}\left({\color{gray}1.58 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/playlist/v/1 $$16.8 \mathrm{ms} \pm 229 \mathrm{μs}\left({\color{gray}3.22 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/uk-address/v/1 $$16.0 \mathrm{ms} \pm 185 \mathrm{μs}\left({\color{gray}-3.887 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/building/v/1 $$17.1 \mathrm{ms} \pm 218 \mathrm{μs}\left({\color{gray}2.67 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/song/v/1 $$17.4 \mathrm{ms} \pm 187 \mathrm{μs}\left({\color{red}6.77 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id entity type ID: https://blockprotocol.org/@alice/types/entity-type/book/v/1 $$17.5 \mathrm{ms} \pm 174 \mathrm{μs}\left({\color{red}7.96 \mathrm{\%}}\right) $$ Flame Graph

representative_read_entity_type

Function Value Mean Flame graphs
get_entity_type_by_id Account ID: d4e16033-c281-4cde-aa35-9085bf2e7579 $$2.13 \mathrm{ms} \pm 6.85 \mathrm{μs}\left({\color{gray}0.566 \mathrm{\%}}\right) $$ Flame Graph

representative_read_multiple_entities

Function Value Mean Flame graphs
link_by_source_by_property depths: DT=0, PT=2, ET=2, E=2 $$87.1 \mathrm{ms} \pm 406 \mathrm{μs}\left({\color{gray}0.934 \mathrm{\%}}\right) $$ Flame Graph
link_by_source_by_property depths: DT=0, PT=0, ET=2, E=2 $$82.9 \mathrm{ms} \pm 535 \mathrm{μs}\left({\color{gray}0.997 \mathrm{\%}}\right) $$ Flame Graph
link_by_source_by_property depths: DT=0, PT=0, ET=0, E=2 $$74.0 \mathrm{ms} \pm 295 \mathrm{μs}\left({\color{gray}0.337 \mathrm{\%}}\right) $$ Flame Graph
link_by_source_by_property depths: DT=2, PT=2, ET=2, E=2 $$90.8 \mathrm{ms} \pm 439 \mathrm{μs}\left({\color{gray}0.494 \mathrm{\%}}\right) $$ Flame Graph
link_by_source_by_property depths: DT=255, PT=255, ET=255, E=255 $$99.7 \mathrm{ms} \pm 502 \mathrm{μs}\left({\color{gray}0.733 \mathrm{\%}}\right) $$ Flame Graph
link_by_source_by_property depths: DT=0, PT=0, ET=0, E=0 $$38.2 \mathrm{ms} \pm 162 \mathrm{μs}\left({\color{gray}-1.043 \mathrm{\%}}\right) $$ Flame Graph
entity_by_property depths: DT=0, PT=2, ET=2, E=2 $$53.5 \mathrm{ms} \pm 251 \mathrm{μs}\left({\color{gray}0.988 \mathrm{\%}}\right) $$ Flame Graph
entity_by_property depths: DT=0, PT=0, ET=2, E=2 $$48.5 \mathrm{ms} \pm 215 \mathrm{μs}\left({\color{gray}0.219 \mathrm{\%}}\right) $$ Flame Graph
entity_by_property depths: DT=0, PT=0, ET=0, E=2 $$43.2 \mathrm{ms} \pm 262 \mathrm{μs}\left({\color{gray}0.788 \mathrm{\%}}\right) $$ Flame Graph
entity_by_property depths: DT=2, PT=2, ET=2, E=2 $$57.0 \mathrm{ms} \pm 288 \mathrm{μs}\left({\color{gray}1.02 \mathrm{\%}}\right) $$ Flame Graph
entity_by_property depths: DT=255, PT=255, ET=255, E=255 $$66.2 \mathrm{ms} \pm 214 \mathrm{μs}\left({\color{gray}0.460 \mathrm{\%}}\right) $$ Flame Graph
entity_by_property depths: DT=0, PT=0, ET=0, E=0 $$38.8 \mathrm{ms} \pm 173 \mathrm{μs}\left({\color{gray}0.171 \mathrm{\%}}\right) $$ Flame Graph

scaling_read_entity_complete_one_depth

Function Value Mean Flame graphs
entity_by_id 25 entities $$180 \mathrm{ms} \pm 564 \mathrm{μs}\left({\color{gray}1.34 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 1 entities $$20.8 \mathrm{ms} \pm 68.2 \mathrm{μs}\left({\color{gray}-1.486 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 5 entities $$27.5 \mathrm{ms} \pm 265 \mathrm{μs}\left({\color{gray}1.46 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 10 entities $$31.9 \mathrm{ms} \pm 150 \mathrm{μs}\left({\color{lightgreen}-29.129 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 50 entities $$5.59 \mathrm{s} \pm 283 \mathrm{ms}\left({\color{red}1967 \mathrm{\%}}\right) $$ Flame Graph

scaling_read_entity_linkless

Function Value Mean Flame graphs
entity_by_id 100 entities $$2.11 \mathrm{ms} \pm 5.71 \mathrm{μs}\left({\color{gray}-0.284 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 1000 entities $$2.95 \mathrm{ms} \pm 12.5 \mathrm{μs}\left({\color{gray}-1.184 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 10000 entities $$9.35 \mathrm{ms} \pm 77.4 \mathrm{μs}\left({\color{lightgreen}-30.686 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 1 entities $$2.00 \mathrm{ms} \pm 6.90 \mathrm{μs}\left({\color{gray}-0.231 \mathrm{\%}}\right) $$ Flame Graph
entity_by_id 10 entities $$2.02 \mathrm{ms} \pm 7.77 \mathrm{μs}\left({\color{gray}-0.031 \mathrm{\%}}\right) $$ Flame Graph

Merged via the queue into main with commit 2994856 Feb 3, 2025
145 of 146 checks passed
@TimDiekmann TimDiekmann deleted the t/h-4007-fix-benchmark-ci branch February 3, 2025 17:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/infra Relates to version control, CI, CD or IaC (area)
Development

Successfully merging this pull request may close these issues.

2 participants