Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TEMP COMMIT: Benchmark quick and dirty bytes.Buffer conversion. #8955

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

reltuk
Copy link
Contributor

@reltuk reltuk commented Mar 6, 2025

No description provided.

@reltuk
Copy link
Contributor Author

reltuk commented Mar 6, 2025

#benchmark

Copy link

github-actions bot commented Mar 6, 2025

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

comparing_percentages
100.000000 to 100.000000
version result total
76ffbf9 ok 5937457
version total_tests
76ffbf9 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 59.99 59.99 0.0
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt a751dc7 40.15 dolt 76ffbf9 40.16 0.02

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.67 0.68 1.49
groupby_scan 18.61 18.28 -1.77
index_join 2.61 2.61 0.0
index_join_scan 1.42 1.52 7.04
index_scan 30.81 31.37 1.82
oltp_point_select 0.27 0.27 0.0
oltp_read_only 5.28 5.37 1.7
select_random_points 0.61 0.61 0.0
select_random_ranges 0.63 0.62 -1.59
table_scan 31.37 31.94 1.82
types_table_scan 118.92 112.67 -5.26
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.32 6.32 0.0
oltp_insert 3.13 3.13 0.0
oltp_read_write 11.45 11.65 1.75
oltp_update_index 3.19 3.19 0.0
oltp_update_non_index 3.07 3.07 0.0
oltp_write_only 6.32 6.32 0.0
types_delete_insert 6.67 6.67 0.0

@reltuk reltuk force-pushed the aaron/sql-types-bytes-buffer-benchmark branch from 76ffbf9 to 3590493 Compare March 7, 2025 18:02
@reltuk
Copy link
Contributor Author

reltuk commented Mar 7, 2025

#benchmark

Copy link

github-actions bot commented Mar 7, 2025

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

comparing_percentages
100.000000 to 100.000000
version result total
3590493 ok 5937457
version total_tests
3590493 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 57.87 61.08 5.55
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt a751dc7 40.66 dolt 3590493 39.83 -2.04

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.68 0.67 -1.47
groupby_scan 18.61 18.61 0.0
index_join 2.61 2.48 -4.98
index_join_scan 1.42 1.44 1.41
index_scan 30.81 30.26 -1.79
oltp_point_select 0.27 0.27 0.0
oltp_read_only 5.28 5.28 0.0
select_random_points 0.6 0.61 1.67
select_random_ranges 0.63 0.62 -1.59
table_scan 31.37 31.37 0.0
types_table_scan 118.92 116.8 -1.78
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.32 6.32 0.0
oltp_insert 3.13 3.13 0.0
oltp_read_write 11.45 11.65 1.75
oltp_update_index 3.19 3.19 0.0
oltp_update_non_index 3.07 3.07 0.0
oltp_write_only 6.32 6.32 0.0
types_delete_insert 6.67 6.67 0.0

@reltuk
Copy link
Contributor Author

reltuk commented Mar 7, 2025

#benchmark

Copy link

github-actions bot commented Mar 7, 2025

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

comparing_percentages
100.000000 to 100.000000
version result total
60feb68 ok 5937457
version total_tests
60feb68 5937457
correctness_percentage
100.0

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 61.08 58.92 -3.54
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt a751dc7 39.97 dolt 60feb68 40.04 0.18

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.68 0.74 8.82
groupby_scan 18.61 18.61 0.0
index_join 2.61 2.52 -3.45
index_join_scan 1.44 1.47 2.08
index_scan 30.81 30.26 -1.79
oltp_point_select 0.26 0.26 0.0
oltp_read_only 5.28 5.28 0.0
select_random_points 0.6 0.61 1.67
select_random_ranges 0.63 0.62 -1.59
table_scan 31.94 31.37 -1.78
types_table_scan 118.92 116.8 -1.78
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.32 6.32 0.0
oltp_insert 3.13 3.13 0.0
oltp_read_write 11.45 11.65 1.75
oltp_update_index 3.19 3.19 0.0
oltp_update_non_index 3.07 3.07 0.0
oltp_write_only 6.32 6.32 0.0
types_delete_insert 6.67 6.67 0.0

@reltuk
Copy link
Contributor Author

reltuk commented Mar 7, 2025

#benchmark

Copy link

github-actions bot commented Mar 7, 2025

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

test_name from_latency_p95 to_latency_p95 percent_change
tpcc-scale-factor-1 59.99 59.99 0.0
test_name from_server_name from_server_version from_tps to_server_name to_server_version to_tps percent_change
tpcc-scale-factor-1 dolt 51eb059 40.17 dolt 60feb68 40.25 0.2

@coffeegoddd
Copy link
Contributor

@reltuk DOLT

read_tests from_latency to_latency percent_change
covering_index_scan 0.67 0.75 11.94
groupby_scan 17.95 18.61 3.68
index_join 2.52 2.52 0.0
index_join_scan 1.42 1.47 3.52
index_scan 30.26 30.26 0.0
oltp_point_select 0.26 0.27 3.85
oltp_read_only 5.28 5.28 0.0
select_random_points 0.6 0.61 1.67
select_random_ranges 0.62 0.63 1.61
table_scan 31.37 31.37 0.0
types_table_scan 112.67 116.8 3.67
write_tests from_latency to_latency percent_change
oltp_delete_insert 6.32 6.32 0.0
oltp_insert 3.07 3.13 1.95
oltp_read_write 11.45 11.65 1.75
oltp_update_index 3.19 3.19 0.0
oltp_update_non_index 3.07 3.13 1.95
oltp_write_only 6.32 6.43 1.74
types_delete_insert 6.67 6.67 0.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants