Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feature](cooldown)backup cooldown data #45589

Open
wants to merge 9 commits into
base: master
Choose a base branch
from
Open

[feature](cooldown)backup cooldown data #45589

wants to merge 9 commits into from

Conversation

justfortaste
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Currently, backup/resore is not supported for cooldown data.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 18, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@justfortaste
Copy link
Contributor Author

run buildall

xy720
xy720 approved these changes Dec 18, 2024
View reviewed changes
Copy link
Member

@xy720 xy720 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xy720
Copy link
Member

xy720 commented Dec 18, 2024

this pr has been review in #43642

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 18, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

lide-reed
lide-reed approved these changes Dec 18, 2024
View reviewed changes
Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.86% (10132/26071)
Line Coverage: 29.77% (85141/286014)
Region Coverage: 28.83% (43686/151550)
Branch Coverage: 25.36% (22189/87492)
Coverage Report: http://coverage.selectdb-in.cc/coverage/60b9dc20b29139d4feef9fe05f83cdf78a15e895_60b9dc20b29139d4feef9fe05f83cdf78a15e895/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39978 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 60b9dc20b29139d4feef9fe05f83cdf78a15e895, data reload: false

------ Round 1 ----------------------------------
q1	17591	7457	7281	7281
q2	2058	183	169	169
q3	10548	1114	1247	1114
q4	10559	754	721	721
q5	7646	2749	2734	2734
q6	244	150	148	148
q7	994	637	615	615
q8	9244	1872	1876	1872
q9	6664	6474	6429	6429
q10	7036	2326	2342	2326
q11	475	276	265	265
q12	424	226	229	226
q13	17782	2984	2950	2950
q14	249	213	214	213
q15	550	500	497	497
q16	661	582	575	575
q17	1001	544	591	544
q18	7208	6817	6669	6669
q19	1350	931	925	925
q20	481	183	183	183
q21	4028	3398	3209	3209
q22	388	319	313	313
Total cold run time: 107181 ms
Total hot run time: 39978 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7233	7283	7258	7258
q2	330	229	235	229
q3	2964	2887	2969	2887
q4	2072	1890	1852	1852
q5	5745	5709	5653	5653
q6	234	144	154	144
q7	2272	1839	1819	1819
q8	3405	3581	3549	3549
q9	8904	9119	9056	9056
q10	3585	3583	3563	3563
q11	619	526	514	514
q12	821	590	610	590
q13	12326	3117	3111	3111
q14	315	287	275	275
q15	567	509	511	509
q16	684	645	646	645
q17	1874	1648	1635	1635
q18	8200	7730	7649	7649
q19	1703	1567	1565	1565
q20	2151	1816	1921	1816
q21	5569	5513	5458	5458
q22	650	623	611	611
Total cold run time: 72223 ms
Total hot run time: 60388 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196585 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 60b9dc20b29139d4feef9fe05f83cdf78a15e895, data reload: false

query1	1281	937	975	937
query2	6243	2348	2315	2315
query3	10976	4708	4728	4708
query4	33743	23405	23456	23405
query5	5213	480	467	467
query6	283	199	188	188
query7	3992	304	305	304
query8	302	227	229	227
query9	9669	2736	2723	2723
query10	510	243	248	243
query11	18095	15187	15237	15187
query12	165	106	103	103
query13	1573	435	433	433
query14	10852	7358	7608	7358
query15	265	191	188	188
query16	8053	431	489	431
query17	1749	611	619	611
query18	2121	318	357	318
query19	372	184	170	170
query20	128	116	121	116
query21	202	114	110	110
query22	4855	4448	4529	4448
query23	34862	33763	34026	33763
query24	10644	2448	2557	2448
query25	623	397	395	395
query26	1134	153	156	153
query27	2523	344	337	337
query28	7548	2471	2477	2471
query29	833	419	425	419
query30	231	149	154	149
query31	1019	830	822	822
query32	93	57	59	57
query33	753	292	285	285
query34	1233	530	504	504
query35	904	751	778	751
query36	1125	973	954	954
query37	144	80	74	74
query38	4225	4084	4154	4084
query39	1498	1517	1435	1435
query40	207	106	100	100
query41	45	44	44	44
query42	119	111	104	104
query43	539	488	498	488
query44	1233	856	827	827
query45	186	171	175	171
query46	1213	720	732	720
query47	2017	1933	1922	1922
query48	425	333	327	327
query49	892	382	403	382
query50	856	408	399	399
query51	7410	7162	7270	7162
query52	110	94	90	90
query53	264	187	182	182
query54	1034	407	446	407
query55	89	82	84	82
query56	263	255	249	249
query57	1253	1142	1162	1142
query58	250	226	233	226
query59	3316	3186	3051	3051
query60	279	260	264	260
query61	116	103	105	103
query62	853	700	722	700
query63	219	194	195	194
query64	3918	667	649	649
query65	3326	3242	3242	3242
query66	759	312	325	312
query67	16376	15524	15610	15524
query68	5395	561	568	561
query69	472	259	254	254
query70	1202	1112	1127	1112
query71	470	254	261	254
query72	7065	4148	3985	3985
query73	791	364	374	364
query74	10297	8792	8854	8792
query75	3817	2649	2673	2649
query76	3506	1009	1117	1009
query77	711	369	294	294
query78	10167	9519	9298	9298
query79	2258	605	608	605
query80	869	422	446	422
query81	530	231	225	225
query82	1348	123	113	113
query83	187	144	138	138
query84	252	74	71	71
query85	1535	308	310	308
query86	448	305	292	292
query87	4602	4389	4344	4344
query88	3922	2216	2229	2216
query89	424	304	293	293
query90	2191	185	189	185
query91	142	105	105	105
query92	73	53	50	50
query93	2953	548	548	548
query94	907	294	301	294
query95	353	247	246	246
query96	637	280	283	280
query97	2852	2633	2694	2633
query98	218	196	192	192
query99	1585	1303	1316	1303
Total cold run time: 309780 ms
Total hot run time: 196585 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.1 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 60b9dc20b29139d4feef9fe05f83cdf78a15e895, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.11
query5	0.41	0.44	0.43
query6	1.17	0.66	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.59	0.50	0.52
query10	0.54	0.57	0.57
query11	0.14	0.10	0.11
query12	0.13	0.11	0.11
query13	0.61	0.61	0.60
query14	2.75	2.76	2.84
query15	0.91	0.84	0.82
query16	0.39	0.40	0.38
query17	1.06	1.06	1.06
query18	0.21	0.22	0.21
query19	1.96	1.87	2.01
query20	0.01	0.02	0.01
query21	15.37	0.59	0.59
query22	2.61	2.10	2.43
query23	16.83	1.13	0.82
query24	2.94	0.97	2.20
query25	0.14	0.22	0.16
query26	0.51	0.14	0.14
query27	0.04	0.04	0.05
query28	9.83	1.12	1.07
query29	12.58	3.23	3.23
query30	0.25	0.06	0.07
query31	2.86	0.40	0.38
query32	3.28	0.46	0.45
query33	3.16	3.09	3.05
query34	16.81	4.44	4.59
query35	4.51	4.47	4.47
query36	0.69	0.48	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.78 s
Total hot run time: 33.1 s

@justfortaste
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.87% (10134/26072)
Line Coverage: 29.78% (85201/286070)
Region Coverage: 28.83% (43695/151579)
Branch Coverage: 25.37% (22200/87514)
Coverage Report: http://coverage.selectdb-in.cc/coverage/065de6ad1dc215830a95e325d1afbc3a08fcdc9f_065de6ad1dc215830a95e325d1afbc3a08fcdc9f/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39738 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 065de6ad1dc215830a95e325d1afbc3a08fcdc9f, data reload: false

------ Round 1 ----------------------------------
q1	17580	7394	7251	7251
q2	2046	186	188	186
q3	10809	1089	1118	1089
q4	10529	746	736	736
q5	7621	2737	2601	2601
q6	238	147	144	144
q7	967	628	626	626
q8	9255	1898	1926	1898
q9	6792	6540	6525	6525
q10	7018	2278	2318	2278
q11	464	264	258	258
q12	429	222	224	222
q13	17785	2967	2934	2934
q14	239	207	209	207
q15	554	526	500	500
q16	669	579	579	579
q17	972	607	554	554
q18	7275	6602	6569	6569
q19	1350	959	948	948
q20	466	187	184	184
q21	3921	3143	3247	3143
q22	376	308	306	306
Total cold run time: 107355 ms
Total hot run time: 39738 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7239	7229	7229	7229
q2	330	230	227	227
q3	2887	2802	2915	2802
q4	2091	1817	1817	1817
q5	5679	5635	5632	5632
q6	222	141	142	141
q7	2219	1785	1785	1785
q8	3358	3551	3441	3441
q9	8906	8934	8950	8934
q10	3640	3524	3518	3518
q11	614	517	500	500
q12	843	597	596	596
q13	10883	3123	3058	3058
q14	313	280	279	279
q15	569	512	508	508
q16	682	645	649	645
q17	1835	1631	1634	1631
q18	8294	7767	7615	7615
q19	1749	1531	1501	1501
q20	2043	1840	1875	1840
q21	5621	5424	5510	5424
q22	616	583	567	567
Total cold run time: 70633 ms
Total hot run time: 59690 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196578 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 065de6ad1dc215830a95e325d1afbc3a08fcdc9f, data reload: false

query1	1266	973	905	905
query2	6245	2399	2247	2247
query3	11119	4686	4745	4686
query4	33215	23353	23286	23286
query5	4034	464	442	442
query6	275	190	188	188
query7	3980	293	303	293
query8	292	219	226	219
query9	9462	2668	2663	2663
query10	467	237	247	237
query11	17902	15324	15275	15275
query12	155	100	102	100
query13	1559	408	413	408
query14	9717	7098	6707	6707
query15	266	198	198	198
query16	8333	462	485	462
query17	1614	577	575	575
query18	2185	309	313	309
query19	368	156	158	156
query20	123	116	111	111
query21	212	110	108	108
query22	5004	4731	4547	4547
query23	34597	33932	33802	33802
query24	10440	2504	2446	2446
query25	645	395	385	385
query26	1246	149	149	149
query27	2465	319	338	319
query28	7536	2424	2438	2424
query29	843	420	409	409
query30	231	156	147	147
query31	1016	819	846	819
query32	101	55	63	55
query33	754	298	315	298
query34	1162	514	517	514
query35	891	787	748	748
query36	1123	954	961	954
query37	152	74	83	74
query38	4235	4173	4275	4173
query39	1519	1485	1471	1471
query40	206	100	101	100
query41	46	41	44	41
query42	108	101	105	101
query43	533	482	493	482
query44	1288	817	810	810
query45	189	169	165	165
query46	1174	715	719	715
query47	2070	1976	1987	1976
query48	408	320	317	317
query49	925	377	406	377
query50	837	415	393	393
query51	7387	7279	7320	7279
query52	106	91	91	91
query53	253	181	183	181
query54	1168	420	474	420
query55	79	78	78	78
query56	265	242	224	224
query57	1318	1178	1141	1141
query58	237	215	225	215
query59	3268	3102	3200	3102
query60	288	251	244	244
query61	109	105	109	105
query62	883	704	676	676
query63	219	187	186	186
query64	4080	732	649	649
query65	3299	3285	3267	3267
query66	817	322	310	310
query67	16428	15567	15550	15550
query68	4613	548	538	538
query69	470	269	252	252
query70	1164	1100	1128	1100
query71	430	244	260	244
query72	6675	4207	4134	4134
query73	776	356	350	350
query74	10188	8859	8776	8776
query75	3472	2649	2651	2649
query76	3297	1010	1165	1010
query77	573	275	260	260
query78	10215	11004	10046	10046
query79	1104	601	580	580
query80	779	413	420	413
query81	500	226	224	224
query82	212	121	119	119
query83	200	144	138	138
query84	288	68	78	68
query85	754	305	307	305
query86	407	303	300	300
query87	4774	4538	4342	4342
query88	3857	2166	2173	2166
query89	395	287	294	287
query90	2053	185	184	184
query91	133	101	106	101
query92	60	50	50	50
query93	1060	525	524	524
query94	775	276	268	268
query95	342	243	242	242
query96	605	282	280	280
query97	2852	2675	2661	2661
query98	209	191	200	191
query99	1576	1272	1312	1272
Total cold run time: 299545 ms
Total hot run time: 196578 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.71 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 065de6ad1dc215830a95e325d1afbc3a08fcdc9f, data reload: false

query1	0.04	0.02	0.03
query2	0.08	0.04	0.03
query3	0.23	0.08	0.06
query4	1.61	0.10	0.11
query5	0.43	0.40	0.42
query6	1.18	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.51	0.49
query10	0.55	0.57	0.56
query11	0.14	0.11	0.10
query12	0.12	0.11	0.11
query13	0.62	0.61	0.60
query14	2.74	2.70	2.84
query15	0.89	0.83	0.82
query16	0.38	0.38	0.37
query17	0.99	0.97	1.00
query18	0.22	0.21	0.20
query19	1.94	1.83	1.97
query20	0.02	0.02	0.01
query21	15.36	0.60	0.60
query22	2.96	2.66	2.61
query23	16.95	0.96	0.78
query24	3.08	1.16	2.07
query25	0.32	0.15	0.05
query26	0.45	0.14	0.13
query27	0.04	0.04	0.04
query28	9.69	1.11	1.07
query29	12.59	3.45	3.41
query30	0.25	0.07	0.07
query31	2.85	0.39	0.38
query32	3.27	0.47	0.45
query33	3.08	3.12	3.13
query34	17.01	4.52	4.50
query35	4.51	4.47	4.53
query36	0.66	0.47	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.03
query40	0.17	0.13	0.13
query41	0.07	0.03	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.37 s
Total hot run time: 33.71 s

@justfortaste
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39819 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97a37a6cabce7490f08c7ba17dcea5382a70cecd, data reload: false

------ Round 1 ----------------------------------
q1	17586	8115	7323	7323
q2	2052	195	173	173
q3	10574	1097	1284	1097
q4	10531	754	731	731
q5	7606	2704	2696	2696
q6	241	147	145	145
q7	985	625	603	603
q8	9249	1858	1930	1858
q9	6613	6378	6490	6378
q10	7060	2299	2317	2299
q11	463	256	258	256
q12	431	227	213	213
q13	17797	2921	2956	2921
q14	250	210	208	208
q15	573	526	496	496
q16	686	588	615	588
q17	981	587	524	524
q18	7266	6664	6750	6664
q19	1338	966	926	926
q20	476	178	182	178
q21	4065	3489	3227	3227
q22	372	315	316	315
Total cold run time: 107195 ms
Total hot run time: 39819 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7335	7252	7250	7250
q2	339	232	231	231
q3	2899	2872	2952	2872
q4	2094	1809	1837	1809
q5	5642	5658	5679	5658
q6	228	140	140	140
q7	2236	1849	1777	1777
q8	3409	3558	3558	3558
q9	8924	8981	8917	8917
q10	3566	3522	3581	3522
q11	603	519	507	507
q12	822	614	648	614
q13	12536	3052	3075	3052
q14	306	281	287	281
q15	561	514	507	507
q16	690	668	672	668
q17	1873	1619	1605	1605
q18	8438	7872	7709	7709
q19	1731	1675	1440	1440
q20	2090	1896	1913	1896
q21	5740	5476	5658	5476
q22	660	566	616	566
Total cold run time: 72722 ms
Total hot run time: 60055 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.87% (10133/26068)
Line Coverage: 29.81% (85277/286090)
Region Coverage: 28.91% (43497/150448)
Branch Coverage: 25.44% (22181/87182)
Coverage Report: http://coverage.selectdb-in.cc/coverage/97a37a6cabce7490f08c7ba17dcea5382a70cecd_97a37a6cabce7490f08c7ba17dcea5382a70cecd/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 198645 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97a37a6cabce7490f08c7ba17dcea5382a70cecd, data reload: false

query1	1352	1051	955	955
query2	6210	2351	2449	2351
query3	11098	4898	4867	4867
query4	33028	23509	23498	23498
query5	4143	492	492	492
query6	293	193	193	193
query7	3986	320	324	320
query8	312	253	248	248
query9	9524	2656	2654	2654
query10	474	254	259	254
query11	17822	15299	15385	15299
query12	159	112	104	104
query13	1648	424	426	424
query14	10486	7750	7783	7750
query15	301	205	192	192
query16	8074	448	463	448
query17	1821	638	578	578
query18	2202	312	318	312
query19	365	155	163	155
query20	124	112	118	112
query21	206	106	109	106
query22	4905	4658	4546	4546
query23	35017	34168	34478	34168
query24	10397	2710	2553	2553
query25	622	388	396	388
query26	1178	154	156	154
query27	2192	341	336	336
query28	7053	2497	2426	2426
query29	841	428	411	411
query30	231	157	151	151
query31	1077	875	834	834
query32	107	57	55	55
query33	784	313	303	303
query34	989	537	547	537
query35	900	795	787	787
query36	1119	971	972	971
query37	147	78	76	76
query38	4272	4229	4192	4192
query39	1518	1478	1447	1447
query40	212	112	107	107
query41	48	44	45	44
query42	117	112	107	107
query43	546	508	513	508
query44	1339	840	855	840
query45	197	170	197	170
query46	1231	754	735	735
query47	2038	1876	1911	1876
query48	433	332	338	332
query49	884	392	407	392
query50	862	417	407	407
query51	7389	7319	7232	7232
query52	103	95	95	95
query53	272	201	189	189
query54	1154	437	427	427
query55	83	80	83	80
query56	277	240	250	240
query57	1322	1185	1182	1182
query58	244	222	248	222
query59	3393	3309	3121	3121
query60	273	243	249	243
query61	104	110	104	104
query62	890	666	681	666
query63	224	190	191	190
query64	3845	672	626	626
query65	3338	3204	3228	3204
query66	753	292	313	292
query67	16209	15599	15602	15599
query68	4857	575	573	573
query69	458	265	263	263
query70	1257	1081	1113	1081
query71	399	246	258	246
query72	6940	4123	4289	4123
query73	815	377	385	377
query74	10224	8966	8902	8902
query75	3405	2638	2664	2638
query76	2744	1042	1176	1042
query77	484	279	269	269
query78	10379	9428	9616	9428
query79	1470	621	610	610
query80	1021	434	420	420
query81	541	235	230	230
query82	900	116	114	114
query83	249	149	148	148
query84	227	68	80	68
query85	1202	315	299	299
query86	366	290	287	287
query87	4666	4316	4262	4262
query88	3400	2278	2232	2232
query89	440	294	296	294
query90	2061	194	193	193
query91	144	111	104	104
query92	63	50	51	50
query93	1510	558	555	555
query94	1024	284	285	284
query95	356	254	264	254
query96	680	279	278	278
query97	2875	2730	2617	2617
query98	224	197	198	197
query99	1587	1340	1330	1330
Total cold run time: 301725 ms
Total hot run time: 198645 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.38 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97a37a6cabce7490f08c7ba17dcea5382a70cecd, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.03
query3	0.25	0.07	0.07
query4	1.61	0.10	0.11
query5	0.42	0.42	0.42
query6	1.14	0.64	0.66
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.50	0.50
query10	0.56	0.56	0.54
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.60	0.60	0.61
query14	2.71	2.83	2.72
query15	0.90	0.82	0.82
query16	0.36	0.38	0.39
query17	0.97	1.07	1.05
query18	0.22	0.21	0.21
query19	2.00	1.83	1.92
query20	0.01	0.01	0.02
query21	15.36	0.61	0.60
query22	2.91	2.85	2.29
query23	17.04	0.94	0.99
query24	2.95	0.98	1.24
query25	0.20	0.14	0.11
query26	0.44	0.14	0.14
query27	0.04	0.05	0.05
query28	10.70	1.10	1.08
query29	12.62	3.23	3.24
query30	0.25	0.06	0.07
query31	2.85	0.38	0.38
query32	3.25	0.47	0.46
query33	3.12	3.06	3.11
query34	16.97	4.47	4.56
query35	4.51	4.52	4.51
query36	0.65	0.50	0.50
query37	0.10	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.07	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.14 s
Total hot run time: 33.38 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.86% (10131/26068)
Line Coverage: 29.80% (85248/286090)
Region Coverage: 28.90% (43481/150448)
Branch Coverage: 25.43% (22170/87182)
Coverage Report: http://coverage.selectdb-in.cc/coverage/4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee_4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39571 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee, data reload: false

------ Round 1 ----------------------------------
q1	17608	7459	7301	7301
q2	2051	176	164	164
q3	10625	1054	1170	1054
q4	10571	711	721	711
q5	7636	2658	2747	2658
q6	242	149	145	145
q7	989	626	607	607
q8	9239	1891	1904	1891
q9	6595	6411	6327	6327
q10	7059	2288	2307	2288
q11	466	257	262	257
q12	427	227	216	216
q13	17791	2933	2948	2933
q14	240	218	209	209
q15	553	514	485	485
q16	666	585	556	556
q17	976	584	577	577
q18	7107	6632	6781	6632
q19	1350	1031	902	902
q20	476	179	184	179
q21	4018	3235	3174	3174
q22	378	319	305	305
Total cold run time: 107063 ms
Total hot run time: 39571 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7240	7229	7256	7229
q2	328	228	229	228
q3	2907	2814	2903	2814
q4	2045	1788	1755	1755
q5	5676	5672	5675	5672
q6	238	146	142	142
q7	2266	1774	1892	1774
q8	3409	3562	3519	3519
q9	8892	8879	8958	8879
q10	3591	3541	3573	3541
q11	590	511	503	503
q12	831	599	574	574
q13	12466	3133	3108	3108
q14	305	284	262	262
q15	564	507	513	507
q16	707	627	651	627
q17	1835	1609	1583	1583
q18	8324	7708	7571	7571
q19	2002	1541	1458	1458
q20	2071	1837	1841	1837
q21	5729	5499	5465	5465
q22	648	601	593	593
Total cold run time: 72664 ms
Total hot run time: 59641 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195196 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee, data reload: false

query1	1282	992	919	919
query2	6225	2451	2280	2280
query3	11106	4907	4808	4808
query4	32980	23231	23335	23231
query5	4304	476	450	450
query6	288	194	179	179
query7	3984	303	306	303
query8	304	248	237	237
query9	9248	2648	2640	2640
query10	456	245	247	245
query11	18003	15207	15039	15039
query12	157	105	103	103
query13	1582	453	428	428
query14	9529	6551	6587	6551
query15	255	195	192	192
query16	8296	478	439	439
query17	1647	583	598	583
query18	2150	320	317	317
query19	383	157	154	154
query20	130	120	113	113
query21	204	108	107	107
query22	4661	4427	4625	4427
query23	35256	33696	33444	33444
query24	10474	2484	2439	2439
query25	664	394	407	394
query26	1223	163	145	145
query27	2460	342	353	342
query28	7626	2444	2399	2399
query29	834	409	436	409
query30	228	154	147	147
query31	1053	818	806	806
query32	97	55	58	55
query33	751	302	307	302
query34	1193	517	507	507
query35	892	741	803	741
query36	1132	999	973	973
query37	163	80	85	80
query38	4350	4165	4201	4165
query39	1478	1476	1415	1415
query40	205	105	113	105
query41	51	48	42	42
query42	120	99	98	98
query43	561	515	511	511
query44	1381	869	841	841
query45	189	169	170	169
query46	1208	743	715	715
query47	2086	1942	1947	1942
query48	416	325	328	325
query49	904	391	389	389
query50	845	397	382	382
query51	7356	7190	7159	7159
query52	107	94	96	94
query53	271	183	179	179
query54	1181	412	408	408
query55	84	98	80	80
query56	262	255	255	255
query57	1306	1169	1171	1169
query58	231	222	219	219
query59	3366	3156	3134	3134
query60	272	265	253	253
query61	106	112	107	107
query62	887	721	690	690
query63	221	194	187	187
query64	3929	689	708	689
query65	3285	3248	3266	3248
query66	864	297	301	297
query67	16616	15612	15548	15548
query68	5864	542	548	542
query69	500	256	246	246
query70	1194	1134	1126	1126
query71	519	251	245	245
query72	6938	4158	4085	4085
query73	791	363	360	360
query74	10228	8837	8864	8837
query75	4060	2622	2628	2622
query76	4265	1052	1115	1052
query77	675	300	267	267
query78	10118	9282	9334	9282
query79	1533	607	601	601
query80	725	446	415	415
query81	498	239	219	219
query82	226	112	118	112
query83	161	147	145	145
query84	272	73	66	66
query85	1006	303	301	301
query86	362	253	290	253
query87	4783	4512	4398	4398
query88	4345	2219	2198	2198
query89	435	288	291	288
query90	2103	192	182	182
query91	134	102	103	102
query92	65	49	51	49
query93	4355	546	537	537
query94	868	284	324	284
query95	350	268	243	243
query96	644	282	274	274
query97	2766	2634	2661	2634
query98	213	204	202	202
query99	1550	1286	1331	1286
Total cold run time: 307904 ms
Total hot run time: 195196 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.46 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4b72d138b06f38cba8a0a0cfbbdb07f36b92c9ee, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.43	0.42	0.41
query6	1.17	0.66	0.66
query7	0.03	0.02	0.01
query8	0.04	0.04	0.03
query9	0.59	0.50	0.50
query10	0.56	0.56	0.55
query11	0.15	0.10	0.10
query12	0.13	0.11	0.11
query13	0.60	0.60	0.59
query14	2.72	2.73	2.83
query15	0.91	0.83	0.83
query16	0.38	0.38	0.38
query17	1.03	1.05	1.06
query18	0.23	0.21	0.22
query19	1.94	1.85	1.93
query20	0.02	0.01	0.01
query21	15.36	0.61	0.59
query22	2.52	2.83	1.50
query23	16.92	0.99	0.82
query24	3.28	1.50	1.00
query25	0.26	0.15	0.12
query26	0.56	0.13	0.14
query27	0.05	0.04	0.04
query28	10.16	1.10	1.08
query29	12.55	3.25	3.24
query30	0.24	0.06	0.06
query31	2.85	0.39	0.39
query32	3.24	0.47	0.46
query33	3.03	3.05	3.08
query34	17.10	4.50	4.50
query35	4.51	4.47	4.45
query36	0.67	0.50	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.17	0.12	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.67 s
Total hot run time: 32.46 s

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40040 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0b9ffbe9968fa1bd8916222011fd1b6e2b25c338, data reload: false

------ Round 1 ----------------------------------
q1	17601	8184	7311	7311
q2	2063	183	182	182
q3	10774	1123	1164	1123
q4	10581	800	738	738
q5	7625	2734	2754	2734
q6	241	149	145	145
q7	1010	623	611	611
q8	9278	1892	1983	1892
q9	6661	6514	6417	6417
q10	6997	2329	2332	2329
q11	474	269	262	262
q12	429	222	228	222
q13	17763	2930	2980	2930
q14	260	208	224	208
q15	571	513	502	502
q16	680	597	585	585
q17	993	551	552	551
q18	7327	6568	6580	6568
q19	1352	1064	972	972
q20	469	188	189	188
q21	4052	3456	3257	3257
q22	384	328	313	313
Total cold run time: 107585 ms
Total hot run time: 40040 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7222	7204	7191	7191
q2	330	223	228	223
q3	2965	2897	2929	2897
q4	2047	1853	1811	1811
q5	5651	5677	5656	5656
q6	226	144	145	144
q7	2270	1783	1808	1783
q8	3402	3571	3557	3557
q9	8891	9040	9044	9040
q10	3636	3538	3587	3538
q11	612	516	506	506
q12	802	619	593	593
q13	12853	3126	3028	3028
q14	315	285	266	266
q15	559	523	502	502
q16	704	662	636	636
q17	1862	1675	1645	1645
q18	8345	7864	7619	7619
q19	2621	1618	1527	1527
q20	2134	1911	1909	1909
q21	5586	5489	5436	5436
q22	655	610	606	606
Total cold run time: 73688 ms
Total hot run time: 60113 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.79% (10094/26021)
Line Coverage: 29.78% (85159/285963)
Region Coverage: 28.90% (43475/150458)
Branch Coverage: 25.43% (22160/87148)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0b9ffbe9968fa1bd8916222011fd1b6e2b25c338_0b9ffbe9968fa1bd8916222011fd1b6e2b25c338/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 197503 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0b9ffbe9968fa1bd8916222011fd1b6e2b25c338, data reload: false

query1	1337	979	973	973
query2	6220	2452	2429	2429
query3	10992	4649	4977	4649
query4	33197	23493	23337	23337
query5	3957	479	463	463
query6	295	214	191	191
query7	3985	309	318	309
query8	292	233	227	227
query9	9581	2745	2756	2745
query10	457	251	249	249
query11	17768	15265	15269	15265
query12	160	108	102	102
query13	1560	418	415	415
query14	9871	7208	7826	7208
query15	297	200	192	192
query16	8335	447	495	447
query17	1802	607	614	607
query18	2164	335	343	335
query19	385	171	176	171
query20	126	119	118	118
query21	213	114	110	110
query22	4853	4608	4409	4409
query23	35296	34397	34000	34000
query24	10653	2612	2505	2505
query25	619	402	395	395
query26	1233	155	152	152
query27	2584	339	342	339
query28	7433	2551	2551	2551
query29	854	408	421	408
query30	234	155	151	151
query31	1058	860	844	844
query32	91	59	55	55
query33	770	311	300	300
query34	974	535	521	521
query35	874	749	774	749
query36	1130	996	985	985
query37	146	75	75	75
query38	4288	4279	4285	4279
query39	1515	1485	1482	1482
query40	209	105	106	105
query41	44	44	46	44
query42	115	102	101	101
query43	545	509	521	509
query44	1234	854	829	829
query45	191	171	173	171
query46	1192	737	745	737
query47	2019	1924	1947	1924
query48	441	327	332	327
query49	955	422	413	413
query50	821	403	383	383
query51	7274	7175	7208	7175
query52	111	99	94	94
query53	283	188	188	188
query54	1255	425	418	418
query55	84	81	83	81
query56	278	269	259	259
query57	1286	1187	1170	1170
query58	238	232	227	227
query59	3370	3039	3329	3039
query60	281	256	261	256
query61	111	108	118	108
query62	859	681	661	661
query63	227	188	187	187
query64	4003	672	661	661
query65	3270	3199	3199	3199
query66	724	302	304	302
query67	15992	15538	15475	15475
query68	5389	566	562	562
query69	481	252	268	252
query70	1217	1172	1118	1118
query71	474	254	247	247
query72	7134	4219	4075	4075
query73	804	432	364	364
query74	10033	8848	8955	8848
query75	3441	2611	2655	2611
query76	3740	1113	1122	1113
query77	582	287	269	269
query78	10243	9572	9354	9354
query79	2613	625	628	625
query80	1352	425	432	425
query81	523	227	228	227
query82	664	121	112	112
query83	198	150	144	144
query84	293	70	70	70
query85	1416	337	303	303
query86	398	317	283	283
query87	4524	4360	4365	4360
query88	4377	2204	2183	2183
query89	495	292	294	292
query90	2094	200	186	186
query91	142	111	104	104
query92	59	51	51	51
query93	5327	558	560	558
query94	861	290	287	287
query95	355	253	251	251
query96	682	282	280	280
query97	2929	2714	2652	2652
query98	217	198	203	198
query99	1611	1314	1332	1314
Total cold run time: 309679 ms
Total hot run time: 197503 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.84 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0b9ffbe9968fa1bd8916222011fd1b6e2b25c338, data reload: false

query1	0.04	0.04	0.06
query2	0.06	0.04	0.03
query3	0.23	0.07	0.08
query4	1.61	0.10	0.11
query5	0.42	0.40	0.41
query6	1.17	0.66	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.58	0.51	0.50
query10	0.55	0.58	0.55
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.60	0.60
query14	2.87	2.73	2.72
query15	0.89	0.83	0.83
query16	0.38	0.38	0.38
query17	1.02	1.06	1.00
query18	0.22	0.21	0.20
query19	1.90	1.83	2.02
query20	0.01	0.01	0.01
query21	15.37	0.58	0.59
query22	2.98	1.83	2.84
query23	17.35	0.98	0.76
query24	3.55	1.70	1.27
query25	0.20	0.10	0.07
query26	0.61	0.14	0.13
query27	0.05	0.03	0.04
query28	9.88	1.09	1.08
query29	12.61	3.22	3.25
query30	0.25	0.06	0.06
query31	2.87	0.40	0.38
query32	3.26	0.48	0.45
query33	3.05	3.10	3.18
query34	16.86	4.48	4.49
query35	4.50	4.46	4.50
query36	0.65	0.49	0.48
query37	0.10	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.03	0.02
query40	0.17	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 107.45 s
Total hot run time: 32.84 s

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32670 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f033662aa968c16724c008f46eccb80f2c1083f3, data reload: false

------ Round 1 ----------------------------------
q1	17615	6200	6031	6031
q2	2045	307	177	177
q3	10412	1299	740	740
q4	10215	881	436	436
q5	7535	2224	2007	2007
q6	202	179	147	147
q7	916	753	616	616
q8	9251	1383	1185	1185
q9	5303	4957	4884	4884
q10	6752	2322	1869	1869
q11	472	284	260	260
q12	341	365	218	218
q13	17768	3637	2992	2992
q14	252	237	224	224
q15	566	504	494	494
q16	620	625	581	581
q17	588	855	331	331
q18	7391	6688	6489	6489
q19	2130	988	554	554
q20	301	309	181	181
q21	2866	2195	1945	1945
q22	361	329	309	309
Total cold run time: 103902 ms
Total hot run time: 32670 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6323	6247	6237	6237
q2	241	331	229	229
q3	2266	2664	2310	2310
q4	1413	1846	1344	1344
q5	4339	4776	4901	4776
q6	192	183	145	145
q7	2109	2021	1831	1831
q8	2638	2818	2697	2697
q9	7414	7254	7363	7254
q10	3081	3325	2820	2820
q11	588	518	496	496
q12	702	769	599	599
q13	3379	3690	3131	3131
q14	291	312	288	288
q15	565	512	498	498
q16	666	699	633	633
q17	1227	1760	1251	1251
q18	7741	7592	7125	7125
q19	799	1112	1042	1042
q20	1922	2030	1861	1861
q21	5515	5037	4958	4958
q22	619	593	565	565
Total cold run time: 54030 ms
Total hot run time: 52090 ms

@justfortaste justfortaste mentioned this pull request Dec 24, 2024
Open
16 tasks
@doris-robot
Copy link

TPC-DS: Total hot run time: 191266 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f033662aa968c16724c008f46eccb80f2c1083f3, data reload: false

query1	969	379	380	379
query2	6519	2495	2460	2460
query3	6704	217	226	217
query4	33600	23677	23623	23623
query5	4395	630	488	488
query6	292	216	189	189
query7	4627	494	313	313
query8	320	265	250	250
query9	9382	2725	2712	2712
query10	481	311	261	261
query11	18552	15585	15247	15247
query12	171	107	103	103
query13	1672	567	429	429
query14	10541	7210	7144	7144
query15	228	199	187	187
query16	7906	615	432	432
query17	1581	725	552	552
query18	2053	402	297	297
query19	221	180	168	168
query20	117	115	116	115
query21	207	125	106	106
query22	4432	4393	4112	4112
query23	34501	33636	33535	33535
query24	6411	2284	2357	2284
query25	488	456	398	398
query26	1221	277	150	150
query27	2235	467	331	331
query28	5297	2473	2424	2424
query29	677	546	410	410
query30	231	182	148	148
query31	1018	907	814	814
query32	70	64	61	61
query33	559	347	299	299
query34	776	835	507	507
query35	797	839	738	738
query36	982	1073	959	959
query37	124	105	76	76
query38	4463	4423	4108	4108
query39	1511	1455	1440	1440
query40	206	111	98	98
query41	49	45	48	45
query42	126	102	104	102
query43	532	529	517	517
query44	1367	813	817	813
query45	184	175	177	175
query46	862	1046	650	650
query47	1928	1902	1867	1867
query48	386	406	318	318
query49	776	474	396	396
query50	638	664	407	407
query51	7151	7257	7154	7154
query52	98	104	93	93
query53	229	252	186	186
query54	489	496	409	409
query55	85	86	126	86
query56	269	269	240	240
query57	1205	1212	1140	1140
query58	234	222	233	222
query59	3149	3203	2987	2987
query60	272	263	265	263
query61	111	110	133	110
query62	882	793	775	775
query63	236	194	198	194
query64	4138	996	662	662
query65	3329	3230	3290	3230
query66	1038	418	312	312
query67	16034	15869	15477	15477
query68	7403	794	518	518
query69	456	288	259	259
query70	1221	1155	1146	1146
query71	444	299	250	250
query72	5721	3837	3931	3837
query73	667	743	366	366
query74	9830	9132	9076	9076
query75	3991	3148	2645	2645
query76	3690	1200	766	766
query77	766	374	276	276
query78	10099	10259	9413	9413
query79	3798	903	585	585
query80	741	520	448	448
query81	504	268	236	236
query82	663	149	127	127
query83	201	169	143	143
query84	289	94	75	75
query85	782	353	308	308
query86	403	328	307	307
query87	4724	4490	4468	4468
query88	4844	2221	2210	2210
query89	406	339	327	327
query90	1832	191	192	191
query91	145	133	107	107
query92	66	58	59	58
query93	1955	903	538	538
query94	659	384	287	287
query95	343	271	269	269
query96	496	618	281	281
query97	2711	2776	2720	2720
query98	225	206	195	195
query99	1694	1534	1440	1440
Total cold run time: 294103 ms
Total hot run time: 191266 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.82 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f033662aa968c16724c008f46eccb80f2c1083f3, data reload: false

query1	0.03	0.04	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.60	0.11	0.11
query5	0.41	0.39	0.40
query6	1.18	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.58	0.51	0.50
query10	0.56	0.57	0.56
query11	0.15	0.12	0.11
query12	0.14	0.11	0.11
query13	0.60	0.60	0.59
query14	2.80	2.86	2.78
query15	0.90	0.82	0.83
query16	0.39	0.39	0.39
query17	1.06	1.04	1.03
query18	0.23	0.22	0.21
query19	1.95	1.78	2.01
query20	0.01	0.01	0.01
query21	15.36	0.92	0.59
query22	0.74	0.82	0.71
query23	15.22	1.43	0.52
query24	2.62	1.37	1.94
query25	0.20	0.22	0.06
query26	0.19	0.15	0.13
query27	0.05	0.05	0.04
query28	14.23	1.50	1.04
query29	12.60	3.94	3.24
query30	0.25	0.09	0.07
query31	2.81	0.60	0.39
query32	3.22	0.55	0.47
query33	3.08	3.11	3.12
query34	16.90	5.18	4.54
query35	4.52	4.55	4.54
query36	0.67	0.50	0.48
query37	0.10	0.06	0.05
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.15	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.04
Total cold run time: 106.09 s
Total hot run time: 31.82 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.79% (10095/26022)
Line Coverage: 29.78% (85181/286002)
Region Coverage: 28.90% (43487/150484)
Branch Coverage: 25.44% (22173/87170)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f033662aa968c16724c008f46eccb80f2c1083f3_f033662aa968c16724c008f46eccb80f2c1083f3/report/index.html

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32715 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7e874e4dda7a99c7f31f3d7766aed4c811596238, data reload: false

------ Round 1 ----------------------------------
q1	17948	6198	6098	6098
q2	2052	315	165	165
q3	10622	1326	729	729
q4	10241	882	437	437
q5	8073	2224	1978	1978
q6	207	179	148	148
q7	904	737	614	614
q8	9243	1377	1179	1179
q9	5344	4996	4987	4987
q10	6773	2316	1867	1867
q11	462	277	251	251
q12	351	366	223	223
q13	17776	3554	2982	2982
q14	240	246	208	208
q15	572	505	496	496
q16	646	626	578	578
q17	577	847	324	324
q18	7328	6703	6406	6406
q19	1825	966	563	563
q20	317	316	182	182
q21	2926	2193	1994	1994
q22	364	331	306	306
Total cold run time: 104791 ms
Total hot run time: 32715 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6270	6232	6221	6221
q2	231	326	229	229
q3	2299	2629	2356	2356
q4	1421	1813	1382	1382
q5	4364	4799	5009	4799
q6	180	179	141	141
q7	2115	1936	1788	1788
q8	2641	2780	2697	2697
q9	7456	7343	7300	7300
q10	3048	3334	2840	2840
q11	567	523	513	513
q12	682	739	616	616
q13	3420	3711	3077	3077
q14	307	330	287	287
q15	556	511	497	497
q16	647	708	654	654
q17	1200	1735	1277	1277
q18	7811	7425	7114	7114
q19	800	1160	1021	1021
q20	1941	1933	1864	1864
q21	5433	5214	4973	4973
q22	623	661	585	585
Total cold run time: 54012 ms
Total hot run time: 52231 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.80% (10096/26023)
Line Coverage: 29.80% (85241/286039)
Region Coverage: 28.92% (43522/150504)
Branch Coverage: 25.45% (22187/87168)
Coverage Report: http://coverage.selectdb-in.cc/coverage/7e874e4dda7a99c7f31f3d7766aed4c811596238_7e874e4dda7a99c7f31f3d7766aed4c811596238/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 190564 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7e874e4dda7a99c7f31f3d7766aed4c811596238, data reload: false

query1	975	379	380	379
query2	6518	2382	2295	2295
query3	6710	228	219	219
query4	34083	23648	23300	23300
query5	4307	612	452	452
query6	299	209	214	209
query7	4624	487	318	318
query8	290	238	231	231
query9	9696	2702	2699	2699
query10	462	304	237	237
query11	17925	15283	15380	15283
query12	155	111	103	103
query13	1665	534	392	392
query14	10351	7149	7675	7149
query15	252	194	196	194
query16	8063	651	454	454
query17	1565	760	577	577
query18	2102	410	298	298
query19	236	177	158	158
query20	118	115	115	115
query21	210	126	109	109
query22	4403	4590	4220	4220
query23	34513	33438	33527	33438
query24	6577	2360	2283	2283
query25	469	434	379	379
query26	1202	283	154	154
query27	1962	454	329	329
query28	5399	2441	2415	2415
query29	711	538	405	405
query30	227	192	160	160
query31	992	862	803	803
query32	84	61	56	56
query33	540	346	289	289
query34	759	853	508	508
query35	834	816	747	747
query36	1003	1028	988	988
query37	112	97	72	72
query38	4161	4343	4095	4095
query39	1540	1471	1464	1464
query40	213	125	101	101
query41	47	46	47	46
query42	120	106	104	104
query43	524	532	478	478
query44	1292	825	807	807
query45	188	172	175	172
query46	865	1038	635	635
query47	1952	1950	1885	1885
query48	366	409	333	333
query49	771	480	391	391
query50	629	672	384	384
query51	7118	7239	7045	7045
query52	97	100	91	91
query53	223	249	187	187
query54	464	470	396	396
query55	82	85	79	79
query56	257	274	231	231
query57	1186	1178	1107	1107
query58	239	223	232	223
query59	2954	3089	2988	2988
query60	306	261	243	243
query61	107	103	105	103
query62	879	764	730	730
query63	241	194	203	194
query64	4315	1012	644	644
query65	3314	3215	3261	3215
query66	1013	420	314	314
query67	15831	15910	15573	15573
query68	8998	757	507	507
query69	461	290	292	290
query70	1237	1170	1059	1059
query71	434	285	252	252
query72	5758	3808	3811	3808
query73	664	755	360	360
query74	10477	9098	9237	9098
query75	4583	3165	2658	2658
query76	5211	1194	777	777
query77	928	372	270	270
query78	10248	10353	9579	9579
query79	3285	897	578	578
query80	745	583	418	418
query81	471	266	232	232
query82	612	146	123	123
query83	199	167	148	148
query84	294	90	69	69
query85	777	356	306	306
query86	359	331	301	301
query87	4445	4631	4486	4486
query88	3905	2247	2246	2246
query89	419	341	298	298
query90	1869	189	186	186
query91	133	131	105	105
query92	70	57	54	54
query93	1130	861	527	527
query94	656	382	282	282
query95	330	258	244	244
query96	482	609	276	276
query97	2748	2833	2704	2704
query98	225	208	202	202
query99	1726	1610	1446	1446
Total cold run time: 295566 ms
Total hot run time: 190564 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.63 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7e874e4dda7a99c7f31f3d7766aed4c811596238, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.60	0.10	0.10
query5	0.43	0.41	0.41
query6	1.15	0.67	0.67
query7	0.02	0.02	0.01
query8	0.05	0.03	0.04
query9	0.60	0.51	0.52
query10	0.57	0.59	0.55
query11	0.15	0.11	0.11
query12	0.13	0.11	0.11
query13	0.61	0.60	0.59
query14	2.83	2.89	2.84
query15	0.89	0.83	0.81
query16	0.40	0.39	0.39
query17	1.04	1.01	1.07
query18	0.22	0.20	0.20
query19	2.00	1.89	2.00
query20	0.02	0.01	0.01
query21	15.39	0.95	0.59
query22	0.76	0.90	0.68
query23	15.18	1.43	0.50
query24	3.07	1.21	1.51
query25	0.17	0.15	0.06
query26	0.38	0.15	0.14
query27	0.06	0.05	0.04
query28	14.18	1.50	1.04
query29	12.61	3.90	3.26
query30	0.25	0.09	0.07
query31	2.82	0.61	0.39
query32	3.24	0.56	0.47
query33	3.08	3.06	3.14
query34	16.93	5.20	4.48
query35	4.58	4.47	4.50
query36	0.64	0.50	0.50
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.12
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.91 s
Total hot run time: 31.63 s

@justfortaste
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33038 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 35a6e6fb983e0eb29d42e5c4b131b531e3211199, data reload: false

------ Round 1 ----------------------------------
q1	17588	6245	6083	6083
q2	2050	321	179	179
q3	10459	2465	768	768
q4	10223	887	462	462
q5	7547	2226	1986	1986
q6	206	181	149	149
q7	901	744	612	612
q8	9240	1378	1185	1185
q9	5328	4948	5001	4948
q10	6774	2312	1866	1866
q11	505	280	258	258
q12	349	362	230	230
q13	17773	3638	3043	3043
q14	229	235	210	210
q15	573	515	498	498
q16	644	610	586	586
q17	604	863	339	339
q18	7117	6524	6519	6519
q19	2590	979	575	575
q20	300	311	187	187
q21	2982	2254	2038	2038
q22	364	340	317	317
Total cold run time: 104346 ms
Total hot run time: 33038 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6389	6293	6339	6293
q2	232	325	228	228
q3	2275	2673	2337	2337
q4	1461	1918	1384	1384
q5	4367	4784	4740	4740
q6	181	176	141	141
q7	1990	1879	1731	1731
q8	2538	2689	2663	2663
q9	7046	6926	6924	6924
q10	2971	3223	2730	2730
q11	603	518	509	509
q12	661	719	614	614
q13	3294	3632	3012	3012
q14	269	279	258	258
q15	574	508	495	495
q16	636	664	664	664
q17	1199	1717	1228	1228
q18	7393	7249	6954	6954
q19	826	1147	1094	1094
q20	1919	1987	1854	1854
q21	5603	5178	4910	4910
q22	597	589	590	589
Total cold run time: 53024 ms
Total hot run time: 51352 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190559 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 35a6e6fb983e0eb29d42e5c4b131b531e3211199, data reload: false

query1	970	398	369	369
query2	6527	2388	2296	2296
query3	6720	215	217	215
query4	33959	23548	23401	23401
query5	4354	616	461	461
query6	299	208	200	200
query7	4623	520	309	309
query8	310	273	247	247
query9	9582	2742	2715	2715
query10	476	325	235	235
query11	18338	15366	15630	15366
query12	160	103	110	103
query13	1663	540	397	397
query14	12033	6930	7086	6930
query15	238	184	177	177
query16	8008	590	399	399
query17	1549	731	549	549
query18	2094	398	298	298
query19	209	205	149	149
query20	119	113	106	106
query21	207	120	101	101
query22	4406	4352	4497	4352
query23	34659	33473	33593	33473
query24	6056	2294	2256	2256
query25	502	443	401	401
query26	1198	275	152	152
query27	2004	454	338	338
query28	5426	2453	2418	2418
query29	732	550	409	409
query30	223	183	150	150
query31	1002	923	820	820
query32	78	62	63	62
query33	521	370	302	302
query34	761	821	522	522
query35	787	807	761	761
query36	1003	1051	916	916
query37	111	105	85	85
query38	4248	4263	4314	4263
query39	1488	1442	1414	1414
query40	212	113	102	102
query41	51	50	47	47
query42	120	105	108	105
query43	530	539	504	504
query44	1317	821	837	821
query45	187	176	175	175
query46	866	1044	663	663
query47	1918	1937	1856	1856
query48	390	403	321	321
query49	769	470	381	381
query50	630	644	389	389
query51	7183	7149	7077	7077
query52	100	99	87	87
query53	223	258	181	181
query54	485	490	394	394
query55	83	79	83	79
query56	257	266	239	239
query57	1240	1206	1154	1154
query58	229	221	226	221
query59	3205	3161	3016	3016
query60	268	260	243	243
query61	148	102	113	102
query62	880	785	755	755
query63	232	186	197	186
query64	4415	988	654	654
query65	3290	3212	3219	3212
query66	1053	423	308	308
query67	16199	15961	15610	15610
query68	9027	777	521	521
query69	461	286	250	250
query70	1239	1156	1210	1156
query71	445	281	249	249
query72	5922	3839	3868	3839
query73	659	741	369	369
query74	10592	8992	9273	8992
query75	4685	3194	2671	2671
query76	4869	1176	789	789
query77	977	374	289	289
query78	10196	10278	9407	9407
query79	3055	913	599	599
query80	696	512	422	422
query81	480	275	279	275
query82	655	148	121	121
query83	196	168	143	143
query84	278	94	72	72
query85	787	352	300	300
query86	353	313	281	281
query87	4570	4411	4354	4354
query88	3717	2205	2154	2154
query89	401	330	294	294
query90	1898	189	188	188
query91	142	135	104	104
query92	65	56	53	53
query93	1054	921	542	542
query94	656	385	284	284
query95	321	253	255	253
query96	488	598	275	275
query97	2795	2833	2705	2705
query98	223	208	196	196
query99	1684	1587	1413	1413
Total cold run time: 297709 ms
Total hot run time: 190559 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.44 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 35a6e6fb983e0eb29d42e5c4b131b531e3211199, data reload: false

query1	0.04	0.05	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.10	0.11
query5	0.40	0.40	0.42
query6	1.15	0.66	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.56	0.52	0.51
query10	0.56	0.59	0.56
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.60	0.61	0.60
query14	2.82	2.83	2.85
query15	0.91	0.82	0.82
query16	0.38	0.38	0.37
query17	1.02	1.04	1.02
query18	0.23	0.21	0.22
query19	1.97	1.87	1.98
query20	0.01	0.01	0.02
query21	15.37	0.95	0.56
query22	0.76	0.94	0.61
query23	15.25	1.48	0.53
query24	3.14	1.48	1.09
query25	0.18	0.15	0.07
query26	0.32	0.15	0.14
query27	0.06	0.04	0.05
query28	13.94	1.52	1.05
query29	12.58	3.93	3.29
query30	0.25	0.09	0.06
query31	2.84	0.59	0.37
query32	3.23	0.54	0.46
query33	3.04	3.07	3.08
query34	16.76	5.18	4.50
query35	4.54	4.50	4.54
query36	0.66	0.48	0.48
query37	0.10	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.33 s
Total hot run time: 31.44 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.79% (10095/26022)
Line Coverage: 29.80% (85241/286047)
Region Coverage: 28.92% (43520/150506)
Branch Coverage: 25.45% (22186/87170)
Coverage Report: http://coverage.selectdb-in.cc/coverage/35a6e6fb983e0eb29d42e5c4b131b531e3211199_35a6e6fb983e0eb29d42e5c4b131b531e3211199/report/index.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lide-reed lide-reed lide-reed approved these changes

@xy720 xy720 xy720 approved these changes

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@justfortaste @Thearas @xy720 @doris-robot @lide-reed