Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [Opt](bvar) Add bvar counter for CALCULATE_DELETE_BITMAP task #46195 #46656

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Jan 8, 2025

Cherry-picked from #46195

Add bvar counter for CALCULATE_DELETE_BITMAP task
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Jan 8, 2025
@dataroaring dataroaring reopened this Jan 8, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40936 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 257574a176124031284de47e7344e76638fd77af, data reload: false

------ Round 1 ----------------------------------
q1	17992	7484	7326	7326
q2	2507	179	166	166
q3	11540	1136	1159	1136
q4	10226	753	688	688
q5	7732	2795	2857	2795
q6	231	150	146	146
q7	974	619	611	611
q8	9361	1953	1987	1953
q9	6655	6394	6424	6394
q10	6978	2316	2310	2310
q11	458	278	264	264
q12	411	203	208	203
q13	17778	2994	3017	2994
q14	247	205	208	205
q15	566	522	544	522
q16	680	589	614	589
q17	962	623	603	603
q18	7314	6742	6597	6597
q19	1391	1134	1144	1134
q20	476	206	201	201
q21	4041	3124	3198	3124
q22	1076	1012	975	975
Total cold run time: 109596 ms
Total hot run time: 40936 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7234	7182	7248	7182
q2	330	232	229	229
q3	3024	3024	2991	2991
q4	2075	1821	1843	1821
q5	5765	5728	5740	5728
q6	228	138	137	137
q7	2273	1815	1825	1815
q8	3350	3541	3498	3498
q9	8942	9002	8975	8975
q10	3588	3513	3544	3513
q11	610	514	511	511
q12	839	618	594	594
q13	10097	3141	3021	3021
q14	285	263	267	263
q15	566	510	510	510
q16	708	656	664	656
q17	1812	1575	1560	1560
q18	7779	7417	7567	7417
q19	1670	1398	1433	1398
q20	2056	1788	1795	1788
q21	5397	5230	5060	5060
q22	1098	972	991	972
Total cold run time: 69726 ms
Total hot run time: 59639 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192062 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 257574a176124031284de47e7344e76638fd77af, data reload: false

query1	967	379	363	363
query2	6514	2050	2076	2050
query3	6713	229	216	216
query4	34186	23631	23558	23558
query5	4387	458	487	458
query6	285	187	182	182
query7	4641	332	320	320
query8	294	231	227	227
query9	9550	2664	2635	2635
query10	482	263	266	263
query11	18177	15104	15137	15104
query12	164	107	101	101
query13	1652	445	412	412
query14	9583	7212	6956	6956
query15	252	182	186	182
query16	7946	497	482	482
query17	1651	583	559	559
query18	1945	327	336	327
query19	362	163	159	159
query20	115	109	111	109
query21	213	104	108	104
query22	4324	4428	4383	4383
query23	34893	34000	33994	33994
query24	11300	2855	2900	2855
query25	678	413	427	413
query26	1204	181	170	170
query27	2734	347	354	347
query28	7746	2450	2400	2400
query29	859	442	440	440
query30	324	170	172	170
query31	1041	805	814	805
query32	93	56	57	56
query33	774	273	291	273
query34	961	501	544	501
query35	859	723	703	703
query36	1079	960	932	932
query37	139	75	79	75
query38	3986	3863	3917	3863
query39	1486	1461	1587	1461
query40	196	97	106	97
query41	53	50	50	50
query42	110	101	101	101
query43	533	484	500	484
query44	1220	810	795	795
query45	180	169	172	169
query46	1140	711	706	706
query47	1893	1834	1841	1834
query48	476	392	405	392
query49	1152	377	391	377
query50	828	413	418	413
query51	7122	7014	7093	7014
query52	102	89	88	88
query53	263	183	188	183
query54	1102	462	451	451
query55	75	81	78	78
query56	261	250	259	250
query57	1226	1116	1083	1083
query58	243	209	211	209
query59	3289	3223	3150	3150
query60	290	259	251	251
query61	130	112	111	111
query62	881	665	671	665
query63	226	190	184	184
query64	4321	681	668	668
query65	3300	3198	3204	3198
query66	950	311	311	311
query67	15783	15673	15605	15605
query68	4074	570	573	570
query69	438	274	263	263
query70	1151	1137	1128	1128
query71	349	260	251	251
query72	6246	4078	4095	4078
query73	776	352	352	352
query74	10026	8887	8942	8887
query75	3407	2638	2612	2612
query76	2710	1044	1043	1043
query77	399	284	273	273
query78	10341	9565	9647	9565
query79	1304	603	600	600
query80	925	440	419	419
query81	542	237	236	236
query82	1286	122	121	121
query83	194	153	150	150
query84	240	78	94	78
query85	1159	307	292	292
query86	316	288	272	272
query87	4338	4285	4271	4271
query88	3619	2401	2361	2361
query89	406	291	300	291
query90	2051	190	184	184
query91	183	150	151	150
query92	62	51	60	51
query93	1068	556	547	547
query94	798	291	283	283
query95	362	257	262	257
query96	607	278	284	278
query97	3295	3189	3206	3189
query98	222	202	194	194
query99	1546	1341	1291	1291
Total cold run time: 296344 ms
Total hot run time: 192062 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 34 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 257574a176124031284de47e7344e76638fd77af, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.23	0.06	0.06
query4	1.63	0.10	0.11
query5	0.52	0.52	0.49
query6	1.13	0.74	0.73
query7	0.02	0.01	0.03
query8	0.04	0.04	0.02
query9	0.56	0.50	0.50
query10	0.55	0.54	0.55
query11	0.14	0.10	0.10
query12	0.15	0.12	0.11
query13	0.61	0.60	0.59
query14	3.06	3.07	2.95
query15	0.89	0.84	0.83
query16	0.39	0.36	0.38
query17	1.08	1.01	1.00
query18	0.24	0.22	0.21
query19	1.89	1.83	1.97
query20	0.02	0.01	0.01
query21	15.40	0.59	0.56
query22	3.17	1.90	2.16
query23	17.08	0.95	0.92
query24	3.49	1.89	2.21
query25	0.26	0.22	0.09
query26	0.62	0.15	0.14
query27	0.05	0.04	0.05
query28	8.90	1.11	1.08
query29	12.60	3.22	3.22
query30	0.25	0.06	0.05
query31	2.86	0.38	0.38
query32	3.25	0.46	0.47
query33	3.00	3.02	3.12
query34	16.89	4.50	4.44
query35	4.63	4.54	4.52
query36	0.68	0.51	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.86 s
Total hot run time: 34 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants