Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](mem leak) fe non_heap mem leak while use jdbc catalog #45806

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[fix](mem leak) fe non_heap mem leak while use jdbc catalog #45806

wants to merge 1 commit into from
+11 −3

Conversation

cambyzju
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #45609

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@cambyzju
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40188 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 53c5ceac9f55cf00e0e935ee534e150f03368cbc, data reload: false

------ Round 1 ----------------------------------
q1	17633	7459	7266	7266
q2	2068	186	182	182
q3	10527	1166	1175	1166
q4	10212	717	735	717
q5	7607	2716	2742	2716
q6	236	152	153	152
q7	1007	624	603	603
q8	9234	1892	1932	1892
q9	6753	6537	6418	6418
q10	7084	2345	2288	2288
q11	464	261	272	261
q12	520	224	224	224
q13	17798	2992	3011	2992
q14	247	223	222	222
q15	551	496	506	496
q16	665	606	593	593
q17	984	552	586	552
q18	7439	6726	6866	6726
q19	1356	1050	1020	1020
q20	470	187	179	179
q21	4069	3213	3424	3213
q22	369	310	314	310
Total cold run time: 107293 ms
Total hot run time: 40188 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7243	7237	7216	7216
q2	332	235	231	231
q3	2947	2766	2836	2766
q4	2014	1806	1694	1694
q5	5385	5452	5454	5452
q6	215	141	140	140
q7	2156	1726	1709	1709
q8	3274	3401	3421	3401
q9	8606	8601	8710	8601
q10	3508	3485	3432	3432
q11	596	490	495	490
q12	791	606	572	572
q13	15455	3030	2986	2986
q14	285	270	280	270
q15	548	507	493	493
q16	672	644	634	634
q17	1801	1605	1556	1556
q18	7860	7361	7406	7361
q19	1699	1638	1502	1502
q20	2090	1857	1831	1831
q21	5488	5205	5128	5128
q22	654	566	596	566
Total cold run time: 73619 ms
Total hot run time: 58031 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191016 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 53c5ceac9f55cf00e0e935ee534e150f03368cbc, data reload: false

query1	989	399	381	381
query2	4261	2485	2478	2478
query3	6538	217	214	214
query4	33934	23508	23432	23432
query5	3362	490	469	469
query6	286	201	208	201
query7	4562	318	313	313
query8	299	242	238	238
query9	9302	2779	2790	2779
query10	475	258	256	256
query11	17986	15110	15166	15110
query12	159	101	103	101
query13	1653	431	437	431
query14	9335	6805	7617	6805
query15	266	181	183	181
query16	7328	435	432	432
query17	1773	606	589	589
query18	2040	306	331	306
query19	356	155	157	155
query20	118	115	114	114
query21	199	102	105	102
query22	4624	4314	4376	4314
query23	36744	33689	33647	33647
query24	10365	2442	2425	2425
query25	531	378	382	378
query26	953	168	157	157
query27	2581	337	332	332
query28	7559	2449	2487	2449
query29	657	410	408	408
query30	274	153	152	152
query31	1023	804	830	804
query32	77	57	66	57
query33	791	282	286	282
query34	1003	515	534	515
query35	880	742	750	742
query36	1111	947	952	947
query37	126	77	75	75
query38	4294	4238	4364	4238
query39	1487	1455	1401	1401
query40	256	107	103	103
query41	47	75	46	46
query42	119	99	97	97
query43	553	499	488	488
query44	1265	809	813	809
query45	183	164	169	164
query46	1150	716	742	716
query47	1944	1807	1849	1807
query48	422	332	328	328
query49	1067	385	377	377
query50	825	377	398	377
query51	7241	7059	7072	7059
query52	104	92	92	92
query53	276	186	184	184
query54	1102	434	407	407
query55	85	74	78	74
query56	252	254	242	242
query57	1216	1094	1126	1094
query58	238	219	229	219
query59	3156	3032	3051	3032
query60	283	241	243	241
query61	107	111	110	110
query62	879	659	687	659
query63	216	189	188	188
query64	4110	659	684	659
query65	3249	3206	3219	3206
query66	1116	312	301	301
query67	15985	15575	15608	15575
query68	5417	581	576	576
query69	439	247	250	247
query70	1183	1028	1111	1028
query71	390	258	246	246
query72	5902	4133	4117	4117
query73	816	374	376	374
query74	9816	8906	8905	8905
query75	3402	2643	2631	2631
query76	2964	1141	1070	1070
query77	659	299	312	299
query78	10290	9481	9436	9436
query79	2467	614	642	614
query80	1070	425	438	425
query81	533	239	234	234
query82	649	129	118	118
query83	255	150	145	145
query84	237	72	69	69
query85	1420	305	294	294
query86	418	305	312	305
query87	4691	4387	4365	4365
query88	4113	2252	2232	2232
query89	409	291	305	291
query90	2099	195	187	187
query91	138	106	102	102
query92	66	51	52	51
query93	1923	566	564	564
query94	1050	294	297	294
query95	355	254	281	254
query96	625	282	288	282
query97	2842	2684	2675	2675
query98	217	196	197	196
query99	1536	1326	1343	1326
Total cold run time: 296138 ms
Total hot run time: 191016 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.81 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 53c5ceac9f55cf00e0e935ee534e150f03368cbc, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.06	0.03
query3	0.23	0.07	0.07
query4	1.60	0.10	0.11
query5	0.42	0.39	0.42
query6	1.16	0.65	0.64
query7	0.02	0.01	0.01
query8	0.04	0.03	0.04
query9	0.57	0.52	0.48
query10	0.56	0.56	0.56
query11	0.15	0.10	0.10
query12	0.14	0.12	0.11
query13	0.60	0.61	0.58
query14	2.73	2.71	2.72
query15	0.90	0.83	0.82
query16	0.39	0.37	0.41
query17	1.00	0.95	1.05
query18	0.22	0.21	0.21
query19	1.81	1.83	2.04
query20	0.01	0.01	0.01
query21	15.38	0.60	0.59
query22	2.79	2.14	1.58
query23	17.09	0.95	0.87
query24	2.61	0.55	1.20
query25	0.12	0.14	0.18
query26	0.43	0.15	0.15
query27	0.04	0.05	0.04
query28	11.06	1.11	1.06
query29	12.63	3.25	3.22
query30	0.26	0.08	0.08
query31	2.84	0.39	0.40
query32	3.23	0.47	0.46
query33	3.10	3.02	3.17
query34	16.98	4.44	4.45
query35	4.48	4.40	4.46
query36	0.66	0.47	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.13	0.14
query41	0.09	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 106.87 s
Total hot run time: 31.81 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
dev/2.1.x dev/3.0.x
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Bug] FE memory leak
4 participants
@cambyzju @hello-stephen @doris-robot @morningman