Introduction

This is a report for the insert benchmark with 80M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has is a c2d-standard-30 with HT off, 16 cores, 64G RAM, Ubuntu 22.04 and ext4 using SW RAID 0 and 2 NVMe devices. The benchmark was run with 8 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables with a table per client. It loads 10M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40m+10m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached by InnoDB. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
ma100618_rel_withdbg.cz11a_c24r64 4347839756118196759480602494874858905475705790046816
ma101108_rel_withdbg.cz11a_c24r64 3448289756117119039005589054780156366465095386146218
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64 3174609195416588435635599084810259036469795812345786
ma110402_rel_withdbg.cz11b_c24r64 3375539756116786838168592514808956684469405407246314
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64 3065139638576373234587595124811658806471055793745951
ma110501_rel_withdbg.cz11b_c24r64 3200009756116562837436571764530854949441655248843524
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64 3225819195416795534217576494548856843444105603443426
ma110600_rel_withdbg.cz11b_c24r64 3305789756116869938369573964532654857441715264843507
ma1106_240723_d8374262_ilwas.cz11b_c24r64 3076929411786484334889573424511356517440065568843018

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
ma100618_rel_withdbg.cz11a_c24r64 1.001.001.001.001.001.001.001.001.001.00
ma101108_rel_withdbg.cz11a_c24r64 0.791.000.870.660.980.980.960.980.930.99
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64 0.730.940.800.600.990.991.000.991.000.98
ma110402_rel_withdbg.cz11b_c24r64 0.781.000.830.640.980.990.960.990.930.99
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64 0.700.990.780.580.990.991.000.991.000.98
ma110501_rel_withdbg.cz11b_c24r64 0.741.000.800.630.950.930.930.930.910.93
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64 0.740.940.830.580.960.930.960.930.970.93
ma110600_rel_withdbg.cz11b_c24r64 0.761.000.840.650.950.930.930.930.910.93
ma1106_240723_d8374262_ilwas.cz11b_c24r64 0.710.960.790.590.950.930.960.930.960.92

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
ma100618_rel_withdbg.cz11a_c24r647967963980398079607965
ma101108_rel_withdbg.cz11a_c24r647967963980398079607960
ma1011_240723_c944cd6e_ilwas.cz11a_c24r647967963980398079657960
ma110402_rel_withdbg.cz11b_c24r647967963980398079607960
ma1104_240723_2ee061c2_ilwas.cz11b_c24r647967963980398279607960
ma110501_rel_withdbg.cz11b_c24r647967963980398079607960
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r647967963980398079607960
ma110600_rel_withdbg.cz11b_c24r647967963980398079607960
ma1106_240723_d8374262_ilwas.cz11b_c24r647967963980398079607960
target8008004000400080008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r6429.61770.1530.1900.0070.0020.0320.447
ma101108_rel_withdbg.cz11a_c24r647.95389.0222.9770.0150.0010.0320.446
ma1011_240723_c944cd6e_ilwas.cz11a_c24r648.70584.2986.9510.0140.0010.0320.430
ma110402_rel_withdbg.cz11b_c24r648.37988.1993.3750.0130.0010.0320.454
ma1104_240723_2ee061c2_ilwas.cz11b_c24r645.20988.0316.7110.0160.0010.0320.452
ma110501_rel_withdbg.cz11b_c24r645.68389.5974.6780.0090.0010.0320.456
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r648.38085.6045.9770.0050.0010.0320.378
ma110600_rel_withdbg.cz11b_c24r646.76989.4413.7460.0110.0010.0320.447
ma1106_240723_d8374262_ilwas.cz11b_c24r646.23686.5107.2110.0100.0010.0320.432

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
434783	0	0	0.0	1276.3	105.0	0.000	0.000	0.003	0.247	478073	60.5	1.100	22	5.3	56.1	6.1	0.447	59254	39670	ma100618_rel_withdbg.cz11a_c24r64
344828	0	0	0.0	1091.1	86.7	0.000	0.000	0.003	0.258	222418	48.1	0.645	22	5.3	56.1	5.7	0.446	45362	29876	ma101108_rel_withdbg.cz11a_c24r64
317460	0	0	0.0	1021.2	79.9	0.000	0.000	0.003	0.258	256255	52.6	0.807	27	5.3	56.1	6.0	0.430	40568	25872	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
337553	0	0	0.0	1072.9	84.8	0.000	0.000	0.003	0.257	246747	47.8	0.731	23	5.3	56.1	6.3	0.454	44253	29768	ma110402_rel_withdbg.cz11b_c24r64
306513	0	0	0.0	983.4	77.0	0.000	0.000	0.003	0.257	288857	52.0	0.942	27	5.3	56.1	5.8	0.452	39358	25872	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
320000	0	0	0.0	1023.7	80.8	0.000	0.000	0.003	0.259	246888	47.5	0.772	24	5.3	56.1	6.0	0.456	41655	28569	ma110501_rel_withdbg.cz11b_c24r64
322581	0	0	0.0	1041.6	81.7	0.000	0.000	0.003	0.259	263610	51.8	0.817	26	5.3	56.1	6.1	0.378	41855	28170	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
330578	0	0	0.0	1050.7	83.2	0.000	0.000	0.003	0.258	242485	47.4	0.734	23	5.3	56.1	6.2	0.447	42954	29369	ma110600_rel_withdbg.cz11b_c24r64
307692	0	0	0.0	990.7	78.2	0.000	0.000	0.003	0.260	292754	51.0	0.951	27	5.3	56.1	5.8	0.432	39657	27478	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
975611	0	0	0.0	4308.4	692.1	0.000	0.000	0.004	0.726	14322	25.9	0.015	4	11.2	62.1	10.0	0.001	NA	NA	ma100618_rel_withdbg.cz11a_c24r64
975611	0	0	0.0	3933.3	685.2	0.000	0.000	0.004	0.719	12374	27.0	0.013	4	11.2	62.1	9.7	0.001	NA	NA	ma101108_rel_withdbg.cz11a_c24r64
919541	0	0	0.0	4122.5	657.8	0.000	0.000	0.004	0.733	13243	27.4	0.014	5	11.2	62.1	9.5	0.001	NA	NA	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
975611	0	0	0.0	3850.4	684.9	0.000	0.000	0.004	0.719	12391	27.2	0.013	4	11.2	62.1	9.8	0.001	NA	NA	ma110402_rel_withdbg.cz11b_c24r64
963857	0	0	0.0	3988.1	687.1	0.000	0.000	0.004	0.730	12306	28.4	0.013	5	11.2	62.1	9.6	0.001	NA	NA	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
975611	0	0	0.0	3917.0	687.2	0.000	0.000	0.004	0.721	11971	27.1	0.012	4	11.2	62.1	9.9	0.002	NA	NA	ma110501_rel_withdbg.cz11b_c24r64
919541	0	0	0.0	4088.4	657.3	0.000	0.000	0.004	0.732	13478	27.6	0.015	5	11.2	62.1	9.9	0.002	NA	NA	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
975611	0	0	0.0	4076.8	688.9	0.000	0.000	0.004	0.723	12738	27.1	0.013	4	11.2	62.1	9.5	0.002	NA	NA	ma110600_rel_withdbg.cz11b_c24r64
941178	0	0	0.0	4133.9	659.5	0.000	0.000	0.004	0.718	13467	28.9	0.014	5	11.2	62.1	9.6	0.001	NA	NA	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.00838.92760.4800.5110.0260.0480.735
ma101108_rel_withdbg.cz11a_c24r640.00126.88071.9801.0850.0280.0260.728
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.00816.59382.6860.6500.0180.046nonzero1.061
ma110402_rel_withdbg.cz11b_c24r640.00121.29377.5651.0940.0210.0250.650
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.00715.25583.9690.7090.0190.0410.728
ma110501_rel_withdbg.cz11b_c24r640.00117.62381.1941.1380.0180.0250.650
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.00821.63277.6600.6420.0180.0390.707
ma110600_rel_withdbg.cz11b_c24r640.00122.68176.1731.0980.0210.0260.707
ma1106_240723_d8374262_ilwas.cz11b_c24r640.00616.05683.1820.6990.0200.0370.661

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.06058.05041.4590.3630.0250.0430.741
ma101108_rel_withdbg.cz11a_c24r640.02741.78557.2930.8510.0210.0230.728
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.06530.36069.0650.4490.0180.0430.771
ma110402_rel_withdbg.cz11b_c24r640.02132.97566.0930.8720.0170.0220.649
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.05021.54777.7580.5880.0180.0380.726
ma110501_rel_withdbg.cz11b_c24r640.02228.63570.4060.9010.0140.0220.649
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.07829.10870.2310.5280.0180.0370.710
ma110600_rel_withdbg.cz11b_c24r640.02835.34963.7130.8700.0170.0230.705
ma1106_240723_d8374262_ilwas.cz11b_c24r640.05523.05376.2620.5760.0180.0350.662

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
81967	0	0	0.0	8432.4	308.9	0.000	0.000	0.103	3.860	594816	73.4	7.257	143	17.0	69.4	19.7	0.735	10538	4595	ma100618_rel_withdbg.cz11a_c24r64
71190	0	2644	10.3	6714.8	260.8	0.037	0.149	0.094	3.752	295989	54.8	4.158	123	16.0	67.8	16.9	0.728	8990	5646	ma101108_rel_withdbg.cz11a_c24r64
65884	0	0	0.0	6990.8	251.0	0.000	0.000	0.106	3.901	338770	68.8	5.142	167	17.1	69.4	19.6	1.061	8392	3746	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
67868	0	2621	10.2	6568.3	251.5	0.039	0.154	0.097	3.794	314418	53.9	4.633	127	15.2	66.4	16.5	0.650	8590	5744	ma110402_rel_withdbg.cz11b_c24r64
63732	0	0	0.0	6841.5	250.4	0.000	0.000	0.107	4.023	356516	67.2	5.594	169	16.0	68.5	18.6	0.728	8141	4196	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
65628	0	2584	10.1	6351.6	243.2	0.039	0.157	0.097	3.794	318520	54.1	4.853	132	15.3	66.3	16.4	0.650	8291	5694	ma110501_rel_withdbg.cz11b_c24r64
67955	0	0	0.0	7399.6	268.4	0.000	0.000	0.109	4.044	346090	66.6	5.093	157	16.6	69.0	19.3	0.707	8641	4492	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
68699	0	2621	10.2	6604.0	253.2	0.038	0.153	0.096	3.774	309160	53.7	4.500	125	15.4	66.5	16.5	0.707	8691	5993	ma110600_rel_withdbg.cz11b_c24r64
64843	0	0	0.0	6805.3	249.8	0.000	0.000	0.105	3.946	367669	66.7	5.670	165	15.9	68.4	18.6	0.661	8241	4345	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r642.75988.8068.1470.2730.011nonzero0.0040.594
ma101108_rel_withdbg.cz11a_c24r640.32269.72429.6120.2830.055nonzero0.0040.512
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.49750.84748.3980.2380.016nonzero0.0040.543
ma110402_rel_withdbg.cz11b_c24r640.30667.27332.0870.2750.0540.0010.0040.503
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.51948.51450.7090.2490.0060.0040.532
ma110501_rel_withdbg.cz11b_c24r640.27264.51134.8840.2780.051nonzero0.0040.493
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.49547.48251.7620.2510.0050.0040.562
ma110600_rel_withdbg.cz11b_c24r640.29967.90831.4610.2760.052nonzero0.0040.488
ma1106_240723_d8374262_ilwas.cz11b_c24r640.51649.37649.8380.2600.0060.0040.442

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r643.32788.0758.3290.2550.010nonzero0.0040.593
ma101108_rel_withdbg.cz11a_c24r640.38669.97929.3090.2670.0550.0010.0040.512
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.70953.29445.7640.2130.015nonzero0.0040.543
ma110402_rel_withdbg.cz11b_c24r640.37467.37231.9340.2630.053nonzero0.0040.502
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.50748.42550.8240.2340.0050.0040.532
ma110501_rel_withdbg.cz11b_c24r640.33064.70034.6480.2660.051nonzero0.0040.492
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.50047.40751.8480.2370.0050.0040.562
ma110600_rel_withdbg.cz11b_c24r640.36468.01731.2990.2630.052nonzero0.0040.488
ma1106_240723_d8374262_ilwas.cz11b_c24r640.51749.40549.8210.2470.0060.0040.443

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
59480	0	0	0.0	5272.4	209.7	0.000	0.000	0.089	3.610	396907	70.4	6.673	189	17.0	69.4	19.8	0.594	7597	4860	ma100618_rel_withdbg.cz11a_c24r64
39005	0	3595	14.0	3578.5	142.7	0.092	0.369	0.092	3.747	274281	46.8	7.032	192	16.0	67.8	16.7	0.512	4935	3296	ma101108_rel_withdbg.cz11a_c24r64
35635	0	0	0.0	3311.3	131.8	0.000	0.000	0.093	3.787	480863	58.2	13.494	261	17.1	69.4	19.7	0.543	4507	3097	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
38168	0	3552	13.9	3523.6	139.9	0.093	0.372	0.092	3.753	279046	46.5	7.311	195	15.2	66.4	16.4	0.503	4824	3316	ma110402_rel_withdbg.cz11b_c24r64
34587	0	0	0.0	3137.6	125.1	0.000	0.000	0.091	3.703	476226	57.7	13.769	267	16.0	68.5	18.6	0.532	4351	3097	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
37436	0	3535	13.8	3451.9	137.3	0.094	0.378	0.092	3.755	286066	46.4	7.642	198	15.3	66.3	16.4	0.493	4731	3217	ma110501_rel_withdbg.cz11b_c24r64
34217	0	0	0.0	3095.6	123.6	0.000	0.000	0.090	3.700	476860	57.5	13.936	269	16.6	69.0	19.3	0.562	4295	2962	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
38369	0	3539	13.8	3532.0	140.5	0.092	0.369	0.092	3.751	275194	46.6	7.172	194	15.4	66.5	16.4	0.488	4855	3332	ma110600_rel_withdbg.cz11b_c24r64
34889	0	0	0.0	3165.7	126.2	0.000	0.000	0.091	3.705	475943	57.6	13.642	264	15.9	68.4	18.5	0.442	4385	3241	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r6499.9730.0260.0010.004
ma101108_rel_withdbg.cz11a_c24r6499.9670.0320.001nonzero0.006
ma1011_240723_c944cd6e_ilwas.cz11a_c24r6499.9770.0220.0010.004
ma110402_rel_withdbg.cz11b_c24r6499.9640.0340.002nonzero0.005
ma1104_240723_2ee061c2_ilwas.cz11b_c24r6499.9790.0200.001nonzero0.004
ma110501_rel_withdbg.cz11b_c24r6499.9600.0380.001nonzero0.004
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r6499.9690.0300.001nonzero0.004
ma110600_rel_withdbg.cz11b_c24r6499.9640.0340.002nonzero0.006
ma1106_240723_d8374262_ilwas.cz11b_c24r6499.9700.0290.001nonzero0.006

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.26798.7530.9790.012
ma101108_rel_withdbg.cz11a_c24r640.01480.56919.4170.008
ma1011_240723_c944cd6e_ilwas.cz11a_c24r641.47986.85111.6700.007
ma110402_rel_withdbg.cz11b_c24r640.00774.48325.5100.008
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.17495.2854.5420.007
ma110501_rel_withdbg.cz11b_c24r640.02464.73635.2400.010
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.02465.72634.2500.008
ma110600_rel_withdbg.cz11b_c24r640.13589.03110.8330.008
ma1106_240723_d8374262_ilwas.cz11b_c24r640.15676.96522.8780.009

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r647.13592.2330.6320.009
ma101108_rel_withdbg.cz11a_c24r640.33084.87214.7990.009
ma1011_240723_c944cd6e_ilwas.cz11a_c24r6410.78181.8757.3440.007
ma110402_rel_withdbg.cz11b_c24r640.27880.07619.6460.008
ma1104_240723_2ee061c2_ilwas.cz11b_c24r641.83395.6222.5450.008
ma110501_rel_withdbg.cz11b_c24r640.70171.27428.0240.009
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.30972.12527.5660.008
ma110600_rel_withdbg.cz11b_c24r641.05291.9107.0380.008
ma1106_240723_d8374262_ilwas.cz11b_c24r641.52180.67417.8060.008

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	60249	0	0.0	5.0	0.8	0.000	0.000	0.006	1.080	226620	50.5	3.761	134	17.0	69.4	19.4	0.004	7576	7352	ma100618_rel_withdbg.cz11a_c24r64
796	58905	22	0.1	5.0	0.9	0.000	0.001	0.006	1.100	220422	50.4	3.742	137	16.0	67.8	16.5	0.006	7464	7240	ma101108_rel_withdbg.cz11a_c24r64
796	59908	0	0.0	5.1	0.9	0.000	0.000	0.006	1.114	225518	50.5	3.764	135	17.1	69.4	19.3	0.004	7544	7306	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	59251	24	0.1	5.1	0.9	0.000	0.002	0.006	1.104	222354	50.5	3.753	136	15.2	66.4	16.3	0.005	7442	7192	ma110402_rel_withdbg.cz11b_c24r64
796	59512	0	0.0	5.1	0.9	0.000	0.000	0.006	1.104	223467	50.5	3.755	136	16.0	68.5	18.2	0.004	7464	7256	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	57176	24	0.1	5.1	0.9	0.000	0.002	0.006	1.101	213813	50.3	3.740	141	15.3	66.3	16.2	0.004	7208	6971	ma110501_rel_withdbg.cz11b_c24r64
796	57649	0	0.0	5.1	0.9	0.000	0.000	0.006	1.094	217156	50.6	3.767	140	16.6	69.0	18.9	0.004	7245	7051	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	57396	27	0.1	10.8	1.0	0.000	0.002	0.014	1.323	215367	50.4	3.752	140	15.4	66.5	16.3	0.006	7240	6971	ma110600_rel_withdbg.cz11b_c24r64
796	57342	0	0.0	5.1	0.9	0.000	0.000	0.006	1.103	216360	50.3	3.773	140	15.9	68.4	18.2	0.006	7211	6984	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r6499.3200.6740.0060.004
ma101108_rel_withdbg.cz11a_c24r6499.2760.7170.008nonzero0.004
ma1011_240723_c944cd6e_ilwas.cz11a_c24r6499.2540.7380.008nonzero0.007
ma110402_rel_withdbg.cz11b_c24r6499.2790.7130.0090.004
ma1104_240723_2ee061c2_ilwas.cz11b_c24r6499.2420.7500.008nonzero0.005
ma110501_rel_withdbg.cz11b_c24r6498.9081.0820.010nonzero0.008
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r6498.9511.0420.0080.004
ma110600_rel_withdbg.cz11b_c24r6498.9201.0710.009nonzero0.006
ma1106_240723_d8374262_ilwas.cz11b_c24r6498.9001.0910.009nonzero0.005

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.00395.6114.3850.006
ma101108_rel_withdbg.cz11a_c24r640.02877.04222.9310.008
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.01061.63938.3510.008
ma110402_rel_withdbg.cz11b_c24r640.12591.3758.5000.008
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.01771.94128.0420.008
ma110501_rel_withdbg.cz11b_c24r640.00781.18118.8120.007
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.42097.0662.5140.006
ma110600_rel_withdbg.cz11b_c24r6455.32344.6770.009
ma1106_240723_d8374262_ilwas.cz11b_c24r640.01494.0315.9550.006

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.42097.9341.6460.006
ma101108_rel_withdbg.cz11a_c24r640.37884.53115.0900.008
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.25072.79226.9580.007
ma110402_rel_withdbg.cz11b_c24r640.54594.4654.9900.013
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.36178.75720.8820.008
ma110501_rel_withdbg.cz11b_c24r640.20187.42712.3720.007
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r645.11893.4551.4270.007
ma110600_rel_withdbg.cz11b_c24r640.07362.78837.1390.009
ma1106_240723_d8374262_ilwas.cz11b_c24r641.40395.1743.4240.006

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	48748	0	0.0	10.4	1.0	0.000	0.000	0.013	1.292	190109	49.1	3.900	161	17.0	69.4	19.4	0.004	6121	5914	ma100618_rel_withdbg.cz11a_c24r64
796	47801	23	0.1	5.0	0.8	0.000	0.002	0.006	1.090	186157	48.9	3.894	164	16.0	67.8	16.5	0.004	6010	5802	ma101108_rel_withdbg.cz11a_c24r64
796	48102	0	0.0	10.6	1.0	0.000	0.000	0.013	1.327	187610	49.1	3.900	163	17.1	69.4	19.3	0.007	6042	5850	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	48089	23	0.1	10.8	1.0	0.000	0.002	0.014	1.323	186848	48.9	3.885	163	15.2	66.4	16.3	0.004	6042	5877	ma110402_rel_withdbg.cz11b_c24r64
796	48116	0	0.0	5.1	0.9	0.000	0.000	0.006	1.097	187351	48.9	3.894	163	16.0	68.5	18.2	0.005	6027	5850	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	45308	26	0.1	10.8	1.0	0.001	0.002	0.014	1.317	175789	48.8	3.880	172	15.3	66.3	16.2	0.008	5690	5532	ma110501_rel_withdbg.cz11b_c24r64
796	45488	0	0.0	5.1	0.9	0.000	0.000	0.006	1.098	176287	48.9	3.875	172	16.6	69.0	19.0	0.004	5706	5546	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	45326	23	0.1	10.8	1.0	0.001	0.002	0.014	1.317	176110	48.9	3.885	173	15.4	66.5	16.3	0.006	5676	5498	ma110600_rel_withdbg.cz11b_c24r64
796	45113	0	0.0	5.1	0.9	0.000	0.000	0.006	1.105	175033	48.9	3.880	173	15.9	68.4	18.2	0.005	5658	5498	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r6499.8010.1910.0060.002nonzero0.033
ma101108_rel_withdbg.cz11a_c24r6499.5360.4500.0120.002nonzero0.033
ma1011_240723_c944cd6e_ilwas.cz11a_c24r6499.8840.1090.0050.002nonzero0.033
ma110402_rel_withdbg.cz11b_c24r6499.5670.4210.012nonzerononzero0.016
ma1104_240723_2ee061c2_ilwas.cz11b_c24r6499.8810.1150.004nonzerononzero0.036
ma110501_rel_withdbg.cz11b_c24r6499.4760.5120.012nonzerononzero0.018
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r6499.8620.1340.005nonzero0.015
ma110600_rel_withdbg.cz11b_c24r6499.4990.4880.012nonzerononzero0.020
ma1106_240723_d8374262_ilwas.cz11b_c24r6499.8560.1390.004nonzerononzero0.022

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.40883.74215.8090.0420.034
ma101108_rel_withdbg.cz11a_c24r640.04456.17143.7420.0430.035
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.23551.90147.8080.0560.031
ma110402_rel_withdbg.cz11b_c24r640.02849.19050.7450.0360.052
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.16243.90555.8630.0710.045
ma110501_rel_withdbg.cz11b_c24r640.03343.53756.4050.0250.033
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.16047.46252.3240.0550.043
ma110600_rel_withdbg.cz11b_c24r640.04050.98748.9370.0360.043
ma1106_240723_d8374262_ilwas.cz11b_c24r640.13846.96952.8490.0440.029

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.76289.3199.8920.0270.030
ma101108_rel_withdbg.cz11a_c24r640.12866.67433.1700.0270.031
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.40161.57837.9880.0340.029
ma110402_rel_withdbg.cz11b_c24r640.11358.22741.6360.0240.027
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.22450.56449.1780.0350.027
ma110501_rel_withdbg.cz11b_c24r640.09752.96846.9220.0130.027
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.57654.24545.1430.0350.035
ma110600_rel_withdbg.cz11b_c24r640.13161.02038.8260.0220.028
ma1106_240723_d8374262_ilwas.cz11b_c24r640.24053.67746.0480.0350.029

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	58905	0	0.0	254.4	10.7	0.000	0.000	0.064	2.766	223244	51.9	3.790	141	17.0	69.4	19.4	0.033	7448	6920	ma100618_rel_withdbg.cz11a_c24r64
3980	56366	118	0.5	254.1	10.8	0.002	0.008	0.064	2.781	210830	51.4	3.740	146	16.0	67.8	16.6	0.033	7096	6553	ma101108_rel_withdbg.cz11a_c24r64
3980	59036	0	0.0	256.1	10.9	0.000	0.000	0.064	2.812	224361	52.4	3.800	142	17.1	69.4	19.4	0.033	7448	6953	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	56684	121	0.5	255.2	10.8	0.002	0.009	0.064	2.781	211942	51.5	3.739	145	15.2	66.4	16.3	0.016	7096	6660	ma110402_rel_withdbg.cz11b_c24r64
3980	58806	0	0.0	262.3	10.9	0.000	0.000	0.066	2.817	223787	52.4	3.806	143	16.0	68.5	18.3	0.036	7371	7128	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	54949	126	0.5	254.8	10.8	0.002	0.009	0.064	2.778	206497	51.5	3.758	150	15.3	66.3	16.3	0.018	6931	6507	ma110501_rel_withdbg.cz11b_c24r64
3980	56843	0	0.0	263.8	11.0	0.000	0.000	0.066	2.827	216011	52.4	3.800	147	16.6	69.0	19.0	0.015	7099	6873	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	54857	121	0.5	251.6	10.7	0.002	0.009	0.063	2.758	205239	51.6	3.741	151	15.4	66.5	16.3	0.020	6905	6441	ma110600_rel_withdbg.cz11b_c24r64
3980	56517	0	0.0	252.0	10.7	0.000	0.000	0.063	2.756	214904	52.3	3.802	148	15.9	68.4	18.3	0.022	7079	6809	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r6498.4281.5530.019nonzero0.011
ma101108_rel_withdbg.cz11a_c24r6498.3501.6280.021nonzero0.010
ma1011_240723_c944cd6e_ilwas.cz11a_c24r6498.2961.6870.017nonzero0.011
ma110402_rel_withdbg.cz11b_c24r6498.3591.6170.0240.0010.010
ma1104_240723_2ee061c2_ilwas.cz11b_c24r6498.2651.7160.019nonzero0.009
ma110501_rel_withdbg.cz11b_c24r6497.8002.1750.025nonzero0.012
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r6497.7072.2730.019nonzero0.009
ma110600_rel_withdbg.cz11b_c24r6497.8412.1340.0250.0010.010
ma1106_240723_d8374262_ilwas.cz11b_c24r6497.6642.3140.021nonzero0.009

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.45485.80813.6940.0440.027
ma101108_rel_withdbg.cz11a_c24r640.02852.99046.9420.0390.027
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.12540.11459.7080.0530.030
ma110402_rel_withdbg.cz11b_c24r640.01043.11956.8240.0470.030
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.09735.42964.4150.0590.032
ma110501_rel_withdbg.cz11b_c24r640.02945.72554.1910.0550.032
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.14842.80857.0030.0410.029
ma110600_rel_withdbg.cz11b_c24r640.03147.87852.0400.0510.040
ma1106_240723_d8374262_ilwas.cz11b_c24r640.08241.18758.7000.0310.037

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.65591.0998.2210.0260.027
ma101108_rel_withdbg.cz11a_c24r640.08464.67635.2060.0330.027
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.27950.26249.4280.0310.031
ma110402_rel_withdbg.cz11b_c24r640.05753.00146.9070.0350.028
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.10441.51358.3440.0400.035
ma110501_rel_withdbg.cz11b_c24r640.11255.70844.1390.0410.029
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.22649.10150.6350.0370.032
ma110600_rel_withdbg.cz11b_c24r640.09958.71041.1530.0380.033
ma1106_240723_d8374262_ilwas.cz11b_c24r640.16347.77952.0300.0280.029

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	47570	0	0.0	424.8	15.7	0.000	0.000	0.107	4.033	192140	50.4	4.039	170	17.0	69.4	19.4	0.011	5963	5770	ma100618_rel_withdbg.cz11a_c24r64
3980	46509	123	0.5	434.4	16.0	0.003	0.011	0.109	4.115	184627	50.1	3.970	172	16.0	67.8	16.6	0.010	5849	5645	ma101108_rel_withdbg.cz11a_c24r64
3980	46979	0	0.0	435.4	16.1	0.000	0.000	0.109	4.136	190537	50.5	4.056	172	17.1	69.4	19.4	0.011	5898	5705	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	46940	122	0.5	437.4	16.0	0.003	0.010	0.110	4.119	187350	50.2	3.991	171	15.2	66.4	16.3	0.010	5913	5722	ma110402_rel_withdbg.cz11b_c24r64
3982	47105	0	0.0	434.0	16.0	0.000	0.000	0.109	4.107	191650	50.5	4.069	172	16.0	68.5	18.2	0.009	5902	5706	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	44165	130	0.5	435.5	16.0	0.003	0.012	0.109	4.109	176514	50.0	3.997	181	15.3	66.3	16.3	0.012	5533	5369	ma110501_rel_withdbg.cz11b_c24r64
3980	44410	0	0.0	434.5	16.0	0.000	0.000	0.109	4.127	180086	50.3	4.055	181	16.6	69.0	18.9	0.009	5573	5386	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	44171	125	0.5	437.6	16.0	0.003	0.011	0.110	4.129	176056	49.9	3.986	181	15.4	66.5	16.3	0.010	5514	5340	ma110600_rel_withdbg.cz11b_c24r64
3980	44006	0	0.0	440.7	16.2	0.000	0.000	0.111	4.164	178653	50.3	4.060	183	15.9	68.4	18.2	0.009	5530	5370	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r6499.5720.4110.0120.005nonzero0.044
ma101108_rel_withdbg.cz11a_c24r6498.6411.3280.0240.006nonzero0.026
ma1011_240723_c944cd6e_ilwas.cz11a_c24r6499.7860.1980.0100.006nonzero0.051
ma110402_rel_withdbg.cz11b_c24r6498.6431.3310.0250.001nonzero0.019
ma1104_240723_2ee061c2_ilwas.cz11b_c24r6499.7730.2170.0090.001nonzero0.024
ma110501_rel_withdbg.cz11b_c24r6498.5061.4700.0230.001nonzero0.030
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r6499.7450.2450.0090.001nonzero0.052
ma110600_rel_withdbg.cz11b_c24r6498.5581.4150.0250.001nonzero0.022
ma1106_240723_d8374262_ilwas.cz11b_c24r6499.7250.2640.0100.001nonzero0.017

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.64480.62718.6730.0550.046
ma101108_rel_withdbg.cz11a_c24r640.05755.96943.8820.0920.059
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.86858.52540.4640.1430.062
ma110402_rel_withdbg.cz11b_c24r640.05751.55548.2680.1210.058
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.54453.93545.3390.1820.057
ma110501_rel_withdbg.cz11b_c24r640.05947.12552.7000.1160.050
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.55055.32443.9880.1380.061
ma110600_rel_withdbg.cz11b_c24r640.09952.34347.4330.1260.035
ma1106_240723_d8374262_ilwas.cz11b_c24r640.45555.29344.0850.1670.035

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r641.27786.06712.6220.0330.046
ma101108_rel_withdbg.cz11a_c24r640.26264.09935.5870.0520.057
ma1011_240723_c944cd6e_ilwas.cz11a_c24r642.36664.06633.4900.078nonzero0.064
ma110402_rel_withdbg.cz11b_c24r640.22858.29141.4030.0770.058
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.81057.94541.1130.1320.054
ma110501_rel_withdbg.cz11b_c24r640.24454.70144.9850.0690.051
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r641.26459.21039.4300.096nonzero0.065
ma110600_rel_withdbg.cz11b_c24r640.41560.26639.2430.0760.032
ma1106_240723_d8374262_ilwas.cz11b_c24r641.04859.09139.7400.1220.032

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	57900	0	0.0	543.1	22.2	0.000	0.000	0.068	2.862	223397	53.9	3.858	149	17.0	69.4	19.4	0.044	7320	6745	ma100618_rel_withdbg.cz11a_c24r64
7960	53861	254	1.0	669.0	26.2	0.005	0.019	0.084	3.372	210762	52.4	3.913	156	16.0	67.8	16.6	0.026	6763	6297	ma101108_rel_withdbg.cz11a_c24r64
7965	58123	0	0.0	685.4	26.8	0.000	0.000	0.086	3.442	223879	54.5	3.852	150	17.1	69.4	19.4	0.051	7336	6857	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	54072	262	1.0	675.3	26.3	0.005	0.019	0.085	3.386	211383	52.6	3.909	156	15.2	66.4	16.3	0.019	6777	6329	ma110402_rel_withdbg.cz11b_c24r64
7960	57937	0	0.0	655.5	25.8	0.000	0.000	0.082	3.317	223750	54.7	3.862	151	16.0	68.5	18.2	0.024	7304	7017	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	52488	269	1.1	668.5	26.1	0.005	0.021	0.084	3.361	206456	52.6	3.933	160	15.3	66.3	16.3	0.030	6585	6137	ma110501_rel_withdbg.cz11b_c24r64
7960	56034	0	0.0	671.2	26.2	0.000	0.000	0.084	3.377	216079	54.5	3.856	156	16.6	69.0	18.9	0.052	7048	6809	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	52648	263	1.0	674.5	26.3	0.005	0.020	0.085	3.386	205469	52.6	3.903	160	15.4	66.5	16.3	0.022	6585	6185	ma110600_rel_withdbg.cz11b_c24r64
7960	55688	0	0.0	668.5	26.2	0.000	0.000	0.084	3.370	215067	54.4	3.862	156	15.9	68.4	18.3	0.017	7016	6729	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r6497.7072.2660.027nonzerononzero0.027
ma101108_rel_withdbg.cz11a_c24r6498.1151.8550.030nonzero0.012
ma1011_240723_c944cd6e_ilwas.cz11a_c24r6497.2672.7100.023nonzerononzero0.020
ma110402_rel_withdbg.cz11b_c24r6497.8032.1640.033nonzerononzero0.018
ma1104_240723_2ee061c2_ilwas.cz11b_c24r6497.2322.7450.023nonzero0.009
ma110501_rel_withdbg.cz11b_c24r6497.1022.8610.037nonzerononzero0.017
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r6496.3833.5900.026nonzero0.012
ma110600_rel_withdbg.cz11b_c24r6497.0492.9160.035nonzero0.010
ma1106_240723_d8374262_ilwas.cz11b_c24r6496.2953.6780.026nonzero0.011

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.52381.64817.7820.0470.043
ma101108_rel_withdbg.cz11a_c24r640.04554.90644.9200.1290.041
ma1011_240723_c944cd6e_ilwas.cz11a_c24r640.39843.60855.8550.1390.048
ma110402_rel_withdbg.cz11b_c24r640.02649.76350.0700.1410.0010.072
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.25740.65158.9810.1110.035
ma110501_rel_withdbg.cz11b_c24r640.04146.02953.7830.1470.039
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.23940.55159.0990.1120.033
ma110600_rel_withdbg.cz11b_c24r640.04250.13549.7270.0970.033
ma1106_240723_d8374262_ilwas.cz11b_c24r640.18441.36558.3530.0990.049

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100618_rel_withdbg.cz11a_c24r640.97587.66011.3310.0340.036
ma101108_rel_withdbg.cz11a_c24r640.19263.36236.3740.0730.041
ma1011_240723_c944cd6e_ilwas.cz11a_c24r641.09549.72849.1000.0760.051
ma110402_rel_withdbg.cz11b_c24r640.13056.51743.2720.0810.063
ma1104_240723_2ee061c2_ilwas.cz11b_c24r640.54144.14555.2410.0730.035
ma110501_rel_withdbg.cz11b_c24r640.18053.41946.3040.0980.040
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r640.57344.18355.1720.0720.033
ma110600_rel_withdbg.cz11b_c24r640.15957.85041.9310.0600.032
ma1106_240723_d8374262_ilwas.cz11b_c24r640.57545.06654.2920.0660.052

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7965	46816	0	0.0	685.3	26.4	0.000	0.000	0.086	3.395	190538	52.1	4.070	178	17.0	69.4	19.4	0.027	5820	5626	ma100618_rel_withdbg.cz11a_c24r64
7960	46218	256	1.0	567.3	23.1	0.006	0.022	0.071	2.973	176452	52.2	3.818	181	16.0	67.8	16.6	0.012	5818	5530	ma101108_rel_withdbg.cz11a_c24r64
7960	45786	0	0.0	567.3	23.2	0.000	0.000	0.071	2.979	193394	52.4	4.224	183	17.1	69.4	19.4	0.020	5769	5530	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	46314	265	1.0	572.7	23.2	0.006	0.023	0.072	2.989	182315	52.1	3.937	180	15.2	66.4	16.3	0.018	5786	5562	ma110402_rel_withdbg.cz11b_c24r64
7960	45951	0	0.0	582.7	23.5	0.000	0.000	0.073	3.022	195246	52.4	4.249	182	16.0	68.5	18.2	0.009	5770	5546	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	43524	273	1.1	578.5	23.4	0.006	0.025	0.073	3.011	172501	52.0	3.963	191	15.3	66.3	16.3	0.017	5437	5226	ma110501_rel_withdbg.cz11b_c24r64
7960	43426	0	0.0	565.4	23.0	0.000	0.000	0.071	2.960	184611	52.3	4.251	193	16.6	69.0	18.9	0.012	5434	5244	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	43507	266	1.0	569.1	23.1	0.006	0.024	0.071	2.976	172368	51.8	3.962	190	15.4	66.5	16.4	0.010	5420	5226	ma110600_rel_withdbg.cz11b_c24r64
7960	43018	0	0.0	559.8	22.9	0.000	0.000	0.070	2.943	182798	52.1	4.249	194	15.9	68.4	18.3	0.011	5388	5194	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
434783	0	0	0.0	1276.3	105.0	0.000	0.000	0.003	0.247	478073	60.5	1.100	22	5.3	56.1	6.1	0.447	59254	39670	ma100618_rel_withdbg.cz11a_c24r64
344828	0	0	0.0	1091.1	86.7	0.000	0.000	0.003	0.258	222418	48.1	0.645	22	5.3	56.1	5.7	0.446	45362	29876	ma101108_rel_withdbg.cz11a_c24r64
317460	0	0	0.0	1021.2	79.9	0.000	0.000	0.003	0.258	256255	52.6	0.807	27	5.3	56.1	6.0	0.430	40568	25872	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
337553	0	0	0.0	1072.9	84.8	0.000	0.000	0.003	0.257	246747	47.8	0.731	23	5.3	56.1	6.3	0.454	44253	29768	ma110402_rel_withdbg.cz11b_c24r64
306513	0	0	0.0	983.4	77.0	0.000	0.000	0.003	0.257	288857	52.0	0.942	27	5.3	56.1	5.8	0.452	39358	25872	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
320000	0	0	0.0	1023.7	80.8	0.000	0.000	0.003	0.259	246888	47.5	0.772	24	5.3	56.1	6.0	0.456	41655	28569	ma110501_rel_withdbg.cz11b_c24r64
322581	0	0	0.0	1041.6	81.7	0.000	0.000	0.003	0.259	263610	51.8	0.817	26	5.3	56.1	6.1	0.378	41855	28170	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
330578	0	0	0.0	1050.7	83.2	0.000	0.000	0.003	0.258	242485	47.4	0.734	23	5.3	56.1	6.2	0.447	42954	29369	ma110600_rel_withdbg.cz11b_c24r64
307692	0	0	0.0	990.7	78.2	0.000	0.000	0.003	0.260	292754	51.0	0.951	27	5.3	56.1	5.8	0.432	39657	27478	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
975611	0	0	0.0	4308.4	692.1	0.000	0.000	0.004	0.726	14322	25.9	0.015	4	11.2	62.1	10.0	0.001	NA	NA	ma100618_rel_withdbg.cz11a_c24r64
975611	0	0	0.0	3933.3	685.2	0.000	0.000	0.004	0.719	12374	27.0	0.013	4	11.2	62.1	9.7	0.001	NA	NA	ma101108_rel_withdbg.cz11a_c24r64
919541	0	0	0.0	4122.5	657.8	0.000	0.000	0.004	0.733	13243	27.4	0.014	5	11.2	62.1	9.5	0.001	NA	NA	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
975611	0	0	0.0	3850.4	684.9	0.000	0.000	0.004	0.719	12391	27.2	0.013	4	11.2	62.1	9.8	0.001	NA	NA	ma110402_rel_withdbg.cz11b_c24r64
963857	0	0	0.0	3988.1	687.1	0.000	0.000	0.004	0.730	12306	28.4	0.013	5	11.2	62.1	9.6	0.001	NA	NA	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
975611	0	0	0.0	3917.0	687.2	0.000	0.000	0.004	0.721	11971	27.1	0.012	4	11.2	62.1	9.9	0.002	NA	NA	ma110501_rel_withdbg.cz11b_c24r64
919541	0	0	0.0	4088.4	657.3	0.000	0.000	0.004	0.732	13478	27.6	0.015	5	11.2	62.1	9.9	0.002	NA	NA	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
975611	0	0	0.0	4076.8	688.9	0.000	0.000	0.004	0.723	12738	27.1	0.013	4	11.2	62.1	9.5	0.002	NA	NA	ma110600_rel_withdbg.cz11b_c24r64
941178	0	0	0.0	4133.9	659.5	0.000	0.000	0.004	0.718	13467	28.9	0.014	5	11.2	62.1	9.6	0.001	NA	NA	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
81967	0	0	0.0	8432.4	308.9	0.000	0.000	0.103	3.860	594816	73.4	7.257	143	17.0	69.4	19.7	0.735	10538	4595	ma100618_rel_withdbg.cz11a_c24r64
71190	0	2644	10.3	6714.8	260.8	0.037	0.149	0.094	3.752	295989	54.8	4.158	123	16.0	67.8	16.9	0.728	8990	5646	ma101108_rel_withdbg.cz11a_c24r64
65884	0	0	0.0	6990.8	251.0	0.000	0.000	0.106	3.901	338770	68.8	5.142	167	17.1	69.4	19.6	1.061	8392	3746	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
67868	0	2621	10.2	6568.3	251.5	0.039	0.154	0.097	3.794	314418	53.9	4.633	127	15.2	66.4	16.5	0.650	8590	5744	ma110402_rel_withdbg.cz11b_c24r64
63732	0	0	0.0	6841.5	250.4	0.000	0.000	0.107	4.023	356516	67.2	5.594	169	16.0	68.5	18.6	0.728	8141	4196	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
65628	0	2584	10.1	6351.6	243.2	0.039	0.157	0.097	3.794	318520	54.1	4.853	132	15.3	66.3	16.4	0.650	8291	5694	ma110501_rel_withdbg.cz11b_c24r64
67955	0	0	0.0	7399.6	268.4	0.000	0.000	0.109	4.044	346090	66.6	5.093	157	16.6	69.0	19.3	0.707	8641	4492	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
68699	0	2621	10.2	6604.0	253.2	0.038	0.153	0.096	3.774	309160	53.7	4.500	125	15.4	66.5	16.5	0.707	8691	5993	ma110600_rel_withdbg.cz11b_c24r64
64843	0	0	0.0	6805.3	249.8	0.000	0.000	0.105	3.946	367669	66.7	5.670	165	15.9	68.4	18.6	0.661	8241	4345	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
59480	0	0	0.0	5272.4	209.7	0.000	0.000	0.089	3.610	396907	70.4	6.673	189	17.0	69.4	19.8	0.594	7597	4860	ma100618_rel_withdbg.cz11a_c24r64
39005	0	3595	14.0	3578.5	142.7	0.092	0.369	0.092	3.747	274281	46.8	7.032	192	16.0	67.8	16.7	0.512	4935	3296	ma101108_rel_withdbg.cz11a_c24r64
35635	0	0	0.0	3311.3	131.8	0.000	0.000	0.093	3.787	480863	58.2	13.494	261	17.1	69.4	19.7	0.543	4507	3097	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
38168	0	3552	13.9	3523.6	139.9	0.093	0.372	0.092	3.753	279046	46.5	7.311	195	15.2	66.4	16.4	0.503	4824	3316	ma110402_rel_withdbg.cz11b_c24r64
34587	0	0	0.0	3137.6	125.1	0.000	0.000	0.091	3.703	476226	57.7	13.769	267	16.0	68.5	18.6	0.532	4351	3097	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
37436	0	3535	13.8	3451.9	137.3	0.094	0.378	0.092	3.755	286066	46.4	7.642	198	15.3	66.3	16.4	0.493	4731	3217	ma110501_rel_withdbg.cz11b_c24r64
34217	0	0	0.0	3095.6	123.6	0.000	0.000	0.090	3.700	476860	57.5	13.936	269	16.6	69.0	19.3	0.562	4295	2962	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
38369	0	3539	13.8	3532.0	140.5	0.092	0.369	0.092	3.751	275194	46.6	7.172	194	15.4	66.5	16.4	0.488	4855	3332	ma110600_rel_withdbg.cz11b_c24r64
34889	0	0	0.0	3165.7	126.2	0.000	0.000	0.091	3.705	475943	57.6	13.642	264	15.9	68.4	18.5	0.442	4385	3241	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	60249	0	0.0	5.0	0.8	0.000	0.000	0.006	1.080	226620	50.5	3.761	134	17.0	69.4	19.4	0.004	7576	7352	ma100618_rel_withdbg.cz11a_c24r64
796	58905	22	0.1	5.0	0.9	0.000	0.001	0.006	1.100	220422	50.4	3.742	137	16.0	67.8	16.5	0.006	7464	7240	ma101108_rel_withdbg.cz11a_c24r64
796	59908	0	0.0	5.1	0.9	0.000	0.000	0.006	1.114	225518	50.5	3.764	135	17.1	69.4	19.3	0.004	7544	7306	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	59251	24	0.1	5.1	0.9	0.000	0.002	0.006	1.104	222354	50.5	3.753	136	15.2	66.4	16.3	0.005	7442	7192	ma110402_rel_withdbg.cz11b_c24r64
796	59512	0	0.0	5.1	0.9	0.000	0.000	0.006	1.104	223467	50.5	3.755	136	16.0	68.5	18.2	0.004	7464	7256	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	57176	24	0.1	5.1	0.9	0.000	0.002	0.006	1.101	213813	50.3	3.740	141	15.3	66.3	16.2	0.004	7208	6971	ma110501_rel_withdbg.cz11b_c24r64
796	57649	0	0.0	5.1	0.9	0.000	0.000	0.006	1.094	217156	50.6	3.767	140	16.6	69.0	18.9	0.004	7245	7051	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	57396	27	0.1	10.8	1.0	0.000	0.002	0.014	1.323	215367	50.4	3.752	140	15.4	66.5	16.3	0.006	7240	6971	ma110600_rel_withdbg.cz11b_c24r64
796	57342	0	0.0	5.1	0.9	0.000	0.000	0.006	1.103	216360	50.3	3.773	140	15.9	68.4	18.2	0.006	7211	6984	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	48748	0	0.0	10.4	1.0	0.000	0.000	0.013	1.292	190109	49.1	3.900	161	17.0	69.4	19.4	0.004	6121	5914	ma100618_rel_withdbg.cz11a_c24r64
796	47801	23	0.1	5.0	0.8	0.000	0.002	0.006	1.090	186157	48.9	3.894	164	16.0	67.8	16.5	0.004	6010	5802	ma101108_rel_withdbg.cz11a_c24r64
796	48102	0	0.0	10.6	1.0	0.000	0.000	0.013	1.327	187610	49.1	3.900	163	17.1	69.4	19.3	0.007	6042	5850	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	48089	23	0.1	10.8	1.0	0.000	0.002	0.014	1.323	186848	48.9	3.885	163	15.2	66.4	16.3	0.004	6042	5877	ma110402_rel_withdbg.cz11b_c24r64
796	48116	0	0.0	5.1	0.9	0.000	0.000	0.006	1.097	187351	48.9	3.894	163	16.0	68.5	18.2	0.005	6027	5850	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	45308	26	0.1	10.8	1.0	0.001	0.002	0.014	1.317	175789	48.8	3.880	172	15.3	66.3	16.2	0.008	5690	5532	ma110501_rel_withdbg.cz11b_c24r64
796	45488	0	0.0	5.1	0.9	0.000	0.000	0.006	1.098	176287	48.9	3.875	172	16.6	69.0	19.0	0.004	5706	5546	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	45326	23	0.1	10.8	1.0	0.001	0.002	0.014	1.317	176110	48.9	3.885	173	15.4	66.5	16.3	0.006	5676	5498	ma110600_rel_withdbg.cz11b_c24r64
796	45113	0	0.0	5.1	0.9	0.000	0.000	0.006	1.105	175033	48.9	3.880	173	15.9	68.4	18.2	0.005	5658	5498	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	58905	0	0.0	254.4	10.7	0.000	0.000	0.064	2.766	223244	51.9	3.790	141	17.0	69.4	19.4	0.033	7448	6920	ma100618_rel_withdbg.cz11a_c24r64
3980	56366	118	0.5	254.1	10.8	0.002	0.008	0.064	2.781	210830	51.4	3.740	146	16.0	67.8	16.6	0.033	7096	6553	ma101108_rel_withdbg.cz11a_c24r64
3980	59036	0	0.0	256.1	10.9	0.000	0.000	0.064	2.812	224361	52.4	3.800	142	17.1	69.4	19.4	0.033	7448	6953	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	56684	121	0.5	255.2	10.8	0.002	0.009	0.064	2.781	211942	51.5	3.739	145	15.2	66.4	16.3	0.016	7096	6660	ma110402_rel_withdbg.cz11b_c24r64
3980	58806	0	0.0	262.3	10.9	0.000	0.000	0.066	2.817	223787	52.4	3.806	143	16.0	68.5	18.3	0.036	7371	7128	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	54949	126	0.5	254.8	10.8	0.002	0.009	0.064	2.778	206497	51.5	3.758	150	15.3	66.3	16.3	0.018	6931	6507	ma110501_rel_withdbg.cz11b_c24r64
3980	56843	0	0.0	263.8	11.0	0.000	0.000	0.066	2.827	216011	52.4	3.800	147	16.6	69.0	19.0	0.015	7099	6873	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	54857	121	0.5	251.6	10.7	0.002	0.009	0.063	2.758	205239	51.6	3.741	151	15.4	66.5	16.3	0.020	6905	6441	ma110600_rel_withdbg.cz11b_c24r64
3980	56517	0	0.0	252.0	10.7	0.000	0.000	0.063	2.756	214904	52.3	3.802	148	15.9	68.4	18.3	0.022	7079	6809	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	47570	0	0.0	424.8	15.7	0.000	0.000	0.107	4.033	192140	50.4	4.039	170	17.0	69.4	19.4	0.011	5963	5770	ma100618_rel_withdbg.cz11a_c24r64
3980	46509	123	0.5	434.4	16.0	0.003	0.011	0.109	4.115	184627	50.1	3.970	172	16.0	67.8	16.6	0.010	5849	5645	ma101108_rel_withdbg.cz11a_c24r64
3980	46979	0	0.0	435.4	16.1	0.000	0.000	0.109	4.136	190537	50.5	4.056	172	17.1	69.4	19.4	0.011	5898	5705	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	46940	122	0.5	437.4	16.0	0.003	0.010	0.110	4.119	187350	50.2	3.991	171	15.2	66.4	16.3	0.010	5913	5722	ma110402_rel_withdbg.cz11b_c24r64
3982	47105	0	0.0	434.0	16.0	0.000	0.000	0.109	4.107	191650	50.5	4.069	172	16.0	68.5	18.2	0.009	5902	5706	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	44165	130	0.5	435.5	16.0	0.003	0.012	0.109	4.109	176514	50.0	3.997	181	15.3	66.3	16.3	0.012	5533	5369	ma110501_rel_withdbg.cz11b_c24r64
3980	44410	0	0.0	434.5	16.0	0.000	0.000	0.109	4.127	180086	50.3	4.055	181	16.6	69.0	18.9	0.009	5573	5386	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	44171	125	0.5	437.6	16.0	0.003	0.011	0.110	4.129	176056	49.9	3.986	181	15.4	66.5	16.3	0.010	5514	5340	ma110600_rel_withdbg.cz11b_c24r64
3980	44006	0	0.0	440.7	16.2	0.000	0.000	0.111	4.164	178653	50.3	4.060	183	15.9	68.4	18.2	0.009	5530	5370	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	57900	0	0.0	543.1	22.2	0.000	0.000	0.068	2.862	223397	53.9	3.858	149	17.0	69.4	19.4	0.044	7320	6745	ma100618_rel_withdbg.cz11a_c24r64
7960	53861	254	1.0	669.0	26.2	0.005	0.019	0.084	3.372	210762	52.4	3.913	156	16.0	67.8	16.6	0.026	6763	6297	ma101108_rel_withdbg.cz11a_c24r64
7965	58123	0	0.0	685.4	26.8	0.000	0.000	0.086	3.442	223879	54.5	3.852	150	17.1	69.4	19.4	0.051	7336	6857	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	54072	262	1.0	675.3	26.3	0.005	0.019	0.085	3.386	211383	52.6	3.909	156	15.2	66.4	16.3	0.019	6777	6329	ma110402_rel_withdbg.cz11b_c24r64
7960	57937	0	0.0	655.5	25.8	0.000	0.000	0.082	3.317	223750	54.7	3.862	151	16.0	68.5	18.2	0.024	7304	7017	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	52488	269	1.1	668.5	26.1	0.005	0.021	0.084	3.361	206456	52.6	3.933	160	15.3	66.3	16.3	0.030	6585	6137	ma110501_rel_withdbg.cz11b_c24r64
7960	56034	0	0.0	671.2	26.2	0.000	0.000	0.084	3.377	216079	54.5	3.856	156	16.6	69.0	18.9	0.052	7048	6809	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	52648	263	1.0	674.5	26.3	0.005	0.020	0.085	3.386	205469	52.6	3.903	160	15.4	66.5	16.3	0.022	6585	6185	ma110600_rel_withdbg.cz11b_c24r64
7960	55688	0	0.0	668.5	26.2	0.000	0.000	0.084	3.370	215067	54.4	3.862	156	15.9	68.4	18.3	0.017	7016	6729	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7965	46816	0	0.0	685.3	26.4	0.000	0.000	0.086	3.395	190538	52.1	4.070	178	17.0	69.4	19.4	0.027	5820	5626	ma100618_rel_withdbg.cz11a_c24r64
7960	46218	256	1.0	567.3	23.1	0.006	0.022	0.071	2.973	176452	52.2	3.818	181	16.0	67.8	16.6	0.012	5818	5530	ma101108_rel_withdbg.cz11a_c24r64
7960	45786	0	0.0	567.3	23.2	0.000	0.000	0.071	2.979	193394	52.4	4.224	183	17.1	69.4	19.4	0.020	5769	5530	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	46314	265	1.0	572.7	23.2	0.006	0.023	0.072	2.989	182315	52.1	3.937	180	15.2	66.4	16.3	0.018	5786	5562	ma110402_rel_withdbg.cz11b_c24r64
7960	45951	0	0.0	582.7	23.5	0.000	0.000	0.073	3.022	195246	52.4	4.249	182	16.0	68.5	18.2	0.009	5770	5546	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	43524	273	1.1	578.5	23.4	0.006	0.025	0.073	3.011	172501	52.0	3.963	191	15.3	66.3	16.3	0.017	5437	5226	ma110501_rel_withdbg.cz11b_c24r64
7960	43426	0	0.0	565.4	23.0	0.000	0.000	0.071	2.960	184611	52.3	4.251	193	16.6	69.0	18.9	0.012	5434	5244	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	43507	266	1.0	569.1	23.1	0.006	0.024	0.071	2.976	172368	51.8	3.962	190	15.4	66.5	16.4	0.010	5420	5226	ma110600_rel_withdbg.cz11b_c24r64
7960	43018	0	0.0	559.8	22.9	0.000	0.000	0.070	2.943	182798	52.1	4.249	194	15.9	68.4	18.3	0.011	5388	5194	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	29.617	70.153	0.190	0.007	0.002	0.032	0.000	0.000	0.000	0.447	ma100618_rel_withdbg.cz11a_c24r64
0.000	7.953	89.022	2.977	0.015	0.001	0.032	0.000	0.000	0.000	0.446	ma101108_rel_withdbg.cz11a_c24r64
0.000	8.705	84.298	6.951	0.014	0.001	0.032	0.000	0.000	0.000	0.430	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	8.379	88.199	3.375	0.013	0.001	0.032	0.000	0.000	0.000	0.454	ma110402_rel_withdbg.cz11b_c24r64
0.000	5.209	88.031	6.711	0.016	0.001	0.032	0.000	0.000	0.000	0.452	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	5.683	89.597	4.678	0.009	0.001	0.032	0.000	0.000	0.000	0.456	ma110501_rel_withdbg.cz11b_c24r64
0.000	8.380	85.604	5.977	0.005	0.001	0.032	0.000	0.000	0.000	0.378	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	6.769	89.441	3.746	0.011	0.001	0.032	0.000	0.000	0.000	0.447	ma110600_rel_withdbg.cz11b_c24r64
0.000	6.236	86.510	7.211	0.010	0.001	0.032	0.000	0.000	0.000	0.432	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.008	38.927	60.480	0.511	0.026	0.048	0.000	0.000	0.000	0.735	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.001	26.880	71.980	1.085	0.028	0.026	0.000	0.000	0.000	0.728	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.008	16.593	82.686	0.650	0.018	0.046	nonzero	0.000	0.000	1.061	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.001	21.293	77.565	1.094	0.021	0.025	0.000	0.000	0.000	0.650	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.007	15.255	83.969	0.709	0.019	0.041	0.000	0.000	0.000	0.728	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.001	17.623	81.194	1.138	0.018	0.025	0.000	0.000	0.000	0.650	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.008	21.632	77.660	0.642	0.018	0.039	0.000	0.000	0.000	0.707	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.001	22.681	76.173	1.098	0.021	0.026	0.000	0.000	0.000	0.707	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.006	16.056	83.182	0.699	0.020	0.037	0.000	0.000	0.000	0.661	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.060	58.050	41.459	0.363	0.025	0.043	0.000	0.000	0.000	0.741	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.027	41.785	57.293	0.851	0.021	0.023	0.000	0.000	0.000	0.728	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.065	30.360	69.065	0.449	0.018	0.043	0.000	0.000	0.000	0.771	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.021	32.975	66.093	0.872	0.017	0.022	0.000	0.000	0.000	0.649	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.050	21.547	77.758	0.588	0.018	0.038	0.000	0.000	0.000	0.726	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.022	28.635	70.406	0.901	0.014	0.022	0.000	0.000	0.000	0.649	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.078	29.108	70.231	0.528	0.018	0.037	0.000	0.000	0.000	0.710	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.028	35.349	63.713	0.870	0.017	0.023	0.000	0.000	0.000	0.705	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.055	23.053	76.262	0.576	0.018	0.035	0.000	0.000	0.000	0.662	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
2.759	88.806	8.147	0.273	0.011	nonzero	0.004	0.000	0.000	0.000	0.594	ma100618_rel_withdbg.cz11a_c24r64
0.322	69.724	29.612	0.283	0.055	nonzero	0.004	0.000	0.000	0.000	0.512	ma101108_rel_withdbg.cz11a_c24r64
0.497	50.847	48.398	0.238	0.016	nonzero	0.004	0.000	0.000	0.000	0.543	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.306	67.273	32.087	0.275	0.054	0.001	0.004	0.000	0.000	0.000	0.503	ma110402_rel_withdbg.cz11b_c24r64
0.519	48.514	50.709	0.249	0.006	0.000	0.004	0.000	0.000	0.000	0.532	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.272	64.511	34.884	0.278	0.051	nonzero	0.004	0.000	0.000	0.000	0.493	ma110501_rel_withdbg.cz11b_c24r64
0.495	47.482	51.762	0.251	0.005	0.000	0.004	0.000	0.000	0.000	0.562	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.299	67.908	31.461	0.276	0.052	nonzero	0.004	0.000	0.000	0.000	0.488	ma110600_rel_withdbg.cz11b_c24r64
0.516	49.376	49.838	0.260	0.006	0.000	0.004	0.000	0.000	0.000	0.442	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
3.327	88.075	8.329	0.255	0.010	nonzero	0.004	0.000	0.000	0.000	0.593	ma100618_rel_withdbg.cz11a_c24r64
0.386	69.979	29.309	0.267	0.055	0.001	0.004	0.000	0.000	0.000	0.512	ma101108_rel_withdbg.cz11a_c24r64
0.709	53.294	45.764	0.213	0.015	nonzero	0.004	0.000	0.000	0.000	0.543	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.374	67.372	31.934	0.263	0.053	nonzero	0.004	0.000	0.000	0.000	0.502	ma110402_rel_withdbg.cz11b_c24r64
0.507	48.425	50.824	0.234	0.005	0.000	0.004	0.000	0.000	0.000	0.532	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.330	64.700	34.648	0.266	0.051	nonzero	0.004	0.000	0.000	0.000	0.492	ma110501_rel_withdbg.cz11b_c24r64
0.500	47.407	51.848	0.237	0.005	0.000	0.004	0.000	0.000	0.000	0.562	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.364	68.017	31.299	0.263	0.052	nonzero	0.004	0.000	0.000	0.000	0.488	ma110600_rel_withdbg.cz11b_c24r64
0.517	49.405	49.821	0.247	0.006	0.000	0.004	0.000	0.000	0.000	0.443	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.973	0.026	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100618_rel_withdbg.cz11a_c24r64
99.967	0.032	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma101108_rel_withdbg.cz11a_c24r64
99.977	0.022	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
99.964	0.034	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma110402_rel_withdbg.cz11b_c24r64
99.979	0.020	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
99.960	0.038	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma110501_rel_withdbg.cz11b_c24r64
99.969	0.030	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
99.964	0.034	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma110600_rel_withdbg.cz11b_c24r64
99.970	0.029	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.267	98.753	0.979	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.014	80.569	19.417	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101108_rel_withdbg.cz11a_c24r64
0.000	1.479	86.851	11.670	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.007	74.483	25.510	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.174	95.285	4.542	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.024	64.736	35.240	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.024	65.726	34.250	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.135	89.031	10.833	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.156	76.965	22.878	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	7.135	92.233	0.632	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.330	84.872	14.799	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma101108_rel_withdbg.cz11a_c24r64
0.000	10.781	81.875	7.344	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.278	80.076	19.646	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110402_rel_withdbg.cz11b_c24r64
0.000	1.833	95.622	2.545	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.701	71.274	28.024	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.309	72.125	27.566	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	1.052	91.910	7.038	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110600_rel_withdbg.cz11b_c24r64
0.000	1.521	80.674	17.806	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.320	0.674	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100618_rel_withdbg.cz11a_c24r64
99.276	0.717	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma101108_rel_withdbg.cz11a_c24r64
99.254	0.738	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
99.279	0.713	0.009	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma110402_rel_withdbg.cz11b_c24r64
99.242	0.750	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
98.908	1.082	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110501_rel_withdbg.cz11b_c24r64
98.951	1.042	0.008	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
98.920	1.071	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma110600_rel_withdbg.cz11b_c24r64
98.900	1.091	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.003	95.611	4.385	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.028	77.042	22.931	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.010	61.639	38.351	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.125	91.375	8.500	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.017	71.941	28.042	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.007	81.181	18.812	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.420	97.066	2.514	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.000	55.323	44.677	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.014	94.031	5.955	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.420	97.934	1.646	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.378	84.531	15.090	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.250	72.792	26.958	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.545	94.465	4.990	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.361	78.757	20.882	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.201	87.427	12.372	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma110501_rel_withdbg.cz11b_c24r64
0.000	5.118	93.455	1.427	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.073	62.788	37.139	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma110600_rel_withdbg.cz11b_c24r64
0.000	1.403	95.174	3.424	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.801	0.191	0.006	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	ma100618_rel_withdbg.cz11a_c24r64
99.536	0.450	0.012	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	ma101108_rel_withdbg.cz11a_c24r64
99.884	0.109	0.005	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
99.567	0.421	0.012	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	ma110402_rel_withdbg.cz11b_c24r64
99.881	0.115	0.004	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
99.476	0.512	0.012	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma110501_rel_withdbg.cz11b_c24r64
99.862	0.134	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
99.499	0.488	0.012	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma110600_rel_withdbg.cz11b_c24r64
99.856	0.139	0.004	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.408	83.742	15.809	0.042	0.000	0.000	0.000	0.000	0.000	0.034	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.044	56.171	43.742	0.043	0.000	0.000	0.000	0.000	0.000	0.035	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.235	51.901	47.808	0.056	0.000	0.000	0.000	0.000	0.000	0.031	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.028	49.190	50.745	0.036	0.000	0.000	0.000	0.000	0.000	0.052	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.162	43.905	55.863	0.071	0.000	0.000	0.000	0.000	0.000	0.045	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.033	43.537	56.405	0.025	0.000	0.000	0.000	0.000	0.000	0.033	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.160	47.462	52.324	0.055	0.000	0.000	0.000	0.000	0.000	0.043	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.040	50.987	48.937	0.036	0.000	0.000	0.000	0.000	0.000	0.043	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.138	46.969	52.849	0.044	0.000	0.000	0.000	0.000	0.000	0.029	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.762	89.319	9.892	0.027	0.000	0.000	0.000	0.000	0.000	0.030	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.128	66.674	33.170	0.027	0.000	0.000	0.000	0.000	0.000	0.031	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.401	61.578	37.988	0.034	0.000	0.000	0.000	0.000	0.000	0.029	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.113	58.227	41.636	0.024	0.000	0.000	0.000	0.000	0.000	0.027	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.224	50.564	49.178	0.035	0.000	0.000	0.000	0.000	0.000	0.027	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.097	52.968	46.922	0.013	0.000	0.000	0.000	0.000	0.000	0.027	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.576	54.245	45.143	0.035	0.000	0.000	0.000	0.000	0.000	0.035	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.131	61.020	38.826	0.022	0.000	0.000	0.000	0.000	0.000	0.028	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.240	53.677	46.048	0.035	0.000	0.000	0.000	0.000	0.000	0.029	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.428	1.553	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma100618_rel_withdbg.cz11a_c24r64
98.350	1.628	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma101108_rel_withdbg.cz11a_c24r64
98.296	1.687	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
98.359	1.617	0.024	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110402_rel_withdbg.cz11b_c24r64
98.265	1.716	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
97.800	2.175	0.025	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110501_rel_withdbg.cz11b_c24r64
97.707	2.273	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
97.841	2.134	0.025	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110600_rel_withdbg.cz11b_c24r64
97.664	2.314	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.454	85.808	13.694	0.044	0.000	0.000	0.000	0.000	0.000	0.027	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.028	52.990	46.942	0.039	0.000	0.000	0.000	0.000	0.000	0.027	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.125	40.114	59.708	0.053	0.000	0.000	0.000	0.000	0.000	0.030	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.010	43.119	56.824	0.047	0.000	0.000	0.000	0.000	0.000	0.030	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.097	35.429	64.415	0.059	0.000	0.000	0.000	0.000	0.000	0.032	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.029	45.725	54.191	0.055	0.000	0.000	0.000	0.000	0.000	0.032	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.148	42.808	57.003	0.041	0.000	0.000	0.000	0.000	0.000	0.029	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.031	47.878	52.040	0.051	0.000	0.000	0.000	0.000	0.000	0.040	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.082	41.187	58.700	0.031	0.000	0.000	0.000	0.000	0.000	0.037	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.655	91.099	8.221	0.026	0.000	0.000	0.000	0.000	0.000	0.027	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.084	64.676	35.206	0.033	0.000	0.000	0.000	0.000	0.000	0.027	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.279	50.262	49.428	0.031	0.000	0.000	0.000	0.000	0.000	0.031	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.057	53.001	46.907	0.035	0.000	0.000	0.000	0.000	0.000	0.028	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.104	41.513	58.344	0.040	0.000	0.000	0.000	0.000	0.000	0.035	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.112	55.708	44.139	0.041	0.000	0.000	0.000	0.000	0.000	0.029	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.226	49.101	50.635	0.037	0.000	0.000	0.000	0.000	0.000	0.032	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.099	58.710	41.153	0.038	0.000	0.000	0.000	0.000	0.000	0.033	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.163	47.779	52.030	0.028	0.000	0.000	0.000	0.000	0.000	0.029	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.572	0.411	0.012	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.044	ma100618_rel_withdbg.cz11a_c24r64
98.641	1.328	0.024	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	ma101108_rel_withdbg.cz11a_c24r64
99.786	0.198	0.010	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.051	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
98.643	1.331	0.025	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma110402_rel_withdbg.cz11b_c24r64
99.773	0.217	0.009	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
98.506	1.470	0.023	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.030	ma110501_rel_withdbg.cz11b_c24r64
99.745	0.245	0.009	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.052	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
98.558	1.415	0.025	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma110600_rel_withdbg.cz11b_c24r64
99.725	0.264	0.010	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.644	80.627	18.673	0.055	0.000	0.000	0.000	0.000	0.000	0.046	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.057	55.969	43.882	0.092	0.000	0.000	0.000	0.000	0.000	0.059	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.868	58.525	40.464	0.143	0.000	0.000	0.000	0.000	0.000	0.062	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.057	51.555	48.268	0.121	0.000	0.000	0.000	0.000	0.000	0.058	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.544	53.935	45.339	0.182	0.000	0.000	0.000	0.000	0.000	0.057	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.059	47.125	52.700	0.116	0.000	0.000	0.000	0.000	0.000	0.050	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.550	55.324	43.988	0.138	0.000	0.000	0.000	0.000	0.000	0.061	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.099	52.343	47.433	0.126	0.000	0.000	0.000	0.000	0.000	0.035	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.455	55.293	44.085	0.167	0.000	0.000	0.000	0.000	0.000	0.035	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.277	86.067	12.622	0.033	0.000	0.000	0.000	0.000	0.000	0.046	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.262	64.099	35.587	0.052	0.000	0.000	0.000	0.000	0.000	0.057	ma101108_rel_withdbg.cz11a_c24r64
0.000	2.366	64.066	33.490	0.078	nonzero	0.000	0.000	0.000	0.000	0.064	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.228	58.291	41.403	0.077	0.000	0.000	0.000	0.000	0.000	0.058	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.810	57.945	41.113	0.132	0.000	0.000	0.000	0.000	0.000	0.054	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.244	54.701	44.985	0.069	0.000	0.000	0.000	0.000	0.000	0.051	ma110501_rel_withdbg.cz11b_c24r64
0.000	1.264	59.210	39.430	0.096	nonzero	0.000	0.000	0.000	0.000	0.065	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.415	60.266	39.243	0.076	0.000	0.000	0.000	0.000	0.000	0.032	ma110600_rel_withdbg.cz11b_c24r64
0.000	1.048	59.091	39.740	0.122	0.000	0.000	0.000	0.000	0.000	0.032	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
97.707	2.266	0.027	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	ma100618_rel_withdbg.cz11a_c24r64
98.115	1.855	0.030	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101108_rel_withdbg.cz11a_c24r64
97.267	2.710	0.023	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
97.803	2.164	0.033	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma110402_rel_withdbg.cz11b_c24r64
97.232	2.745	0.023	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
97.102	2.861	0.037	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma110501_rel_withdbg.cz11b_c24r64
96.383	3.590	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
97.049	2.916	0.035	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110600_rel_withdbg.cz11b_c24r64
96.295	3.678	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.523	81.648	17.782	0.047	0.000	0.000	0.000	0.000	0.000	0.043	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.045	54.906	44.920	0.129	0.000	0.000	0.000	0.000	0.000	0.041	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.398	43.608	55.855	0.139	0.000	0.000	0.000	0.000	0.000	0.048	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.026	49.763	50.070	0.141	0.001	0.000	0.000	0.000	0.000	0.072	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.257	40.651	58.981	0.111	0.000	0.000	0.000	0.000	0.000	0.035	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.041	46.029	53.783	0.147	0.000	0.000	0.000	0.000	0.000	0.039	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.239	40.551	59.099	0.112	0.000	0.000	0.000	0.000	0.000	0.033	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.042	50.135	49.727	0.097	0.000	0.000	0.000	0.000	0.000	0.033	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.184	41.365	58.353	0.099	0.000	0.000	0.000	0.000	0.000	0.049	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.975	87.660	11.331	0.034	0.000	0.000	0.000	0.000	0.000	0.036	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.192	63.362	36.374	0.073	0.000	0.000	0.000	0.000	0.000	0.041	ma101108_rel_withdbg.cz11a_c24r64
0.000	1.095	49.728	49.100	0.076	0.000	0.000	0.000	0.000	0.000	0.051	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.130	56.517	43.272	0.081	0.000	0.000	0.000	0.000	0.000	0.063	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.541	44.145	55.241	0.073	0.000	0.000	0.000	0.000	0.000	0.035	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.180	53.419	46.304	0.098	0.000	0.000	0.000	0.000	0.000	0.040	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.573	44.183	55.172	0.072	0.000	0.000	0.000	0.000	0.000	0.033	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.159	57.850	41.931	0.060	0.000	0.000	0.000	0.000	0.000	0.032	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.575	45.066	54.292	0.066	0.000	0.000	0.000	0.000	0.000	0.052	ma1106_240723_d8374262_ilwas.cz11b_c24r64