Introduction

This is a report for the insert benchmark with 80M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has is a c2d-standard-30 with HT off, 16 cores, 64G RAM, Ubuntu 22.04 and ext4 using SW RAID 0 and 2 NVMe devices. The benchmark was run with 8 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables with a table per client. It loads 10M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40m+10m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached by InnoDB. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:

ma100244_rel_withdbg.cz11a_c24r64 - MariaDB 10.2.44, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma100339_rel_withdbg.cz11a_c24r64 - MariaDB 10.3.39, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma100434_rel_withdbg.cz11a_c24r64 - MariaDB 10.4.34, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma100525_rel_withdbg.cz11a_c24r64 - MariaDB 10.5.25, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma100618_rel_withdbg.cz11a_c24r64 - MariaDB 10.6.18, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma101108_rel_withdbg.cz11a_c24r64 - MariaDB 10.11.8, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64 - MariaDB 10.11, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo on July 7, 2024 at git hash c944cd6e
ma110402_rel_withdbg.cz11b_c24r64 - MariaDB 11.4.2, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64 - MariaDB 11.4, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo on July 7, 2024 at git hash 2ee061c2
ma110501_rel_withdbg.cz11b_c24r64 - MariaDB 11.5.1, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64 - MariaDB 11.5, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo on July 7, 2024 at git hash 2f4b0ba3
ma110600_rel_withdbg.cz11b_c24r64 - MariaDB 11.6.0, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo
ma1106_240723_d8374262_ilwas.cz11b_c24r64 - MariaDB 11.6, compiled with -DCMAKE_BUILD_TYPE=RelWithDebInfo on July 7, 2024 at git hash d8374262

Summary
l.i0: load without secondary indexes
l.x: create secondary indexes
l.i1: continue load after secondary indexes created with 50 inserts per transaction
l.i2: continue load after secondary indexes created with 5 inserts per transaction
qr100.L1: range queries with 100 insert/s per client
qp100.L2: point queries with 100 insert/s per client
qr500.L3: range queries with 500 insert/s per client
qp500.L4: point queries with 500 insert/s per client
qr1000.L5: range queries with 1000 insert/s per client
qp1000.L6: point queries with 1000 insert/s per client

Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
ma100244_rel_withdbg.cz11a_c24r64	601504	987656	103426	51184	58716	49910	56457	48532	55319	47761
ma100339_rel_withdbg.cz11a_c24r64	481928	987656	100787	55710	58228	49022	56610	47898	55016	47263
ma100434_rel_withdbg.cz11a_c24r64	496894	987656	103593	55749	56065	47390	54046	46416	52746	45709
ma100525_rel_withdbg.cz11a_c24r64	388350	930234	67912	50665	59709	48658	58984	47552	58084	45705
ma100618_rel_withdbg.cz11a_c24r64	434783	975611	81967	59480	60249	48748	58905	47570	57900	46816
ma101108_rel_withdbg.cz11a_c24r64	344828	975611	71190	39005	58905	47801	56366	46509	53861	46218
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	317460	919541	65884	35635	59908	48102	59036	46979	58123	45786
ma110402_rel_withdbg.cz11b_c24r64	337553	975611	67868	38168	59251	48089	56684	46940	54072	46314
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	306513	963857	63732	34587	59512	48116	58806	47105	57937	45951
ma110501_rel_withdbg.cz11b_c24r64	320000	975611	65628	37436	57176	45308	54949	44165	52488	43524
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	322581	919541	67955	34217	57649	45488	56843	44410	56034	43426
ma110600_rel_withdbg.cz11b_c24r64	330578	975611	68699	38369	57396	45326	54857	44171	52648	43507
ma1106_240723_d8374262_ilwas.cz11b_c24r64	307692	941178	64843	34889	57342	45113	56517	44006	55688	43018

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
ma100244_rel_withdbg.cz11a_c24r64	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00
ma100339_rel_withdbg.cz11a_c24r64	0.80	1.00	0.97	1.09	0.99	0.98	1.00	0.99	0.99	0.99
ma100434_rel_withdbg.cz11a_c24r64	0.83	1.00	1.00	1.09	0.95	0.95	0.96	0.96	0.95	0.96
ma100525_rel_withdbg.cz11a_c24r64	0.65	0.94	0.66	0.99	1.02	0.97	1.04	0.98	1.05	0.96
ma100618_rel_withdbg.cz11a_c24r64	0.72	0.99	0.79	1.16	1.03	0.98	1.04	0.98	1.05	0.98
ma101108_rel_withdbg.cz11a_c24r64	0.57	0.99	0.69	0.76	1.00	0.96	1.00	0.96	0.97	0.97
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.53	0.93	0.64	0.70	1.02	0.96	1.05	0.97	1.05	0.96
ma110402_rel_withdbg.cz11b_c24r64	0.56	0.99	0.66	0.75	1.01	0.96	1.00	0.97	0.98	0.97
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.51	0.98	0.62	0.68	1.01	0.96	1.04	0.97	1.05	0.96
ma110501_rel_withdbg.cz11b_c24r64	0.53	0.99	0.63	0.73	0.97	0.91	0.97	0.91	0.95	0.91
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.54	0.93	0.66	0.67	0.98	0.91	1.01	0.92	1.01	0.91
ma110600_rel_withdbg.cz11b_c24r64	0.55	0.99	0.66	0.75	0.98	0.91	0.97	0.91	0.95	0.91
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.51	0.95	0.63	0.68	0.98	0.90	1.00	0.91	1.01	0.90

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbms	qr100.L1	qp100.L2	qr500.L3	qp500.L4	qr1000.L5	qp1000.L6
ma100244_rel_withdbg.cz11a_c24r64	796	796	3980	3980	7960	7960
ma100339_rel_withdbg.cz11a_c24r64	796	796	3980	3980	7960	7960
ma100434_rel_withdbg.cz11a_c24r64	796	796	3980	3980	7960	7960
ma100525_rel_withdbg.cz11a_c24r64	796	796	3980	3980	7960	7960
ma100618_rel_withdbg.cz11a_c24r64	796	796	3980	3980	7960	7965
ma101108_rel_withdbg.cz11a_c24r64	796	796	3980	3980	7960	7960
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	796	796	3980	3980	7965	7960
ma110402_rel_withdbg.cz11b_c24r64	796	796	3980	3980	7960	7960
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	796	796	3980	3982	7960	7960
ma110501_rel_withdbg.cz11b_c24r64	796	796	3980	3980	7960	7960
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	796	796	3980	3980	7960	7960
ma110600_rel_withdbg.cz11b_c24r64	796	796	3980	3980	7960	7960
ma1106_240723_d8374262_ilwas.cz11b_c24r64	796	796	3980	3980	7960	7960
target	800	800	4000	4000	8000	8000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	256ms	1s	max
ma100244_rel_withdbg.cz11a_c24r64	48.535	51.387	0.017	0.024	0.006	0.032	0.668
ma100339_rel_withdbg.cz11a_c24r64	26.272	73.473	0.197	0.023	0.003	0.032	0.684
ma100434_rel_withdbg.cz11a_c24r64	31.852	67.876	0.223	0.016	0.003	0.032	0.532
ma100525_rel_withdbg.cz11a_c24r64	11.428	88.168	0.144	0.177	0.052	0.032	0.445
ma100618_rel_withdbg.cz11a_c24r64	29.617	70.153	0.190	0.007	0.002	0.032	0.447
ma101108_rel_withdbg.cz11a_c24r64	7.953	89.022	2.977	0.015	0.001	0.032	0.446
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	8.705	84.298	6.951	0.014	0.001	0.032	0.430
ma110402_rel_withdbg.cz11b_c24r64	8.379	88.199	3.375	0.013	0.001	0.032	0.454
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	5.209	88.031	6.711	0.016	0.001	0.032	0.452
ma110501_rel_withdbg.cz11b_c24r64	5.683	89.597	4.678	0.009	0.001	0.032	0.456
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	8.380	85.604	5.977	0.005	0.001	0.032	0.378
ma110600_rel_withdbg.cz11b_c24r64	6.769	89.441	3.746	0.011	0.001	0.032	0.447
ma1106_240723_d8374262_ilwas.cz11b_c24r64	6.236	86.510	7.211	0.010	0.001	0.032	0.432

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
601504	0	0	0.0	1962.0	179.5	0.000	0.000	0.003	0.306	62350	53.6	0.104	14	5.3	56.1	6.7	0.668	91302	41256	ma100244_rel_withdbg.cz11a_c24r64
481928	0	0	0.0	1541.8	152.3	0.000	0.000	0.003	0.324	56530	70.7	0.117	23	5.3	56.1	6.8	0.684	69739	31067	ma100339_rel_withdbg.cz11a_c24r64
496894	0	0	0.0	1674.1	159.7	0.000	0.000	0.003	0.329	59167	70.6	0.119	23	5.3	56.1	NA	0.532	73122	34278	ma100434_rel_withdbg.cz11a_c24r64
388350	0	0	0.0	2651.3	120.2	0.000	0.000	0.007	0.317	384651	57.6	0.990	24	5.3	56.1	6.8	0.445	53842	34573	ma100525_rel_withdbg.cz11a_c24r64
434783	0	0	0.0	1276.3	105.0	0.000	0.000	0.003	0.247	478073	60.5	1.100	22	5.3	56.1	6.1	0.447	59254	39670	ma100618_rel_withdbg.cz11a_c24r64
344828	0	0	0.0	1091.1	86.7	0.000	0.000	0.003	0.258	222418	48.1	0.645	22	5.3	56.1	5.7	0.446	45362	29876	ma101108_rel_withdbg.cz11a_c24r64
317460	0	0	0.0	1021.2	79.9	0.000	0.000	0.003	0.258	256255	52.6	0.807	27	5.3	56.1	6.0	0.430	40568	25872	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
337553	0	0	0.0	1072.9	84.8	0.000	0.000	0.003	0.257	246747	47.8	0.731	23	5.3	56.1	6.3	0.454	44253	29768	ma110402_rel_withdbg.cz11b_c24r64
306513	0	0	0.0	983.4	77.0	0.000	0.000	0.003	0.257	288857	52.0	0.942	27	5.3	56.1	5.8	0.452	39358	25872	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
320000	0	0	0.0	1023.7	80.8	0.000	0.000	0.003	0.259	246888	47.5	0.772	24	5.3	56.1	6.0	0.456	41655	28569	ma110501_rel_withdbg.cz11b_c24r64
322581	0	0	0.0	1041.6	81.7	0.000	0.000	0.003	0.259	263610	51.8	0.817	26	5.3	56.1	6.1	0.378	41855	28170	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
330578	0	0	0.0	1050.7	83.2	0.000	0.000	0.003	0.258	242485	47.4	0.734	23	5.3	56.1	6.2	0.447	42954	29369	ma110600_rel_withdbg.cz11b_c24r64
307692	0	0	0.0	990.7	78.2	0.000	0.000	0.003	0.260	292754	51.0	0.951	27	5.3	56.1	5.8	0.432	39657	27478	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.x

l.x: create secondary indexes.

Average throughput:

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
987656	0	0	0.0	3895.3	724.0	0.000	0.000	0.004	0.751	23425	23.8	0.024	4	12.2	63.0	11.2	0.004	NA	NA	ma100244_rel_withdbg.cz11a_c24r64
987656	0	0	0.0	3834.5	720.6	0.000	0.000	0.004	0.747	34871	24.3	0.035	4	12.2	63.0	10.9	0.004	NA	NA	ma100339_rel_withdbg.cz11a_c24r64
987656	0	0	0.0	3919.9	724.2	0.000	0.000	0.004	0.751	31292	24.1	0.032	4	12.0	62.8	NA	0.001	NA	NA	ma100434_rel_withdbg.cz11a_c24r64
930234	0	0	0.0	1527.6	622.0	0.000	0.000	0.002	0.685	3347	25.8	0.004	4	12.0	62.8	10.3	0.001	NA	NA	ma100525_rel_withdbg.cz11a_c24r64
975611	0	0	0.0	4308.4	692.1	0.000	0.000	0.004	0.726	14322	25.9	0.015	4	11.2	62.1	10.0	0.001	NA	NA	ma100618_rel_withdbg.cz11a_c24r64
975611	0	0	0.0	3933.3	685.2	0.000	0.000	0.004	0.719	12374	27.0	0.013	4	11.2	62.1	9.7	0.001	NA	NA	ma101108_rel_withdbg.cz11a_c24r64
919541	0	0	0.0	4122.5	657.8	0.000	0.000	0.004	0.733	13243	27.4	0.014	5	11.2	62.1	9.5	0.001	NA	NA	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
975611	0	0	0.0	3850.4	684.9	0.000	0.000	0.004	0.719	12391	27.2	0.013	4	11.2	62.1	9.8	0.001	NA	NA	ma110402_rel_withdbg.cz11b_c24r64
963857	0	0	0.0	3988.1	687.1	0.000	0.000	0.004	0.730	12306	28.4	0.013	5	11.2	62.1	9.6	0.001	NA	NA	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
975611	0	0	0.0	3917.0	687.2	0.000	0.000	0.004	0.721	11971	27.1	0.012	4	11.2	62.1	9.9	0.002	NA	NA	ma110501_rel_withdbg.cz11b_c24r64
919541	0	0	0.0	4088.4	657.3	0.000	0.000	0.004	0.732	13478	27.6	0.015	5	11.2	62.1	9.9	0.002	NA	NA	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
975611	0	0	0.0	4076.8	688.9	0.000	0.000	0.004	0.723	12738	27.1	0.013	4	11.2	62.1	9.5	0.002	NA	NA	ma110600_rel_withdbg.cz11b_c24r64
941178	0	0	0.0	4133.9	659.5	0.000	0.000	0.004	0.718	13467	28.9	0.014	5	11.2	62.1	9.6	0.001	NA	NA	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	1ms	4ms	16ms	64ms	256ms	1s	4s	max
ma100244_rel_withdbg.cz11a_c24r64	0.003	76.405	23.302	0.134	0.108	0.048		0.682
ma100339_rel_withdbg.cz11a_c24r64	0.002	83.966	15.568	0.106	0.259	0.099		0.683
ma100434_rel_withdbg.cz11a_c24r64	0.002	86.022	13.505	0.106	0.266	0.099		0.713
ma100525_rel_withdbg.cz11a_c24r64	0.015	24.160	75.334	0.301	0.045	0.144		0.742
ma100618_rel_withdbg.cz11a_c24r64	0.008	38.927	60.480	0.511	0.026	0.048		0.735
ma101108_rel_withdbg.cz11a_c24r64	0.001	26.880	71.980	1.085	0.028	0.026		0.728
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.008	16.593	82.686	0.650	0.018	0.046	nonzero	1.061
ma110402_rel_withdbg.cz11b_c24r64	0.001	21.293	77.565	1.094	0.021	0.025		0.650
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.007	15.255	83.969	0.709	0.019	0.041		0.728
ma110501_rel_withdbg.cz11b_c24r64	0.001	17.623	81.194	1.138	0.018	0.025		0.650
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.008	21.632	77.660	0.642	0.018	0.039		0.707
ma110600_rel_withdbg.cz11b_c24r64	0.001	22.681	76.173	1.098	0.021	0.026		0.707
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.006	16.056	83.182	0.699	0.020	0.037		0.661

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	256ms	1s	max
ma100244_rel_withdbg.cz11a_c24r64	0.019	76.272	23.429	0.125	0.109	0.046	0.683
ma100339_rel_withdbg.cz11a_c24r64	0.024	83.624	15.904	0.091	0.269	0.088	0.684
ma100434_rel_withdbg.cz11a_c24r64	0.026	85.748	13.771	0.091	0.275	0.089	0.715
ma100525_rel_withdbg.cz11a_c24r64	0.038	30.008	69.555	0.213	0.083	0.103	0.742
ma100618_rel_withdbg.cz11a_c24r64	0.060	58.050	41.459	0.363	0.025	0.043	0.741
ma101108_rel_withdbg.cz11a_c24r64	0.027	41.785	57.293	0.851	0.021	0.023	0.728
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.065	30.360	69.065	0.449	0.018	0.043	0.771
ma110402_rel_withdbg.cz11b_c24r64	0.021	32.975	66.093	0.872	0.017	0.022	0.649
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.050	21.547	77.758	0.588	0.018	0.038	0.726
ma110501_rel_withdbg.cz11b_c24r64	0.022	28.635	70.406	0.901	0.014	0.022	0.649
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.078	29.108	70.231	0.528	0.018	0.037	0.710
ma110600_rel_withdbg.cz11b_c24r64	0.028	35.349	63.713	0.870	0.017	0.023	0.705
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.055	23.053	76.262	0.576	0.018	0.035	0.662

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
103426	0	0	0.0	5258.4	223.6	0.000	0.000	0.051	2.214	41456	84.3	0.401	130	21.6	74.3	24.9	0.682	14235	200	ma100244_rel_withdbg.cz11a_c24r64
100787	0	0	0.0	4886.4	216.2	0.000	0.000	0.048	2.197	44966	76.6	0.446	122	20.1	72.3	22.9	0.683	15833	200	ma100339_rel_withdbg.cz11a_c24r64
103593	0	0	0.0	5050.2	222.8	0.000	0.000	0.049	2.203	46188	76.1	0.446	118	20.1	72.3	NA	0.713	16338	150	ma100434_rel_withdbg.cz11a_c24r64
67912	0	0	0.0	9754.5	318.9	0.000	0.000	0.144	4.808	531668	67.2	7.829	158	19.6	71.9	21.0	0.742	9040	200	ma100525_rel_withdbg.cz11a_c24r64
81967	0	0	0.0	8432.4	308.9	0.000	0.000	0.103	3.860	594816	73.4	7.257	143	17.0	69.4	19.7	0.735	10538	4595	ma100618_rel_withdbg.cz11a_c24r64
71190	0	2644	10.3	6714.8	260.8	0.037	0.149	0.094	3.752	295989	54.8	4.158	123	16.0	67.8	16.9	0.728	8990	5646	ma101108_rel_withdbg.cz11a_c24r64
65884	0	0	0.0	6990.8	251.0	0.000	0.000	0.106	3.901	338770	68.8	5.142	167	17.1	69.4	19.6	1.061	8392	3746	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
67868	0	2621	10.2	6568.3	251.5	0.039	0.154	0.097	3.794	314418	53.9	4.633	127	15.2	66.4	16.5	0.650	8590	5744	ma110402_rel_withdbg.cz11b_c24r64
63732	0	0	0.0	6841.5	250.4	0.000	0.000	0.107	4.023	356516	67.2	5.594	169	16.0	68.5	18.6	0.728	8141	4196	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
65628	0	2584	10.1	6351.6	243.2	0.039	0.157	0.097	3.794	318520	54.1	4.853	132	15.3	66.3	16.4	0.650	8291	5694	ma110501_rel_withdbg.cz11b_c24r64
67955	0	0	0.0	7399.6	268.4	0.000	0.000	0.109	4.044	346090	66.6	5.093	157	16.6	69.0	19.3	0.707	8641	4492	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
68699	0	2621	10.2	6604.0	253.2	0.038	0.153	0.096	3.774	309160	53.7	4.500	125	15.4	66.5	16.5	0.707	8691	5993	ma110600_rel_withdbg.cz11b_c24r64
64843	0	0	0.0	6805.3	249.8	0.000	0.000	0.105	3.946	367669	66.7	5.670	165	15.9	68.4	18.6	0.661	8241	4345	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	256ms	1s	max
ma100244_rel_withdbg.cz11a_c24r64	2.042	84.766	12.902	0.125	0.162	nonzero	0.004	0.682
ma100339_rel_withdbg.cz11a_c24r64	3.670	85.463	10.658	0.109	0.096	nonzero	0.004	0.678
ma100434_rel_withdbg.cz11a_c24r64	3.416	85.732	10.651	0.098	0.098	nonzero	0.004	0.626
ma100525_rel_withdbg.cz11a_c24r64	1.574	84.115	13.891	0.332	0.085	nonzero	0.004	0.691
ma100618_rel_withdbg.cz11a_c24r64	2.759	88.806	8.147	0.273	0.011	nonzero	0.004	0.594
ma101108_rel_withdbg.cz11a_c24r64	0.322	69.724	29.612	0.283	0.055	nonzero	0.004	0.512
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.497	50.847	48.398	0.238	0.016	nonzero	0.004	0.543
ma110402_rel_withdbg.cz11b_c24r64	0.306	67.273	32.087	0.275	0.054	0.001	0.004	0.503
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.519	48.514	50.709	0.249	0.006		0.004	0.532
ma110501_rel_withdbg.cz11b_c24r64	0.272	64.511	34.884	0.278	0.051	nonzero	0.004	0.493
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.495	47.482	51.762	0.251	0.005		0.004	0.562
ma110600_rel_withdbg.cz11b_c24r64	0.299	67.908	31.461	0.276	0.052	nonzero	0.004	0.488
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.516	49.376	49.838	0.260	0.006		0.004	0.442

dbms	256us	1ms	4ms	16ms	64ms	256ms	1s	max
ma100244_rel_withdbg.cz11a_c24r64	2.022	84.715	12.979	0.120	0.161	nonzero	0.004	0.683
ma100339_rel_withdbg.cz11a_c24r64	4.226	84.937	10.636	0.102	0.095	nonzero	0.004	0.677
ma100434_rel_withdbg.cz11a_c24r64	3.950	85.241	10.617	0.092	0.097	nonzero	0.004	0.625
ma100525_rel_withdbg.cz11a_c24r64	1.711	83.713	14.191	0.298	0.083	nonzero	0.004	0.691
ma100618_rel_withdbg.cz11a_c24r64	3.327	88.075	8.329	0.255	0.010	nonzero	0.004	0.593
ma101108_rel_withdbg.cz11a_c24r64	0.386	69.979	29.309	0.267	0.055	0.001	0.004	0.512
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.709	53.294	45.764	0.213	0.015	nonzero	0.004	0.543
ma110402_rel_withdbg.cz11b_c24r64	0.374	67.372	31.934	0.263	0.053	nonzero	0.004	0.502
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.507	48.425	50.824	0.234	0.005		0.004	0.532
ma110501_rel_withdbg.cz11b_c24r64	0.330	64.700	34.648	0.266	0.051	nonzero	0.004	0.492
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.500	47.407	51.848	0.237	0.005		0.004	0.562
ma110600_rel_withdbg.cz11b_c24r64	0.364	68.017	31.299	0.263	0.052	nonzero	0.004	0.488
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.517	49.405	49.821	0.247	0.006		0.004	0.443

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
51184	0	0	0.0	4619.7	198.2	0.000	0.000	0.090	3.966	170403	75.1	3.329	235	21.6	74.3	25.2	0.682	6905	185	ma100244_rel_withdbg.cz11a_c24r64
55710	0	0	0.0	4926.4	214.5	0.000	0.000	0.088	3.943	189159	73.5	3.395	211	20.1	72.3	23.2	0.678	7387	190	ma100339_rel_withdbg.cz11a_c24r64
55749	0	0	0.0	4805.3	209.1	0.000	0.000	0.086	3.841	190455	73.6	3.416	211	20.1	72.3	NA	0.626	7379	190	ma100434_rel_withdbg.cz11a_c24r64
50665	0	0	0.0	9204.9	317.3	0.000	0.000	0.182	6.413	348531	68.4	6.879	216	19.6	71.9	21.0	0.691	6625	190	ma100525_rel_withdbg.cz11a_c24r64
59480	0	0	0.0	5272.4	209.7	0.000	0.000	0.089	3.610	396907	70.4	6.673	189	17.0	69.4	19.8	0.594	7597	4860	ma100618_rel_withdbg.cz11a_c24r64
39005	0	3595	14.0	3578.5	142.7	0.092	0.369	0.092	3.747	274281	46.8	7.032	192	16.0	67.8	16.7	0.512	4935	3296	ma101108_rel_withdbg.cz11a_c24r64
35635	0	0	0.0	3311.3	131.8	0.000	0.000	0.093	3.787	480863	58.2	13.494	261	17.1	69.4	19.7	0.543	4507	3097	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
38168	0	3552	13.9	3523.6	139.9	0.093	0.372	0.092	3.753	279046	46.5	7.311	195	15.2	66.4	16.4	0.503	4824	3316	ma110402_rel_withdbg.cz11b_c24r64
34587	0	0	0.0	3137.6	125.1	0.000	0.000	0.091	3.703	476226	57.7	13.769	267	16.0	68.5	18.6	0.532	4351	3097	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
37436	0	3535	13.8	3451.9	137.3	0.094	0.378	0.092	3.755	286066	46.4	7.642	198	15.3	66.3	16.4	0.493	4731	3217	ma110501_rel_withdbg.cz11b_c24r64
34217	0	0	0.0	3095.6	123.6	0.000	0.000	0.090	3.700	476860	57.5	13.936	269	16.6	69.0	19.3	0.562	4295	2962	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
38369	0	3539	13.8	3532.0	140.5	0.092	0.369	0.092	3.751	275194	46.6	7.172	194	15.4	66.5	16.4	0.488	4855	3332	ma110600_rel_withdbg.cz11b_c24r64
34889	0	0	0.0	3165.7	126.2	0.000	0.000	0.091	3.705	475943	57.6	13.642	264	15.9	68.4	18.5	0.442	4385	3241	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	99.641	0.342	0.017	nonzero	nonzero	0.022
ma100339_rel_withdbg.cz11a_c24r64	99.657	0.332	0.011	nonzero	nonzero	0.019
ma100434_rel_withdbg.cz11a_c24r64	99.605	0.384	0.011	nonzero		0.011
ma100525_rel_withdbg.cz11a_c24r64	99.964	0.034	0.001	nonzero		0.004
ma100618_rel_withdbg.cz11a_c24r64	99.973	0.026	0.001			0.004
ma101108_rel_withdbg.cz11a_c24r64	99.967	0.032	0.001	nonzero		0.006
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	99.977	0.022	0.001			0.004
ma110402_rel_withdbg.cz11b_c24r64	99.964	0.034	0.002	nonzero		0.005
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	99.979	0.020	0.001	nonzero		0.004
ma110501_rel_withdbg.cz11b_c24r64	99.960	0.038	0.001	nonzero		0.004
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	99.969	0.030	0.001	nonzero		0.004
ma110600_rel_withdbg.cz11b_c24r64	99.964	0.034	0.002	nonzero		0.006
ma1106_240723_d8374262_ilwas.cz11b_c24r64	99.970	0.029	0.001	nonzero		0.006

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.021	97.771	2.201	0.007	0.028
ma100339_rel_withdbg.cz11a_c24r64	0.010	97.295	2.688	0.007	0.026
ma100434_rel_withdbg.cz11a_c24r64		97.410	2.587	0.003	0.016
ma100525_rel_withdbg.cz11a_c24r64	0.042	91.684	8.274		0.015
ma100618_rel_withdbg.cz11a_c24r64	0.267	98.753	0.979		0.012
ma101108_rel_withdbg.cz11a_c24r64	0.014	80.569	19.417		0.008
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	1.479	86.851	11.670		0.007
ma110402_rel_withdbg.cz11b_c24r64	0.007	74.483	25.510		0.008
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.174	95.285	4.542		0.007
ma110501_rel_withdbg.cz11b_c24r64	0.024	64.736	35.240		0.010
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.024	65.726	34.250		0.008
ma110600_rel_withdbg.cz11b_c24r64	0.135	89.031	10.833		0.008
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.156	76.965	22.878		0.009

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	2.128	96.062	1.799	0.010	0.021
ma100339_rel_withdbg.cz11a_c24r64	4.722	93.319	1.951	0.007	0.031
ma100434_rel_withdbg.cz11a_c24r64	4.576	93.420	2.003		0.013
ma100525_rel_withdbg.cz11a_c24r64	2.236	92.285	5.479		0.015
ma100618_rel_withdbg.cz11a_c24r64	7.135	92.233	0.632		0.009
ma101108_rel_withdbg.cz11a_c24r64	0.330	84.872	14.799		0.009
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	10.781	81.875	7.344		0.007
ma110402_rel_withdbg.cz11b_c24r64	0.278	80.076	19.646		0.008
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	1.833	95.622	2.545		0.008
ma110501_rel_withdbg.cz11b_c24r64	0.701	71.274	28.024		0.009
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.309	72.125	27.566		0.008
ma110600_rel_withdbg.cz11b_c24r64	1.052	91.910	7.038		0.008
ma1106_240723_d8374262_ilwas.cz11b_c24r64	1.521	80.674	17.806		0.008

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	58716	0	0.0	6116.6	185.1	0.000	0.000	7.684	238.135	225476	50.8	3.840	138	21.6	74.3	25.3	0.022	7352	6955	ma100244_rel_withdbg.cz11a_c24r64
796	58228	0	0.0	6079.0	184.0	0.000	0.000	7.637	236.669	223715	50.8	3.842	140	20.1	72.3	23.2	0.019	7320	6909	ma100339_rel_withdbg.cz11a_c24r64
796	56065	0	0.0	6092.8	184.4	0.000	0.000	7.654	237.253	215266	50.8	3.840	145	20.1	72.3	NA	0.011	7000	6601	ma100434_rel_withdbg.cz11a_c24r64
796	59709	0	0.0	5.0	0.9	0.000	0.000	0.006	1.099	225873	50.7	3.783	136	19.6	71.9	20.8	0.004	7531	7288	ma100525_rel_withdbg.cz11a_c24r64
796	60249	0	0.0	5.0	0.8	0.000	0.000	0.006	1.080	226620	50.5	3.761	134	17.0	69.4	19.4	0.004	7576	7352	ma100618_rel_withdbg.cz11a_c24r64
796	58905	22	0.1	5.0	0.9	0.000	0.001	0.006	1.100	220422	50.4	3.742	137	16.0	67.8	16.5	0.006	7464	7240	ma101108_rel_withdbg.cz11a_c24r64
796	59908	0	0.0	5.1	0.9	0.000	0.000	0.006	1.114	225518	50.5	3.764	135	17.1	69.4	19.3	0.004	7544	7306	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	59251	24	0.1	5.1	0.9	0.000	0.002	0.006	1.104	222354	50.5	3.753	136	15.2	66.4	16.3	0.005	7442	7192	ma110402_rel_withdbg.cz11b_c24r64
796	59512	0	0.0	5.1	0.9	0.000	0.000	0.006	1.104	223467	50.5	3.755	136	16.0	68.5	18.2	0.004	7464	7256	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	57176	24	0.1	5.1	0.9	0.000	0.002	0.006	1.101	213813	50.3	3.740	141	15.3	66.3	16.2	0.004	7208	6971	ma110501_rel_withdbg.cz11b_c24r64
796	57649	0	0.0	5.1	0.9	0.000	0.000	0.006	1.094	217156	50.6	3.767	140	16.6	69.0	18.9	0.004	7245	7051	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	57396	27	0.1	10.8	1.0	0.000	0.002	0.014	1.323	215367	50.4	3.752	140	15.4	66.5	16.3	0.006	7240	6971	ma110600_rel_withdbg.cz11b_c24r64
796	57342	0	0.0	5.1	0.9	0.000	0.000	0.006	1.103	216360	50.3	3.773	140	15.9	68.4	18.2	0.006	7211	6984	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	99.249	0.732	0.019	nonzero	nonzero	0.017
ma100339_rel_withdbg.cz11a_c24r64	99.143	0.843	0.014	nonzero		0.014
ma100434_rel_withdbg.cz11a_c24r64	99.006	0.976	0.017	nonzero		0.013
ma100525_rel_withdbg.cz11a_c24r64	99.289	0.702	0.010			0.004
ma100618_rel_withdbg.cz11a_c24r64	99.320	0.674	0.006			0.004
ma101108_rel_withdbg.cz11a_c24r64	99.276	0.717	0.008	nonzero		0.004
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	99.254	0.738	0.008	nonzero		0.007
ma110402_rel_withdbg.cz11b_c24r64	99.279	0.713	0.009			0.004
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	99.242	0.750	0.008	nonzero		0.005
ma110501_rel_withdbg.cz11b_c24r64	98.908	1.082	0.010	nonzero		0.008
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	98.951	1.042	0.008			0.004
ma110600_rel_withdbg.cz11b_c24r64	98.920	1.071	0.009	nonzero		0.006
ma1106_240723_d8374262_ilwas.cz11b_c24r64	98.900	1.091	0.009	nonzero		0.005

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.010	97.542	2.431	0.017	0.028
ma100339_rel_withdbg.cz11a_c24r64		97.247	2.747	0.007	0.018
ma100434_rel_withdbg.cz11a_c24r64	0.003	97.344	2.649	0.003	0.019
ma100525_rel_withdbg.cz11a_c24r64		99.788	0.212		0.005
ma100618_rel_withdbg.cz11a_c24r64	0.003	95.611	4.385		0.006
ma101108_rel_withdbg.cz11a_c24r64	0.028	77.042	22.931		0.008
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.010	61.639	38.351		0.008
ma110402_rel_withdbg.cz11b_c24r64	0.125	91.375	8.500		0.008
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.017	71.941	28.042		0.008
ma110501_rel_withdbg.cz11b_c24r64	0.007	81.181	18.812		0.007
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.420	97.066	2.514		0.006
ma110600_rel_withdbg.cz11b_c24r64		55.323	44.677		0.009
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.014	94.031	5.955		0.006

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.795	97.281	1.913	0.010	0.025
ma100339_rel_withdbg.cz11a_c24r64	1.708	96.385	1.903	0.003	0.017
ma100434_rel_withdbg.cz11a_c24r64	1.611	96.406	1.983		0.013
ma100525_rel_withdbg.cz11a_c24r64	0.486	99.424	0.090		0.005
ma100618_rel_withdbg.cz11a_c24r64	0.420	97.934	1.646		0.006
ma101108_rel_withdbg.cz11a_c24r64	0.378	84.531	15.090		0.008
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.250	72.792	26.958		0.007
ma110402_rel_withdbg.cz11b_c24r64	0.545	94.465	4.990		0.013
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.361	78.757	20.882		0.008
ma110501_rel_withdbg.cz11b_c24r64	0.201	87.427	12.372		0.007
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	5.118	93.455	1.427		0.007
ma110600_rel_withdbg.cz11b_c24r64	0.073	62.788	37.139		0.009
ma1106_240723_d8374262_ilwas.cz11b_c24r64	1.403	95.174	3.424		0.006

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	49910	0	0.0	6035.9	182.7	0.000	0.000	7.583	235.018	194248	50.3	3.892	161	21.6	74.3	25.2	0.017	6281	6089	ma100244_rel_withdbg.cz11a_c24r64
796	49022	0	0.0	6013.0	182.0	0.000	0.000	7.554	234.109	193491	50.2	3.947	164	20.1	72.3	23.2	0.014	6139	5946	ma100339_rel_withdbg.cz11a_c24r64
796	47390	0	0.0	6014.1	182.0	0.000	0.000	7.555	234.189	186741	50.1	3.940	169	20.1	72.3	NA	0.013	5946	5770	ma100434_rel_withdbg.cz11a_c24r64
796	48658	0	0.0	5.0	0.9	0.000	0.000	0.006	1.096	191343	49.2	3.932	162	19.6	71.9	20.9	0.004	6105	5915	ma100525_rel_withdbg.cz11a_c24r64
796	48748	0	0.0	10.4	1.0	0.000	0.000	0.013	1.292	190109	49.1	3.900	161	17.0	69.4	19.4	0.004	6121	5914	ma100618_rel_withdbg.cz11a_c24r64
796	47801	23	0.1	5.0	0.8	0.000	0.002	0.006	1.090	186157	48.9	3.894	164	16.0	67.8	16.5	0.004	6010	5802	ma101108_rel_withdbg.cz11a_c24r64
796	48102	0	0.0	10.6	1.0	0.000	0.000	0.013	1.327	187610	49.1	3.900	163	17.1	69.4	19.3	0.007	6042	5850	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	48089	23	0.1	10.8	1.0	0.000	0.002	0.014	1.323	186848	48.9	3.885	163	15.2	66.4	16.3	0.004	6042	5877	ma110402_rel_withdbg.cz11b_c24r64
796	48116	0	0.0	5.1	0.9	0.000	0.000	0.006	1.097	187351	48.9	3.894	163	16.0	68.5	18.2	0.005	6027	5850	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	45308	26	0.1	10.8	1.0	0.001	0.002	0.014	1.317	175789	48.8	3.880	172	15.3	66.3	16.2	0.008	5690	5532	ma110501_rel_withdbg.cz11b_c24r64
796	45488	0	0.0	5.1	0.9	0.000	0.000	0.006	1.098	176287	48.9	3.875	172	16.6	69.0	19.0	0.004	5706	5546	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	45326	23	0.1	10.8	1.0	0.001	0.002	0.014	1.317	176110	48.9	3.885	173	15.4	66.5	16.3	0.006	5676	5498	ma110600_rel_withdbg.cz11b_c24r64
796	45113	0	0.0	5.1	0.9	0.000	0.000	0.006	1.105	175033	48.9	3.880	173	15.9	68.4	18.2	0.005	5658	5498	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	99.102	0.812	0.083	0.003	nonzero	0.023
ma100339_rel_withdbg.cz11a_c24r64	99.244	0.691	0.063	0.002	nonzero	0.019
ma100434_rel_withdbg.cz11a_c24r64	99.046	0.882	0.070	0.002	nonzero	0.023
ma100525_rel_withdbg.cz11a_c24r64	99.800	0.187	0.013	nonzero	nonzero	0.019
ma100618_rel_withdbg.cz11a_c24r64	99.801	0.191	0.006	0.002	nonzero	0.033
ma101108_rel_withdbg.cz11a_c24r64	99.536	0.450	0.012	0.002	nonzero	0.033
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	99.884	0.109	0.005	0.002	nonzero	0.033
ma110402_rel_withdbg.cz11b_c24r64	99.567	0.421	0.012	nonzero	nonzero	0.016
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	99.881	0.115	0.004	nonzero	nonzero	0.036
ma110501_rel_withdbg.cz11b_c24r64	99.476	0.512	0.012	nonzero	nonzero	0.018
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	99.862	0.134	0.005	nonzero		0.015
ma110600_rel_withdbg.cz11b_c24r64	99.499	0.488	0.012	nonzero	nonzero	0.020
ma1106_240723_d8374262_ilwas.cz11b_c24r64	99.856	0.139	0.004	nonzero	nonzero	0.022

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.182	95.056	4.737	0.024	0.041
ma100339_rel_withdbg.cz11a_c24r64	0.133	95.524	4.329	0.015	0.037
ma100434_rel_withdbg.cz11a_c24r64	0.073	95.669	4.242	0.017	0.031
ma100525_rel_withdbg.cz11a_c24r64	0.003	56.354	43.590	0.053	0.035
ma100618_rel_withdbg.cz11a_c24r64	0.408	83.742	15.809	0.042	0.034
ma101108_rel_withdbg.cz11a_c24r64	0.044	56.171	43.742	0.043	0.035
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.235	51.901	47.808	0.056	0.031
ma110402_rel_withdbg.cz11b_c24r64	0.028	49.190	50.745	0.036	0.052
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.162	43.905	55.863	0.071	0.045
ma110501_rel_withdbg.cz11b_c24r64	0.033	43.537	56.405	0.025	0.033
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.160	47.462	52.324	0.055	0.043
ma110600_rel_withdbg.cz11b_c24r64	0.040	50.987	48.937	0.036	0.043
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.138	46.969	52.849	0.044	0.029

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	1.702	94.831	3.449	0.019	0.037
ma100339_rel_withdbg.cz11a_c24r64	4.929	92.126	2.931	0.013	0.037
ma100434_rel_withdbg.cz11a_c24r64	4.207	92.866	2.916	0.011	0.028
ma100525_rel_withdbg.cz11a_c24r64	0.132	64.036	35.801	0.031	0.028
ma100618_rel_withdbg.cz11a_c24r64	0.762	89.319	9.892	0.027	0.030
ma101108_rel_withdbg.cz11a_c24r64	0.128	66.674	33.170	0.027	0.031
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.401	61.578	37.988	0.034	0.029
ma110402_rel_withdbg.cz11b_c24r64	0.113	58.227	41.636	0.024	0.027
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.224	50.564	49.178	0.035	0.027
ma110501_rel_withdbg.cz11b_c24r64	0.097	52.968	46.922	0.013	0.027
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.576	54.245	45.143	0.035	0.035
ma110600_rel_withdbg.cz11b_c24r64	0.131	61.020	38.826	0.022	0.028
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.240	53.677	46.048	0.035	0.029

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	56457	0	0.0	8515.3	260.6	0.000	0.000	2.140	67.059	219765	53.0	3.893	150	21.6	74.3	25.2	0.023	7067	6601	ma100244_rel_withdbg.cz11a_c24r64
3980	56610	0	0.0	8073.9	247.4	0.000	0.000	2.029	63.650	220212	52.5	3.890	148	20.1	72.3	23.2	0.019	7080	6601	ma100339_rel_withdbg.cz11a_c24r64
3980	54046	0	0.0	8828.6	270.2	0.000	0.000	2.218	69.519	212799	52.6	3.937	156	20.1	72.3	NA	0.023	6777	6361	ma100434_rel_withdbg.cz11a_c24r64
3980	58984	0	0.0	19.8	4.2	0.000	0.000	0.005	1.090	225044	52.4	3.815	142	19.6	71.9	20.9	0.019	7403	7128	ma100525_rel_withdbg.cz11a_c24r64
3980	58905	0	0.0	254.4	10.7	0.000	0.000	0.064	2.766	223244	51.9	3.790	141	17.0	69.4	19.4	0.033	7448	6920	ma100618_rel_withdbg.cz11a_c24r64
3980	56366	118	0.5	254.1	10.8	0.002	0.008	0.064	2.781	210830	51.4	3.740	146	16.0	67.8	16.6	0.033	7096	6553	ma101108_rel_withdbg.cz11a_c24r64
3980	59036	0	0.0	256.1	10.9	0.000	0.000	0.064	2.812	224361	52.4	3.800	142	17.1	69.4	19.4	0.033	7448	6953	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	56684	121	0.5	255.2	10.8	0.002	0.009	0.064	2.781	211942	51.5	3.739	145	15.2	66.4	16.3	0.016	7096	6660	ma110402_rel_withdbg.cz11b_c24r64
3980	58806	0	0.0	262.3	10.9	0.000	0.000	0.066	2.817	223787	52.4	3.806	143	16.0	68.5	18.3	0.036	7371	7128	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	54949	126	0.5	254.8	10.8	0.002	0.009	0.064	2.778	206497	51.5	3.758	150	15.3	66.3	16.3	0.018	6931	6507	ma110501_rel_withdbg.cz11b_c24r64
3980	56843	0	0.0	263.8	11.0	0.000	0.000	0.066	2.827	216011	52.4	3.800	147	16.6	69.0	19.0	0.015	7099	6873	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	54857	121	0.5	251.6	10.7	0.002	0.009	0.063	2.758	205239	51.6	3.741	151	15.4	66.5	16.3	0.020	6905	6441	ma110600_rel_withdbg.cz11b_c24r64
3980	56517	0	0.0	252.0	10.7	0.000	0.000	0.063	2.756	214904	52.3	3.802	148	15.9	68.4	18.3	0.022	7079	6809	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	98.586	1.306	0.104	0.004	nonzero	0.017
ma100339_rel_withdbg.cz11a_c24r64	98.514	1.403	0.082	0.001	nonzero	0.019
ma100434_rel_withdbg.cz11a_c24r64	98.407	1.508	0.084	0.001		0.016
ma100525_rel_withdbg.cz11a_c24r64	98.256	1.703	0.040	nonzero		0.009
ma100618_rel_withdbg.cz11a_c24r64	98.428	1.553	0.019	nonzero		0.011
ma101108_rel_withdbg.cz11a_c24r64	98.350	1.628	0.021	nonzero		0.010
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	98.296	1.687	0.017	nonzero		0.011
ma110402_rel_withdbg.cz11b_c24r64	98.359	1.617	0.024	0.001		0.010
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	98.265	1.716	0.019	nonzero		0.009
ma110501_rel_withdbg.cz11b_c24r64	97.800	2.175	0.025	nonzero		0.012
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	97.707	2.273	0.019	nonzero		0.009
ma110600_rel_withdbg.cz11b_c24r64	97.841	2.134	0.025	0.001		0.010
ma1106_240723_d8374262_ilwas.cz11b_c24r64	97.664	2.314	0.021	nonzero		0.009

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.133	94.099	5.734	0.034	0.030
ma100339_rel_withdbg.cz11a_c24r64	0.115	95.580	4.284	0.021	0.057
ma100434_rel_withdbg.cz11a_c24r64	0.125	95.935	3.926	0.014	0.036
ma100525_rel_withdbg.cz11a_c24r64	0.001	51.394	48.582	0.023	0.032
ma100618_rel_withdbg.cz11a_c24r64	0.454	85.808	13.694	0.044	0.027
ma101108_rel_withdbg.cz11a_c24r64	0.028	52.990	46.942	0.039	0.027
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.125	40.114	59.708	0.053	0.030
ma110402_rel_withdbg.cz11b_c24r64	0.010	43.119	56.824	0.047	0.030
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.097	35.429	64.415	0.059	0.032
ma110501_rel_withdbg.cz11b_c24r64	0.029	45.725	54.191	0.055	0.032
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.148	42.808	57.003	0.041	0.029
ma110600_rel_withdbg.cz11b_c24r64	0.031	47.878	52.040	0.051	0.040
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.082	41.187	58.700	0.031	0.037

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	1.203	94.483	4.292	0.023	0.027
ma100339_rel_withdbg.cz11a_c24r64	3.451	93.641	2.897	0.010	0.057
ma100434_rel_withdbg.cz11a_c24r64	4.497	92.928	2.564	0.012	0.036
ma100525_rel_withdbg.cz11a_c24r64	0.021	60.675	39.283	0.022	0.028
ma100618_rel_withdbg.cz11a_c24r64	0.655	91.099	8.221	0.026	0.027
ma101108_rel_withdbg.cz11a_c24r64	0.084	64.676	35.206	0.033	0.027
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.279	50.262	49.428	0.031	0.031
ma110402_rel_withdbg.cz11b_c24r64	0.057	53.001	46.907	0.035	0.028
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.104	41.513	58.344	0.040	0.035
ma110501_rel_withdbg.cz11b_c24r64	0.112	55.708	44.139	0.041	0.029
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.226	49.101	50.635	0.037	0.032
ma110600_rel_withdbg.cz11b_c24r64	0.099	58.710	41.153	0.038	0.033
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.163	47.779	52.030	0.028	0.029

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	48532	0	0.0	8004.3	245.2	0.000	0.000	2.011	63.091	192900	52.4	3.975	173	21.6	74.3	25.3	0.017	6073	5851	ma100244_rel_withdbg.cz11a_c24r64
3980	47898	0	0.0	8844.8	270.7	0.000	0.000	2.222	69.636	191632	52.3	4.001	175	20.1	72.3	23.2	0.019	6025	5818	ma100339_rel_withdbg.cz11a_c24r64
3980	46416	0	0.0	8826.4	270.1	0.000	0.000	2.218	69.497	184759	52.4	3.981	181	20.1	72.3	NA	0.016	5818	5626	ma100434_rel_withdbg.cz11a_c24r64
3980	47552	0	0.0	20.4	4.2	0.000	0.000	0.005	1.089	193475	50.7	4.069	171	19.6	71.9	20.9	0.009	5947	5754	ma100525_rel_withdbg.cz11a_c24r64
3980	47570	0	0.0	424.8	15.7	0.000	0.000	0.107	4.033	192140	50.4	4.039	170	17.0	69.4	19.4	0.011	5963	5770	ma100618_rel_withdbg.cz11a_c24r64
3980	46509	123	0.5	434.4	16.0	0.003	0.011	0.109	4.115	184627	50.1	3.970	172	16.0	67.8	16.6	0.010	5849	5645	ma101108_rel_withdbg.cz11a_c24r64
3980	46979	0	0.0	435.4	16.1	0.000	0.000	0.109	4.136	190537	50.5	4.056	172	17.1	69.4	19.4	0.011	5898	5705	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	46940	122	0.5	437.4	16.0	0.003	0.010	0.110	4.119	187350	50.2	3.991	171	15.2	66.4	16.3	0.010	5913	5722	ma110402_rel_withdbg.cz11b_c24r64
3982	47105	0	0.0	434.0	16.0	0.000	0.000	0.109	4.107	191650	50.5	4.069	172	16.0	68.5	18.2	0.009	5902	5706	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	44165	130	0.5	435.5	16.0	0.003	0.012	0.109	4.109	176514	50.0	3.997	181	15.3	66.3	16.3	0.012	5533	5369	ma110501_rel_withdbg.cz11b_c24r64
3980	44410	0	0.0	434.5	16.0	0.000	0.000	0.109	4.127	180086	50.3	4.055	181	16.6	69.0	18.9	0.009	5573	5386	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	44171	125	0.5	437.6	16.0	0.003	0.011	0.110	4.129	176056	49.9	3.986	181	15.4	66.5	16.3	0.010	5514	5340	ma110600_rel_withdbg.cz11b_c24r64
3980	44006	0	0.0	440.7	16.2	0.000	0.000	0.111	4.164	178653	50.3	4.060	183	15.9	68.4	18.2	0.009	5530	5370	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	98.808	1.034	0.147	0.012	nonzero	0.029
ma100339_rel_withdbg.cz11a_c24r64	98.809	1.043	0.141	0.007	nonzero	0.040
ma100434_rel_withdbg.cz11a_c24r64	98.604	1.247	0.142	0.007	nonzero	0.028
ma100525_rel_withdbg.cz11a_c24r64	99.571	0.406	0.023	nonzero		0.010
ma100618_rel_withdbg.cz11a_c24r64	99.572	0.411	0.012	0.005	nonzero	0.044
ma101108_rel_withdbg.cz11a_c24r64	98.641	1.328	0.024	0.006	nonzero	0.026
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	99.786	0.198	0.010	0.006	nonzero	0.051
ma110402_rel_withdbg.cz11b_c24r64	98.643	1.331	0.025	0.001	nonzero	0.019
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	99.773	0.217	0.009	0.001	nonzero	0.024
ma110501_rel_withdbg.cz11b_c24r64	98.506	1.470	0.023	0.001	nonzero	0.030
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	99.745	0.245	0.009	0.001	nonzero	0.052
ma110600_rel_withdbg.cz11b_c24r64	98.558	1.415	0.025	0.001	nonzero	0.022
ma1106_240723_d8374262_ilwas.cz11b_c24r64	99.725	0.264	0.010	0.001	nonzero	0.017

dbms	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.049	73.712	25.913	0.326	0.045
ma100339_rel_withdbg.cz11a_c24r64	0.035	79.381	20.471	0.113	0.045
ma100434_rel_withdbg.cz11a_c24r64	0.035	80.731	19.120	0.114	0.046
ma100525_rel_withdbg.cz11a_c24r64	0.088	62.955	36.823	0.134	0.032
ma100618_rel_withdbg.cz11a_c24r64	0.644	80.627	18.673	0.055	0.046
ma101108_rel_withdbg.cz11a_c24r64	0.057	55.969	43.882	0.092	0.059
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.868	58.525	40.464	0.143	0.062
ma110402_rel_withdbg.cz11b_c24r64	0.057	51.555	48.268	0.121	0.058
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.544	53.935	45.339	0.182	0.057
ma110501_rel_withdbg.cz11b_c24r64	0.059	47.125	52.700	0.116	0.050
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.550	55.324	43.988	0.138	0.061
ma110600_rel_withdbg.cz11b_c24r64	0.099	52.343	47.433	0.126	0.035
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.455	55.293	44.085	0.167	0.035

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.252	76.480	23.003	0.266		0.042
ma100339_rel_withdbg.cz11a_c24r64	0.701	81.989	17.230	0.080		0.045
ma100434_rel_withdbg.cz11a_c24r64	0.794	82.947	16.175	0.084		0.045
ma100525_rel_withdbg.cz11a_c24r64	0.802	68.335	30.803	0.059		0.031
ma100618_rel_withdbg.cz11a_c24r64	1.277	86.067	12.622	0.033		0.046
ma101108_rel_withdbg.cz11a_c24r64	0.262	64.099	35.587	0.052		0.057
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	2.366	64.066	33.490	0.078	nonzero	0.064
ma110402_rel_withdbg.cz11b_c24r64	0.228	58.291	41.403	0.077		0.058
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.810	57.945	41.113	0.132		0.054
ma110501_rel_withdbg.cz11b_c24r64	0.244	54.701	44.985	0.069		0.051
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	1.264	59.210	39.430	0.096	nonzero	0.065
ma110600_rel_withdbg.cz11b_c24r64	0.415	60.266	39.243	0.076		0.032
ma1106_240723_d8374262_ilwas.cz11b_c24r64	1.048	59.091	39.740	0.122		0.032

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	55319	0	0.0	7572.1	235.8	0.000	0.000	0.951	30.328	214833	54.8	3.883	158	21.6	74.3	25.3	0.029	6931	6425	ma100244_rel_withdbg.cz11a_c24r64
7960	55016	0	0.0	8064.7	250.9	0.000	0.000	1.013	32.279	215522	54.4	3.917	158	20.1	72.3	23.3	0.040	6904	6380	ma100339_rel_withdbg.cz11a_c24r64
7960	52746	0	0.0	8521.9	264.7	0.000	0.000	1.071	34.056	207957	54.4	3.943	165	20.1	72.3	NA	0.028	6633	6201	ma100434_rel_withdbg.cz11a_c24r64
7960	58084	0	0.0	38.2	8.5	0.000	0.000	0.005	1.089	222098	54.5	3.824	150	19.6	71.9	20.9	0.010	7290	7048	ma100525_rel_withdbg.cz11a_c24r64
7960	57900	0	0.0	543.1	22.2	0.000	0.000	0.068	2.862	223397	53.9	3.858	149	17.0	69.4	19.4	0.044	7320	6745	ma100618_rel_withdbg.cz11a_c24r64
7960	53861	254	1.0	669.0	26.2	0.005	0.019	0.084	3.372	210762	52.4	3.913	156	16.0	67.8	16.6	0.026	6763	6297	ma101108_rel_withdbg.cz11a_c24r64
7965	58123	0	0.0	685.4	26.8	0.000	0.000	0.086	3.442	223879	54.5	3.852	150	17.1	69.4	19.4	0.051	7336	6857	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	54072	262	1.0	675.3	26.3	0.005	0.019	0.085	3.386	211383	52.6	3.909	156	15.2	66.4	16.3	0.019	6777	6329	ma110402_rel_withdbg.cz11b_c24r64
7960	57937	0	0.0	655.5	25.8	0.000	0.000	0.082	3.317	223750	54.7	3.862	151	16.0	68.5	18.2	0.024	7304	7017	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	52488	269	1.1	668.5	26.1	0.005	0.021	0.084	3.361	206456	52.6	3.933	160	15.3	66.3	16.3	0.030	6585	6137	ma110501_rel_withdbg.cz11b_c24r64
7960	56034	0	0.0	671.2	26.2	0.000	0.000	0.084	3.377	216079	54.5	3.856	156	16.6	69.0	18.9	0.052	7048	6809	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	52648	263	1.0	674.5	26.3	0.005	0.020	0.085	3.386	205469	52.6	3.903	160	15.4	66.5	16.3	0.022	6585	6185	ma110600_rel_withdbg.cz11b_c24r64
7960	55688	0	0.0	668.5	26.2	0.000	0.000	0.084	3.370	215067	54.4	3.862	156	15.9	68.4	18.3	0.017	7016	6729	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel_withdbg.cz11a_c24r64	98.136	1.684	0.169	0.011	nonzero	0.022
ma100339_rel_withdbg.cz11a_c24r64	98.179	1.651	0.164	0.006	nonzero	0.020
ma100434_rel_withdbg.cz11a_c24r64	98.039	1.793	0.161	0.007	nonzero	0.021
ma100525_rel_withdbg.cz11a_c24r64	96.791	3.137	0.071	nonzero	nonzero	0.019
ma100618_rel_withdbg.cz11a_c24r64	97.707	2.266	0.027	nonzero	nonzero	0.027
ma101108_rel_withdbg.cz11a_c24r64	98.115	1.855	0.030	nonzero		0.012
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	97.267	2.710	0.023	nonzero	nonzero	0.020
ma110402_rel_withdbg.cz11b_c24r64	97.803	2.164	0.033	nonzero	nonzero	0.018
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	97.232	2.745	0.023	nonzero		0.009
ma110501_rel_withdbg.cz11b_c24r64	97.102	2.861	0.037	nonzero	nonzero	0.017
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	96.383	3.590	0.026	nonzero		0.012
ma110600_rel_withdbg.cz11b_c24r64	97.049	2.916	0.035	nonzero		0.010
ma1106_240723_d8374262_ilwas.cz11b_c24r64	96.295	3.678	0.026	nonzero		0.011

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.050	74.704	24.934	0.312		0.053
ma100339_rel_withdbg.cz11a_c24r64	0.024	80.285	19.583	0.108		0.043
ma100434_rel_withdbg.cz11a_c24r64	0.040	79.760	20.076	0.123		0.040
ma100525_rel_withdbg.cz11a_c24r64	0.042	44.523	54.637	0.797	nonzero	0.068
ma100618_rel_withdbg.cz11a_c24r64	0.523	81.648	17.782	0.047		0.043
ma101108_rel_withdbg.cz11a_c24r64	0.045	54.906	44.920	0.129		0.041
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	0.398	43.608	55.855	0.139		0.048
ma110402_rel_withdbg.cz11b_c24r64	0.026	49.763	50.070	0.141	0.001	0.072
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.257	40.651	58.981	0.111		0.035
ma110501_rel_withdbg.cz11b_c24r64	0.041	46.029	53.783	0.147		0.039
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.239	40.551	59.099	0.112		0.033
ma110600_rel_withdbg.cz11b_c24r64	0.042	50.135	49.727	0.097		0.033
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.184	41.365	58.353	0.099		0.049

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel_withdbg.cz11a_c24r64	0.261	77.373	22.129	0.237		0.056
ma100339_rel_withdbg.cz11a_c24r64	0.622	82.860	16.433	0.084		0.041
ma100434_rel_withdbg.cz11a_c24r64	0.545	82.443	16.911	0.100		0.045
ma100525_rel_withdbg.cz11a_c24r64	0.407	50.711	48.369	0.512	nonzero	0.065
ma100618_rel_withdbg.cz11a_c24r64	0.975	87.660	11.331	0.034		0.036
ma101108_rel_withdbg.cz11a_c24r64	0.192	63.362	36.374	0.073		0.041
ma1011_240723_c944cd6e_ilwas.cz11a_c24r64	1.095	49.728	49.100	0.076		0.051
ma110402_rel_withdbg.cz11b_c24r64	0.130	56.517	43.272	0.081		0.063
ma1104_240723_2ee061c2_ilwas.cz11b_c24r64	0.541	44.145	55.241	0.073		0.035
ma110501_rel_withdbg.cz11b_c24r64	0.180	53.419	46.304	0.098		0.040
ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64	0.573	44.183	55.172	0.072		0.033
ma110600_rel_withdbg.cz11b_c24r64	0.159	57.850	41.931	0.060		0.032
ma1106_240723_d8374262_ilwas.cz11b_c24r64	0.575	45.066	54.292	0.066		0.052

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	47761	0	0.0	8598.7	266.7	0.000	0.000	1.080	34.307	188592	54.8	3.949	184	21.6	74.3	25.3	0.022	5978	5705	ma100244_rel_withdbg.cz11a_c24r64
7960	47263	0	0.0	6895.4	215.7	0.000	0.000	0.866	27.744	184267	54.0	3.899	183	20.1	72.3	23.3	0.020	5930	5674	ma100339_rel_withdbg.cz11a_c24r64
7960	45709	0	0.0	8302.8	258.2	0.000	0.000	1.043	33.210	179087	54.3	3.918	190	20.1	72.3	NA	0.021	5769	5468	ma100434_rel_withdbg.cz11a_c24r64
7960	45705	0	0.0	4233.0	130.3	0.000	0.000	0.532	16.762	210194	53.2	4.599	186	19.6	71.9	20.9	0.019	5754	5420	ma100525_rel_withdbg.cz11a_c24r64
7965	46816	0	0.0	685.3	26.4	0.000	0.000	0.086	3.395	190538	52.1	4.070	178	17.0	69.4	19.4	0.027	5820	5626	ma100618_rel_withdbg.cz11a_c24r64
7960	46218	256	1.0	567.3	23.1	0.006	0.022	0.071	2.973	176452	52.2	3.818	181	16.0	67.8	16.6	0.012	5818	5530	ma101108_rel_withdbg.cz11a_c24r64
7960	45786	0	0.0	567.3	23.2	0.000	0.000	0.071	2.979	193394	52.4	4.224	183	17.1	69.4	19.4	0.020	5769	5530	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	46314	265	1.0	572.7	23.2	0.006	0.023	0.072	2.989	182315	52.1	3.937	180	15.2	66.4	16.3	0.018	5786	5562	ma110402_rel_withdbg.cz11b_c24r64
7960	45951	0	0.0	582.7	23.5	0.000	0.000	0.073	3.022	195246	52.4	4.249	182	16.0	68.5	18.2	0.009	5770	5546	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	43524	273	1.1	578.5	23.4	0.006	0.025	0.073	3.011	172501	52.0	3.963	191	15.3	66.3	16.3	0.017	5437	5226	ma110501_rel_withdbg.cz11b_c24r64
7960	43426	0	0.0	565.4	23.0	0.000	0.000	0.071	2.960	184611	52.3	4.251	193	16.6	69.0	18.9	0.012	5434	5244	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	43507	266	1.0	569.1	23.1	0.006	0.024	0.071	2.976	172368	51.8	3.962	190	15.4	66.5	16.4	0.010	5420	5226	ma110600_rel_withdbg.cz11b_c24r64
7960	43018	0	0.0	559.8	22.9	0.000	0.000	0.070	2.943	182798	52.1	4.249	194	15.9	68.4	18.3	0.011	5388	5194	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
601504	0	0	0.0	1962.0	179.5	0.000	0.000	0.003	0.306	62350	53.6	0.104	14	5.3	56.1	6.7	0.668	91302	41256	ma100244_rel_withdbg.cz11a_c24r64
481928	0	0	0.0	1541.8	152.3	0.000	0.000	0.003	0.324	56530	70.7	0.117	23	5.3	56.1	6.8	0.684	69739	31067	ma100339_rel_withdbg.cz11a_c24r64
496894	0	0	0.0	1674.1	159.7	0.000	0.000	0.003	0.329	59167	70.6	0.119	23	5.3	56.1	NA	0.532	73122	34278	ma100434_rel_withdbg.cz11a_c24r64
388350	0	0	0.0	2651.3	120.2	0.000	0.000	0.007	0.317	384651	57.6	0.990	24	5.3	56.1	6.8	0.445	53842	34573	ma100525_rel_withdbg.cz11a_c24r64
434783	0	0	0.0	1276.3	105.0	0.000	0.000	0.003	0.247	478073	60.5	1.100	22	5.3	56.1	6.1	0.447	59254	39670	ma100618_rel_withdbg.cz11a_c24r64
344828	0	0	0.0	1091.1	86.7	0.000	0.000	0.003	0.258	222418	48.1	0.645	22	5.3	56.1	5.7	0.446	45362	29876	ma101108_rel_withdbg.cz11a_c24r64
317460	0	0	0.0	1021.2	79.9	0.000	0.000	0.003	0.258	256255	52.6	0.807	27	5.3	56.1	6.0	0.430	40568	25872	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
337553	0	0	0.0	1072.9	84.8	0.000	0.000	0.003	0.257	246747	47.8	0.731	23	5.3	56.1	6.3	0.454	44253	29768	ma110402_rel_withdbg.cz11b_c24r64
306513	0	0	0.0	983.4	77.0	0.000	0.000	0.003	0.257	288857	52.0	0.942	27	5.3	56.1	5.8	0.452	39358	25872	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
320000	0	0	0.0	1023.7	80.8	0.000	0.000	0.003	0.259	246888	47.5	0.772	24	5.3	56.1	6.0	0.456	41655	28569	ma110501_rel_withdbg.cz11b_c24r64
322581	0	0	0.0	1041.6	81.7	0.000	0.000	0.003	0.259	263610	51.8	0.817	26	5.3	56.1	6.1	0.378	41855	28170	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
330578	0	0	0.0	1050.7	83.2	0.000	0.000	0.003	0.258	242485	47.4	0.734	23	5.3	56.1	6.2	0.447	42954	29369	ma110600_rel_withdbg.cz11b_c24r64
307692	0	0	0.0	990.7	78.2	0.000	0.000	0.003	0.260	292754	51.0	0.951	27	5.3	56.1	5.8	0.432	39657	27478	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
987656	0	0	0.0	3895.3	724.0	0.000	0.000	0.004	0.751	23425	23.8	0.024	4	12.2	63.0	11.2	0.004	NA	NA	ma100244_rel_withdbg.cz11a_c24r64
987656	0	0	0.0	3834.5	720.6	0.000	0.000	0.004	0.747	34871	24.3	0.035	4	12.2	63.0	10.9	0.004	NA	NA	ma100339_rel_withdbg.cz11a_c24r64
987656	0	0	0.0	3919.9	724.2	0.000	0.000	0.004	0.751	31292	24.1	0.032	4	12.0	62.8	NA	0.001	NA	NA	ma100434_rel_withdbg.cz11a_c24r64
930234	0	0	0.0	1527.6	622.0	0.000	0.000	0.002	0.685	3347	25.8	0.004	4	12.0	62.8	10.3	0.001	NA	NA	ma100525_rel_withdbg.cz11a_c24r64
975611	0	0	0.0	4308.4	692.1	0.000	0.000	0.004	0.726	14322	25.9	0.015	4	11.2	62.1	10.0	0.001	NA	NA	ma100618_rel_withdbg.cz11a_c24r64
975611	0	0	0.0	3933.3	685.2	0.000	0.000	0.004	0.719	12374	27.0	0.013	4	11.2	62.1	9.7	0.001	NA	NA	ma101108_rel_withdbg.cz11a_c24r64
919541	0	0	0.0	4122.5	657.8	0.000	0.000	0.004	0.733	13243	27.4	0.014	5	11.2	62.1	9.5	0.001	NA	NA	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
975611	0	0	0.0	3850.4	684.9	0.000	0.000	0.004	0.719	12391	27.2	0.013	4	11.2	62.1	9.8	0.001	NA	NA	ma110402_rel_withdbg.cz11b_c24r64
963857	0	0	0.0	3988.1	687.1	0.000	0.000	0.004	0.730	12306	28.4	0.013	5	11.2	62.1	9.6	0.001	NA	NA	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
975611	0	0	0.0	3917.0	687.2	0.000	0.000	0.004	0.721	11971	27.1	0.012	4	11.2	62.1	9.9	0.002	NA	NA	ma110501_rel_withdbg.cz11b_c24r64
919541	0	0	0.0	4088.4	657.3	0.000	0.000	0.004	0.732	13478	27.6	0.015	5	11.2	62.1	9.9	0.002	NA	NA	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
975611	0	0	0.0	4076.8	688.9	0.000	0.000	0.004	0.723	12738	27.1	0.013	4	11.2	62.1	9.5	0.002	NA	NA	ma110600_rel_withdbg.cz11b_c24r64
941178	0	0	0.0	4133.9	659.5	0.000	0.000	0.004	0.718	13467	28.9	0.014	5	11.2	62.1	9.6	0.001	NA	NA	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
103426	0	0	0.0	5258.4	223.6	0.000	0.000	0.051	2.214	41456	84.3	0.401	130	21.6	74.3	24.9	0.682	14235	200	ma100244_rel_withdbg.cz11a_c24r64
100787	0	0	0.0	4886.4	216.2	0.000	0.000	0.048	2.197	44966	76.6	0.446	122	20.1	72.3	22.9	0.683	15833	200	ma100339_rel_withdbg.cz11a_c24r64
103593	0	0	0.0	5050.2	222.8	0.000	0.000	0.049	2.203	46188	76.1	0.446	118	20.1	72.3	NA	0.713	16338	150	ma100434_rel_withdbg.cz11a_c24r64
67912	0	0	0.0	9754.5	318.9	0.000	0.000	0.144	4.808	531668	67.2	7.829	158	19.6	71.9	21.0	0.742	9040	200	ma100525_rel_withdbg.cz11a_c24r64
81967	0	0	0.0	8432.4	308.9	0.000	0.000	0.103	3.860	594816	73.4	7.257	143	17.0	69.4	19.7	0.735	10538	4595	ma100618_rel_withdbg.cz11a_c24r64
71190	0	2644	10.3	6714.8	260.8	0.037	0.149	0.094	3.752	295989	54.8	4.158	123	16.0	67.8	16.9	0.728	8990	5646	ma101108_rel_withdbg.cz11a_c24r64
65884	0	0	0.0	6990.8	251.0	0.000	0.000	0.106	3.901	338770	68.8	5.142	167	17.1	69.4	19.6	1.061	8392	3746	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
67868	0	2621	10.2	6568.3	251.5	0.039	0.154	0.097	3.794	314418	53.9	4.633	127	15.2	66.4	16.5	0.650	8590	5744	ma110402_rel_withdbg.cz11b_c24r64
63732	0	0	0.0	6841.5	250.4	0.000	0.000	0.107	4.023	356516	67.2	5.594	169	16.0	68.5	18.6	0.728	8141	4196	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
65628	0	2584	10.1	6351.6	243.2	0.039	0.157	0.097	3.794	318520	54.1	4.853	132	15.3	66.3	16.4	0.650	8291	5694	ma110501_rel_withdbg.cz11b_c24r64
67955	0	0	0.0	7399.6	268.4	0.000	0.000	0.109	4.044	346090	66.6	5.093	157	16.6	69.0	19.3	0.707	8641	4492	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
68699	0	2621	10.2	6604.0	253.2	0.038	0.153	0.096	3.774	309160	53.7	4.500	125	15.4	66.5	16.5	0.707	8691	5993	ma110600_rel_withdbg.cz11b_c24r64
64843	0	0	0.0	6805.3	249.8	0.000	0.000	0.105	3.946	367669	66.7	5.670	165	15.9	68.4	18.6	0.661	8241	4345	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
51184	0	0	0.0	4619.7	198.2	0.000	0.000	0.090	3.966	170403	75.1	3.329	235	21.6	74.3	25.2	0.682	6905	185	ma100244_rel_withdbg.cz11a_c24r64
55710	0	0	0.0	4926.4	214.5	0.000	0.000	0.088	3.943	189159	73.5	3.395	211	20.1	72.3	23.2	0.678	7387	190	ma100339_rel_withdbg.cz11a_c24r64
55749	0	0	0.0	4805.3	209.1	0.000	0.000	0.086	3.841	190455	73.6	3.416	211	20.1	72.3	NA	0.626	7379	190	ma100434_rel_withdbg.cz11a_c24r64
50665	0	0	0.0	9204.9	317.3	0.000	0.000	0.182	6.413	348531	68.4	6.879	216	19.6	71.9	21.0	0.691	6625	190	ma100525_rel_withdbg.cz11a_c24r64
59480	0	0	0.0	5272.4	209.7	0.000	0.000	0.089	3.610	396907	70.4	6.673	189	17.0	69.4	19.8	0.594	7597	4860	ma100618_rel_withdbg.cz11a_c24r64
39005	0	3595	14.0	3578.5	142.7	0.092	0.369	0.092	3.747	274281	46.8	7.032	192	16.0	67.8	16.7	0.512	4935	3296	ma101108_rel_withdbg.cz11a_c24r64
35635	0	0	0.0	3311.3	131.8	0.000	0.000	0.093	3.787	480863	58.2	13.494	261	17.1	69.4	19.7	0.543	4507	3097	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
38168	0	3552	13.9	3523.6	139.9	0.093	0.372	0.092	3.753	279046	46.5	7.311	195	15.2	66.4	16.4	0.503	4824	3316	ma110402_rel_withdbg.cz11b_c24r64
34587	0	0	0.0	3137.6	125.1	0.000	0.000	0.091	3.703	476226	57.7	13.769	267	16.0	68.5	18.6	0.532	4351	3097	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
37436	0	3535	13.8	3451.9	137.3	0.094	0.378	0.092	3.755	286066	46.4	7.642	198	15.3	66.3	16.4	0.493	4731	3217	ma110501_rel_withdbg.cz11b_c24r64
34217	0	0	0.0	3095.6	123.6	0.000	0.000	0.090	3.700	476860	57.5	13.936	269	16.6	69.0	19.3	0.562	4295	2962	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
38369	0	3539	13.8	3532.0	140.5	0.092	0.369	0.092	3.751	275194	46.6	7.172	194	15.4	66.5	16.4	0.488	4855	3332	ma110600_rel_withdbg.cz11b_c24r64
34889	0	0	0.0	3165.7	126.2	0.000	0.000	0.091	3.705	475943	57.6	13.642	264	15.9	68.4	18.5	0.442	4385	3241	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	58716	0	0.0	6116.6	185.1	0.000	0.000	7.684	238.135	225476	50.8	3.840	138	21.6	74.3	25.3	0.022	7352	6955	ma100244_rel_withdbg.cz11a_c24r64
796	58228	0	0.0	6079.0	184.0	0.000	0.000	7.637	236.669	223715	50.8	3.842	140	20.1	72.3	23.2	0.019	7320	6909	ma100339_rel_withdbg.cz11a_c24r64
796	56065	0	0.0	6092.8	184.4	0.000	0.000	7.654	237.253	215266	50.8	3.840	145	20.1	72.3	NA	0.011	7000	6601	ma100434_rel_withdbg.cz11a_c24r64
796	59709	0	0.0	5.0	0.9	0.000	0.000	0.006	1.099	225873	50.7	3.783	136	19.6	71.9	20.8	0.004	7531	7288	ma100525_rel_withdbg.cz11a_c24r64
796	60249	0	0.0	5.0	0.8	0.000	0.000	0.006	1.080	226620	50.5	3.761	134	17.0	69.4	19.4	0.004	7576	7352	ma100618_rel_withdbg.cz11a_c24r64
796	58905	22	0.1	5.0	0.9	0.000	0.001	0.006	1.100	220422	50.4	3.742	137	16.0	67.8	16.5	0.006	7464	7240	ma101108_rel_withdbg.cz11a_c24r64
796	59908	0	0.0	5.1	0.9	0.000	0.000	0.006	1.114	225518	50.5	3.764	135	17.1	69.4	19.3	0.004	7544	7306	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	59251	24	0.1	5.1	0.9	0.000	0.002	0.006	1.104	222354	50.5	3.753	136	15.2	66.4	16.3	0.005	7442	7192	ma110402_rel_withdbg.cz11b_c24r64
796	59512	0	0.0	5.1	0.9	0.000	0.000	0.006	1.104	223467	50.5	3.755	136	16.0	68.5	18.2	0.004	7464	7256	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	57176	24	0.1	5.1	0.9	0.000	0.002	0.006	1.101	213813	50.3	3.740	141	15.3	66.3	16.2	0.004	7208	6971	ma110501_rel_withdbg.cz11b_c24r64
796	57649	0	0.0	5.1	0.9	0.000	0.000	0.006	1.094	217156	50.6	3.767	140	16.6	69.0	18.9	0.004	7245	7051	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	57396	27	0.1	10.8	1.0	0.000	0.002	0.014	1.323	215367	50.4	3.752	140	15.4	66.5	16.3	0.006	7240	6971	ma110600_rel_withdbg.cz11b_c24r64
796	57342	0	0.0	5.1	0.9	0.000	0.000	0.006	1.103	216360	50.3	3.773	140	15.9	68.4	18.2	0.006	7211	6984	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	49910	0	0.0	6035.9	182.7	0.000	0.000	7.583	235.018	194248	50.3	3.892	161	21.6	74.3	25.2	0.017	6281	6089	ma100244_rel_withdbg.cz11a_c24r64
796	49022	0	0.0	6013.0	182.0	0.000	0.000	7.554	234.109	193491	50.2	3.947	164	20.1	72.3	23.2	0.014	6139	5946	ma100339_rel_withdbg.cz11a_c24r64
796	47390	0	0.0	6014.1	182.0	0.000	0.000	7.555	234.189	186741	50.1	3.940	169	20.1	72.3	NA	0.013	5946	5770	ma100434_rel_withdbg.cz11a_c24r64
796	48658	0	0.0	5.0	0.9	0.000	0.000	0.006	1.096	191343	49.2	3.932	162	19.6	71.9	20.9	0.004	6105	5915	ma100525_rel_withdbg.cz11a_c24r64
796	48748	0	0.0	10.4	1.0	0.000	0.000	0.013	1.292	190109	49.1	3.900	161	17.0	69.4	19.4	0.004	6121	5914	ma100618_rel_withdbg.cz11a_c24r64
796	47801	23	0.1	5.0	0.8	0.000	0.002	0.006	1.090	186157	48.9	3.894	164	16.0	67.8	16.5	0.004	6010	5802	ma101108_rel_withdbg.cz11a_c24r64
796	48102	0	0.0	10.6	1.0	0.000	0.000	0.013	1.327	187610	49.1	3.900	163	17.1	69.4	19.3	0.007	6042	5850	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
796	48089	23	0.1	10.8	1.0	0.000	0.002	0.014	1.323	186848	48.9	3.885	163	15.2	66.4	16.3	0.004	6042	5877	ma110402_rel_withdbg.cz11b_c24r64
796	48116	0	0.0	5.1	0.9	0.000	0.000	0.006	1.097	187351	48.9	3.894	163	16.0	68.5	18.2	0.005	6027	5850	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
796	45308	26	0.1	10.8	1.0	0.001	0.002	0.014	1.317	175789	48.8	3.880	172	15.3	66.3	16.2	0.008	5690	5532	ma110501_rel_withdbg.cz11b_c24r64
796	45488	0	0.0	5.1	0.9	0.000	0.000	0.006	1.098	176287	48.9	3.875	172	16.6	69.0	19.0	0.004	5706	5546	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
796	45326	23	0.1	10.8	1.0	0.001	0.002	0.014	1.317	176110	48.9	3.885	173	15.4	66.5	16.3	0.006	5676	5498	ma110600_rel_withdbg.cz11b_c24r64
796	45113	0	0.0	5.1	0.9	0.000	0.000	0.006	1.105	175033	48.9	3.880	173	15.9	68.4	18.2	0.005	5658	5498	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	56457	0	0.0	8515.3	260.6	0.000	0.000	2.140	67.059	219765	53.0	3.893	150	21.6	74.3	25.2	0.023	7067	6601	ma100244_rel_withdbg.cz11a_c24r64
3980	56610	0	0.0	8073.9	247.4	0.000	0.000	2.029	63.650	220212	52.5	3.890	148	20.1	72.3	23.2	0.019	7080	6601	ma100339_rel_withdbg.cz11a_c24r64
3980	54046	0	0.0	8828.6	270.2	0.000	0.000	2.218	69.519	212799	52.6	3.937	156	20.1	72.3	NA	0.023	6777	6361	ma100434_rel_withdbg.cz11a_c24r64
3980	58984	0	0.0	19.8	4.2	0.000	0.000	0.005	1.090	225044	52.4	3.815	142	19.6	71.9	20.9	0.019	7403	7128	ma100525_rel_withdbg.cz11a_c24r64
3980	58905	0	0.0	254.4	10.7	0.000	0.000	0.064	2.766	223244	51.9	3.790	141	17.0	69.4	19.4	0.033	7448	6920	ma100618_rel_withdbg.cz11a_c24r64
3980	56366	118	0.5	254.1	10.8	0.002	0.008	0.064	2.781	210830	51.4	3.740	146	16.0	67.8	16.6	0.033	7096	6553	ma101108_rel_withdbg.cz11a_c24r64
3980	59036	0	0.0	256.1	10.9	0.000	0.000	0.064	2.812	224361	52.4	3.800	142	17.1	69.4	19.4	0.033	7448	6953	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	56684	121	0.5	255.2	10.8	0.002	0.009	0.064	2.781	211942	51.5	3.739	145	15.2	66.4	16.3	0.016	7096	6660	ma110402_rel_withdbg.cz11b_c24r64
3980	58806	0	0.0	262.3	10.9	0.000	0.000	0.066	2.817	223787	52.4	3.806	143	16.0	68.5	18.3	0.036	7371	7128	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	54949	126	0.5	254.8	10.8	0.002	0.009	0.064	2.778	206497	51.5	3.758	150	15.3	66.3	16.3	0.018	6931	6507	ma110501_rel_withdbg.cz11b_c24r64
3980	56843	0	0.0	263.8	11.0	0.000	0.000	0.066	2.827	216011	52.4	3.800	147	16.6	69.0	19.0	0.015	7099	6873	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	54857	121	0.5	251.6	10.7	0.002	0.009	0.063	2.758	205239	51.6	3.741	151	15.4	66.5	16.3	0.020	6905	6441	ma110600_rel_withdbg.cz11b_c24r64
3980	56517	0	0.0	252.0	10.7	0.000	0.000	0.063	2.756	214904	52.3	3.802	148	15.9	68.4	18.3	0.022	7079	6809	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	48532	0	0.0	8004.3	245.2	0.000	0.000	2.011	63.091	192900	52.4	3.975	173	21.6	74.3	25.3	0.017	6073	5851	ma100244_rel_withdbg.cz11a_c24r64
3980	47898	0	0.0	8844.8	270.7	0.000	0.000	2.222	69.636	191632	52.3	4.001	175	20.1	72.3	23.2	0.019	6025	5818	ma100339_rel_withdbg.cz11a_c24r64
3980	46416	0	0.0	8826.4	270.1	0.000	0.000	2.218	69.497	184759	52.4	3.981	181	20.1	72.3	NA	0.016	5818	5626	ma100434_rel_withdbg.cz11a_c24r64
3980	47552	0	0.0	20.4	4.2	0.000	0.000	0.005	1.089	193475	50.7	4.069	171	19.6	71.9	20.9	0.009	5947	5754	ma100525_rel_withdbg.cz11a_c24r64
3980	47570	0	0.0	424.8	15.7	0.000	0.000	0.107	4.033	192140	50.4	4.039	170	17.0	69.4	19.4	0.011	5963	5770	ma100618_rel_withdbg.cz11a_c24r64
3980	46509	123	0.5	434.4	16.0	0.003	0.011	0.109	4.115	184627	50.1	3.970	172	16.0	67.8	16.6	0.010	5849	5645	ma101108_rel_withdbg.cz11a_c24r64
3980	46979	0	0.0	435.4	16.1	0.000	0.000	0.109	4.136	190537	50.5	4.056	172	17.1	69.4	19.4	0.011	5898	5705	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
3980	46940	122	0.5	437.4	16.0	0.003	0.010	0.110	4.119	187350	50.2	3.991	171	15.2	66.4	16.3	0.010	5913	5722	ma110402_rel_withdbg.cz11b_c24r64
3982	47105	0	0.0	434.0	16.0	0.000	0.000	0.109	4.107	191650	50.5	4.069	172	16.0	68.5	18.2	0.009	5902	5706	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
3980	44165	130	0.5	435.5	16.0	0.003	0.012	0.109	4.109	176514	50.0	3.997	181	15.3	66.3	16.3	0.012	5533	5369	ma110501_rel_withdbg.cz11b_c24r64
3980	44410	0	0.0	434.5	16.0	0.000	0.000	0.109	4.127	180086	50.3	4.055	181	16.6	69.0	18.9	0.009	5573	5386	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
3980	44171	125	0.5	437.6	16.0	0.003	0.011	0.110	4.129	176056	49.9	3.986	181	15.4	66.5	16.3	0.010	5514	5340	ma110600_rel_withdbg.cz11b_c24r64
3980	44006	0	0.0	440.7	16.2	0.000	0.000	0.111	4.164	178653	50.3	4.060	183	15.9	68.4	18.2	0.009	5530	5370	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	55319	0	0.0	7572.1	235.8	0.000	0.000	0.951	30.328	214833	54.8	3.883	158	21.6	74.3	25.3	0.029	6931	6425	ma100244_rel_withdbg.cz11a_c24r64
7960	55016	0	0.0	8064.7	250.9	0.000	0.000	1.013	32.279	215522	54.4	3.917	158	20.1	72.3	23.3	0.040	6904	6380	ma100339_rel_withdbg.cz11a_c24r64
7960	52746	0	0.0	8521.9	264.7	0.000	0.000	1.071	34.056	207957	54.4	3.943	165	20.1	72.3	NA	0.028	6633	6201	ma100434_rel_withdbg.cz11a_c24r64
7960	58084	0	0.0	38.2	8.5	0.000	0.000	0.005	1.089	222098	54.5	3.824	150	19.6	71.9	20.9	0.010	7290	7048	ma100525_rel_withdbg.cz11a_c24r64
7960	57900	0	0.0	543.1	22.2	0.000	0.000	0.068	2.862	223397	53.9	3.858	149	17.0	69.4	19.4	0.044	7320	6745	ma100618_rel_withdbg.cz11a_c24r64
7960	53861	254	1.0	669.0	26.2	0.005	0.019	0.084	3.372	210762	52.4	3.913	156	16.0	67.8	16.6	0.026	6763	6297	ma101108_rel_withdbg.cz11a_c24r64
7965	58123	0	0.0	685.4	26.8	0.000	0.000	0.086	3.442	223879	54.5	3.852	150	17.1	69.4	19.4	0.051	7336	6857	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	54072	262	1.0	675.3	26.3	0.005	0.019	0.085	3.386	211383	52.6	3.909	156	15.2	66.4	16.3	0.019	6777	6329	ma110402_rel_withdbg.cz11b_c24r64
7960	57937	0	0.0	655.5	25.8	0.000	0.000	0.082	3.317	223750	54.7	3.862	151	16.0	68.5	18.2	0.024	7304	7017	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	52488	269	1.1	668.5	26.1	0.005	0.021	0.084	3.361	206456	52.6	3.933	160	15.3	66.3	16.3	0.030	6585	6137	ma110501_rel_withdbg.cz11b_c24r64
7960	56034	0	0.0	671.2	26.2	0.000	0.000	0.084	3.377	216079	54.5	3.856	156	16.6	69.0	18.9	0.052	7048	6809	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	52648	263	1.0	674.5	26.3	0.005	0.020	0.085	3.386	205469	52.6	3.903	160	15.4	66.5	16.3	0.022	6585	6185	ma110600_rel_withdbg.cz11b_c24r64
7960	55688	0	0.0	668.5	26.2	0.000	0.000	0.084	3.370	215067	54.4	3.862	156	15.9	68.4	18.3	0.017	7016	6729	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	47761	0	0.0	8598.7	266.7	0.000	0.000	1.080	34.307	188592	54.8	3.949	184	21.6	74.3	25.3	0.022	5978	5705	ma100244_rel_withdbg.cz11a_c24r64
7960	47263	0	0.0	6895.4	215.7	0.000	0.000	0.866	27.744	184267	54.0	3.899	183	20.1	72.3	23.3	0.020	5930	5674	ma100339_rel_withdbg.cz11a_c24r64
7960	45709	0	0.0	8302.8	258.2	0.000	0.000	1.043	33.210	179087	54.3	3.918	190	20.1	72.3	NA	0.021	5769	5468	ma100434_rel_withdbg.cz11a_c24r64
7960	45705	0	0.0	4233.0	130.3	0.000	0.000	0.532	16.762	210194	53.2	4.599	186	19.6	71.9	20.9	0.019	5754	5420	ma100525_rel_withdbg.cz11a_c24r64
7965	46816	0	0.0	685.3	26.4	0.000	0.000	0.086	3.395	190538	52.1	4.070	178	17.0	69.4	19.4	0.027	5820	5626	ma100618_rel_withdbg.cz11a_c24r64
7960	46218	256	1.0	567.3	23.1	0.006	0.022	0.071	2.973	176452	52.2	3.818	181	16.0	67.8	16.6	0.012	5818	5530	ma101108_rel_withdbg.cz11a_c24r64
7960	45786	0	0.0	567.3	23.2	0.000	0.000	0.071	2.979	193394	52.4	4.224	183	17.1	69.4	19.4	0.020	5769	5530	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
7960	46314	265	1.0	572.7	23.2	0.006	0.023	0.072	2.989	182315	52.1	3.937	180	15.2	66.4	16.3	0.018	5786	5562	ma110402_rel_withdbg.cz11b_c24r64
7960	45951	0	0.0	582.7	23.5	0.000	0.000	0.073	3.022	195246	52.4	4.249	182	16.0	68.5	18.2	0.009	5770	5546	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
7960	43524	273	1.1	578.5	23.4	0.006	0.025	0.073	3.011	172501	52.0	3.963	191	15.3	66.3	16.3	0.017	5437	5226	ma110501_rel_withdbg.cz11b_c24r64
7960	43426	0	0.0	565.4	23.0	0.000	0.000	0.071	2.960	184611	52.3	4.251	193	16.6	69.0	18.9	0.012	5434	5244	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
7960	43507	266	1.0	569.1	23.1	0.006	0.024	0.071	2.976	172368	51.8	3.962	190	15.4	66.5	16.4	0.010	5420	5226	ma110600_rel_withdbg.cz11b_c24r64
7960	43018	0	0.0	559.8	22.9	0.000	0.000	0.070	2.943	182798	52.1	4.249	194	15.9	68.4	18.3	0.011	5388	5194	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i0

l.i0: load without secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	48.535	51.387	0.017	0.024	0.006	0.032	0.000	0.000	0.000	0.668	ma100244_rel_withdbg.cz11a_c24r64
0.000	26.272	73.473	0.197	0.023	0.003	0.032	0.000	0.000	0.000	0.684	ma100339_rel_withdbg.cz11a_c24r64
0.000	31.852	67.876	0.223	0.016	0.003	0.032	0.000	0.000	0.000	0.532	ma100434_rel_withdbg.cz11a_c24r64
0.000	11.428	88.168	0.144	0.177	0.052	0.032	0.000	0.000	0.000	0.445	ma100525_rel_withdbg.cz11a_c24r64
0.000	29.617	70.153	0.190	0.007	0.002	0.032	0.000	0.000	0.000	0.447	ma100618_rel_withdbg.cz11a_c24r64
0.000	7.953	89.022	2.977	0.015	0.001	0.032	0.000	0.000	0.000	0.446	ma101108_rel_withdbg.cz11a_c24r64
0.000	8.705	84.298	6.951	0.014	0.001	0.032	0.000	0.000	0.000	0.430	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	8.379	88.199	3.375	0.013	0.001	0.032	0.000	0.000	0.000	0.454	ma110402_rel_withdbg.cz11b_c24r64
0.000	5.209	88.031	6.711	0.016	0.001	0.032	0.000	0.000	0.000	0.452	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	5.683	89.597	4.678	0.009	0.001	0.032	0.000	0.000	0.000	0.456	ma110501_rel_withdbg.cz11b_c24r64
0.000	8.380	85.604	5.977	0.005	0.001	0.032	0.000	0.000	0.000	0.378	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	6.769	89.441	3.746	0.011	0.001	0.032	0.000	0.000	0.000	0.447	ma110600_rel_withdbg.cz11b_c24r64
0.000	6.236	86.510	7.211	0.010	0.001	0.032	0.000	0.000	0.000	0.432	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.x

l.x: create secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

TODO - determine whether there is data for create index response time

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.003	76.405	23.302	0.134	0.108	0.048	0.000	0.000	0.000	0.682	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.002	83.966	15.568	0.106	0.259	0.099	0.000	0.000	0.000	0.683	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.002	86.022	13.505	0.106	0.266	0.099	0.000	0.000	0.000	0.713	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.015	24.160	75.334	0.301	0.045	0.144	0.000	0.000	0.000	0.742	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.008	38.927	60.480	0.511	0.026	0.048	0.000	0.000	0.000	0.735	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.001	26.880	71.980	1.085	0.028	0.026	0.000	0.000	0.000	0.728	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.008	16.593	82.686	0.650	0.018	0.046	nonzero	0.000	0.000	1.061	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.001	21.293	77.565	1.094	0.021	0.025	0.000	0.000	0.000	0.650	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.007	15.255	83.969	0.709	0.019	0.041	0.000	0.000	0.000	0.728	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.001	17.623	81.194	1.138	0.018	0.025	0.000	0.000	0.000	0.650	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.008	21.632	77.660	0.642	0.018	0.039	0.000	0.000	0.000	0.707	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.001	22.681	76.173	1.098	0.021	0.026	0.000	0.000	0.000	0.707	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.006	16.056	83.182	0.699	0.020	0.037	0.000	0.000	0.000	0.661	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.019	76.272	23.429	0.125	0.109	0.046	0.000	0.000	0.000	0.683	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.024	83.624	15.904	0.091	0.269	0.088	0.000	0.000	0.000	0.684	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.026	85.748	13.771	0.091	0.275	0.089	0.000	0.000	0.000	0.715	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.038	30.008	69.555	0.213	0.083	0.103	0.000	0.000	0.000	0.742	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.060	58.050	41.459	0.363	0.025	0.043	0.000	0.000	0.000	0.741	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.027	41.785	57.293	0.851	0.021	0.023	0.000	0.000	0.000	0.728	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.065	30.360	69.065	0.449	0.018	0.043	0.000	0.000	0.000	0.771	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.021	32.975	66.093	0.872	0.017	0.022	0.000	0.000	0.000	0.649	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.050	21.547	77.758	0.588	0.018	0.038	0.000	0.000	0.000	0.726	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.022	28.635	70.406	0.901	0.014	0.022	0.000	0.000	0.000	0.649	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.078	29.108	70.231	0.528	0.018	0.037	0.000	0.000	0.000	0.710	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.028	35.349	63.713	0.870	0.017	0.023	0.000	0.000	0.000	0.705	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.055	23.053	76.262	0.576	0.018	0.035	0.000	0.000	0.000	0.662	ma1106_240723_d8374262_ilwas.cz11b_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
2.042	84.766	12.902	0.125	0.162	nonzero	0.004	0.000	0.000	0.000	0.682	ma100244_rel_withdbg.cz11a_c24r64
3.670	85.463	10.658	0.109	0.096	nonzero	0.004	0.000	0.000	0.000	0.678	ma100339_rel_withdbg.cz11a_c24r64
3.416	85.732	10.651	0.098	0.098	nonzero	0.004	0.000	0.000	0.000	0.626	ma100434_rel_withdbg.cz11a_c24r64
1.574	84.115	13.891	0.332	0.085	nonzero	0.004	0.000	0.000	0.000	0.691	ma100525_rel_withdbg.cz11a_c24r64
2.759	88.806	8.147	0.273	0.011	nonzero	0.004	0.000	0.000	0.000	0.594	ma100618_rel_withdbg.cz11a_c24r64
0.322	69.724	29.612	0.283	0.055	nonzero	0.004	0.000	0.000	0.000	0.512	ma101108_rel_withdbg.cz11a_c24r64
0.497	50.847	48.398	0.238	0.016	nonzero	0.004	0.000	0.000	0.000	0.543	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.306	67.273	32.087	0.275	0.054	0.001	0.004	0.000	0.000	0.000	0.503	ma110402_rel_withdbg.cz11b_c24r64
0.519	48.514	50.709	0.249	0.006	0.000	0.004	0.000	0.000	0.000	0.532	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.272	64.511	34.884	0.278	0.051	nonzero	0.004	0.000	0.000	0.000	0.493	ma110501_rel_withdbg.cz11b_c24r64
0.495	47.482	51.762	0.251	0.005	0.000	0.004	0.000	0.000	0.000	0.562	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.299	67.908	31.461	0.276	0.052	nonzero	0.004	0.000	0.000	0.000	0.488	ma110600_rel_withdbg.cz11b_c24r64
0.516	49.376	49.838	0.260	0.006	0.000	0.004	0.000	0.000	0.000	0.442	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
2.022	84.715	12.979	0.120	0.161	nonzero	0.004	0.000	0.000	0.000	0.683	ma100244_rel_withdbg.cz11a_c24r64
4.226	84.937	10.636	0.102	0.095	nonzero	0.004	0.000	0.000	0.000	0.677	ma100339_rel_withdbg.cz11a_c24r64
3.950	85.241	10.617	0.092	0.097	nonzero	0.004	0.000	0.000	0.000	0.625	ma100434_rel_withdbg.cz11a_c24r64
1.711	83.713	14.191	0.298	0.083	nonzero	0.004	0.000	0.000	0.000	0.691	ma100525_rel_withdbg.cz11a_c24r64
3.327	88.075	8.329	0.255	0.010	nonzero	0.004	0.000	0.000	0.000	0.593	ma100618_rel_withdbg.cz11a_c24r64
0.386	69.979	29.309	0.267	0.055	0.001	0.004	0.000	0.000	0.000	0.512	ma101108_rel_withdbg.cz11a_c24r64
0.709	53.294	45.764	0.213	0.015	nonzero	0.004	0.000	0.000	0.000	0.543	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.374	67.372	31.934	0.263	0.053	nonzero	0.004	0.000	0.000	0.000	0.502	ma110402_rel_withdbg.cz11b_c24r64
0.507	48.425	50.824	0.234	0.005	0.000	0.004	0.000	0.000	0.000	0.532	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.330	64.700	34.648	0.266	0.051	nonzero	0.004	0.000	0.000	0.000	0.492	ma110501_rel_withdbg.cz11b_c24r64
0.500	47.407	51.848	0.237	0.005	0.000	0.004	0.000	0.000	0.000	0.562	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.364	68.017	31.299	0.263	0.052	nonzero	0.004	0.000	0.000	0.000	0.488	ma110600_rel_withdbg.cz11b_c24r64
0.517	49.405	49.821	0.247	0.006	0.000	0.004	0.000	0.000	0.000	0.443	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.641	0.342	0.017	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma100244_rel_withdbg.cz11a_c24r64
99.657	0.332	0.011	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma100339_rel_withdbg.cz11a_c24r64
99.605	0.384	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma100434_rel_withdbg.cz11a_c24r64
99.964	0.034	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100525_rel_withdbg.cz11a_c24r64
99.973	0.026	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100618_rel_withdbg.cz11a_c24r64
99.967	0.032	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma101108_rel_withdbg.cz11a_c24r64
99.977	0.022	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
99.964	0.034	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma110402_rel_withdbg.cz11b_c24r64
99.979	0.020	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
99.960	0.038	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma110501_rel_withdbg.cz11b_c24r64
99.969	0.030	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
99.964	0.034	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma110600_rel_withdbg.cz11b_c24r64
99.970	0.029	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.021	97.771	2.201	0.007	0.000	0.000	0.000	0.000	0.000	0.028	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.010	97.295	2.688	0.007	0.000	0.000	0.000	0.000	0.000	0.026	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.000	97.410	2.587	0.003	0.000	0.000	0.000	0.000	0.000	0.016	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.042	91.684	8.274	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.267	98.753	0.979	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.014	80.569	19.417	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101108_rel_withdbg.cz11a_c24r64
0.000	1.479	86.851	11.670	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.007	74.483	25.510	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.174	95.285	4.542	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.024	64.736	35.240	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.024	65.726	34.250	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.135	89.031	10.833	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.156	76.965	22.878	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.128	96.062	1.799	0.010	0.000	0.000	0.000	0.000	0.000	0.021	ma100244_rel_withdbg.cz11a_c24r64
0.000	4.722	93.319	1.951	0.007	0.000	0.000	0.000	0.000	0.000	0.031	ma100339_rel_withdbg.cz11a_c24r64
0.000	4.576	93.420	2.003	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma100434_rel_withdbg.cz11a_c24r64
0.000	2.236	92.285	5.479	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma100525_rel_withdbg.cz11a_c24r64
0.000	7.135	92.233	0.632	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.330	84.872	14.799	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma101108_rel_withdbg.cz11a_c24r64
0.000	10.781	81.875	7.344	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.278	80.076	19.646	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110402_rel_withdbg.cz11b_c24r64
0.000	1.833	95.622	2.545	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.701	71.274	28.024	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.309	72.125	27.566	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	1.052	91.910	7.038	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110600_rel_withdbg.cz11b_c24r64
0.000	1.521	80.674	17.806	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.249	0.732	0.019	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma100244_rel_withdbg.cz11a_c24r64
99.143	0.843	0.014	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma100339_rel_withdbg.cz11a_c24r64
99.006	0.976	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma100434_rel_withdbg.cz11a_c24r64
99.289	0.702	0.010	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100525_rel_withdbg.cz11a_c24r64
99.320	0.674	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100618_rel_withdbg.cz11a_c24r64
99.276	0.717	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma101108_rel_withdbg.cz11a_c24r64
99.254	0.738	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
99.279	0.713	0.009	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma110402_rel_withdbg.cz11b_c24r64
99.242	0.750	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
98.908	1.082	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110501_rel_withdbg.cz11b_c24r64
98.951	1.042	0.008	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
98.920	1.071	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma110600_rel_withdbg.cz11b_c24r64
98.900	1.091	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.010	97.542	2.431	0.017	0.000	0.000	0.000	0.000	0.000	0.028	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.000	97.247	2.747	0.007	0.000	0.000	0.000	0.000	0.000	0.018	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.003	97.344	2.649	0.003	0.000	0.000	0.000	0.000	0.000	0.019	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.000	99.788	0.212	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.003	95.611	4.385	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.028	77.042	22.931	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.010	61.639	38.351	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.125	91.375	8.500	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.017	71.941	28.042	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.007	81.181	18.812	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.420	97.066	2.514	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.000	55.323	44.677	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.014	94.031	5.955	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.795	97.281	1.913	0.010	0.000	0.000	0.000	0.000	0.000	0.025	ma100244_rel_withdbg.cz11a_c24r64
0.000	1.708	96.385	1.903	0.003	0.000	0.000	0.000	0.000	0.000	0.017	ma100339_rel_withdbg.cz11a_c24r64
0.000	1.611	96.406	1.983	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.486	99.424	0.090	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.420	97.934	1.646	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.378	84.531	15.090	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.250	72.792	26.958	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.545	94.465	4.990	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.361	78.757	20.882	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.201	87.427	12.372	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma110501_rel_withdbg.cz11b_c24r64
0.000	5.118	93.455	1.427	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.073	62.788	37.139	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma110600_rel_withdbg.cz11b_c24r64
0.000	1.403	95.174	3.424	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.102	0.812	0.083	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	ma100244_rel_withdbg.cz11a_c24r64
99.244	0.691	0.063	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma100339_rel_withdbg.cz11a_c24r64
99.046	0.882	0.070	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	ma100434_rel_withdbg.cz11a_c24r64
99.800	0.187	0.013	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma100525_rel_withdbg.cz11a_c24r64
99.801	0.191	0.006	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	ma100618_rel_withdbg.cz11a_c24r64
99.536	0.450	0.012	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	ma101108_rel_withdbg.cz11a_c24r64
99.884	0.109	0.005	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
99.567	0.421	0.012	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	ma110402_rel_withdbg.cz11b_c24r64
99.881	0.115	0.004	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
99.476	0.512	0.012	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma110501_rel_withdbg.cz11b_c24r64
99.862	0.134	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
99.499	0.488	0.012	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma110600_rel_withdbg.cz11b_c24r64
99.856	0.139	0.004	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.182	95.056	4.737	0.024	0.000	0.000	0.000	0.000	0.000	0.041	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.133	95.524	4.329	0.015	0.000	0.000	0.000	0.000	0.000	0.037	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.073	95.669	4.242	0.017	0.000	0.000	0.000	0.000	0.000	0.031	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.003	56.354	43.590	0.053	0.000	0.000	0.000	0.000	0.000	0.035	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.408	83.742	15.809	0.042	0.000	0.000	0.000	0.000	0.000	0.034	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.044	56.171	43.742	0.043	0.000	0.000	0.000	0.000	0.000	0.035	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.235	51.901	47.808	0.056	0.000	0.000	0.000	0.000	0.000	0.031	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.028	49.190	50.745	0.036	0.000	0.000	0.000	0.000	0.000	0.052	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.162	43.905	55.863	0.071	0.000	0.000	0.000	0.000	0.000	0.045	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.033	43.537	56.405	0.025	0.000	0.000	0.000	0.000	0.000	0.033	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.160	47.462	52.324	0.055	0.000	0.000	0.000	0.000	0.000	0.043	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.040	50.987	48.937	0.036	0.000	0.000	0.000	0.000	0.000	0.043	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.138	46.969	52.849	0.044	0.000	0.000	0.000	0.000	0.000	0.029	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.702	94.831	3.449	0.019	0.000	0.000	0.000	0.000	0.000	0.037	ma100244_rel_withdbg.cz11a_c24r64
0.000	4.929	92.126	2.931	0.013	0.000	0.000	0.000	0.000	0.000	0.037	ma100339_rel_withdbg.cz11a_c24r64
0.000	4.207	92.866	2.916	0.011	0.000	0.000	0.000	0.000	0.000	0.028	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.132	64.036	35.801	0.031	0.000	0.000	0.000	0.000	0.000	0.028	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.762	89.319	9.892	0.027	0.000	0.000	0.000	0.000	0.000	0.030	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.128	66.674	33.170	0.027	0.000	0.000	0.000	0.000	0.000	0.031	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.401	61.578	37.988	0.034	0.000	0.000	0.000	0.000	0.000	0.029	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.113	58.227	41.636	0.024	0.000	0.000	0.000	0.000	0.000	0.027	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.224	50.564	49.178	0.035	0.000	0.000	0.000	0.000	0.000	0.027	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.097	52.968	46.922	0.013	0.000	0.000	0.000	0.000	0.000	0.027	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.576	54.245	45.143	0.035	0.000	0.000	0.000	0.000	0.000	0.035	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.131	61.020	38.826	0.022	0.000	0.000	0.000	0.000	0.000	0.028	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.240	53.677	46.048	0.035	0.000	0.000	0.000	0.000	0.000	0.029	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.586	1.306	0.104	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma100244_rel_withdbg.cz11a_c24r64
98.514	1.403	0.082	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma100339_rel_withdbg.cz11a_c24r64
98.407	1.508	0.084	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.016	ma100434_rel_withdbg.cz11a_c24r64
98.256	1.703	0.040	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma100525_rel_withdbg.cz11a_c24r64
98.428	1.553	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma100618_rel_withdbg.cz11a_c24r64
98.350	1.628	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma101108_rel_withdbg.cz11a_c24r64
98.296	1.687	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
98.359	1.617	0.024	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110402_rel_withdbg.cz11b_c24r64
98.265	1.716	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
97.800	2.175	0.025	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110501_rel_withdbg.cz11b_c24r64
97.707	2.273	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
97.841	2.134	0.025	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110600_rel_withdbg.cz11b_c24r64
97.664	2.314	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.133	94.099	5.734	0.034	0.000	0.000	0.000	0.000	0.000	0.030	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.115	95.580	4.284	0.021	0.000	0.000	0.000	0.000	0.000	0.057	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.125	95.935	3.926	0.014	0.000	0.000	0.000	0.000	0.000	0.036	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.001	51.394	48.582	0.023	0.000	0.000	0.000	0.000	0.000	0.032	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.454	85.808	13.694	0.044	0.000	0.000	0.000	0.000	0.000	0.027	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.028	52.990	46.942	0.039	0.000	0.000	0.000	0.000	0.000	0.027	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.125	40.114	59.708	0.053	0.000	0.000	0.000	0.000	0.000	0.030	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.010	43.119	56.824	0.047	0.000	0.000	0.000	0.000	0.000	0.030	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.097	35.429	64.415	0.059	0.000	0.000	0.000	0.000	0.000	0.032	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.029	45.725	54.191	0.055	0.000	0.000	0.000	0.000	0.000	0.032	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.148	42.808	57.003	0.041	0.000	0.000	0.000	0.000	0.000	0.029	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.031	47.878	52.040	0.051	0.000	0.000	0.000	0.000	0.000	0.040	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.082	41.187	58.700	0.031	0.000	0.000	0.000	0.000	0.000	0.037	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.203	94.483	4.292	0.023	0.000	0.000	0.000	0.000	0.000	0.027	ma100244_rel_withdbg.cz11a_c24r64
0.000	3.451	93.641	2.897	0.010	0.000	0.000	0.000	0.000	0.000	0.057	ma100339_rel_withdbg.cz11a_c24r64
0.000	4.497	92.928	2.564	0.012	0.000	0.000	0.000	0.000	0.000	0.036	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.021	60.675	39.283	0.022	0.000	0.000	0.000	0.000	0.000	0.028	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.655	91.099	8.221	0.026	0.000	0.000	0.000	0.000	0.000	0.027	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.084	64.676	35.206	0.033	0.000	0.000	0.000	0.000	0.000	0.027	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.279	50.262	49.428	0.031	0.000	0.000	0.000	0.000	0.000	0.031	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.057	53.001	46.907	0.035	0.000	0.000	0.000	0.000	0.000	0.028	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.104	41.513	58.344	0.040	0.000	0.000	0.000	0.000	0.000	0.035	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.112	55.708	44.139	0.041	0.000	0.000	0.000	0.000	0.000	0.029	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.226	49.101	50.635	0.037	0.000	0.000	0.000	0.000	0.000	0.032	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.099	58.710	41.153	0.038	0.000	0.000	0.000	0.000	0.000	0.033	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.163	47.779	52.030	0.028	0.000	0.000	0.000	0.000	0.000	0.029	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.808	1.034	0.147	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	ma100244_rel_withdbg.cz11a_c24r64
98.809	1.043	0.141	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	ma100339_rel_withdbg.cz11a_c24r64
98.604	1.247	0.142	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	ma100434_rel_withdbg.cz11a_c24r64
99.571	0.406	0.023	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma100525_rel_withdbg.cz11a_c24r64
99.572	0.411	0.012	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.044	ma100618_rel_withdbg.cz11a_c24r64
98.641	1.328	0.024	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	ma101108_rel_withdbg.cz11a_c24r64
99.786	0.198	0.010	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.051	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
98.643	1.331	0.025	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma110402_rel_withdbg.cz11b_c24r64
99.773	0.217	0.009	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
98.506	1.470	0.023	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.030	ma110501_rel_withdbg.cz11b_c24r64
99.745	0.245	0.009	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.052	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
98.558	1.415	0.025	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma110600_rel_withdbg.cz11b_c24r64
99.725	0.264	0.010	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.049	73.712	25.913	0.326	0.000	0.000	0.000	0.000	0.000	0.045	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.035	79.381	20.471	0.113	0.000	0.000	0.000	0.000	0.000	0.045	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.035	80.731	19.120	0.114	0.000	0.000	0.000	0.000	0.000	0.046	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.088	62.955	36.823	0.134	0.000	0.000	0.000	0.000	0.000	0.032	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.644	80.627	18.673	0.055	0.000	0.000	0.000	0.000	0.000	0.046	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.057	55.969	43.882	0.092	0.000	0.000	0.000	0.000	0.000	0.059	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.868	58.525	40.464	0.143	0.000	0.000	0.000	0.000	0.000	0.062	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.057	51.555	48.268	0.121	0.000	0.000	0.000	0.000	0.000	0.058	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.544	53.935	45.339	0.182	0.000	0.000	0.000	0.000	0.000	0.057	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.059	47.125	52.700	0.116	0.000	0.000	0.000	0.000	0.000	0.050	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.550	55.324	43.988	0.138	0.000	0.000	0.000	0.000	0.000	0.061	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.099	52.343	47.433	0.126	0.000	0.000	0.000	0.000	0.000	0.035	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.455	55.293	44.085	0.167	0.000	0.000	0.000	0.000	0.000	0.035	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.252	76.480	23.003	0.266	0.000	0.000	0.000	0.000	0.000	0.042	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.701	81.989	17.230	0.080	0.000	0.000	0.000	0.000	0.000	0.045	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.794	82.947	16.175	0.084	0.000	0.000	0.000	0.000	0.000	0.045	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.802	68.335	30.803	0.059	0.000	0.000	0.000	0.000	0.000	0.031	ma100525_rel_withdbg.cz11a_c24r64
0.000	1.277	86.067	12.622	0.033	0.000	0.000	0.000	0.000	0.000	0.046	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.262	64.099	35.587	0.052	0.000	0.000	0.000	0.000	0.000	0.057	ma101108_rel_withdbg.cz11a_c24r64
0.000	2.366	64.066	33.490	0.078	nonzero	0.000	0.000	0.000	0.000	0.064	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.228	58.291	41.403	0.077	0.000	0.000	0.000	0.000	0.000	0.058	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.810	57.945	41.113	0.132	0.000	0.000	0.000	0.000	0.000	0.054	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.244	54.701	44.985	0.069	0.000	0.000	0.000	0.000	0.000	0.051	ma110501_rel_withdbg.cz11b_c24r64
0.000	1.264	59.210	39.430	0.096	nonzero	0.000	0.000	0.000	0.000	0.065	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.415	60.266	39.243	0.076	0.000	0.000	0.000	0.000	0.000	0.032	ma110600_rel_withdbg.cz11b_c24r64
0.000	1.048	59.091	39.740	0.122	0.000	0.000	0.000	0.000	0.000	0.032	ma1106_240723_d8374262_ilwas.cz11b_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.136	1.684	0.169	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma100244_rel_withdbg.cz11a_c24r64
98.179	1.651	0.164	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma100339_rel_withdbg.cz11a_c24r64
98.039	1.793	0.161	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.021	ma100434_rel_withdbg.cz11a_c24r64
96.791	3.137	0.071	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma100525_rel_withdbg.cz11a_c24r64
97.707	2.266	0.027	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	ma100618_rel_withdbg.cz11a_c24r64
98.115	1.855	0.030	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101108_rel_withdbg.cz11a_c24r64
97.267	2.710	0.023	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
97.803	2.164	0.033	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma110402_rel_withdbg.cz11b_c24r64
97.232	2.745	0.023	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
97.102	2.861	0.037	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma110501_rel_withdbg.cz11b_c24r64
96.383	3.590	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
97.049	2.916	0.035	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110600_rel_withdbg.cz11b_c24r64
96.295	3.678	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.050	74.704	24.934	0.312	0.000	0.000	0.000	0.000	0.000	0.053	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.024	80.285	19.583	0.108	0.000	0.000	0.000	0.000	0.000	0.043	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.040	79.760	20.076	0.123	0.000	0.000	0.000	0.000	0.000	0.040	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.042	44.523	54.637	0.797	nonzero	0.000	0.000	0.000	0.000	0.068	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.523	81.648	17.782	0.047	0.000	0.000	0.000	0.000	0.000	0.043	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.045	54.906	44.920	0.129	0.000	0.000	0.000	0.000	0.000	0.041	ma101108_rel_withdbg.cz11a_c24r64
0.000	0.398	43.608	55.855	0.139	0.000	0.000	0.000	0.000	0.000	0.048	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.026	49.763	50.070	0.141	0.001	0.000	0.000	0.000	0.000	0.072	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.257	40.651	58.981	0.111	0.000	0.000	0.000	0.000	0.000	0.035	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.041	46.029	53.783	0.147	0.000	0.000	0.000	0.000	0.000	0.039	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.239	40.551	59.099	0.112	0.000	0.000	0.000	0.000	0.000	0.033	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.042	50.135	49.727	0.097	0.000	0.000	0.000	0.000	0.000	0.033	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.184	41.365	58.353	0.099	0.000	0.000	0.000	0.000	0.000	0.049	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.261	77.373	22.129	0.237	0.000	0.000	0.000	0.000	0.000	0.056	ma100244_rel_withdbg.cz11a_c24r64
0.000	0.622	82.860	16.433	0.084	0.000	0.000	0.000	0.000	0.000	0.041	ma100339_rel_withdbg.cz11a_c24r64
0.000	0.545	82.443	16.911	0.100	0.000	0.000	0.000	0.000	0.000	0.045	ma100434_rel_withdbg.cz11a_c24r64
0.000	0.407	50.711	48.369	0.512	nonzero	0.000	0.000	0.000	0.000	0.065	ma100525_rel_withdbg.cz11a_c24r64
0.000	0.975	87.660	11.331	0.034	0.000	0.000	0.000	0.000	0.000	0.036	ma100618_rel_withdbg.cz11a_c24r64
0.000	0.192	63.362	36.374	0.073	0.000	0.000	0.000	0.000	0.000	0.041	ma101108_rel_withdbg.cz11a_c24r64
0.000	1.095	49.728	49.100	0.076	0.000	0.000	0.000	0.000	0.000	0.051	ma1011_240723_c944cd6e_ilwas.cz11a_c24r64
0.000	0.130	56.517	43.272	0.081	0.000	0.000	0.000	0.000	0.000	0.063	ma110402_rel_withdbg.cz11b_c24r64
0.000	0.541	44.145	55.241	0.073	0.000	0.000	0.000	0.000	0.000	0.035	ma1104_240723_2ee061c2_ilwas.cz11b_c24r64
0.000	0.180	53.419	46.304	0.098	0.000	0.000	0.000	0.000	0.000	0.040	ma110501_rel_withdbg.cz11b_c24r64
0.000	0.573	44.183	55.172	0.072	0.000	0.000	0.000	0.000	0.000	0.033	ma1105_240723_2f4b0ba3_ilwas.cz11b_c24r64
0.000	0.159	57.850	41.931	0.060	0.000	0.000	0.000	0.000	0.000	0.032	ma110600_rel_withdbg.cz11b_c24r64
0.000	0.575	45.066	54.292	0.066	0.000	0.000	0.000	0.000	0.000	0.052	ma1106_240723_d8374262_ilwas.cz11b_c24r64

Introduction

Contents

Summary

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6