Introduction

This is a report for the insert benchmark with 800M docs and 1 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 16G RAM and an NVMe SSD. It is described here as the Beelink. The benchmark was run with 1 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 1 table. It loads 800M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 5m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is larger than memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:

my5621_rel.cz10a_bee - MySQL 5.6.21 with InnoDB, rel build that uses CMAKE_BUILD_TYPE=Release, cz10a_bee config
my5631_rel.cz10a_bee - MySQL 5.6.31 with InnoDB, rel build, cz10a_bee config
my5641_rel.cz10a_bee - MySQL 5.6.41 with InnoDB, rel build, cz10a_bee config
my5651_rel.cz10a_bee - MySQL 5.6.51 with InnoDB, rel build, cz10a_bee config
my5710_rel.cz10a_bee - MySQL 5.7.10 with InnoDB, rel build, cz10a_bee config
my5720_rel.cz10a_bee - MySQL 5.7.20 with InnoDB, rel build, cz10a_bee config
my5730_rel.cz10a_bee - MySQL 5.7.30 with InnoDB, rel build, cz10a_bee config
my5744_rel.cz10a_bee - MySQL 5.7.44 with InnoDB, rel build, cz10a_bee config
my8013_rel.cz10a_bee - MySQL 8.0.13 with InnoDB, rel build, cz10a_bee config
my8014_rel.cz10a_bee - MySQL 8.0.14 with InnoDB, rel build, cz10a_bee config
my8020_rel.cz10a_bee - MySQL 8.0.20 with InnoDB, rel build, cz10a_bee config
my8028_rel.cz10a_bee - MySQL 8.0.28 with InnoDB, rel build, cz10a_bee config
my8035_rel.cz10a_bee - MySQL 8.0.35 with InnoDB, rel build, cz10a_bee config
my8035_rel.cz10aps0_bee - MySQL 8.0.35 with InnoDB, rel build, cz10aps0_bee config that disables the perf schema
my8035_rel_lessps.cz10a_bee - MySQL 8.0.35 with InnoDB, rel_less build that disables most of the perf schema at compile time, cz10a_bee config
my8036_rel.cz10a_bee - MySQL 8.0.36 with InnoDB, rel build, cz10a_bee config

Summary
l.i0: load without secondary indexes
l.x: create secondary indexes
l.i1: continue load after secondary indexes created with 50 inserts per transaction
l.i2: continue load after secondary indexes created with 5 inserts per transaction
qr100.L1: range queries with 100 insert/s per client
qp100.L2: point queries with 100 insert/s per client
qr500.L3: range queries with 500 insert/s per client
qp500.L4: point queries with 500 insert/s per client
qr1000.L5: range queries with 1000 insert/s per client
qp1000.L6: point queries with 1000 insert/s per client

Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
my5621_rel.cz10a_bee	101048	80800	1332	1645	5291	672	4877	592	4477	510
my5631_rel.cz10a_bee	91880	81708	1320	1621	5205	647	4797	570	4392	502
my5641_rel.cz10a_bee	92368	76518	1321	1629	5152	645	4770	570	4382	501
my5651_rel.cz10a_bee	92904	81875	1327	1626	5161	645	4730	569	4370	499
my5710_rel.cz10a_bee	83981	113928	1798	2101	4090	646	4192	574	4280	521
my5720_rel.cz10a_bee	83255	114564	1787	2008	3977	647	4126	573	4201	520
my5730_rel.cz10a_bee	80759	111467	1723	2024	3903	646	4017	573	4212	520
my5744_rel.cz10a_bee	80980	109845	1729	2049	3870	644	4046	570	4132	518
my8013_rel.cz10a_bee	68329	105235	1752	2053	3581	622	3870	553	4100	504
my8014_rel.cz10a_bee	67883	103106	1596	1802	3434	619	3679	550	3867	498
my8020_rel.cz10a_bee	62554	103172	1706	1934	3378	618	3599	555	3756	517
my8028_rel.cz10a_bee	62174	139714	1800	1992	3094	627	3249	565	3300	523
my8035_rel.cz10a_bee	54949	106738	1712	1905	3593	615	3738	556	3828	512
my8035_rel_lessps.cz10a_bee	58582	159267	1738	2008	4130	628	4334	565	4449	522
my8035_rel.cz10aps0_bee	56798	161258	1725	1946	3956	629	4174	563	4219	520
my8036_rel.cz10a_bee	55021	105152	1721	1912	3604	611	3750	553	3819	511

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
my5621_rel.cz10a_bee	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00
my5631_rel.cz10a_bee	0.91	1.01	0.99	0.99	0.98	0.96	0.98	0.96	0.98	0.98
my5641_rel.cz10a_bee	0.91	0.95	0.99	0.99	0.97	0.96	0.98	0.96	0.98	0.98
my5651_rel.cz10a_bee	0.92	1.01	1.00	0.99	0.98	0.96	0.97	0.96	0.98	0.98
my5710_rel.cz10a_bee	0.83	1.41	1.35	1.28	0.77	0.96	0.86	0.97	0.96	1.02
my5720_rel.cz10a_bee	0.82	1.42	1.34	1.22	0.75	0.96	0.85	0.97	0.94	1.02
my5730_rel.cz10a_bee	0.80	1.38	1.29	1.23	0.74	0.96	0.82	0.97	0.94	1.02
my5744_rel.cz10a_bee	0.80	1.36	1.30	1.25	0.73	0.96	0.83	0.96	0.92	1.02
my8013_rel.cz10a_bee	0.68	1.30	1.32	1.25	0.68	0.93	0.79	0.93	0.92	0.99
my8014_rel.cz10a_bee	0.67	1.28	1.20	1.10	0.65	0.92	0.75	0.93	0.86	0.98
my8020_rel.cz10a_bee	0.62	1.28	1.28	1.18	0.64	0.92	0.74	0.94	0.84	1.01
my8028_rel.cz10a_bee	0.62	1.73	1.35	1.21	0.58	0.93	0.67	0.95	0.74	1.03
my8035_rel.cz10a_bee	0.54	1.32	1.29	1.16	0.68	0.92	0.77	0.94	0.86	1.00
my8035_rel_lessps.cz10a_bee	0.58	1.97	1.30	1.22	0.78	0.93	0.89	0.95	0.99	1.02
my8035_rel.cz10aps0_bee	0.56	2.00	1.30	1.18	0.75	0.94	0.86	0.95	0.94	1.02
my8036_rel.cz10a_bee	0.54	1.30	1.29	1.16	0.68	0.91	0.77	0.93	0.85	1.00

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbms	qr100.L1	qp100.L2	qr500.L3	qp500.L4	qr1000.L5	qp1000.L6
my5621_rel.cz10a_bee	100	100	499	499	998	998
my5631_rel.cz10a_bee	100	100	499	499	998	998
my5641_rel.cz10a_bee	100	100	499	499	998	999
my5651_rel.cz10a_bee	100	100	499	499	998	998
my5710_rel.cz10a_bee	100	100	499	499	998	998
my5720_rel.cz10a_bee	100	100	499	499	998	998
my5730_rel.cz10a_bee	100	100	498	499	998	998
my5744_rel.cz10a_bee	100	100	498	498	997	997
my8013_rel.cz10a_bee	100	100	499	498	997	997
my8014_rel.cz10a_bee	100	100	499	499	998	998
my8020_rel.cz10a_bee	100	100	499	499	998	998
my8028_rel.cz10a_bee	100	100	499	499	998	998
my8035_rel.cz10a_bee	100	100	499	499	999	998
my8035_rel_lessps.cz10a_bee	100	100	499	499	998	998
my8035_rel.cz10aps0_bee	100	100	499	499	998	999
my8036_rel.cz10a_bee	100	100	499	499	998	998
target	100	100	500	500	1000	1000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	92.077	7.801	0.118	0.003	0.002	0.103
my5631_rel.cz10a_bee	61.238	38.614	0.085	0.060	0.004	0.215
my5641_rel.cz10a_bee	64.912	34.941	0.083	0.060	0.004	0.184
my5651_rel.cz10a_bee	70.153	29.700	0.082	0.061	0.004	0.230
my5710_rel.cz10a_bee	2.011	97.652	0.318	0.016	0.002	0.120
my5720_rel.cz10a_bee	0.866	98.795	0.321	0.016	0.002	0.122
my5730_rel.cz10a_bee	0.445	99.185	0.220	0.148	0.002	0.118
my5744_rel.cz10a_bee	0.415	99.215	0.218	0.149	0.003	0.121
my8013_rel.cz10a_bee		99.483	0.381	0.134	0.002	0.104
my8014_rel.cz10a_bee		99.398	0.445	0.154	0.003	0.111
my8020_rel.cz10a_bee		99.364	0.460	0.172	0.004	0.126
my8028_rel.cz10a_bee		99.464	0.386	0.146	0.004	0.107
my8035_rel.cz10a_bee		99.406	0.445	0.146	0.003	0.183
my8035_rel_lessps.cz10a_bee		99.432	0.424	0.141	0.003	0.176
my8035_rel.cz10aps0_bee		99.417	0.437	0.143	0.003	0.092
my8036_rel.cz10a_bee		99.405	0.445	0.146	0.003	0.107

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
101048	0	885	3.5	512.2	36.4	0.009	0.035	0.005	0.369	12625	22.4	0.125	18	52.6	69.1	10.6	0.103	101218	90965	my5621_rel.cz10a_bee
91880	0	804	3.1	459.8	33.2	0.009	0.035	0.005	0.370	11605	21.9	0.126	19	52.6	69.1	10.6	0.215	91908	76270	my5631_rel.cz10a_bee
92368	0	809	3.2	460.8	33.3	0.009	0.035	0.005	0.369	11658	21.9	0.126	19	52.6	69.1	10.6	0.184	92500	76089	my5641_rel.cz10a_bee
92904	0	814	3.2	465.3	33.5	0.009	0.035	0.005	0.370	11744	22.0	0.126	19	52.6	69.1	10.6	0.230	93197	76048	my5651_rel.cz10a_bee
83981	0	0	0.0	433.8	30.4	0.000	0.000	0.005	0.371	9194	21.5	0.109	20	52.6	69.1	10.9	0.120	84306	75616	my5710_rel.cz10a_bee
83255	0	0	0.0	430.2	30.2	0.000	0.000	0.005	0.371	9109	21.6	0.109	21	52.6	69.1	10.9	0.122	83593	74914	my5720_rel.cz10a_bee
80759	0	0	0.0	419.0	29.3	0.000	0.000	0.005	0.371	8855	21.3	0.110	21	52.6	69.1	10.9	0.118	81008	72448	my5730_rel.cz10a_bee
80980	0	0	0.0	420.7	29.4	0.000	0.000	0.005	0.372	9017	21.4	0.111	21	52.6	69.1	10.9	0.121	81352	71824	my5744_rel.cz10a_bee
68329	0	22	0.1	363.4	26.0	0.000	0.001	0.005	0.389	55849	34.9	0.817	41	52.4	69.0	11.0	0.104	68426	60634	my8013_rel.cz10a_bee
67883	0	21	0.1	362.5	25.8	0.000	0.001	0.005	0.389	19399	22.9	0.286	27	52.4	69.0	11.1	0.111	67926	60455	my8014_rel.cz10a_bee
62554	0	0	0.0	388.3	23.5	0.000	0.000	0.006	0.385	17227	22.0	0.275	28	52.4	69.0	11.1	0.126	62466	55340	my8020_rel.cz10a_bee
62174	0	0	0.0	382.3	23.4	0.000	0.000	0.006	0.385	7186	21.0	0.116	27	52.4	69.0	11.0	0.107	62382	55556	my8028_rel.cz10a_bee
54949	0	0	0.0	338.5	20.8	0.000	0.000	0.006	0.388	6574	20.2	0.120	29	52.4	69.0	11.1	0.183	55081	49758	my8035_rel.cz10a_bee
58582	0	0	0.0	360.3	22.2	0.000	0.000	0.006	0.389	6980	20.9	0.119	29	52.4	69.0	10.7	0.176	58742	52940	my8035_rel_lessps.cz10a_bee
56798	0	0	0.0	349.3	21.6	0.000	0.000	0.006	0.389	6779	20.5	0.119	29	52.4	69.0	10.8	0.092	56933	51341	my8035_rel.cz10aps0_bee
55021	0	0	0.0	339.0	20.9	0.000	0.000	0.006	0.389	6582	20.2	0.120	29	52.4	69.0	11.1	0.107	55152	49746	my8036_rel.cz10a_bee

l.x

l.x: create secondary indexes.

Average throughput:

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
80800	0	568	81.7	708.8	103.6	0.007	1.035	0.009	1.312	1840	11.2	0.023	11	111.4	127.9	10.8	0.002	NA	NA	my5621_rel.cz10a_bee
81708	0	546	82.6	699.6	104.7	0.007	1.035	0.009	1.312	1807	11.3	0.022	11	111.4	127.9	10.8	0.002	NA	NA	my5631_rel.cz10a_bee
76518	0	516	77.4	671.5	98.2	0.007	1.035	0.009	1.315	1788	10.9	0.023	11	111.4	127.9	10.8	0.003	NA	NA	my5641_rel.cz10a_bee
81875	0	550	82.7	709.1	105.0	0.007	1.035	0.009	1.313	1857	11.1	0.023	11	111.4	127.9	10.8	0.003	NA	NA	my5651_rel.cz10a_bee
113928	0	716	114.5	978.1	135.5	0.006	1.029	0.009	1.218	6586	12.4	0.058	9	121.1	137.7	11.1	0.002	NA	NA	my5710_rel.cz10a_bee
114564	0	716	115.2	974.8	136.2	0.006	1.030	0.009	1.217	6586	12.4	0.057	9	121.1	137.7	11.1	0.002	NA	NA	my5720_rel.cz10a_bee
111467	0	692	112.1	963.6	132.6	0.006	1.029	0.009	1.218	6528	12.0	0.059	9	121.1	137.7	11.0	0.002	NA	NA	my5730_rel.cz10a_bee
109845	0	692	110.8	952.2	131.0	0.006	1.033	0.009	1.222	6708	12.2	0.061	9	121.1	137.7	10.4	0.002	NA	NA	my5744_rel.cz10a_bee
105235	0	688	106.1	815.5	125.5	0.007	1.032	0.008	1.222	10356	14.1	0.098	11	120.7	137.2	10.4	0.005	NA	NA	my8013_rel.cz10a_bee
103106	0	640	103.6	782.2	122.8	0.006	1.029	0.008	1.219	7072	12.2	0.069	9	120.7	137.2	10.5	0.005	NA	NA	my8014_rel.cz10a_bee
103172	0	638	103.7	891.4	122.9	0.006	1.029	0.009	1.220	6704	12.1	0.065	9	120.7	137.3	11.2	0.003	NA	NA	my8020_rel.cz10a_bee
139714	0	2346	222.4	2854.8	199.9	0.017	1.630	0.020	1.465	11025	42.5	0.079	24	120.7	137.3	11.2	0.004	NA	NA	my8028_rel.cz10a_bee
106738	0	1792	169.8	2181.0	152.7	0.017	1.629	0.020	1.465	8827	43.5	0.083	33	120.7	137.3	11.2	0.004	NA	NA	my8035_rel.cz10a_bee
159267	0	2675	253.6	3245.2	227.8	0.017	1.630	0.020	1.465	12843	40.8	0.081	20	120.7	137.3	10.9	0.003	NA	NA	my8035_rel_lessps.cz10a_bee
161258	0	2705	256.2	3287.6	230.8	0.017	1.627	0.020	1.466	13075	40.7	0.081	20	120.7	137.3	11.0	0.003	NA	NA	my8035_rel.cz10aps0_bee
105152	0	1765	167.4	2146.0	150.4	0.017	1.630	0.020	1.465	8686	43.6	0.083	33	120.7	137.3	11.2	0.004	NA	NA	my8036_rel.cz10a_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	16ms	64ms	256ms	1s	max
my5621_rel.cz10a_bee	0.585	89.492	9.921	0.001	0.689
my5631_rel.cz10a_bee	0.475	89.359	10.161	0.005	0.797
my5641_rel.cz10a_bee	0.496	89.450	10.050	0.004	0.863
my5651_rel.cz10a_bee	0.484	89.338	10.174	0.005	0.710
my5710_rel.cz10a_bee	24.575	70.234	5.191		0.251
my5720_rel.cz10a_bee	23.384	71.421	5.194	0.001	0.266
my5730_rel.cz10a_bee	22.980	71.529	5.489	0.003	0.348
my5744_rel.cz10a_bee	23.245	71.362	5.389	0.004	0.337
my8013_rel.cz10a_bee	22.804	71.418	5.775	0.004	0.405
my8014_rel.cz10a_bee	13.581	80.082	6.333	0.004	0.396
my8020_rel.cz10a_bee	16.574	77.771	5.655		0.256
my8028_rel.cz10a_bee	22.089	72.719	5.190	0.003	0.467
my8035_rel.cz10a_bee	16.773	77.761	5.465	0.001	0.261
my8035_rel_lessps.cz10a_bee	19.220	75.355	5.425		0.212
my8035_rel.cz10aps0_bee	17.992	76.578	5.429	0.001	0.288
my8036_rel.cz10a_bee	17.570	77.000	5.430		0.249

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	4ms	16ms	64ms	256ms	1s	max
my5621_rel.cz10a_bee	7.965	87.580	4.446	0.007	0.001	0.557
my5631_rel.cz10a_bee	7.706	87.669	4.617	0.006	0.001	0.639
my5641_rel.cz10a_bee	7.303	88.135	4.553	0.009	0.001	0.681
my5651_rel.cz10a_bee	6.101	89.356	4.539	0.003	0.001	0.588
my5710_rel.cz10a_bee	84.642	15.163	0.188	0.007		0.128
my5720_rel.cz10a_bee	83.526	16.286	0.186	0.001		0.140
my5730_rel.cz10a_bee	86.684	13.071	0.239	0.006		0.077
my5744_rel.cz10a_bee	84.528	15.205	0.261	0.006		0.103
my8013_rel.cz10a_bee	81.141	17.752	1.076	0.030		0.150
my8014_rel.cz10a_bee	70.868	27.776	1.325	0.031		0.135
my8020_rel.cz10a_bee	73.189	25.725	1.061	0.025		0.107
my8028_rel.cz10a_bee	70.976	28.759	0.261	0.004		0.130
my8035_rel.cz10a_bee	47.145	52.521	0.329	0.005		0.076
my8035_rel_lessps.cz10a_bee	59.496	40.151	0.346	0.006		0.102
my8035_rel.cz10aps0_bee	53.604	46.084	0.310	0.003		0.068
my8036_rel.cz10a_bee	47.870	51.776	0.354			0.061

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1332	0	7474	116.2	9084.5	296.7	5.613	89.362	6.823	228.150	42966	14.2	32.269	853	148.0	164.5	10.5	0.689	1249	899	my5621_rel.cz10a_bee
1320	0	7426	115.5	9092.6	294.6	5.624	89.532	6.886	228.446	42609	14.2	32.267	860	147.9	164.4	10.5	0.797	1249	849	my5631_rel.cz10a_bee
1321	0	7430	115.5	9109.5	295.0	5.623	89.523	6.894	228.597	42852	14.2	32.429	860	147.9	164.4	10.5	0.863	1249	849	my5641_rel.cz10a_bee
1327	0	7445	115.8	9122.0	295.5	5.612	89.348	6.876	228.071	43015	14.3	32.425	862	148.0	164.5	10.5	0.710	1249	849	my5651_rel.cz10a_bee
1798	0	9166	143.2	11343.3	369.1	5.096	81.542	6.307	210.151	56714	21.8	31.534	970	150.6	167.2	10.7	0.251	1698	999	my5710_rel.cz10a_bee
1787	0	9112	142.4	11273.1	366.8	5.098	81.569	6.307	210.134	56879	22.0	31.824	985	150.6	167.2	10.7	0.266	1698	999	my5720_rel.cz10a_bee
1723	0	8875	138.7	10972.8	356.6	5.150	82.398	6.367	211.907	56072	21.2	32.538	984	150.3	166.9	10.7	0.348	1648	899	my5730_rel.cz10a_bee
1729	0	8912	139.3	11023.3	358.3	5.154	82.458	6.374	212.163	56825	21.4	32.860	990	150.3	166.8	10.7	0.337	1648	899	my5744_rel.cz10a_bee
1752	0	8973	140.2	11206.0	361.1	5.121	81.941	6.396	211.051	93426	33.4	53.325	1525	150.0	166.6	10.7	0.405	1648	949	my8013_rel.cz10a_bee
1596	0	8171	127.7	10125.3	328.6	5.121	81.944	6.346	210.902	76633	18.9	48.031	948	150.0	166.6	10.5	0.396	1500	849	my8014_rel.cz10a_bee
1706	0	8804	137.6	13131.1	353.9	5.162	82.584	7.698	212.464	68615	17.3	40.227	811	149.6	166.4	10.5	0.256	1648	849	my8020_rel.cz10a_bee
1800	0	9270	144.8	13861.2	373.7	5.150	82.398	7.700	212.597	60823	21.8	33.789	969	149.6	166.3	10.7	0.467	1748	949	my8028_rel.cz10a_bee
1712	0	8835	138.0	13249.7	367.6	5.160	82.552	7.738	219.821	55841	22.8	32.611	1065	149.5	166.3	10.7	0.261	1648	899	my8035_rel.cz10a_bee
1738	0	8958	140.0	13417.9	372.3	5.155	82.486	7.722	219.413	56849	22.6	32.717	1041	149.6	166.4	10.6	0.212	1648	900	my8035_rel_lessps.cz10a_bee
1725	0	8871	138.6	13311.9	369.3	5.143	82.292	7.718	219.245	56185	22.8	32.575	1058	149.6	166.3	10.7	0.288	1648	949	my8035_rel.cz10aps0_bee
1721	0	8862	138.5	13288.6	368.6	5.149	82.380	7.721	219.326	56029	22.8	32.554	1060	149.6	166.3	10.7	0.249	1648	899	my8036_rel.cz10a_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	3.379	82.553	13.617	0.451	0.001	0.066
my5631_rel.cz10a_bee	3.125	82.522	13.857	0.496		0.062
my5641_rel.cz10a_bee	3.193	82.624	13.713	0.470	0.001	0.065
my5651_rel.cz10a_bee	3.236	82.431	13.881	0.452		0.061
my5710_rel.cz10a_bee	8.330	83.292	8.013	0.364	0.001	0.092
my5720_rel.cz10a_bee	6.410	84.348	8.928	0.314		0.058
my5730_rel.cz10a_bee	6.602	84.097	8.971	0.331		0.061
my5744_rel.cz10a_bee	6.983	83.892	8.825	0.298	0.001	0.065
my8013_rel.cz10a_bee	7.239	85.565	6.324	0.869	0.003	0.088
my8014_rel.cz10a_bee	3.517	87.070	8.636	0.773	0.003	0.097
my8020_rel.cz10a_bee	4.154	90.511	4.507	0.819	0.010	0.144
my8028_rel.cz10a_bee	3.712	90.631	5.132	0.523	0.001	0.068
my8035_rel.cz10a_bee	2.627	91.239	5.518	0.617	0.001	0.077
my8035_rel_lessps.cz10a_bee	4.250	90.020	5.163	0.564	0.002	0.083
my8035_rel.cz10aps0_bee	3.365	90.665	5.365	0.603	0.002	0.085
my8036_rel.cz10a_bee	2.724	91.200	5.470	0.605	0.001	0.064

dbms	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	19.262	77.797	2.847	0.093		0.058
my5631_rel.cz10a_bee	17.482	79.429	2.968	0.121		0.061
my5641_rel.cz10a_bee	18.896	78.067	2.939	0.099		0.061
my5651_rel.cz10a_bee	18.626	78.331	2.943	0.101		0.044
my5710_rel.cz10a_bee	58.217	41.197	0.565	0.021	0.001	0.091
my5720_rel.cz10a_bee	50.113	49.166	0.704	0.017		0.039
my5730_rel.cz10a_bee	55.534	43.807	0.638	0.020	0.001	0.075
my5744_rel.cz10a_bee	57.111	42.193	0.678	0.018		0.064
my8013_rel.cz10a_bee	62.184	36.984	0.656	0.176	0.001	0.100
my8014_rel.cz10a_bee	44.897	53.727	1.164	0.211	0.001	0.069
my8020_rel.cz10a_bee	49.256	49.801	0.766	0.176	0.002	0.128
my8028_rel.cz10a_bee	30.416	69.006	0.538	0.040		0.049
my8035_rel.cz10a_bee	15.756	83.627	0.565	0.052		0.063
my8035_rel_lessps.cz10a_bee	28.775	70.663	0.523	0.038		0.046
my8035_rel.cz10aps0_bee	20.873	78.527	0.546	0.053		0.051
my8036_rel.cz10a_bee	15.007	84.361	0.576	0.056		0.048

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1645	0	7757	115.2	8791.9	275.6	4.716	71.734	5.346	171.567	48881	20.8	29.720	1012	148.0	164.5	10.5	0.066	1663	1344	my5621_rel.cz10a_bee
1621	0	7674	114.0	8766.9	272.5	4.735	72.039	5.409	172.160	48228	20.8	29.758	1027	147.9	164.5	10.5	0.062	1638	1328	my5631_rel.cz10a_bee
1629	0	7698	114.4	8814.6	273.5	4.727	71.909	5.412	171.958	48528	20.8	29.797	1022	147.9	164.4	10.5	0.065	1644	1333	my5641_rel.cz10a_bee
1626	0	7700	114.4	8779.8	272.8	4.735	72.047	5.400	171.814	48447	20.8	29.795	1023	148.0	164.5	10.5	0.061	1643	1334	my5651_rel.cz10a_bee
2101	0	7993	124.9	9827.7	309.2	3.805	60.875	4.678	150.701	58110	29.6	27.661	1127	150.8	167.5	10.7	0.092	2073	1764	my5710_rel.cz10a_bee
2008	0	7977	124.6	9769.3	307.4	3.973	63.562	4.865	156.782	58271	29.7	29.019	1183	150.6	167.3	10.7	0.058	1973	1713	my5720_rel.cz10a_bee
2024	0	8087	126.4	9899.2	311.6	3.995	63.920	4.890	157.628	59540	29.5	29.414	1166	150.4	167.1	10.7	0.061	1983	1723	my5730_rel.cz10a_bee
2049	0	8175	127.7	10024.5	315.7	3.990	63.834	4.892	157.758	60660	29.6	29.603	1156	150.3	167.1	10.7	0.065	2028	1709	my5744_rel.cz10a_bee
2053	0	8072	126.1	9999.5	311.9	3.931	62.902	4.870	155.536	94898	40.5	46.217	1578	150.0	166.9	10.7	0.088	2038	1655	my8013_rel.cz10a_bee
1802	0	7363	115.0	8987.8	282.8	4.086	65.382	4.988	160.732	81949	28.6	45.482	1270	150.0	166.8	10.5	0.097	1749	1470	my8014_rel.cz10a_bee
1934	0	7993	124.9	11782.6	307.0	4.133	66.121	6.092	162.530	76380	28.7	39.489	1187	149.6	166.4	10.5	0.144	1874	1634	my8020_rel.cz10a_bee
1992	0	8394	131.2	12342.7	321.9	4.214	67.423	6.196	165.453	61348	30.9	30.797	1241	149.6	166.4	10.7	0.068	1949	1713	my8028_rel.cz10a_bee
1905	0	8092	126.4	11910.1	318.3	4.249	67.978	6.253	171.134	56420	31.8	29.622	1336	149.5	166.4	10.7	0.077	1858	1664	my8035_rel.cz10a_bee
2008	0	8271	129.2	12209.3	326.2	4.119	65.902	6.080	166.369	58517	31.8	29.142	1267	149.6	166.4	10.6	0.083	1948	1728	my8035_rel_lessps.cz10a_bee
1946	0	8154	127.4	12021.1	321.2	4.191	67.055	6.179	169.066	57640	32.0	29.628	1316	149.6	166.5	10.7	0.085	1903	1698	my8035_rel.cz10aps0_bee
1912	0	8088	126.4	11931.0	318.8	4.230	67.684	6.240	170.742	57007	32.2	29.816	1347	149.6	166.4	10.7	0.064	1873	1673	my8036_rel.cz10a_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	94.658	5.190	0.136	0.015	nonzero	0.020
my5631_rel.cz10a_bee	94.125	5.727	0.132	0.015	nonzero	0.023
my5641_rel.cz10a_bee	93.917	5.934	0.134	0.015	nonzero	0.019
my5651_rel.cz10a_bee	93.948	5.898	0.137	0.017	nonzero	0.017
my5710_rel.cz10a_bee	71.193	28.639	0.154	0.015	nonzero	0.037
my5720_rel.cz10a_bee	67.843	31.986	0.155	0.015	nonzero	0.035
my5730_rel.cz10a_bee	65.037	34.793	0.155	0.016	nonzero	0.036
my5744_rel.cz10a_bee	65.433	34.397	0.155	0.015	nonzero	0.034
my8013_rel.cz10a_bee	56.205	43.610	0.171	0.015	nonzero	0.036
my8014_rel.cz10a_bee	47.037	52.766	0.181	0.016	nonzero	0.035
my8020_rel.cz10a_bee	40.364	59.436	0.182	0.017	nonzero	0.045
my8028_rel.cz10a_bee	28.441	71.348	0.197	0.014		0.012
my8035_rel.cz10a_bee	53.250	46.745	0.005	0.001	nonzero	0.046
my8035_rel_lessps.cz10a_bee	70.826	29.168	0.005	nonzero	nonzero	0.033
my8035_rel.cz10aps0_bee	67.540	32.453	0.006	0.001	nonzero	0.031
my8036_rel.cz10a_bee	54.508	45.486	0.005	0.001		0.009

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	0.083	99.778	0.139	0.083
my5631_rel.cz10a_bee	0.056	99.528	0.417	0.128
my5641_rel.cz10a_bee	0.167	99.778	0.056	0.075
my5651_rel.cz10a_bee	0.222	99.583	0.194	0.107
my5710_rel.cz10a_bee	18.833	81.083	0.083	0.086
my5720_rel.cz10a_bee	17.361	82.639		0.037
my5730_rel.cz10a_bee	19.417	80.556	0.028	0.076
my5744_rel.cz10a_bee	25.444	74.556		0.064
my8013_rel.cz10a_bee	14.083	85.917		0.045
my8014_rel.cz10a_bee	5.722	94.250	0.028	0.072
my8020_rel.cz10a_bee	7.111	92.889		0.053
my8028_rel.cz10a_bee	16.167	83.833		0.035
my8035_rel.cz10a_bee	7.806	91.722	0.472	0.114
my8035_rel_lessps.cz10a_bee	11.917	88.083		0.037
my8035_rel.cz10aps0_bee	10.139	89.861		0.061
my8036_rel.cz10a_bee	8.556	91.250	0.194	0.104

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	17.278	80.972	1.750	0.040
my5631_rel.cz10a_bee	15.889	81.722	2.389	0.045
my5641_rel.cz10a_bee	17.389	81.361	1.250	0.034
my5651_rel.cz10a_bee	17.500	80.611	1.889	0.035
my5710_rel.cz10a_bee	98.417	1.361	0.222	0.028
my5720_rel.cz10a_bee	97.611	2.389		0.013
my5730_rel.cz10a_bee	99.111	0.889		0.013
my5744_rel.cz10a_bee	98.417	1.583		0.016
my8013_rel.cz10a_bee	95.972	3.944	0.083	0.019
my8014_rel.cz10a_bee	94.000	5.917	0.083	0.046
my8020_rel.cz10a_bee	93.639	6.361		0.015
my8028_rel.cz10a_bee	99.222	0.778		0.014
my8035_rel.cz10a_bee	97.056	2.278	0.667	0.043
my8035_rel_lessps.cz10a_bee	98.222	1.778		0.012
my8035_rel.cz10aps0_bee	98.722	1.139	0.139	0.025
my8036_rel.cz10a_bee	98.639	1.222	0.139	0.039

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	5291	632	9.8	552.0	17.2	0.119	1.900	5.531	176.057	23201	13.1	4.385	198	148.0	164.5	10.5	0.020	5290	3772	my5621_rel.cz10a_bee
100	5205	631	9.8	647.0	19.9	0.121	1.930	6.490	204.354	23198	13.2	4.457	203	147.9	164.5	10.5	0.023	5198	3292	my5631_rel.cz10a_bee
100	5152	631	9.8	556.0	17.1	0.122	1.947	5.571	175.954	22676	13.0	4.401	202	147.9	164.4	10.5	0.019	5147	3419	my5641_rel.cz10a_bee
100	5161	632	9.8	622.4	19.1	0.122	1.947	6.237	196.355	22923	13.2	4.442	205	148.0	164.5	10.5	0.017	5162	3261	my5651_rel.cz10a_bee
100	4090	987	15.4	899.9	27.7	0.241	3.862	9.026	284.571	20679	14.3	5.056	280	150.8	167.5	10.7	0.037	4043	2335	my5710_rel.cz10a_bee
100	3977	877	13.7	760.5	23.5	0.221	3.530	7.628	240.962	19559	14.1	4.918	284	150.6	167.3	10.7	0.035	3948	2493	my5720_rel.cz10a_bee
100	3903	750	11.7	618.3	19.0	0.192	3.074	6.195	194.869	18561	13.9	4.756	285	150.4	167.1	10.7	0.036	3867	2461	my5730_rel.cz10a_bee
100	3870	736	11.5	601.7	18.5	0.190	3.044	6.041	189.905	18404	14.1	4.755	291	150.3	167.1	10.7	0.034	3836	2397	my5744_rel.cz10a_bee
100	3581	958	15.0	892.5	27.2	0.268	4.281	8.961	279.269	24340	15.3	6.797	342	150.0	166.9	10.7	0.036	3548	2253	my8013_rel.cz10a_bee
100	3434	956	14.9	868.0	26.6	0.278	4.454	8.697	273.081	20678	14.4	6.022	336	150.0	166.8	10.5	0.035	3404	2286	my8014_rel.cz10a_bee
100	3378	828	12.9	863.2	22.1	0.245	3.922	8.649	226.511	18599	14.0	5.506	332	149.6	166.4	10.5	0.045	3356	2399	my8020_rel.cz10a_bee
100	3094	633	9.9	568.5	14.6	0.205	3.274	5.702	150.334	15007	13.3	4.851	344	149.6	166.4	10.7	0.012	3084	2104	my8028_rel.cz10a_bee
100	3593	582	9.1	631.0	16.6	0.162	2.590	6.323	170.354	17037	13.9	4.742	309	149.5	166.4	10.7	0.046	3548	3308	my8035_rel.cz10a_bee
100	4130	651	10.2	739.9	19.4	0.158	2.522	7.421	199.604	19521	14.1	4.726	273	149.6	166.4	10.6	0.033	4060	3756	my8035_rel_lessps.cz10a_bee
100	3956	630	9.9	720.9	18.9	0.159	2.550	7.231	194.358	18774	14.2	4.745	287	149.6	166.5	10.7	0.031	3900	3596	my8035_rel.cz10aps0_bee
100	3604	590	9.2	652.6	17.2	0.164	2.621	6.539	176.023	17135	14.0	4.754	311	149.6	166.4	10.7	0.009	3564	3324	my8036_rel.cz10a_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	0.874	98.899	0.226	0.001	0.037
my5631_rel.cz10a_bee	0.561	99.203	0.235	0.001	0.036
my5641_rel.cz10a_bee	0.500	99.279	0.220	0.001	0.039
my5651_rel.cz10a_bee	0.527	99.236	0.236	0.001	0.036
my5710_rel.cz10a_bee	0.387	99.280	0.332	0.001	0.039
my5720_rel.cz10a_bee	0.397	99.264	0.338	0.001	0.040
my5730_rel.cz10a_bee	0.384	99.281	0.334	0.001	0.038
my5744_rel.cz10a_bee	0.381	99.282	0.336	0.001	0.037
my8013_rel.cz10a_bee	0.186	99.487	0.326	0.001	0.037
my8014_rel.cz10a_bee	0.145	99.501	0.353	0.001	0.036
my8020_rel.cz10a_bee	0.131	99.649	0.220	0.001	0.043
my8028_rel.cz10a_bee	0.168	99.586	0.244	0.001	0.041
my8035_rel.cz10a_bee	0.106	99.645	0.248	0.001	0.045
my8035_rel_lessps.cz10a_bee	0.180	99.603	0.215	0.001	0.042
my8035_rel.cz10aps0_bee	0.186	99.577	0.236	0.001	0.044
my8036_rel.cz10a_bee	0.098	99.533	0.368	0.002	0.042

dbms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	0.278	99.389	0.333	0.115
my5631_rel.cz10a_bee	0.111	99.639	0.250	0.082
my5641_rel.cz10a_bee	0.167	99.500	0.333	0.098
my5651_rel.cz10a_bee	0.083	99.611	0.306	0.094
my5710_rel.cz10a_bee	19.278	80.722		0.060
my5720_rel.cz10a_bee	16.222	83.778		0.038
my5730_rel.cz10a_bee	18.000	82.000		0.039
my5744_rel.cz10a_bee	30.056	69.944		0.052
my8013_rel.cz10a_bee	13.056	86.917	0.028	0.065
my8014_rel.cz10a_bee	4.056	95.917	0.028	0.111
my8020_rel.cz10a_bee	4.556	95.444		0.057
my8028_rel.cz10a_bee	14.972	85.028		0.041
my8035_rel.cz10a_bee	7.583	92.417		0.056
my8035_rel_lessps.cz10a_bee	9.417	90.583		0.039
my8035_rel.cz10aps0_bee	8.722	91.278		0.043
my8036_rel.cz10a_bee	3.833	96.139	0.028	0.066

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	62.472	37.028	0.472	0.028	0.070
my5631_rel.cz10a_bee	58.222	41.111	0.667		0.049
my5641_rel.cz10a_bee	66.000	33.444	0.556		0.055
my5651_rel.cz10a_bee	66.194	33.500	0.306		0.041
my5710_rel.cz10a_bee	99.333	0.667			0.010
my5720_rel.cz10a_bee	99.389	0.611			0.010
my5730_rel.cz10a_bee	99.556	0.444			0.010
my5744_rel.cz10a_bee	99.250	0.750			0.011
my8013_rel.cz10a_bee	97.389	2.611			0.012
my8014_rel.cz10a_bee	96.250	3.722	0.028		0.023
my8020_rel.cz10a_bee	95.194	4.722	0.083		0.019
my8028_rel.cz10a_bee	98.528	1.472			0.015
my8035_rel.cz10a_bee	97.861	2.139			0.016
my8035_rel_lessps.cz10a_bee	98.694	1.306			0.011
my8035_rel.cz10aps0_bee	98.667	1.333			0.012
my8036_rel.cz10a_bee	98.472	1.500	0.028		0.022

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	672	6554	102.4	994.2	30.5	9.758	156.047	9.962	313.152	18215	4.7	27.118	560	148.0	164.5	10.5	0.037	672	575	my5621_rel.cz10a_bee
100	647	6343	99.1	864.9	26.3	9.799	156.709	8.666	270.225	17277	4.6	26.692	569	147.9	164.5	10.5	0.036	655	591	my5631_rel.cz10a_bee
100	645	6333	98.9	965.4	29.4	9.818	157.006	9.673	301.912	17582	4.5	27.259	558	147.9	164.4	10.5	0.039	655	559	my5641_rel.cz10a_bee
100	645	6327	98.8	888.5	27.0	9.811	156.891	8.903	277.307	17310	4.7	26.842	583	148.0	164.5	10.5	0.036	655	591	my5651_rel.cz10a_bee
100	646	6359	99.4	990.6	30.3	9.841	157.463	9.926	310.889	18121	5.4	28.046	669	150.8	167.5	10.7	0.039	655	592	my5710_rel.cz10a_bee
100	647	6369	99.5	986.4	30.2	9.838	157.406	9.884	309.778	18169	5.4	28.064	667	150.6	167.3	10.7	0.040	655	591	my5720_rel.cz10a_bee
100	646	6353	99.3	986.5	30.2	9.841	157.462	9.885	309.392	18202	5.3	28.198	657	150.4	167.1	10.7	0.038	655	591	my5730_rel.cz10a_bee
100	644	6369	99.5	982.2	30.0	9.882	158.107	9.871	309.018	18277	5.5	28.359	683	150.3	167.1	10.7	0.037	655	576	my5744_rel.cz10a_bee
100	622	6178	96.5	990.9	30.1	9.926	158.809	9.959	309.718	22075	6.1	35.468	784	150.0	166.9	10.7	0.037	624	543	my8013_rel.cz10a_bee
100	619	6136	95.9	988.7	30.2	9.915	158.648	9.917	310.539	19435	5.7	31.407	737	150.0	166.8	10.5	0.036	623	559	my8014_rel.cz10a_bee
100	618	6123	95.7	1177.3	29.9	9.899	158.389	11.796	306.811	18199	5.5	29.425	711	149.6	166.4	10.5	0.043	623	559	my8020_rel.cz10a_bee
100	627	6196	96.8	1187.0	30.0	9.881	158.092	11.894	307.978	17945	5.5	28.615	702	149.6	166.4	10.7	0.041	624	575	my8028_rel.cz10a_bee
100	615	6098	95.3	1136.4	29.2	9.916	158.653	11.398	299.871	17650	5.9	28.699	768	149.5	166.4	10.7	0.045	623	559	my8035_rel.cz10a_bee
100	628	6202	96.9	1138.7	29.3	9.869	157.909	11.410	300.211	17939	5.5	28.548	700	149.6	166.4	10.6	0.042	639	575	my8035_rel_lessps.cz10a_bee
100	629	6212	97.1	1143.8	29.4	9.871	157.928	11.460	301.469	17950	5.7	28.523	725	149.6	166.5	10.7	0.044	639	575	my8035_rel.cz10aps0_bee
100	611	6059	94.7	1133.4	29.1	9.916	158.649	11.357	298.839	17530	6.1	28.686	799	149.6	166.4	10.7	0.042	623	543	my8036_rel.cz10a_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	89.493	10.245	0.235	0.027		0.013
my5631_rel.cz10a_bee	88.787	10.945	0.239	0.028	nonzero	0.036
my5641_rel.cz10a_bee	88.673	11.048	0.251	0.027	nonzero	0.017
my5651_rel.cz10a_bee	88.236	11.477	0.259	0.028	nonzero	0.039
my5710_rel.cz10a_bee	74.936	24.881	0.159	0.024	nonzero	0.030
my5720_rel.cz10a_bee	73.117	26.694	0.163	0.026	nonzero	0.037
my5730_rel.cz10a_bee	70.072	29.737	0.167	0.024		0.016
my5744_rel.cz10a_bee	70.837	28.976	0.166	0.022	nonzero	0.024
my8013_rel.cz10a_bee	66.892	32.906	0.180	0.023		0.013
my8014_rel.cz10a_bee	59.046	40.745	0.186	0.023	nonzero	0.037
my8020_rel.cz10a_bee	53.009	46.773	0.188	0.030	nonzero	0.040
my8028_rel.cz10a_bee	38.424	61.336	0.211	0.029	nonzero	0.036
my8035_rel.cz10a_bee	58.840	41.151	0.008	0.001		0.011
my8035_rel_lessps.cz10a_bee	75.891	24.102	0.006	0.001	nonzero	0.027
my8035_rel.cz10aps0_bee	73.031	26.962	0.006	0.001	nonzero	0.023
my8036_rel.cz10a_bee	59.465	40.526	0.008	0.001		0.010

dbms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	6.639	93.328	0.033	0.072
my5631_rel.cz10a_bee	5.689	94.272	0.039	0.089
my5641_rel.cz10a_bee	5.383	94.567	0.050	0.074
my5651_rel.cz10a_bee	5.694	94.211	0.094	0.079
my5710_rel.cz10a_bee	77.056	22.944		0.053
my5720_rel.cz10a_bee	71.978	28.022		0.055
my5730_rel.cz10a_bee	76.700	23.300		0.040
my5744_rel.cz10a_bee	80.244	19.756		0.059
my8013_rel.cz10a_bee	65.044	34.950	0.006	0.069
my8014_rel.cz10a_bee	54.461	45.539		0.053
my8020_rel.cz10a_bee	57.989	41.983	0.028	0.080
my8028_rel.cz10a_bee	70.389	29.611		0.036
my8035_rel.cz10a_bee	58.406	41.583	0.011	0.083
my8035_rel_lessps.cz10a_bee	63.222	36.778		0.048
my8035_rel.cz10aps0_bee	60.489	39.511		0.039
my8036_rel.cz10a_bee	37.833	62.167		0.048

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	14.367	85.361	0.272	0.028
my5631_rel.cz10a_bee	13.822	85.917	0.261	0.027
my5641_rel.cz10a_bee	11.967	87.739	0.294	0.029
my5651_rel.cz10a_bee	12.522	86.994	0.483	0.035
my5710_rel.cz10a_bee	99.017	0.972	0.011	0.024
my5720_rel.cz10a_bee	98.517	1.483		0.016
my5730_rel.cz10a_bee	99.106	0.894		0.012
my5744_rel.cz10a_bee	94.733	5.261	0.006	0.019
my8013_rel.cz10a_bee	95.783	4.167	0.050	0.028
my8014_rel.cz10a_bee	93.700	6.272	0.028	0.021
my8020_rel.cz10a_bee	92.589	7.372	0.039	0.024
my8028_rel.cz10a_bee	98.917	1.083		0.013
my8035_rel.cz10a_bee	97.250	2.728	0.022	0.031
my8035_rel_lessps.cz10a_bee	97.928	2.061	0.011	0.020
my8035_rel.cz10aps0_bee	98.372	1.617	0.011	0.017
my8036_rel.cz10a_bee	97.617	2.350	0.033	0.020

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	4877	2978	46.3	3115.4	96.8	0.611	9.723	6.246	198.693	33746	16.6	6.919	272	148.0	164.5	10.5	0.013	4891	2955	my5621_rel.cz10a_bee
499	4797	2978	46.3	3154.2	97.1	0.621	9.886	6.324	199.369	33469	16.6	6.977	277	147.9	164.5	10.5	0.036	4811	2876	my5631_rel.cz10a_bee
499	4770	2978	46.3	3167.7	97.5	0.624	9.945	6.351	200.165	33399	16.6	7.003	278	147.9	164.4	10.5	0.017	4783	2855	my5641_rel.cz10a_bee
499	4730	2978	46.3	3168.8	97.5	0.630	10.025	6.349	200.063	33261	16.6	7.031	281	148.0	164.5	10.5	0.039	4747	2812	my5651_rel.cz10a_bee
499	4192	2999	46.9	3214.8	100.2	0.715	11.446	6.445	205.664	32435	18.0	7.738	344	150.8	167.5	10.7	0.030	4142	2590	my5710_rel.cz10a_bee
499	4126	2996	46.8	3211.0	100.1	0.726	11.616	6.440	205.532	32373	18.1	7.846	351	150.6	167.3	10.7	0.037	4077	2509	my5720_rel.cz10a_bee
498	4017	2992	46.8	3207.5	100.0	0.745	11.918	6.445	205.667	32116	18.0	7.995	358	150.4	167.1	10.7	0.016	3980	2413	my5730_rel.cz10a_bee
498	4046	2994	46.8	3213.7	100.1	0.740	11.838	6.457	206.037	32542	18.1	8.042	358	150.3	167.1	10.7	0.024	4012	2412	my5744_rel.cz10a_bee
499	3870	3001	46.9	3244.8	100.2	0.775	12.407	6.508	205.854	41391	21.2	10.695	438	150.0	166.9	10.7	0.013	3868	2477	my8013_rel.cz10a_bee
499	3679	2997	46.8	3221.3	100.3	0.815	13.032	6.458	205.902	37107	18.1	10.086	394	150.0	166.8	10.5	0.037	3676	2174	my8014_rel.cz10a_bee
499	3599	2991	46.7	3877.4	100.0	0.831	13.295	7.769	205.152	32738	17.5	9.095	389	149.6	166.4	10.5	0.040	3593	2280	my8020_rel.cz10a_bee
499	3249	2990	46.7	3867.6	99.8	0.920	14.724	7.754	204.854	30081	18.0	9.258	443	149.6	166.4	10.7	0.036	3229	2048	my8028_rel.cz10a_bee
499	3738	2936	45.9	3890.6	102.5	0.785	12.568	7.800	210.372	31771	18.8	8.500	402	149.5	166.4	10.7	0.011	3708	3340	my8035_rel.cz10a_bee
499	4334	2940	45.9	3893.0	102.5	0.678	10.852	7.808	210.588	33967	18.5	7.837	341	149.6	166.4	10.6	0.027	4269	3818	my8035_rel_lessps.cz10a_bee
499	4174	2940	45.9	3891.6	102.5	0.704	11.269	7.802	210.438	33470	18.7	8.018	358	149.6	166.5	10.7	0.023	4123	3660	my8035_rel.cz10aps0_bee
499	3750	2938	45.9	3894.0	102.6	0.783	12.534	7.807	210.554	31892	18.9	8.505	403	149.6	166.4	10.7	0.010	3723	3324	my8036_rel.cz10a_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	0.060	97.954	1.979	0.007		0.044
my5631_rel.cz10a_bee	0.033	97.757	2.203	0.007		0.043
my5641_rel.cz10a_bee	0.033	97.752	2.207	0.008		0.047
my5651_rel.cz10a_bee	0.028	97.769	2.195	0.007		0.047
my5710_rel.cz10a_bee	0.019	97.621	2.354	0.007		0.049
my5720_rel.cz10a_bee	0.018	97.633	2.343	0.006		0.042
my5730_rel.cz10a_bee	0.019	97.617	2.357	0.007		0.044
my5744_rel.cz10a_bee	0.017	97.610	2.366	0.007		0.043
my8013_rel.cz10a_bee	0.007	97.505	2.481	0.007		0.043
my8014_rel.cz10a_bee	0.006	97.485	2.501	0.007		0.045
my8020_rel.cz10a_bee	0.004	99.099	0.761	0.136		0.057
my8028_rel.cz10a_bee	0.005	99.030	0.869	0.096		0.054
my8035_rel.cz10a_bee	0.004	98.962	0.928	0.106		0.056
my8035_rel_lessps.cz10a_bee	0.009	99.019	0.857	0.115		0.055
my8035_rel.cz10aps0_bee	0.006	99.005	0.872	0.117		0.054
my8036_rel.cz10a_bee	0.003	98.765	1.177	0.054	nonzero	0.069

dbms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	4.894	94.283	0.822	0.142
my5631_rel.cz10a_bee	4.739	94.183	1.078	0.116
my5641_rel.cz10a_bee	4.111	94.528	1.361	0.117
my5651_rel.cz10a_bee	4.972	94.261	0.767	0.116
my5710_rel.cz10a_bee	87.667	12.289	0.044	0.089
my5720_rel.cz10a_bee	86.222	13.739	0.039	0.077
my5730_rel.cz10a_bee	87.006	12.961	0.033	0.091
my5744_rel.cz10a_bee	91.033	8.939	0.028	0.077
my8013_rel.cz10a_bee	72.878	26.844	0.278	0.092
my8014_rel.cz10a_bee	61.806	37.950	0.244	0.105
my8020_rel.cz10a_bee	65.739	33.711	0.550	0.122
my8028_rel.cz10a_bee	81.894	17.783	0.322	0.104
my8035_rel.cz10a_bee	68.183	30.878	0.939	0.114
my8035_rel_lessps.cz10a_bee	75.100	24.706	0.194	0.110
my8035_rel.cz10aps0_bee	71.617	27.828	0.556	0.105
my8036_rel.cz10a_bee	47.217	51.967	0.817	0.113

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	24.906	72.711	2.383		0.061
my5631_rel.cz10a_bee	23.906	73.400	2.694		0.050
my5641_rel.cz10a_bee	23.994	73.400	2.600	0.006	0.085
my5651_rel.cz10a_bee	23.094	74.089	2.817		0.062
my5710_rel.cz10a_bee	98.894	1.100	0.006		0.018
my5720_rel.cz10a_bee	98.789	1.200	0.011		0.019
my5730_rel.cz10a_bee	98.889	1.106	0.006		0.020
my5744_rel.cz10a_bee	95.406	4.572	0.022		0.020
my8013_rel.cz10a_bee	94.667	4.806	0.528		0.043
my8014_rel.cz10a_bee	91.900	7.506	0.594		0.057
my8020_rel.cz10a_bee	92.550	7.044	0.406		0.055
my8028_rel.cz10a_bee	98.367	1.561	0.072		0.030
my8035_rel.cz10a_bee	95.433	4.306	0.261		0.030
my8035_rel_lessps.cz10a_bee	97.778	2.094	0.128		0.045
my8035_rel.cz10aps0_bee	96.572	3.228	0.200		0.051
my8036_rel.cz10a_bee	95.006	4.817	0.178		0.045

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	592	8592	134.0	3487.4	107.7	14.526	232.035	6.992	221.138	28846	8.1	48.768	1096	148.0	164.5	10.5	0.044	591	559	my5621_rel.cz10a_bee
499	570	8400	131.0	3514.1	107.6	14.729	235.275	7.045	220.809	28392	8.1	49.784	1136	147.9	164.5	10.5	0.043	575	543	my5631_rel.cz10a_bee
499	570	8392	130.9	3514.7	107.6	14.727	235.237	7.042	220.701	28410	8.2	49.859	1151	147.9	164.4	10.5	0.047	575	543	my5641_rel.cz10a_bee
499	569	8390	130.9	3516.2	107.6	14.742	235.477	7.045	220.797	28420	8.1	49.939	1139	148.0	164.5	10.5	0.047	575	543	my5651_rel.cz10a_bee
499	574	8452	132.1	3519.7	108.7	14.717	235.472	7.056	223.241	30224	9.6	52.628	1337	150.8	167.5	10.7	0.049	575	543	my5710_rel.cz10a_bee
499	573	8439	131.9	3518.5	108.7	14.735	235.757	7.054	223.139	30326	9.7	52.952	1355	150.6	167.3	10.7	0.042	575	543	my5720_rel.cz10a_bee
499	573	8439	131.9	3517.1	108.7	14.727	235.635	7.051	223.077	30558	9.7	53.329	1354	150.4	167.1	10.7	0.044	575	543	my5730_rel.cz10a_bee
498	570	8412	131.4	3507.7	108.6	14.770	236.326	7.039	223.225	30753	9.7	54.001	1363	150.3	167.1	10.7	0.043	575	543	my5744_rel.cz10a_bee
498	553	8268	129.2	3542.0	108.7	14.948	239.176	7.113	223.465	48027	11.0	86.832	1591	150.0	166.9	10.7	0.043	559	527	my8013_rel.cz10a_bee
499	550	8232	128.6	3512.3	108.6	14.962	239.388	7.037	222.843	37047	10.1	67.334	1469	150.0	166.8	10.5	0.045	544	512	my8014_rel.cz10a_bee
499	555	8272	129.3	4219.5	108.3	14.894	238.302	8.454	222.242	32312	9.1	58.178	1311	149.6	166.4	10.5	0.057	559	527	my8020_rel.cz10a_bee
499	565	8361	130.6	4224.8	108.5	14.791	236.658	8.465	222.547	30799	10.0	54.482	1415	149.6	166.4	10.7	0.054	560	543	my8028_rel.cz10a_bee
499	556	8276	129.3	4270.4	111.7	14.875	237.996	8.556	229.130	30497	10.7	54.812	1538	149.5	166.4	10.8	0.056	559	527	my8035_rel.cz10a_bee
499	565	8362	130.6	4275.3	111.8	14.791	236.660	8.566	229.395	30856	10.2	54.583	1443	149.6	166.4	10.6	0.055	560	543	my8035_rel_lessps.cz10a_bee
499	563	8338	130.3	4272.4	111.7	14.812	236.996	8.560	229.232	30695	10.4	54.530	1478	149.6	166.5	10.7	0.054	559	540	my8035_rel.cz10aps0_bee
499	553	8247	128.9	4269.7	111.7	14.911	238.577	8.555	229.094	30288	10.9	54.761	1577	149.6	166.4	10.7	0.069	559	512	my8036_rel.cz10a_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	83.099	16.478	0.399	0.024	nonzero	0.048
my5631_rel.cz10a_bee	81.805	17.763	0.409	0.024	nonzero	0.037
my5641_rel.cz10a_bee	81.626	17.951	0.402	0.021	nonzero	0.038
my5651_rel.cz10a_bee	81.667	17.919	0.392	0.021	nonzero	0.034
my5710_rel.cz10a_bee	76.898	22.919	0.168	0.015	nonzero	0.033
my5720_rel.cz10a_bee	74.801	25.006	0.176	0.017	nonzero	0.038
my5730_rel.cz10a_bee	74.973	24.842	0.171	0.014	nonzero	0.036
my5744_rel.cz10a_bee	74.149	25.661	0.176	0.014	nonzero	0.034
my8013_rel.cz10a_bee	73.047	26.756	0.186	0.011	nonzero	0.037
my8014_rel.cz10a_bee	65.400	34.389	0.194	0.017	nonzero	0.035
my8020_rel.cz10a_bee	59.931	39.858	0.194	0.017	0.001	0.049
my8028_rel.cz10a_bee	40.499	59.253	0.229	0.018	0.001	0.047
my8035_rel.cz10a_bee	61.790	38.191	0.018	0.001		0.011
my8035_rel_lessps.cz10a_bee	78.802	21.185	0.011	0.001		0.009
my8035_rel.cz10aps0_bee	74.718	25.268	0.013	0.001	nonzero	0.027
my8036_rel.cz10a_bee	61.581	38.403	0.015	0.001		0.014

dbms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	27.506	72.186	0.308	0.119
my5631_rel.cz10a_bee	25.214	74.497	0.289	0.100
my5641_rel.cz10a_bee	24.442	75.278	0.281	0.112
my5651_rel.cz10a_bee	25.397	74.311	0.292	0.107
my5710_rel.cz10a_bee	93.978	6.014	0.008	0.070
my5720_rel.cz10a_bee	92.750	7.250		0.058
my5730_rel.cz10a_bee	92.517	7.469	0.014	0.085
my5744_rel.cz10a_bee	91.981	8.000	0.019	0.081
my8013_rel.cz10a_bee	87.311	12.600	0.089	0.092
my8014_rel.cz10a_bee	81.958	18.033	0.008	0.080
my8020_rel.cz10a_bee	86.606	13.394		0.064
my8028_rel.cz10a_bee	91.764	8.233	0.003	0.065
my8035_rel.cz10a_bee	84.750	15.131	0.119	0.113
my8035_rel_lessps.cz10a_bee	88.700	11.300		0.042
my8035_rel.cz10aps0_bee	88.236	11.692	0.072	0.087
my8036_rel.cz10a_bee	86.419	13.581		0.041

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	14.575	84.967	0.458	0.043
my5631_rel.cz10a_bee	12.911	86.633	0.456	0.054
my5641_rel.cz10a_bee	12.492	87.072	0.436	0.048
my5651_rel.cz10a_bee	12.594	86.919	0.486	0.055
my5710_rel.cz10a_bee	98.217	1.742	0.042	0.036
my5720_rel.cz10a_bee	97.861	2.136	0.003	0.021
my5730_rel.cz10a_bee	97.431	2.539	0.031	0.049
my5744_rel.cz10a_bee	95.925	4.056	0.019	0.046
my8013_rel.cz10a_bee	96.433	3.206	0.361	0.057
my8014_rel.cz10a_bee	93.131	6.772	0.097	0.060
my8020_rel.cz10a_bee	94.181	5.775	0.044	0.050
my8028_rel.cz10a_bee	98.406	1.586	0.008	0.049
my8035_rel.cz10a_bee	95.100	4.883	0.017	0.019
my8035_rel_lessps.cz10a_bee	97.756	2.225	0.019	0.043
my8035_rel.cz10aps0_bee	96.817	3.167	0.017	0.021
my8036_rel.cz10a_bee	96.569	3.400	0.031	0.043

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	4477	5636	87.6	6272.2	194.0	1.259	20.044	6.283	199.013	47624	20.3	10.637	363	148.0	164.5	10.5	0.048	4571	2347	my5621_rel.cz10a_bee
998	4392	5637	87.6	6332.6	194.1	1.283	20.434	6.347	199.264	47330	20.3	10.775	370	147.9	164.5	10.5	0.037	4475	2367	my5631_rel.cz10a_bee
998	4382	5635	87.6	6332.5	194.1	1.286	20.478	6.347	199.253	47508	20.5	10.843	374	147.9	164.4	10.5	0.038	4461	2462	my5641_rel.cz10a_bee
998	4370	5636	87.6	6334.8	194.2	1.290	20.535	6.346	199.206	47253	20.3	10.812	372	148.0	164.5	10.5	0.034	4443	2445	my5651_rel.cz10a_bee
998	4280	5632	88.0	6332.9	196.9	1.316	21.057	6.344	201.960	48392	22.7	11.308	424	150.8	167.5	10.7	0.033	4251	2366	my5710_rel.cz10a_bee
998	4201	5624	87.9	6323.8	196.6	1.339	21.423	6.335	201.662	48541	22.9	11.555	436	150.6	167.3	10.7	0.038	4171	2541	my5720_rel.cz10a_bee
998	4212	5625	87.9	6322.7	196.6	1.335	21.365	6.337	201.740	48747	22.8	11.573	433	150.4	167.1	10.7	0.036	4171	2648	my5730_rel.cz10a_bee
997	4132	5624	87.9	6327.6	196.6	1.361	21.780	6.349	202.023	48905	22.9	11.837	443	150.3	167.1	10.7	0.034	4123	2445	my5744_rel.cz10a_bee
997	4100	5632	88.0	6390.5	197.0	1.374	21.981	6.408	202.253	67527	29.5	16.472	576	150.0	166.9	10.7	0.037	4124	2399	my8013_rel.cz10a_bee
998	3867	5628	87.9	6334.2	196.8	1.456	23.289	6.349	201.949	58760	22.7	15.196	470	150.0	166.8	10.5	0.035	3886	2221	my8014_rel.cz10a_bee
998	3756	5626	87.9	7645.8	196.7	1.498	23.961	7.663	201.834	49811	21.6	13.260	460	149.6	166.4	10.5	0.049	3772	2190	my8020_rel.cz10a_bee
998	3300	5625	87.9	7641.7	196.6	1.705	27.277	7.655	201.656	46476	22.8	14.086	553	149.6	166.4	10.7	0.047	3292	2062	my8028_rel.cz10a_bee
999	3828	5543	86.6	7626.9	199.7	1.448	23.170	7.636	204.688	48007	23.9	12.542	500	149.5	166.4	10.8	0.011	3788	3420	my8035_rel.cz10a_bee
998	4449	5545	86.6	7627.4	199.7	1.246	19.941	7.640	204.835	50441	23.5	11.338	423	149.6	166.4	10.6	0.009	4382	3884	my8035_rel_lessps.cz10a_bee
998	4219	5547	86.7	7630.3	199.8	1.315	21.040	7.648	205.017	49670	23.6	11.774	448	149.6	166.5	10.7	0.027	4171	3724	my8035_rel.cz10aps0_bee
998	3819	5542	86.6	7629.9	199.7	1.451	23.220	7.643	204.865	48241	23.9	12.633	501	149.6	166.4	10.7	0.014	3789	3404	my8036_rel.cz10a_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	0.009	94.884	5.093	0.014		0.043
my5631_rel.cz10a_bee	0.006	94.797	5.183	0.014		0.045
my5641_rel.cz10a_bee	0.004	94.833	5.149	0.014		0.047
my5651_rel.cz10a_bee	0.005	94.856	5.125	0.013		0.047
my5710_rel.cz10a_bee	0.003	95.058	4.924	0.014		0.047
my5720_rel.cz10a_bee	0.004	95.020	4.962	0.013		0.043
my5730_rel.cz10a_bee	0.004	94.990	4.992	0.014		0.045
my5744_rel.cz10a_bee	0.005	94.973	5.009	0.013		0.046
my8013_rel.cz10a_bee	0.001	94.888	5.097	0.014		0.057
my8014_rel.cz10a_bee	0.001	94.414	5.571	0.015		0.042
my8020_rel.cz10a_bee	0.001	98.095	1.664	0.241		0.061
my8028_rel.cz10a_bee	0.001	98.026	1.781	0.192		0.055
my8035_rel.cz10a_bee	nonzero	97.901	1.893	0.205		0.059
my8035_rel_lessps.cz10a_bee	0.001	97.971	1.827	0.201		0.062
my8035_rel.cz10aps0_bee	0.001	97.943	1.853	0.203	nonzero	0.091
my8036_rel.cz10a_bee	nonzero	97.884	1.910	0.206		0.056

dbms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	18.006	79.586	2.408	0.112
my5631_rel.cz10a_bee	15.758	81.528	2.714	0.118
my5641_rel.cz10a_bee	15.092	82.439	2.469	0.116
my5651_rel.cz10a_bee	17.192	81.167	1.642	0.113
my5710_rel.cz10a_bee	75.117	24.714	0.169	0.100
my5720_rel.cz10a_bee	76.436	23.394	0.169	0.094
my5730_rel.cz10a_bee	77.008	22.819	0.172	0.085
my5744_rel.cz10a_bee	71.981	27.814	0.206	0.089
my8013_rel.cz10a_bee	78.789	21.058	0.153	0.096
my8014_rel.cz10a_bee	67.275	32.486	0.239	0.106
my8020_rel.cz10a_bee	79.247	19.594	1.158	0.122
my8028_rel.cz10a_bee	87.803	11.067	1.131	0.119
my8035_rel.cz10a_bee	82.431	16.778	0.792	0.126
my8035_rel_lessps.cz10a_bee	85.447	14.119	0.433	0.117
my8035_rel.cz10aps0_bee	83.597	15.481	0.922	0.129
my8036_rel.cz10a_bee	80.508	18.756	0.736	0.114

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	19.608	78.978	1.414		0.062
my5631_rel.cz10a_bee	19.344	79.225	1.431		0.061
my5641_rel.cz10a_bee	19.092	79.425	1.483		0.051
my5651_rel.cz10a_bee	17.981	80.608	1.411		0.058
my5710_rel.cz10a_bee	97.519	2.447	0.031	0.003	0.087
my5720_rel.cz10a_bee	97.572	2.406	0.022		0.025
my5730_rel.cz10a_bee	97.728	2.242	0.031		0.057
my5744_rel.cz10a_bee	96.692	3.286	0.022		0.060
my8013_rel.cz10a_bee	97.172	2.653	0.172	0.003	0.078
my8014_rel.cz10a_bee	95.506	4.222	0.269	0.003	0.074
my8020_rel.cz10a_bee	95.119	4.372	0.506	0.003	0.070
my8028_rel.cz10a_bee	97.728	2.211	0.061		0.047
my8035_rel.cz10a_bee	95.450	4.378	0.172		0.046
my8035_rel_lessps.cz10a_bee	96.519	3.289	0.192		0.059
my8035_rel.cz10aps0_bee	96.042	3.789	0.169		0.058
my8036_rel.cz10a_bee	94.114	5.625	0.261		0.053

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	510	10634	165.7	6360.1	195.8	20.842	332.619	6.371	200.818	41822	12.5	81.972	1960	148.0	164.5	10.5	0.043	511	479	my5621_rel.cz10a_bee
998	502	10550	164.4	6418.0	195.8	21.025	335.521	6.429	200.829	41686	12.4	83.074	1977	147.9	164.5	10.5	0.045	496	463	my5631_rel.cz10a_bee
999	501	10538	164.2	6414.6	195.7	21.038	335.728	6.422	200.684	41759	12.8	83.368	2044	147.9	164.4	10.5	0.047	495	463	my5641_rel.cz10a_bee
998	499	10528	164.1	6413.6	195.7	21.099	336.701	6.424	200.702	41638	12.3	83.442	1972	148.0	164.5	10.5	0.047	495	463	my5651_rel.cz10a_bee
998	521	10708	167.3	6389.5	196.6	20.549	328.784	6.400	201.645	44653	14.5	85.691	2226	150.8	167.5	10.7	0.047	512	463	my5710_rel.cz10a_bee
998	520	10697	167.1	6381.0	196.5	20.587	329.387	6.392	201.545	44830	14.6	86.278	2248	150.6	167.3	10.7	0.043	512	463	my5720_rel.cz10a_bee
998	520	10702	167.2	6382.6	196.4	20.566	329.051	6.393	201.499	45228	14.6	86.911	2244	150.4	167.1	10.7	0.045	512	463	my5730_rel.cz10a_bee
997	518	10698	167.2	6394.1	196.7	20.638	330.202	6.412	201.993	45667	14.6	88.092	2253	150.3	167.1	10.7	0.046	512	448	my5744_rel.cz10a_bee
997	504	10555	164.9	6446.0	196.5	20.935	334.955	6.464	201.801	67066	22.7	133.014	3602	150.0	166.9	10.7	0.057	496	464	my8013_rel.cz10a_bee
998	498	10486	163.8	6385.3	196.2	21.076	337.222	6.396	201.256	58484	14.6	117.555	2348	150.0	166.8	10.5	0.042	496	448	my8014_rel.cz10a_bee
998	517	10674	166.8	7668.1	196.3	20.654	330.462	7.681	201.307	49073	13.2	94.956	2043	149.6	166.4	10.5	0.061	512	464	my8020_rel.cz10a_bee
998	523	10744	167.9	7671.3	196.5	20.526	328.420	7.689	201.633	45512	15.0	86.955	2293	149.6	166.4	10.7	0.055	527	495	my8028_rel.cz10a_bee
998	512	10633	166.1	7778.4	202.2	20.756	332.090	7.792	207.393	44779	16.1	87.408	2514	149.5	166.4	10.8	0.059	511	479	my8035_rel.cz10a_bee
998	522	10722	167.5	7777.8	202.2	20.561	328.967	7.796	207.508	45170	15.7	86.616	2408	149.6	166.4	10.6	0.062	527	479	my8035_rel_lessps.cz10a_bee
999	520	10700	167.2	7778.3	202.2	20.577	329.224	7.788	207.266	44980	15.8	86.499	2431	149.6	166.5	10.7	0.091	512	479	my8035_rel.cz10aps0_bee
998	511	10613	165.8	7770.8	202.0	20.777	332.424	7.784	207.153	44662	16.0	87.435	2506	149.6	166.4	10.7	0.056	511	463	my8036_rel.cz10a_bee

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
101048	0	885	3.5	512.2	36.4	0.009	0.035	0.005	0.369	12625	22.4	0.125	18	52.6	69.1	10.6	0.103	101218	90965	my5621_rel.cz10a_bee
91880	0	804	3.1	459.8	33.2	0.009	0.035	0.005	0.370	11605	21.9	0.126	19	52.6	69.1	10.6	0.215	91908	76270	my5631_rel.cz10a_bee
92368	0	809	3.2	460.8	33.3	0.009	0.035	0.005	0.369	11658	21.9	0.126	19	52.6	69.1	10.6	0.184	92500	76089	my5641_rel.cz10a_bee
92904	0	814	3.2	465.3	33.5	0.009	0.035	0.005	0.370	11744	22.0	0.126	19	52.6	69.1	10.6	0.230	93197	76048	my5651_rel.cz10a_bee
83981	0	0	0.0	433.8	30.4	0.000	0.000	0.005	0.371	9194	21.5	0.109	20	52.6	69.1	10.9	0.120	84306	75616	my5710_rel.cz10a_bee
83255	0	0	0.0	430.2	30.2	0.000	0.000	0.005	0.371	9109	21.6	0.109	21	52.6	69.1	10.9	0.122	83593	74914	my5720_rel.cz10a_bee
80759	0	0	0.0	419.0	29.3	0.000	0.000	0.005	0.371	8855	21.3	0.110	21	52.6	69.1	10.9	0.118	81008	72448	my5730_rel.cz10a_bee
80980	0	0	0.0	420.7	29.4	0.000	0.000	0.005	0.372	9017	21.4	0.111	21	52.6	69.1	10.9	0.121	81352	71824	my5744_rel.cz10a_bee
68329	0	22	0.1	363.4	26.0	0.000	0.001	0.005	0.389	55849	34.9	0.817	41	52.4	69.0	11.0	0.104	68426	60634	my8013_rel.cz10a_bee
67883	0	21	0.1	362.5	25.8	0.000	0.001	0.005	0.389	19399	22.9	0.286	27	52.4	69.0	11.1	0.111	67926	60455	my8014_rel.cz10a_bee
62554	0	0	0.0	388.3	23.5	0.000	0.000	0.006	0.385	17227	22.0	0.275	28	52.4	69.0	11.1	0.126	62466	55340	my8020_rel.cz10a_bee
62174	0	0	0.0	382.3	23.4	0.000	0.000	0.006	0.385	7186	21.0	0.116	27	52.4	69.0	11.0	0.107	62382	55556	my8028_rel.cz10a_bee
54949	0	0	0.0	338.5	20.8	0.000	0.000	0.006	0.388	6574	20.2	0.120	29	52.4	69.0	11.1	0.183	55081	49758	my8035_rel.cz10a_bee
58582	0	0	0.0	360.3	22.2	0.000	0.000	0.006	0.389	6980	20.9	0.119	29	52.4	69.0	10.7	0.176	58742	52940	my8035_rel_lessps.cz10a_bee
56798	0	0	0.0	349.3	21.6	0.000	0.000	0.006	0.389	6779	20.5	0.119	29	52.4	69.0	10.8	0.092	56933	51341	my8035_rel.cz10aps0_bee
55021	0	0	0.0	339.0	20.9	0.000	0.000	0.006	0.389	6582	20.2	0.120	29	52.4	69.0	11.1	0.107	55152	49746	my8036_rel.cz10a_bee

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
80800	0	568	81.7	708.8	103.6	0.007	1.035	0.009	1.312	1840	11.2	0.023	11	111.4	127.9	10.8	0.002	NA	NA	my5621_rel.cz10a_bee
81708	0	546	82.6	699.6	104.7	0.007	1.035	0.009	1.312	1807	11.3	0.022	11	111.4	127.9	10.8	0.002	NA	NA	my5631_rel.cz10a_bee
76518	0	516	77.4	671.5	98.2	0.007	1.035	0.009	1.315	1788	10.9	0.023	11	111.4	127.9	10.8	0.003	NA	NA	my5641_rel.cz10a_bee
81875	0	550	82.7	709.1	105.0	0.007	1.035	0.009	1.313	1857	11.1	0.023	11	111.4	127.9	10.8	0.003	NA	NA	my5651_rel.cz10a_bee
113928	0	716	114.5	978.1	135.5	0.006	1.029	0.009	1.218	6586	12.4	0.058	9	121.1	137.7	11.1	0.002	NA	NA	my5710_rel.cz10a_bee
114564	0	716	115.2	974.8	136.2	0.006	1.030	0.009	1.217	6586	12.4	0.057	9	121.1	137.7	11.1	0.002	NA	NA	my5720_rel.cz10a_bee
111467	0	692	112.1	963.6	132.6	0.006	1.029	0.009	1.218	6528	12.0	0.059	9	121.1	137.7	11.0	0.002	NA	NA	my5730_rel.cz10a_bee
109845	0	692	110.8	952.2	131.0	0.006	1.033	0.009	1.222	6708	12.2	0.061	9	121.1	137.7	10.4	0.002	NA	NA	my5744_rel.cz10a_bee
105235	0	688	106.1	815.5	125.5	0.007	1.032	0.008	1.222	10356	14.1	0.098	11	120.7	137.2	10.4	0.005	NA	NA	my8013_rel.cz10a_bee
103106	0	640	103.6	782.2	122.8	0.006	1.029	0.008	1.219	7072	12.2	0.069	9	120.7	137.2	10.5	0.005	NA	NA	my8014_rel.cz10a_bee
103172	0	638	103.7	891.4	122.9	0.006	1.029	0.009	1.220	6704	12.1	0.065	9	120.7	137.3	11.2	0.003	NA	NA	my8020_rel.cz10a_bee
139714	0	2346	222.4	2854.8	199.9	0.017	1.630	0.020	1.465	11025	42.5	0.079	24	120.7	137.3	11.2	0.004	NA	NA	my8028_rel.cz10a_bee
106738	0	1792	169.8	2181.0	152.7	0.017	1.629	0.020	1.465	8827	43.5	0.083	33	120.7	137.3	11.2	0.004	NA	NA	my8035_rel.cz10a_bee
159267	0	2675	253.6	3245.2	227.8	0.017	1.630	0.020	1.465	12843	40.8	0.081	20	120.7	137.3	10.9	0.003	NA	NA	my8035_rel_lessps.cz10a_bee
161258	0	2705	256.2	3287.6	230.8	0.017	1.627	0.020	1.466	13075	40.7	0.081	20	120.7	137.3	11.0	0.003	NA	NA	my8035_rel.cz10aps0_bee
105152	0	1765	167.4	2146.0	150.4	0.017	1.630	0.020	1.465	8686	43.6	0.083	33	120.7	137.3	11.2	0.004	NA	NA	my8036_rel.cz10a_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1332	0	7474	116.2	9084.5	296.7	5.613	89.362	6.823	228.150	42966	14.2	32.269	853	148.0	164.5	10.5	0.689	1249	899	my5621_rel.cz10a_bee
1320	0	7426	115.5	9092.6	294.6	5.624	89.532	6.886	228.446	42609	14.2	32.267	860	147.9	164.4	10.5	0.797	1249	849	my5631_rel.cz10a_bee
1321	0	7430	115.5	9109.5	295.0	5.623	89.523	6.894	228.597	42852	14.2	32.429	860	147.9	164.4	10.5	0.863	1249	849	my5641_rel.cz10a_bee
1327	0	7445	115.8	9122.0	295.5	5.612	89.348	6.876	228.071	43015	14.3	32.425	862	148.0	164.5	10.5	0.710	1249	849	my5651_rel.cz10a_bee
1798	0	9166	143.2	11343.3	369.1	5.096	81.542	6.307	210.151	56714	21.8	31.534	970	150.6	167.2	10.7	0.251	1698	999	my5710_rel.cz10a_bee
1787	0	9112	142.4	11273.1	366.8	5.098	81.569	6.307	210.134	56879	22.0	31.824	985	150.6	167.2	10.7	0.266	1698	999	my5720_rel.cz10a_bee
1723	0	8875	138.7	10972.8	356.6	5.150	82.398	6.367	211.907	56072	21.2	32.538	984	150.3	166.9	10.7	0.348	1648	899	my5730_rel.cz10a_bee
1729	0	8912	139.3	11023.3	358.3	5.154	82.458	6.374	212.163	56825	21.4	32.860	990	150.3	166.8	10.7	0.337	1648	899	my5744_rel.cz10a_bee
1752	0	8973	140.2	11206.0	361.1	5.121	81.941	6.396	211.051	93426	33.4	53.325	1525	150.0	166.6	10.7	0.405	1648	949	my8013_rel.cz10a_bee
1596	0	8171	127.7	10125.3	328.6	5.121	81.944	6.346	210.902	76633	18.9	48.031	948	150.0	166.6	10.5	0.396	1500	849	my8014_rel.cz10a_bee
1706	0	8804	137.6	13131.1	353.9	5.162	82.584	7.698	212.464	68615	17.3	40.227	811	149.6	166.4	10.5	0.256	1648	849	my8020_rel.cz10a_bee
1800	0	9270	144.8	13861.2	373.7	5.150	82.398	7.700	212.597	60823	21.8	33.789	969	149.6	166.3	10.7	0.467	1748	949	my8028_rel.cz10a_bee
1712	0	8835	138.0	13249.7	367.6	5.160	82.552	7.738	219.821	55841	22.8	32.611	1065	149.5	166.3	10.7	0.261	1648	899	my8035_rel.cz10a_bee
1738	0	8958	140.0	13417.9	372.3	5.155	82.486	7.722	219.413	56849	22.6	32.717	1041	149.6	166.4	10.6	0.212	1648	900	my8035_rel_lessps.cz10a_bee
1725	0	8871	138.6	13311.9	369.3	5.143	82.292	7.718	219.245	56185	22.8	32.575	1058	149.6	166.3	10.7	0.288	1648	949	my8035_rel.cz10aps0_bee
1721	0	8862	138.5	13288.6	368.6	5.149	82.380	7.721	219.326	56029	22.8	32.554	1060	149.6	166.3	10.7	0.249	1648	899	my8036_rel.cz10a_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1645	0	7757	115.2	8791.9	275.6	4.716	71.734	5.346	171.567	48881	20.8	29.720	1012	148.0	164.5	10.5	0.066	1663	1344	my5621_rel.cz10a_bee
1621	0	7674	114.0	8766.9	272.5	4.735	72.039	5.409	172.160	48228	20.8	29.758	1027	147.9	164.5	10.5	0.062	1638	1328	my5631_rel.cz10a_bee
1629	0	7698	114.4	8814.6	273.5	4.727	71.909	5.412	171.958	48528	20.8	29.797	1022	147.9	164.4	10.5	0.065	1644	1333	my5641_rel.cz10a_bee
1626	0	7700	114.4	8779.8	272.8	4.735	72.047	5.400	171.814	48447	20.8	29.795	1023	148.0	164.5	10.5	0.061	1643	1334	my5651_rel.cz10a_bee
2101	0	7993	124.9	9827.7	309.2	3.805	60.875	4.678	150.701	58110	29.6	27.661	1127	150.8	167.5	10.7	0.092	2073	1764	my5710_rel.cz10a_bee
2008	0	7977	124.6	9769.3	307.4	3.973	63.562	4.865	156.782	58271	29.7	29.019	1183	150.6	167.3	10.7	0.058	1973	1713	my5720_rel.cz10a_bee
2024	0	8087	126.4	9899.2	311.6	3.995	63.920	4.890	157.628	59540	29.5	29.414	1166	150.4	167.1	10.7	0.061	1983	1723	my5730_rel.cz10a_bee
2049	0	8175	127.7	10024.5	315.7	3.990	63.834	4.892	157.758	60660	29.6	29.603	1156	150.3	167.1	10.7	0.065	2028	1709	my5744_rel.cz10a_bee
2053	0	8072	126.1	9999.5	311.9	3.931	62.902	4.870	155.536	94898	40.5	46.217	1578	150.0	166.9	10.7	0.088	2038	1655	my8013_rel.cz10a_bee
1802	0	7363	115.0	8987.8	282.8	4.086	65.382	4.988	160.732	81949	28.6	45.482	1270	150.0	166.8	10.5	0.097	1749	1470	my8014_rel.cz10a_bee
1934	0	7993	124.9	11782.6	307.0	4.133	66.121	6.092	162.530	76380	28.7	39.489	1187	149.6	166.4	10.5	0.144	1874	1634	my8020_rel.cz10a_bee
1992	0	8394	131.2	12342.7	321.9	4.214	67.423	6.196	165.453	61348	30.9	30.797	1241	149.6	166.4	10.7	0.068	1949	1713	my8028_rel.cz10a_bee
1905	0	8092	126.4	11910.1	318.3	4.249	67.978	6.253	171.134	56420	31.8	29.622	1336	149.5	166.4	10.7	0.077	1858	1664	my8035_rel.cz10a_bee
2008	0	8271	129.2	12209.3	326.2	4.119	65.902	6.080	166.369	58517	31.8	29.142	1267	149.6	166.4	10.6	0.083	1948	1728	my8035_rel_lessps.cz10a_bee
1946	0	8154	127.4	12021.1	321.2	4.191	67.055	6.179	169.066	57640	32.0	29.628	1316	149.6	166.5	10.7	0.085	1903	1698	my8035_rel.cz10aps0_bee
1912	0	8088	126.4	11931.0	318.8	4.230	67.684	6.240	170.742	57007	32.2	29.816	1347	149.6	166.4	10.7	0.064	1873	1673	my8036_rel.cz10a_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	5291	632	9.8	552.0	17.2	0.119	1.900	5.531	176.057	23201	13.1	4.385	198	148.0	164.5	10.5	0.020	5290	3772	my5621_rel.cz10a_bee
100	5205	631	9.8	647.0	19.9	0.121	1.930	6.490	204.354	23198	13.2	4.457	203	147.9	164.5	10.5	0.023	5198	3292	my5631_rel.cz10a_bee
100	5152	631	9.8	556.0	17.1	0.122	1.947	5.571	175.954	22676	13.0	4.401	202	147.9	164.4	10.5	0.019	5147	3419	my5641_rel.cz10a_bee
100	5161	632	9.8	622.4	19.1	0.122	1.947	6.237	196.355	22923	13.2	4.442	205	148.0	164.5	10.5	0.017	5162	3261	my5651_rel.cz10a_bee
100	4090	987	15.4	899.9	27.7	0.241	3.862	9.026	284.571	20679	14.3	5.056	280	150.8	167.5	10.7	0.037	4043	2335	my5710_rel.cz10a_bee
100	3977	877	13.7	760.5	23.5	0.221	3.530	7.628	240.962	19559	14.1	4.918	284	150.6	167.3	10.7	0.035	3948	2493	my5720_rel.cz10a_bee
100	3903	750	11.7	618.3	19.0	0.192	3.074	6.195	194.869	18561	13.9	4.756	285	150.4	167.1	10.7	0.036	3867	2461	my5730_rel.cz10a_bee
100	3870	736	11.5	601.7	18.5	0.190	3.044	6.041	189.905	18404	14.1	4.755	291	150.3	167.1	10.7	0.034	3836	2397	my5744_rel.cz10a_bee
100	3581	958	15.0	892.5	27.2	0.268	4.281	8.961	279.269	24340	15.3	6.797	342	150.0	166.9	10.7	0.036	3548	2253	my8013_rel.cz10a_bee
100	3434	956	14.9	868.0	26.6	0.278	4.454	8.697	273.081	20678	14.4	6.022	336	150.0	166.8	10.5	0.035	3404	2286	my8014_rel.cz10a_bee
100	3378	828	12.9	863.2	22.1	0.245	3.922	8.649	226.511	18599	14.0	5.506	332	149.6	166.4	10.5	0.045	3356	2399	my8020_rel.cz10a_bee
100	3094	633	9.9	568.5	14.6	0.205	3.274	5.702	150.334	15007	13.3	4.851	344	149.6	166.4	10.7	0.012	3084	2104	my8028_rel.cz10a_bee
100	3593	582	9.1	631.0	16.6	0.162	2.590	6.323	170.354	17037	13.9	4.742	309	149.5	166.4	10.7	0.046	3548	3308	my8035_rel.cz10a_bee
100	4130	651	10.2	739.9	19.4	0.158	2.522	7.421	199.604	19521	14.1	4.726	273	149.6	166.4	10.6	0.033	4060	3756	my8035_rel_lessps.cz10a_bee
100	3956	630	9.9	720.9	18.9	0.159	2.550	7.231	194.358	18774	14.2	4.745	287	149.6	166.5	10.7	0.031	3900	3596	my8035_rel.cz10aps0_bee
100	3604	590	9.2	652.6	17.2	0.164	2.621	6.539	176.023	17135	14.0	4.754	311	149.6	166.4	10.7	0.009	3564	3324	my8036_rel.cz10a_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	672	6554	102.4	994.2	30.5	9.758	156.047	9.962	313.152	18215	4.7	27.118	560	148.0	164.5	10.5	0.037	672	575	my5621_rel.cz10a_bee
100	647	6343	99.1	864.9	26.3	9.799	156.709	8.666	270.225	17277	4.6	26.692	569	147.9	164.5	10.5	0.036	655	591	my5631_rel.cz10a_bee
100	645	6333	98.9	965.4	29.4	9.818	157.006	9.673	301.912	17582	4.5	27.259	558	147.9	164.4	10.5	0.039	655	559	my5641_rel.cz10a_bee
100	645	6327	98.8	888.5	27.0	9.811	156.891	8.903	277.307	17310	4.7	26.842	583	148.0	164.5	10.5	0.036	655	591	my5651_rel.cz10a_bee
100	646	6359	99.4	990.6	30.3	9.841	157.463	9.926	310.889	18121	5.4	28.046	669	150.8	167.5	10.7	0.039	655	592	my5710_rel.cz10a_bee
100	647	6369	99.5	986.4	30.2	9.838	157.406	9.884	309.778	18169	5.4	28.064	667	150.6	167.3	10.7	0.040	655	591	my5720_rel.cz10a_bee
100	646	6353	99.3	986.5	30.2	9.841	157.462	9.885	309.392	18202	5.3	28.198	657	150.4	167.1	10.7	0.038	655	591	my5730_rel.cz10a_bee
100	644	6369	99.5	982.2	30.0	9.882	158.107	9.871	309.018	18277	5.5	28.359	683	150.3	167.1	10.7	0.037	655	576	my5744_rel.cz10a_bee
100	622	6178	96.5	990.9	30.1	9.926	158.809	9.959	309.718	22075	6.1	35.468	784	150.0	166.9	10.7	0.037	624	543	my8013_rel.cz10a_bee
100	619	6136	95.9	988.7	30.2	9.915	158.648	9.917	310.539	19435	5.7	31.407	737	150.0	166.8	10.5	0.036	623	559	my8014_rel.cz10a_bee
100	618	6123	95.7	1177.3	29.9	9.899	158.389	11.796	306.811	18199	5.5	29.425	711	149.6	166.4	10.5	0.043	623	559	my8020_rel.cz10a_bee
100	627	6196	96.8	1187.0	30.0	9.881	158.092	11.894	307.978	17945	5.5	28.615	702	149.6	166.4	10.7	0.041	624	575	my8028_rel.cz10a_bee
100	615	6098	95.3	1136.4	29.2	9.916	158.653	11.398	299.871	17650	5.9	28.699	768	149.5	166.4	10.7	0.045	623	559	my8035_rel.cz10a_bee
100	628	6202	96.9	1138.7	29.3	9.869	157.909	11.410	300.211	17939	5.5	28.548	700	149.6	166.4	10.6	0.042	639	575	my8035_rel_lessps.cz10a_bee
100	629	6212	97.1	1143.8	29.4	9.871	157.928	11.460	301.469	17950	5.7	28.523	725	149.6	166.5	10.7	0.044	639	575	my8035_rel.cz10aps0_bee
100	611	6059	94.7	1133.4	29.1	9.916	158.649	11.357	298.839	17530	6.1	28.686	799	149.6	166.4	10.7	0.042	623	543	my8036_rel.cz10a_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	4877	2978	46.3	3115.4	96.8	0.611	9.723	6.246	198.693	33746	16.6	6.919	272	148.0	164.5	10.5	0.013	4891	2955	my5621_rel.cz10a_bee
499	4797	2978	46.3	3154.2	97.1	0.621	9.886	6.324	199.369	33469	16.6	6.977	277	147.9	164.5	10.5	0.036	4811	2876	my5631_rel.cz10a_bee
499	4770	2978	46.3	3167.7	97.5	0.624	9.945	6.351	200.165	33399	16.6	7.003	278	147.9	164.4	10.5	0.017	4783	2855	my5641_rel.cz10a_bee
499	4730	2978	46.3	3168.8	97.5	0.630	10.025	6.349	200.063	33261	16.6	7.031	281	148.0	164.5	10.5	0.039	4747	2812	my5651_rel.cz10a_bee
499	4192	2999	46.9	3214.8	100.2	0.715	11.446	6.445	205.664	32435	18.0	7.738	344	150.8	167.5	10.7	0.030	4142	2590	my5710_rel.cz10a_bee
499	4126	2996	46.8	3211.0	100.1	0.726	11.616	6.440	205.532	32373	18.1	7.846	351	150.6	167.3	10.7	0.037	4077	2509	my5720_rel.cz10a_bee
498	4017	2992	46.8	3207.5	100.0	0.745	11.918	6.445	205.667	32116	18.0	7.995	358	150.4	167.1	10.7	0.016	3980	2413	my5730_rel.cz10a_bee
498	4046	2994	46.8	3213.7	100.1	0.740	11.838	6.457	206.037	32542	18.1	8.042	358	150.3	167.1	10.7	0.024	4012	2412	my5744_rel.cz10a_bee
499	3870	3001	46.9	3244.8	100.2	0.775	12.407	6.508	205.854	41391	21.2	10.695	438	150.0	166.9	10.7	0.013	3868	2477	my8013_rel.cz10a_bee
499	3679	2997	46.8	3221.3	100.3	0.815	13.032	6.458	205.902	37107	18.1	10.086	394	150.0	166.8	10.5	0.037	3676	2174	my8014_rel.cz10a_bee
499	3599	2991	46.7	3877.4	100.0	0.831	13.295	7.769	205.152	32738	17.5	9.095	389	149.6	166.4	10.5	0.040	3593	2280	my8020_rel.cz10a_bee
499	3249	2990	46.7	3867.6	99.8	0.920	14.724	7.754	204.854	30081	18.0	9.258	443	149.6	166.4	10.7	0.036	3229	2048	my8028_rel.cz10a_bee
499	3738	2936	45.9	3890.6	102.5	0.785	12.568	7.800	210.372	31771	18.8	8.500	402	149.5	166.4	10.7	0.011	3708	3340	my8035_rel.cz10a_bee
499	4334	2940	45.9	3893.0	102.5	0.678	10.852	7.808	210.588	33967	18.5	7.837	341	149.6	166.4	10.6	0.027	4269	3818	my8035_rel_lessps.cz10a_bee
499	4174	2940	45.9	3891.6	102.5	0.704	11.269	7.802	210.438	33470	18.7	8.018	358	149.6	166.5	10.7	0.023	4123	3660	my8035_rel.cz10aps0_bee
499	3750	2938	45.9	3894.0	102.6	0.783	12.534	7.807	210.554	31892	18.9	8.505	403	149.6	166.4	10.7	0.010	3723	3324	my8036_rel.cz10a_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	592	8592	134.0	3487.4	107.7	14.526	232.035	6.992	221.138	28846	8.1	48.768	1096	148.0	164.5	10.5	0.044	591	559	my5621_rel.cz10a_bee
499	570	8400	131.0	3514.1	107.6	14.729	235.275	7.045	220.809	28392	8.1	49.784	1136	147.9	164.5	10.5	0.043	575	543	my5631_rel.cz10a_bee
499	570	8392	130.9	3514.7	107.6	14.727	235.237	7.042	220.701	28410	8.2	49.859	1151	147.9	164.4	10.5	0.047	575	543	my5641_rel.cz10a_bee
499	569	8390	130.9	3516.2	107.6	14.742	235.477	7.045	220.797	28420	8.1	49.939	1139	148.0	164.5	10.5	0.047	575	543	my5651_rel.cz10a_bee
499	574	8452	132.1	3519.7	108.7	14.717	235.472	7.056	223.241	30224	9.6	52.628	1337	150.8	167.5	10.7	0.049	575	543	my5710_rel.cz10a_bee
499	573	8439	131.9	3518.5	108.7	14.735	235.757	7.054	223.139	30326	9.7	52.952	1355	150.6	167.3	10.7	0.042	575	543	my5720_rel.cz10a_bee
499	573	8439	131.9	3517.1	108.7	14.727	235.635	7.051	223.077	30558	9.7	53.329	1354	150.4	167.1	10.7	0.044	575	543	my5730_rel.cz10a_bee
498	570	8412	131.4	3507.7	108.6	14.770	236.326	7.039	223.225	30753	9.7	54.001	1363	150.3	167.1	10.7	0.043	575	543	my5744_rel.cz10a_bee
498	553	8268	129.2	3542.0	108.7	14.948	239.176	7.113	223.465	48027	11.0	86.832	1591	150.0	166.9	10.7	0.043	559	527	my8013_rel.cz10a_bee
499	550	8232	128.6	3512.3	108.6	14.962	239.388	7.037	222.843	37047	10.1	67.334	1469	150.0	166.8	10.5	0.045	544	512	my8014_rel.cz10a_bee
499	555	8272	129.3	4219.5	108.3	14.894	238.302	8.454	222.242	32312	9.1	58.178	1311	149.6	166.4	10.5	0.057	559	527	my8020_rel.cz10a_bee
499	565	8361	130.6	4224.8	108.5	14.791	236.658	8.465	222.547	30799	10.0	54.482	1415	149.6	166.4	10.7	0.054	560	543	my8028_rel.cz10a_bee
499	556	8276	129.3	4270.4	111.7	14.875	237.996	8.556	229.130	30497	10.7	54.812	1538	149.5	166.4	10.8	0.056	559	527	my8035_rel.cz10a_bee
499	565	8362	130.6	4275.3	111.8	14.791	236.660	8.566	229.395	30856	10.2	54.583	1443	149.6	166.4	10.6	0.055	560	543	my8035_rel_lessps.cz10a_bee
499	563	8338	130.3	4272.4	111.7	14.812	236.996	8.560	229.232	30695	10.4	54.530	1478	149.6	166.5	10.7	0.054	559	540	my8035_rel.cz10aps0_bee
499	553	8247	128.9	4269.7	111.7	14.911	238.577	8.555	229.094	30288	10.9	54.761	1577	149.6	166.4	10.7	0.069	559	512	my8036_rel.cz10a_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	4477	5636	87.6	6272.2	194.0	1.259	20.044	6.283	199.013	47624	20.3	10.637	363	148.0	164.5	10.5	0.048	4571	2347	my5621_rel.cz10a_bee
998	4392	5637	87.6	6332.6	194.1	1.283	20.434	6.347	199.264	47330	20.3	10.775	370	147.9	164.5	10.5	0.037	4475	2367	my5631_rel.cz10a_bee
998	4382	5635	87.6	6332.5	194.1	1.286	20.478	6.347	199.253	47508	20.5	10.843	374	147.9	164.4	10.5	0.038	4461	2462	my5641_rel.cz10a_bee
998	4370	5636	87.6	6334.8	194.2	1.290	20.535	6.346	199.206	47253	20.3	10.812	372	148.0	164.5	10.5	0.034	4443	2445	my5651_rel.cz10a_bee
998	4280	5632	88.0	6332.9	196.9	1.316	21.057	6.344	201.960	48392	22.7	11.308	424	150.8	167.5	10.7	0.033	4251	2366	my5710_rel.cz10a_bee
998	4201	5624	87.9	6323.8	196.6	1.339	21.423	6.335	201.662	48541	22.9	11.555	436	150.6	167.3	10.7	0.038	4171	2541	my5720_rel.cz10a_bee
998	4212	5625	87.9	6322.7	196.6	1.335	21.365	6.337	201.740	48747	22.8	11.573	433	150.4	167.1	10.7	0.036	4171	2648	my5730_rel.cz10a_bee
997	4132	5624	87.9	6327.6	196.6	1.361	21.780	6.349	202.023	48905	22.9	11.837	443	150.3	167.1	10.7	0.034	4123	2445	my5744_rel.cz10a_bee
997	4100	5632	88.0	6390.5	197.0	1.374	21.981	6.408	202.253	67527	29.5	16.472	576	150.0	166.9	10.7	0.037	4124	2399	my8013_rel.cz10a_bee
998	3867	5628	87.9	6334.2	196.8	1.456	23.289	6.349	201.949	58760	22.7	15.196	470	150.0	166.8	10.5	0.035	3886	2221	my8014_rel.cz10a_bee
998	3756	5626	87.9	7645.8	196.7	1.498	23.961	7.663	201.834	49811	21.6	13.260	460	149.6	166.4	10.5	0.049	3772	2190	my8020_rel.cz10a_bee
998	3300	5625	87.9	7641.7	196.6	1.705	27.277	7.655	201.656	46476	22.8	14.086	553	149.6	166.4	10.7	0.047	3292	2062	my8028_rel.cz10a_bee
999	3828	5543	86.6	7626.9	199.7	1.448	23.170	7.636	204.688	48007	23.9	12.542	500	149.5	166.4	10.8	0.011	3788	3420	my8035_rel.cz10a_bee
998	4449	5545	86.6	7627.4	199.7	1.246	19.941	7.640	204.835	50441	23.5	11.338	423	149.6	166.4	10.6	0.009	4382	3884	my8035_rel_lessps.cz10a_bee
998	4219	5547	86.7	7630.3	199.8	1.315	21.040	7.648	205.017	49670	23.6	11.774	448	149.6	166.5	10.7	0.027	4171	3724	my8035_rel.cz10aps0_bee
998	3819	5542	86.6	7629.9	199.7	1.451	23.220	7.643	204.865	48241	23.9	12.633	501	149.6	166.4	10.7	0.014	3789	3404	my8036_rel.cz10a_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	510	10634	165.7	6360.1	195.8	20.842	332.619	6.371	200.818	41822	12.5	81.972	1960	148.0	164.5	10.5	0.043	511	479	my5621_rel.cz10a_bee
998	502	10550	164.4	6418.0	195.8	21.025	335.521	6.429	200.829	41686	12.4	83.074	1977	147.9	164.5	10.5	0.045	496	463	my5631_rel.cz10a_bee
999	501	10538	164.2	6414.6	195.7	21.038	335.728	6.422	200.684	41759	12.8	83.368	2044	147.9	164.4	10.5	0.047	495	463	my5641_rel.cz10a_bee
998	499	10528	164.1	6413.6	195.7	21.099	336.701	6.424	200.702	41638	12.3	83.442	1972	148.0	164.5	10.5	0.047	495	463	my5651_rel.cz10a_bee
998	521	10708	167.3	6389.5	196.6	20.549	328.784	6.400	201.645	44653	14.5	85.691	2226	150.8	167.5	10.7	0.047	512	463	my5710_rel.cz10a_bee
998	520	10697	167.1	6381.0	196.5	20.587	329.387	6.392	201.545	44830	14.6	86.278	2248	150.6	167.3	10.7	0.043	512	463	my5720_rel.cz10a_bee
998	520	10702	167.2	6382.6	196.4	20.566	329.051	6.393	201.499	45228	14.6	86.911	2244	150.4	167.1	10.7	0.045	512	463	my5730_rel.cz10a_bee
997	518	10698	167.2	6394.1	196.7	20.638	330.202	6.412	201.993	45667	14.6	88.092	2253	150.3	167.1	10.7	0.046	512	448	my5744_rel.cz10a_bee
997	504	10555	164.9	6446.0	196.5	20.935	334.955	6.464	201.801	67066	22.7	133.014	3602	150.0	166.9	10.7	0.057	496	464	my8013_rel.cz10a_bee
998	498	10486	163.8	6385.3	196.2	21.076	337.222	6.396	201.256	58484	14.6	117.555	2348	150.0	166.8	10.5	0.042	496	448	my8014_rel.cz10a_bee
998	517	10674	166.8	7668.1	196.3	20.654	330.462	7.681	201.307	49073	13.2	94.956	2043	149.6	166.4	10.5	0.061	512	464	my8020_rel.cz10a_bee
998	523	10744	167.9	7671.3	196.5	20.526	328.420	7.689	201.633	45512	15.0	86.955	2293	149.6	166.4	10.7	0.055	527	495	my8028_rel.cz10a_bee
998	512	10633	166.1	7778.4	202.2	20.756	332.090	7.792	207.393	44779	16.1	87.408	2514	149.5	166.4	10.8	0.059	511	479	my8035_rel.cz10a_bee
998	522	10722	167.5	7777.8	202.2	20.561	328.967	7.796	207.508	45170	15.7	86.616	2408	149.6	166.4	10.6	0.062	527	479	my8035_rel_lessps.cz10a_bee
999	520	10700	167.2	7778.3	202.2	20.577	329.224	7.788	207.266	44980	15.8	86.499	2431	149.6	166.5	10.7	0.091	512	479	my8035_rel.cz10aps0_bee
998	511	10613	165.8	7770.8	202.0	20.777	332.424	7.784	207.153	44662	16.0	87.435	2506	149.6	166.4	10.7	0.056	511	463	my8036_rel.cz10a_bee

l.i0

l.i0: load without secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	92.077	7.801	0.118	0.003	0.002	0.000	0.000	0.000	0.000	0.103	my5621_rel.cz10a_bee
0.000	61.238	38.614	0.085	0.060	0.004	0.000	0.000	0.000	0.000	0.215	my5631_rel.cz10a_bee
0.000	64.912	34.941	0.083	0.060	0.004	0.000	0.000	0.000	0.000	0.184	my5641_rel.cz10a_bee
0.000	70.153	29.700	0.082	0.061	0.004	0.000	0.000	0.000	0.000	0.230	my5651_rel.cz10a_bee
0.000	2.011	97.652	0.318	0.016	0.002	0.000	0.000	0.000	0.000	0.120	my5710_rel.cz10a_bee
0.000	0.866	98.795	0.321	0.016	0.002	0.000	0.000	0.000	0.000	0.122	my5720_rel.cz10a_bee
0.000	0.445	99.185	0.220	0.148	0.002	0.000	0.000	0.000	0.000	0.118	my5730_rel.cz10a_bee
0.000	0.415	99.215	0.218	0.149	0.003	0.000	0.000	0.000	0.000	0.121	my5744_rel.cz10a_bee
0.000	0.000	99.483	0.381	0.134	0.002	0.000	0.000	0.000	0.000	0.104	my8013_rel.cz10a_bee
0.000	0.000	99.398	0.445	0.154	0.003	0.000	0.000	0.000	0.000	0.111	my8014_rel.cz10a_bee
0.000	0.000	99.364	0.460	0.172	0.004	0.000	0.000	0.000	0.000	0.126	my8020_rel.cz10a_bee
0.000	0.000	99.464	0.386	0.146	0.004	0.000	0.000	0.000	0.000	0.107	my8028_rel.cz10a_bee
0.000	0.000	99.406	0.445	0.146	0.003	0.000	0.000	0.000	0.000	0.183	my8035_rel.cz10a_bee
0.000	0.000	99.432	0.424	0.141	0.003	0.000	0.000	0.000	0.000	0.176	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.417	0.437	0.143	0.003	0.000	0.000	0.000	0.000	0.092	my8035_rel.cz10aps0_bee
0.000	0.000	99.405	0.445	0.146	0.003	0.000	0.000	0.000	0.000	0.107	my8036_rel.cz10a_bee

l.x

l.x: create secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

TODO - determine whether there is data for create index response time

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.585	89.492	9.921	0.001	0.000	0.000	0.000	0.689	my5621_rel.cz10a_bee
0.000	0.000	0.000	0.475	89.359	10.161	0.005	0.000	0.000	0.000	0.797	my5631_rel.cz10a_bee
0.000	0.000	0.000	0.496	89.450	10.050	0.004	0.000	0.000	0.000	0.863	my5641_rel.cz10a_bee
0.000	0.000	0.000	0.484	89.338	10.174	0.005	0.000	0.000	0.000	0.710	my5651_rel.cz10a_bee
0.000	0.000	0.000	24.575	70.234	5.191	0.000	0.000	0.000	0.000	0.251	my5710_rel.cz10a_bee
0.000	0.000	0.000	23.384	71.421	5.194	0.001	0.000	0.000	0.000	0.266	my5720_rel.cz10a_bee
0.000	0.000	0.000	22.980	71.529	5.489	0.003	0.000	0.000	0.000	0.348	my5730_rel.cz10a_bee
0.000	0.000	0.000	23.245	71.362	5.389	0.004	0.000	0.000	0.000	0.337	my5744_rel.cz10a_bee
0.000	0.000	0.000	22.804	71.418	5.775	0.004	0.000	0.000	0.000	0.405	my8013_rel.cz10a_bee
0.000	0.000	0.000	13.581	80.082	6.333	0.004	0.000	0.000	0.000	0.396	my8014_rel.cz10a_bee
0.000	0.000	0.000	16.574	77.771	5.655	0.000	0.000	0.000	0.000	0.256	my8020_rel.cz10a_bee
0.000	0.000	0.000	22.089	72.719	5.190	0.003	0.000	0.000	0.000	0.467	my8028_rel.cz10a_bee
0.000	0.000	0.000	16.773	77.761	5.465	0.001	0.000	0.000	0.000	0.261	my8035_rel.cz10a_bee
0.000	0.000	0.000	19.220	75.355	5.425	0.000	0.000	0.000	0.000	0.212	my8035_rel_lessps.cz10a_bee
0.000	0.000	0.000	17.992	76.578	5.429	0.001	0.000	0.000	0.000	0.288	my8035_rel.cz10aps0_bee
0.000	0.000	0.000	17.570	77.000	5.430	0.000	0.000	0.000	0.000	0.249	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	7.965	87.580	4.446	0.007	0.001	0.000	0.000	0.000	0.557	my5621_rel.cz10a_bee
0.000	0.000	7.706	87.669	4.617	0.006	0.001	0.000	0.000	0.000	0.639	my5631_rel.cz10a_bee
0.000	0.000	7.303	88.135	4.553	0.009	0.001	0.000	0.000	0.000	0.681	my5641_rel.cz10a_bee
0.000	0.000	6.101	89.356	4.539	0.003	0.001	0.000	0.000	0.000	0.588	my5651_rel.cz10a_bee
0.000	0.000	84.642	15.163	0.188	0.007	0.000	0.000	0.000	0.000	0.128	my5710_rel.cz10a_bee
0.000	0.000	83.526	16.286	0.186	0.001	0.000	0.000	0.000	0.000	0.140	my5720_rel.cz10a_bee
0.000	0.000	86.684	13.071	0.239	0.006	0.000	0.000	0.000	0.000	0.077	my5730_rel.cz10a_bee
0.000	0.000	84.528	15.205	0.261	0.006	0.000	0.000	0.000	0.000	0.103	my5744_rel.cz10a_bee
0.000	0.000	81.141	17.752	1.076	0.030	0.000	0.000	0.000	0.000	0.150	my8013_rel.cz10a_bee
0.000	0.000	70.868	27.776	1.325	0.031	0.000	0.000	0.000	0.000	0.135	my8014_rel.cz10a_bee
0.000	0.000	73.189	25.725	1.061	0.025	0.000	0.000	0.000	0.000	0.107	my8020_rel.cz10a_bee
0.000	0.000	70.976	28.759	0.261	0.004	0.000	0.000	0.000	0.000	0.130	my8028_rel.cz10a_bee
0.000	0.000	47.145	52.521	0.329	0.005	0.000	0.000	0.000	0.000	0.076	my8035_rel.cz10a_bee
0.000	0.000	59.496	40.151	0.346	0.006	0.000	0.000	0.000	0.000	0.102	my8035_rel_lessps.cz10a_bee
0.000	0.000	53.604	46.084	0.310	0.003	0.000	0.000	0.000	0.000	0.068	my8035_rel.cz10aps0_bee
0.000	0.000	47.870	51.776	0.354	0.000	0.000	0.000	0.000	0.000	0.061	my8036_rel.cz10a_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	3.379	82.553	13.617	0.451	0.001	0.000	0.000	0.000	0.000	0.066	my5621_rel.cz10a_bee
0.000	3.125	82.522	13.857	0.496	0.000	0.000	0.000	0.000	0.000	0.062	my5631_rel.cz10a_bee
0.000	3.193	82.624	13.713	0.470	0.001	0.000	0.000	0.000	0.000	0.065	my5641_rel.cz10a_bee
0.000	3.236	82.431	13.881	0.452	0.000	0.000	0.000	0.000	0.000	0.061	my5651_rel.cz10a_bee
0.000	8.330	83.292	8.013	0.364	0.001	0.000	0.000	0.000	0.000	0.092	my5710_rel.cz10a_bee
0.000	6.410	84.348	8.928	0.314	0.000	0.000	0.000	0.000	0.000	0.058	my5720_rel.cz10a_bee
0.000	6.602	84.097	8.971	0.331	0.000	0.000	0.000	0.000	0.000	0.061	my5730_rel.cz10a_bee
0.000	6.983	83.892	8.825	0.298	0.001	0.000	0.000	0.000	0.000	0.065	my5744_rel.cz10a_bee
0.000	7.239	85.565	6.324	0.869	0.003	0.000	0.000	0.000	0.000	0.088	my8013_rel.cz10a_bee
0.000	3.517	87.070	8.636	0.773	0.003	0.000	0.000	0.000	0.000	0.097	my8014_rel.cz10a_bee
0.000	4.154	90.511	4.507	0.819	0.010	0.000	0.000	0.000	0.000	0.144	my8020_rel.cz10a_bee
0.000	3.712	90.631	5.132	0.523	0.001	0.000	0.000	0.000	0.000	0.068	my8028_rel.cz10a_bee
0.000	2.627	91.239	5.518	0.617	0.001	0.000	0.000	0.000	0.000	0.077	my8035_rel.cz10a_bee
0.000	4.250	90.020	5.163	0.564	0.002	0.000	0.000	0.000	0.000	0.083	my8035_rel_lessps.cz10a_bee
0.000	3.365	90.665	5.365	0.603	0.002	0.000	0.000	0.000	0.000	0.085	my8035_rel.cz10aps0_bee
0.000	2.724	91.200	5.470	0.605	0.001	0.000	0.000	0.000	0.000	0.064	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	19.262	77.797	2.847	0.093	0.000	0.000	0.000	0.000	0.000	0.058	my5621_rel.cz10a_bee
0.000	17.482	79.429	2.968	0.121	0.000	0.000	0.000	0.000	0.000	0.061	my5631_rel.cz10a_bee
0.000	18.896	78.067	2.939	0.099	0.000	0.000	0.000	0.000	0.000	0.061	my5641_rel.cz10a_bee
0.000	18.626	78.331	2.943	0.101	0.000	0.000	0.000	0.000	0.000	0.044	my5651_rel.cz10a_bee
0.000	58.217	41.197	0.565	0.021	0.001	0.000	0.000	0.000	0.000	0.091	my5710_rel.cz10a_bee
0.000	50.113	49.166	0.704	0.017	0.000	0.000	0.000	0.000	0.000	0.039	my5720_rel.cz10a_bee
0.000	55.534	43.807	0.638	0.020	0.001	0.000	0.000	0.000	0.000	0.075	my5730_rel.cz10a_bee
0.000	57.111	42.193	0.678	0.018	0.000	0.000	0.000	0.000	0.000	0.064	my5744_rel.cz10a_bee
0.000	62.184	36.984	0.656	0.176	0.001	0.000	0.000	0.000	0.000	0.100	my8013_rel.cz10a_bee
0.000	44.897	53.727	1.164	0.211	0.001	0.000	0.000	0.000	0.000	0.069	my8014_rel.cz10a_bee
0.000	49.256	49.801	0.766	0.176	0.002	0.000	0.000	0.000	0.000	0.128	my8020_rel.cz10a_bee
0.000	30.416	69.006	0.538	0.040	0.000	0.000	0.000	0.000	0.000	0.049	my8028_rel.cz10a_bee
0.000	15.756	83.627	0.565	0.052	0.000	0.000	0.000	0.000	0.000	0.063	my8035_rel.cz10a_bee
0.000	28.775	70.663	0.523	0.038	0.000	0.000	0.000	0.000	0.000	0.046	my8035_rel_lessps.cz10a_bee
0.000	20.873	78.527	0.546	0.053	0.000	0.000	0.000	0.000	0.000	0.051	my8035_rel.cz10aps0_bee
0.000	15.007	84.361	0.576	0.056	0.000	0.000	0.000	0.000	0.000	0.048	my8036_rel.cz10a_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
94.658	5.190	0.136	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	my5621_rel.cz10a_bee
94.125	5.727	0.132	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	my5631_rel.cz10a_bee
93.917	5.934	0.134	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	my5641_rel.cz10a_bee
93.948	5.898	0.137	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5651_rel.cz10a_bee
71.193	28.639	0.154	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.037	my5710_rel.cz10a_bee
67.843	31.986	0.155	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.035	my5720_rel.cz10a_bee
65.037	34.793	0.155	0.016	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	my5730_rel.cz10a_bee
65.433	34.397	0.155	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.034	my5744_rel.cz10a_bee
56.205	43.610	0.171	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	my8013_rel.cz10a_bee
47.037	52.766	0.181	0.016	nonzero	0.000	0.000	0.000	0.000	0.000	0.035	my8014_rel.cz10a_bee
40.364	59.436	0.182	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.045	my8020_rel.cz10a_bee
28.441	71.348	0.197	0.014	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8028_rel.cz10a_bee
53.250	46.745	0.005	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.046	my8035_rel.cz10a_bee
70.826	29.168	0.005	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	my8035_rel_lessps.cz10a_bee
67.540	32.453	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	my8035_rel.cz10aps0_bee
54.508	45.486	0.005	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.083	99.778	0.139	0.000	0.000	0.000	0.000	0.083	my5621_rel.cz10a_bee
0.000	0.000	0.000	0.056	99.528	0.417	0.000	0.000	0.000	0.000	0.128	my5631_rel.cz10a_bee
0.000	0.000	0.000	0.167	99.778	0.056	0.000	0.000	0.000	0.000	0.075	my5641_rel.cz10a_bee
0.000	0.000	0.000	0.222	99.583	0.194	0.000	0.000	0.000	0.000	0.107	my5651_rel.cz10a_bee
0.000	0.000	0.000	18.833	81.083	0.083	0.000	0.000	0.000	0.000	0.086	my5710_rel.cz10a_bee
0.000	0.000	0.000	17.361	82.639	0.000	0.000	0.000	0.000	0.000	0.037	my5720_rel.cz10a_bee
0.000	0.000	0.000	19.417	80.556	0.028	0.000	0.000	0.000	0.000	0.076	my5730_rel.cz10a_bee
0.000	0.000	0.000	25.444	74.556	0.000	0.000	0.000	0.000	0.000	0.064	my5744_rel.cz10a_bee
0.000	0.000	0.000	14.083	85.917	0.000	0.000	0.000	0.000	0.000	0.045	my8013_rel.cz10a_bee
0.000	0.000	0.000	5.722	94.250	0.028	0.000	0.000	0.000	0.000	0.072	my8014_rel.cz10a_bee
0.000	0.000	0.000	7.111	92.889	0.000	0.000	0.000	0.000	0.000	0.053	my8020_rel.cz10a_bee
0.000	0.000	0.000	16.167	83.833	0.000	0.000	0.000	0.000	0.000	0.035	my8028_rel.cz10a_bee
0.000	0.000	0.000	7.806	91.722	0.472	0.000	0.000	0.000	0.000	0.114	my8035_rel.cz10a_bee
0.000	0.000	0.000	11.917	88.083	0.000	0.000	0.000	0.000	0.000	0.037	my8035_rel_lessps.cz10a_bee
0.000	0.000	0.000	10.139	89.861	0.000	0.000	0.000	0.000	0.000	0.061	my8035_rel.cz10aps0_bee
0.000	0.000	0.000	8.556	91.250	0.194	0.000	0.000	0.000	0.000	0.104	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	17.278	80.972	1.750	0.000	0.000	0.000	0.000	0.000	0.040	my5621_rel.cz10a_bee
0.000	0.000	15.889	81.722	2.389	0.000	0.000	0.000	0.000	0.000	0.045	my5631_rel.cz10a_bee
0.000	0.000	17.389	81.361	1.250	0.000	0.000	0.000	0.000	0.000	0.034	my5641_rel.cz10a_bee
0.000	0.000	17.500	80.611	1.889	0.000	0.000	0.000	0.000	0.000	0.035	my5651_rel.cz10a_bee
0.000	0.000	98.417	1.361	0.222	0.000	0.000	0.000	0.000	0.000	0.028	my5710_rel.cz10a_bee
0.000	0.000	97.611	2.389	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5720_rel.cz10a_bee
0.000	0.000	99.111	0.889	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5730_rel.cz10a_bee
0.000	0.000	98.417	1.583	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5744_rel.cz10a_bee
0.000	0.000	95.972	3.944	0.083	0.000	0.000	0.000	0.000	0.000	0.019	my8013_rel.cz10a_bee
0.000	0.000	94.000	5.917	0.083	0.000	0.000	0.000	0.000	0.000	0.046	my8014_rel.cz10a_bee
0.000	0.000	93.639	6.361	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8020_rel.cz10a_bee
0.000	0.000	99.222	0.778	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8028_rel.cz10a_bee
0.000	0.000	97.056	2.278	0.667	0.000	0.000	0.000	0.000	0.000	0.043	my8035_rel.cz10a_bee
0.000	0.000	98.222	1.778	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8035_rel_lessps.cz10a_bee
0.000	0.000	98.722	1.139	0.139	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel.cz10aps0_bee
0.000	0.000	98.639	1.222	0.139	0.000	0.000	0.000	0.000	0.000	0.039	my8036_rel.cz10a_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.874	98.899	0.226	0.001	0.000	0.000	0.000	0.000	0.000	0.037	my5621_rel.cz10a_bee
0.000	0.561	99.203	0.235	0.001	0.000	0.000	0.000	0.000	0.000	0.036	my5631_rel.cz10a_bee
0.000	0.500	99.279	0.220	0.001	0.000	0.000	0.000	0.000	0.000	0.039	my5641_rel.cz10a_bee
0.000	0.527	99.236	0.236	0.001	0.000	0.000	0.000	0.000	0.000	0.036	my5651_rel.cz10a_bee
0.000	0.387	99.280	0.332	0.001	0.000	0.000	0.000	0.000	0.000	0.039	my5710_rel.cz10a_bee
0.000	0.397	99.264	0.338	0.001	0.000	0.000	0.000	0.000	0.000	0.040	my5720_rel.cz10a_bee
0.000	0.384	99.281	0.334	0.001	0.000	0.000	0.000	0.000	0.000	0.038	my5730_rel.cz10a_bee
0.000	0.381	99.282	0.336	0.001	0.000	0.000	0.000	0.000	0.000	0.037	my5744_rel.cz10a_bee
0.000	0.186	99.487	0.326	0.001	0.000	0.000	0.000	0.000	0.000	0.037	my8013_rel.cz10a_bee
0.000	0.145	99.501	0.353	0.001	0.000	0.000	0.000	0.000	0.000	0.036	my8014_rel.cz10a_bee
0.000	0.131	99.649	0.220	0.001	0.000	0.000	0.000	0.000	0.000	0.043	my8020_rel.cz10a_bee
0.000	0.168	99.586	0.244	0.001	0.000	0.000	0.000	0.000	0.000	0.041	my8028_rel.cz10a_bee
0.000	0.106	99.645	0.248	0.001	0.000	0.000	0.000	0.000	0.000	0.045	my8035_rel.cz10a_bee
0.000	0.180	99.603	0.215	0.001	0.000	0.000	0.000	0.000	0.000	0.042	my8035_rel_lessps.cz10a_bee
0.000	0.186	99.577	0.236	0.001	0.000	0.000	0.000	0.000	0.000	0.044	my8035_rel.cz10aps0_bee
0.000	0.098	99.533	0.368	0.002	0.000	0.000	0.000	0.000	0.000	0.042	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.278	99.389	0.333	0.000	0.000	0.000	0.000	0.115	my5621_rel.cz10a_bee
0.000	0.000	0.000	0.111	99.639	0.250	0.000	0.000	0.000	0.000	0.082	my5631_rel.cz10a_bee
0.000	0.000	0.000	0.167	99.500	0.333	0.000	0.000	0.000	0.000	0.098	my5641_rel.cz10a_bee
0.000	0.000	0.000	0.083	99.611	0.306	0.000	0.000	0.000	0.000	0.094	my5651_rel.cz10a_bee
0.000	0.000	0.000	19.278	80.722	0.000	0.000	0.000	0.000	0.000	0.060	my5710_rel.cz10a_bee
0.000	0.000	0.000	16.222	83.778	0.000	0.000	0.000	0.000	0.000	0.038	my5720_rel.cz10a_bee
0.000	0.000	0.000	18.000	82.000	0.000	0.000	0.000	0.000	0.000	0.039	my5730_rel.cz10a_bee
0.000	0.000	0.000	30.056	69.944	0.000	0.000	0.000	0.000	0.000	0.052	my5744_rel.cz10a_bee
0.000	0.000	0.000	13.056	86.917	0.028	0.000	0.000	0.000	0.000	0.065	my8013_rel.cz10a_bee
0.000	0.000	0.000	4.056	95.917	0.028	0.000	0.000	0.000	0.000	0.111	my8014_rel.cz10a_bee
0.000	0.000	0.000	4.556	95.444	0.000	0.000	0.000	0.000	0.000	0.057	my8020_rel.cz10a_bee
0.000	0.000	0.000	14.972	85.028	0.000	0.000	0.000	0.000	0.000	0.041	my8028_rel.cz10a_bee
0.000	0.000	0.000	7.583	92.417	0.000	0.000	0.000	0.000	0.000	0.056	my8035_rel.cz10a_bee
0.000	0.000	0.000	9.417	90.583	0.000	0.000	0.000	0.000	0.000	0.039	my8035_rel_lessps.cz10a_bee
0.000	0.000	0.000	8.722	91.278	0.000	0.000	0.000	0.000	0.000	0.043	my8035_rel.cz10aps0_bee
0.000	0.000	0.000	3.833	96.139	0.028	0.000	0.000	0.000	0.000	0.066	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	62.472	37.028	0.472	0.028	0.000	0.000	0.000	0.000	0.070	my5621_rel.cz10a_bee
0.000	0.000	58.222	41.111	0.667	0.000	0.000	0.000	0.000	0.000	0.049	my5631_rel.cz10a_bee
0.000	0.000	66.000	33.444	0.556	0.000	0.000	0.000	0.000	0.000	0.055	my5641_rel.cz10a_bee
0.000	0.000	66.194	33.500	0.306	0.000	0.000	0.000	0.000	0.000	0.041	my5651_rel.cz10a_bee
0.000	0.000	99.333	0.667	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5710_rel.cz10a_bee
0.000	0.000	99.389	0.611	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5720_rel.cz10a_bee
0.000	0.000	99.556	0.444	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5730_rel.cz10a_bee
0.000	0.000	99.250	0.750	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my5744_rel.cz10a_bee
0.000	0.000	97.389	2.611	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8013_rel.cz10a_bee
0.000	0.000	96.250	3.722	0.028	0.000	0.000	0.000	0.000	0.000	0.023	my8014_rel.cz10a_bee
0.000	0.000	95.194	4.722	0.083	0.000	0.000	0.000	0.000	0.000	0.019	my8020_rel.cz10a_bee
0.000	0.000	98.528	1.472	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8028_rel.cz10a_bee
0.000	0.000	97.861	2.139	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8035_rel.cz10a_bee
0.000	0.000	98.694	1.306	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8035_rel_lessps.cz10a_bee
0.000	0.000	98.667	1.333	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8035_rel.cz10aps0_bee
0.000	0.000	98.472	1.500	0.028	0.000	0.000	0.000	0.000	0.000	0.022	my8036_rel.cz10a_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
89.493	10.245	0.235	0.027	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5621_rel.cz10a_bee
88.787	10.945	0.239	0.028	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	my5631_rel.cz10a_bee
88.673	11.048	0.251	0.027	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5641_rel.cz10a_bee
88.236	11.477	0.259	0.028	nonzero	0.000	0.000	0.000	0.000	0.000	0.039	my5651_rel.cz10a_bee
74.936	24.881	0.159	0.024	nonzero	0.000	0.000	0.000	0.000	0.000	0.030	my5710_rel.cz10a_bee
73.117	26.694	0.163	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.037	my5720_rel.cz10a_bee
70.072	29.737	0.167	0.024	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5730_rel.cz10a_bee
70.837	28.976	0.166	0.022	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	my5744_rel.cz10a_bee
66.892	32.906	0.180	0.023	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8013_rel.cz10a_bee
59.046	40.745	0.186	0.023	nonzero	0.000	0.000	0.000	0.000	0.000	0.037	my8014_rel.cz10a_bee
53.009	46.773	0.188	0.030	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	my8020_rel.cz10a_bee
38.424	61.336	0.211	0.029	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	my8028_rel.cz10a_bee
58.840	41.151	0.008	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8035_rel.cz10a_bee
75.891	24.102	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	my8035_rel_lessps.cz10a_bee
73.031	26.962	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	my8035_rel.cz10aps0_bee
59.465	40.526	0.008	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	6.639	93.328	0.033	0.000	0.000	0.000	0.000	0.072	my5621_rel.cz10a_bee
0.000	0.000	0.000	5.689	94.272	0.039	0.000	0.000	0.000	0.000	0.089	my5631_rel.cz10a_bee
0.000	0.000	0.000	5.383	94.567	0.050	0.000	0.000	0.000	0.000	0.074	my5641_rel.cz10a_bee
0.000	0.000	0.000	5.694	94.211	0.094	0.000	0.000	0.000	0.000	0.079	my5651_rel.cz10a_bee
0.000	0.000	0.000	77.056	22.944	0.000	0.000	0.000	0.000	0.000	0.053	my5710_rel.cz10a_bee
0.000	0.000	0.000	71.978	28.022	0.000	0.000	0.000	0.000	0.000	0.055	my5720_rel.cz10a_bee
0.000	0.000	0.000	76.700	23.300	0.000	0.000	0.000	0.000	0.000	0.040	my5730_rel.cz10a_bee
0.000	0.000	0.000	80.244	19.756	0.000	0.000	0.000	0.000	0.000	0.059	my5744_rel.cz10a_bee
0.000	0.000	0.000	65.044	34.950	0.006	0.000	0.000	0.000	0.000	0.069	my8013_rel.cz10a_bee
0.000	0.000	0.000	54.461	45.539	0.000	0.000	0.000	0.000	0.000	0.053	my8014_rel.cz10a_bee
0.000	0.000	0.000	57.989	41.983	0.028	0.000	0.000	0.000	0.000	0.080	my8020_rel.cz10a_bee
0.000	0.000	0.000	70.389	29.611	0.000	0.000	0.000	0.000	0.000	0.036	my8028_rel.cz10a_bee
0.000	0.000	0.000	58.406	41.583	0.011	0.000	0.000	0.000	0.000	0.083	my8035_rel.cz10a_bee
0.000	0.000	0.000	63.222	36.778	0.000	0.000	0.000	0.000	0.000	0.048	my8035_rel_lessps.cz10a_bee
0.000	0.000	0.000	60.489	39.511	0.000	0.000	0.000	0.000	0.000	0.039	my8035_rel.cz10aps0_bee
0.000	0.000	0.000	37.833	62.167	0.000	0.000	0.000	0.000	0.000	0.048	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	14.367	85.361	0.272	0.000	0.000	0.000	0.000	0.000	0.028	my5621_rel.cz10a_bee
0.000	0.000	13.822	85.917	0.261	0.000	0.000	0.000	0.000	0.000	0.027	my5631_rel.cz10a_bee
0.000	0.000	11.967	87.739	0.294	0.000	0.000	0.000	0.000	0.000	0.029	my5641_rel.cz10a_bee
0.000	0.000	12.522	86.994	0.483	0.000	0.000	0.000	0.000	0.000	0.035	my5651_rel.cz10a_bee
0.000	0.000	99.017	0.972	0.011	0.000	0.000	0.000	0.000	0.000	0.024	my5710_rel.cz10a_bee
0.000	0.000	98.517	1.483	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5720_rel.cz10a_bee
0.000	0.000	99.106	0.894	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5730_rel.cz10a_bee
0.000	0.000	94.733	5.261	0.006	0.000	0.000	0.000	0.000	0.000	0.019	my5744_rel.cz10a_bee
0.000	0.000	95.783	4.167	0.050	0.000	0.000	0.000	0.000	0.000	0.028	my8013_rel.cz10a_bee
0.000	0.000	93.700	6.272	0.028	0.000	0.000	0.000	0.000	0.000	0.021	my8014_rel.cz10a_bee
0.000	0.000	92.589	7.372	0.039	0.000	0.000	0.000	0.000	0.000	0.024	my8020_rel.cz10a_bee
0.000	0.000	98.917	1.083	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8028_rel.cz10a_bee
0.000	0.000	97.250	2.728	0.022	0.000	0.000	0.000	0.000	0.000	0.031	my8035_rel.cz10a_bee
0.000	0.000	97.928	2.061	0.011	0.000	0.000	0.000	0.000	0.000	0.020	my8035_rel_lessps.cz10a_bee
0.000	0.000	98.372	1.617	0.011	0.000	0.000	0.000	0.000	0.000	0.017	my8035_rel.cz10aps0_bee
0.000	0.000	97.617	2.350	0.033	0.000	0.000	0.000	0.000	0.000	0.020	my8036_rel.cz10a_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.060	97.954	1.979	0.007	0.000	0.000	0.000	0.000	0.000	0.044	my5621_rel.cz10a_bee
0.000	0.033	97.757	2.203	0.007	0.000	0.000	0.000	0.000	0.000	0.043	my5631_rel.cz10a_bee
0.000	0.033	97.752	2.207	0.008	0.000	0.000	0.000	0.000	0.000	0.047	my5641_rel.cz10a_bee
0.000	0.028	97.769	2.195	0.007	0.000	0.000	0.000	0.000	0.000	0.047	my5651_rel.cz10a_bee
0.000	0.019	97.621	2.354	0.007	0.000	0.000	0.000	0.000	0.000	0.049	my5710_rel.cz10a_bee
0.000	0.018	97.633	2.343	0.006	0.000	0.000	0.000	0.000	0.000	0.042	my5720_rel.cz10a_bee
0.000	0.019	97.617	2.357	0.007	0.000	0.000	0.000	0.000	0.000	0.044	my5730_rel.cz10a_bee
0.000	0.017	97.610	2.366	0.007	0.000	0.000	0.000	0.000	0.000	0.043	my5744_rel.cz10a_bee
0.000	0.007	97.505	2.481	0.007	0.000	0.000	0.000	0.000	0.000	0.043	my8013_rel.cz10a_bee
0.000	0.006	97.485	2.501	0.007	0.000	0.000	0.000	0.000	0.000	0.045	my8014_rel.cz10a_bee
0.000	0.004	99.099	0.761	0.136	0.000	0.000	0.000	0.000	0.000	0.057	my8020_rel.cz10a_bee
0.000	0.005	99.030	0.869	0.096	0.000	0.000	0.000	0.000	0.000	0.054	my8028_rel.cz10a_bee
0.000	0.004	98.962	0.928	0.106	0.000	0.000	0.000	0.000	0.000	0.056	my8035_rel.cz10a_bee
0.000	0.009	99.019	0.857	0.115	0.000	0.000	0.000	0.000	0.000	0.055	my8035_rel_lessps.cz10a_bee
0.000	0.006	99.005	0.872	0.117	0.000	0.000	0.000	0.000	0.000	0.054	my8035_rel.cz10aps0_bee
0.000	0.003	98.765	1.177	0.054	nonzero	0.000	0.000	0.000	0.000	0.069	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	4.894	94.283	0.822	0.000	0.000	0.000	0.000	0.142	my5621_rel.cz10a_bee
0.000	0.000	0.000	4.739	94.183	1.078	0.000	0.000	0.000	0.000	0.116	my5631_rel.cz10a_bee
0.000	0.000	0.000	4.111	94.528	1.361	0.000	0.000	0.000	0.000	0.117	my5641_rel.cz10a_bee
0.000	0.000	0.000	4.972	94.261	0.767	0.000	0.000	0.000	0.000	0.116	my5651_rel.cz10a_bee
0.000	0.000	0.000	87.667	12.289	0.044	0.000	0.000	0.000	0.000	0.089	my5710_rel.cz10a_bee
0.000	0.000	0.000	86.222	13.739	0.039	0.000	0.000	0.000	0.000	0.077	my5720_rel.cz10a_bee
0.000	0.000	0.000	87.006	12.961	0.033	0.000	0.000	0.000	0.000	0.091	my5730_rel.cz10a_bee
0.000	0.000	0.000	91.033	8.939	0.028	0.000	0.000	0.000	0.000	0.077	my5744_rel.cz10a_bee
0.000	0.000	0.000	72.878	26.844	0.278	0.000	0.000	0.000	0.000	0.092	my8013_rel.cz10a_bee
0.000	0.000	0.000	61.806	37.950	0.244	0.000	0.000	0.000	0.000	0.105	my8014_rel.cz10a_bee
0.000	0.000	0.000	65.739	33.711	0.550	0.000	0.000	0.000	0.000	0.122	my8020_rel.cz10a_bee
0.000	0.000	0.000	81.894	17.783	0.322	0.000	0.000	0.000	0.000	0.104	my8028_rel.cz10a_bee
0.000	0.000	0.000	68.183	30.878	0.939	0.000	0.000	0.000	0.000	0.114	my8035_rel.cz10a_bee
0.000	0.000	0.000	75.100	24.706	0.194	0.000	0.000	0.000	0.000	0.110	my8035_rel_lessps.cz10a_bee
0.000	0.000	0.000	71.617	27.828	0.556	0.000	0.000	0.000	0.000	0.105	my8035_rel.cz10aps0_bee
0.000	0.000	0.000	47.217	51.967	0.817	0.000	0.000	0.000	0.000	0.113	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	24.906	72.711	2.383	0.000	0.000	0.000	0.000	0.000	0.061	my5621_rel.cz10a_bee
0.000	0.000	23.906	73.400	2.694	0.000	0.000	0.000	0.000	0.000	0.050	my5631_rel.cz10a_bee
0.000	0.000	23.994	73.400	2.600	0.006	0.000	0.000	0.000	0.000	0.085	my5641_rel.cz10a_bee
0.000	0.000	23.094	74.089	2.817	0.000	0.000	0.000	0.000	0.000	0.062	my5651_rel.cz10a_bee
0.000	0.000	98.894	1.100	0.006	0.000	0.000	0.000	0.000	0.000	0.018	my5710_rel.cz10a_bee
0.000	0.000	98.789	1.200	0.011	0.000	0.000	0.000	0.000	0.000	0.019	my5720_rel.cz10a_bee
0.000	0.000	98.889	1.106	0.006	0.000	0.000	0.000	0.000	0.000	0.020	my5730_rel.cz10a_bee
0.000	0.000	95.406	4.572	0.022	0.000	0.000	0.000	0.000	0.000	0.020	my5744_rel.cz10a_bee
0.000	0.000	94.667	4.806	0.528	0.000	0.000	0.000	0.000	0.000	0.043	my8013_rel.cz10a_bee
0.000	0.000	91.900	7.506	0.594	0.000	0.000	0.000	0.000	0.000	0.057	my8014_rel.cz10a_bee
0.000	0.000	92.550	7.044	0.406	0.000	0.000	0.000	0.000	0.000	0.055	my8020_rel.cz10a_bee
0.000	0.000	98.367	1.561	0.072	0.000	0.000	0.000	0.000	0.000	0.030	my8028_rel.cz10a_bee
0.000	0.000	95.433	4.306	0.261	0.000	0.000	0.000	0.000	0.000	0.030	my8035_rel.cz10a_bee
0.000	0.000	97.778	2.094	0.128	0.000	0.000	0.000	0.000	0.000	0.045	my8035_rel_lessps.cz10a_bee
0.000	0.000	96.572	3.228	0.200	0.000	0.000	0.000	0.000	0.000	0.051	my8035_rel.cz10aps0_bee
0.000	0.000	95.006	4.817	0.178	0.000	0.000	0.000	0.000	0.000	0.045	my8036_rel.cz10a_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
83.099	16.478	0.399	0.024	nonzero	0.000	0.000	0.000	0.000	0.000	0.048	my5621_rel.cz10a_bee
81.805	17.763	0.409	0.024	nonzero	0.000	0.000	0.000	0.000	0.000	0.037	my5631_rel.cz10a_bee
81.626	17.951	0.402	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.038	my5641_rel.cz10a_bee
81.667	17.919	0.392	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.034	my5651_rel.cz10a_bee
76.898	22.919	0.168	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	my5710_rel.cz10a_bee
74.801	25.006	0.176	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.038	my5720_rel.cz10a_bee
74.973	24.842	0.171	0.014	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	my5730_rel.cz10a_bee
74.149	25.661	0.176	0.014	nonzero	0.000	0.000	0.000	0.000	0.000	0.034	my5744_rel.cz10a_bee
73.047	26.756	0.186	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.037	my8013_rel.cz10a_bee
65.400	34.389	0.194	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.035	my8014_rel.cz10a_bee
59.931	39.858	0.194	0.017	0.001	0.000	0.000	0.000	0.000	0.000	0.049	my8020_rel.cz10a_bee
40.499	59.253	0.229	0.018	0.001	0.000	0.000	0.000	0.000	0.000	0.047	my8028_rel.cz10a_bee
61.790	38.191	0.018	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8035_rel.cz10a_bee
78.802	21.185	0.011	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8035_rel_lessps.cz10a_bee
74.718	25.268	0.013	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	my8035_rel.cz10aps0_bee
61.581	38.403	0.015	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	27.506	72.186	0.308	0.000	0.000	0.000	0.000	0.119	my5621_rel.cz10a_bee
0.000	0.000	0.000	25.214	74.497	0.289	0.000	0.000	0.000	0.000	0.100	my5631_rel.cz10a_bee
0.000	0.000	0.000	24.442	75.278	0.281	0.000	0.000	0.000	0.000	0.112	my5641_rel.cz10a_bee
0.000	0.000	0.000	25.397	74.311	0.292	0.000	0.000	0.000	0.000	0.107	my5651_rel.cz10a_bee
0.000	0.000	0.000	93.978	6.014	0.008	0.000	0.000	0.000	0.000	0.070	my5710_rel.cz10a_bee
0.000	0.000	0.000	92.750	7.250	0.000	0.000	0.000	0.000	0.000	0.058	my5720_rel.cz10a_bee
0.000	0.000	0.000	92.517	7.469	0.014	0.000	0.000	0.000	0.000	0.085	my5730_rel.cz10a_bee
0.000	0.000	0.000	91.981	8.000	0.019	0.000	0.000	0.000	0.000	0.081	my5744_rel.cz10a_bee
0.000	0.000	0.000	87.311	12.600	0.089	0.000	0.000	0.000	0.000	0.092	my8013_rel.cz10a_bee
0.000	0.000	0.000	81.958	18.033	0.008	0.000	0.000	0.000	0.000	0.080	my8014_rel.cz10a_bee
0.000	0.000	0.000	86.606	13.394	0.000	0.000	0.000	0.000	0.000	0.064	my8020_rel.cz10a_bee
0.000	0.000	0.000	91.764	8.233	0.003	0.000	0.000	0.000	0.000	0.065	my8028_rel.cz10a_bee
0.000	0.000	0.000	84.750	15.131	0.119	0.000	0.000	0.000	0.000	0.113	my8035_rel.cz10a_bee
0.000	0.000	0.000	88.700	11.300	0.000	0.000	0.000	0.000	0.000	0.042	my8035_rel_lessps.cz10a_bee
0.000	0.000	0.000	88.236	11.692	0.072	0.000	0.000	0.000	0.000	0.087	my8035_rel.cz10aps0_bee
0.000	0.000	0.000	86.419	13.581	0.000	0.000	0.000	0.000	0.000	0.041	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	14.575	84.967	0.458	0.000	0.000	0.000	0.000	0.000	0.043	my5621_rel.cz10a_bee
0.000	0.000	12.911	86.633	0.456	0.000	0.000	0.000	0.000	0.000	0.054	my5631_rel.cz10a_bee
0.000	0.000	12.492	87.072	0.436	0.000	0.000	0.000	0.000	0.000	0.048	my5641_rel.cz10a_bee
0.000	0.000	12.594	86.919	0.486	0.000	0.000	0.000	0.000	0.000	0.055	my5651_rel.cz10a_bee
0.000	0.000	98.217	1.742	0.042	0.000	0.000	0.000	0.000	0.000	0.036	my5710_rel.cz10a_bee
0.000	0.000	97.861	2.136	0.003	0.000	0.000	0.000	0.000	0.000	0.021	my5720_rel.cz10a_bee
0.000	0.000	97.431	2.539	0.031	0.000	0.000	0.000	0.000	0.000	0.049	my5730_rel.cz10a_bee
0.000	0.000	95.925	4.056	0.019	0.000	0.000	0.000	0.000	0.000	0.046	my5744_rel.cz10a_bee
0.000	0.000	96.433	3.206	0.361	0.000	0.000	0.000	0.000	0.000	0.057	my8013_rel.cz10a_bee
0.000	0.000	93.131	6.772	0.097	0.000	0.000	0.000	0.000	0.000	0.060	my8014_rel.cz10a_bee
0.000	0.000	94.181	5.775	0.044	0.000	0.000	0.000	0.000	0.000	0.050	my8020_rel.cz10a_bee
0.000	0.000	98.406	1.586	0.008	0.000	0.000	0.000	0.000	0.000	0.049	my8028_rel.cz10a_bee
0.000	0.000	95.100	4.883	0.017	0.000	0.000	0.000	0.000	0.000	0.019	my8035_rel.cz10a_bee
0.000	0.000	97.756	2.225	0.019	0.000	0.000	0.000	0.000	0.000	0.043	my8035_rel_lessps.cz10a_bee
0.000	0.000	96.817	3.167	0.017	0.000	0.000	0.000	0.000	0.000	0.021	my8035_rel.cz10aps0_bee
0.000	0.000	96.569	3.400	0.031	0.000	0.000	0.000	0.000	0.000	0.043	my8036_rel.cz10a_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.009	94.884	5.093	0.014	0.000	0.000	0.000	0.000	0.000	0.043	my5621_rel.cz10a_bee
0.000	0.006	94.797	5.183	0.014	0.000	0.000	0.000	0.000	0.000	0.045	my5631_rel.cz10a_bee
0.000	0.004	94.833	5.149	0.014	0.000	0.000	0.000	0.000	0.000	0.047	my5641_rel.cz10a_bee
0.000	0.005	94.856	5.125	0.013	0.000	0.000	0.000	0.000	0.000	0.047	my5651_rel.cz10a_bee
0.000	0.003	95.058	4.924	0.014	0.000	0.000	0.000	0.000	0.000	0.047	my5710_rel.cz10a_bee
0.000	0.004	95.020	4.962	0.013	0.000	0.000	0.000	0.000	0.000	0.043	my5720_rel.cz10a_bee
0.000	0.004	94.990	4.992	0.014	0.000	0.000	0.000	0.000	0.000	0.045	my5730_rel.cz10a_bee
0.000	0.005	94.973	5.009	0.013	0.000	0.000	0.000	0.000	0.000	0.046	my5744_rel.cz10a_bee
0.000	0.001	94.888	5.097	0.014	0.000	0.000	0.000	0.000	0.000	0.057	my8013_rel.cz10a_bee
0.000	0.001	94.414	5.571	0.015	0.000	0.000	0.000	0.000	0.000	0.042	my8014_rel.cz10a_bee
0.000	0.001	98.095	1.664	0.241	0.000	0.000	0.000	0.000	0.000	0.061	my8020_rel.cz10a_bee
0.000	0.001	98.026	1.781	0.192	0.000	0.000	0.000	0.000	0.000	0.055	my8028_rel.cz10a_bee
0.000	nonzero	97.901	1.893	0.205	0.000	0.000	0.000	0.000	0.000	0.059	my8035_rel.cz10a_bee
0.000	0.001	97.971	1.827	0.201	0.000	0.000	0.000	0.000	0.000	0.062	my8035_rel_lessps.cz10a_bee
0.000	0.001	97.943	1.853	0.203	nonzero	0.000	0.000	0.000	0.000	0.091	my8035_rel.cz10aps0_bee
0.000	nonzero	97.884	1.910	0.206	0.000	0.000	0.000	0.000	0.000	0.056	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	18.006	79.586	2.408	0.000	0.000	0.000	0.000	0.112	my5621_rel.cz10a_bee
0.000	0.000	0.000	15.758	81.528	2.714	0.000	0.000	0.000	0.000	0.118	my5631_rel.cz10a_bee
0.000	0.000	0.000	15.092	82.439	2.469	0.000	0.000	0.000	0.000	0.116	my5641_rel.cz10a_bee
0.000	0.000	0.000	17.192	81.167	1.642	0.000	0.000	0.000	0.000	0.113	my5651_rel.cz10a_bee
0.000	0.000	0.000	75.117	24.714	0.169	0.000	0.000	0.000	0.000	0.100	my5710_rel.cz10a_bee
0.000	0.000	0.000	76.436	23.394	0.169	0.000	0.000	0.000	0.000	0.094	my5720_rel.cz10a_bee
0.000	0.000	0.000	77.008	22.819	0.172	0.000	0.000	0.000	0.000	0.085	my5730_rel.cz10a_bee
0.000	0.000	0.000	71.981	27.814	0.206	0.000	0.000	0.000	0.000	0.089	my5744_rel.cz10a_bee
0.000	0.000	0.000	78.789	21.058	0.153	0.000	0.000	0.000	0.000	0.096	my8013_rel.cz10a_bee
0.000	0.000	0.000	67.275	32.486	0.239	0.000	0.000	0.000	0.000	0.106	my8014_rel.cz10a_bee
0.000	0.000	0.000	79.247	19.594	1.158	0.000	0.000	0.000	0.000	0.122	my8020_rel.cz10a_bee
0.000	0.000	0.000	87.803	11.067	1.131	0.000	0.000	0.000	0.000	0.119	my8028_rel.cz10a_bee
0.000	0.000	0.000	82.431	16.778	0.792	0.000	0.000	0.000	0.000	0.126	my8035_rel.cz10a_bee
0.000	0.000	0.000	85.447	14.119	0.433	0.000	0.000	0.000	0.000	0.117	my8035_rel_lessps.cz10a_bee
0.000	0.000	0.000	83.597	15.481	0.922	0.000	0.000	0.000	0.000	0.129	my8035_rel.cz10aps0_bee
0.000	0.000	0.000	80.508	18.756	0.736	0.000	0.000	0.000	0.000	0.114	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	19.608	78.978	1.414	0.000	0.000	0.000	0.000	0.000	0.062	my5621_rel.cz10a_bee
0.000	0.000	19.344	79.225	1.431	0.000	0.000	0.000	0.000	0.000	0.061	my5631_rel.cz10a_bee
0.000	0.000	19.092	79.425	1.483	0.000	0.000	0.000	0.000	0.000	0.051	my5641_rel.cz10a_bee
0.000	0.000	17.981	80.608	1.411	0.000	0.000	0.000	0.000	0.000	0.058	my5651_rel.cz10a_bee
0.000	0.000	97.519	2.447	0.031	0.003	0.000	0.000	0.000	0.000	0.087	my5710_rel.cz10a_bee
0.000	0.000	97.572	2.406	0.022	0.000	0.000	0.000	0.000	0.000	0.025	my5720_rel.cz10a_bee
0.000	0.000	97.728	2.242	0.031	0.000	0.000	0.000	0.000	0.000	0.057	my5730_rel.cz10a_bee
0.000	0.000	96.692	3.286	0.022	0.000	0.000	0.000	0.000	0.000	0.060	my5744_rel.cz10a_bee
0.000	0.000	97.172	2.653	0.172	0.003	0.000	0.000	0.000	0.000	0.078	my8013_rel.cz10a_bee
0.000	0.000	95.506	4.222	0.269	0.003	0.000	0.000	0.000	0.000	0.074	my8014_rel.cz10a_bee
0.000	0.000	95.119	4.372	0.506	0.003	0.000	0.000	0.000	0.000	0.070	my8020_rel.cz10a_bee
0.000	0.000	97.728	2.211	0.061	0.000	0.000	0.000	0.000	0.000	0.047	my8028_rel.cz10a_bee
0.000	0.000	95.450	4.378	0.172	0.000	0.000	0.000	0.000	0.000	0.046	my8035_rel.cz10a_bee
0.000	0.000	96.519	3.289	0.192	0.000	0.000	0.000	0.000	0.000	0.059	my8035_rel_lessps.cz10a_bee
0.000	0.000	96.042	3.789	0.169	0.000	0.000	0.000	0.000	0.000	0.058	my8035_rel.cz10aps0_bee
0.000	0.000	94.114	5.625	0.261	0.000	0.000	0.000	0.000	0.000	0.053	my8036_rel.cz10a_bee

Introduction

Contents

Summary

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6