Introduction

This is a report for the insert benchmark with 32M docs and 4 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 16G RAM and an NVMe SSD. It is described here as the Beelink. The benchmark was run with 1 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 4 tables with a table per client. It loads 8M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40m+10m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:

ma100244_rel.cz11a_bee - MariaDB 10.2.44 with the cz11a_bee config that uses innodb_flush_method=O_DIRECT_NO_FSYNC
ma100339_rel.cz11a_bee - MariaDB 10.3.39 with the cz11a_bee config
ma100433_rel.cz11a_bee - MariaDB 10.4.33 with the cz11a_bee config
ma100524_rel.cz11a_bee - MariaDB 10.5.24 with the cz11a_bee config
ma100617_rel.cz11a_bee - MariaDB 10.6.17 with the cz11a_bee config
ma101107_rel.cz11a_bee - MariaDB 10.11.7 with the cz11a_bee config
ma101107_rel.cz11b_bee - MariaDB 10.11.7 with the cz11b_bee config that uses innodb_flush_method=O_DIRECT
ma101107_rel.cz11c_bee - MariaDB 10.11.7 with the cz11c_bee config that uses innodb_flush_method=fsync
ma101107_rel.cz11d_bee - MariaDB 10.11.7 with the cz11d_bee config that uses innodb_change_buffering=all
ma110401_rel.cz11b_bee - MariaDB 11.4.1 with the cz11b_bee config that uses innodb_flush_method=O_DIRECT
ma110401_rel.cz11c_bee - MariaDB 11.4.1 with the cz11c_bee config that uses innodb_flush_method=fsync
my5651_rel.cz11a_bee - MySQL 5.6.51 with the cz11a_bee config
my5744_rel.cz11a_bee - MySQL 5.7.44 with the cz11a_bee config
my8036_rel.cz11a_bee - MySQL 8.0.36 with the cz11a_bee config
my8036_rel.cz11b_bee - MySQL 8.0.36 with the cz11b_bee config that uses innodb_flush_method=O_DIRECT
my8036_rel.cz11c_bee - MySQL 8.0.36 with the cz11c_bee config that uses innodb_flush_method=fsync
my8036_rel.cz11d_bee - MySQL 8.0.36 with the cz11d_bee config that uses innodb_change_buffering=none
pg162_def.cx9a2_bee - Postgres 16.2 with the cx9a2_bee config

Summary
l.i0: load without secondary indexes
l.x: create secondary indexes
l.i1: continue load after secondary indexes created with 50 inserts per transaction
l.i2: continue load after secondary indexes created with 5 inserts per transaction
qr100.L1: range queries with 100 insert/s per client
qp100.L2: point queries with 100 insert/s per client
qr500.L3: range queries with 500 insert/s per client
qp500.L4: point queries with 500 insert/s per client
qr1000.L5: range queries with 1000 insert/s per client
qp1000.L6: point queries with 1000 insert/s per client

Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
ma100244_rel.cz11a_bee	285714	603775	43278	19990	18411	20957	17799	19513	17320	18897
ma100339_rel.cz11a_bee	219178	561405	48106	20090	17720	19830	17258	18796	16575	18093
ma100433_rel.cz11a_bee	219178	592594	47591	19920	16424	18731	16258	18135	15744	17476
ma100524_rel.cz11a_bee	230216	516131	51184	22522	15786	18452	15725	18167	15412	17035
ma100617_rel.cz11a_bee	248062	470590	51249	24891	16040	19524	16238	19138	15971	18966
ma101107_rel.cz11a_bee	251968	421054	48558	22222	16259	19804	16269	19191	15856	18791
ma101107_rel.cz11b_bee	197531	463770	40879	21918	16028	18924	16138	19189	15676	18808
ma101107_rel.cz11c_bee	172973	470590	38750	19465	15989	19178	16099	19213	15638	18826
ma101107_rel.cz11d_bee	251968	463770	48324	22112	16092	19075	16294	19208	15793	18780
ma110401_rel.cz11b_bee	250000	421054	42941	21751	16142	19489	16469	19158	15856	18863
ma110401_rel.cz11c_bee	206452	415586	38647	19812	15965	18185	16356	19168	15816	18778
my5651_rel.cz11a_bee	313725	278262	32720	16577	25385	23759	25032	22473	24346	22694
my5744_rel.cz11a_bee	262295	561405	43396	19455	20161	19410	20016	19275	19462	18429
my8036_rel.cz11a_bee	189349	421054	25429	12001	17519	15251	17092	15105	16872	14562
my8036_rel.cz11b_bee	182857	58608	20377	11419	17494	15441	17524	14684	17422	13780
my8036_rel.cz11c_bee	184971	34115	14981	11096	18224	15200	17884	14462	17538	13360
my8036_rel.cz11d_bee	189349	400001	25584	12023	17496	15584	17152	15134	16875	14476
pg162_def.cx9a2_bee	251968	761907	69055	11047	47802	18923	44971	18423	42631	18015

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
ma100244_rel.cz11a_bee	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00
ma100339_rel.cz11a_bee	0.77	0.93	1.11	1.01	0.96	0.95	0.97	0.96	0.96	0.96
ma100433_rel.cz11a_bee	0.77	0.98	1.10	1.00	0.89	0.89	0.91	0.93	0.91	0.92
ma100524_rel.cz11a_bee	0.81	0.85	1.18	1.13	0.86	0.88	0.88	0.93	0.89	0.90
ma100617_rel.cz11a_bee	0.87	0.78	1.18	1.25	0.87	0.93	0.91	0.98	0.92	1.00
ma101107_rel.cz11a_bee	0.88	0.70	1.12	1.11	0.88	0.94	0.91	0.98	0.92	0.99
ma101107_rel.cz11b_bee	0.69	0.77	0.94	1.10	0.87	0.90	0.91	0.98	0.91	1.00
ma101107_rel.cz11c_bee	0.61	0.78	0.90	0.97	0.87	0.92	0.90	0.98	0.90	1.00
ma101107_rel.cz11d_bee	0.88	0.77	1.12	1.11	0.87	0.91	0.92	0.98	0.91	0.99
ma110401_rel.cz11b_bee	0.88	0.70	0.99	1.09	0.88	0.93	0.93	0.98	0.92	1.00
ma110401_rel.cz11c_bee	0.72	0.69	0.89	0.99	0.87	0.87	0.92	0.98	0.91	0.99
my5651_rel.cz11a_bee	1.10	0.46	0.76	0.83	1.38	1.13	1.41	1.15	1.41	1.20
my5744_rel.cz11a_bee	0.92	0.93	1.00	0.97	1.10	0.93	1.12	0.99	1.12	0.98
my8036_rel.cz11a_bee	0.66	0.70	0.59	0.60	0.95	0.73	0.96	0.77	0.97	0.77
my8036_rel.cz11b_bee	0.64	0.10	0.47	0.57	0.95	0.74	0.98	0.75	1.01	0.73
my8036_rel.cz11c_bee	0.65	0.06	0.35	0.56	0.99	0.73	1.00	0.74	1.01	0.71
my8036_rel.cz11d_bee	0.66	0.66	0.59	0.60	0.95	0.74	0.96	0.78	0.97	0.77
pg162_def.cx9a2_bee	0.88	1.26	1.60	0.55	2.60	0.90	2.53	0.94	2.46	0.95

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbms	qr100.L1	qp100.L2	qr500.L3	qp500.L4	qr1000.L5	qp1000.L6
ma100244_rel.cz11a_bee	399	399	1994	1994	3989	3989
ma100339_rel.cz11a_bee	399	399	1994	1994	3987	3987
ma100433_rel.cz11a_bee	399	399	1994	1994	3989	3989
ma100524_rel.cz11a_bee	399	399	1993	1994	3989	3989
ma100617_rel.cz11a_bee	399	399	1994	1994	3989	3989
ma101107_rel.cz11a_bee	399	399	1993	1994	3989	3989
ma101107_rel.cz11b_bee	399	399	1994	1993	3989	3989
ma101107_rel.cz11c_bee	399	399	1993	1994	3989	3989
ma101107_rel.cz11d_bee	399	399	1994	1994	3989	3989
ma110401_rel.cz11b_bee	399	399	1993	1994	3989	3989
ma110401_rel.cz11c_bee	399	399	1994	1994	3989	3989
my5651_rel.cz11a_bee	399	399	1993	1994	3989	3987
my5744_rel.cz11a_bee	399	399	1994	1994	3989	3989
my8036_rel.cz11a_bee	399	399	1993	1993	3989	3989
my8036_rel.cz11b_bee	399	399	1994	1994	3987	3989
my8036_rel.cz11c_bee	399	399	1994	1994	3989	3989
my8036_rel.cz11d_bee	399	399	1994	1994	3989	3989
pg162_def.cx9a2_bee	399	399	1994	1993	3989	3989
target	400	400	2000	2000	4000	4000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	256ms	1s	16s	gt	max
ma100244_rel.cz11a_bee	12.431	86.986	0.549	0.017	0.016				0.150
ma100339_rel.cz11a_bee	1.176	97.269	1.509	0.029	0.016				0.154
ma100433_rel.cz11a_bee	0.385	98.043	1.526	0.030	0.016				0.147
ma100524_rel.cz11a_bee	0.961	97.745	1.038	0.236	0.020				0.146
ma100617_rel.cz11a_bee	0.795	96.750	2.400	0.034	0.020				0.217
ma101107_rel.cz11a_bee	3.082	94.691	2.171	0.037	0.019				0.196
ma101107_rel.cz11b_bee	2.473	95.289	2.143	0.075	0.017		0.001	0.001	19.505
ma101107_rel.cz11c_bee	2.562	95.150	2.202	0.065	0.017	0.001	0.001	0.001	56.292
ma101107_rel.cz11d_bee	2.832	94.928	2.173	0.048	0.019				0.191
ma110401_rel.cz11b_bee	2.108	95.707	2.125	0.040	0.019				0.200
ma110401_rel.cz11c_bee	1.565	96.262	2.029	0.121	0.018	0.001	0.004		11.218
my5651_rel.cz11a_bee	60.494	39.257	0.135	0.107	0.006				0.169
my5744_rel.cz11a_bee	0.289	99.199	0.391	0.115	0.006				0.173
my8036_rel.cz11a_bee		99.246	0.613	0.130	0.012				0.151
my8036_rel.cz11b_bee		98.876	0.985	0.105	0.034				0.165
my8036_rel.cz11c_bee		98.977	0.861	0.146	0.017				0.175
my8036_rel.cz11d_bee		99.229	0.645	0.115	0.011				0.157
pg162_def.cx9a2_bee		99.907	0.093	nonzero					0.018

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
285714	0	1	0.0	1029.7	92.3	0.000	0.000	0.004	0.331	29836	70.8	0.104	20	2.1	18.0	2.2	0.150	80940	58636	ma100244_rel.cz11a_bee
219178	0	0	0.0	876.5	77.9	0.000	0.000	0.004	0.364	33696	78.0	0.154	28	2.1	18.0	2.7	0.154	60624	44251	ma100339_rel.cz11a_bee
219178	0	0	0.0	904.1	78.4	0.000	0.000	0.004	0.366	33638	78.5	0.153	29	2.1	18.0	NA	0.147	60709	46349	ma100433_rel.cz11a_bee
230216	0	0	0.0	1458.8	72.3	0.000	0.000	0.006	0.322	54636	72.4	0.237	25	2.1	18.0	2.3	0.146	63930	47648	ma100524_rel.cz11a_bee
248062	0	0	0.0	756.3	62.4	0.000	0.000	0.003	0.258	40632	73.6	0.164	24	2.1	18.0	2.3	0.217	69125	52843	ma100617_rel.cz11a_bee
251968	0	0	0.0	825.8	65.9	0.000	0.000	0.003	0.268	30027	73.1	0.119	23	2.1	18.0	2.3	0.196	70388	54159	ma101107_rel.cz11a_bee
197531	0	0	0.0	676.1	51.6	0.000	0.000	0.003	0.267	24320	58.4	0.123	24	2.1	18.0	2.3	19.505	68226	0	ma101107_rel.cz11b_bee
172973	0	0	0.0	200.7	45.5	0.000	0.000	0.001	0.269	21849	51.6	0.126	24	2.1	18.0	2.4	56.292	66428	0	ma101107_rel.cz11c_bee
251968	0	0	0.0	825.0	65.8	0.000	0.000	0.003	0.267	30437	73.1	0.121	23	2.1	18.0	2.3	0.191	69924	54141	ma101107_rel.cz11d_bee
250000	0	0	0.0	831.5	65.9	0.000	0.000	0.003	0.270	30993	73.2	0.124	23	2.1	18.0	2.3	0.200	69724	50046	ma110401_rel.cz11b_bee
206452	0	0	0.0	178.6	54.1	0.000	0.000	0.001	0.268	25945	61.2	0.126	24	2.1	18.0	2.4	11.218	68326	0	ma110401_rel.cz11c_bee
313725	0	99	0.4	820.5	91.1	0.000	0.001	0.003	0.297	31203	75.3	0.099	19	2.1	17.6	2.6	0.169	92030	75217	my5651_rel.cz11a_bee
262295	0	0	0.0	720.9	76.3	0.000	0.000	0.003	0.298	27796	69.7	0.106	21	2.1	17.7	3.0	0.173	74919	51843	my5744_rel.cz11a_bee
189349	0	0	0.0	783.5	62.1	0.000	0.000	0.004	0.336	22535	70.7	0.119	30	2.1	17.7	3.0	0.151	51344	41255	my8036_rel.cz11a_bee
182857	0	0	0.0	913.5	59.1	0.000	0.000	0.005	0.331	21225	69.8	0.116	31	2.1	17.7	3.0	0.165	50447	36061	my8036_rel.cz11b_bee
184971	0	0	0.0	586.7	56.1	0.000	0.000	0.003	0.311	20793	69.9	0.112	30	2.1	17.7	3.0	0.175	50745	34563	my8036_rel.cz11c_bee
189349	0	0	0.0	785.0	62.2	0.000	0.000	0.004	0.336	22374	71.0	0.118	30	2.1	17.7	3.0	0.157	51644	43652	my8036_rel.cz11d_bee
251968	0	0	0.0	294.6	106.3	0.000	0.000	0.001	0.432	24940	73.7	0.099	23	3.1	8.3	1.3	0.018	71523	58736	pg162_def.cx9a2_bee

l.x

l.x: create secondary indexes.

Average throughput:

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
603775	0	0	0.0	2291.6	453.7	0.000	0.000	0.004	0.769	19800	45.7	0.033	6	4.9	20.7	3.0	0.002	NA	NA	ma100244_rel.cz11a_bee
561405	0	0	0.0	2215.1	420.6	0.000	0.000	0.004	0.767	19957	46.6	0.036	7	4.9	20.7	2.9	0.002	NA	NA	ma100339_rel.cz11a_bee
592594	0	0	0.0	2288.0	446.9	0.000	0.000	0.004	0.772	18213	45.6	0.031	6	4.8	20.6	NA	0.002	NA	NA	ma100433_rel.cz11a_bee
516131	0	0	0.0	773.5	350.9	0.000	0.000	0.001	0.696	1920	44.8	0.004	7	4.8	20.6	5.0	0.002	NA	NA	ma100524_rel.cz11a_bee
470590	0	0	0.0	2583.4	351.8	0.000	0.000	0.005	0.766	8846	43.9	0.019	7	4.8	20.6	4.6	0.002	NA	NA	ma100617_rel.cz11a_bee
421054	0	0	0.0	2409.0	307.4	0.000	0.000	0.006	0.748	8497	41.3	0.020	8	4.8	20.6	4.4	0.002	NA	NA	ma101107_rel.cz11a_bee
463770	0	0	0.0	2475.2	329.4	0.000	0.000	0.005	0.727	8168	44.6	0.018	8	4.8	20.6	4.6	0.002	NA	NA	ma101107_rel.cz11b_bee
470590	0	0	0.0	832.6	347.9	0.000	0.000	0.002	0.757	8430	44.5	0.018	8	4.8	20.6	4.5	0.002	NA	NA	ma101107_rel.cz11c_bee
463770	0	0	0.0	2466.4	347.0	0.000	0.000	0.005	0.766	8053	44.1	0.017	8	4.8	20.6	4.6	0.002	NA	NA	ma101107_rel.cz11d_bee
421054	0	0	0.0	2302.8	305.9	0.000	0.000	0.005	0.744	7891	41.8	0.019	8	4.8	20.6	4.3	0.002	NA	NA	ma110401_rel.cz11b_bee
415586	0	0	0.0	726.8	304.7	0.000	0.000	0.002	0.751	7872	41.6	0.019	8	4.8	20.6	4.3	0.002	NA	NA	ma110401_rel.cz11c_bee
278262	0	0	0.0	2438.3	260.0	0.000	0.000	0.009	0.957	6583	39.1	0.024	11	4.5	20.0	4.5	0.002	NA	NA	my5651_rel.cz11a_bee
561405	0	0	0.0	6160.0	483.3	0.000	0.000	0.011	0.882	31387	45.2	0.056	6	4.9	20.4	3.2	0.002	NA	NA	my5744_rel.cz11a_bee
421054	0	2186	136.2	8559.0	427.2	0.005	0.331	0.020	1.039	25790	89.3	0.061	17	4.9	20.4	3.9	0.004	NA	NA	my8036_rel.cz11a_bee
58608	0	301	18.8	1604.5	61.8	0.005	0.328	0.027	1.080	13149	20.6	0.224	28	4.9	20.4	5.7	0.009	NA	NA	my8036_rel.cz11b_bee
34115	0	175	10.9	1091.6	36.7	0.005	0.328	0.032	1.103	12002	15.2	0.352	36	4.9	20.4	5.7	0.006	NA	NA	my8036_rel.cz11c_bee
400001	0	2055	127.9	8285.8	405.1	0.005	0.327	0.021	1.037	24713	89.4	0.062	18	4.9	20.4	3.4	0.007	NA	NA	my8036_rel.cz11d_bee
761907	0	0	0.0	563.4	249.9	0.000	0.000	0.001	0.336	2666	38.6	0.003	4	6.2	14.2	3.1	0.004	NA	NA	pg162_def.cx9a2_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max
ma100244_rel.cz11a_bee	62.852	35.788	1.359	0.001					0.128
ma100339_rel.cz11a_bee	71.086	28.018	0.890	0.006					0.170
ma100433_rel.cz11a_bee	70.290	28.778	0.927	0.005					0.168
ma100524_rel.cz11a_bee	72.617	27.129	0.196	0.015	0.043	nonzero			1.234
ma100617_rel.cz11a_bee	65.785	34.034	0.168	0.013	nonzero				0.342
ma101107_rel.cz11a_bee	63.882	35.728	0.380	0.010	nonzero				0.294
ma101107_rel.cz11b_bee	62.906	33.202	3.859	0.032	0.001				0.515
ma101107_rel.cz11c_bee	80.939	15.100	3.350	0.537	0.074	nonzero			1.143
ma101107_rel.cz11d_bee	63.224	36.385	0.381	0.009	nonzero				0.345
ma110401_rel.cz11b_bee	65.331	31.546	3.101	0.022	nonzero				0.441
ma110401_rel.cz11c_bee	82.573	13.304	3.484	0.565	0.073	nonzero			1.195
my5651_rel.cz11a_bee	39.432	57.402	3.158	0.009					0.131
my5744_rel.cz11a_bee	59.486	39.700	0.807	0.008					0.155
my8036_rel.cz11a_bee	55.537	40.393	0.927	3.142					0.255
my8036_rel.cz11b_bee	57.684	37.090	1.973	3.094	0.095	0.061	0.001	0.001	30.175
my8036_rel.cz11c_bee	61.403	32.586	2.305	2.984	0.594	0.128		0.001	52.888
my8036_rel.cz11d_bee	55.878	40.169	0.821	3.132					0.227
pg162_def.cx9a2_bee	95.633	4.353	0.015						0.051

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max
ma100244_rel.cz11a_bee		64.067	34.791	1.141	0.001					0.130
ma100339_rel.cz11a_bee		72.320	26.911	0.763	0.006					0.165
ma100433_rel.cz11a_bee		71.681	27.516	0.798	0.005					0.170
ma100524_rel.cz11a_bee		75.498	24.289	0.156	0.014	0.043				0.993
ma100617_rel.cz11a_bee		85.049	14.845	0.096	0.010	nonzero				0.341
ma101107_rel.cz11a_bee		77.259	22.493	0.240	0.008	nonzero				0.293
ma101107_rel.cz11b_bee		76.929	19.992	3.054	0.024	nonzero				0.352
ma101107_rel.cz11c_bee	nonzero	86.025	10.400	3.020	0.480	0.074				0.911
ma101107_rel.cz11d_bee		77.090	22.669	0.233	0.008	nonzero				0.339
ma110401_rel.cz11b_bee		75.804	21.729	2.449	0.017	nonzero				0.324
ma110401_rel.cz11c_bee	nonzero	86.591	9.631	3.196	0.510	0.072				0.910
my5651_rel.cz11a_bee		55.950	41.811	2.232	0.007					0.141
my5744_rel.cz11a_bee		63.085	36.320	0.588	0.007					0.155
my8036_rel.cz11a_bee		63.931	32.348	0.726	2.995					0.216
my8036_rel.cz11b_bee		67.395	28.024	1.552	2.885	0.086	0.056	0.001	0.001	30.167
my8036_rel.cz11c_bee		70.947	23.831	1.825	2.740	0.542	0.114	nonzero	0.001	52.887
my8036_rel.cz11d_bee		64.394	31.988	0.642	2.976					0.214
pg162_def.cx9a2_bee	4.255	87.872	7.861	0.012						0.043

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
43278	0	0	0.0	5145.7	193.4	0.000	0.000	0.119	4.575	28072	85.4	0.649	158	7.8	23.9	8.9	0.128	10788	8038	ma100244_rel.cz11a_bee
48106	0	0	0.0	5105.7	190.4	0.000	0.000	0.106	4.054	29752	84.6	0.618	141	8.2	24.7	9.4	0.170	12086	8740	ma100339_rel.cz11a_bee
47591	0	0	0.0	5223.2	193.1	0.000	0.000	0.110	4.156	29832	84.5	0.627	142	8.2	24.7	NA	0.168	11937	8787	ma100433_rel.cz11a_bee
51184	0	0	0.0	9666.9	309.3	0.000	0.000	0.189	6.187	72506	84.6	1.417	132	8.2	25.6	9.4	1.234	13235	200	ma100524_rel.cz11a_bee
51249	0	0	0.0	6264.5	226.6	0.000	0.000	0.122	4.527	96959	80.6	1.892	126	6.7	22.7	6.8	0.342	12983	7841	ma100617_rel.cz11a_bee
48558	0	2074	8.1	5851.2	215.6	0.043	0.171	0.120	4.546	75160	75.3	1.548	124	6.7	22.5	6.6	0.294	12241	8239	ma101107_rel.cz11a_bee
40879	0	1767	6.9	5256.3	184.9	0.043	0.173	0.129	4.632	69802	66.4	1.708	130	6.7	22.9	6.6	0.515	10139	5394	ma101107_rel.cz11b_bee
38750	0	1430	5.6	3585.7	126.2	0.037	0.148	0.093	3.336	40856	59.5	1.054	123	8.5	25.8	10.2	1.143	10639	150	ma101107_rel.cz11c_bee
48324	0	2075	8.1	5865.6	215.7	0.043	0.172	0.121	4.570	75476	75.5	1.562	125	6.6	22.4	6.6	0.345	12191	7991	ma101107_rel.cz11d_bee
42941	0	1836	7.2	5427.5	192.4	0.043	0.171	0.126	4.589	70644	67.5	1.645	126	6.6	22.5	6.5	0.441	10788	6443	ma110401_rel.cz11b_bee
38647	0	1458	5.7	3473.1	123.6	0.038	0.151	0.090	3.274	39703	58.4	1.027	121	8.6	25.8	10.1	1.195	10039	200	ma110401_rel.cz11c_bee
32720	0	876	3.4	2814.6	120.1	0.027	0.107	0.086	3.758	29971	68.3	0.916	167	7.2	22.7	8.1	0.131	8191	6643	my5651_rel.cz11a_bee
43396	0	0	0.0	3674.4	155.7	0.000	0.000	0.085	3.674	24605	83.9	0.567	155	7.6	23.1	8.8	0.155	10888	9090	my5744_rel.cz11a_bee
25429	0	25	0.4	3283.1	120.2	0.001	0.015	0.129	4.840	21116	54.5	0.830	171	6.4	22.0	7.5	0.255	6341	3645	my8036_rel.cz11a_bee
20377	0	20	0.3	1119.5	50.7	0.001	0.015	0.055	2.546	16852	45.9	0.827	180	6.4	22.0	7.6	30.175	5596	0	my8036_rel.cz11b_bee
14981	0	3	0.1	880.9	36.8	0.000	0.009	0.059	2.517	17657	37.1	1.179	198	6.4	22.0	6.8	52.888	3496	0	my8036_rel.cz11c_bee
25584	0	25	0.4	3301.0	121.0	0.001	0.015	0.129	4.842	21217	54.5	0.829	170	6.4	22.0	7.6	0.227	6343	3499	my8036_rel.cz11d_bee
69055	0	63	0.3	301.5	76.3	0.001	0.004	0.004	1.131	23358	86.7	0.338	100	9.1	49.1	2.9	0.051	16632	8391	pg162_def.cx9a2_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max
ma100244_rel.cz11a_bee	0.003	78.024	20.126	1.835	0.011	0.001					0.090
ma100339_rel.cz11a_bee	0.003	79.533	18.417	2.012	0.034	0.001					0.078
ma100433_rel.cz11a_bee	0.001	79.009	18.998	1.950	0.040	0.001					0.080
ma100524_rel.cz11a_bee	0.012	82.944	16.327	0.650	0.065	nonzero					0.072
ma100617_rel.cz11a_bee	0.014	87.824	11.224	0.933	0.004	nonzero					0.066
ma101107_rel.cz11a_bee	0.011	82.903	15.979	1.102	0.004	0.001					0.145
ma101107_rel.cz11b_bee	0.072	83.677	14.958	1.227	0.065	0.001					0.237
ma101107_rel.cz11c_bee	0.348	85.303	12.647	1.099	0.590	0.013	nonzero				0.283
ma101107_rel.cz11d_bee	0.008	82.505	16.379	1.103	0.003	0.001					0.109
ma110401_rel.cz11b_bee	0.141	84.496	14.001	1.244	0.117	0.002					0.138
ma110401_rel.cz11c_bee	0.274	84.559	13.507	1.185	0.465	0.010					0.228
my5651_rel.cz11a_bee	0.070	67.806	29.847	2.148	0.129	0.001					0.124
my5744_rel.cz11a_bee	0.001	74.357	24.157	1.475	0.009	0.001					0.086
my8036_rel.cz11a_bee		64.766	33.169	1.550	0.016	0.498					0.133
my8036_rel.cz11b_bee		62.915	34.569	1.898	0.138	0.479					0.169
my8036_rel.cz11c_bee		67.131	30.299	1.694	0.398	0.477	nonzero	0.001	nonzero	nonzero	21.851
my8036_rel.cz11d_bee		64.799	33.156	1.530	0.016	0.500					0.130
pg162_def.cx9a2_bee	0.037	94.947	4.998	0.017	nonzero						0.019

dbms	256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max
ma100244_rel.cz11a_bee	0.004	78.008	20.151	1.826	0.010	0.001					0.090
ma100339_rel.cz11a_bee	0.005	79.638	18.296	2.027	0.034	0.001					0.077
ma100433_rel.cz11a_bee	0.004	79.246	18.745	1.965	0.039	0.001					0.079
ma100524_rel.cz11a_bee	0.019	83.164	16.102	0.649	0.065	nonzero					0.073
ma100617_rel.cz11a_bee	0.022	87.824	11.096	1.054	0.004	nonzero					0.067
ma101107_rel.cz11a_bee	0.026	83.191	15.635	1.143	0.004	0.001					0.144
ma101107_rel.cz11b_bee	0.125	83.946	14.618	1.252	0.057	0.001					0.220
ma101107_rel.cz11c_bee	0.573	85.326	12.461	1.103	0.525	0.012	nonzero				0.285
ma101107_rel.cz11d_bee	0.027	82.897	15.929	1.142	0.003	0.001					0.110
ma110401_rel.cz11b_bee	0.160	84.532	13.950	1.252	0.105	0.002					0.127
ma110401_rel.cz11c_bee	0.287	84.644	13.452	1.181	0.426	0.009					0.226
my5651_rel.cz11a_bee	0.127	67.421	30.164	2.159	0.129	0.001					0.124
my5744_rel.cz11a_bee	0.002	74.267	24.230	1.491	0.009	0.001					0.085
my8036_rel.cz11a_bee		65.220	32.713	1.555	0.015	0.498					0.132
my8036_rel.cz11b_bee		63.406	34.079	1.901	0.136	0.478					0.174
my8036_rel.cz11c_bee		67.628	29.809	1.694	0.395	0.474	nonzero	0.001	nonzero	nonzero	21.850
my8036_rel.cz11d_bee		65.279	32.671	1.536	0.016	0.499					0.138
pg162_def.cx9a2_bee		18.051	81.882	0.067	nonzero						0.027

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19990	0	0	0.0	3093.2	118.1	0.000	0.000	0.155	6.050	64983	81.3	3.251	325	7.8	23.9	8.9	0.090	5001	3713	ma100244_rel.cz11a_bee
20090	0	0	0.0	3522.5	132.3	0.000	0.000	0.175	6.744	66595	79.5	3.315	317	8.2	24.7	9.5	0.078	5084	3511	ma100339_rel.cz11a_bee
19920	0	0	0.0	3388.3	127.3	0.000	0.000	0.170	6.543	65692	79.6	3.298	320	8.2	24.7	NA	0.080	5084	3361	ma100433_rel.cz11a_bee
22522	0	0	0.0	9827.6	313.3	0.000	0.000	0.436	14.245	108549	81.1	4.820	288	8.2	25.6	9.4	0.072	5734	190	ma100524_rel.cz11a_bee
24891	0	0	0.0	2830.8	106.5	0.000	0.000	0.114	4.379	91358	79.4	3.670	255	6.7	22.7	6.7	0.066	6213	5504	ma100617_rel.cz11a_bee
22222	0	3118	12.2	2641.7	99.3	0.140	0.561	0.119	4.576	93789	73.6	4.221	265	6.7	22.5	6.5	0.145	5572	5049	ma101107_rel.cz11a_bee
21918	0	3078	12.0	2678.2	97.5	0.140	0.562	0.122	4.554	93517	72.6	4.267	265	6.7	22.9	6.5	0.237	5529	4215	ma101107_rel.cz11b_bee
19465	0	2765	10.8	2411.0	89.6	0.142	0.568	0.124	4.715	81767	65.7	4.201	270	8.5	25.8	10.5	0.283	5226	180	ma101107_rel.cz11c_bee
22112	0	3104	12.1	2633.4	98.9	0.140	0.561	0.119	4.582	93581	73.7	4.232	267	6.6	22.4	6.5	0.109	5546	4900	ma101107_rel.cz11d_bee
21751	0	3051	11.9	2661.6	96.8	0.140	0.561	0.122	4.556	92713	71.9	4.263	264	6.6	22.5	6.5	0.138	5507	4581	ma110401_rel.cz11b_bee
19812	0	2820	11.0	2526.7	93.7	0.142	0.569	0.128	4.841	83058	67.4	4.192	272	8.6	25.8	10.4	0.228	5199	170	ma110401_rel.cz11c_bee
16577	0	2761	10.8	1762.9	71.8	0.167	0.666	0.106	4.433	63889	73.8	3.854	356	7.2	22.7	8.1	0.124	4145	3566	my5651_rel.cz11a_bee
19455	0	0	0.0	2033.7	83.8	0.000	0.000	0.105	4.413	62521	77.1	3.214	317	7.6	23.1	8.8	0.086	4854	4345	my5744_rel.cz11a_bee
12001	0	0	0.0	1835.3	63.6	0.000	0.000	0.153	5.429	45020	55.4	3.751	369	6.4	22.0	7.6	0.133	3001	1869	my8036_rel.cz11a_bee
11419	0	0	0.0	769.6	30.4	0.000	0.000	0.067	2.724	40710	53.3	3.565	373	6.4	22.0	7.6	0.169	2852	1798	my8036_rel.cz11b_bee
11096	0	0	0.0	656.6	27.1	0.000	0.000	0.059	2.501	42667	55.3	3.845	399	6.4	22.0	6.8	21.851	2782	644	my8036_rel.cz11c_bee
12023	0	0	0.0	1776.6	62.2	0.000	0.000	0.148	5.297	44918	55.4	3.736	369	6.4	22.0	7.6	0.130	2986	1837	my8036_rel.cz11d_bee
11047	0	0	0.0	51.3	11.7	0.000	0.000	0.005	1.082	38043	70.9	3.444	513	9.1	49.1	0.1	0.019	2233	1309	pg162_def.cx9a2_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	256us	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	85.149	14.732	0.114	0.005	nonzero		0.027
ma100339_rel.cz11a_bee	81.853	18.033	0.111	0.004	nonzero		0.029
ma100433_rel.cz11a_bee	73.453	26.423	0.121	0.004	nonzero		0.026
ma100524_rel.cz11a_bee	67.703	32.250	0.046	0.001			0.010
ma100617_rel.cz11a_bee	69.396	30.588	0.016	0.001			0.009
ma101107_rel.cz11a_bee	70.969	29.013	0.016	0.002			0.008
ma101107_rel.cz11b_bee	68.939	31.044	0.016	0.002			0.010
ma101107_rel.cz11c_bee	68.761	31.221	0.016	0.001			0.011
ma101107_rel.cz11d_bee	69.361	30.623	0.015	0.001			0.012
ma110401_rel.cz11b_bee	70.543	29.441	0.015	0.001			0.009
ma110401_rel.cz11c_bee	68.524	31.460	0.015	0.002			0.015
my5651_rel.cz11a_bee	98.368	1.596	0.026	0.010	nonzero		0.021
my5744_rel.cz11a_bee	89.758	10.232	0.009	0.001			0.012
my8036_rel.cz11a_bee	78.884	21.108	0.006	0.001			0.012
my8036_rel.cz11b_bee	78.578	21.413	0.007	0.002	nonzero		0.045
my8036_rel.cz11c_bee	83.595	16.395	0.007	0.003	nonzero	nonzero	0.145
my8036_rel.cz11d_bee	78.578	21.414	0.007	0.001			0.013
pg162_def.cx9a2_bee	99.990	0.004	0.005	nonzero			0.008

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	95.604	4.188	0.208		0.051
ma100339_rel.cz11a_bee	94.729	4.868	0.403		0.040
ma100433_rel.cz11a_bee	94.549	5.146	0.306		0.044
ma100524_rel.cz11a_bee	99.083	0.917			0.010
ma100617_rel.cz11a_bee	99.806	0.188	0.007		0.016
ma101107_rel.cz11a_bee	57.799	42.194	0.007		0.019
ma101107_rel.cz11b_bee	87.910	12.090			0.012
ma101107_rel.cz11c_bee	74.403	25.597			0.016
ma101107_rel.cz11d_bee	75.174	24.826			0.014
ma110401_rel.cz11b_bee	70.424	29.563	0.014		0.017
ma110401_rel.cz11c_bee	79.639	20.361			0.015
my5651_rel.cz11a_bee	84.229	15.542	0.229		0.037
my5744_rel.cz11a_bee	98.403	1.562	0.035		0.020
my8036_rel.cz11a_bee	96.826	3.160	0.014		0.026
my8036_rel.cz11b_bee	94.625	5.083	0.215	0.076	0.102
my8036_rel.cz11c_bee	93.875	5.431	0.479	0.215	0.204
my8036_rel.cz11d_bee	92.882	7.062	0.007	0.049	0.104
pg162_def.cx9a2_bee	99.243	0.757			0.013

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee		96.819	3.035	0.146		0.036
ma100339_rel.cz11a_bee		96.174	3.625	0.201		0.038
ma100433_rel.cz11a_bee		96.174	3.653	0.174		0.037
ma100524_rel.cz11a_bee		99.340	0.660			0.009
ma100617_rel.cz11a_bee		99.590	0.410			0.015
ma101107_rel.cz11a_bee		59.639	40.347	0.014		0.019
ma101107_rel.cz11b_bee		87.910	12.090			0.013
ma101107_rel.cz11c_bee		74.785	25.215			0.015
ma101107_rel.cz11d_bee		75.528	24.472			0.014
ma110401_rel.cz11b_bee		71.264	28.736			0.015
ma110401_rel.cz11c_bee		80.188	19.812			0.014
my5651_rel.cz11a_bee		85.611	14.215	0.174		0.032
my5744_rel.cz11a_bee		98.604	1.389	0.007		0.017
my8036_rel.cz11a_bee		96.993	2.993	0.014		0.037
my8036_rel.cz11b_bee		95.312	4.472	0.125	0.090	0.104
my8036_rel.cz11c_bee		95.062	4.326	0.431	0.181	0.164
my8036_rel.cz11d_bee		94.625	5.333	0.007	0.035	0.103
pg162_def.cx9a2_bee	15.035	84.632	0.333			0.013

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	18411	0	0.0	3088.2	93.7	0.000	0.000	7.748	240.587	81123	51.5	4.406	224	7.8	23.9	8.8	0.027	4557	3981	ma100244_rel.cz11a_bee
399	17720	0	0.0	3108.2	94.3	0.000	0.000	7.798	242.162	78282	51.5	4.418	232	8.2	24.7	9.5	0.029	4475	3836	ma100339_rel.cz11a_bee
399	16424	0	0.0	3103.8	94.1	0.000	0.000	7.787	241.813	73544	51.5	4.478	251	8.2	24.7	NA	0.026	4139	3614	ma100433_rel.cz11a_bee
399	15786	0	0.0	2.2	0.4	0.000	0.000	0.006	1.104	61249	50.7	3.880	257	8.2	25.6	9.4	0.010	3948	3468	ma100524_rel.cz11a_bee
399	16040	0	0.0	13.8	0.8	0.000	0.000	0.035	1.952	61166	51.1	3.813	255	6.7	22.7	6.7	0.009	3964	3438	ma100617_rel.cz11a_bee
399	16259	10	0.0	9.3	0.6	0.001	0.003	0.023	1.645	61983	50.9	3.812	250	6.7	22.5	6.5	0.008	4029	3532	ma101107_rel.cz11a_bee
399	16028	14	0.1	8.2	0.6	0.001	0.003	0.021	1.524	61135	50.9	3.814	254	6.7	22.9	6.5	0.010	3996	3500	ma101107_rel.cz11b_bee
399	15989	12	0.0	2.2	0.4	0.001	0.003	0.006	1.131	60944	50.9	3.812	255	8.5	25.8	9.7	0.011	3980	3484	ma101107_rel.cz11c_bee
399	16092	12	0.0	19.7	0.9	0.001	0.003	0.049	2.406	61430	51.0	3.818	254	6.6	22.4	6.5	0.012	4012	3500	ma101107_rel.cz11d_bee
399	16142	11	0.0	13.7	0.8	0.001	0.003	0.034	1.933	61560	51.0	3.814	253	6.6	22.5	6.5	0.009	4013	3564	ma110401_rel.cz11b_bee
399	15965	12	0.0	7.5	0.6	0.001	0.003	0.019	1.538	60867	50.9	3.813	255	8.6	25.8	9.7	0.015	3947	3468	ma110401_rel.cz11c_bee
399	25385	14	0.1	348.8	10.9	0.001	0.002	0.875	27.937	97440	50.4	3.839	159	7.2	22.7	8.1	0.021	6361	5786	my5651_rel.cz11a_bee
399	20161	0	0.0	467.7	14.4	0.000	0.000	1.173	36.977	78143	51.4	3.876	204	7.6	23.1	8.8	0.012	5034	4332	my5744_rel.cz11a_bee
399	17519	0	0.0	528.2	13.6	0.000	0.000	1.324	34.977	68313	51.1	3.899	233	6.4	22.0	7.6	0.012	4331	3612	my8036_rel.cz11a_bee
399	17494	0	0.0	212.0	4.1	0.000	0.000	0.532	10.529	67566	51.4	3.862	235	6.4	22.0	7.6	0.045	4459	3534	my8036_rel.cz11b_bee
399	18224	0	0.0	247.4	4.2	0.000	0.000	0.620	10.860	69987	52.4	3.840	230	6.4	22.0	6.9	0.145	4613	3676	my8036_rel.cz11c_bee
399	17496	0	0.0	485.1	12.5	0.000	0.000	1.216	32.214	68145	51.2	3.895	234	6.4	22.0	7.6	0.013	4267	3548	my8036_rel.cz11d_bee
399	47802	0	0.0	11.3	1.4	0.000	0.000	0.028	3.664	182094	50.4	3.809	84	9.1	47.5	2.9	0.008	12003	10405	pg162_def.cx9a2_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel.cz11a_bee	98.347	1.626	0.026	0.001	nonzero	0.021
ma100339_rel.cz11a_bee	97.018	2.956	0.026	0.001	nonzero	0.022
ma100433_rel.cz11a_bee	94.288	5.679	0.032	0.001	nonzero	0.021
ma100524_rel.cz11a_bee	93.770	6.222	0.008	nonzero		0.008
ma100617_rel.cz11a_bee	97.055	2.901	0.043	0.001		0.008
ma101107_rel.cz11a_bee	98.034	1.923	0.042	0.001		0.008
ma101107_rel.cz11b_bee	94.936	5.019	0.044	0.002		0.010
ma101107_rel.cz11c_bee	95.727	4.228	0.044	0.001		0.012
ma101107_rel.cz11d_bee	95.813	4.141	0.045	0.001		0.009
ma110401_rel.cz11b_bee	96.711	3.246	0.042	0.001		0.010
ma110401_rel.cz11c_bee	92.261	7.692	0.045	0.002		0.010
my5651_rel.cz11a_bee	98.739	1.192	0.058	0.012		0.012
my5744_rel.cz11a_bee	95.942	4.015	0.038	0.005		0.012
my8036_rel.cz11a_bee	80.253	19.730	0.014	0.003		0.010
my8036_rel.cz11b_bee	84.283	15.695	0.017	0.004		0.012
my8036_rel.cz11c_bee	78.259	21.720	0.016	0.005		0.015
my8036_rel.cz11d_bee	85.570	14.413	0.014	0.003		0.012
pg162_def.cx9a2_bee	96.943	2.975	0.081	0.001		0.008

dbms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	95.465	4.174	0.361		0.047
ma100339_rel.cz11a_bee	94.035	5.590	0.375		0.036
ma100433_rel.cz11a_bee	94.861	4.854	0.285		0.034
ma100524_rel.cz11a_bee	99.160	0.840			0.009
ma100617_rel.cz11a_bee	99.708	0.285	0.007		0.017
ma101107_rel.cz11a_bee	81.306	18.694			0.015
ma101107_rel.cz11b_bee	87.646	12.354			0.015
ma101107_rel.cz11c_bee	75.514	24.486			0.015
ma101107_rel.cz11d_bee	86.646	13.347	0.007		0.016
ma110401_rel.cz11b_bee	88.153	11.847			0.013
ma110401_rel.cz11c_bee	78.000	22.000			0.015
my5651_rel.cz11a_bee	86.701	13.174	0.125		0.023
my5744_rel.cz11a_bee	98.944	1.049	0.007		0.016
my8036_rel.cz11a_bee	96.236	3.681	0.021	0.062	0.106
my8036_rel.cz11b_bee	96.667	3.271	0.062		0.042
my8036_rel.cz11c_bee	95.493	4.174	0.264	0.069	0.123
my8036_rel.cz11d_bee	96.493	3.479	0.021	0.007	0.102
pg162_def.cx9a2_bee	99.167	0.833			0.007

dbms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	96.465	3.278	0.257		0.033
ma100339_rel.cz11a_bee	95.924	3.826	0.250		0.031
ma100433_rel.cz11a_bee	96.382	3.410	0.208		0.033
ma100524_rel.cz11a_bee	99.674	0.326			0.010
ma100617_rel.cz11a_bee	99.646	0.347	0.007		0.016
ma101107_rel.cz11a_bee	81.500	18.500			0.014
ma101107_rel.cz11b_bee	87.785	12.215			0.016
ma101107_rel.cz11c_bee	75.826	24.167	0.007		0.017
ma101107_rel.cz11d_bee	86.625	13.375			0.015
ma110401_rel.cz11b_bee	88.097	11.896	0.007		0.017
ma110401_rel.cz11c_bee	78.264	21.736			0.016
my5651_rel.cz11a_bee	87.660	12.299	0.042		0.022
my5744_rel.cz11a_bee	99.021	0.965	0.014		0.020
my8036_rel.cz11a_bee	96.500	3.438	0.014	0.049	0.103
my8036_rel.cz11b_bee	96.389	3.542	0.069		0.048
my8036_rel.cz11c_bee	95.701	4.069	0.174	0.056	0.102
my8036_rel.cz11d_bee	96.458	3.528	0.007	0.007	0.102
pg162_def.cx9a2_bee	98.604	1.396			0.007

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	20957	0	0.0	3079.6	93.4	0.000	0.000	7.722	239.790	93836	52.3	4.478	200	7.8	23.9	8.9	0.021	5273	4667	ma100244_rel.cz11a_bee
399	19830	0	0.0	3086.7	93.6	0.000	0.000	7.740	240.375	88523	52.2	4.464	211	8.2	24.7	9.5	0.022	5021	4316	ma100339_rel.cz11a_bee
399	18731	0	0.0	3089.4	93.7	0.000	0.000	7.747	240.574	82779	52.1	4.419	223	8.2	24.7	NA	0.021	4811	4171	ma100433_rel.cz11a_bee
399	18452	0	0.0	2.3	0.4	0.000	0.000	0.006	1.099	69106	50.6	3.745	219	8.2	25.6	9.4	0.008	4619	4299	ma100524_rel.cz11a_bee
399	19524	0	0.0	25.4	1.1	0.000	0.000	0.064	2.806	77448	50.9	3.967	209	6.7	22.7	6.7	0.008	4955	3996	ma100617_rel.cz11a_bee
399	19804	13	0.1	21.2	1.0	0.001	0.003	0.053	2.520	78848	51.0	3.981	206	6.7	22.5	6.5	0.008	4981	4509	ma101107_rel.cz11a_bee
399	18924	14	0.1	20.0	0.9	0.001	0.003	0.050	2.391	74496	50.7	3.937	214	6.7	22.9	6.6	0.010	4797	3948	ma101107_rel.cz11b_bee
399	19178	13	0.0	2.6	0.5	0.001	0.003	0.007	1.158	75669	50.7	3.946	211	8.5	25.8	9.7	0.012	4908	3916	ma101107_rel.cz11c_bee
399	19075	14	0.1	25.4	1.1	0.001	0.003	0.064	2.834	75405	50.7	3.953	213	6.6	22.4	6.5	0.009	4891	3964	ma101107_rel.cz11d_bee
399	19489	14	0.1	26.1	1.1	0.001	0.003	0.066	2.833	77240	50.7	3.963	208	6.6	22.5	6.5	0.010	5003	4014	ma110401_rel.cz11b_bee
399	18185	12	0.0	9.8	0.7	0.001	0.003	0.024	1.688	70867	50.4	3.897	222	8.6	25.8	9.7	0.010	4539	3853	ma110401_rel.cz11c_bee
399	23759	14	0.1	2.2	0.4	0.001	0.002	0.005	1.087	93639	49.4	3.941	166	7.2	22.7	8.1	0.012	6089	4813	my5651_rel.cz11a_bee
399	19410	0	0.0	39.4	1.4	0.000	0.000	0.099	3.661	76196	50.3	3.926	207	7.6	23.1	8.8	0.012	4891	4123	my5744_rel.cz11a_bee
399	15251	0	0.0	67.4	2.1	0.000	0.000	0.169	5.481	59346	50.3	3.891	264	6.4	22.1	7.6	0.010	3901	3356	my8036_rel.cz11a_bee
399	15441	0	0.0	150.2	3.3	0.000	0.000	0.377	8.443	61754	51.0	3.999	264	6.4	22.1	7.6	0.012	3900	3436	my8036_rel.cz11b_bee
399	15200	0	0.0	180.3	3.4	0.000	0.000	0.452	8.757	60092	51.8	3.953	273	6.4	22.1	6.9	0.015	3852	3372	my8036_rel.cz11c_bee
399	15584	0	0.0	71.9	2.2	0.000	0.000	0.180	5.760	61752	50.4	3.962	259	6.4	22.1	7.6	0.012	3944	3420	my8036_rel.cz11d_bee
399	18923	0	0.0	33.9	3.2	0.000	0.000	0.085	8.296	75162	51.8	3.972	219	9.1	45.5	2.7	0.008	4779	4491	pg162_def.cx9a2_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	85.099	14.449	0.410	0.041	0.001		0.036
ma100339_rel.cz11a_bee	82.509	17.128	0.319	0.042	0.001		0.056
ma100433_rel.cz11a_bee	76.213	23.401	0.342	0.042	0.001		0.038
ma100524_rel.cz11a_bee	69.002	30.861	0.116	0.022	nonzero		0.025
ma100617_rel.cz11a_bee	72.675	27.202	0.110	0.013	nonzero		0.020
ma101107_rel.cz11a_bee	72.673	27.227	0.088	0.012	nonzero		0.024
ma101107_rel.cz11b_bee	71.593	28.304	0.087	0.016	nonzero		0.042
ma101107_rel.cz11c_bee	71.673	28.212	0.095	0.018	0.002	nonzero	0.121
ma101107_rel.cz11d_bee	72.381	27.521	0.087	0.011	nonzero		0.019
ma110401_rel.cz11b_bee	74.076	25.833	0.079	0.012	nonzero		0.031
ma110401_rel.cz11c_bee	72.966	26.942	0.081	0.011	nonzero	nonzero	0.073
my5651_rel.cz11a_bee	98.236	1.660	0.089	0.014	nonzero		0.037
my5744_rel.cz11a_bee	90.342	9.631	0.020	0.007	nonzero		0.026
my8036_rel.cz11a_bee	77.985	21.983	0.021	0.011	nonzero		0.030
my8036_rel.cz11b_bee	81.320	18.629	0.035	0.016	0.001	nonzero	0.093
my8036_rel.cz11c_bee	85.556	14.390	0.034	0.019	0.001	nonzero	0.102
my8036_rel.cz11d_bee	78.135	21.833	0.022	0.010	nonzero		0.041
pg162_def.cx9a2_bee	99.931	0.040	0.026	0.004	nonzero		0.034

dbms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	77.314	20.871	1.815		0.063
ma100339_rel.cz11a_bee	71.251	26.001	2.747		0.054
ma100433_rel.cz11a_bee	72.165	25.321	2.514		0.057
ma100524_rel.cz11a_bee	95.962	3.978	0.060		0.036
ma100617_rel.cz11a_bee	95.310	4.640	0.050		0.039
ma101107_rel.cz11a_bee	93.333	6.599	0.068		0.040
ma101107_rel.cz11b_bee	93.126	6.711	0.161	0.001	0.065
ma101107_rel.cz11c_bee	92.004	7.714	0.265	0.017	0.146
ma101107_rel.cz11d_bee	93.469	6.476	0.054		0.030
ma110401_rel.cz11b_bee	93.364	6.510	0.126		0.036
ma110401_rel.cz11c_bee	93.192	6.567	0.236	0.006	0.079
my5651_rel.cz11a_bee	67.400	31.524	1.076		0.059
my5744_rel.cz11a_bee	94.901	4.810	0.289		0.064
my8036_rel.cz11a_bee	86.285	12.310	1.051	0.354	0.131
my8036_rel.cz11b_bee	87.268	11.322	1.161	0.249	0.124
my8036_rel.cz11c_bee	81.035	15.851	2.506	0.608	0.166
my8036_rel.cz11d_bee	85.592	13.061	1.075	0.272	0.129
pg162_def.cx9a2_bee	95.479	4.417	0.104		0.037

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee		82.043	16.636	1.319	0.001	0.067
ma100339_rel.cz11a_bee		77.429	20.617	1.954		0.062
ma100433_rel.cz11a_bee		78.344	19.893	1.762		0.058
ma100524_rel.cz11a_bee		97.531	2.447	0.022		0.037
ma100617_rel.cz11a_bee		97.214	2.763	0.024		0.039
ma101107_rel.cz11a_bee		95.182	4.783	0.035		0.040
ma101107_rel.cz11b_bee		95.106	4.814	0.081		0.039
ma101107_rel.cz11c_bee		94.540	5.317	0.139	0.004	0.134
ma101107_rel.cz11d_bee		95.265	4.715	0.019		0.029
ma110401_rel.cz11b_bee		95.031	4.897	0.072		0.035
ma110401_rel.cz11c_bee		94.910	4.967	0.122	0.001	0.071
my5651_rel.cz11a_bee		76.469	22.818	0.713		0.049
my5744_rel.cz11a_bee		96.256	3.547	0.197		0.062
my8036_rel.cz11a_bee		89.608	9.412	0.667	0.312	0.124
my8036_rel.cz11b_bee		90.022	8.812	0.935	0.231	0.117
my8036_rel.cz11c_bee		85.599	12.028	1.835	0.539	0.184
my8036_rel.cz11d_bee		89.040	10.035	0.676	0.249	0.126
pg162_def.cx9a2_bee	9.639	84.776	5.422	0.163		0.029

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	17799	0	0.0	10070.0	306.3	0.000	0.000	5.049	157.263	100743	55.2	5.660	248	7.8	23.9	8.9	0.036	4443	3900	ma100244_rel.cz11a_bee
1994	17258	0	0.0	10156.1	309.0	0.000	0.000	5.092	158.631	98427	55.3	5.703	256	8.2	24.7	9.5	0.056	4363	3821	ma100339_rel.cz11a_bee
1994	16258	0	0.0	10116.6	307.8	0.000	0.000	5.073	158.016	94381	55.3	5.805	272	8.2	24.7	NA	0.038	4091	3548	ma100433_rel.cz11a_bee
1993	15725	0	0.0	6.8	2.1	0.000	0.000	0.003	1.084	61188	52.0	3.891	265	8.2	25.6	9.4	0.025	3933	3404	ma100524_rel.cz11a_bee
1994	16238	0	0.0	230.0	8.3	0.000	0.000	0.115	4.276	62263	52.4	3.835	258	6.7	22.7	6.7	0.020	4075	3502	ma100617_rel.cz11a_bee
1993	16269	72	0.3	240.5	8.7	0.004	0.018	0.121	4.455	62602	52.6	3.848	259	6.7	22.5	6.5	0.024	4044	3532	ma101107_rel.cz11a_bee
1994	16138	73	0.3	245.5	8.6	0.005	0.018	0.123	4.429	62149	52.5	3.851	260	6.7	22.9	6.6	0.042	4013	3468	ma101107_rel.cz11b_bee
1993	16099	73	0.3	260.1	9.4	0.005	0.018	0.130	4.817	61896	52.4	3.845	260	8.5	25.8	9.7	0.121	4012	3436	ma101107_rel.cz11c_bee
1994	16294	72	0.3	227.2	8.3	0.004	0.018	0.114	4.258	62675	52.7	3.846	259	6.6	22.4	6.5	0.019	4076	3516	ma101107_rel.cz11d_bee
1993	16469	73	0.3	236.5	8.4	0.004	0.018	0.119	4.293	63307	52.5	3.844	255	6.6	22.5	6.5	0.031	4093	3582	ma110401_rel.cz11b_bee
1994	16356	73	0.3	250.0	9.0	0.004	0.018	0.125	4.644	62742	52.6	3.836	257	8.6	25.8	9.7	0.073	4059	3516	ma110401_rel.cz11c_bee
1993	25032	62	0.2	697.1	22.9	0.002	0.010	0.350	11.775	95269	52.9	3.806	169	7.2	22.7	8.1	0.037	6249	5626	my5651_rel.cz11a_bee
1994	20016	0	0.0	282.3	10.4	0.000	0.000	0.142	5.328	75169	53.6	3.755	214	7.6	23.1	8.8	0.026	4957	4285	my5744_rel.cz11a_bee
1993	17092	0	0.0	421.4	13.0	0.000	0.000	0.211	6.662	65399	53.4	3.826	250	6.4	22.1	7.6	0.030	4315	3550	my8036_rel.cz11a_bee
1994	17524	0	0.0	508.0	12.0	0.000	0.000	0.255	6.146	67449	55.5	3.849	253	6.4	22.1	7.6	0.093	4475	3628	my8036_rel.cz11b_bee
1994	17884	0	0.0	585.3	12.0	0.000	0.000	0.293	6.155	69173	57.9	3.868	259	6.4	22.1	6.9	0.102	4573	3662	my8036_rel.cz11c_bee
1994	17152	0	0.0	414.4	12.8	0.000	0.000	0.208	6.549	65770	53.5	3.835	250	6.4	22.1	7.6	0.041	4331	3580	my8036_rel.cz11d_bee
1994	44971	0	0.0	62.0	4.5	0.000	0.000	0.031	2.329	169727	51.6	3.774	92	9.1	43.4	8.2	0.034	11523	8519	pg162_def.cx9a2_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
ma100244_rel.cz11a_bee	96.597	3.251	0.141	0.011	nonzero	0.029
ma100339_rel.cz11a_bee	95.183	4.693	0.113	0.011	nonzero	0.022
ma100433_rel.cz11a_bee	92.701	7.171	0.116	0.012	nonzero	0.030
ma100524_rel.cz11a_bee	92.284	7.694	0.018	0.004	nonzero	0.029
ma100617_rel.cz11a_bee	96.054	3.824	0.111	0.011	nonzero	0.017
ma101107_rel.cz11a_bee	96.132	3.759	0.099	0.010	nonzero	0.019
ma101107_rel.cz11b_bee	95.938	3.943	0.108	0.012	nonzero	0.018
ma101107_rel.cz11c_bee	96.086	3.794	0.108	0.012	nonzero	0.017
ma101107_rel.cz11d_bee	96.113	3.766	0.110	0.011	nonzero	0.018
ma110401_rel.cz11b_bee	95.904	3.983	0.100	0.013	nonzero	0.018
ma110401_rel.cz11c_bee	95.820	4.067	0.102	0.012	nonzero	0.040
my5651_rel.cz11a_bee	97.465	2.282	0.235	0.019	nonzero	0.017
my5744_rel.cz11a_bee	94.989	4.900	0.094	0.017	nonzero	0.027
my8036_rel.cz11a_bee	80.278	19.676	0.034	0.012	nonzero	0.028
my8036_rel.cz11b_bee	73.325	26.608	0.047	0.020	nonzero	0.042
my8036_rel.cz11c_bee	66.119	33.808	0.050	0.023	0.001	0.054
my8036_rel.cz11d_bee	79.685	20.266	0.035	0.013	0.001	0.029
pg162_def.cx9a2_bee	96.358	3.496	0.135	0.011	nonzero	0.022

dbms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	82.782	15.338	1.879	0.001	0.069
ma100339_rel.cz11a_bee	80.006	17.908	2.085	0.001	0.066
ma100433_rel.cz11a_bee	77.586	20.044	2.369		0.059
ma100524_rel.cz11a_bee	97.156	2.797	0.047		0.038
ma100617_rel.cz11a_bee	96.814	3.151	0.035		0.039
ma101107_rel.cz11a_bee	95.129	4.835	0.036		0.030
ma101107_rel.cz11b_bee	92.156	7.754	0.090		0.040
ma101107_rel.cz11c_bee	90.347	9.496	0.157		0.048
ma101107_rel.cz11d_bee	93.353	6.603	0.044		0.039
ma110401_rel.cz11b_bee	93.774	6.112	0.114		0.046
ma110401_rel.cz11c_bee	93.826	5.950	0.215	0.008	0.193
my5651_rel.cz11a_bee	76.542	23.081	0.378		0.049
my5744_rel.cz11a_bee	98.069	1.889	0.042		0.048
my8036_rel.cz11a_bee	91.044	8.249	0.532	0.175	0.123
my8036_rel.cz11b_bee	88.122	10.312	1.296	0.269	0.125
my8036_rel.cz11c_bee	78.003	18.632	2.690	0.675	0.163
my8036_rel.cz11d_bee	90.943	8.138	0.633	0.286	0.125
pg162_def.cx9a2_bee	97.733	2.240	0.026		0.026

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee		87.026	11.749	1.225		0.052
ma100339_rel.cz11a_bee		85.125	13.482	1.393		0.051
ma100433_rel.cz11a_bee		83.439	15.006	1.556		0.056
ma100524_rel.cz11a_bee		98.268	1.706	0.026		0.038
ma100617_rel.cz11a_bee		98.118	1.869	0.013		0.037
ma101107_rel.cz11a_bee		96.296	3.690	0.014		0.028
ma101107_rel.cz11b_bee		94.221	5.740	0.039		0.040
ma101107_rel.cz11c_bee		93.086	6.818	0.096		0.044
ma101107_rel.cz11d_bee		95.157	4.821	0.022		0.039
ma110401_rel.cz11b_bee		95.283	4.657	0.060		0.045
ma110401_rel.cz11c_bee		95.215	4.674	0.108	0.003	0.123
my5651_rel.cz11a_bee		83.628	16.118	0.254		0.047
my5744_rel.cz11a_bee		98.776	1.201	0.022		0.048
my8036_rel.cz11a_bee		92.862	6.606	0.374	0.158	0.121
my8036_rel.cz11b_bee		90.943	7.918	0.907	0.232	0.156
my8036_rel.cz11c_bee		83.147	14.258	2.019	0.575	0.158
my8036_rel.cz11d_bee		93.299	6.078	0.378	0.246	0.125
pg162_def.cx9a2_bee	6.374	91.174	2.418	0.035		0.026

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	19513	0	0.0	10282.8	312.7	0.000	0.000	5.156	160.562	108909	57.3	5.581	235	7.8	23.9	8.8	0.029	4910	4459	ma100244_rel.cz11a_bee
1994	18796	0	0.0	10284.9	312.9	0.000	0.000	5.157	160.632	106146	57.2	5.647	243	8.2	24.7	9.5	0.022	4731	4299	ma100339_rel.cz11a_bee
1994	18135	0	0.0	10297.2	313.2	0.000	0.000	5.163	160.820	103790	57.2	5.723	252	8.2	24.7	NA	0.030	4571	4155	ma100433_rel.cz11a_bee
1994	18167	0	0.0	6.8	2.1	0.000	0.000	0.003	1.089	67912	52.8	3.738	233	8.2	25.6	9.4	0.029	4539	4221	ma100524_rel.cz11a_bee
1994	19138	0	0.0	202.1	7.5	0.000	0.000	0.101	3.863	76986	52.3	4.023	219	6.7	22.7	6.7	0.017	4843	4379	ma100617_rel.cz11a_bee
1994	19191	74	0.3	195.9	7.4	0.004	0.015	0.098	3.802	77261	52.4	4.026	218	6.7	22.5	6.5	0.019	4827	4395	ma101107_rel.cz11a_bee
1993	19189	74	0.3	202.0	7.4	0.004	0.015	0.101	3.810	77308	52.4	4.029	218	6.7	22.9	6.5	0.018	4855	4411	ma101107_rel.cz11b_bee
1994	19213	73	0.3	193.6	7.5	0.004	0.015	0.097	3.827	77145	52.5	4.015	219	8.5	25.8	9.7	0.017	4829	4427	ma101107_rel.cz11c_bee
1994	19208	73	0.3	211.7	7.8	0.004	0.015	0.106	4.025	77412	52.4	4.030	218	6.6	22.4	6.5	0.018	4859	4395	ma101107_rel.cz11d_bee
1994	19158	73	0.3	204.8	7.5	0.004	0.015	0.103	3.842	77112	52.2	4.025	218	6.6	22.5	6.5	0.018	4813	4331	ma110401_rel.cz11b_bee
1994	19168	73	0.3	200.1	7.6	0.004	0.015	0.100	3.903	76974	52.3	4.016	218	8.6	25.8	9.7	0.040	4859	4301	ma110401_rel.cz11c_bee
1994	22473	63	0.2	540.2	18.2	0.003	0.011	0.271	9.344	89973	51.1	4.004	182	7.2	22.7	8.1	0.017	5674	4699	my5651_rel.cz11a_bee
1994	19275	0	0.0	262.0	9.8	0.000	0.000	0.131	5.015	76572	52.2	3.973	217	7.6	23.1	8.8	0.027	4891	4046	my5744_rel.cz11a_bee
1993	15105	0	0.0	408.4	12.7	0.000	0.000	0.205	6.507	60736	53.1	4.021	281	6.4	22.1	7.6	0.028	3819	3374	my8036_rel.cz11a_bee
1994	14684	0	0.0	542.8	12.6	0.000	0.000	0.272	6.487	59490	55.3	4.051	301	6.4	22.1	7.6	0.042	3700	3276	my8036_rel.cz11b_bee
1994	14462	0	0.0	620.0	12.6	0.000	0.000	0.311	6.457	59914	58.2	4.143	322	6.4	22.1	6.9	0.054	3628	3117	my8036_rel.cz11c_bee
1994	15134	0	0.0	400.6	12.5	0.000	0.000	0.201	6.408	60329	53.0	3.986	280	6.4	22.1	7.6	0.029	3836	3358	my8036_rel.cz11d_bee
1993	18423	0	0.0	30.2	4.9	0.000	0.000	0.015	2.492	73251	52.8	3.976	229	9.1	39.3	7.2	0.022	4637	4203	pg162_def.cx9a2_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	84.873	14.546	0.500	0.078	0.002		0.037
ma100339_rel.cz11a_bee	81.427	17.959	0.541	0.071	0.003		0.042
ma100433_rel.cz11a_bee	76.090	23.282	0.550	0.075	0.003		0.051
ma100524_rel.cz11a_bee	71.003	28.491	0.455	0.051	nonzero		0.031
ma100617_rel.cz11a_bee	72.905	26.815	0.252	0.027	nonzero		0.028
ma101107_rel.cz11a_bee	72.121	27.597	0.255	0.027	nonzero		0.025
ma101107_rel.cz11b_bee	70.838	28.872	0.254	0.034	0.001	nonzero	0.077
ma101107_rel.cz11c_bee	71.344	28.328	0.283	0.040	0.004	nonzero	0.103
ma101107_rel.cz11d_bee	71.551	28.145	0.278	0.026	nonzero		0.040
ma110401_rel.cz11b_bee	72.217	27.531	0.225	0.026	nonzero		0.028
ma110401_rel.cz11c_bee	71.654	28.074	0.244	0.026	0.001	nonzero	0.128
my5651_rel.cz11a_bee	97.842	1.957	0.173	0.027	0.001		0.058
my5744_rel.cz11a_bee	90.014	9.905	0.062	0.019	0.001		0.046
my8036_rel.cz11a_bee	79.093	20.800	0.074	0.031	0.003		0.048
my8036_rel.cz11b_bee	85.119	14.727	0.102	0.048	0.003	nonzero	0.083
my8036_rel.cz11c_bee	87.959	11.910	0.086	0.041	0.004	nonzero	0.117
my8036_rel.cz11d_bee	79.016	20.879	0.074	0.029	0.002		0.052
pg162_def.cx9a2_bee	99.765	0.175	0.052	0.008	nonzero		0.036

dbms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	58.472	37.326	4.202	0.001	0.067
ma100339_rel.cz11a_bee	61.134	35.042	3.822	0.002	0.074
ma100433_rel.cz11a_bee	59.494	36.493	4.012	0.001	0.070
ma100524_rel.cz11a_bee	64.597	33.784	1.619		0.054
ma100617_rel.cz11a_bee	78.119	21.629	0.251		0.050
ma101107_rel.cz11a_bee	73.843	25.893	0.264		0.042
ma101107_rel.cz11b_bee	72.099	27.505	0.395	0.001	0.069
ma101107_rel.cz11c_bee	71.402	27.980	0.610	0.008	0.133
ma101107_rel.cz11d_bee	69.611	30.113	0.276		0.039
ma110401_rel.cz11b_bee	76.920	22.660	0.420		0.051
ma110401_rel.cz11c_bee	71.469	27.901	0.626	0.003	0.194
my5651_rel.cz11a_bee	44.122	52.656	3.222		0.059
my5744_rel.cz11a_bee	73.409	24.966	1.624	0.001	0.067
my8036_rel.cz11a_bee	64.655	30.896	3.487	0.963	0.148
my8036_rel.cz11b_bee	62.992	30.940	5.075	0.993	0.189
my8036_rel.cz11c_bee	63.365	30.023	5.299	1.313	0.241
my8036_rel.cz11d_bee	68.292	27.570	3.252	0.886	0.152
pg162_def.cx9a2_bee	90.424	9.331	0.245		0.040

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee		65.162	31.508	3.330		0.063
ma100339_rel.cz11a_bee		68.388	28.774	2.838	0.001	0.070
ma100433_rel.cz11a_bee		67.332	29.547	3.122		0.062
ma100524_rel.cz11a_bee		71.760	27.213	1.028		0.058
ma100617_rel.cz11a_bee		83.255	16.540	0.205		0.042
ma101107_rel.cz11a_bee		79.099	20.728	0.174		0.044
ma101107_rel.cz11b_bee		77.497	22.257	0.245	0.001	0.071
ma101107_rel.cz11c_bee		76.966	22.653	0.380	0.001	0.108
ma101107_rel.cz11d_bee		75.333	24.503	0.164		0.042
ma110401_rel.cz11b_bee		81.279	18.439	0.282		0.053
ma110401_rel.cz11c_bee		76.758	22.820	0.417	0.004	0.192
my5651_rel.cz11a_bee	0.001	53.565	44.135	2.300		0.057
my5744_rel.cz11a_bee		78.606	19.983	1.411		0.053
my8036_rel.cz11a_bee		71.585	24.879	2.667	0.869	0.138
my8036_rel.cz11b_bee		70.851	24.447	3.823	0.879	0.194
my8036_rel.cz11c_bee		71.294	23.676	3.908	1.122	0.210
my8036_rel.cz11d_bee		75.481	21.357	2.397	0.765	0.137
pg162_def.cx9a2_bee	4.400	84.480	10.842	0.278		0.041

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	17320	0	0.0	10190.0	312.0	0.000	0.000	2.555	80.088	98566	57.7	5.691	267	7.8	23.9	8.8	0.037	4365	3852	ma100244_rel.cz11a_bee
3987	16575	0	0.0	10529.8	322.4	0.000	0.000	2.641	82.798	97344	57.5	5.873	278	8.2	24.7	9.5	0.042	4187	3644	ma100339_rel.cz11a_bee
3989	15744	0	0.0	10405.4	318.6	0.000	0.000	2.609	81.784	93425	57.7	5.934	293	8.2	24.7	NA	0.051	3996	3470	ma100433_rel.cz11a_bee
3989	15412	0	0.0	5361.8	163.1	0.000	0.000	1.344	41.873	84473	55.3	5.481	287	8.2	25.6	9.4	0.031	3852	3308	ma100524_rel.cz11a_bee
3989	15971	0	0.0	401.7	15.0	0.000	0.000	0.101	3.847	62072	54.2	3.886	271	6.7	22.7	6.7	0.028	4012	3452	ma100617_rel.cz11a_bee
3989	15856	137	0.5	425.7	15.8	0.009	0.035	0.107	4.053	61745	54.3	3.894	274	6.7	22.5	6.5	0.025	3931	3420	ma101107_rel.cz11a_bee
3989	15676	135	0.5	436.5	15.7	0.009	0.034	0.109	4.035	61213	54.2	3.905	277	6.7	22.9	6.5	0.077	3933	3404	ma101107_rel.cz11b_bee
3989	15638	136	0.5	456.3	16.8	0.009	0.035	0.114	4.301	60982	54.0	3.899	276	8.5	25.8	9.7	0.103	3900	3276	ma101107_rel.cz11c_bee
3989	15793	130	0.5	422.5	15.7	0.008	0.033	0.106	4.032	61493	54.3	3.894	275	6.6	22.4	6.5	0.040	3964	3404	ma101107_rel.cz11d_bee
3989	15856	138	0.5	442.3	15.9	0.009	0.035	0.111	4.070	61653	54.2	3.888	273	6.6	22.5	6.5	0.028	3966	3422	ma110401_rel.cz11b_bee
3989	15816	136	0.5	456.5	16.7	0.009	0.034	0.114	4.282	61309	54.4	3.876	275	8.6	25.8	9.7	0.128	3996	3422	ma110401_rel.cz11c_bee
3989	24346	114	0.4	750.2	26.5	0.005	0.019	0.188	6.790	91301	55.4	3.750	182	7.2	22.7	8.1	0.058	6025	5418	my5651_rel.cz11a_bee
3989	19462	0	0.0	541.4	20.2	0.000	0.000	0.136	5.180	71655	56.5	3.682	232	7.6	23.1	8.8	0.046	4893	4141	my5744_rel.cz11a_bee
3989	16872	0	0.0	796.8	24.9	0.000	0.000	0.200	6.384	64385	56.4	3.816	267	6.4	22.1	7.6	0.048	4299	3564	my8036_rel.cz11a_bee
3987	17422	0	0.0	1111.1	25.2	0.000	0.000	0.279	6.462	67731	60.7	3.888	279	6.4	22.1	7.6	0.083	4413	3644	my8036_rel.cz11b_bee
3989	17538	0	0.0	1013.5	21.3	0.000	0.000	0.254	5.458	68662	63.6	3.915	290	6.4	22.1	6.9	0.117	4427	3772	my8036_rel.cz11c_bee
3989	16875	0	0.0	799.7	24.9	0.000	0.000	0.200	6.403	64621	56.4	3.829	267	6.4	22.1	7.6	0.052	4251	3518	my8036_rel.cz11d_bee
3989	42631	0	0.0	36.6	6.3	0.000	0.000	0.009	1.619	159741	52.9	3.747	99	9.1	36.7	4.0	0.036	10948	8215	pg162_def.cx9a2_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	96.079	3.708	0.181	0.032	0.001		0.042
ma100339_rel.cz11a_bee	94.091	5.703	0.179	0.026	0.001		0.038
ma100433_rel.cz11a_bee	90.413	9.374	0.184	0.028	0.001		0.033
ma100524_rel.cz11a_bee	87.494	12.276	0.208	0.023	nonzero		0.030
ma100617_rel.cz11a_bee	94.652	5.225	0.110	0.013	nonzero		0.029
ma101107_rel.cz11a_bee	93.645	6.233	0.111	0.012	nonzero		0.016
ma101107_rel.cz11b_bee	93.720	6.162	0.107	0.011	nonzero		0.020
ma101107_rel.cz11c_bee	93.542	6.339	0.108	0.011	nonzero		0.063
ma101107_rel.cz11d_bee	93.194	6.697	0.098	0.011	nonzero		0.022
ma110401_rel.cz11b_bee	93.863	6.024	0.100	0.013	nonzero		0.025
ma110401_rel.cz11c_bee	93.408	6.482	0.097	0.013	nonzero		0.024
my5651_rel.cz11a_bee	96.994	2.622	0.354	0.030	nonzero		0.028
my5744_rel.cz11a_bee	92.653	7.086	0.218	0.042	0.001		0.037
my8036_rel.cz11a_bee	75.304	24.560	0.103	0.032	0.002		0.052
my8036_rel.cz11b_bee	61.063	38.736	0.144	0.056	0.002		0.051
my8036_rel.cz11c_bee	48.259	51.552	0.137	0.050	0.002	nonzero	0.143
my8036_rel.cz11d_bee	73.825	26.003	0.127	0.041	0.004		0.047
pg162_def.cx9a2_bee	95.717	4.074	0.188	0.021	0.001		0.032

dbms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee	63.572	31.534	4.893	0.001	0.068
ma100339_rel.cz11a_bee	66.365	29.410	4.221	0.004	0.084
ma100433_rel.cz11a_bee	64.490	30.873	4.636	0.001	0.066
ma100524_rel.cz11a_bee	62.524	34.760	2.716		0.054
ma100617_rel.cz11a_bee	80.290	19.301	0.408		0.054
ma101107_rel.cz11a_bee	76.844	22.881	0.276		0.038
ma101107_rel.cz11b_bee	80.263	19.380	0.358		0.050
ma101107_rel.cz11c_bee	78.049	21.422	0.526	0.003	0.071
ma101107_rel.cz11d_bee	82.680	17.042	0.278		0.044
ma110401_rel.cz11b_bee	84.777	14.833	0.390		0.053
ma110401_rel.cz11c_bee	83.327	16.110	0.563		0.052
my5651_rel.cz11a_bee	52.681	46.067	1.251	0.001	0.069
my5744_rel.cz11a_bee	77.252	22.062	0.685		0.051
my8036_rel.cz11a_bee	71.709	24.872	2.551	0.868	0.143
my8036_rel.cz11b_bee	64.085	29.413	5.333	1.169	0.158
my8036_rel.cz11c_bee	63.131	30.015	5.455	1.399	0.202
my8036_rel.cz11d_bee	63.250	31.788	3.765	1.198	0.151
pg162_def.cx9a2_bee	92.068	7.676	0.256		0.037

dbms	1ms	4ms	16ms	64ms	256ms	max
ma100244_rel.cz11a_bee		69.903	26.408	3.688	0.001	0.067
ma100339_rel.cz11a_bee		73.563	23.320	3.115	0.001	0.072
ma100433_rel.cz11a_bee		71.824	24.800	3.374	0.003	0.069
ma100524_rel.cz11a_bee		69.446	28.818	1.735	0.001	0.067
ma100617_rel.cz11a_bee		84.628	15.036	0.335		0.060
ma101107_rel.cz11a_bee		81.510	18.310	0.181		0.042
ma101107_rel.cz11b_bee		84.139	15.667	0.194		0.038
ma101107_rel.cz11c_bee		82.430	17.262	0.308	0.001	0.064
ma101107_rel.cz11d_bee		86.371	13.469	0.160		0.051
ma110401_rel.cz11b_bee		87.701	12.081	0.218		0.053
ma110401_rel.cz11c_bee		86.635	13.031	0.334		0.058
my5651_rel.cz11a_bee		62.965	36.124	0.911		0.055
my5744_rel.cz11a_bee		82.297	17.112	0.591		0.057
my8036_rel.cz11a_bee		76.862	20.558	1.820	0.760	0.141
my8036_rel.cz11b_bee		71.583	23.385	4.029	1.003	0.172
my8036_rel.cz11c_bee		70.720	23.931	4.147	1.202	0.197
my8036_rel.cz11d_bee		70.278	25.790	2.854	1.078	0.143
pg162_def.cx9a2_bee	5.676	85.057	8.992	0.276		0.035

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	18897	0	0.0	10547.4	322.7	0.000	0.000	2.644	82.850	104909	60.2	5.552	255	7.8	23.9	8.8	0.042	4747	4283	ma100244_rel.cz11a_bee
3987	18093	0	0.0	10694.4	327.3	0.000	0.000	2.683	84.066	102940	60.1	5.689	266	8.2	24.7	9.5	0.038	4525	4123	ma100339_rel.cz11a_bee
3989	17476	0	0.0	10701.6	327.5	0.000	0.000	2.683	84.079	100649	60.1	5.759	275	8.2	24.7	NA	0.033	4411	4012	ma100433_rel.cz11a_bee
3989	17035	0	0.0	10275.7	310.7	0.000	0.000	2.576	79.760	109689	58.3	6.439	274	8.2	25.6	9.4	0.030	4283	3947	ma100524_rel.cz11a_bee
3989	18966	0	0.0	423.2	15.6	0.000	0.000	0.106	4.010	76387	55.1	4.028	232	6.7	22.7	6.7	0.029	4763	4474	ma100617_rel.cz11a_bee
3989	18791	139	0.5	420.7	15.6	0.007	0.030	0.105	4.009	75952	55.2	4.042	235	6.7	22.5	6.5	0.016	4715	4413	ma101107_rel.cz11a_bee
3989	18808	141	0.6	440.2	15.8	0.007	0.030	0.110	4.060	76093	55.2	4.046	235	6.7	22.9	6.5	0.020	4731	4381	ma101107_rel.cz11b_bee
3989	18826	140	0.5	452.7	16.6	0.007	0.030	0.113	4.271	75807	55.3	4.027	235	8.5	25.8	9.7	0.063	4747	4381	ma101107_rel.cz11c_bee
3989	18780	144	0.6	422.9	15.7	0.008	0.031	0.106	4.028	75746	55.4	4.033	236	6.6	22.4	6.5	0.022	4717	3981	ma101107_rel.cz11d_bee
3989	18863	143	0.6	436.6	15.7	0.008	0.030	0.109	4.031	76306	55.0	4.045	233	6.6	22.5	6.5	0.025	4715	4379	ma110401_rel.cz11b_bee
3989	18778	142	0.6	446.4	16.4	0.008	0.030	0.112	4.208	75524	55.1	4.022	235	8.6	25.8	9.7	0.024	4701	4315	ma110401_rel.cz11c_bee
3987	22694	121	0.5	653.2	23.5	0.005	0.021	0.164	6.046	92226	53.7	4.064	189	7.2	22.7	8.1	0.028	5721	4955	my5651_rel.cz11a_bee
3989	18429	0	0.0	540.2	20.1	0.000	0.000	0.135	5.172	74083	54.3	4.020	236	7.6	23.1	8.8	0.037	4667	3869	my5744_rel.cz11a_bee
3989	14562	0	0.0	795.2	24.8	0.000	0.000	0.199	6.372	59289	56.1	4.071	308	6.4	22.2	7.6	0.052	3660	3292	my8036_rel.cz11a_bee
3989	13780	0	0.0	1099.6	25.0	0.000	0.000	0.276	6.406	57443	60.4	4.169	351	6.4	22.2	7.6	0.051	3452	3117	my8036_rel.cz11b_bee
3989	13360	0	0.0	998.4	21.0	0.000	0.000	0.250	5.402	56876	63.4	4.257	380	6.4	22.2	6.9	0.143	3340	2972	my8036_rel.cz11c_bee
3989	14476	0	0.0	799.9	24.9	0.000	0.000	0.201	6.404	57958	55.7	4.004	308	6.4	22.2	7.6	0.047	3660	3228	my8036_rel.cz11d_bee
3989	18015	0	0.0	36.7	6.6	0.000	0.000	0.009	1.691	71694	54.2	3.980	241	9.2	35.2	4.7	0.032	4539	3931	pg162_def.cx9a2_bee

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
285714	0	1	0.0	1029.7	92.3	0.000	0.000	0.004	0.331	29836	70.8	0.104	20	2.1	18.0	2.2	0.150	80940	58636	ma100244_rel.cz11a_bee
219178	0	0	0.0	876.5	77.9	0.000	0.000	0.004	0.364	33696	78.0	0.154	28	2.1	18.0	2.7	0.154	60624	44251	ma100339_rel.cz11a_bee
219178	0	0	0.0	904.1	78.4	0.000	0.000	0.004	0.366	33638	78.5	0.153	29	2.1	18.0	NA	0.147	60709	46349	ma100433_rel.cz11a_bee
230216	0	0	0.0	1458.8	72.3	0.000	0.000	0.006	0.322	54636	72.4	0.237	25	2.1	18.0	2.3	0.146	63930	47648	ma100524_rel.cz11a_bee
248062	0	0	0.0	756.3	62.4	0.000	0.000	0.003	0.258	40632	73.6	0.164	24	2.1	18.0	2.3	0.217	69125	52843	ma100617_rel.cz11a_bee
251968	0	0	0.0	825.8	65.9	0.000	0.000	0.003	0.268	30027	73.1	0.119	23	2.1	18.0	2.3	0.196	70388	54159	ma101107_rel.cz11a_bee
197531	0	0	0.0	676.1	51.6	0.000	0.000	0.003	0.267	24320	58.4	0.123	24	2.1	18.0	2.3	19.505	68226	0	ma101107_rel.cz11b_bee
172973	0	0	0.0	200.7	45.5	0.000	0.000	0.001	0.269	21849	51.6	0.126	24	2.1	18.0	2.4	56.292	66428	0	ma101107_rel.cz11c_bee
251968	0	0	0.0	825.0	65.8	0.000	0.000	0.003	0.267	30437	73.1	0.121	23	2.1	18.0	2.3	0.191	69924	54141	ma101107_rel.cz11d_bee
250000	0	0	0.0	831.5	65.9	0.000	0.000	0.003	0.270	30993	73.2	0.124	23	2.1	18.0	2.3	0.200	69724	50046	ma110401_rel.cz11b_bee
206452	0	0	0.0	178.6	54.1	0.000	0.000	0.001	0.268	25945	61.2	0.126	24	2.1	18.0	2.4	11.218	68326	0	ma110401_rel.cz11c_bee
313725	0	99	0.4	820.5	91.1	0.000	0.001	0.003	0.297	31203	75.3	0.099	19	2.1	17.6	2.6	0.169	92030	75217	my5651_rel.cz11a_bee
262295	0	0	0.0	720.9	76.3	0.000	0.000	0.003	0.298	27796	69.7	0.106	21	2.1	17.7	3.0	0.173	74919	51843	my5744_rel.cz11a_bee
189349	0	0	0.0	783.5	62.1	0.000	0.000	0.004	0.336	22535	70.7	0.119	30	2.1	17.7	3.0	0.151	51344	41255	my8036_rel.cz11a_bee
182857	0	0	0.0	913.5	59.1	0.000	0.000	0.005	0.331	21225	69.8	0.116	31	2.1	17.7	3.0	0.165	50447	36061	my8036_rel.cz11b_bee
184971	0	0	0.0	586.7	56.1	0.000	0.000	0.003	0.311	20793	69.9	0.112	30	2.1	17.7	3.0	0.175	50745	34563	my8036_rel.cz11c_bee
189349	0	0	0.0	785.0	62.2	0.000	0.000	0.004	0.336	22374	71.0	0.118	30	2.1	17.7	3.0	0.157	51644	43652	my8036_rel.cz11d_bee
251968	0	0	0.0	294.6	106.3	0.000	0.000	0.001	0.432	24940	73.7	0.099	23	3.1	8.3	1.3	0.018	71523	58736	pg162_def.cx9a2_bee

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
603775	0	0	0.0	2291.6	453.7	0.000	0.000	0.004	0.769	19800	45.7	0.033	6	4.9	20.7	3.0	0.002	NA	NA	ma100244_rel.cz11a_bee
561405	0	0	0.0	2215.1	420.6	0.000	0.000	0.004	0.767	19957	46.6	0.036	7	4.9	20.7	2.9	0.002	NA	NA	ma100339_rel.cz11a_bee
592594	0	0	0.0	2288.0	446.9	0.000	0.000	0.004	0.772	18213	45.6	0.031	6	4.8	20.6	NA	0.002	NA	NA	ma100433_rel.cz11a_bee
516131	0	0	0.0	773.5	350.9	0.000	0.000	0.001	0.696	1920	44.8	0.004	7	4.8	20.6	5.0	0.002	NA	NA	ma100524_rel.cz11a_bee
470590	0	0	0.0	2583.4	351.8	0.000	0.000	0.005	0.766	8846	43.9	0.019	7	4.8	20.6	4.6	0.002	NA	NA	ma100617_rel.cz11a_bee
421054	0	0	0.0	2409.0	307.4	0.000	0.000	0.006	0.748	8497	41.3	0.020	8	4.8	20.6	4.4	0.002	NA	NA	ma101107_rel.cz11a_bee
463770	0	0	0.0	2475.2	329.4	0.000	0.000	0.005	0.727	8168	44.6	0.018	8	4.8	20.6	4.6	0.002	NA	NA	ma101107_rel.cz11b_bee
470590	0	0	0.0	832.6	347.9	0.000	0.000	0.002	0.757	8430	44.5	0.018	8	4.8	20.6	4.5	0.002	NA	NA	ma101107_rel.cz11c_bee
463770	0	0	0.0	2466.4	347.0	0.000	0.000	0.005	0.766	8053	44.1	0.017	8	4.8	20.6	4.6	0.002	NA	NA	ma101107_rel.cz11d_bee
421054	0	0	0.0	2302.8	305.9	0.000	0.000	0.005	0.744	7891	41.8	0.019	8	4.8	20.6	4.3	0.002	NA	NA	ma110401_rel.cz11b_bee
415586	0	0	0.0	726.8	304.7	0.000	0.000	0.002	0.751	7872	41.6	0.019	8	4.8	20.6	4.3	0.002	NA	NA	ma110401_rel.cz11c_bee
278262	0	0	0.0	2438.3	260.0	0.000	0.000	0.009	0.957	6583	39.1	0.024	11	4.5	20.0	4.5	0.002	NA	NA	my5651_rel.cz11a_bee
561405	0	0	0.0	6160.0	483.3	0.000	0.000	0.011	0.882	31387	45.2	0.056	6	4.9	20.4	3.2	0.002	NA	NA	my5744_rel.cz11a_bee
421054	0	2186	136.2	8559.0	427.2	0.005	0.331	0.020	1.039	25790	89.3	0.061	17	4.9	20.4	3.9	0.004	NA	NA	my8036_rel.cz11a_bee
58608	0	301	18.8	1604.5	61.8	0.005	0.328	0.027	1.080	13149	20.6	0.224	28	4.9	20.4	5.7	0.009	NA	NA	my8036_rel.cz11b_bee
34115	0	175	10.9	1091.6	36.7	0.005	0.328	0.032	1.103	12002	15.2	0.352	36	4.9	20.4	5.7	0.006	NA	NA	my8036_rel.cz11c_bee
400001	0	2055	127.9	8285.8	405.1	0.005	0.327	0.021	1.037	24713	89.4	0.062	18	4.9	20.4	3.4	0.007	NA	NA	my8036_rel.cz11d_bee
761907	0	0	0.0	563.4	249.9	0.000	0.000	0.001	0.336	2666	38.6	0.003	4	6.2	14.2	3.1	0.004	NA	NA	pg162_def.cx9a2_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
43278	0	0	0.0	5145.7	193.4	0.000	0.000	0.119	4.575	28072	85.4	0.649	158	7.8	23.9	8.9	0.128	10788	8038	ma100244_rel.cz11a_bee
48106	0	0	0.0	5105.7	190.4	0.000	0.000	0.106	4.054	29752	84.6	0.618	141	8.2	24.7	9.4	0.170	12086	8740	ma100339_rel.cz11a_bee
47591	0	0	0.0	5223.2	193.1	0.000	0.000	0.110	4.156	29832	84.5	0.627	142	8.2	24.7	NA	0.168	11937	8787	ma100433_rel.cz11a_bee
51184	0	0	0.0	9666.9	309.3	0.000	0.000	0.189	6.187	72506	84.6	1.417	132	8.2	25.6	9.4	1.234	13235	200	ma100524_rel.cz11a_bee
51249	0	0	0.0	6264.5	226.6	0.000	0.000	0.122	4.527	96959	80.6	1.892	126	6.7	22.7	6.8	0.342	12983	7841	ma100617_rel.cz11a_bee
48558	0	2074	8.1	5851.2	215.6	0.043	0.171	0.120	4.546	75160	75.3	1.548	124	6.7	22.5	6.6	0.294	12241	8239	ma101107_rel.cz11a_bee
40879	0	1767	6.9	5256.3	184.9	0.043	0.173	0.129	4.632	69802	66.4	1.708	130	6.7	22.9	6.6	0.515	10139	5394	ma101107_rel.cz11b_bee
38750	0	1430	5.6	3585.7	126.2	0.037	0.148	0.093	3.336	40856	59.5	1.054	123	8.5	25.8	10.2	1.143	10639	150	ma101107_rel.cz11c_bee
48324	0	2075	8.1	5865.6	215.7	0.043	0.172	0.121	4.570	75476	75.5	1.562	125	6.6	22.4	6.6	0.345	12191	7991	ma101107_rel.cz11d_bee
42941	0	1836	7.2	5427.5	192.4	0.043	0.171	0.126	4.589	70644	67.5	1.645	126	6.6	22.5	6.5	0.441	10788	6443	ma110401_rel.cz11b_bee
38647	0	1458	5.7	3473.1	123.6	0.038	0.151	0.090	3.274	39703	58.4	1.027	121	8.6	25.8	10.1	1.195	10039	200	ma110401_rel.cz11c_bee
32720	0	876	3.4	2814.6	120.1	0.027	0.107	0.086	3.758	29971	68.3	0.916	167	7.2	22.7	8.1	0.131	8191	6643	my5651_rel.cz11a_bee
43396	0	0	0.0	3674.4	155.7	0.000	0.000	0.085	3.674	24605	83.9	0.567	155	7.6	23.1	8.8	0.155	10888	9090	my5744_rel.cz11a_bee
25429	0	25	0.4	3283.1	120.2	0.001	0.015	0.129	4.840	21116	54.5	0.830	171	6.4	22.0	7.5	0.255	6341	3645	my8036_rel.cz11a_bee
20377	0	20	0.3	1119.5	50.7	0.001	0.015	0.055	2.546	16852	45.9	0.827	180	6.4	22.0	7.6	30.175	5596	0	my8036_rel.cz11b_bee
14981	0	3	0.1	880.9	36.8	0.000	0.009	0.059	2.517	17657	37.1	1.179	198	6.4	22.0	6.8	52.888	3496	0	my8036_rel.cz11c_bee
25584	0	25	0.4	3301.0	121.0	0.001	0.015	0.129	4.842	21217	54.5	0.829	170	6.4	22.0	7.6	0.227	6343	3499	my8036_rel.cz11d_bee
69055	0	63	0.3	301.5	76.3	0.001	0.004	0.004	1.131	23358	86.7	0.338	100	9.1	49.1	2.9	0.051	16632	8391	pg162_def.cx9a2_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19990	0	0	0.0	3093.2	118.1	0.000	0.000	0.155	6.050	64983	81.3	3.251	325	7.8	23.9	8.9	0.090	5001	3713	ma100244_rel.cz11a_bee
20090	0	0	0.0	3522.5	132.3	0.000	0.000	0.175	6.744	66595	79.5	3.315	317	8.2	24.7	9.5	0.078	5084	3511	ma100339_rel.cz11a_bee
19920	0	0	0.0	3388.3	127.3	0.000	0.000	0.170	6.543	65692	79.6	3.298	320	8.2	24.7	NA	0.080	5084	3361	ma100433_rel.cz11a_bee
22522	0	0	0.0	9827.6	313.3	0.000	0.000	0.436	14.245	108549	81.1	4.820	288	8.2	25.6	9.4	0.072	5734	190	ma100524_rel.cz11a_bee
24891	0	0	0.0	2830.8	106.5	0.000	0.000	0.114	4.379	91358	79.4	3.670	255	6.7	22.7	6.7	0.066	6213	5504	ma100617_rel.cz11a_bee
22222	0	3118	12.2	2641.7	99.3	0.140	0.561	0.119	4.576	93789	73.6	4.221	265	6.7	22.5	6.5	0.145	5572	5049	ma101107_rel.cz11a_bee
21918	0	3078	12.0	2678.2	97.5	0.140	0.562	0.122	4.554	93517	72.6	4.267	265	6.7	22.9	6.5	0.237	5529	4215	ma101107_rel.cz11b_bee
19465	0	2765	10.8	2411.0	89.6	0.142	0.568	0.124	4.715	81767	65.7	4.201	270	8.5	25.8	10.5	0.283	5226	180	ma101107_rel.cz11c_bee
22112	0	3104	12.1	2633.4	98.9	0.140	0.561	0.119	4.582	93581	73.7	4.232	267	6.6	22.4	6.5	0.109	5546	4900	ma101107_rel.cz11d_bee
21751	0	3051	11.9	2661.6	96.8	0.140	0.561	0.122	4.556	92713	71.9	4.263	264	6.6	22.5	6.5	0.138	5507	4581	ma110401_rel.cz11b_bee
19812	0	2820	11.0	2526.7	93.7	0.142	0.569	0.128	4.841	83058	67.4	4.192	272	8.6	25.8	10.4	0.228	5199	170	ma110401_rel.cz11c_bee
16577	0	2761	10.8	1762.9	71.8	0.167	0.666	0.106	4.433	63889	73.8	3.854	356	7.2	22.7	8.1	0.124	4145	3566	my5651_rel.cz11a_bee
19455	0	0	0.0	2033.7	83.8	0.000	0.000	0.105	4.413	62521	77.1	3.214	317	7.6	23.1	8.8	0.086	4854	4345	my5744_rel.cz11a_bee
12001	0	0	0.0	1835.3	63.6	0.000	0.000	0.153	5.429	45020	55.4	3.751	369	6.4	22.0	7.6	0.133	3001	1869	my8036_rel.cz11a_bee
11419	0	0	0.0	769.6	30.4	0.000	0.000	0.067	2.724	40710	53.3	3.565	373	6.4	22.0	7.6	0.169	2852	1798	my8036_rel.cz11b_bee
11096	0	0	0.0	656.6	27.1	0.000	0.000	0.059	2.501	42667	55.3	3.845	399	6.4	22.0	6.8	21.851	2782	644	my8036_rel.cz11c_bee
12023	0	0	0.0	1776.6	62.2	0.000	0.000	0.148	5.297	44918	55.4	3.736	369	6.4	22.0	7.6	0.130	2986	1837	my8036_rel.cz11d_bee
11047	0	0	0.0	51.3	11.7	0.000	0.000	0.005	1.082	38043	70.9	3.444	513	9.1	49.1	0.1	0.019	2233	1309	pg162_def.cx9a2_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	18411	0	0.0	3088.2	93.7	0.000	0.000	7.748	240.587	81123	51.5	4.406	224	7.8	23.9	8.8	0.027	4557	3981	ma100244_rel.cz11a_bee
399	17720	0	0.0	3108.2	94.3	0.000	0.000	7.798	242.162	78282	51.5	4.418	232	8.2	24.7	9.5	0.029	4475	3836	ma100339_rel.cz11a_bee
399	16424	0	0.0	3103.8	94.1	0.000	0.000	7.787	241.813	73544	51.5	4.478	251	8.2	24.7	NA	0.026	4139	3614	ma100433_rel.cz11a_bee
399	15786	0	0.0	2.2	0.4	0.000	0.000	0.006	1.104	61249	50.7	3.880	257	8.2	25.6	9.4	0.010	3948	3468	ma100524_rel.cz11a_bee
399	16040	0	0.0	13.8	0.8	0.000	0.000	0.035	1.952	61166	51.1	3.813	255	6.7	22.7	6.7	0.009	3964	3438	ma100617_rel.cz11a_bee
399	16259	10	0.0	9.3	0.6	0.001	0.003	0.023	1.645	61983	50.9	3.812	250	6.7	22.5	6.5	0.008	4029	3532	ma101107_rel.cz11a_bee
399	16028	14	0.1	8.2	0.6	0.001	0.003	0.021	1.524	61135	50.9	3.814	254	6.7	22.9	6.5	0.010	3996	3500	ma101107_rel.cz11b_bee
399	15989	12	0.0	2.2	0.4	0.001	0.003	0.006	1.131	60944	50.9	3.812	255	8.5	25.8	9.7	0.011	3980	3484	ma101107_rel.cz11c_bee
399	16092	12	0.0	19.7	0.9	0.001	0.003	0.049	2.406	61430	51.0	3.818	254	6.6	22.4	6.5	0.012	4012	3500	ma101107_rel.cz11d_bee
399	16142	11	0.0	13.7	0.8	0.001	0.003	0.034	1.933	61560	51.0	3.814	253	6.6	22.5	6.5	0.009	4013	3564	ma110401_rel.cz11b_bee
399	15965	12	0.0	7.5	0.6	0.001	0.003	0.019	1.538	60867	50.9	3.813	255	8.6	25.8	9.7	0.015	3947	3468	ma110401_rel.cz11c_bee
399	25385	14	0.1	348.8	10.9	0.001	0.002	0.875	27.937	97440	50.4	3.839	159	7.2	22.7	8.1	0.021	6361	5786	my5651_rel.cz11a_bee
399	20161	0	0.0	467.7	14.4	0.000	0.000	1.173	36.977	78143	51.4	3.876	204	7.6	23.1	8.8	0.012	5034	4332	my5744_rel.cz11a_bee
399	17519	0	0.0	528.2	13.6	0.000	0.000	1.324	34.977	68313	51.1	3.899	233	6.4	22.0	7.6	0.012	4331	3612	my8036_rel.cz11a_bee
399	17494	0	0.0	212.0	4.1	0.000	0.000	0.532	10.529	67566	51.4	3.862	235	6.4	22.0	7.6	0.045	4459	3534	my8036_rel.cz11b_bee
399	18224	0	0.0	247.4	4.2	0.000	0.000	0.620	10.860	69987	52.4	3.840	230	6.4	22.0	6.9	0.145	4613	3676	my8036_rel.cz11c_bee
399	17496	0	0.0	485.1	12.5	0.000	0.000	1.216	32.214	68145	51.2	3.895	234	6.4	22.0	7.6	0.013	4267	3548	my8036_rel.cz11d_bee
399	47802	0	0.0	11.3	1.4	0.000	0.000	0.028	3.664	182094	50.4	3.809	84	9.1	47.5	2.9	0.008	12003	10405	pg162_def.cx9a2_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	20957	0	0.0	3079.6	93.4	0.000	0.000	7.722	239.790	93836	52.3	4.478	200	7.8	23.9	8.9	0.021	5273	4667	ma100244_rel.cz11a_bee
399	19830	0	0.0	3086.7	93.6	0.000	0.000	7.740	240.375	88523	52.2	4.464	211	8.2	24.7	9.5	0.022	5021	4316	ma100339_rel.cz11a_bee
399	18731	0	0.0	3089.4	93.7	0.000	0.000	7.747	240.574	82779	52.1	4.419	223	8.2	24.7	NA	0.021	4811	4171	ma100433_rel.cz11a_bee
399	18452	0	0.0	2.3	0.4	0.000	0.000	0.006	1.099	69106	50.6	3.745	219	8.2	25.6	9.4	0.008	4619	4299	ma100524_rel.cz11a_bee
399	19524	0	0.0	25.4	1.1	0.000	0.000	0.064	2.806	77448	50.9	3.967	209	6.7	22.7	6.7	0.008	4955	3996	ma100617_rel.cz11a_bee
399	19804	13	0.1	21.2	1.0	0.001	0.003	0.053	2.520	78848	51.0	3.981	206	6.7	22.5	6.5	0.008	4981	4509	ma101107_rel.cz11a_bee
399	18924	14	0.1	20.0	0.9	0.001	0.003	0.050	2.391	74496	50.7	3.937	214	6.7	22.9	6.6	0.010	4797	3948	ma101107_rel.cz11b_bee
399	19178	13	0.0	2.6	0.5	0.001	0.003	0.007	1.158	75669	50.7	3.946	211	8.5	25.8	9.7	0.012	4908	3916	ma101107_rel.cz11c_bee
399	19075	14	0.1	25.4	1.1	0.001	0.003	0.064	2.834	75405	50.7	3.953	213	6.6	22.4	6.5	0.009	4891	3964	ma101107_rel.cz11d_bee
399	19489	14	0.1	26.1	1.1	0.001	0.003	0.066	2.833	77240	50.7	3.963	208	6.6	22.5	6.5	0.010	5003	4014	ma110401_rel.cz11b_bee
399	18185	12	0.0	9.8	0.7	0.001	0.003	0.024	1.688	70867	50.4	3.897	222	8.6	25.8	9.7	0.010	4539	3853	ma110401_rel.cz11c_bee
399	23759	14	0.1	2.2	0.4	0.001	0.002	0.005	1.087	93639	49.4	3.941	166	7.2	22.7	8.1	0.012	6089	4813	my5651_rel.cz11a_bee
399	19410	0	0.0	39.4	1.4	0.000	0.000	0.099	3.661	76196	50.3	3.926	207	7.6	23.1	8.8	0.012	4891	4123	my5744_rel.cz11a_bee
399	15251	0	0.0	67.4	2.1	0.000	0.000	0.169	5.481	59346	50.3	3.891	264	6.4	22.1	7.6	0.010	3901	3356	my8036_rel.cz11a_bee
399	15441	0	0.0	150.2	3.3	0.000	0.000	0.377	8.443	61754	51.0	3.999	264	6.4	22.1	7.6	0.012	3900	3436	my8036_rel.cz11b_bee
399	15200	0	0.0	180.3	3.4	0.000	0.000	0.452	8.757	60092	51.8	3.953	273	6.4	22.1	6.9	0.015	3852	3372	my8036_rel.cz11c_bee
399	15584	0	0.0	71.9	2.2	0.000	0.000	0.180	5.760	61752	50.4	3.962	259	6.4	22.1	7.6	0.012	3944	3420	my8036_rel.cz11d_bee
399	18923	0	0.0	33.9	3.2	0.000	0.000	0.085	8.296	75162	51.8	3.972	219	9.1	45.5	2.7	0.008	4779	4491	pg162_def.cx9a2_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	17799	0	0.0	10070.0	306.3	0.000	0.000	5.049	157.263	100743	55.2	5.660	248	7.8	23.9	8.9	0.036	4443	3900	ma100244_rel.cz11a_bee
1994	17258	0	0.0	10156.1	309.0	0.000	0.000	5.092	158.631	98427	55.3	5.703	256	8.2	24.7	9.5	0.056	4363	3821	ma100339_rel.cz11a_bee
1994	16258	0	0.0	10116.6	307.8	0.000	0.000	5.073	158.016	94381	55.3	5.805	272	8.2	24.7	NA	0.038	4091	3548	ma100433_rel.cz11a_bee
1993	15725	0	0.0	6.8	2.1	0.000	0.000	0.003	1.084	61188	52.0	3.891	265	8.2	25.6	9.4	0.025	3933	3404	ma100524_rel.cz11a_bee
1994	16238	0	0.0	230.0	8.3	0.000	0.000	0.115	4.276	62263	52.4	3.835	258	6.7	22.7	6.7	0.020	4075	3502	ma100617_rel.cz11a_bee
1993	16269	72	0.3	240.5	8.7	0.004	0.018	0.121	4.455	62602	52.6	3.848	259	6.7	22.5	6.5	0.024	4044	3532	ma101107_rel.cz11a_bee
1994	16138	73	0.3	245.5	8.6	0.005	0.018	0.123	4.429	62149	52.5	3.851	260	6.7	22.9	6.6	0.042	4013	3468	ma101107_rel.cz11b_bee
1993	16099	73	0.3	260.1	9.4	0.005	0.018	0.130	4.817	61896	52.4	3.845	260	8.5	25.8	9.7	0.121	4012	3436	ma101107_rel.cz11c_bee
1994	16294	72	0.3	227.2	8.3	0.004	0.018	0.114	4.258	62675	52.7	3.846	259	6.6	22.4	6.5	0.019	4076	3516	ma101107_rel.cz11d_bee
1993	16469	73	0.3	236.5	8.4	0.004	0.018	0.119	4.293	63307	52.5	3.844	255	6.6	22.5	6.5	0.031	4093	3582	ma110401_rel.cz11b_bee
1994	16356	73	0.3	250.0	9.0	0.004	0.018	0.125	4.644	62742	52.6	3.836	257	8.6	25.8	9.7	0.073	4059	3516	ma110401_rel.cz11c_bee
1993	25032	62	0.2	697.1	22.9	0.002	0.010	0.350	11.775	95269	52.9	3.806	169	7.2	22.7	8.1	0.037	6249	5626	my5651_rel.cz11a_bee
1994	20016	0	0.0	282.3	10.4	0.000	0.000	0.142	5.328	75169	53.6	3.755	214	7.6	23.1	8.8	0.026	4957	4285	my5744_rel.cz11a_bee
1993	17092	0	0.0	421.4	13.0	0.000	0.000	0.211	6.662	65399	53.4	3.826	250	6.4	22.1	7.6	0.030	4315	3550	my8036_rel.cz11a_bee
1994	17524	0	0.0	508.0	12.0	0.000	0.000	0.255	6.146	67449	55.5	3.849	253	6.4	22.1	7.6	0.093	4475	3628	my8036_rel.cz11b_bee
1994	17884	0	0.0	585.3	12.0	0.000	0.000	0.293	6.155	69173	57.9	3.868	259	6.4	22.1	6.9	0.102	4573	3662	my8036_rel.cz11c_bee
1994	17152	0	0.0	414.4	12.8	0.000	0.000	0.208	6.549	65770	53.5	3.835	250	6.4	22.1	7.6	0.041	4331	3580	my8036_rel.cz11d_bee
1994	44971	0	0.0	62.0	4.5	0.000	0.000	0.031	2.329	169727	51.6	3.774	92	9.1	43.4	8.2	0.034	11523	8519	pg162_def.cx9a2_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	19513	0	0.0	10282.8	312.7	0.000	0.000	5.156	160.562	108909	57.3	5.581	235	7.8	23.9	8.8	0.029	4910	4459	ma100244_rel.cz11a_bee
1994	18796	0	0.0	10284.9	312.9	0.000	0.000	5.157	160.632	106146	57.2	5.647	243	8.2	24.7	9.5	0.022	4731	4299	ma100339_rel.cz11a_bee
1994	18135	0	0.0	10297.2	313.2	0.000	0.000	5.163	160.820	103790	57.2	5.723	252	8.2	24.7	NA	0.030	4571	4155	ma100433_rel.cz11a_bee
1994	18167	0	0.0	6.8	2.1	0.000	0.000	0.003	1.089	67912	52.8	3.738	233	8.2	25.6	9.4	0.029	4539	4221	ma100524_rel.cz11a_bee
1994	19138	0	0.0	202.1	7.5	0.000	0.000	0.101	3.863	76986	52.3	4.023	219	6.7	22.7	6.7	0.017	4843	4379	ma100617_rel.cz11a_bee
1994	19191	74	0.3	195.9	7.4	0.004	0.015	0.098	3.802	77261	52.4	4.026	218	6.7	22.5	6.5	0.019	4827	4395	ma101107_rel.cz11a_bee
1993	19189	74	0.3	202.0	7.4	0.004	0.015	0.101	3.810	77308	52.4	4.029	218	6.7	22.9	6.5	0.018	4855	4411	ma101107_rel.cz11b_bee
1994	19213	73	0.3	193.6	7.5	0.004	0.015	0.097	3.827	77145	52.5	4.015	219	8.5	25.8	9.7	0.017	4829	4427	ma101107_rel.cz11c_bee
1994	19208	73	0.3	211.7	7.8	0.004	0.015	0.106	4.025	77412	52.4	4.030	218	6.6	22.4	6.5	0.018	4859	4395	ma101107_rel.cz11d_bee
1994	19158	73	0.3	204.8	7.5	0.004	0.015	0.103	3.842	77112	52.2	4.025	218	6.6	22.5	6.5	0.018	4813	4331	ma110401_rel.cz11b_bee
1994	19168	73	0.3	200.1	7.6	0.004	0.015	0.100	3.903	76974	52.3	4.016	218	8.6	25.8	9.7	0.040	4859	4301	ma110401_rel.cz11c_bee
1994	22473	63	0.2	540.2	18.2	0.003	0.011	0.271	9.344	89973	51.1	4.004	182	7.2	22.7	8.1	0.017	5674	4699	my5651_rel.cz11a_bee
1994	19275	0	0.0	262.0	9.8	0.000	0.000	0.131	5.015	76572	52.2	3.973	217	7.6	23.1	8.8	0.027	4891	4046	my5744_rel.cz11a_bee
1993	15105	0	0.0	408.4	12.7	0.000	0.000	0.205	6.507	60736	53.1	4.021	281	6.4	22.1	7.6	0.028	3819	3374	my8036_rel.cz11a_bee
1994	14684	0	0.0	542.8	12.6	0.000	0.000	0.272	6.487	59490	55.3	4.051	301	6.4	22.1	7.6	0.042	3700	3276	my8036_rel.cz11b_bee
1994	14462	0	0.0	620.0	12.6	0.000	0.000	0.311	6.457	59914	58.2	4.143	322	6.4	22.1	6.9	0.054	3628	3117	my8036_rel.cz11c_bee
1994	15134	0	0.0	400.6	12.5	0.000	0.000	0.201	6.408	60329	53.0	3.986	280	6.4	22.1	7.6	0.029	3836	3358	my8036_rel.cz11d_bee
1993	18423	0	0.0	30.2	4.9	0.000	0.000	0.015	2.492	73251	52.8	3.976	229	9.1	39.3	7.2	0.022	4637	4203	pg162_def.cx9a2_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	17320	0	0.0	10190.0	312.0	0.000	0.000	2.555	80.088	98566	57.7	5.691	267	7.8	23.9	8.8	0.037	4365	3852	ma100244_rel.cz11a_bee
3987	16575	0	0.0	10529.8	322.4	0.000	0.000	2.641	82.798	97344	57.5	5.873	278	8.2	24.7	9.5	0.042	4187	3644	ma100339_rel.cz11a_bee
3989	15744	0	0.0	10405.4	318.6	0.000	0.000	2.609	81.784	93425	57.7	5.934	293	8.2	24.7	NA	0.051	3996	3470	ma100433_rel.cz11a_bee
3989	15412	0	0.0	5361.8	163.1	0.000	0.000	1.344	41.873	84473	55.3	5.481	287	8.2	25.6	9.4	0.031	3852	3308	ma100524_rel.cz11a_bee
3989	15971	0	0.0	401.7	15.0	0.000	0.000	0.101	3.847	62072	54.2	3.886	271	6.7	22.7	6.7	0.028	4012	3452	ma100617_rel.cz11a_bee
3989	15856	137	0.5	425.7	15.8	0.009	0.035	0.107	4.053	61745	54.3	3.894	274	6.7	22.5	6.5	0.025	3931	3420	ma101107_rel.cz11a_bee
3989	15676	135	0.5	436.5	15.7	0.009	0.034	0.109	4.035	61213	54.2	3.905	277	6.7	22.9	6.5	0.077	3933	3404	ma101107_rel.cz11b_bee
3989	15638	136	0.5	456.3	16.8	0.009	0.035	0.114	4.301	60982	54.0	3.899	276	8.5	25.8	9.7	0.103	3900	3276	ma101107_rel.cz11c_bee
3989	15793	130	0.5	422.5	15.7	0.008	0.033	0.106	4.032	61493	54.3	3.894	275	6.6	22.4	6.5	0.040	3964	3404	ma101107_rel.cz11d_bee
3989	15856	138	0.5	442.3	15.9	0.009	0.035	0.111	4.070	61653	54.2	3.888	273	6.6	22.5	6.5	0.028	3966	3422	ma110401_rel.cz11b_bee
3989	15816	136	0.5	456.5	16.7	0.009	0.034	0.114	4.282	61309	54.4	3.876	275	8.6	25.8	9.7	0.128	3996	3422	ma110401_rel.cz11c_bee
3989	24346	114	0.4	750.2	26.5	0.005	0.019	0.188	6.790	91301	55.4	3.750	182	7.2	22.7	8.1	0.058	6025	5418	my5651_rel.cz11a_bee
3989	19462	0	0.0	541.4	20.2	0.000	0.000	0.136	5.180	71655	56.5	3.682	232	7.6	23.1	8.8	0.046	4893	4141	my5744_rel.cz11a_bee
3989	16872	0	0.0	796.8	24.9	0.000	0.000	0.200	6.384	64385	56.4	3.816	267	6.4	22.1	7.6	0.048	4299	3564	my8036_rel.cz11a_bee
3987	17422	0	0.0	1111.1	25.2	0.000	0.000	0.279	6.462	67731	60.7	3.888	279	6.4	22.1	7.6	0.083	4413	3644	my8036_rel.cz11b_bee
3989	17538	0	0.0	1013.5	21.3	0.000	0.000	0.254	5.458	68662	63.6	3.915	290	6.4	22.1	6.9	0.117	4427	3772	my8036_rel.cz11c_bee
3989	16875	0	0.0	799.7	24.9	0.000	0.000	0.200	6.403	64621	56.4	3.829	267	6.4	22.1	7.6	0.052	4251	3518	my8036_rel.cz11d_bee
3989	42631	0	0.0	36.6	6.3	0.000	0.000	0.009	1.619	159741	52.9	3.747	99	9.1	36.7	4.0	0.036	10948	8215	pg162_def.cx9a2_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	18897	0	0.0	10547.4	322.7	0.000	0.000	2.644	82.850	104909	60.2	5.552	255	7.8	23.9	8.8	0.042	4747	4283	ma100244_rel.cz11a_bee
3987	18093	0	0.0	10694.4	327.3	0.000	0.000	2.683	84.066	102940	60.1	5.689	266	8.2	24.7	9.5	0.038	4525	4123	ma100339_rel.cz11a_bee
3989	17476	0	0.0	10701.6	327.5	0.000	0.000	2.683	84.079	100649	60.1	5.759	275	8.2	24.7	NA	0.033	4411	4012	ma100433_rel.cz11a_bee
3989	17035	0	0.0	10275.7	310.7	0.000	0.000	2.576	79.760	109689	58.3	6.439	274	8.2	25.6	9.4	0.030	4283	3947	ma100524_rel.cz11a_bee
3989	18966	0	0.0	423.2	15.6	0.000	0.000	0.106	4.010	76387	55.1	4.028	232	6.7	22.7	6.7	0.029	4763	4474	ma100617_rel.cz11a_bee
3989	18791	139	0.5	420.7	15.6	0.007	0.030	0.105	4.009	75952	55.2	4.042	235	6.7	22.5	6.5	0.016	4715	4413	ma101107_rel.cz11a_bee
3989	18808	141	0.6	440.2	15.8	0.007	0.030	0.110	4.060	76093	55.2	4.046	235	6.7	22.9	6.5	0.020	4731	4381	ma101107_rel.cz11b_bee
3989	18826	140	0.5	452.7	16.6	0.007	0.030	0.113	4.271	75807	55.3	4.027	235	8.5	25.8	9.7	0.063	4747	4381	ma101107_rel.cz11c_bee
3989	18780	144	0.6	422.9	15.7	0.008	0.031	0.106	4.028	75746	55.4	4.033	236	6.6	22.4	6.5	0.022	4717	3981	ma101107_rel.cz11d_bee
3989	18863	143	0.6	436.6	15.7	0.008	0.030	0.109	4.031	76306	55.0	4.045	233	6.6	22.5	6.5	0.025	4715	4379	ma110401_rel.cz11b_bee
3989	18778	142	0.6	446.4	16.4	0.008	0.030	0.112	4.208	75524	55.1	4.022	235	8.6	25.8	9.7	0.024	4701	4315	ma110401_rel.cz11c_bee
3987	22694	121	0.5	653.2	23.5	0.005	0.021	0.164	6.046	92226	53.7	4.064	189	7.2	22.7	8.1	0.028	5721	4955	my5651_rel.cz11a_bee
3989	18429	0	0.0	540.2	20.1	0.000	0.000	0.135	5.172	74083	54.3	4.020	236	7.6	23.1	8.8	0.037	4667	3869	my5744_rel.cz11a_bee
3989	14562	0	0.0	795.2	24.8	0.000	0.000	0.199	6.372	59289	56.1	4.071	308	6.4	22.2	7.6	0.052	3660	3292	my8036_rel.cz11a_bee
3989	13780	0	0.0	1099.6	25.0	0.000	0.000	0.276	6.406	57443	60.4	4.169	351	6.4	22.2	7.6	0.051	3452	3117	my8036_rel.cz11b_bee
3989	13360	0	0.0	998.4	21.0	0.000	0.000	0.250	5.402	56876	63.4	4.257	380	6.4	22.2	6.9	0.143	3340	2972	my8036_rel.cz11c_bee
3989	14476	0	0.0	799.9	24.9	0.000	0.000	0.201	6.404	57958	55.7	4.004	308	6.4	22.2	7.6	0.047	3660	3228	my8036_rel.cz11d_bee
3989	18015	0	0.0	36.7	6.6	0.000	0.000	0.009	1.691	71694	54.2	3.980	241	9.2	35.2	4.7	0.032	4539	3931	pg162_def.cx9a2_bee

l.i0

l.i0: load without secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	12.431	86.986	0.549	0.017	0.016	0.000	0.000	0.000	0.000	0.150	ma100244_rel.cz11a_bee
0.000	1.176	97.269	1.509	0.029	0.016	0.000	0.000	0.000	0.000	0.154	ma100339_rel.cz11a_bee
0.000	0.385	98.043	1.526	0.030	0.016	0.000	0.000	0.000	0.000	0.147	ma100433_rel.cz11a_bee
0.000	0.961	97.745	1.038	0.236	0.020	0.000	0.000	0.000	0.000	0.146	ma100524_rel.cz11a_bee
0.000	0.795	96.750	2.400	0.034	0.020	0.000	0.000	0.000	0.000	0.217	ma100617_rel.cz11a_bee
0.000	3.082	94.691	2.171	0.037	0.019	0.000	0.000	0.000	0.000	0.196	ma101107_rel.cz11a_bee
0.000	2.473	95.289	2.143	0.075	0.017	0.000	0.000	0.001	0.001	19.505	ma101107_rel.cz11b_bee
0.000	2.562	95.150	2.202	0.065	0.017	0.001	0.000	0.001	0.001	56.292	ma101107_rel.cz11c_bee
0.000	2.832	94.928	2.173	0.048	0.019	0.000	0.000	0.000	0.000	0.191	ma101107_rel.cz11d_bee
0.000	2.108	95.707	2.125	0.040	0.019	0.000	0.000	0.000	0.000	0.200	ma110401_rel.cz11b_bee
0.000	1.565	96.262	2.029	0.121	0.018	0.001	0.000	0.004	0.000	11.218	ma110401_rel.cz11c_bee
0.000	60.494	39.257	0.135	0.107	0.006	0.000	0.000	0.000	0.000	0.169	my5651_rel.cz11a_bee
0.000	0.289	99.199	0.391	0.115	0.006	0.000	0.000	0.000	0.000	0.173	my5744_rel.cz11a_bee
0.000	0.000	99.246	0.613	0.130	0.012	0.000	0.000	0.000	0.000	0.151	my8036_rel.cz11a_bee
0.000	0.000	98.876	0.985	0.105	0.034	0.000	0.000	0.000	0.000	0.165	my8036_rel.cz11b_bee
0.000	0.000	98.977	0.861	0.146	0.017	0.000	0.000	0.000	0.000	0.175	my8036_rel.cz11c_bee
0.000	0.000	99.229	0.645	0.115	0.011	0.000	0.000	0.000	0.000	0.157	my8036_rel.cz11d_bee
0.000	0.000	99.907	0.093	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	pg162_def.cx9a2_bee

l.x

l.x: create secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

TODO - determine whether there is data for create index response time

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	62.852	35.788	1.359	0.001	0.000	0.000	0.000	0.000	0.128	ma100244_rel.cz11a_bee
0.000	0.000	71.086	28.018	0.890	0.006	0.000	0.000	0.000	0.000	0.170	ma100339_rel.cz11a_bee
0.000	0.000	70.290	28.778	0.927	0.005	0.000	0.000	0.000	0.000	0.168	ma100433_rel.cz11a_bee
0.000	0.000	72.617	27.129	0.196	0.015	0.043	nonzero	0.000	0.000	1.234	ma100524_rel.cz11a_bee
0.000	0.000	65.785	34.034	0.168	0.013	nonzero	0.000	0.000	0.000	0.342	ma100617_rel.cz11a_bee
0.000	0.000	63.882	35.728	0.380	0.010	nonzero	0.000	0.000	0.000	0.294	ma101107_rel.cz11a_bee
0.000	0.000	62.906	33.202	3.859	0.032	0.001	0.000	0.000	0.000	0.515	ma101107_rel.cz11b_bee
0.000	0.000	80.939	15.100	3.350	0.537	0.074	nonzero	0.000	0.000	1.143	ma101107_rel.cz11c_bee
0.000	0.000	63.224	36.385	0.381	0.009	nonzero	0.000	0.000	0.000	0.345	ma101107_rel.cz11d_bee
0.000	0.000	65.331	31.546	3.101	0.022	nonzero	0.000	0.000	0.000	0.441	ma110401_rel.cz11b_bee
0.000	0.000	82.573	13.304	3.484	0.565	0.073	nonzero	0.000	0.000	1.195	ma110401_rel.cz11c_bee
0.000	0.000	39.432	57.402	3.158	0.009	0.000	0.000	0.000	0.000	0.131	my5651_rel.cz11a_bee
0.000	0.000	59.486	39.700	0.807	0.008	0.000	0.000	0.000	0.000	0.155	my5744_rel.cz11a_bee
0.000	0.000	55.537	40.393	0.927	3.142	0.000	0.000	0.000	0.000	0.255	my8036_rel.cz11a_bee
0.000	0.000	57.684	37.090	1.973	3.094	0.095	0.061	0.001	0.001	30.175	my8036_rel.cz11b_bee
0.000	0.000	61.403	32.586	2.305	2.984	0.594	0.128	0.000	0.001	52.888	my8036_rel.cz11c_bee
0.000	0.000	55.878	40.169	0.821	3.132	0.000	0.000	0.000	0.000	0.227	my8036_rel.cz11d_bee
0.000	0.000	95.633	4.353	0.015	0.000	0.000	0.000	0.000	0.000	0.051	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	64.067	34.791	1.141	0.001	0.000	0.000	0.000	0.000	0.130	ma100244_rel.cz11a_bee
0.000	0.000	72.320	26.911	0.763	0.006	0.000	0.000	0.000	0.000	0.165	ma100339_rel.cz11a_bee
0.000	0.000	71.681	27.516	0.798	0.005	0.000	0.000	0.000	0.000	0.170	ma100433_rel.cz11a_bee
0.000	0.000	75.498	24.289	0.156	0.014	0.043	0.000	0.000	0.000	0.993	ma100524_rel.cz11a_bee
0.000	0.000	85.049	14.845	0.096	0.010	nonzero	0.000	0.000	0.000	0.341	ma100617_rel.cz11a_bee
0.000	0.000	77.259	22.493	0.240	0.008	nonzero	0.000	0.000	0.000	0.293	ma101107_rel.cz11a_bee
0.000	0.000	76.929	19.992	3.054	0.024	nonzero	0.000	0.000	0.000	0.352	ma101107_rel.cz11b_bee
0.000	nonzero	86.025	10.400	3.020	0.480	0.074	0.000	0.000	0.000	0.911	ma101107_rel.cz11c_bee
0.000	0.000	77.090	22.669	0.233	0.008	nonzero	0.000	0.000	0.000	0.339	ma101107_rel.cz11d_bee
0.000	0.000	75.804	21.729	2.449	0.017	nonzero	0.000	0.000	0.000	0.324	ma110401_rel.cz11b_bee
0.000	nonzero	86.591	9.631	3.196	0.510	0.072	0.000	0.000	0.000	0.910	ma110401_rel.cz11c_bee
0.000	0.000	55.950	41.811	2.232	0.007	0.000	0.000	0.000	0.000	0.141	my5651_rel.cz11a_bee
0.000	0.000	63.085	36.320	0.588	0.007	0.000	0.000	0.000	0.000	0.155	my5744_rel.cz11a_bee
0.000	0.000	63.931	32.348	0.726	2.995	0.000	0.000	0.000	0.000	0.216	my8036_rel.cz11a_bee
0.000	0.000	67.395	28.024	1.552	2.885	0.086	0.056	0.001	0.001	30.167	my8036_rel.cz11b_bee
0.000	0.000	70.947	23.831	1.825	2.740	0.542	0.114	nonzero	0.001	52.887	my8036_rel.cz11c_bee
0.000	0.000	64.394	31.988	0.642	2.976	0.000	0.000	0.000	0.000	0.214	my8036_rel.cz11d_bee
0.000	4.255	87.872	7.861	0.012	0.000	0.000	0.000	0.000	0.000	0.043	pg162_def.cx9a2_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.003	78.024	20.126	1.835	0.011	0.001	0.000	0.000	0.000	0.000	0.090	ma100244_rel.cz11a_bee
0.003	79.533	18.417	2.012	0.034	0.001	0.000	0.000	0.000	0.000	0.078	ma100339_rel.cz11a_bee
0.001	79.009	18.998	1.950	0.040	0.001	0.000	0.000	0.000	0.000	0.080	ma100433_rel.cz11a_bee
0.012	82.944	16.327	0.650	0.065	nonzero	0.000	0.000	0.000	0.000	0.072	ma100524_rel.cz11a_bee
0.014	87.824	11.224	0.933	0.004	nonzero	0.000	0.000	0.000	0.000	0.066	ma100617_rel.cz11a_bee
0.011	82.903	15.979	1.102	0.004	0.001	0.000	0.000	0.000	0.000	0.145	ma101107_rel.cz11a_bee
0.072	83.677	14.958	1.227	0.065	0.001	0.000	0.000	0.000	0.000	0.237	ma101107_rel.cz11b_bee
0.348	85.303	12.647	1.099	0.590	0.013	nonzero	0.000	0.000	0.000	0.283	ma101107_rel.cz11c_bee
0.008	82.505	16.379	1.103	0.003	0.001	0.000	0.000	0.000	0.000	0.109	ma101107_rel.cz11d_bee
0.141	84.496	14.001	1.244	0.117	0.002	0.000	0.000	0.000	0.000	0.138	ma110401_rel.cz11b_bee
0.274	84.559	13.507	1.185	0.465	0.010	0.000	0.000	0.000	0.000	0.228	ma110401_rel.cz11c_bee
0.070	67.806	29.847	2.148	0.129	0.001	0.000	0.000	0.000	0.000	0.124	my5651_rel.cz11a_bee
0.001	74.357	24.157	1.475	0.009	0.001	0.000	0.000	0.000	0.000	0.086	my5744_rel.cz11a_bee
0.000	64.766	33.169	1.550	0.016	0.498	0.000	0.000	0.000	0.000	0.133	my8036_rel.cz11a_bee
0.000	62.915	34.569	1.898	0.138	0.479	0.000	0.000	0.000	0.000	0.169	my8036_rel.cz11b_bee
0.000	67.131	30.299	1.694	0.398	0.477	nonzero	0.001	nonzero	nonzero	21.851	my8036_rel.cz11c_bee
0.000	64.799	33.156	1.530	0.016	0.500	0.000	0.000	0.000	0.000	0.130	my8036_rel.cz11d_bee
0.037	94.947	4.998	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.004	78.008	20.151	1.826	0.010	0.001	0.000	0.000	0.000	0.000	0.090	ma100244_rel.cz11a_bee
0.005	79.638	18.296	2.027	0.034	0.001	0.000	0.000	0.000	0.000	0.077	ma100339_rel.cz11a_bee
0.004	79.246	18.745	1.965	0.039	0.001	0.000	0.000	0.000	0.000	0.079	ma100433_rel.cz11a_bee
0.019	83.164	16.102	0.649	0.065	nonzero	0.000	0.000	0.000	0.000	0.073	ma100524_rel.cz11a_bee
0.022	87.824	11.096	1.054	0.004	nonzero	0.000	0.000	0.000	0.000	0.067	ma100617_rel.cz11a_bee
0.026	83.191	15.635	1.143	0.004	0.001	0.000	0.000	0.000	0.000	0.144	ma101107_rel.cz11a_bee
0.125	83.946	14.618	1.252	0.057	0.001	0.000	0.000	0.000	0.000	0.220	ma101107_rel.cz11b_bee
0.573	85.326	12.461	1.103	0.525	0.012	nonzero	0.000	0.000	0.000	0.285	ma101107_rel.cz11c_bee
0.027	82.897	15.929	1.142	0.003	0.001	0.000	0.000	0.000	0.000	0.110	ma101107_rel.cz11d_bee
0.160	84.532	13.950	1.252	0.105	0.002	0.000	0.000	0.000	0.000	0.127	ma110401_rel.cz11b_bee
0.287	84.644	13.452	1.181	0.426	0.009	0.000	0.000	0.000	0.000	0.226	ma110401_rel.cz11c_bee
0.127	67.421	30.164	2.159	0.129	0.001	0.000	0.000	0.000	0.000	0.124	my5651_rel.cz11a_bee
0.002	74.267	24.230	1.491	0.009	0.001	0.000	0.000	0.000	0.000	0.085	my5744_rel.cz11a_bee
0.000	65.220	32.713	1.555	0.015	0.498	0.000	0.000	0.000	0.000	0.132	my8036_rel.cz11a_bee
0.000	63.406	34.079	1.901	0.136	0.478	0.000	0.000	0.000	0.000	0.174	my8036_rel.cz11b_bee
0.000	67.628	29.809	1.694	0.395	0.474	nonzero	0.001	nonzero	nonzero	21.850	my8036_rel.cz11c_bee
0.000	65.279	32.671	1.536	0.016	0.499	0.000	0.000	0.000	0.000	0.138	my8036_rel.cz11d_bee
0.000	18.051	81.882	0.067	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	pg162_def.cx9a2_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
85.149	14.732	0.114	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	ma100244_rel.cz11a_bee
81.853	18.033	0.111	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	ma100339_rel.cz11a_bee
73.453	26.423	0.121	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	ma100433_rel.cz11a_bee
67.703	32.250	0.046	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma100524_rel.cz11a_bee
69.396	30.588	0.016	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma100617_rel.cz11a_bee
70.969	29.013	0.016	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101107_rel.cz11a_bee
68.939	31.044	0.016	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma101107_rel.cz11b_bee
68.761	31.221	0.016	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma101107_rel.cz11c_bee
69.361	30.623	0.015	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11d_bee
70.543	29.441	0.015	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma110401_rel.cz11b_bee
68.524	31.460	0.015	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma110401_rel.cz11c_bee
98.368	1.596	0.026	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.021	my5651_rel.cz11a_bee
89.758	10.232	0.009	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5744_rel.cz11a_bee
78.884	21.108	0.006	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8036_rel.cz11a_bee
78.578	21.413	0.007	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.045	my8036_rel.cz11b_bee
83.595	16.395	0.007	0.003	nonzero	nonzero	0.000	0.000	0.000	0.000	0.145	my8036_rel.cz11c_bee
78.578	21.414	0.007	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8036_rel.cz11d_bee
99.990	0.004	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	pg162_def.cx9a2_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	95.604	4.188	0.208	0.000	0.000	0.000	0.000	0.000	0.051	ma100244_rel.cz11a_bee
0.000	0.000	94.729	4.868	0.403	0.000	0.000	0.000	0.000	0.000	0.040	ma100339_rel.cz11a_bee
0.000	0.000	94.549	5.146	0.306	0.000	0.000	0.000	0.000	0.000	0.044	ma100433_rel.cz11a_bee
0.000	0.000	99.083	0.917	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma100524_rel.cz11a_bee
0.000	0.000	99.806	0.188	0.007	0.000	0.000	0.000	0.000	0.000	0.016	ma100617_rel.cz11a_bee
0.000	0.000	57.799	42.194	0.007	0.000	0.000	0.000	0.000	0.000	0.019	ma101107_rel.cz11a_bee
0.000	0.000	87.910	12.090	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11b_bee
0.000	0.000	74.403	25.597	0.000	0.000	0.000	0.000	0.000	0.000	0.016	ma101107_rel.cz11c_bee
0.000	0.000	75.174	24.826	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma101107_rel.cz11d_bee
0.000	0.000	70.424	29.563	0.014	0.000	0.000	0.000	0.000	0.000	0.017	ma110401_rel.cz11b_bee
0.000	0.000	79.639	20.361	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma110401_rel.cz11c_bee
0.000	0.000	84.229	15.542	0.229	0.000	0.000	0.000	0.000	0.000	0.037	my5651_rel.cz11a_bee
0.000	0.000	98.403	1.562	0.035	0.000	0.000	0.000	0.000	0.000	0.020	my5744_rel.cz11a_bee
0.000	0.000	96.826	3.160	0.014	0.000	0.000	0.000	0.000	0.000	0.026	my8036_rel.cz11a_bee
0.000	0.000	94.625	5.083	0.215	0.076	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11b_bee
0.000	0.000	93.875	5.431	0.479	0.215	0.000	0.000	0.000	0.000	0.204	my8036_rel.cz11c_bee
0.000	0.000	92.882	7.062	0.007	0.049	0.000	0.000	0.000	0.000	0.104	my8036_rel.cz11d_bee
0.000	0.000	99.243	0.757	0.000	0.000	0.000	0.000	0.000	0.000	0.013	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	96.819	3.035	0.146	0.000	0.000	0.000	0.000	0.000	0.036	ma100244_rel.cz11a_bee
0.000	0.000	96.174	3.625	0.201	0.000	0.000	0.000	0.000	0.000	0.038	ma100339_rel.cz11a_bee
0.000	0.000	96.174	3.653	0.174	0.000	0.000	0.000	0.000	0.000	0.037	ma100433_rel.cz11a_bee
0.000	0.000	99.340	0.660	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma100524_rel.cz11a_bee
0.000	0.000	99.590	0.410	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma100617_rel.cz11a_bee
0.000	0.000	59.639	40.347	0.014	0.000	0.000	0.000	0.000	0.000	0.019	ma101107_rel.cz11a_bee
0.000	0.000	87.910	12.090	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11b_bee
0.000	0.000	74.785	25.215	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma101107_rel.cz11c_bee
0.000	0.000	75.528	24.472	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma101107_rel.cz11d_bee
0.000	0.000	71.264	28.736	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma110401_rel.cz11b_bee
0.000	0.000	80.188	19.812	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma110401_rel.cz11c_bee
0.000	0.000	85.611	14.215	0.174	0.000	0.000	0.000	0.000	0.000	0.032	my5651_rel.cz11a_bee
0.000	0.000	98.604	1.389	0.007	0.000	0.000	0.000	0.000	0.000	0.017	my5744_rel.cz11a_bee
0.000	0.000	96.993	2.993	0.014	0.000	0.000	0.000	0.000	0.000	0.037	my8036_rel.cz11a_bee
0.000	0.000	95.312	4.472	0.125	0.090	0.000	0.000	0.000	0.000	0.104	my8036_rel.cz11b_bee
0.000	0.000	95.062	4.326	0.431	0.181	0.000	0.000	0.000	0.000	0.164	my8036_rel.cz11c_bee
0.000	0.000	94.625	5.333	0.007	0.035	0.000	0.000	0.000	0.000	0.103	my8036_rel.cz11d_bee
0.000	15.035	84.632	0.333	0.000	0.000	0.000	0.000	0.000	0.000	0.013	pg162_def.cx9a2_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.347	1.626	0.026	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.021	ma100244_rel.cz11a_bee
97.018	2.956	0.026	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma100339_rel.cz11a_bee
94.288	5.679	0.032	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.021	ma100433_rel.cz11a_bee
93.770	6.222	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma100524_rel.cz11a_bee
97.055	2.901	0.043	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma100617_rel.cz11a_bee
98.034	1.923	0.042	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101107_rel.cz11a_bee
94.936	5.019	0.044	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma101107_rel.cz11b_bee
95.727	4.228	0.044	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11c_bee
95.813	4.141	0.045	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma101107_rel.cz11d_bee
96.711	3.246	0.042	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110401_rel.cz11b_bee
92.261	7.692	0.045	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110401_rel.cz11c_bee
98.739	1.192	0.058	0.012	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5651_rel.cz11a_bee
95.942	4.015	0.038	0.005	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5744_rel.cz11a_bee
80.253	19.730	0.014	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my8036_rel.cz11a_bee
84.283	15.695	0.017	0.004	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8036_rel.cz11b_bee
78.259	21.720	0.016	0.005	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8036_rel.cz11c_bee
85.570	14.413	0.014	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8036_rel.cz11d_bee
96.943	2.975	0.081	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.008	pg162_def.cx9a2_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	95.465	4.174	0.361	0.000	0.000	0.000	0.000	0.000	0.047	ma100244_rel.cz11a_bee
0.000	0.000	94.035	5.590	0.375	0.000	0.000	0.000	0.000	0.000	0.036	ma100339_rel.cz11a_bee
0.000	0.000	94.861	4.854	0.285	0.000	0.000	0.000	0.000	0.000	0.034	ma100433_rel.cz11a_bee
0.000	0.000	99.160	0.840	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma100524_rel.cz11a_bee
0.000	0.000	99.708	0.285	0.007	0.000	0.000	0.000	0.000	0.000	0.017	ma100617_rel.cz11a_bee
0.000	0.000	81.306	18.694	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma101107_rel.cz11a_bee
0.000	0.000	87.646	12.354	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma101107_rel.cz11b_bee
0.000	0.000	75.514	24.486	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma101107_rel.cz11c_bee
0.000	0.000	86.646	13.347	0.007	0.000	0.000	0.000	0.000	0.000	0.016	ma101107_rel.cz11d_bee
0.000	0.000	88.153	11.847	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma110401_rel.cz11b_bee
0.000	0.000	78.000	22.000	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma110401_rel.cz11c_bee
0.000	0.000	86.701	13.174	0.125	0.000	0.000	0.000	0.000	0.000	0.023	my5651_rel.cz11a_bee
0.000	0.000	98.944	1.049	0.007	0.000	0.000	0.000	0.000	0.000	0.016	my5744_rel.cz11a_bee
0.000	0.000	96.236	3.681	0.021	0.062	0.000	0.000	0.000	0.000	0.106	my8036_rel.cz11a_bee
0.000	0.000	96.667	3.271	0.062	0.000	0.000	0.000	0.000	0.000	0.042	my8036_rel.cz11b_bee
0.000	0.000	95.493	4.174	0.264	0.069	0.000	0.000	0.000	0.000	0.123	my8036_rel.cz11c_bee
0.000	0.000	96.493	3.479	0.021	0.007	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11d_bee
0.000	0.000	99.167	0.833	0.000	0.000	0.000	0.000	0.000	0.000	0.007	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	96.465	3.278	0.257	0.000	0.000	0.000	0.000	0.000	0.033	ma100244_rel.cz11a_bee
0.000	0.000	95.924	3.826	0.250	0.000	0.000	0.000	0.000	0.000	0.031	ma100339_rel.cz11a_bee
0.000	0.000	96.382	3.410	0.208	0.000	0.000	0.000	0.000	0.000	0.033	ma100433_rel.cz11a_bee
0.000	0.000	99.674	0.326	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma100524_rel.cz11a_bee
0.000	0.000	99.646	0.347	0.007	0.000	0.000	0.000	0.000	0.000	0.016	ma100617_rel.cz11a_bee
0.000	0.000	81.500	18.500	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma101107_rel.cz11a_bee
0.000	0.000	87.785	12.215	0.000	0.000	0.000	0.000	0.000	0.000	0.016	ma101107_rel.cz11b_bee
0.000	0.000	75.826	24.167	0.007	0.000	0.000	0.000	0.000	0.000	0.017	ma101107_rel.cz11c_bee
0.000	0.000	86.625	13.375	0.000	0.000	0.000	0.000	0.000	0.000	0.015	ma101107_rel.cz11d_bee
0.000	0.000	88.097	11.896	0.007	0.000	0.000	0.000	0.000	0.000	0.017	ma110401_rel.cz11b_bee
0.000	0.000	78.264	21.736	0.000	0.000	0.000	0.000	0.000	0.000	0.016	ma110401_rel.cz11c_bee
0.000	0.000	87.660	12.299	0.042	0.000	0.000	0.000	0.000	0.000	0.022	my5651_rel.cz11a_bee
0.000	0.000	99.021	0.965	0.014	0.000	0.000	0.000	0.000	0.000	0.020	my5744_rel.cz11a_bee
0.000	0.000	96.500	3.438	0.014	0.049	0.000	0.000	0.000	0.000	0.103	my8036_rel.cz11a_bee
0.000	0.000	96.389	3.542	0.069	0.000	0.000	0.000	0.000	0.000	0.048	my8036_rel.cz11b_bee
0.000	0.000	95.701	4.069	0.174	0.056	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11c_bee
0.000	0.000	96.458	3.528	0.007	0.007	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11d_bee
0.000	0.000	98.604	1.396	0.000	0.000	0.000	0.000	0.000	0.000	0.007	pg162_def.cx9a2_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
85.099	14.449	0.410	0.041	0.001	0.000	0.000	0.000	0.000	0.000	0.036	ma100244_rel.cz11a_bee
82.509	17.128	0.319	0.042	0.001	0.000	0.000	0.000	0.000	0.000	0.056	ma100339_rel.cz11a_bee
76.213	23.401	0.342	0.042	0.001	0.000	0.000	0.000	0.000	0.000	0.038	ma100433_rel.cz11a_bee
69.002	30.861	0.116	0.022	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	ma100524_rel.cz11a_bee
72.675	27.202	0.110	0.013	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma100617_rel.cz11a_bee
72.673	27.227	0.088	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	ma101107_rel.cz11a_bee
71.593	28.304	0.087	0.016	nonzero	0.000	0.000	0.000	0.000	0.000	0.042	ma101107_rel.cz11b_bee
71.673	28.212	0.095	0.018	0.002	nonzero	0.000	0.000	0.000	0.000	0.121	ma101107_rel.cz11c_bee
72.381	27.521	0.087	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma101107_rel.cz11d_bee
74.076	25.833	0.079	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	ma110401_rel.cz11b_bee
72.966	26.942	0.081	0.011	nonzero	nonzero	0.000	0.000	0.000	0.000	0.073	ma110401_rel.cz11c_bee
98.236	1.660	0.089	0.014	nonzero	0.000	0.000	0.000	0.000	0.000	0.037	my5651_rel.cz11a_bee
90.342	9.631	0.020	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	my5744_rel.cz11a_bee
77.985	21.983	0.021	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.030	my8036_rel.cz11a_bee
81.320	18.629	0.035	0.016	0.001	nonzero	0.000	0.000	0.000	0.000	0.093	my8036_rel.cz11b_bee
85.556	14.390	0.034	0.019	0.001	nonzero	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11c_bee
78.135	21.833	0.022	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.041	my8036_rel.cz11d_bee
99.931	0.040	0.026	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.034	pg162_def.cx9a2_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	77.314	20.871	1.815	0.000	0.000	0.000	0.000	0.000	0.063	ma100244_rel.cz11a_bee
0.000	0.000	71.251	26.001	2.747	0.000	0.000	0.000	0.000	0.000	0.054	ma100339_rel.cz11a_bee
0.000	0.000	72.165	25.321	2.514	0.000	0.000	0.000	0.000	0.000	0.057	ma100433_rel.cz11a_bee
0.000	0.000	95.962	3.978	0.060	0.000	0.000	0.000	0.000	0.000	0.036	ma100524_rel.cz11a_bee
0.000	0.000	95.310	4.640	0.050	0.000	0.000	0.000	0.000	0.000	0.039	ma100617_rel.cz11a_bee
0.000	0.000	93.333	6.599	0.068	0.000	0.000	0.000	0.000	0.000	0.040	ma101107_rel.cz11a_bee
0.000	0.000	93.126	6.711	0.161	0.001	0.000	0.000	0.000	0.000	0.065	ma101107_rel.cz11b_bee
0.000	0.000	92.004	7.714	0.265	0.017	0.000	0.000	0.000	0.000	0.146	ma101107_rel.cz11c_bee
0.000	0.000	93.469	6.476	0.054	0.000	0.000	0.000	0.000	0.000	0.030	ma101107_rel.cz11d_bee
0.000	0.000	93.364	6.510	0.126	0.000	0.000	0.000	0.000	0.000	0.036	ma110401_rel.cz11b_bee
0.000	0.000	93.192	6.567	0.236	0.006	0.000	0.000	0.000	0.000	0.079	ma110401_rel.cz11c_bee
0.000	0.000	67.400	31.524	1.076	0.000	0.000	0.000	0.000	0.000	0.059	my5651_rel.cz11a_bee
0.000	0.000	94.901	4.810	0.289	0.000	0.000	0.000	0.000	0.000	0.064	my5744_rel.cz11a_bee
0.000	0.000	86.285	12.310	1.051	0.354	0.000	0.000	0.000	0.000	0.131	my8036_rel.cz11a_bee
0.000	0.000	87.268	11.322	1.161	0.249	0.000	0.000	0.000	0.000	0.124	my8036_rel.cz11b_bee
0.000	0.000	81.035	15.851	2.506	0.608	0.000	0.000	0.000	0.000	0.166	my8036_rel.cz11c_bee
0.000	0.000	85.592	13.061	1.075	0.272	0.000	0.000	0.000	0.000	0.129	my8036_rel.cz11d_bee
0.000	0.000	95.479	4.417	0.104	0.000	0.000	0.000	0.000	0.000	0.037	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	82.043	16.636	1.319	0.001	0.000	0.000	0.000	0.000	0.067	ma100244_rel.cz11a_bee
0.000	0.000	77.429	20.617	1.954	0.000	0.000	0.000	0.000	0.000	0.062	ma100339_rel.cz11a_bee
0.000	0.000	78.344	19.893	1.762	0.000	0.000	0.000	0.000	0.000	0.058	ma100433_rel.cz11a_bee
0.000	0.000	97.531	2.447	0.022	0.000	0.000	0.000	0.000	0.000	0.037	ma100524_rel.cz11a_bee
0.000	0.000	97.214	2.763	0.024	0.000	0.000	0.000	0.000	0.000	0.039	ma100617_rel.cz11a_bee
0.000	0.000	95.182	4.783	0.035	0.000	0.000	0.000	0.000	0.000	0.040	ma101107_rel.cz11a_bee
0.000	0.000	95.106	4.814	0.081	0.000	0.000	0.000	0.000	0.000	0.039	ma101107_rel.cz11b_bee
0.000	0.000	94.540	5.317	0.139	0.004	0.000	0.000	0.000	0.000	0.134	ma101107_rel.cz11c_bee
0.000	0.000	95.265	4.715	0.019	0.000	0.000	0.000	0.000	0.000	0.029	ma101107_rel.cz11d_bee
0.000	0.000	95.031	4.897	0.072	0.000	0.000	0.000	0.000	0.000	0.035	ma110401_rel.cz11b_bee
0.000	0.000	94.910	4.967	0.122	0.001	0.000	0.000	0.000	0.000	0.071	ma110401_rel.cz11c_bee
0.000	0.000	76.469	22.818	0.713	0.000	0.000	0.000	0.000	0.000	0.049	my5651_rel.cz11a_bee
0.000	0.000	96.256	3.547	0.197	0.000	0.000	0.000	0.000	0.000	0.062	my5744_rel.cz11a_bee
0.000	0.000	89.608	9.412	0.667	0.312	0.000	0.000	0.000	0.000	0.124	my8036_rel.cz11a_bee
0.000	0.000	90.022	8.812	0.935	0.231	0.000	0.000	0.000	0.000	0.117	my8036_rel.cz11b_bee
0.000	0.000	85.599	12.028	1.835	0.539	0.000	0.000	0.000	0.000	0.184	my8036_rel.cz11c_bee
0.000	0.000	89.040	10.035	0.676	0.249	0.000	0.000	0.000	0.000	0.126	my8036_rel.cz11d_bee
0.000	9.639	84.776	5.422	0.163	0.000	0.000	0.000	0.000	0.000	0.029	pg162_def.cx9a2_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
96.597	3.251	0.141	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	ma100244_rel.cz11a_bee
95.183	4.693	0.113	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma100339_rel.cz11a_bee
92.701	7.171	0.116	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.030	ma100433_rel.cz11a_bee
92.284	7.694	0.018	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	ma100524_rel.cz11a_bee
96.054	3.824	0.111	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma100617_rel.cz11a_bee
96.132	3.759	0.099	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	ma101107_rel.cz11a_bee
95.938	3.943	0.108	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma101107_rel.cz11b_bee
96.086	3.794	0.108	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	ma101107_rel.cz11c_bee
96.113	3.766	0.110	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma101107_rel.cz11d_bee
95.904	3.983	0.100	0.013	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma110401_rel.cz11b_bee
95.820	4.067	0.102	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	ma110401_rel.cz11c_bee
97.465	2.282	0.235	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5651_rel.cz11a_bee
94.989	4.900	0.094	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	my5744_rel.cz11a_bee
80.278	19.676	0.034	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	my8036_rel.cz11a_bee
73.325	26.608	0.047	0.020	nonzero	0.000	0.000	0.000	0.000	0.000	0.042	my8036_rel.cz11b_bee
66.119	33.808	0.050	0.023	0.001	0.000	0.000	0.000	0.000	0.000	0.054	my8036_rel.cz11c_bee
79.685	20.266	0.035	0.013	0.001	0.000	0.000	0.000	0.000	0.000	0.029	my8036_rel.cz11d_bee
96.358	3.496	0.135	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	pg162_def.cx9a2_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	82.782	15.338	1.879	0.001	0.000	0.000	0.000	0.000	0.069	ma100244_rel.cz11a_bee
0.000	0.000	80.006	17.908	2.085	0.001	0.000	0.000	0.000	0.000	0.066	ma100339_rel.cz11a_bee
0.000	0.000	77.586	20.044	2.369	0.000	0.000	0.000	0.000	0.000	0.059	ma100433_rel.cz11a_bee
0.000	0.000	97.156	2.797	0.047	0.000	0.000	0.000	0.000	0.000	0.038	ma100524_rel.cz11a_bee
0.000	0.000	96.814	3.151	0.035	0.000	0.000	0.000	0.000	0.000	0.039	ma100617_rel.cz11a_bee
0.000	0.000	95.129	4.835	0.036	0.000	0.000	0.000	0.000	0.000	0.030	ma101107_rel.cz11a_bee
0.000	0.000	92.156	7.754	0.090	0.000	0.000	0.000	0.000	0.000	0.040	ma101107_rel.cz11b_bee
0.000	0.000	90.347	9.496	0.157	0.000	0.000	0.000	0.000	0.000	0.048	ma101107_rel.cz11c_bee
0.000	0.000	93.353	6.603	0.044	0.000	0.000	0.000	0.000	0.000	0.039	ma101107_rel.cz11d_bee
0.000	0.000	93.774	6.112	0.114	0.000	0.000	0.000	0.000	0.000	0.046	ma110401_rel.cz11b_bee
0.000	0.000	93.826	5.950	0.215	0.008	0.000	0.000	0.000	0.000	0.193	ma110401_rel.cz11c_bee
0.000	0.000	76.542	23.081	0.378	0.000	0.000	0.000	0.000	0.000	0.049	my5651_rel.cz11a_bee
0.000	0.000	98.069	1.889	0.042	0.000	0.000	0.000	0.000	0.000	0.048	my5744_rel.cz11a_bee
0.000	0.000	91.044	8.249	0.532	0.175	0.000	0.000	0.000	0.000	0.123	my8036_rel.cz11a_bee
0.000	0.000	88.122	10.312	1.296	0.269	0.000	0.000	0.000	0.000	0.125	my8036_rel.cz11b_bee
0.000	0.000	78.003	18.632	2.690	0.675	0.000	0.000	0.000	0.000	0.163	my8036_rel.cz11c_bee
0.000	0.000	90.943	8.138	0.633	0.286	0.000	0.000	0.000	0.000	0.125	my8036_rel.cz11d_bee
0.000	0.000	97.733	2.240	0.026	0.000	0.000	0.000	0.000	0.000	0.026	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	87.026	11.749	1.225	0.000	0.000	0.000	0.000	0.000	0.052	ma100244_rel.cz11a_bee
0.000	0.000	85.125	13.482	1.393	0.000	0.000	0.000	0.000	0.000	0.051	ma100339_rel.cz11a_bee
0.000	0.000	83.439	15.006	1.556	0.000	0.000	0.000	0.000	0.000	0.056	ma100433_rel.cz11a_bee
0.000	0.000	98.268	1.706	0.026	0.000	0.000	0.000	0.000	0.000	0.038	ma100524_rel.cz11a_bee
0.000	0.000	98.118	1.869	0.013	0.000	0.000	0.000	0.000	0.000	0.037	ma100617_rel.cz11a_bee
0.000	0.000	96.296	3.690	0.014	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11a_bee
0.000	0.000	94.221	5.740	0.039	0.000	0.000	0.000	0.000	0.000	0.040	ma101107_rel.cz11b_bee
0.000	0.000	93.086	6.818	0.096	0.000	0.000	0.000	0.000	0.000	0.044	ma101107_rel.cz11c_bee
0.000	0.000	95.157	4.821	0.022	0.000	0.000	0.000	0.000	0.000	0.039	ma101107_rel.cz11d_bee
0.000	0.000	95.283	4.657	0.060	0.000	0.000	0.000	0.000	0.000	0.045	ma110401_rel.cz11b_bee
0.000	0.000	95.215	4.674	0.108	0.003	0.000	0.000	0.000	0.000	0.123	ma110401_rel.cz11c_bee
0.000	0.000	83.628	16.118	0.254	0.000	0.000	0.000	0.000	0.000	0.047	my5651_rel.cz11a_bee
0.000	0.000	98.776	1.201	0.022	0.000	0.000	0.000	0.000	0.000	0.048	my5744_rel.cz11a_bee
0.000	0.000	92.862	6.606	0.374	0.158	0.000	0.000	0.000	0.000	0.121	my8036_rel.cz11a_bee
0.000	0.000	90.943	7.918	0.907	0.232	0.000	0.000	0.000	0.000	0.156	my8036_rel.cz11b_bee
0.000	0.000	83.147	14.258	2.019	0.575	0.000	0.000	0.000	0.000	0.158	my8036_rel.cz11c_bee
0.000	0.000	93.299	6.078	0.378	0.246	0.000	0.000	0.000	0.000	0.125	my8036_rel.cz11d_bee
0.000	6.374	91.174	2.418	0.035	0.000	0.000	0.000	0.000	0.000	0.026	pg162_def.cx9a2_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
84.873	14.546	0.500	0.078	0.002	0.000	0.000	0.000	0.000	0.000	0.037	ma100244_rel.cz11a_bee
81.427	17.959	0.541	0.071	0.003	0.000	0.000	0.000	0.000	0.000	0.042	ma100339_rel.cz11a_bee
76.090	23.282	0.550	0.075	0.003	0.000	0.000	0.000	0.000	0.000	0.051	ma100433_rel.cz11a_bee
71.003	28.491	0.455	0.051	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	ma100524_rel.cz11a_bee
72.905	26.815	0.252	0.027	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	ma100617_rel.cz11a_bee
72.121	27.597	0.255	0.027	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	ma101107_rel.cz11a_bee
70.838	28.872	0.254	0.034	0.001	nonzero	0.000	0.000	0.000	0.000	0.077	ma101107_rel.cz11b_bee
71.344	28.328	0.283	0.040	0.004	nonzero	0.000	0.000	0.000	0.000	0.103	ma101107_rel.cz11c_bee
71.551	28.145	0.278	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	ma101107_rel.cz11d_bee
72.217	27.531	0.225	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	ma110401_rel.cz11b_bee
71.654	28.074	0.244	0.026	0.001	nonzero	0.000	0.000	0.000	0.000	0.128	ma110401_rel.cz11c_bee
97.842	1.957	0.173	0.027	0.001	0.000	0.000	0.000	0.000	0.000	0.058	my5651_rel.cz11a_bee
90.014	9.905	0.062	0.019	0.001	0.000	0.000	0.000	0.000	0.000	0.046	my5744_rel.cz11a_bee
79.093	20.800	0.074	0.031	0.003	0.000	0.000	0.000	0.000	0.000	0.048	my8036_rel.cz11a_bee
85.119	14.727	0.102	0.048	0.003	nonzero	0.000	0.000	0.000	0.000	0.083	my8036_rel.cz11b_bee
87.959	11.910	0.086	0.041	0.004	nonzero	0.000	0.000	0.000	0.000	0.117	my8036_rel.cz11c_bee
79.016	20.879	0.074	0.029	0.002	0.000	0.000	0.000	0.000	0.000	0.052	my8036_rel.cz11d_bee
99.765	0.175	0.052	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	pg162_def.cx9a2_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	58.472	37.326	4.202	0.001	0.000	0.000	0.000	0.000	0.067	ma100244_rel.cz11a_bee
0.000	0.000	61.134	35.042	3.822	0.002	0.000	0.000	0.000	0.000	0.074	ma100339_rel.cz11a_bee
0.000	0.000	59.494	36.493	4.012	0.001	0.000	0.000	0.000	0.000	0.070	ma100433_rel.cz11a_bee
0.000	0.000	64.597	33.784	1.619	0.000	0.000	0.000	0.000	0.000	0.054	ma100524_rel.cz11a_bee
0.000	0.000	78.119	21.629	0.251	0.000	0.000	0.000	0.000	0.000	0.050	ma100617_rel.cz11a_bee
0.000	0.000	73.843	25.893	0.264	0.000	0.000	0.000	0.000	0.000	0.042	ma101107_rel.cz11a_bee
0.000	0.000	72.099	27.505	0.395	0.001	0.000	0.000	0.000	0.000	0.069	ma101107_rel.cz11b_bee
0.000	0.000	71.402	27.980	0.610	0.008	0.000	0.000	0.000	0.000	0.133	ma101107_rel.cz11c_bee
0.000	0.000	69.611	30.113	0.276	0.000	0.000	0.000	0.000	0.000	0.039	ma101107_rel.cz11d_bee
0.000	0.000	76.920	22.660	0.420	0.000	0.000	0.000	0.000	0.000	0.051	ma110401_rel.cz11b_bee
0.000	0.000	71.469	27.901	0.626	0.003	0.000	0.000	0.000	0.000	0.194	ma110401_rel.cz11c_bee
0.000	0.000	44.122	52.656	3.222	0.000	0.000	0.000	0.000	0.000	0.059	my5651_rel.cz11a_bee
0.000	0.000	73.409	24.966	1.624	0.001	0.000	0.000	0.000	0.000	0.067	my5744_rel.cz11a_bee
0.000	0.000	64.655	30.896	3.487	0.963	0.000	0.000	0.000	0.000	0.148	my8036_rel.cz11a_bee
0.000	0.000	62.992	30.940	5.075	0.993	0.000	0.000	0.000	0.000	0.189	my8036_rel.cz11b_bee
0.000	0.000	63.365	30.023	5.299	1.313	0.000	0.000	0.000	0.000	0.241	my8036_rel.cz11c_bee
0.000	0.000	68.292	27.570	3.252	0.886	0.000	0.000	0.000	0.000	0.152	my8036_rel.cz11d_bee
0.000	0.000	90.424	9.331	0.245	0.000	0.000	0.000	0.000	0.000	0.040	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	65.162	31.508	3.330	0.000	0.000	0.000	0.000	0.000	0.063	ma100244_rel.cz11a_bee
0.000	0.000	68.388	28.774	2.838	0.001	0.000	0.000	0.000	0.000	0.070	ma100339_rel.cz11a_bee
0.000	0.000	67.332	29.547	3.122	0.000	0.000	0.000	0.000	0.000	0.062	ma100433_rel.cz11a_bee
0.000	0.000	71.760	27.213	1.028	0.000	0.000	0.000	0.000	0.000	0.058	ma100524_rel.cz11a_bee
0.000	0.000	83.255	16.540	0.205	0.000	0.000	0.000	0.000	0.000	0.042	ma100617_rel.cz11a_bee
0.000	0.000	79.099	20.728	0.174	0.000	0.000	0.000	0.000	0.000	0.044	ma101107_rel.cz11a_bee
0.000	0.000	77.497	22.257	0.245	0.001	0.000	0.000	0.000	0.000	0.071	ma101107_rel.cz11b_bee
0.000	0.000	76.966	22.653	0.380	0.001	0.000	0.000	0.000	0.000	0.108	ma101107_rel.cz11c_bee
0.000	0.000	75.333	24.503	0.164	0.000	0.000	0.000	0.000	0.000	0.042	ma101107_rel.cz11d_bee
0.000	0.000	81.279	18.439	0.282	0.000	0.000	0.000	0.000	0.000	0.053	ma110401_rel.cz11b_bee
0.000	0.000	76.758	22.820	0.417	0.004	0.000	0.000	0.000	0.000	0.192	ma110401_rel.cz11c_bee
0.000	0.001	53.565	44.135	2.300	0.000	0.000	0.000	0.000	0.000	0.057	my5651_rel.cz11a_bee
0.000	0.000	78.606	19.983	1.411	0.000	0.000	0.000	0.000	0.000	0.053	my5744_rel.cz11a_bee
0.000	0.000	71.585	24.879	2.667	0.869	0.000	0.000	0.000	0.000	0.138	my8036_rel.cz11a_bee
0.000	0.000	70.851	24.447	3.823	0.879	0.000	0.000	0.000	0.000	0.194	my8036_rel.cz11b_bee
0.000	0.000	71.294	23.676	3.908	1.122	0.000	0.000	0.000	0.000	0.210	my8036_rel.cz11c_bee
0.000	0.000	75.481	21.357	2.397	0.765	0.000	0.000	0.000	0.000	0.137	my8036_rel.cz11d_bee
0.000	4.400	84.480	10.842	0.278	0.000	0.000	0.000	0.000	0.000	0.041	pg162_def.cx9a2_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
96.079	3.708	0.181	0.032	0.001	0.000	0.000	0.000	0.000	0.000	0.042	ma100244_rel.cz11a_bee
94.091	5.703	0.179	0.026	0.001	0.000	0.000	0.000	0.000	0.000	0.038	ma100339_rel.cz11a_bee
90.413	9.374	0.184	0.028	0.001	0.000	0.000	0.000	0.000	0.000	0.033	ma100433_rel.cz11a_bee
87.494	12.276	0.208	0.023	nonzero	0.000	0.000	0.000	0.000	0.000	0.030	ma100524_rel.cz11a_bee
94.652	5.225	0.110	0.013	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	ma100617_rel.cz11a_bee
93.645	6.233	0.111	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	ma101107_rel.cz11a_bee
93.720	6.162	0.107	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma101107_rel.cz11b_bee
93.542	6.339	0.108	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.063	ma101107_rel.cz11c_bee
93.194	6.697	0.098	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma101107_rel.cz11d_bee
93.863	6.024	0.100	0.013	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	ma110401_rel.cz11b_bee
93.408	6.482	0.097	0.013	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	ma110401_rel.cz11c_bee
96.994	2.622	0.354	0.030	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	my5651_rel.cz11a_bee
92.653	7.086	0.218	0.042	0.001	0.000	0.000	0.000	0.000	0.000	0.037	my5744_rel.cz11a_bee
75.304	24.560	0.103	0.032	0.002	0.000	0.000	0.000	0.000	0.000	0.052	my8036_rel.cz11a_bee
61.063	38.736	0.144	0.056	0.002	0.000	0.000	0.000	0.000	0.000	0.051	my8036_rel.cz11b_bee
48.259	51.552	0.137	0.050	0.002	nonzero	0.000	0.000	0.000	0.000	0.143	my8036_rel.cz11c_bee
73.825	26.003	0.127	0.041	0.004	0.000	0.000	0.000	0.000	0.000	0.047	my8036_rel.cz11d_bee
95.717	4.074	0.188	0.021	0.001	0.000	0.000	0.000	0.000	0.000	0.032	pg162_def.cx9a2_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	63.572	31.534	4.893	0.001	0.000	0.000	0.000	0.000	0.068	ma100244_rel.cz11a_bee
0.000	0.000	66.365	29.410	4.221	0.004	0.000	0.000	0.000	0.000	0.084	ma100339_rel.cz11a_bee
0.000	0.000	64.490	30.873	4.636	0.001	0.000	0.000	0.000	0.000	0.066	ma100433_rel.cz11a_bee
0.000	0.000	62.524	34.760	2.716	0.000	0.000	0.000	0.000	0.000	0.054	ma100524_rel.cz11a_bee
0.000	0.000	80.290	19.301	0.408	0.000	0.000	0.000	0.000	0.000	0.054	ma100617_rel.cz11a_bee
0.000	0.000	76.844	22.881	0.276	0.000	0.000	0.000	0.000	0.000	0.038	ma101107_rel.cz11a_bee
0.000	0.000	80.263	19.380	0.358	0.000	0.000	0.000	0.000	0.000	0.050	ma101107_rel.cz11b_bee
0.000	0.000	78.049	21.422	0.526	0.003	0.000	0.000	0.000	0.000	0.071	ma101107_rel.cz11c_bee
0.000	0.000	82.680	17.042	0.278	0.000	0.000	0.000	0.000	0.000	0.044	ma101107_rel.cz11d_bee
0.000	0.000	84.777	14.833	0.390	0.000	0.000	0.000	0.000	0.000	0.053	ma110401_rel.cz11b_bee
0.000	0.000	83.327	16.110	0.563	0.000	0.000	0.000	0.000	0.000	0.052	ma110401_rel.cz11c_bee
0.000	0.000	52.681	46.067	1.251	0.001	0.000	0.000	0.000	0.000	0.069	my5651_rel.cz11a_bee
0.000	0.000	77.252	22.062	0.685	0.000	0.000	0.000	0.000	0.000	0.051	my5744_rel.cz11a_bee
0.000	0.000	71.709	24.872	2.551	0.868	0.000	0.000	0.000	0.000	0.143	my8036_rel.cz11a_bee
0.000	0.000	64.085	29.413	5.333	1.169	0.000	0.000	0.000	0.000	0.158	my8036_rel.cz11b_bee
0.000	0.000	63.131	30.015	5.455	1.399	0.000	0.000	0.000	0.000	0.202	my8036_rel.cz11c_bee
0.000	0.000	63.250	31.788	3.765	1.198	0.000	0.000	0.000	0.000	0.151	my8036_rel.cz11d_bee
0.000	0.000	92.068	7.676	0.256	0.000	0.000	0.000	0.000	0.000	0.037	pg162_def.cx9a2_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	69.903	26.408	3.688	0.001	0.000	0.000	0.000	0.000	0.067	ma100244_rel.cz11a_bee
0.000	0.000	73.563	23.320	3.115	0.001	0.000	0.000	0.000	0.000	0.072	ma100339_rel.cz11a_bee
0.000	0.000	71.824	24.800	3.374	0.003	0.000	0.000	0.000	0.000	0.069	ma100433_rel.cz11a_bee
0.000	0.000	69.446	28.818	1.735	0.001	0.000	0.000	0.000	0.000	0.067	ma100524_rel.cz11a_bee
0.000	0.000	84.628	15.036	0.335	0.000	0.000	0.000	0.000	0.000	0.060	ma100617_rel.cz11a_bee
0.000	0.000	81.510	18.310	0.181	0.000	0.000	0.000	0.000	0.000	0.042	ma101107_rel.cz11a_bee
0.000	0.000	84.139	15.667	0.194	0.000	0.000	0.000	0.000	0.000	0.038	ma101107_rel.cz11b_bee
0.000	0.000	82.430	17.262	0.308	0.001	0.000	0.000	0.000	0.000	0.064	ma101107_rel.cz11c_bee
0.000	0.000	86.371	13.469	0.160	0.000	0.000	0.000	0.000	0.000	0.051	ma101107_rel.cz11d_bee
0.000	0.000	87.701	12.081	0.218	0.000	0.000	0.000	0.000	0.000	0.053	ma110401_rel.cz11b_bee
0.000	0.000	86.635	13.031	0.334	0.000	0.000	0.000	0.000	0.000	0.058	ma110401_rel.cz11c_bee
0.000	0.000	62.965	36.124	0.911	0.000	0.000	0.000	0.000	0.000	0.055	my5651_rel.cz11a_bee
0.000	0.000	82.297	17.112	0.591	0.000	0.000	0.000	0.000	0.000	0.057	my5744_rel.cz11a_bee
0.000	0.000	76.862	20.558	1.820	0.760	0.000	0.000	0.000	0.000	0.141	my8036_rel.cz11a_bee
0.000	0.000	71.583	23.385	4.029	1.003	0.000	0.000	0.000	0.000	0.172	my8036_rel.cz11b_bee
0.000	0.000	70.720	23.931	4.147	1.202	0.000	0.000	0.000	0.000	0.197	my8036_rel.cz11c_bee
0.000	0.000	70.278	25.790	2.854	1.078	0.000	0.000	0.000	0.000	0.143	my8036_rel.cz11d_bee
0.000	5.676	85.057	8.992	0.276	0.000	0.000	0.000	0.000	0.000	0.035	pg162_def.cx9a2_bee

Introduction

Contents

Summary

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6