Introduction

This is a report for the insert benchmark with 30M docs and 1 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 16G RAM and an NVMe SSD. It is described here as the Beelink. The benchmark was run with 1 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 1 table. It loads 30M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 50m+50m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:

my5621_rel.cz10a_bee - MySQL 5.6.21, InnoDB, z10a_bee config
my5631_rel.cz10a_bee - MySQL 5.6.31, InnoDB, z10a_bee config
my5641_rel.cz10a_bee - MySQL 5.6.41, InnoDB, z10a_bee config
my5651_rel.cz10a_bee - MySQL 5.6.51, InnoDB, z10a_bee config
my5710_rel.cz10a_bee - MySQL 5.7.10, InnoDB, z10a_bee config
my5720_rel.cz10a_bee - MySQL 5.7.20, InnoDB, z10a_bee config
my5730_rel.cz10a_bee - MySQL 5.7.30, InnoDB, z10a_bee config
my5744_rel.cz10a_bee - MySQL 5.7.44, InnoDB, z10a_bee config
my8013_rel.cz10a_bee - MySQL 8.0.13, InnoDB, z10a_bee config
my8014_rel.cz10a_bee - MySQL 8.0.14, InnoDB, z10a_bee config
my8020_rel.cz10a_bee - MySQL 8.0.20, InnoDB, z10a_bee config
my8028_rel.cz10a_bee - MySQL 8.0.28, InnoDB, z10a_bee config
my8035_rel.cz10a_bee - MySQL 8.0.35, InnoDB, z10a_bee config
my8035_rel.cz10aps0_bee - MySQL 8.0.35, InnoDB, z10aps0_bee config that disables the perf schema
my8035_rel_lessps.cz10a_bee - MySQL 8.0.35, InnoDB, z10a_bee config, most of perf schema disabled at compile time
my8035_rel_lessps.cz10aps0_bee - MySQL 8.0.35, InnoDB, z10aps0_bee config that disables the perf schema, most of perf schema disabled at compile time
my8036_rel.cz10a_bee - MySQL 8.0.36, InnoDB, z10a_bee config

Summary
l.i0: load without secondary indexes
l.x: create secondary indexes
l.i1: continue load after secondary indexes created with 50 inserts per transaction
l.i2: continue load after secondary indexes created with 5 inserts per transaction
qr100.L1: range queries with 100 insert/s per client
qp100.L2: point queries with 100 insert/s per client
qr500.L3: range queries with 500 insert/s per client
qp500.L4: point queries with 500 insert/s per client
qr1000.L5: range queries with 1000 insert/s per client
qp1000.L6: point queries with 1000 insert/s per client

Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
my5621_rel.cz10a_bee	103448	101352	18527	12165	5688	4652	5671	4641	5680	4607
my5631_rel.cz10a_bee	98361	102740	17969	11962	5577	4558	5598	4518	5562	4553
my5641_rel.cz10a_bee	98039	100000	17905	11919	5592	4563	5601	4605	5596	4572
my5651_rel.cz10a_bee	100000	107914	18124	12106	5570	4574	5547	4507	5573	4528
my5710_rel.cz10a_bee	86207	149254	20942	10941	4237	3924	4222	3780	4280	3832
my5720_rel.cz10a_bee	87209	150000	20555	10753	4187	3833	4197	3765	4174	3799
my5730_rel.cz10a_bee	84270	148515	20460	10753	4158	3796	4211	3790	4164	3745
my5744_rel.cz10a_bee	83799	146342	20418	10504	4124	3768	4108	3697	4118	3686
my8013_rel.cz10a_bee	70588	136987	18544	10730	3637	3275	3694	3200	3766	3317
my8014_rel.cz10a_bee	70422	133929	17683	10661	3594	3106	3580	3128	3620	3119
my8020_rel.cz10a_bee	65646	129311	17338	10330	3408	3091	3443	3002	3501	3050
my8028_rel.cz10a_bee	63966	151516	19029	9242	3254	3058	3239	3021	3200	3026
my8035_rel.cz10a_bee	56818	138249	16928	8584	3554	2826	3540	2814	3567	2783
my8035_rel.cz10aps0_bee	59172	206897	17331	9042	3955	3056	3933	2962	3985	2957
my8035_rel_lessps.cz10a_bee	60606	209791	17825	9320	4080	3011	4123	3066	4077	3009
my8035_rel_lessps.cz10aps0_bee	60484	206897	17723	9242	4048	3099	4026	3041	4054	3052
my8036_rel.cz10a_bee	57252	136987	16906	8584	3526	2814	3550	2825	3531	2800

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbms	l.i0	l.x	l.i1	l.i2	qr100	qp100	qr500	qp500	qr1000	qp1000
my5621_rel.cz10a_bee	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00	1.00
my5631_rel.cz10a_bee	0.95	1.01	0.97	0.98	0.98	0.98	0.99	0.97	0.98	0.99
my5641_rel.cz10a_bee	0.95	0.99	0.97	0.98	0.98	0.98	0.99	0.99	0.99	0.99
my5651_rel.cz10a_bee	0.97	1.06	0.98	1.00	0.98	0.98	0.98	0.97	0.98	0.98
my5710_rel.cz10a_bee	0.83	1.47	1.13	0.90	0.74	0.84	0.74	0.81	0.75	0.83
my5720_rel.cz10a_bee	0.84	1.48	1.11	0.88	0.74	0.82	0.74	0.81	0.73	0.82
my5730_rel.cz10a_bee	0.81	1.47	1.10	0.88	0.73	0.82	0.74	0.82	0.73	0.81
my5744_rel.cz10a_bee	0.81	1.44	1.10	0.86	0.73	0.81	0.72	0.80	0.72	0.80
my8013_rel.cz10a_bee	0.68	1.35	1.00	0.88	0.64	0.70	0.65	0.69	0.66	0.72
my8014_rel.cz10a_bee	0.68	1.32	0.95	0.88	0.63	0.67	0.63	0.67	0.64	0.68
my8020_rel.cz10a_bee	0.63	1.28	0.94	0.85	0.60	0.66	0.61	0.65	0.62	0.66
my8028_rel.cz10a_bee	0.62	1.49	1.03	0.76	0.57	0.66	0.57	0.65	0.56	0.66
my8035_rel.cz10a_bee	0.55	1.36	0.91	0.71	0.62	0.61	0.62	0.61	0.63	0.60
my8035_rel.cz10aps0_bee	0.57	2.04	0.94	0.74	0.70	0.66	0.69	0.64	0.70	0.64
my8035_rel_lessps.cz10a_bee	0.59	2.07	0.96	0.77	0.72	0.65	0.73	0.66	0.72	0.65
my8035_rel_lessps.cz10aps0_bee	0.58	2.04	0.96	0.76	0.71	0.67	0.71	0.66	0.71	0.66
my8036_rel.cz10a_bee	0.55	1.35	0.91	0.71	0.62	0.60	0.63	0.61	0.62	0.61

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbms	qr100.L1	qp100.L2	qr500.L3	qp500.L4	qr1000.L5	qp1000.L6
my5621_rel.cz10a_bee	100	100	499	499	997	998
my5631_rel.cz10a_bee	100	100	499	499	997	998
my5641_rel.cz10a_bee	100	100	499	498	997	995
my5651_rel.cz10a_bee	100	100	499	495	998	998
my5710_rel.cz10a_bee	100	100	499	499	998	998
my5720_rel.cz10a_bee	100	100	499	499	998	997
my5730_rel.cz10a_bee	100	100	499	499	997	998
my5744_rel.cz10a_bee	100	100	499	499	998	998
my8013_rel.cz10a_bee	100	100	499	499	998	997
my8014_rel.cz10a_bee	100	100	499	499	997	998
my8020_rel.cz10a_bee	100	100	499	499	998	998
my8028_rel.cz10a_bee	100	100	499	499	998	998
my8035_rel.cz10a_bee	100	100	499	499	997	998
my8035_rel.cz10aps0_bee	100	100	499	499	998	998
my8035_rel_lessps.cz10a_bee	100	100	499	499	998	998
my8035_rel_lessps.cz10aps0_bee	100	100	499	499	997	998
my8036_rel.cz10a_bee	100	100	499	499	998	998
target	100	100	500	500	1000	1000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	94.239	5.643	0.110	0.004	0.003	0.100
my5631_rel.cz10a_bee	87.819	12.059	0.117	0.002	0.003	0.098
my5641_rel.cz10a_bee	85.496	14.381	0.119	0.001	0.003	0.100
my5651_rel.cz10a_bee	90.958	8.926	0.111	0.001	0.003	0.097
my5710_rel.cz10a_bee	4.581	95.127	0.284	0.006	0.002	0.118
my5720_rel.cz10a_bee	8.024	91.683	0.286	0.005	0.002	0.105
my5730_rel.cz10a_bee	3.060	96.600	0.199	0.139	0.002	0.111
my5744_rel.cz10a_bee	2.324	97.334	0.200	0.140	0.002	0.111
my8013_rel.cz10a_bee		99.558	0.354	0.088		0.059
my8014_rel.cz10a_bee		99.441	0.455	0.103	nonzero	0.070
my8020_rel.cz10a_bee		99.379	0.465	0.152	0.003	0.088
my8028_rel.cz10a_bee		99.464	0.392	0.141	0.003	0.075
my8035_rel.cz10a_bee		99.417	0.444	0.137	0.003	0.069
my8035_rel.cz10aps0_bee		99.443	0.423	0.131	0.003	0.070
my8035_rel_lessps.cz10a_bee		99.451	0.401	0.146	0.002	0.068
my8035_rel_lessps.cz10aps0_bee		99.448	0.407	0.142	0.003	0.073
my8036_rel.cz10a_bee		99.421	0.453	0.123	0.003	0.074

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
103448	0	905	3.5	317.3	31.2	0.009	0.035	0.003	0.309	12308	22.8	0.119	18	2.0	18.5	2.5	0.100	104188	88828	my5621_rel.cz10a_bee
98361	0	854	3.3	300.4	29.8	0.009	0.035	0.003	0.310	11975	22.3	0.122	18	2.0	18.5	2.6	0.098	99116	87333	my5631_rel.cz10a_bee
98039	0	857	3.3	299.9	29.5	0.009	0.035	0.003	0.309	11906	22.5	0.121	18	2.0	18.5	2.6	0.100	98410	84327	my5641_rel.cz10a_bee
100000	0	878	3.4	305.1	30.4	0.009	0.035	0.003	0.311	12305	22.5	0.123	18	2.0	18.5	2.7	0.097	100604	87340	my5651_rel.cz10a_bee
86207	0	0	0.0	280.5	26.1	0.000	0.000	0.003	0.310	9029	21.8	0.105	20	2.0	18.5	2.8	0.118	86605	76444	my5710_rel.cz10a_bee
87209	0	0	0.0	283.8	26.5	0.000	0.000	0.003	0.311	9123	22.1	0.105	20	2.0	18.5	2.9	0.105	87805	76814	my5720_rel.cz10a_bee
84270	0	0	0.0	278.4	25.9	0.000	0.000	0.003	0.315	8844	21.6	0.105	21	2.0	18.5	2.9	0.111	84757	74217	my5730_rel.cz10a_bee
83799	0	0	0.0	276.1	25.8	0.000	0.000	0.003	0.315	8808	21.5	0.105	21	2.0	18.5	2.9	0.111	84512	73232	my5744_rel.cz10a_bee
70588	0	613	2.4	256.1	23.3	0.009	0.035	0.004	0.339	57300	35.1	0.812	40	2.0	18.5	3.1	0.059	70922	64363	my8013_rel.cz10a_bee
70422	0	583	2.3	256.8	23.2	0.008	0.033	0.004	0.338	20363	22.8	0.289	26	2.0	18.5	3.1	0.070	70231	63472	my8014_rel.cz10a_bee
65646	0	0	0.0	274.3	21.4	0.000	0.000	0.004	0.334	17552	22.4	0.267	27	2.0	18.5	3.1	0.088	66089	58459	my8020_rel.cz10a_bee
63966	0	0	0.0	263.3	20.9	0.000	0.000	0.004	0.334	7024	20.9	0.110	26	2.0	18.6	3.0	0.075	64328	58433	my8028_rel.cz10a_bee
56818	0	0	0.0	245.3	18.9	0.000	0.000	0.004	0.341	6455	20.5	0.114	29	2.0	18.6	3.1	0.069	56876	51241	my8035_rel.cz10a_bee
59172	0	0	0.0	256.4	19.8	0.000	0.000	0.004	0.342	6771	21.2	0.114	29	2.0	18.6	2.9	0.070	59535	53057	my8035_rel.cz10aps0_bee
60606	0	0	0.0	260.9	20.2	0.000	0.000	0.004	0.342	6906	20.7	0.114	27	2.0	18.6	2.7	0.068	60833	55150	my8035_rel_lessps.cz10a_bee
60484	0	0	0.0	261.5	20.2	0.000	0.000	0.004	0.342	6896	20.7	0.114	27	2.0	18.6	2.7	0.073	60833	54869	my8035_rel_lessps.cz10aps0_bee
57252	0	0	0.0	246.6	19.1	0.000	0.000	0.004	0.341	6585	20.8	0.115	29	2.0	18.6	3.1	0.074	57337	52241	my8036_rel.cz10a_bee

l.x

l.x: create secondary indexes.

Average throughput:

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
101352	0	15	0.1	855.6	105.4	0.000	0.001	0.008	1.065	2393	11.2	0.024	9	4.2	20.7	4.6	0.002	NA	NA	my5621_rel.cz10a_bee
102740	0	12	0.0	861.7	107.4	0.000	0.000	0.008	1.071	2438	11.4	0.024	9	4.2	20.7	4.6	0.002	NA	NA	my5631_rel.cz10a_bee
100000	0	13	0.1	831.1	103.5	0.000	0.001	0.008	1.060	2328	11.4	0.023	9	4.2	20.7	4.9	0.002	NA	NA	my5641_rel.cz10a_bee
107914	0	11	0.0	858.6	111.7	0.000	0.000	0.008	1.059	2532	11.6	0.023	9	4.2	20.7	4.8	0.002	NA	NA	my5651_rel.cz10a_bee
149254	0	0	0.0	1539.6	144.6	0.000	0.000	0.010	0.992	9586	12.5	0.064	7	4.6	21.1	4.4	0.002	NA	NA	my5710_rel.cz10a_bee
150000	0	0	0.0	1681.2	146.5	0.000	0.000	0.011	1.000	9892	12.5	0.066	7	4.6	21.1	4.4	0.002	NA	NA	my5720_rel.cz10a_bee
148515	0	0	0.0	1370.0	141.3	0.000	0.000	0.009	0.974	8939	12.3	0.060	7	4.6	21.1	4.4	0.002	NA	NA	my5730_rel.cz10a_bee
146342	0	0	0.0	1518.2	141.4	0.000	0.000	0.010	0.989	9446	12.4	0.065	7	4.6	21.1	4.4	0.002	NA	NA	my5744_rel.cz10a_bee
136987	0	0	0.0	1192.5	128.8	0.000	0.000	0.009	0.963	12243	14.1	0.089	8	4.5	21.1	4.9	0.003	NA	NA	my8013_rel.cz10a_bee
133929	0	0	0.0	1176.9	126.9	0.000	0.000	0.009	0.970	8848	12.3	0.066	7	4.5	21.1	4.7	0.003	NA	NA	my8014_rel.cz10a_bee
129311	0	0	0.0	1381.5	119.5	0.000	0.000	0.011	0.947	8607	11.9	0.067	7	4.5	21.1	3.9	0.003	NA	NA	my8020_rel.cz10a_bee
151516	0	777	49.1	2832.3	166.9	0.005	0.332	0.019	1.128	10549	44.1	0.070	23	4.5	21.1	4.5	0.003	NA	NA	my8028_rel.cz10a_bee
138249	0	704	44.5	2806.3	155.1	0.005	0.330	0.020	1.149	10192	42.9	0.074	25	4.5	21.1	5.3	0.003	NA	NA	my8035_rel.cz10a_bee
206897	0	1045	66.1	4306.5	231.8	0.005	0.327	0.021	1.147	15107	40.4	0.073	16	4.5	21.1	4.1	0.003	NA	NA	my8035_rel.cz10aps0_bee
209791	0	1082	68.4	4149.8	235.2	0.005	0.334	0.020	1.148	14760	40.3	0.070	15	4.5	21.1	4.2	0.006	NA	NA	my8035_rel_lessps.cz10a_bee
206897	0	1083	68.4	3552.3	225.8	0.005	0.339	0.017	1.118	13598	40.2	0.066	16	4.5	21.1	4.2	0.003	NA	NA	my8035_rel_lessps.cz10aps0_bee
136987	0	705	44.6	2541.8	151.0	0.005	0.333	0.019	1.129	9646	43.3	0.070	25	4.5	21.1	5.3	0.004	NA	NA	my8036_rel.cz10a_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	95.085	4.732	0.182	0.001	0.109
my5631_rel.cz10a_bee	94.656	5.163	0.180	nonzero	0.110
my5641_rel.cz10a_bee	94.592	5.229	0.178	nonzero	0.103
my5651_rel.cz10a_bee	94.834	4.986	0.179	nonzero	0.101
my5710_rel.cz10a_bee	97.367	2.603	0.027	0.003	0.098
my5720_rel.cz10a_bee	96.925	3.047	0.025	0.003	0.093
my5730_rel.cz10a_bee	96.991	2.937	0.069	0.003	0.086
my5744_rel.cz10a_bee	96.978	2.950	0.069	0.003	0.083
my8013_rel.cz10a_bee	97.371	2.258	0.361	0.010	0.126
my8014_rel.cz10a_bee	96.571	3.077	0.347	0.006	0.133
my8020_rel.cz10a_bee	96.935	2.704	0.323	0.039	0.184
my8028_rel.cz10a_bee	97.338	2.558	0.101	0.002	0.103
my8035_rel.cz10a_bee	96.182	3.671	0.146	0.001	0.112
my8035_rel.cz10aps0_bee	96.339	3.515	0.145	0.001	0.104
my8035_rel_lessps.cz10a_bee	96.510	3.346	0.144	nonzero	0.080
my8035_rel_lessps.cz10aps0_bee	96.498	3.357	0.144	0.001	0.104
my8036_rel.cz10a_bee	96.192	3.661	0.146	0.001	0.104

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	96.362	3.476	0.161	0.001	0.076
my5631_rel.cz10a_bee	96.240	3.607	0.152		0.062
my5641_rel.cz10a_bee	96.139	3.714	0.147		0.061
my5651_rel.cz10a_bee	96.295	3.556	0.149	nonzero	0.073
my5710_rel.cz10a_bee	98.247	1.740	0.010	0.003	0.103
my5720_rel.cz10a_bee	97.768	2.219	0.010	0.003	0.093
my5730_rel.cz10a_bee	97.784	2.195	0.018	0.003	0.087
my5744_rel.cz10a_bee	97.721	2.261	0.015	0.003	0.088
my8013_rel.cz10a_bee	98.560	1.187	0.247	0.006	0.118
my8014_rel.cz10a_bee	97.899	1.836	0.262	0.004	0.102
my8020_rel.cz10a_bee	98.447	1.263	0.267	0.024	0.161
my8028_rel.cz10a_bee	98.324	1.648	0.026	0.002	0.102
my8035_rel.cz10a_bee	97.945	2.014	0.041	nonzero	0.102
my8035_rel.cz10aps0_bee	97.949	2.007	0.043	0.001	0.103
my8035_rel_lessps.cz10a_bee	97.962	1.996	0.042		0.063
my8035_rel_lessps.cz10aps0_bee	97.958	1.999	0.042	0.001	0.105
my8036_rel.cz10a_bee	97.925	2.033	0.042	0.001	0.103

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
18527	0	625	2.4	1842.3	81.7	0.034	0.135	0.099	4.516	15706	34.5	0.848	149	6.2	22.7	6.8	0.109	19579	5894	my5621_rel.cz10a_bee
17969	0	601	2.3	1794.6	79.4	0.033	0.134	0.100	4.527	15532	34.2	0.864	152	6.1	22.6	6.8	0.110	19029	5547	my5631_rel.cz10a_bee
17905	0	602	2.3	1794.8	79.4	0.034	0.134	0.100	4.543	15492	34.3	0.865	153	6.1	22.6	6.8	0.103	18979	5394	my5641_rel.cz10a_bee
18124	0	611	2.4	1818.4	80.4	0.034	0.135	0.100	4.545	15570	34.4	0.859	152	6.2	22.7	6.8	0.101	19229	5644	my5651_rel.cz10a_bee
20942	0	0	0.0	2069.2	89.8	0.000	0.000	0.099	4.390	15157	38.3	0.724	146	6.7	23.3	7.8	0.098	21475	7641	my5710_rel.cz10a_bee
20555	0	0	0.0	2074.2	90.6	0.000	0.000	0.101	4.512	15139	38.5	0.737	150	6.6	23.1	7.7	0.093	21277	7293	my5720_rel.cz10a_bee
20460	0	0	0.0	2058.3	90.5	0.000	0.000	0.101	4.528	15103	38.2	0.738	149	6.5	23.0	7.6	0.086	21226	7741	my5730_rel.cz10a_bee
20418	0	0	0.0	2062.5	90.8	0.000	0.000	0.101	4.555	15073	37.9	0.738	148	6.5	23.0	7.6	0.083	21127	8441	my5744_rel.cz10a_bee
18544	0	0	0.0	1812.2	79.5	0.000	0.000	0.098	4.388	65561	50.2	3.535	217	6.6	23.4	7.9	0.126	19177	6199	my8013_rel.cz10a_bee
17683	0	0	0.0	1757.2	76.6	0.000	0.000	0.099	4.437	30762	38.5	1.740	174	6.6	23.4	7.9	0.133	18282	5444	my8014_rel.cz10a_bee
17338	0	63	1.0	2049.7	75.9	0.004	0.058	0.118	4.482	29743	37.8	1.715	174	6.4	23.1	7.6	0.184	18329	5094	my8020_rel.cz10a_bee
19029	0	69	1.1	2239.0	83.0	0.004	0.058	0.118	4.466	14942	37.2	0.785	156	6.5	23.2	7.7	0.103	19829	5941	my8028_rel.cz10a_bee
16928	0	62	1.0	2599.2	97.6	0.004	0.058	0.154	5.903	15444	36.8	0.912	174	6.5	23.2	7.8	0.112	17730	5094	my8035_rel.cz10a_bee
17331	0	63	1.0	2683.8	100.3	0.004	0.058	0.155	5.925	15885	37.0	0.917	171	6.5	23.3	7.6	0.104	18180	5097	my8035_rel.cz10aps0_bee
17825	0	65	1.0	2765.3	103.4	0.004	0.058	0.155	5.939	16300	37.1	0.914	167	6.5	23.3	7.5	0.080	18729	4744	my8035_rel_lessps.cz10a_bee
17723	0	64	1.0	2697.9	101.5	0.004	0.058	0.152	5.865	16044	37.0	0.905	167	6.5	23.3	7.4	0.104	18580	5148	my8035_rel_lessps.cz10aps0_bee
16906	0	61	1.0	2643.1	98.7	0.004	0.058	0.156	5.979	15567	36.8	0.921	174	6.5	23.2	7.8	0.104	17680	5194	my8036_rel.cz10a_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	13.649	86.108	0.040	0.200	0.001	nonzero	0.079
my5631_rel.cz10a_bee	10.344	89.396	0.052	0.207	0.001		0.049
my5641_rel.cz10a_bee	9.774	89.966	0.050	0.209	0.001		0.049
my5651_rel.cz10a_bee	10.521	89.230	0.048	0.200	0.001	nonzero	0.067
my5710_rel.cz10a_bee	0.142	99.604	0.052	0.201	0.001	nonzero	0.078
my5720_rel.cz10a_bee	0.084	99.639	0.060	0.216	0.001	nonzero	0.075
my5730_rel.cz10a_bee	0.026	99.712	0.046	0.214	0.001	nonzero	0.074
my5744_rel.cz10a_bee	0.038	99.678	0.055	0.228	0.001	nonzero	0.074
my8013_rel.cz10a_bee		99.731	0.071	0.189	0.008	0.001	0.077
my8014_rel.cz10a_bee		99.733	0.081	0.182	0.003	0.001	0.077
my8020_rel.cz10a_bee		99.814	0.045	0.137	0.004	0.001	0.085
my8028_rel.cz10a_bee		99.711	0.080	0.207	0.001	nonzero	0.101
my8035_rel.cz10a_bee		99.555	0.213	0.230	0.002	nonzero	0.102
my8035_rel.cz10aps0_bee		99.627	0.150	0.220	0.002	nonzero	0.102
my8035_rel_lessps.cz10a_bee		99.646	0.133	0.219	0.002	nonzero	0.102
my8035_rel_lessps.cz10aps0_bee		99.644	0.135	0.219	0.002	nonzero	0.101
my8036_rel.cz10a_bee		99.547	0.219	0.232	0.002	nonzero	0.102

dbms	256us	1ms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	13.822	85.943	0.033	0.200	0.001	nonzero	0.079
my5631_rel.cz10a_bee	13.423	86.334	0.035	0.206	0.001		0.049
my5641_rel.cz10a_bee	12.547	87.208	0.035	0.209	0.001		0.048
my5651_rel.cz10a_bee	13.917	85.849	0.033	0.200	0.001	nonzero	0.068
my5710_rel.cz10a_bee	0.169	99.605	0.024	0.201	0.001	nonzero	0.079
my5720_rel.cz10a_bee	0.053	99.707	0.023	0.215	0.001	nonzero	0.075
my5730_rel.cz10a_bee	0.066	99.696	0.024	0.213	0.001	nonzero	0.074
my5744_rel.cz10a_bee	0.158	99.583	0.033	0.226	0.001	nonzero	0.074
my8013_rel.cz10a_bee		99.783	0.028	0.180	0.008	0.001	0.077
my8014_rel.cz10a_bee		99.786	0.032	0.178	0.003	0.001	0.077
my8020_rel.cz10a_bee		99.848	0.016	0.132	0.003	0.001	0.086
my8028_rel.cz10a_bee		99.768	0.026	0.204	0.001	nonzero	0.101
my8035_rel.cz10a_bee		99.696	0.073	0.229	0.002	nonzero	0.102
my8035_rel.cz10aps0_bee		99.739	0.041	0.217	0.002	nonzero	0.102
my8035_rel_lessps.cz10a_bee		99.742	0.038	0.217	0.002	nonzero	0.102
my8035_rel_lessps.cz10aps0_bee		99.745	0.036	0.216	0.002	nonzero	0.101
my8036_rel.cz10a_bee		99.701	0.069	0.227	0.002	nonzero	0.102

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
12165	0	2192	8.6	1242.9	51.8	0.180	0.721	0.102	4.360	58349	36.3	4.796	239	6.2	22.7	6.8	0.079	12202	10818	my5621_rel.cz10a_bee
11962	0	2153	8.4	1259.6	52.0	0.180	0.720	0.105	4.454	57575	36.3	4.813	243	6.1	22.6	6.8	0.049	11991	10886	my5631_rel.cz10a_bee
11919	0	2146	8.4	1251.2	51.7	0.180	0.720	0.105	4.441	57422	36.3	4.818	244	6.2	22.7	6.8	0.049	11947	10788	my5641_rel.cz10a_bee
12106	0	2177	8.5	1192.4	50.2	0.180	0.719	0.098	4.242	57886	36.2	4.781	239	6.2	22.7	6.8	0.067	12100	10983	my5651_rel.cz10a_bee
10941	0	0	0.0	1132.1	46.9	0.000	0.000	0.103	4.389	49107	37.5	4.488	274	6.7	23.3	7.8	0.078	10918	9404	my5710_rel.cz10a_bee
10753	0	0	0.0	1120.6	46.5	0.000	0.000	0.104	4.426	48816	37.2	4.540	277	6.6	23.1	7.7	0.075	10778	9329	my5720_rel.cz10a_bee
10753	0	0	0.0	1139.0	47.0	0.000	0.000	0.106	4.475	48991	37.1	4.556	276	6.5	23.0	7.6	0.074	10733	9124	my5730_rel.cz10a_bee
10504	0	0	0.0	1111.1	46.0	0.000	0.000	0.106	4.482	44436	36.2	4.230	276	6.5	23.0	7.6	0.074	10518	9153	my5744_rel.cz10a_bee
10730	0	0	0.0	1084.7	46.0	0.000	0.000	0.101	4.388	88692	49.4	8.266	368	6.6	23.4	8.0	0.077	10781	8721	my8013_rel.cz10a_bee
10661	0	0	0.0	1114.2	46.9	0.000	0.000	0.105	4.500	88122	49.7	8.266	373	6.6	23.4	8.0	0.077	10693	8806	my8014_rel.cz10a_bee
10330	0	0	0.0	1252.2	44.2	0.000	0.000	0.121	4.377	75151	48.8	7.275	378	6.4	23.1	7.6	0.085	10386	8683	my8020_rel.cz10a_bee
9242	0	0	0.0	1185.4	41.0	0.000	0.000	0.128	4.543	39706	35.3	4.296	306	6.5	23.2	7.8	0.101	9247	8136	my8028_rel.cz10a_bee
8584	0	0	0.0	1380.0	47.9	0.000	0.000	0.161	5.711	37651	35.1	4.386	327	6.5	23.2	7.8	0.102	8611	7661	my8035_rel.cz10a_bee
9042	0	0	0.0	1392.3	48.8	0.000	0.000	0.154	5.523	39499	35.3	4.369	312	6.5	23.3	7.6	0.102	9050	7832	my8035_rel.cz10aps0_bee
9320	0	0	0.0	1464.5	51.1	0.000	0.000	0.157	5.619	40774	35.4	4.375	304	6.5	23.3	7.5	0.102	9355	8126	my8035_rel_lessps.cz10a_bee
9242	0	0	0.0	1462.5	50.9	0.000	0.000	0.158	5.641	40534	35.4	4.386	306	6.5	23.3	7.5	0.101	9305	7981	my8035_rel_lessps.cz10aps0_bee
8584	0	0	0.0	1354.8	47.2	0.000	0.000	0.158	5.626	37636	35.0	4.385	326	6.5	23.2	7.8	0.102	8615	7567	my8036_rel.cz10a_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	96.549	3.445	0.002	0.004	nonzero	0.017
my5631_rel.cz10a_bee	96.320	3.674	0.002	0.004	nonzero	0.022
my5641_rel.cz10a_bee	96.317	3.677	0.002	0.003	nonzero	0.017
my5651_rel.cz10a_bee	96.223	3.771	0.003	0.004	nonzero	0.023
my5710_rel.cz10a_bee	73.134	26.865	nonzero	nonzero		0.005
my5720_rel.cz10a_bee	72.645	27.355	nonzero			0.003
my5730_rel.cz10a_bee	70.938	29.061	nonzero	nonzero		0.008
my5744_rel.cz10a_bee	70.406	29.594	nonzero	nonzero		0.004
my8013_rel.cz10a_bee	58.362	41.638	nonzero			0.003
my8014_rel.cz10a_bee	55.771	44.229	nonzero			0.002
my8020_rel.cz10a_bee	42.533	57.466	nonzero			0.003
my8028_rel.cz10a_bee	31.781	68.218	0.001	nonzero		0.007
my8035_rel.cz10a_bee	53.764	46.235	0.001			0.004
my8035_rel.cz10aps0_bee	66.039	33.960	0.001			0.004
my8035_rel_lessps.cz10a_bee	70.136	29.863	0.001	nonzero		0.005
my8035_rel_lessps.cz10aps0_bee	68.855	31.144	0.001	nonzero		0.005
my8036_rel.cz10a_bee	51.457	48.543	0.001	nonzero		0.005

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	42.806	52.806	4.389	0.038
my5631_rel.cz10a_bee	42.778	51.694	5.528	0.040
my5641_rel.cz10a_bee	44.750	52.111	3.139	0.037
my5651_rel.cz10a_bee	41.222	53.556	5.222	0.033
my5710_rel.cz10a_bee	99.444	0.556		0.015
my5720_rel.cz10a_bee	99.500	0.500		0.013
my5730_rel.cz10a_bee	98.250	1.639	0.111	0.028
my5744_rel.cz10a_bee	99.583	0.417		0.009
my8013_rel.cz10a_bee	94.250	5.611	0.139	0.026
my8014_rel.cz10a_bee	95.417	4.583		0.015
my8020_rel.cz10a_bee	95.194	4.778	0.028	0.020
my8028_rel.cz10a_bee	98.250	1.750		0.016
my8035_rel.cz10a_bee	99.750	0.250		0.014
my8035_rel.cz10aps0_bee	99.250	0.750		0.016
my8035_rel_lessps.cz10a_bee	99.778	0.194	0.028	0.025
my8035_rel_lessps.cz10aps0_bee	98.722	1.250	0.028	0.019
my8036_rel.cz10a_bee	97.750	2.139	0.111	0.019

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	42.806	54.972	2.222	0.031
my5631_rel.cz10a_bee	41.611	55.639	2.750	0.033
my5641_rel.cz10a_bee	44.889	53.694	1.417	0.029
my5651_rel.cz10a_bee	41.444	56.167	2.389	0.042
my5710_rel.cz10a_bee	99.417	0.583		0.012
my5720_rel.cz10a_bee	99.611	0.389		0.014
my5730_rel.cz10a_bee	98.611	1.333	0.056	0.023
my5744_rel.cz10a_bee	99.639	0.361		0.009
my8013_rel.cz10a_bee	96.250	3.722	0.028	0.018
my8014_rel.cz10a_bee	97.167	2.833		0.015
my8020_rel.cz10a_bee	96.833	3.167		0.014
my8028_rel.cz10a_bee	98.528	1.417	0.056	0.019
my8035_rel.cz10a_bee	99.889	0.111		0.008
my8035_rel.cz10aps0_bee	99.361	0.639		0.009
my8035_rel_lessps.cz10a_bee	99.806	0.194		0.008
my8035_rel_lessps.cz10aps0_bee	98.889	1.111		0.014
my8036_rel.cz10a_bee	98.111	1.889		0.015

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	5688	4	0.0	524.2	15.7	0.001	0.003	5.253	160.667	23529	13.0	4.136	183	6.2	22.7	6.8	0.017	5642	5466	my5621_rel.cz10a_bee
100	5577	4	0.0	527.1	15.8	0.001	0.003	5.282	161.639	23156	13.1	4.152	188	6.1	22.6	6.8	0.022	5532	5370	my5631_rel.cz10a_bee
100	5592	4	0.0	517.6	15.5	0.001	0.003	5.187	158.930	23167	13.1	4.143	187	6.2	22.7	6.8	0.017	5549	5386	my5641_rel.cz10a_bee
100	5570	4	0.0	545.9	16.3	0.001	0.003	5.475	167.560	23178	13.2	4.161	190	6.2	22.7	6.8	0.023	5530	5354	my5651_rel.cz10a_bee
100	4237	0	0.0	113.7	3.2	0.000	0.000	1.140	32.916	16728	12.6	3.948	238	6.7	23.3	7.8	0.005	4190	3979	my5710_rel.cz10a_bee
100	4187	0	0.0	103.1	2.9	0.000	0.000	1.034	29.747	16501	12.6	3.941	241	6.6	23.1	7.7	0.003	4139	3916	my5720_rel.cz10a_bee
100	4158	0	0.0	109.7	3.1	0.000	0.000	1.101	31.727	16416	12.6	3.948	242	6.5	23.0	7.6	0.008	4093	3915	my5730_rel.cz10a_bee
100	4124	0	0.0	109.6	3.1	0.000	0.000	1.098	31.589	16287	12.5	3.949	242	6.5	23.0	7.6	0.004	4072	3869	my5744_rel.cz10a_bee
100	3637	0	0.0	145.7	4.1	0.000	0.000	1.461	41.735	15948	13.2	4.385	290	6.6	23.4	8.0	0.003	3626	3421	my8013_rel.cz10a_bee
100	3594	0	0.0	124.6	3.4	0.000	0.000	1.249	35.243	15046	13.1	4.186	292	6.6	23.4	8.0	0.002	3564	3388	my8014_rel.cz10a_bee
100	3408	0	0.0	132.4	3.2	0.000	0.000	1.326	32.960	14248	12.9	4.181	303	6.4	23.1	7.6	0.003	3387	3180	my8020_rel.cz10a_bee
100	3254	0	0.0	140.3	3.5	0.000	0.000	1.406	35.874	13055	12.5	4.012	307	6.5	23.2	7.8	0.007	3228	3084	my8028_rel.cz10a_bee
100	3554	0	0.0	131.6	3.3	0.000	0.000	1.320	34.220	14368	12.7	4.043	286	6.5	23.2	7.8	0.004	3530	3340	my8035_rel.cz10a_bee
100	3955	0	0.0	131.7	3.3	0.000	0.000	1.320	33.720	15884	12.9	4.016	261	6.5	23.3	7.6	0.004	3912	3678	my8035_rel.cz10aps0_bee
100	4080	0	0.0	140.8	3.5	0.000	0.000	1.411	36.174	16393	13.0	4.018	255	6.5	23.3	7.5	0.005	4043	3805	my8035_rel_lessps.cz10a_bee
100	4048	0	0.0	138.7	3.5	0.000	0.000	1.391	35.692	16273	13.2	4.020	261	6.5	23.3	7.5	0.005	4008	3772	my8035_rel_lessps.cz10aps0_bee
100	3526	0	0.0	126.6	3.2	0.000	0.000	1.270	32.756	14246	12.7	4.041	288	6.5	23.2	7.8	0.005	3487	3310	my8036_rel.cz10a_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	94.712	5.283	0.003	0.002	nonzero	0.018
my5631_rel.cz10a_bee	93.673	6.322	0.003	0.002	nonzero	0.022
my5641_rel.cz10a_bee	93.887	6.109	0.003	0.002	nonzero	0.017
my5651_rel.cz10a_bee	94.197	5.797	0.003	0.003	nonzero	0.017
my5710_rel.cz10a_bee	87.925	12.073	0.002	nonzero		0.006
my5720_rel.cz10a_bee	86.136	13.861	0.002	nonzero		0.006
my5730_rel.cz10a_bee	84.521	15.477	0.002	nonzero		0.005
my5744_rel.cz10a_bee	83.898	16.101	0.001			0.004
my8013_rel.cz10a_bee	30.307	69.692	0.001	nonzero		0.007
my8014_rel.cz10a_bee	18.609	81.390	0.001			0.003
my8020_rel.cz10a_bee	19.745	80.254	0.002			0.003
my8028_rel.cz10a_bee	14.746	85.253	0.001			0.003
my8035_rel.cz10a_bee	12.571	87.428	0.001			0.004
my8035_rel.cz10aps0_bee	14.840	85.158	0.001	nonzero		0.005
my8035_rel_lessps.cz10a_bee	7.309	92.690	0.001			0.004
my8035_rel_lessps.cz10aps0_bee	14.102	85.897	0.001			0.003
my8036_rel.cz10a_bee	11.628	88.371	0.001	nonzero		0.004

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	49.250	47.833	2.917	0.040
my5631_rel.cz10a_bee	48.972	47.944	3.083	0.044
my5641_rel.cz10a_bee	49.111	47.500	3.389	0.041
my5651_rel.cz10a_bee	46.389	48.861	4.750	0.052
my5710_rel.cz10a_bee	99.389	0.611		0.015
my5720_rel.cz10a_bee	99.472	0.528		0.009
my5730_rel.cz10a_bee	99.611	0.389		0.016
my5744_rel.cz10a_bee	99.500	0.500		0.013
my8013_rel.cz10a_bee	94.444	5.472	0.083	0.021
my8014_rel.cz10a_bee	95.111	4.861	0.028	0.017
my8020_rel.cz10a_bee	95.222	4.750	0.028	0.020
my8028_rel.cz10a_bee	99.528	0.472		0.016
my8035_rel.cz10a_bee	99.639	0.361		0.014
my8035_rel.cz10aps0_bee	99.750	0.222	0.028	0.025
my8035_rel_lessps.cz10a_bee	99.500	0.500		0.014
my8035_rel_lessps.cz10aps0_bee	99.806	0.194		0.014
my8036_rel.cz10a_bee	99.722	0.278		0.014

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	48.361	49.806	1.833	0.037
my5631_rel.cz10a_bee	48.194	50.222	1.583	0.033
my5641_rel.cz10a_bee	48.417	49.667	1.917	0.037
my5651_rel.cz10a_bee	44.750	53.194	2.056	0.033
my5710_rel.cz10a_bee	99.389	0.611		0.012
my5720_rel.cz10a_bee	99.500	0.500		0.008
my5730_rel.cz10a_bee	99.667	0.333		0.016
my5744_rel.cz10a_bee	99.444	0.556		0.013
my8013_rel.cz10a_bee	97.000	3.000		0.014
my8014_rel.cz10a_bee	96.333	3.667		0.014
my8020_rel.cz10a_bee	96.444	3.556		0.014
my8028_rel.cz10a_bee	99.583	0.417		0.008
my8035_rel.cz10a_bee	99.722	0.278		0.009
my8035_rel.cz10aps0_bee	99.806	0.194		0.007
my8035_rel_lessps.cz10a_bee	99.556	0.444		0.009
my8035_rel_lessps.cz10aps0_bee	99.861	0.139		0.008
my8036_rel.cz10a_bee	99.778	0.222		0.008

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	4652	4	0.0	560.8	16.8	0.001	0.004	5.625	172.263	20635	13.1	4.436	225	6.2	22.7	6.8	0.018	4619	4350	my5621_rel.cz10a_bee
100	4558	4	0.0	533.0	15.9	0.001	0.004	5.346	163.477	20220	13.7	4.436	240	6.1	22.6	6.8	0.022	4519	4253	my5631_rel.cz10a_bee
100	4563	4	0.0	528.8	15.8	0.001	0.004	5.304	162.211	20225	13.5	4.432	237	6.2	22.7	6.8	0.017	4507	4242	my5641_rel.cz10a_bee
100	4574	4	0.0	520.4	15.5	0.001	0.004	5.220	159.592	20225	13.2	4.421	231	6.2	22.7	6.8	0.017	4554	4286	my5651_rel.cz10a_bee
100	3924	0	0.0	24.0	0.5	0.000	0.000	0.241	5.358	16049	13.3	4.090	271	6.7	23.3	7.8	0.006	3836	3596	my5710_rel.cz10a_bee
100	3833	0	0.0	26.2	0.6	0.000	0.000	0.263	5.984	15683	13.4	4.092	280	6.6	23.1	7.7	0.006	3756	3564	my5720_rel.cz10a_bee
100	3796	0	0.0	25.8	0.6	0.000	0.000	0.258	5.872	15534	14.0	4.092	295	6.5	23.0	7.6	0.005	3708	3484	my5730_rel.cz10a_bee
100	3768	0	0.0	24.1	0.5	0.000	0.000	0.242	5.410	15446	13.8	4.100	293	6.5	23.0	7.6	0.004	3675	3436	my5744_rel.cz10a_bee
100	3275	0	0.0	33.1	0.7	0.000	0.000	0.332	7.251	14878	14.1	4.542	344	6.6	23.4	8.0	0.007	3101	2861	my8013_rel.cz10a_bee
100	3106	0	0.0	36.4	0.8	0.000	0.000	0.365	8.101	13515	13.2	4.352	340	6.6	23.4	8.0	0.003	3002	2797	my8014_rel.cz10a_bee
100	3091	0	0.0	30.0	0.6	0.000	0.000	0.301	6.435	13462	13.5	4.355	349	6.4	23.1	7.6	0.003	2943	2749	my8020_rel.cz10a_bee
100	3058	0	0.0	30.7	0.7	0.000	0.000	0.308	7.640	12610	13.3	4.124	348	6.5	23.2	7.8	0.003	2956	2765	my8028_rel.cz10a_bee
100	2826	0	0.0	33.3	0.9	0.000	0.000	0.334	8.778	11880	13.4	4.204	379	6.5	23.2	7.8	0.004	2703	2572	my8035_rel.cz10a_bee
100	3056	0	0.0	34.5	0.9	0.000	0.000	0.346	9.005	12790	13.6	4.185	356	6.5	23.3	7.6	0.005	2937	2765	my8035_rel.cz10aps0_bee
100	3011	0	0.0	34.8	0.9	0.000	0.000	0.349	9.236	12622	12.8	4.192	340	6.5	23.3	7.5	0.004	2975	2813	my8035_rel_lessps.cz10a_bee
100	3099	0	0.0	41.7	1.0	0.000	0.000	0.417	10.733	12998	13.8	4.194	356	6.5	23.3	7.5	0.003	3021	2829	my8035_rel_lessps.cz10aps0_bee
100	2814	0	0.0	33.3	0.9	0.000	0.000	0.334	8.764	11828	13.4	4.204	381	6.5	23.2	7.8	0.004	2717	2573	my8036_rel.cz10a_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	96.529	3.466	0.002	0.003		0.016
my5631_rel.cz10a_bee	96.282	3.713	0.002	0.003		0.016
my5641_rel.cz10a_bee	96.289	3.706	0.002	0.003	nonzero	0.016
my5651_rel.cz10a_bee	95.586	4.409	0.002	0.003		0.015
my5710_rel.cz10a_bee	71.909	28.090	nonzero	nonzero		0.007
my5720_rel.cz10a_bee	71.551	28.449	nonzero	nonzero		0.004
my5730_rel.cz10a_bee	71.811	28.189	0.001			0.003
my5744_rel.cz10a_bee	69.972	30.028	nonzero			0.003
my8013_rel.cz10a_bee	60.344	39.655	0.001	nonzero		0.005
my8014_rel.cz10a_bee	54.916	45.084	nonzero			0.003
my8020_rel.cz10a_bee	44.913	55.086	0.001			0.003
my8028_rel.cz10a_bee	30.766	69.233	0.001	nonzero		0.004
my8035_rel.cz10a_bee	53.141	46.858	0.001	nonzero		0.006
my8035_rel.cz10aps0_bee	64.397	35.602	0.001	nonzero		0.004
my8035_rel_lessps.cz10a_bee	70.810	29.189	0.001	nonzero		0.005
my8035_rel_lessps.cz10aps0_bee	67.852	32.147	0.001			0.004
my8036_rel.cz10a_bee	52.924	47.075	0.001			0.003

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	89.550	10.178	0.272	0.035
my5631_rel.cz10a_bee	89.650	10.183	0.167	0.035
my5641_rel.cz10a_bee	89.689	10.194	0.117	0.033
my5651_rel.cz10a_bee	89.739	10.128	0.133	0.029
my5710_rel.cz10a_bee	99.633	0.367		0.014
my5720_rel.cz10a_bee	99.417	0.583		0.014
my5730_rel.cz10a_bee	99.361	0.639		0.009
my5744_rel.cz10a_bee	99.556	0.444		0.012
my8013_rel.cz10a_bee	94.828	5.094	0.078	0.022
my8014_rel.cz10a_bee	95.111	4.856	0.033	0.021
my8020_rel.cz10a_bee	94.972	4.983	0.044	0.026
my8028_rel.cz10a_bee	99.711	0.278	0.011	0.022
my8035_rel.cz10a_bee	99.239	0.750	0.011	0.025
my8035_rel.cz10aps0_bee	99.283	0.706	0.011	0.026
my8035_rel_lessps.cz10a_bee	99.533	0.461	0.006	0.025
my8035_rel_lessps.cz10aps0_bee	99.550	0.439	0.011	0.025
my8036_rel.cz10a_bee	99.267	0.722	0.011	0.025

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	89.994	9.839	0.167	0.033
my5631_rel.cz10a_bee	90.161	9.694	0.144	0.025
my5641_rel.cz10a_bee	90.339	9.589	0.072	0.042
my5651_rel.cz10a_bee	90.278	9.644	0.078	0.024
my5710_rel.cz10a_bee	99.728	0.272		0.014
my5720_rel.cz10a_bee	99.639	0.361		0.012
my5730_rel.cz10a_bee	99.628	0.372		0.009
my5744_rel.cz10a_bee	99.667	0.333		0.010
my8013_rel.cz10a_bee	96.061	3.917	0.022	0.021
my8014_rel.cz10a_bee	96.406	3.567	0.028	0.019
my8020_rel.cz10a_bee	96.272	3.694	0.033	0.022
my8028_rel.cz10a_bee	99.761	0.239		0.014
my8035_rel.cz10a_bee	99.722	0.267	0.011	0.025
my8035_rel.cz10aps0_bee	99.617	0.372	0.011	0.024
my8035_rel_lessps.cz10a_bee	99.744	0.250	0.006	0.024
my8035_rel_lessps.cz10aps0_bee	99.772	0.222	0.006	0.024
my8036_rel.cz10a_bee	99.772	0.217	0.011	0.024

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	5671	17	0.1	287.1	9.1	0.003	0.012	0.576	18.720	22906	13.5	4.039	190	6.2	22.7	6.8	0.016	5629	5455	my5621_rel.cz10a_bee
499	5598	17	0.1	116.1	4.0	0.003	0.012	0.233	8.157	22090	13.5	3.946	193	6.1	22.6	6.8	0.016	5546	5370	my5631_rel.cz10a_bee
499	5601	17	0.1	69.5	2.6	0.003	0.012	0.139	5.274	22041	13.7	3.935	196	6.2	22.7	6.8	0.016	5562	5370	my5641_rel.cz10a_bee
499	5547	17	0.1	149.8	5.0	0.003	0.012	0.300	10.235	21975	13.4	3.962	193	6.2	22.7	6.8	0.015	5533	5419	my5651_rel.cz10a_bee
499	4222	0	0.0	57.9	1.9	0.000	0.000	0.116	3.954	16583	13.5	3.927	256	6.7	23.3	7.8	0.007	4172	3980	my5710_rel.cz10a_bee
499	4197	0	0.0	69.9	2.3	0.000	0.000	0.140	4.735	16532	13.6	3.939	259	6.6	23.1	7.7	0.004	4139	3946	my5720_rel.cz10a_bee
499	4211	0	0.0	62.2	2.1	0.000	0.000	0.125	4.266	16569	13.5	3.935	256	6.5	23.0	7.6	0.003	4141	3931	my5730_rel.cz10a_bee
499	4108	0	0.0	67.1	2.2	0.000	0.000	0.135	4.582	16193	13.5	3.942	263	6.5	23.0	7.6	0.003	4059	3868	my5744_rel.cz10a_bee
499	3694	0	0.0	57.4	1.8	0.000	0.000	0.115	3.748	17876	14.2	4.839	308	6.6	23.4	8.0	0.005	3661	3439	my8013_rel.cz10a_bee
499	3580	0	0.0	57.7	1.9	0.000	0.000	0.116	3.799	15262	14.0	4.263	313	6.6	23.4	8.0	0.003	3549	3358	my8014_rel.cz10a_bee
499	3443	0	0.0	77.5	2.3	0.000	0.000	0.155	4.658	14749	13.8	4.284	321	6.4	23.1	7.6	0.003	3421	3228	my8020_rel.cz10a_bee
499	3239	0	0.0	76.3	2.3	0.000	0.000	0.153	4.790	12897	13.4	3.982	331	6.5	23.2	7.8	0.004	3223	3070	my8028_rel.cz10a_bee
499	3540	0	0.0	88.2	2.8	0.000	0.000	0.177	5.704	14278	13.7	4.033	310	6.5	23.2	7.8	0.006	3516	3341	my8035_rel.cz10a_bee
499	3933	0	0.0	86.9	2.7	0.000	0.000	0.174	5.607	15775	13.9	4.011	283	6.5	23.3	7.6	0.004	3884	3675	my8035_rel.cz10aps0_bee
499	4123	0	0.0	84.2	2.7	0.000	0.000	0.169	5.502	16508	14.0	4.004	272	6.5	23.3	7.5	0.005	4059	3820	my8035_rel_lessps.cz10a_bee
499	4026	0	0.0	81.7	2.6	0.000	0.000	0.164	5.354	16118	13.9	4.003	276	6.5	23.3	7.5	0.004	3982	3756	my8035_rel_lessps.cz10aps0_bee
499	3550	0	0.0	86.6	2.7	0.000	0.000	0.173	5.618	14321	13.8	4.034	311	6.5	23.2	7.8	0.003	3516	3326	my8036_rel.cz10a_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	max
my5621_rel.cz10a_bee	93.944	6.048	0.006	0.002	0.014
my5631_rel.cz10a_bee	93.108	6.884	0.006	0.002	0.011
my5641_rel.cz10a_bee	93.923	6.070	0.006	0.001	0.010
my5651_rel.cz10a_bee	93.269	6.724	0.005	0.001	0.012
my5710_rel.cz10a_bee	83.306	16.688	0.006	nonzero	0.007
my5720_rel.cz10a_bee	82.921	17.073	0.006	nonzero	0.008
my5730_rel.cz10a_bee	83.558	16.438	0.004	nonzero	0.005
my5744_rel.cz10a_bee	81.915	18.080	0.005	nonzero	0.005
my8013_rel.cz10a_bee	26.779	73.217	0.004	nonzero	0.007
my8014_rel.cz10a_bee	22.326	77.671	0.003	nonzero	0.004
my8020_rel.cz10a_bee	14.725	85.272	0.003	nonzero	0.005
my8028_rel.cz10a_bee	13.469	86.525	0.005	nonzero	0.004
my8035_rel.cz10a_bee	11.958	88.039	0.003	nonzero	0.005
my8035_rel.cz10aps0_bee	9.055	90.940	0.005	nonzero	0.005
my8035_rel_lessps.cz10a_bee	14.168	85.828	0.004	nonzero	0.005
my8035_rel_lessps.cz10aps0_bee	11.174	88.821	0.005	nonzero	0.005
my8036_rel.cz10a_bee	11.759	88.236	0.005		0.004

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	89.161	10.706	0.133	0.023
my5631_rel.cz10a_bee	89.206	10.589	0.206	0.031
my5641_rel.cz10a_bee	88.722	11.172	0.106	0.022
my5651_rel.cz10a_bee	88.778	11.083	0.139	0.024
my5710_rel.cz10a_bee	99.544	0.456		0.015
my5720_rel.cz10a_bee	99.317	0.683		0.014
my5730_rel.cz10a_bee	99.500	0.500		0.011
my5744_rel.cz10a_bee	99.556	0.444		0.011
my8013_rel.cz10a_bee	94.922	5.006	0.072	0.021
my8014_rel.cz10a_bee	94.706	5.228	0.067	0.022
my8020_rel.cz10a_bee	94.628	5.306	0.067	0.024
my8028_rel.cz10a_bee	99.472	0.522	0.006	0.016
my8035_rel.cz10a_bee	98.694	1.289	0.017	0.025
my8035_rel.cz10aps0_bee	99.117	0.883		0.015
my8035_rel_lessps.cz10a_bee	99.306	0.689	0.006	0.025
my8035_rel_lessps.cz10aps0_bee	99.206	0.794		0.016
my8036_rel.cz10a_bee	98.817	1.172	0.011	0.025

dbms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	89.494	10.489	0.017	0.022
my5631_rel.cz10a_bee	89.978	9.911	0.111	0.027
my5641_rel.cz10a_bee	89.761	10.222	0.017	0.017
my5651_rel.cz10a_bee	89.206	10.739	0.056	0.028
my5710_rel.cz10a_bee	99.656	0.344		0.013
my5720_rel.cz10a_bee	99.561	0.439		0.014
my5730_rel.cz10a_bee	99.672	0.328		0.011
my5744_rel.cz10a_bee	99.661	0.339		0.011
my8013_rel.cz10a_bee	96.361	3.594	0.044	0.019
my8014_rel.cz10a_bee	96.256	3.711	0.033	0.021
my8020_rel.cz10a_bee	95.944	4.028	0.028	0.023
my8028_rel.cz10a_bee	99.578	0.422		0.016
my8035_rel.cz10a_bee	99.517	0.472	0.011	0.024
my8035_rel.cz10aps0_bee	99.661	0.339		0.015
my8035_rel_lessps.cz10a_bee	99.650	0.344	0.006	0.024
my8035_rel_lessps.cz10aps0_bee	99.594	0.406		0.013
my8036_rel.cz10a_bee	99.711	0.283	0.006	0.024

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	4641	17	0.1	134.4	4.5	0.004	0.014	0.269	9.262	19376	13.9	4.175	240	6.2	22.7	6.8	0.014	4586	4282	my5621_rel.cz10a_bee
499	4518	17	0.1	312.2	9.9	0.004	0.015	0.626	20.291	19488	13.7	4.314	243	6.1	22.6	6.8	0.011	4477	4218	my5631_rel.cz10a_bee
498	4605	17	0.1	314.3	9.9	0.004	0.014	0.631	20.392	19998	14.4	4.343	250	6.2	22.7	6.8	0.010	4539	4235	my5641_rel.cz10a_bee
495	4507	17	0.1	265.5	8.4	0.004	0.015	0.536	17.479	19407	13.9	4.306	247	6.2	22.7	6.8	0.012	4491	4219	my5651_rel.cz10a_bee
499	3780	0	0.0	80.8	2.6	0.000	0.000	0.162	5.406	15731	14.2	4.162	301	6.7	23.3	7.8	0.007	3708	3500	my5710_rel.cz10a_bee
499	3765	0	0.0	82.6	2.7	0.000	0.000	0.166	5.541	15687	13.8	4.166	293	6.6	23.1	7.7	0.008	3724	3516	my5720_rel.cz10a_bee
499	3790	0	0.0	85.4	2.8	0.000	0.000	0.171	5.744	15791	14.4	4.167	304	6.5	23.0	7.6	0.005	3707	3467	my5730_rel.cz10a_bee
499	3697	0	0.0	88.6	2.9	0.000	0.000	0.178	5.918	15456	13.9	4.181	301	6.5	23.0	7.6	0.005	3645	3420	my5744_rel.cz10a_bee
499	3200	0	0.0	86.0	2.7	0.000	0.000	0.173	5.625	16638	14.6	5.200	365	6.6	23.4	8.0	0.007	3100	2844	my8013_rel.cz10a_bee
499	3128	0	0.0	93.1	2.9	0.000	0.000	0.187	5.998	14278	14.3	4.565	366	6.6	23.4	8.0	0.004	3021	2813	my8014_rel.cz10a_bee
499	3002	0	0.0	94.8	2.7	0.000	0.000	0.190	5.492	13712	14.4	4.568	384	6.4	23.1	7.6	0.005	2909	2719	my8020_rel.cz10a_bee
499	3021	0	0.0	86.8	2.6	0.000	0.000	0.174	5.264	12716	13.7	4.209	363	6.5	23.2	7.8	0.004	2943	2780	my8028_rel.cz10a_bee
499	2814	0	0.0	91.2	2.8	0.000	0.000	0.183	5.806	12106	14.3	4.301	407	6.5	23.2	7.8	0.005	2716	2541	my8035_rel.cz10a_bee
499	2962	0	0.0	81.9	2.6	0.000	0.000	0.164	5.356	12651	13.8	4.271	373	6.5	23.3	7.6	0.005	2909	2736	my8035_rel.cz10aps0_bee
499	3066	0	0.0	98.4	3.0	0.000	0.000	0.197	6.192	13129	14.1	4.283	368	6.5	23.3	7.5	0.005	3005	2829	my8035_rel_lessps.cz10a_bee
499	3041	0	0.0	78.6	2.5	0.000	0.000	0.158	5.180	12963	14.0	4.263	368	6.5	23.3	7.5	0.005	2990	2814	my8035_rel_lessps.cz10aps0_bee
499	2825	0	0.0	84.1	2.7	0.000	0.000	0.169	5.477	12118	14.1	4.289	399	6.5	23.2	7.8	0.004	2732	2572	my8036_rel.cz10a_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	96.436	3.558	0.003	0.003	nonzero	0.017
my5631_rel.cz10a_bee	95.937	4.058	0.003	0.003		0.014
my5641_rel.cz10a_bee	95.938	4.054	0.004	0.003	nonzero	0.021
my5651_rel.cz10a_bee	96.047	3.945	0.006	0.003	nonzero	0.023
my5710_rel.cz10a_bee	73.741	26.258	0.001	nonzero		0.007
my5720_rel.cz10a_bee	71.787	28.212	0.001	nonzero		0.005
my5730_rel.cz10a_bee	71.627	28.372	0.001	nonzero		0.008
my5744_rel.cz10a_bee	70.707	29.292	0.001	nonzero		0.004
my8013_rel.cz10a_bee	62.804	37.194	0.001	nonzero		0.008
my8014_rel.cz10a_bee	57.156	42.843	0.001	nonzero		0.008
my8020_rel.cz10a_bee	47.686	52.312	0.002	nonzero		0.005
my8028_rel.cz10a_bee	29.597	70.400	0.003	nonzero		0.009
my8035_rel.cz10a_bee	53.727	46.270	0.002	nonzero		0.005
my8035_rel.cz10aps0_bee	67.069	32.929	0.002	nonzero		0.008
my8035_rel_lessps.cz10a_bee	69.691	30.307	0.002	nonzero		0.004
my8035_rel_lessps.cz10aps0_bee	68.844	31.154	0.002	nonzero		0.006
my8036_rel.cz10a_bee	51.411	48.587	0.002	nonzero		0.008

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	93.236	6.625	0.139		0.041
my5631_rel.cz10a_bee	93.389	6.544	0.067		0.045
my5641_rel.cz10a_bee	91.939	7.900	0.161		0.039
my5651_rel.cz10a_bee	90.511	9.144	0.344		0.041
my5710_rel.cz10a_bee	99.539	0.458	0.003		0.039
my5720_rel.cz10a_bee	99.578	0.419	0.003		0.049
my5730_rel.cz10a_bee	99.286	0.711	0.003		0.040
my5744_rel.cz10a_bee	99.464	0.531	0.006		0.042
my8013_rel.cz10a_bee	95.397	4.508	0.094		0.050
my8014_rel.cz10a_bee	94.883	5.022	0.094		0.040
my8020_rel.cz10a_bee	95.375	4.547	0.078		0.058
my8028_rel.cz10a_bee	99.358	0.633	0.008		0.058
my8035_rel.cz10a_bee	96.878	3.108	0.011	0.003	0.105
my8035_rel.cz10aps0_bee	97.939	2.044	0.017		0.033
my8035_rel_lessps.cz10a_bee	98.414	1.569	0.017		0.043
my8035_rel_lessps.cz10aps0_bee	98.308	1.675	0.017		0.039
my8036_rel.cz10a_bee	96.892	3.092	0.017		0.050

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	93.753	6.147	0.100		0.040
my5631_rel.cz10a_bee	94.183	5.783	0.033		0.045
my5641_rel.cz10a_bee	92.797	7.078	0.125		0.040
my5651_rel.cz10a_bee	92.183	7.550	0.267		0.041
my5710_rel.cz10a_bee	99.694	0.303	0.003		0.040
my5720_rel.cz10a_bee	99.764	0.233	0.003		0.048
my5730_rel.cz10a_bee	99.486	0.511	0.003		0.038
my5744_rel.cz10a_bee	99.608	0.389	0.003		0.043
my8013_rel.cz10a_bee	96.144	3.819	0.036		0.047
my8014_rel.cz10a_bee	95.872	4.069	0.058		0.040
my8020_rel.cz10a_bee	96.219	3.722	0.058		0.049
my8028_rel.cz10a_bee	99.781	0.217	0.003		0.049
my8035_rel.cz10a_bee	99.511	0.478	0.008	0.003	0.104
my8035_rel.cz10aps0_bee	99.664	0.331	0.006		0.041
my8035_rel_lessps.cz10a_bee	99.594	0.397	0.008		0.051
my8035_rel_lessps.cz10aps0_bee	99.725	0.261	0.014		0.048
my8036_rel.cz10a_bee	99.694	0.294	0.011		0.041

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
997	5680	33	0.1	419.4	13.6	0.006	0.023	0.421	13.981	23564	14.7	4.149	207	6.2	22.7	6.8	0.017	5627	5438	my5621_rel.cz10a_bee
997	5562	33	0.1	272.2	9.2	0.006	0.024	0.273	9.414	22689	14.7	4.079	211	6.1	22.6	6.8	0.014	5516	5353	my5631_rel.cz10a_bee
997	5596	33	0.1	263.9	8.9	0.006	0.024	0.265	9.164	22951	15.0	4.101	214	6.2	22.7	6.8	0.021	5546	5324	my5641_rel.cz10a_bee
998	5573	33	0.1	1275.3	39.3	0.006	0.024	1.278	40.351	25905	15.1	4.648	217	6.2	22.7	6.8	0.023	5530	5263	my5651_rel.cz10a_bee
998	4280	0	0.0	124.4	4.5	0.000	0.000	0.125	4.576	17176	14.6	4.013	273	6.7	23.3	7.8	0.007	4219	3995	my5710_rel.cz10a_bee
998	4174	0	0.0	119.1	4.3	0.000	0.000	0.119	4.437	16773	14.5	4.018	278	6.6	23.1	7.7	0.005	4126	3915	my5720_rel.cz10a_bee
997	4164	0	0.0	121.3	4.4	0.000	0.000	0.122	4.516	16757	14.6	4.025	281	6.5	23.0	7.6	0.008	4094	3884	my5730_rel.cz10a_bee
998	4118	0	0.0	121.3	4.4	0.000	0.000	0.122	4.517	16575	14.6	4.025	284	6.5	23.0	7.6	0.004	4060	3836	my5744_rel.cz10a_bee
998	3766	0	0.0	130.9	4.6	0.000	0.000	0.131	4.726	20618	15.4	5.475	327	6.6	23.4	8.0	0.008	3723	3438	my8013_rel.cz10a_bee
997	3620	0	0.0	123.1	4.4	0.000	0.000	0.123	4.481	16281	15.1	4.497	334	6.6	23.4	8.0	0.008	3581	3359	my8014_rel.cz10a_bee
998	3501	0	0.0	145.9	4.5	0.000	0.000	0.146	4.616	15721	15.1	4.491	345	6.4	23.1	7.6	0.005	3454	3228	my8020_rel.cz10a_bee
998	3200	0	0.0	141.9	4.5	0.000	0.000	0.142	4.614	13112	14.4	4.098	360	6.5	23.2	7.8	0.009	3180	3037	my8028_rel.cz10a_bee
997	3567	0	0.0	219.0	6.7	0.000	0.000	0.220	6.888	14957	14.9	4.193	334	6.5	23.2	7.8	0.005	3532	3325	my8035_rel.cz10a_bee
998	3985	0	0.0	218.0	6.7	0.000	0.000	0.219	6.867	16544	15.1	4.152	303	6.5	23.3	7.6	0.008	3918	3676	my8035_rel.cz10aps0_bee
998	4077	0	0.0	213.1	6.6	0.000	0.000	0.214	6.733	16877	15.1	4.140	296	6.5	23.3	7.5	0.004	4025	3771	my8035_rel_lessps.cz10a_bee
997	4054	0	0.0	218.3	6.7	0.000	0.000	0.219	6.883	16804	15.1	4.145	298	6.5	23.3	7.5	0.006	3996	3743	my8035_rel_lessps.cz10aps0_bee
998	3531	0	0.0	217.6	6.7	0.000	0.000	0.218	6.856	14810	14.9	4.194	338	6.5	23.2	7.8	0.008	3496	3292	my8036_rel.cz10a_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

dbms	256us	1ms	4ms	16ms	64ms	max
my5621_rel.cz10a_bee	93.392	6.599	0.008	0.002		0.016
my5631_rel.cz10a_bee	92.745	7.245	0.009	0.001	nonzero	0.017
my5641_rel.cz10a_bee	93.194	6.797	0.008	0.001		0.010
my5651_rel.cz10a_bee	92.595	7.396	0.008	0.001		0.012
my5710_rel.cz10a_bee	83.235	16.755	0.010	nonzero		0.007
my5720_rel.cz10a_bee	82.878	17.112	0.010	nonzero		0.004
my5730_rel.cz10a_bee	81.611	18.378	0.011	nonzero		0.006
my5744_rel.cz10a_bee	80.690	19.301	0.008	nonzero		0.006
my8013_rel.cz10a_bee	38.397	61.582	0.021	nonzero		0.005
my8014_rel.cz10a_bee	21.895	78.100	0.006	nonzero		0.016
my8020_rel.cz10a_bee	20.027	79.966	0.007	nonzero		0.004
my8028_rel.cz10a_bee	14.620	85.373	0.007	nonzero		0.005
my8035_rel.cz10a_bee	10.592	89.399	0.008	nonzero		0.007
my8035_rel.cz10aps0_bee	10.225	89.766	0.009	nonzero		0.004
my8035_rel_lessps.cz10a_bee	10.658	89.333	0.009	nonzero		0.006
my8035_rel_lessps.cz10aps0_bee	14.265	85.728	0.008	nonzero		0.006
my8036_rel.cz10a_bee	11.392	88.599	0.009	nonzero		0.004

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	93.325	6.497	0.178		0.040
my5631_rel.cz10a_bee	91.333	8.381	0.286		0.039
my5641_rel.cz10a_bee	92.222	7.636	0.142		0.045
my5651_rel.cz10a_bee	89.864	9.836	0.300		0.040
my5710_rel.cz10a_bee	99.386	0.608	0.006		0.046
my5720_rel.cz10a_bee	99.358	0.639	0.003		0.040
my5730_rel.cz10a_bee	99.325	0.672	0.003		0.049
my5744_rel.cz10a_bee	99.389	0.608	0.003		0.050
my8013_rel.cz10a_bee	94.908	5.036	0.056		0.049
my8014_rel.cz10a_bee	94.867	5.067	0.067		0.049
my8020_rel.cz10a_bee	95.178	4.758	0.064		0.058
my8028_rel.cz10a_bee	99.158	0.836	0.006		0.057
my8035_rel.cz10a_bee	96.847	3.144	0.008		0.041
my8035_rel.cz10aps0_bee	97.772	2.217	0.011		0.041
my8035_rel_lessps.cz10a_bee	98.344	1.644	0.011		0.051
my8035_rel_lessps.cz10aps0_bee	98.356	1.633	0.008	0.003	0.103
my8036_rel.cz10a_bee	96.381	3.600	0.019		0.048

dbms	4ms	16ms	64ms	256ms	max
my5621_rel.cz10a_bee	93.903	5.956	0.142		0.037
my5631_rel.cz10a_bee	92.900	6.914	0.186		0.040
my5641_rel.cz10a_bee	93.542	6.356	0.103		0.045
my5651_rel.cz10a_bee	91.600	8.181	0.219		0.038
my5710_rel.cz10a_bee	99.631	0.364	0.006		0.049
my5720_rel.cz10a_bee	99.608	0.389	0.003		0.041
my5730_rel.cz10a_bee	99.564	0.433	0.003		0.047
my5744_rel.cz10a_bee	99.614	0.383	0.003		0.047
my8013_rel.cz10a_bee	96.786	3.175	0.039		0.048
my8014_rel.cz10a_bee	95.894	4.053	0.053		0.046
my8020_rel.cz10a_bee	96.242	3.731	0.028		0.049
my8028_rel.cz10a_bee	99.644	0.353	0.003		0.047
my8035_rel.cz10a_bee	99.683	0.308	0.008		0.050
my8035_rel.cz10aps0_bee	99.694	0.297	0.008		0.049
my8035_rel_lessps.cz10a_bee	99.775	0.217	0.008		0.041
my8035_rel_lessps.cz10aps0_bee	99.736	0.258	0.003	0.003	0.104
my8036_rel.cz10a_bee	99.444	0.539	0.017		0.038

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	4607	33	0.1	307.4	10.2	0.007	0.028	0.308	10.496	20050	14.9	4.352	259	6.2	22.7	6.8	0.016	4542	4283	my5621_rel.cz10a_bee
998	4553	33	0.1	705.7	22.2	0.007	0.029	0.707	22.804	21108	15.0	4.636	264	6.1	22.6	6.8	0.017	4495	4220	my5631_rel.cz10a_bee
995	4572	33	0.1	565.9	18.0	0.007	0.029	0.569	18.544	20941	15.2	4.580	266	6.2	22.7	6.8	0.010	4509	4171	my5641_rel.cz10a_bee
998	4528	33	0.1	1353.4	41.7	0.007	0.029	1.356	42.773	23057	15.3	5.093	270	6.2	22.7	6.8	0.012	4462	4206	my5651_rel.cz10a_bee
998	3832	0	0.0	121.8	4.4	0.000	0.000	0.122	4.502	16243	15.1	4.239	315	6.7	23.3	7.8	0.007	3740	3530	my5710_rel.cz10a_bee
997	3799	0	0.0	121.8	4.4	0.000	0.000	0.122	4.532	16126	15.2	4.245	320	6.6	23.1	7.7	0.004	3724	3516	my5720_rel.cz10a_bee
998	3745	0	0.0	115.0	4.2	0.000	0.000	0.115	4.307	15882	15.0	4.240	320	6.5	23.0	7.6	0.006	3676	3452	my5730_rel.cz10a_bee
998	3686	0	0.0	115.9	4.2	0.000	0.000	0.116	4.338	15667	15.2	4.251	330	6.5	23.0	7.6	0.006	3629	3418	my5744_rel.cz10a_bee
997	3317	0	0.0	129.1	4.5	0.000	0.000	0.129	4.655	17919	16.6	5.402	400	6.6	23.4	8.0	0.005	3260	2858	my8013_rel.cz10a_bee
998	3119	0	0.0	121.0	4.3	0.000	0.000	0.121	4.436	14884	16.0	4.772	410	6.6	23.4	8.0	0.016	3037	2797	my8014_rel.cz10a_bee
998	3050	0	0.0	139.7	4.3	0.000	0.000	0.140	4.451	14532	15.7	4.764	412	6.4	23.1	7.6	0.004	2973	2717	my8020_rel.cz10a_bee
998	3026	0	0.0	138.7	4.4	0.000	0.000	0.139	4.537	13068	15.2	4.318	402	6.5	23.2	7.8	0.005	2956	2780	my8028_rel.cz10a_bee
998	2783	0	0.0	203.4	6.3	0.000	0.000	0.204	6.486	12502	15.3	4.492	440	6.5	23.3	7.8	0.007	2701	2541	my8035_rel.cz10a_bee
998	2957	0	0.0	210.0	6.5	0.000	0.000	0.210	6.672	13212	15.0	4.468	406	6.5	23.3	7.6	0.004	2910	2719	my8035_rel.cz10aps0_bee
998	3009	0	0.0	196.3	6.1	0.000	0.000	0.197	6.304	13385	15.0	4.448	399	6.5	23.3	7.5	0.006	2972	2813	my8035_rel_lessps.cz10a_bee
998	3052	0	0.0	209.6	6.5	0.000	0.000	0.210	6.657	13586	14.9	4.451	391	6.5	23.3	7.5	0.006	2989	2813	my8035_rel_lessps.cz10aps0_bee
998	2800	0	0.0	206.7	6.4	0.000	0.000	0.207	6.568	12562	15.3	4.486	437	6.5	23.3	7.8	0.004	2717	2542	my8036_rel.cz10a_bee

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
103448	0	905	3.5	317.3	31.2	0.009	0.035	0.003	0.309	12308	22.8	0.119	18	2.0	18.5	2.5	0.100	104188	88828	my5621_rel.cz10a_bee
98361	0	854	3.3	300.4	29.8	0.009	0.035	0.003	0.310	11975	22.3	0.122	18	2.0	18.5	2.6	0.098	99116	87333	my5631_rel.cz10a_bee
98039	0	857	3.3	299.9	29.5	0.009	0.035	0.003	0.309	11906	22.5	0.121	18	2.0	18.5	2.6	0.100	98410	84327	my5641_rel.cz10a_bee
100000	0	878	3.4	305.1	30.4	0.009	0.035	0.003	0.311	12305	22.5	0.123	18	2.0	18.5	2.7	0.097	100604	87340	my5651_rel.cz10a_bee
86207	0	0	0.0	280.5	26.1	0.000	0.000	0.003	0.310	9029	21.8	0.105	20	2.0	18.5	2.8	0.118	86605	76444	my5710_rel.cz10a_bee
87209	0	0	0.0	283.8	26.5	0.000	0.000	0.003	0.311	9123	22.1	0.105	20	2.0	18.5	2.9	0.105	87805	76814	my5720_rel.cz10a_bee
84270	0	0	0.0	278.4	25.9	0.000	0.000	0.003	0.315	8844	21.6	0.105	21	2.0	18.5	2.9	0.111	84757	74217	my5730_rel.cz10a_bee
83799	0	0	0.0	276.1	25.8	0.000	0.000	0.003	0.315	8808	21.5	0.105	21	2.0	18.5	2.9	0.111	84512	73232	my5744_rel.cz10a_bee
70588	0	613	2.4	256.1	23.3	0.009	0.035	0.004	0.339	57300	35.1	0.812	40	2.0	18.5	3.1	0.059	70922	64363	my8013_rel.cz10a_bee
70422	0	583	2.3	256.8	23.2	0.008	0.033	0.004	0.338	20363	22.8	0.289	26	2.0	18.5	3.1	0.070	70231	63472	my8014_rel.cz10a_bee
65646	0	0	0.0	274.3	21.4	0.000	0.000	0.004	0.334	17552	22.4	0.267	27	2.0	18.5	3.1	0.088	66089	58459	my8020_rel.cz10a_bee
63966	0	0	0.0	263.3	20.9	0.000	0.000	0.004	0.334	7024	20.9	0.110	26	2.0	18.6	3.0	0.075	64328	58433	my8028_rel.cz10a_bee
56818	0	0	0.0	245.3	18.9	0.000	0.000	0.004	0.341	6455	20.5	0.114	29	2.0	18.6	3.1	0.069	56876	51241	my8035_rel.cz10a_bee
59172	0	0	0.0	256.4	19.8	0.000	0.000	0.004	0.342	6771	21.2	0.114	29	2.0	18.6	2.9	0.070	59535	53057	my8035_rel.cz10aps0_bee
60606	0	0	0.0	260.9	20.2	0.000	0.000	0.004	0.342	6906	20.7	0.114	27	2.0	18.6	2.7	0.068	60833	55150	my8035_rel_lessps.cz10a_bee
60484	0	0	0.0	261.5	20.2	0.000	0.000	0.004	0.342	6896	20.7	0.114	27	2.0	18.6	2.7	0.073	60833	54869	my8035_rel_lessps.cz10aps0_bee
57252	0	0	0.0	246.6	19.1	0.000	0.000	0.004	0.341	6585	20.8	0.115	29	2.0	18.6	3.1	0.074	57337	52241	my8036_rel.cz10a_bee

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
101352	0	15	0.1	855.6	105.4	0.000	0.001	0.008	1.065	2393	11.2	0.024	9	4.2	20.7	4.6	0.002	NA	NA	my5621_rel.cz10a_bee
102740	0	12	0.0	861.7	107.4	0.000	0.000	0.008	1.071	2438	11.4	0.024	9	4.2	20.7	4.6	0.002	NA	NA	my5631_rel.cz10a_bee
100000	0	13	0.1	831.1	103.5	0.000	0.001	0.008	1.060	2328	11.4	0.023	9	4.2	20.7	4.9	0.002	NA	NA	my5641_rel.cz10a_bee
107914	0	11	0.0	858.6	111.7	0.000	0.000	0.008	1.059	2532	11.6	0.023	9	4.2	20.7	4.8	0.002	NA	NA	my5651_rel.cz10a_bee
149254	0	0	0.0	1539.6	144.6	0.000	0.000	0.010	0.992	9586	12.5	0.064	7	4.6	21.1	4.4	0.002	NA	NA	my5710_rel.cz10a_bee
150000	0	0	0.0	1681.2	146.5	0.000	0.000	0.011	1.000	9892	12.5	0.066	7	4.6	21.1	4.4	0.002	NA	NA	my5720_rel.cz10a_bee
148515	0	0	0.0	1370.0	141.3	0.000	0.000	0.009	0.974	8939	12.3	0.060	7	4.6	21.1	4.4	0.002	NA	NA	my5730_rel.cz10a_bee
146342	0	0	0.0	1518.2	141.4	0.000	0.000	0.010	0.989	9446	12.4	0.065	7	4.6	21.1	4.4	0.002	NA	NA	my5744_rel.cz10a_bee
136987	0	0	0.0	1192.5	128.8	0.000	0.000	0.009	0.963	12243	14.1	0.089	8	4.5	21.1	4.9	0.003	NA	NA	my8013_rel.cz10a_bee
133929	0	0	0.0	1176.9	126.9	0.000	0.000	0.009	0.970	8848	12.3	0.066	7	4.5	21.1	4.7	0.003	NA	NA	my8014_rel.cz10a_bee
129311	0	0	0.0	1381.5	119.5	0.000	0.000	0.011	0.947	8607	11.9	0.067	7	4.5	21.1	3.9	0.003	NA	NA	my8020_rel.cz10a_bee
151516	0	777	49.1	2832.3	166.9	0.005	0.332	0.019	1.128	10549	44.1	0.070	23	4.5	21.1	4.5	0.003	NA	NA	my8028_rel.cz10a_bee
138249	0	704	44.5	2806.3	155.1	0.005	0.330	0.020	1.149	10192	42.9	0.074	25	4.5	21.1	5.3	0.003	NA	NA	my8035_rel.cz10a_bee
206897	0	1045	66.1	4306.5	231.8	0.005	0.327	0.021	1.147	15107	40.4	0.073	16	4.5	21.1	4.1	0.003	NA	NA	my8035_rel.cz10aps0_bee
209791	0	1082	68.4	4149.8	235.2	0.005	0.334	0.020	1.148	14760	40.3	0.070	15	4.5	21.1	4.2	0.006	NA	NA	my8035_rel_lessps.cz10a_bee
206897	0	1083	68.4	3552.3	225.8	0.005	0.339	0.017	1.118	13598	40.2	0.066	16	4.5	21.1	4.2	0.003	NA	NA	my8035_rel_lessps.cz10aps0_bee
136987	0	705	44.6	2541.8	151.0	0.005	0.333	0.019	1.129	9646	43.3	0.070	25	4.5	21.1	5.3	0.004	NA	NA	my8036_rel.cz10a_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
18527	0	625	2.4	1842.3	81.7	0.034	0.135	0.099	4.516	15706	34.5	0.848	149	6.2	22.7	6.8	0.109	19579	5894	my5621_rel.cz10a_bee
17969	0	601	2.3	1794.6	79.4	0.033	0.134	0.100	4.527	15532	34.2	0.864	152	6.1	22.6	6.8	0.110	19029	5547	my5631_rel.cz10a_bee
17905	0	602	2.3	1794.8	79.4	0.034	0.134	0.100	4.543	15492	34.3	0.865	153	6.1	22.6	6.8	0.103	18979	5394	my5641_rel.cz10a_bee
18124	0	611	2.4	1818.4	80.4	0.034	0.135	0.100	4.545	15570	34.4	0.859	152	6.2	22.7	6.8	0.101	19229	5644	my5651_rel.cz10a_bee
20942	0	0	0.0	2069.2	89.8	0.000	0.000	0.099	4.390	15157	38.3	0.724	146	6.7	23.3	7.8	0.098	21475	7641	my5710_rel.cz10a_bee
20555	0	0	0.0	2074.2	90.6	0.000	0.000	0.101	4.512	15139	38.5	0.737	150	6.6	23.1	7.7	0.093	21277	7293	my5720_rel.cz10a_bee
20460	0	0	0.0	2058.3	90.5	0.000	0.000	0.101	4.528	15103	38.2	0.738	149	6.5	23.0	7.6	0.086	21226	7741	my5730_rel.cz10a_bee
20418	0	0	0.0	2062.5	90.8	0.000	0.000	0.101	4.555	15073	37.9	0.738	148	6.5	23.0	7.6	0.083	21127	8441	my5744_rel.cz10a_bee
18544	0	0	0.0	1812.2	79.5	0.000	0.000	0.098	4.388	65561	50.2	3.535	217	6.6	23.4	7.9	0.126	19177	6199	my8013_rel.cz10a_bee
17683	0	0	0.0	1757.2	76.6	0.000	0.000	0.099	4.437	30762	38.5	1.740	174	6.6	23.4	7.9	0.133	18282	5444	my8014_rel.cz10a_bee
17338	0	63	1.0	2049.7	75.9	0.004	0.058	0.118	4.482	29743	37.8	1.715	174	6.4	23.1	7.6	0.184	18329	5094	my8020_rel.cz10a_bee
19029	0	69	1.1	2239.0	83.0	0.004	0.058	0.118	4.466	14942	37.2	0.785	156	6.5	23.2	7.7	0.103	19829	5941	my8028_rel.cz10a_bee
16928	0	62	1.0	2599.2	97.6	0.004	0.058	0.154	5.903	15444	36.8	0.912	174	6.5	23.2	7.8	0.112	17730	5094	my8035_rel.cz10a_bee
17331	0	63	1.0	2683.8	100.3	0.004	0.058	0.155	5.925	15885	37.0	0.917	171	6.5	23.3	7.6	0.104	18180	5097	my8035_rel.cz10aps0_bee
17825	0	65	1.0	2765.3	103.4	0.004	0.058	0.155	5.939	16300	37.1	0.914	167	6.5	23.3	7.5	0.080	18729	4744	my8035_rel_lessps.cz10a_bee
17723	0	64	1.0	2697.9	101.5	0.004	0.058	0.152	5.865	16044	37.0	0.905	167	6.5	23.3	7.4	0.104	18580	5148	my8035_rel_lessps.cz10aps0_bee
16906	0	61	1.0	2643.1	98.7	0.004	0.058	0.156	5.979	15567	36.8	0.921	174	6.5	23.2	7.8	0.104	17680	5194	my8036_rel.cz10a_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
12165	0	2192	8.6	1242.9	51.8	0.180	0.721	0.102	4.360	58349	36.3	4.796	239	6.2	22.7	6.8	0.079	12202	10818	my5621_rel.cz10a_bee
11962	0	2153	8.4	1259.6	52.0	0.180	0.720	0.105	4.454	57575	36.3	4.813	243	6.1	22.6	6.8	0.049	11991	10886	my5631_rel.cz10a_bee
11919	0	2146	8.4	1251.2	51.7	0.180	0.720	0.105	4.441	57422	36.3	4.818	244	6.2	22.7	6.8	0.049	11947	10788	my5641_rel.cz10a_bee
12106	0	2177	8.5	1192.4	50.2	0.180	0.719	0.098	4.242	57886	36.2	4.781	239	6.2	22.7	6.8	0.067	12100	10983	my5651_rel.cz10a_bee
10941	0	0	0.0	1132.1	46.9	0.000	0.000	0.103	4.389	49107	37.5	4.488	274	6.7	23.3	7.8	0.078	10918	9404	my5710_rel.cz10a_bee
10753	0	0	0.0	1120.6	46.5	0.000	0.000	0.104	4.426	48816	37.2	4.540	277	6.6	23.1	7.7	0.075	10778	9329	my5720_rel.cz10a_bee
10753	0	0	0.0	1139.0	47.0	0.000	0.000	0.106	4.475	48991	37.1	4.556	276	6.5	23.0	7.6	0.074	10733	9124	my5730_rel.cz10a_bee
10504	0	0	0.0	1111.1	46.0	0.000	0.000	0.106	4.482	44436	36.2	4.230	276	6.5	23.0	7.6	0.074	10518	9153	my5744_rel.cz10a_bee
10730	0	0	0.0	1084.7	46.0	0.000	0.000	0.101	4.388	88692	49.4	8.266	368	6.6	23.4	8.0	0.077	10781	8721	my8013_rel.cz10a_bee
10661	0	0	0.0	1114.2	46.9	0.000	0.000	0.105	4.500	88122	49.7	8.266	373	6.6	23.4	8.0	0.077	10693	8806	my8014_rel.cz10a_bee
10330	0	0	0.0	1252.2	44.2	0.000	0.000	0.121	4.377	75151	48.8	7.275	378	6.4	23.1	7.6	0.085	10386	8683	my8020_rel.cz10a_bee
9242	0	0	0.0	1185.4	41.0	0.000	0.000	0.128	4.543	39706	35.3	4.296	306	6.5	23.2	7.8	0.101	9247	8136	my8028_rel.cz10a_bee
8584	0	0	0.0	1380.0	47.9	0.000	0.000	0.161	5.711	37651	35.1	4.386	327	6.5	23.2	7.8	0.102	8611	7661	my8035_rel.cz10a_bee
9042	0	0	0.0	1392.3	48.8	0.000	0.000	0.154	5.523	39499	35.3	4.369	312	6.5	23.3	7.6	0.102	9050	7832	my8035_rel.cz10aps0_bee
9320	0	0	0.0	1464.5	51.1	0.000	0.000	0.157	5.619	40774	35.4	4.375	304	6.5	23.3	7.5	0.102	9355	8126	my8035_rel_lessps.cz10a_bee
9242	0	0	0.0	1462.5	50.9	0.000	0.000	0.158	5.641	40534	35.4	4.386	306	6.5	23.3	7.5	0.101	9305	7981	my8035_rel_lessps.cz10aps0_bee
8584	0	0	0.0	1354.8	47.2	0.000	0.000	0.158	5.626	37636	35.0	4.385	326	6.5	23.2	7.8	0.102	8615	7567	my8036_rel.cz10a_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	5688	4	0.0	524.2	15.7	0.001	0.003	5.253	160.667	23529	13.0	4.136	183	6.2	22.7	6.8	0.017	5642	5466	my5621_rel.cz10a_bee
100	5577	4	0.0	527.1	15.8	0.001	0.003	5.282	161.639	23156	13.1	4.152	188	6.1	22.6	6.8	0.022	5532	5370	my5631_rel.cz10a_bee
100	5592	4	0.0	517.6	15.5	0.001	0.003	5.187	158.930	23167	13.1	4.143	187	6.2	22.7	6.8	0.017	5549	5386	my5641_rel.cz10a_bee
100	5570	4	0.0	545.9	16.3	0.001	0.003	5.475	167.560	23178	13.2	4.161	190	6.2	22.7	6.8	0.023	5530	5354	my5651_rel.cz10a_bee
100	4237	0	0.0	113.7	3.2	0.000	0.000	1.140	32.916	16728	12.6	3.948	238	6.7	23.3	7.8	0.005	4190	3979	my5710_rel.cz10a_bee
100	4187	0	0.0	103.1	2.9	0.000	0.000	1.034	29.747	16501	12.6	3.941	241	6.6	23.1	7.7	0.003	4139	3916	my5720_rel.cz10a_bee
100	4158	0	0.0	109.7	3.1	0.000	0.000	1.101	31.727	16416	12.6	3.948	242	6.5	23.0	7.6	0.008	4093	3915	my5730_rel.cz10a_bee
100	4124	0	0.0	109.6	3.1	0.000	0.000	1.098	31.589	16287	12.5	3.949	242	6.5	23.0	7.6	0.004	4072	3869	my5744_rel.cz10a_bee
100	3637	0	0.0	145.7	4.1	0.000	0.000	1.461	41.735	15948	13.2	4.385	290	6.6	23.4	8.0	0.003	3626	3421	my8013_rel.cz10a_bee
100	3594	0	0.0	124.6	3.4	0.000	0.000	1.249	35.243	15046	13.1	4.186	292	6.6	23.4	8.0	0.002	3564	3388	my8014_rel.cz10a_bee
100	3408	0	0.0	132.4	3.2	0.000	0.000	1.326	32.960	14248	12.9	4.181	303	6.4	23.1	7.6	0.003	3387	3180	my8020_rel.cz10a_bee
100	3254	0	0.0	140.3	3.5	0.000	0.000	1.406	35.874	13055	12.5	4.012	307	6.5	23.2	7.8	0.007	3228	3084	my8028_rel.cz10a_bee
100	3554	0	0.0	131.6	3.3	0.000	0.000	1.320	34.220	14368	12.7	4.043	286	6.5	23.2	7.8	0.004	3530	3340	my8035_rel.cz10a_bee
100	3955	0	0.0	131.7	3.3	0.000	0.000	1.320	33.720	15884	12.9	4.016	261	6.5	23.3	7.6	0.004	3912	3678	my8035_rel.cz10aps0_bee
100	4080	0	0.0	140.8	3.5	0.000	0.000	1.411	36.174	16393	13.0	4.018	255	6.5	23.3	7.5	0.005	4043	3805	my8035_rel_lessps.cz10a_bee
100	4048	0	0.0	138.7	3.5	0.000	0.000	1.391	35.692	16273	13.2	4.020	261	6.5	23.3	7.5	0.005	4008	3772	my8035_rel_lessps.cz10aps0_bee
100	3526	0	0.0	126.6	3.2	0.000	0.000	1.270	32.756	14246	12.7	4.041	288	6.5	23.2	7.8	0.005	3487	3310	my8036_rel.cz10a_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	4652	4	0.0	560.8	16.8	0.001	0.004	5.625	172.263	20635	13.1	4.436	225	6.2	22.7	6.8	0.018	4619	4350	my5621_rel.cz10a_bee
100	4558	4	0.0	533.0	15.9	0.001	0.004	5.346	163.477	20220	13.7	4.436	240	6.1	22.6	6.8	0.022	4519	4253	my5631_rel.cz10a_bee
100	4563	4	0.0	528.8	15.8	0.001	0.004	5.304	162.211	20225	13.5	4.432	237	6.2	22.7	6.8	0.017	4507	4242	my5641_rel.cz10a_bee
100	4574	4	0.0	520.4	15.5	0.001	0.004	5.220	159.592	20225	13.2	4.421	231	6.2	22.7	6.8	0.017	4554	4286	my5651_rel.cz10a_bee
100	3924	0	0.0	24.0	0.5	0.000	0.000	0.241	5.358	16049	13.3	4.090	271	6.7	23.3	7.8	0.006	3836	3596	my5710_rel.cz10a_bee
100	3833	0	0.0	26.2	0.6	0.000	0.000	0.263	5.984	15683	13.4	4.092	280	6.6	23.1	7.7	0.006	3756	3564	my5720_rel.cz10a_bee
100	3796	0	0.0	25.8	0.6	0.000	0.000	0.258	5.872	15534	14.0	4.092	295	6.5	23.0	7.6	0.005	3708	3484	my5730_rel.cz10a_bee
100	3768	0	0.0	24.1	0.5	0.000	0.000	0.242	5.410	15446	13.8	4.100	293	6.5	23.0	7.6	0.004	3675	3436	my5744_rel.cz10a_bee
100	3275	0	0.0	33.1	0.7	0.000	0.000	0.332	7.251	14878	14.1	4.542	344	6.6	23.4	8.0	0.007	3101	2861	my8013_rel.cz10a_bee
100	3106	0	0.0	36.4	0.8	0.000	0.000	0.365	8.101	13515	13.2	4.352	340	6.6	23.4	8.0	0.003	3002	2797	my8014_rel.cz10a_bee
100	3091	0	0.0	30.0	0.6	0.000	0.000	0.301	6.435	13462	13.5	4.355	349	6.4	23.1	7.6	0.003	2943	2749	my8020_rel.cz10a_bee
100	3058	0	0.0	30.7	0.7	0.000	0.000	0.308	7.640	12610	13.3	4.124	348	6.5	23.2	7.8	0.003	2956	2765	my8028_rel.cz10a_bee
100	2826	0	0.0	33.3	0.9	0.000	0.000	0.334	8.778	11880	13.4	4.204	379	6.5	23.2	7.8	0.004	2703	2572	my8035_rel.cz10a_bee
100	3056	0	0.0	34.5	0.9	0.000	0.000	0.346	9.005	12790	13.6	4.185	356	6.5	23.3	7.6	0.005	2937	2765	my8035_rel.cz10aps0_bee
100	3011	0	0.0	34.8	0.9	0.000	0.000	0.349	9.236	12622	12.8	4.192	340	6.5	23.3	7.5	0.004	2975	2813	my8035_rel_lessps.cz10a_bee
100	3099	0	0.0	41.7	1.0	0.000	0.000	0.417	10.733	12998	13.8	4.194	356	6.5	23.3	7.5	0.003	3021	2829	my8035_rel_lessps.cz10aps0_bee
100	2814	0	0.0	33.3	0.9	0.000	0.000	0.334	8.764	11828	13.4	4.204	381	6.5	23.2	7.8	0.004	2717	2573	my8036_rel.cz10a_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	5671	17	0.1	287.1	9.1	0.003	0.012	0.576	18.720	22906	13.5	4.039	190	6.2	22.7	6.8	0.016	5629	5455	my5621_rel.cz10a_bee
499	5598	17	0.1	116.1	4.0	0.003	0.012	0.233	8.157	22090	13.5	3.946	193	6.1	22.6	6.8	0.016	5546	5370	my5631_rel.cz10a_bee
499	5601	17	0.1	69.5	2.6	0.003	0.012	0.139	5.274	22041	13.7	3.935	196	6.2	22.7	6.8	0.016	5562	5370	my5641_rel.cz10a_bee
499	5547	17	0.1	149.8	5.0	0.003	0.012	0.300	10.235	21975	13.4	3.962	193	6.2	22.7	6.8	0.015	5533	5419	my5651_rel.cz10a_bee
499	4222	0	0.0	57.9	1.9	0.000	0.000	0.116	3.954	16583	13.5	3.927	256	6.7	23.3	7.8	0.007	4172	3980	my5710_rel.cz10a_bee
499	4197	0	0.0	69.9	2.3	0.000	0.000	0.140	4.735	16532	13.6	3.939	259	6.6	23.1	7.7	0.004	4139	3946	my5720_rel.cz10a_bee
499	4211	0	0.0	62.2	2.1	0.000	0.000	0.125	4.266	16569	13.5	3.935	256	6.5	23.0	7.6	0.003	4141	3931	my5730_rel.cz10a_bee
499	4108	0	0.0	67.1	2.2	0.000	0.000	0.135	4.582	16193	13.5	3.942	263	6.5	23.0	7.6	0.003	4059	3868	my5744_rel.cz10a_bee
499	3694	0	0.0	57.4	1.8	0.000	0.000	0.115	3.748	17876	14.2	4.839	308	6.6	23.4	8.0	0.005	3661	3439	my8013_rel.cz10a_bee
499	3580	0	0.0	57.7	1.9	0.000	0.000	0.116	3.799	15262	14.0	4.263	313	6.6	23.4	8.0	0.003	3549	3358	my8014_rel.cz10a_bee
499	3443	0	0.0	77.5	2.3	0.000	0.000	0.155	4.658	14749	13.8	4.284	321	6.4	23.1	7.6	0.003	3421	3228	my8020_rel.cz10a_bee
499	3239	0	0.0	76.3	2.3	0.000	0.000	0.153	4.790	12897	13.4	3.982	331	6.5	23.2	7.8	0.004	3223	3070	my8028_rel.cz10a_bee
499	3540	0	0.0	88.2	2.8	0.000	0.000	0.177	5.704	14278	13.7	4.033	310	6.5	23.2	7.8	0.006	3516	3341	my8035_rel.cz10a_bee
499	3933	0	0.0	86.9	2.7	0.000	0.000	0.174	5.607	15775	13.9	4.011	283	6.5	23.3	7.6	0.004	3884	3675	my8035_rel.cz10aps0_bee
499	4123	0	0.0	84.2	2.7	0.000	0.000	0.169	5.502	16508	14.0	4.004	272	6.5	23.3	7.5	0.005	4059	3820	my8035_rel_lessps.cz10a_bee
499	4026	0	0.0	81.7	2.6	0.000	0.000	0.164	5.354	16118	13.9	4.003	276	6.5	23.3	7.5	0.004	3982	3756	my8035_rel_lessps.cz10aps0_bee
499	3550	0	0.0	86.6	2.7	0.000	0.000	0.173	5.618	14321	13.8	4.034	311	6.5	23.2	7.8	0.003	3516	3326	my8036_rel.cz10a_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	4641	17	0.1	134.4	4.5	0.004	0.014	0.269	9.262	19376	13.9	4.175	240	6.2	22.7	6.8	0.014	4586	4282	my5621_rel.cz10a_bee
499	4518	17	0.1	312.2	9.9	0.004	0.015	0.626	20.291	19488	13.7	4.314	243	6.1	22.6	6.8	0.011	4477	4218	my5631_rel.cz10a_bee
498	4605	17	0.1	314.3	9.9	0.004	0.014	0.631	20.392	19998	14.4	4.343	250	6.2	22.7	6.8	0.010	4539	4235	my5641_rel.cz10a_bee
495	4507	17	0.1	265.5	8.4	0.004	0.015	0.536	17.479	19407	13.9	4.306	247	6.2	22.7	6.8	0.012	4491	4219	my5651_rel.cz10a_bee
499	3780	0	0.0	80.8	2.6	0.000	0.000	0.162	5.406	15731	14.2	4.162	301	6.7	23.3	7.8	0.007	3708	3500	my5710_rel.cz10a_bee
499	3765	0	0.0	82.6	2.7	0.000	0.000	0.166	5.541	15687	13.8	4.166	293	6.6	23.1	7.7	0.008	3724	3516	my5720_rel.cz10a_bee
499	3790	0	0.0	85.4	2.8	0.000	0.000	0.171	5.744	15791	14.4	4.167	304	6.5	23.0	7.6	0.005	3707	3467	my5730_rel.cz10a_bee
499	3697	0	0.0	88.6	2.9	0.000	0.000	0.178	5.918	15456	13.9	4.181	301	6.5	23.0	7.6	0.005	3645	3420	my5744_rel.cz10a_bee
499	3200	0	0.0	86.0	2.7	0.000	0.000	0.173	5.625	16638	14.6	5.200	365	6.6	23.4	8.0	0.007	3100	2844	my8013_rel.cz10a_bee
499	3128	0	0.0	93.1	2.9	0.000	0.000	0.187	5.998	14278	14.3	4.565	366	6.6	23.4	8.0	0.004	3021	2813	my8014_rel.cz10a_bee
499	3002	0	0.0	94.8	2.7	0.000	0.000	0.190	5.492	13712	14.4	4.568	384	6.4	23.1	7.6	0.005	2909	2719	my8020_rel.cz10a_bee
499	3021	0	0.0	86.8	2.6	0.000	0.000	0.174	5.264	12716	13.7	4.209	363	6.5	23.2	7.8	0.004	2943	2780	my8028_rel.cz10a_bee
499	2814	0	0.0	91.2	2.8	0.000	0.000	0.183	5.806	12106	14.3	4.301	407	6.5	23.2	7.8	0.005	2716	2541	my8035_rel.cz10a_bee
499	2962	0	0.0	81.9	2.6	0.000	0.000	0.164	5.356	12651	13.8	4.271	373	6.5	23.3	7.6	0.005	2909	2736	my8035_rel.cz10aps0_bee
499	3066	0	0.0	98.4	3.0	0.000	0.000	0.197	6.192	13129	14.1	4.283	368	6.5	23.3	7.5	0.005	3005	2829	my8035_rel_lessps.cz10a_bee
499	3041	0	0.0	78.6	2.5	0.000	0.000	0.158	5.180	12963	14.0	4.263	368	6.5	23.3	7.5	0.005	2990	2814	my8035_rel_lessps.cz10aps0_bee
499	2825	0	0.0	84.1	2.7	0.000	0.000	0.169	5.477	12118	14.1	4.289	399	6.5	23.2	7.8	0.004	2732	2572	my8036_rel.cz10a_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
997	5680	33	0.1	419.4	13.6	0.006	0.023	0.421	13.981	23564	14.7	4.149	207	6.2	22.7	6.8	0.017	5627	5438	my5621_rel.cz10a_bee
997	5562	33	0.1	272.2	9.2	0.006	0.024	0.273	9.414	22689	14.7	4.079	211	6.1	22.6	6.8	0.014	5516	5353	my5631_rel.cz10a_bee
997	5596	33	0.1	263.9	8.9	0.006	0.024	0.265	9.164	22951	15.0	4.101	214	6.2	22.7	6.8	0.021	5546	5324	my5641_rel.cz10a_bee
998	5573	33	0.1	1275.3	39.3	0.006	0.024	1.278	40.351	25905	15.1	4.648	217	6.2	22.7	6.8	0.023	5530	5263	my5651_rel.cz10a_bee
998	4280	0	0.0	124.4	4.5	0.000	0.000	0.125	4.576	17176	14.6	4.013	273	6.7	23.3	7.8	0.007	4219	3995	my5710_rel.cz10a_bee
998	4174	0	0.0	119.1	4.3	0.000	0.000	0.119	4.437	16773	14.5	4.018	278	6.6	23.1	7.7	0.005	4126	3915	my5720_rel.cz10a_bee
997	4164	0	0.0	121.3	4.4	0.000	0.000	0.122	4.516	16757	14.6	4.025	281	6.5	23.0	7.6	0.008	4094	3884	my5730_rel.cz10a_bee
998	4118	0	0.0	121.3	4.4	0.000	0.000	0.122	4.517	16575	14.6	4.025	284	6.5	23.0	7.6	0.004	4060	3836	my5744_rel.cz10a_bee
998	3766	0	0.0	130.9	4.6	0.000	0.000	0.131	4.726	20618	15.4	5.475	327	6.6	23.4	8.0	0.008	3723	3438	my8013_rel.cz10a_bee
997	3620	0	0.0	123.1	4.4	0.000	0.000	0.123	4.481	16281	15.1	4.497	334	6.6	23.4	8.0	0.008	3581	3359	my8014_rel.cz10a_bee
998	3501	0	0.0	145.9	4.5	0.000	0.000	0.146	4.616	15721	15.1	4.491	345	6.4	23.1	7.6	0.005	3454	3228	my8020_rel.cz10a_bee
998	3200	0	0.0	141.9	4.5	0.000	0.000	0.142	4.614	13112	14.4	4.098	360	6.5	23.2	7.8	0.009	3180	3037	my8028_rel.cz10a_bee
997	3567	0	0.0	219.0	6.7	0.000	0.000	0.220	6.888	14957	14.9	4.193	334	6.5	23.2	7.8	0.005	3532	3325	my8035_rel.cz10a_bee
998	3985	0	0.0	218.0	6.7	0.000	0.000	0.219	6.867	16544	15.1	4.152	303	6.5	23.3	7.6	0.008	3918	3676	my8035_rel.cz10aps0_bee
998	4077	0	0.0	213.1	6.6	0.000	0.000	0.214	6.733	16877	15.1	4.140	296	6.5	23.3	7.5	0.004	4025	3771	my8035_rel_lessps.cz10a_bee
997	4054	0	0.0	218.3	6.7	0.000	0.000	0.219	6.883	16804	15.1	4.145	298	6.5	23.3	7.5	0.006	3996	3743	my8035_rel_lessps.cz10aps0_bee
998	3531	0	0.0	217.6	6.7	0.000	0.000	0.218	6.856	14810	14.9	4.194	338	6.5	23.2	7.8	0.008	3496	3292	my8036_rel.cz10a_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	4607	33	0.1	307.4	10.2	0.007	0.028	0.308	10.496	20050	14.9	4.352	259	6.2	22.7	6.8	0.016	4542	4283	my5621_rel.cz10a_bee
998	4553	33	0.1	705.7	22.2	0.007	0.029	0.707	22.804	21108	15.0	4.636	264	6.1	22.6	6.8	0.017	4495	4220	my5631_rel.cz10a_bee
995	4572	33	0.1	565.9	18.0	0.007	0.029	0.569	18.544	20941	15.2	4.580	266	6.2	22.7	6.8	0.010	4509	4171	my5641_rel.cz10a_bee
998	4528	33	0.1	1353.4	41.7	0.007	0.029	1.356	42.773	23057	15.3	5.093	270	6.2	22.7	6.8	0.012	4462	4206	my5651_rel.cz10a_bee
998	3832	0	0.0	121.8	4.4	0.000	0.000	0.122	4.502	16243	15.1	4.239	315	6.7	23.3	7.8	0.007	3740	3530	my5710_rel.cz10a_bee
997	3799	0	0.0	121.8	4.4	0.000	0.000	0.122	4.532	16126	15.2	4.245	320	6.6	23.1	7.7	0.004	3724	3516	my5720_rel.cz10a_bee
998	3745	0	0.0	115.0	4.2	0.000	0.000	0.115	4.307	15882	15.0	4.240	320	6.5	23.0	7.6	0.006	3676	3452	my5730_rel.cz10a_bee
998	3686	0	0.0	115.9	4.2	0.000	0.000	0.116	4.338	15667	15.2	4.251	330	6.5	23.0	7.6	0.006	3629	3418	my5744_rel.cz10a_bee
997	3317	0	0.0	129.1	4.5	0.000	0.000	0.129	4.655	17919	16.6	5.402	400	6.6	23.4	8.0	0.005	3260	2858	my8013_rel.cz10a_bee
998	3119	0	0.0	121.0	4.3	0.000	0.000	0.121	4.436	14884	16.0	4.772	410	6.6	23.4	8.0	0.016	3037	2797	my8014_rel.cz10a_bee
998	3050	0	0.0	139.7	4.3	0.000	0.000	0.140	4.451	14532	15.7	4.764	412	6.4	23.1	7.6	0.004	2973	2717	my8020_rel.cz10a_bee
998	3026	0	0.0	138.7	4.4	0.000	0.000	0.139	4.537	13068	15.2	4.318	402	6.5	23.2	7.8	0.005	2956	2780	my8028_rel.cz10a_bee
998	2783	0	0.0	203.4	6.3	0.000	0.000	0.204	6.486	12502	15.3	4.492	440	6.5	23.3	7.8	0.007	2701	2541	my8035_rel.cz10a_bee
998	2957	0	0.0	210.0	6.5	0.000	0.000	0.210	6.672	13212	15.0	4.468	406	6.5	23.3	7.6	0.004	2910	2719	my8035_rel.cz10aps0_bee
998	3009	0	0.0	196.3	6.1	0.000	0.000	0.197	6.304	13385	15.0	4.448	399	6.5	23.3	7.5	0.006	2972	2813	my8035_rel_lessps.cz10a_bee
998	3052	0	0.0	209.6	6.5	0.000	0.000	0.210	6.657	13586	14.9	4.451	391	6.5	23.3	7.5	0.006	2989	2813	my8035_rel_lessps.cz10aps0_bee
998	2800	0	0.0	206.7	6.4	0.000	0.000	0.207	6.568	12562	15.3	4.486	437	6.5	23.3	7.8	0.004	2717	2542	my8036_rel.cz10a_bee

l.i0

l.i0: load without secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	94.239	5.643	0.110	0.004	0.003	0.000	0.000	0.000	0.000	0.100	my5621_rel.cz10a_bee
0.000	87.819	12.059	0.117	0.002	0.003	0.000	0.000	0.000	0.000	0.098	my5631_rel.cz10a_bee
0.000	85.496	14.381	0.119	0.001	0.003	0.000	0.000	0.000	0.000	0.100	my5641_rel.cz10a_bee
0.000	90.958	8.926	0.111	0.001	0.003	0.000	0.000	0.000	0.000	0.097	my5651_rel.cz10a_bee
0.000	4.581	95.127	0.284	0.006	0.002	0.000	0.000	0.000	0.000	0.118	my5710_rel.cz10a_bee
0.000	8.024	91.683	0.286	0.005	0.002	0.000	0.000	0.000	0.000	0.105	my5720_rel.cz10a_bee
0.000	3.060	96.600	0.199	0.139	0.002	0.000	0.000	0.000	0.000	0.111	my5730_rel.cz10a_bee
0.000	2.324	97.334	0.200	0.140	0.002	0.000	0.000	0.000	0.000	0.111	my5744_rel.cz10a_bee
0.000	0.000	99.558	0.354	0.088	0.000	0.000	0.000	0.000	0.000	0.059	my8013_rel.cz10a_bee
0.000	0.000	99.441	0.455	0.103	nonzero	0.000	0.000	0.000	0.000	0.070	my8014_rel.cz10a_bee
0.000	0.000	99.379	0.465	0.152	0.003	0.000	0.000	0.000	0.000	0.088	my8020_rel.cz10a_bee
0.000	0.000	99.464	0.392	0.141	0.003	0.000	0.000	0.000	0.000	0.075	my8028_rel.cz10a_bee
0.000	0.000	99.417	0.444	0.137	0.003	0.000	0.000	0.000	0.000	0.069	my8035_rel.cz10a_bee
0.000	0.000	99.443	0.423	0.131	0.003	0.000	0.000	0.000	0.000	0.070	my8035_rel.cz10aps0_bee
0.000	0.000	99.451	0.401	0.146	0.002	0.000	0.000	0.000	0.000	0.068	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.448	0.407	0.142	0.003	0.000	0.000	0.000	0.000	0.073	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.421	0.453	0.123	0.003	0.000	0.000	0.000	0.000	0.074	my8036_rel.cz10a_bee

l.x

l.x: create secondary indexes
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

TODO - determine whether there is data for create index response time

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	95.085	4.732	0.182	0.001	0.000	0.000	0.000	0.000	0.109	my5621_rel.cz10a_bee
0.000	0.000	94.656	5.163	0.180	nonzero	0.000	0.000	0.000	0.000	0.110	my5631_rel.cz10a_bee
0.000	0.000	94.592	5.229	0.178	nonzero	0.000	0.000	0.000	0.000	0.103	my5641_rel.cz10a_bee
0.000	0.000	94.834	4.986	0.179	nonzero	0.000	0.000	0.000	0.000	0.101	my5651_rel.cz10a_bee
0.000	0.000	97.367	2.603	0.027	0.003	0.000	0.000	0.000	0.000	0.098	my5710_rel.cz10a_bee
0.000	0.000	96.925	3.047	0.025	0.003	0.000	0.000	0.000	0.000	0.093	my5720_rel.cz10a_bee
0.000	0.000	96.991	2.937	0.069	0.003	0.000	0.000	0.000	0.000	0.086	my5730_rel.cz10a_bee
0.000	0.000	96.978	2.950	0.069	0.003	0.000	0.000	0.000	0.000	0.083	my5744_rel.cz10a_bee
0.000	0.000	97.371	2.258	0.361	0.010	0.000	0.000	0.000	0.000	0.126	my8013_rel.cz10a_bee
0.000	0.000	96.571	3.077	0.347	0.006	0.000	0.000	0.000	0.000	0.133	my8014_rel.cz10a_bee
0.000	0.000	96.935	2.704	0.323	0.039	0.000	0.000	0.000	0.000	0.184	my8020_rel.cz10a_bee
0.000	0.000	97.338	2.558	0.101	0.002	0.000	0.000	0.000	0.000	0.103	my8028_rel.cz10a_bee
0.000	0.000	96.182	3.671	0.146	0.001	0.000	0.000	0.000	0.000	0.112	my8035_rel.cz10a_bee
0.000	0.000	96.339	3.515	0.145	0.001	0.000	0.000	0.000	0.000	0.104	my8035_rel.cz10aps0_bee
0.000	0.000	96.510	3.346	0.144	nonzero	0.000	0.000	0.000	0.000	0.080	my8035_rel_lessps.cz10a_bee
0.000	0.000	96.498	3.357	0.144	0.001	0.000	0.000	0.000	0.000	0.104	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	96.192	3.661	0.146	0.001	0.000	0.000	0.000	0.000	0.104	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	96.362	3.476	0.161	0.001	0.000	0.000	0.000	0.000	0.076	my5621_rel.cz10a_bee
0.000	0.000	96.240	3.607	0.152	0.000	0.000	0.000	0.000	0.000	0.062	my5631_rel.cz10a_bee
0.000	0.000	96.139	3.714	0.147	0.000	0.000	0.000	0.000	0.000	0.061	my5641_rel.cz10a_bee
0.000	0.000	96.295	3.556	0.149	nonzero	0.000	0.000	0.000	0.000	0.073	my5651_rel.cz10a_bee
0.000	0.000	98.247	1.740	0.010	0.003	0.000	0.000	0.000	0.000	0.103	my5710_rel.cz10a_bee
0.000	0.000	97.768	2.219	0.010	0.003	0.000	0.000	0.000	0.000	0.093	my5720_rel.cz10a_bee
0.000	0.000	97.784	2.195	0.018	0.003	0.000	0.000	0.000	0.000	0.087	my5730_rel.cz10a_bee
0.000	0.000	97.721	2.261	0.015	0.003	0.000	0.000	0.000	0.000	0.088	my5744_rel.cz10a_bee
0.000	0.000	98.560	1.187	0.247	0.006	0.000	0.000	0.000	0.000	0.118	my8013_rel.cz10a_bee
0.000	0.000	97.899	1.836	0.262	0.004	0.000	0.000	0.000	0.000	0.102	my8014_rel.cz10a_bee
0.000	0.000	98.447	1.263	0.267	0.024	0.000	0.000	0.000	0.000	0.161	my8020_rel.cz10a_bee
0.000	0.000	98.324	1.648	0.026	0.002	0.000	0.000	0.000	0.000	0.102	my8028_rel.cz10a_bee
0.000	0.000	97.945	2.014	0.041	nonzero	0.000	0.000	0.000	0.000	0.102	my8035_rel.cz10a_bee
0.000	0.000	97.949	2.007	0.043	0.001	0.000	0.000	0.000	0.000	0.103	my8035_rel.cz10aps0_bee
0.000	0.000	97.962	1.996	0.042	0.000	0.000	0.000	0.000	0.000	0.063	my8035_rel_lessps.cz10a_bee
0.000	0.000	97.958	1.999	0.042	0.001	0.000	0.000	0.000	0.000	0.105	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	97.925	2.033	0.042	0.001	0.000	0.000	0.000	0.000	0.103	my8036_rel.cz10a_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
13.649	86.108	0.040	0.200	0.001	nonzero	0.000	0.000	0.000	0.000	0.079	my5621_rel.cz10a_bee
10.344	89.396	0.052	0.207	0.001	0.000	0.000	0.000	0.000	0.000	0.049	my5631_rel.cz10a_bee
9.774	89.966	0.050	0.209	0.001	0.000	0.000	0.000	0.000	0.000	0.049	my5641_rel.cz10a_bee
10.521	89.230	0.048	0.200	0.001	nonzero	0.000	0.000	0.000	0.000	0.067	my5651_rel.cz10a_bee
0.142	99.604	0.052	0.201	0.001	nonzero	0.000	0.000	0.000	0.000	0.078	my5710_rel.cz10a_bee
0.084	99.639	0.060	0.216	0.001	nonzero	0.000	0.000	0.000	0.000	0.075	my5720_rel.cz10a_bee
0.026	99.712	0.046	0.214	0.001	nonzero	0.000	0.000	0.000	0.000	0.074	my5730_rel.cz10a_bee
0.038	99.678	0.055	0.228	0.001	nonzero	0.000	0.000	0.000	0.000	0.074	my5744_rel.cz10a_bee
0.000	99.731	0.071	0.189	0.008	0.001	0.000	0.000	0.000	0.000	0.077	my8013_rel.cz10a_bee
0.000	99.733	0.081	0.182	0.003	0.001	0.000	0.000	0.000	0.000	0.077	my8014_rel.cz10a_bee
0.000	99.814	0.045	0.137	0.004	0.001	0.000	0.000	0.000	0.000	0.085	my8020_rel.cz10a_bee
0.000	99.711	0.080	0.207	0.001	nonzero	0.000	0.000	0.000	0.000	0.101	my8028_rel.cz10a_bee
0.000	99.555	0.213	0.230	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8035_rel.cz10a_bee
0.000	99.627	0.150	0.220	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8035_rel.cz10aps0_bee
0.000	99.646	0.133	0.219	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8035_rel_lessps.cz10a_bee
0.000	99.644	0.135	0.219	0.002	nonzero	0.000	0.000	0.000	0.000	0.101	my8035_rel_lessps.cz10aps0_bee
0.000	99.547	0.219	0.232	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
13.822	85.943	0.033	0.200	0.001	nonzero	0.000	0.000	0.000	0.000	0.079	my5621_rel.cz10a_bee
13.423	86.334	0.035	0.206	0.001	0.000	0.000	0.000	0.000	0.000	0.049	my5631_rel.cz10a_bee
12.547	87.208	0.035	0.209	0.001	0.000	0.000	0.000	0.000	0.000	0.048	my5641_rel.cz10a_bee
13.917	85.849	0.033	0.200	0.001	nonzero	0.000	0.000	0.000	0.000	0.068	my5651_rel.cz10a_bee
0.169	99.605	0.024	0.201	0.001	nonzero	0.000	0.000	0.000	0.000	0.079	my5710_rel.cz10a_bee
0.053	99.707	0.023	0.215	0.001	nonzero	0.000	0.000	0.000	0.000	0.075	my5720_rel.cz10a_bee
0.066	99.696	0.024	0.213	0.001	nonzero	0.000	0.000	0.000	0.000	0.074	my5730_rel.cz10a_bee
0.158	99.583	0.033	0.226	0.001	nonzero	0.000	0.000	0.000	0.000	0.074	my5744_rel.cz10a_bee
0.000	99.783	0.028	0.180	0.008	0.001	0.000	0.000	0.000	0.000	0.077	my8013_rel.cz10a_bee
0.000	99.786	0.032	0.178	0.003	0.001	0.000	0.000	0.000	0.000	0.077	my8014_rel.cz10a_bee
0.000	99.848	0.016	0.132	0.003	0.001	0.000	0.000	0.000	0.000	0.086	my8020_rel.cz10a_bee
0.000	99.768	0.026	0.204	0.001	nonzero	0.000	0.000	0.000	0.000	0.101	my8028_rel.cz10a_bee
0.000	99.696	0.073	0.229	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8035_rel.cz10a_bee
0.000	99.739	0.041	0.217	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8035_rel.cz10aps0_bee
0.000	99.742	0.038	0.217	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8035_rel_lessps.cz10a_bee
0.000	99.745	0.036	0.216	0.002	nonzero	0.000	0.000	0.000	0.000	0.101	my8035_rel_lessps.cz10aps0_bee
0.000	99.701	0.069	0.227	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz10a_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
96.549	3.445	0.002	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5621_rel.cz10a_bee
96.320	3.674	0.002	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	my5631_rel.cz10a_bee
96.317	3.677	0.002	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5641_rel.cz10a_bee
96.223	3.771	0.003	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	my5651_rel.cz10a_bee
73.134	26.865	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my5710_rel.cz10a_bee
72.645	27.355	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my5720_rel.cz10a_bee
70.938	29.061	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my5730_rel.cz10a_bee
70.406	29.594	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5744_rel.cz10a_bee
58.362	41.638	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8013_rel.cz10a_bee
55.771	44.229	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8014_rel.cz10a_bee
42.533	57.466	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8020_rel.cz10a_bee
31.781	68.218	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8028_rel.cz10a_bee
53.764	46.235	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel.cz10a_bee
66.039	33.960	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel.cz10aps0_bee
70.136	29.863	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel_lessps.cz10a_bee
68.855	31.144	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel_lessps.cz10aps0_bee
51.457	48.543	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	42.806	52.806	4.389	0.000	0.000	0.000	0.000	0.000	0.038	my5621_rel.cz10a_bee
0.000	0.000	42.778	51.694	5.528	0.000	0.000	0.000	0.000	0.000	0.040	my5631_rel.cz10a_bee
0.000	0.000	44.750	52.111	3.139	0.000	0.000	0.000	0.000	0.000	0.037	my5641_rel.cz10a_bee
0.000	0.000	41.222	53.556	5.222	0.000	0.000	0.000	0.000	0.000	0.033	my5651_rel.cz10a_bee
0.000	0.000	99.444	0.556	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my5710_rel.cz10a_bee
0.000	0.000	99.500	0.500	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5720_rel.cz10a_bee
0.000	0.000	98.250	1.639	0.111	0.000	0.000	0.000	0.000	0.000	0.028	my5730_rel.cz10a_bee
0.000	0.000	99.583	0.417	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my5744_rel.cz10a_bee
0.000	0.000	94.250	5.611	0.139	0.000	0.000	0.000	0.000	0.000	0.026	my8013_rel.cz10a_bee
0.000	0.000	95.417	4.583	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8014_rel.cz10a_bee
0.000	0.000	95.194	4.778	0.028	0.000	0.000	0.000	0.000	0.000	0.020	my8020_rel.cz10a_bee
0.000	0.000	98.250	1.750	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8028_rel.cz10a_bee
0.000	0.000	99.750	0.250	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8035_rel.cz10a_bee
0.000	0.000	99.250	0.750	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8035_rel.cz10aps0_bee
0.000	0.000	99.778	0.194	0.028	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel_lessps.cz10a_bee
0.000	0.000	98.722	1.250	0.028	0.000	0.000	0.000	0.000	0.000	0.019	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	97.750	2.139	0.111	0.000	0.000	0.000	0.000	0.000	0.019	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	42.806	54.972	2.222	0.000	0.000	0.000	0.000	0.000	0.031	my5621_rel.cz10a_bee
0.000	0.000	41.611	55.639	2.750	0.000	0.000	0.000	0.000	0.000	0.033	my5631_rel.cz10a_bee
0.000	0.000	44.889	53.694	1.417	0.000	0.000	0.000	0.000	0.000	0.029	my5641_rel.cz10a_bee
0.000	0.000	41.444	56.167	2.389	0.000	0.000	0.000	0.000	0.000	0.042	my5651_rel.cz10a_bee
0.000	0.000	99.417	0.583	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5710_rel.cz10a_bee
0.000	0.000	99.611	0.389	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5720_rel.cz10a_bee
0.000	0.000	98.611	1.333	0.056	0.000	0.000	0.000	0.000	0.000	0.023	my5730_rel.cz10a_bee
0.000	0.000	99.639	0.361	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my5744_rel.cz10a_bee
0.000	0.000	96.250	3.722	0.028	0.000	0.000	0.000	0.000	0.000	0.018	my8013_rel.cz10a_bee
0.000	0.000	97.167	2.833	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8014_rel.cz10a_bee
0.000	0.000	96.833	3.167	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8020_rel.cz10a_bee
0.000	0.000	98.528	1.417	0.056	0.000	0.000	0.000	0.000	0.000	0.019	my8028_rel.cz10a_bee
0.000	0.000	99.889	0.111	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8035_rel.cz10a_bee
0.000	0.000	99.361	0.639	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8035_rel.cz10aps0_bee
0.000	0.000	99.806	0.194	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8035_rel_lessps.cz10a_bee
0.000	0.000	98.889	1.111	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	98.111	1.889	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8036_rel.cz10a_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
94.712	5.283	0.003	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	my5621_rel.cz10a_bee
93.673	6.322	0.003	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	my5631_rel.cz10a_bee
93.887	6.109	0.003	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5641_rel.cz10a_bee
94.197	5.797	0.003	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5651_rel.cz10a_bee
87.925	12.073	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my5710_rel.cz10a_bee
86.136	13.861	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my5720_rel.cz10a_bee
84.521	15.477	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my5730_rel.cz10a_bee
83.898	16.101	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5744_rel.cz10a_bee
30.307	69.692	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8013_rel.cz10a_bee
18.609	81.390	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8014_rel.cz10a_bee
19.745	80.254	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8020_rel.cz10a_bee
14.746	85.253	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8028_rel.cz10a_bee
12.571	87.428	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel.cz10a_bee
14.840	85.158	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel.cz10aps0_bee
7.309	92.690	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel_lessps.cz10a_bee
14.102	85.897	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8035_rel_lessps.cz10aps0_bee
11.628	88.371	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	49.250	47.833	2.917	0.000	0.000	0.000	0.000	0.000	0.040	my5621_rel.cz10a_bee
0.000	0.000	48.972	47.944	3.083	0.000	0.000	0.000	0.000	0.000	0.044	my5631_rel.cz10a_bee
0.000	0.000	49.111	47.500	3.389	0.000	0.000	0.000	0.000	0.000	0.041	my5641_rel.cz10a_bee
0.000	0.000	46.389	48.861	4.750	0.000	0.000	0.000	0.000	0.000	0.052	my5651_rel.cz10a_bee
0.000	0.000	99.389	0.611	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my5710_rel.cz10a_bee
0.000	0.000	99.472	0.528	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my5720_rel.cz10a_bee
0.000	0.000	99.611	0.389	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5730_rel.cz10a_bee
0.000	0.000	99.500	0.500	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5744_rel.cz10a_bee
0.000	0.000	94.444	5.472	0.083	0.000	0.000	0.000	0.000	0.000	0.021	my8013_rel.cz10a_bee
0.000	0.000	95.111	4.861	0.028	0.000	0.000	0.000	0.000	0.000	0.017	my8014_rel.cz10a_bee
0.000	0.000	95.222	4.750	0.028	0.000	0.000	0.000	0.000	0.000	0.020	my8020_rel.cz10a_bee
0.000	0.000	99.528	0.472	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8028_rel.cz10a_bee
0.000	0.000	99.639	0.361	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8035_rel.cz10a_bee
0.000	0.000	99.750	0.222	0.028	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel.cz10aps0_bee
0.000	0.000	99.500	0.500	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.806	0.194	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.722	0.278	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	48.361	49.806	1.833	0.000	0.000	0.000	0.000	0.000	0.037	my5621_rel.cz10a_bee
0.000	0.000	48.194	50.222	1.583	0.000	0.000	0.000	0.000	0.000	0.033	my5631_rel.cz10a_bee
0.000	0.000	48.417	49.667	1.917	0.000	0.000	0.000	0.000	0.000	0.037	my5641_rel.cz10a_bee
0.000	0.000	44.750	53.194	2.056	0.000	0.000	0.000	0.000	0.000	0.033	my5651_rel.cz10a_bee
0.000	0.000	99.389	0.611	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5710_rel.cz10a_bee
0.000	0.000	99.500	0.500	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my5720_rel.cz10a_bee
0.000	0.000	99.667	0.333	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5730_rel.cz10a_bee
0.000	0.000	99.444	0.556	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5744_rel.cz10a_bee
0.000	0.000	97.000	3.000	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8013_rel.cz10a_bee
0.000	0.000	96.333	3.667	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8014_rel.cz10a_bee
0.000	0.000	96.444	3.556	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8020_rel.cz10a_bee
0.000	0.000	99.583	0.417	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8028_rel.cz10a_bee
0.000	0.000	99.722	0.278	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8035_rel.cz10a_bee
0.000	0.000	99.806	0.194	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8035_rel.cz10aps0_bee
0.000	0.000	99.556	0.444	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.861	0.139	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.778	0.222	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8036_rel.cz10a_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
96.529	3.466	0.002	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5621_rel.cz10a_bee
96.282	3.713	0.002	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5631_rel.cz10a_bee
96.289	3.706	0.002	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	my5641_rel.cz10a_bee
95.586	4.409	0.002	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my5651_rel.cz10a_bee
71.909	28.090	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5710_rel.cz10a_bee
71.551	28.449	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5720_rel.cz10a_bee
71.811	28.189	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my5730_rel.cz10a_bee
69.972	30.028	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my5744_rel.cz10a_bee
60.344	39.655	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8013_rel.cz10a_bee
54.916	45.084	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8014_rel.cz10a_bee
44.913	55.086	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8020_rel.cz10a_bee
30.766	69.233	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8028_rel.cz10a_bee
53.141	46.858	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8035_rel.cz10a_bee
64.397	35.602	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel.cz10aps0_bee
70.810	29.189	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel_lessps.cz10a_bee
67.852	32.147	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel_lessps.cz10aps0_bee
52.924	47.075	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	89.550	10.178	0.272	0.000	0.000	0.000	0.000	0.000	0.035	my5621_rel.cz10a_bee
0.000	0.000	89.650	10.183	0.167	0.000	0.000	0.000	0.000	0.000	0.035	my5631_rel.cz10a_bee
0.000	0.000	89.689	10.194	0.117	0.000	0.000	0.000	0.000	0.000	0.033	my5641_rel.cz10a_bee
0.000	0.000	89.739	10.128	0.133	0.000	0.000	0.000	0.000	0.000	0.029	my5651_rel.cz10a_bee
0.000	0.000	99.633	0.367	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5710_rel.cz10a_bee
0.000	0.000	99.417	0.583	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5720_rel.cz10a_bee
0.000	0.000	99.361	0.639	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my5730_rel.cz10a_bee
0.000	0.000	99.556	0.444	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5744_rel.cz10a_bee
0.000	0.000	94.828	5.094	0.078	0.000	0.000	0.000	0.000	0.000	0.022	my8013_rel.cz10a_bee
0.000	0.000	95.111	4.856	0.033	0.000	0.000	0.000	0.000	0.000	0.021	my8014_rel.cz10a_bee
0.000	0.000	94.972	4.983	0.044	0.000	0.000	0.000	0.000	0.000	0.026	my8020_rel.cz10a_bee
0.000	0.000	99.711	0.278	0.011	0.000	0.000	0.000	0.000	0.000	0.022	my8028_rel.cz10a_bee
0.000	0.000	99.239	0.750	0.011	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel.cz10a_bee
0.000	0.000	99.283	0.706	0.011	0.000	0.000	0.000	0.000	0.000	0.026	my8035_rel.cz10aps0_bee
0.000	0.000	99.533	0.461	0.006	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.550	0.439	0.011	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.267	0.722	0.011	0.000	0.000	0.000	0.000	0.000	0.025	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	89.994	9.839	0.167	0.000	0.000	0.000	0.000	0.000	0.033	my5621_rel.cz10a_bee
0.000	0.000	90.161	9.694	0.144	0.000	0.000	0.000	0.000	0.000	0.025	my5631_rel.cz10a_bee
0.000	0.000	90.339	9.589	0.072	0.000	0.000	0.000	0.000	0.000	0.042	my5641_rel.cz10a_bee
0.000	0.000	90.278	9.644	0.078	0.000	0.000	0.000	0.000	0.000	0.024	my5651_rel.cz10a_bee
0.000	0.000	99.728	0.272	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5710_rel.cz10a_bee
0.000	0.000	99.639	0.361	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5720_rel.cz10a_bee
0.000	0.000	99.628	0.372	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my5730_rel.cz10a_bee
0.000	0.000	99.667	0.333	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5744_rel.cz10a_bee
0.000	0.000	96.061	3.917	0.022	0.000	0.000	0.000	0.000	0.000	0.021	my8013_rel.cz10a_bee
0.000	0.000	96.406	3.567	0.028	0.000	0.000	0.000	0.000	0.000	0.019	my8014_rel.cz10a_bee
0.000	0.000	96.272	3.694	0.033	0.000	0.000	0.000	0.000	0.000	0.022	my8020_rel.cz10a_bee
0.000	0.000	99.761	0.239	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8028_rel.cz10a_bee
0.000	0.000	99.722	0.267	0.011	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel.cz10a_bee
0.000	0.000	99.617	0.372	0.011	0.000	0.000	0.000	0.000	0.000	0.024	my8035_rel.cz10aps0_bee
0.000	0.000	99.744	0.250	0.006	0.000	0.000	0.000	0.000	0.000	0.024	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.772	0.222	0.006	0.000	0.000	0.000	0.000	0.000	0.024	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.772	0.217	0.011	0.000	0.000	0.000	0.000	0.000	0.024	my8036_rel.cz10a_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
93.944	6.048	0.006	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5621_rel.cz10a_bee
93.108	6.884	0.006	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my5631_rel.cz10a_bee
93.923	6.070	0.006	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5641_rel.cz10a_bee
93.269	6.724	0.005	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5651_rel.cz10a_bee
83.306	16.688	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5710_rel.cz10a_bee
82.921	17.073	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my5720_rel.cz10a_bee
83.558	16.438	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my5730_rel.cz10a_bee
81.915	18.080	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my5744_rel.cz10a_bee
26.779	73.217	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8013_rel.cz10a_bee
22.326	77.671	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8014_rel.cz10a_bee
14.725	85.272	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8020_rel.cz10a_bee
13.469	86.525	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8028_rel.cz10a_bee
11.958	88.039	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel.cz10a_bee
9.055	90.940	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel.cz10aps0_bee
14.168	85.828	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel_lessps.cz10a_bee
11.174	88.821	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel_lessps.cz10aps0_bee
11.759	88.236	0.005	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	89.161	10.706	0.133	0.000	0.000	0.000	0.000	0.000	0.023	my5621_rel.cz10a_bee
0.000	0.000	89.206	10.589	0.206	0.000	0.000	0.000	0.000	0.000	0.031	my5631_rel.cz10a_bee
0.000	0.000	88.722	11.172	0.106	0.000	0.000	0.000	0.000	0.000	0.022	my5641_rel.cz10a_bee
0.000	0.000	88.778	11.083	0.139	0.000	0.000	0.000	0.000	0.000	0.024	my5651_rel.cz10a_bee
0.000	0.000	99.544	0.456	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my5710_rel.cz10a_bee
0.000	0.000	99.317	0.683	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5720_rel.cz10a_bee
0.000	0.000	99.500	0.500	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my5730_rel.cz10a_bee
0.000	0.000	99.556	0.444	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my5744_rel.cz10a_bee
0.000	0.000	94.922	5.006	0.072	0.000	0.000	0.000	0.000	0.000	0.021	my8013_rel.cz10a_bee
0.000	0.000	94.706	5.228	0.067	0.000	0.000	0.000	0.000	0.000	0.022	my8014_rel.cz10a_bee
0.000	0.000	94.628	5.306	0.067	0.000	0.000	0.000	0.000	0.000	0.024	my8020_rel.cz10a_bee
0.000	0.000	99.472	0.522	0.006	0.000	0.000	0.000	0.000	0.000	0.016	my8028_rel.cz10a_bee
0.000	0.000	98.694	1.289	0.017	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel.cz10a_bee
0.000	0.000	99.117	0.883	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8035_rel.cz10aps0_bee
0.000	0.000	99.306	0.689	0.006	0.000	0.000	0.000	0.000	0.000	0.025	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.206	0.794	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	98.817	1.172	0.011	0.000	0.000	0.000	0.000	0.000	0.025	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	89.494	10.489	0.017	0.000	0.000	0.000	0.000	0.000	0.022	my5621_rel.cz10a_bee
0.000	0.000	89.978	9.911	0.111	0.000	0.000	0.000	0.000	0.000	0.027	my5631_rel.cz10a_bee
0.000	0.000	89.761	10.222	0.017	0.000	0.000	0.000	0.000	0.000	0.017	my5641_rel.cz10a_bee
0.000	0.000	89.206	10.739	0.056	0.000	0.000	0.000	0.000	0.000	0.028	my5651_rel.cz10a_bee
0.000	0.000	99.656	0.344	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5710_rel.cz10a_bee
0.000	0.000	99.561	0.439	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5720_rel.cz10a_bee
0.000	0.000	99.672	0.328	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my5730_rel.cz10a_bee
0.000	0.000	99.661	0.339	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my5744_rel.cz10a_bee
0.000	0.000	96.361	3.594	0.044	0.000	0.000	0.000	0.000	0.000	0.019	my8013_rel.cz10a_bee
0.000	0.000	96.256	3.711	0.033	0.000	0.000	0.000	0.000	0.000	0.021	my8014_rel.cz10a_bee
0.000	0.000	95.944	4.028	0.028	0.000	0.000	0.000	0.000	0.000	0.023	my8020_rel.cz10a_bee
0.000	0.000	99.578	0.422	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8028_rel.cz10a_bee
0.000	0.000	99.517	0.472	0.011	0.000	0.000	0.000	0.000	0.000	0.024	my8035_rel.cz10a_bee
0.000	0.000	99.661	0.339	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8035_rel.cz10aps0_bee
0.000	0.000	99.650	0.344	0.006	0.000	0.000	0.000	0.000	0.000	0.024	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.594	0.406	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.711	0.283	0.006	0.000	0.000	0.000	0.000	0.000	0.024	my8036_rel.cz10a_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
96.436	3.558	0.003	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5621_rel.cz10a_bee
95.937	4.058	0.003	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5631_rel.cz10a_bee
95.938	4.054	0.004	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.021	my5641_rel.cz10a_bee
96.047	3.945	0.006	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	my5651_rel.cz10a_bee
73.741	26.258	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5710_rel.cz10a_bee
71.787	28.212	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my5720_rel.cz10a_bee
71.627	28.372	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my5730_rel.cz10a_bee
70.707	29.292	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5744_rel.cz10a_bee
62.804	37.194	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8013_rel.cz10a_bee
57.156	42.843	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8014_rel.cz10a_bee
47.686	52.312	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8020_rel.cz10a_bee
29.597	70.400	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8028_rel.cz10a_bee
53.727	46.270	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8035_rel.cz10a_bee
67.069	32.929	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8035_rel.cz10aps0_bee
69.691	30.307	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel_lessps.cz10a_bee
68.844	31.154	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8035_rel_lessps.cz10aps0_bee
51.411	48.587	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	93.236	6.625	0.139	0.000	0.000	0.000	0.000	0.000	0.041	my5621_rel.cz10a_bee
0.000	0.000	93.389	6.544	0.067	0.000	0.000	0.000	0.000	0.000	0.045	my5631_rel.cz10a_bee
0.000	0.000	91.939	7.900	0.161	0.000	0.000	0.000	0.000	0.000	0.039	my5641_rel.cz10a_bee
0.000	0.000	90.511	9.144	0.344	0.000	0.000	0.000	0.000	0.000	0.041	my5651_rel.cz10a_bee
0.000	0.000	99.539	0.458	0.003	0.000	0.000	0.000	0.000	0.000	0.039	my5710_rel.cz10a_bee
0.000	0.000	99.578	0.419	0.003	0.000	0.000	0.000	0.000	0.000	0.049	my5720_rel.cz10a_bee
0.000	0.000	99.286	0.711	0.003	0.000	0.000	0.000	0.000	0.000	0.040	my5730_rel.cz10a_bee
0.000	0.000	99.464	0.531	0.006	0.000	0.000	0.000	0.000	0.000	0.042	my5744_rel.cz10a_bee
0.000	0.000	95.397	4.508	0.094	0.000	0.000	0.000	0.000	0.000	0.050	my8013_rel.cz10a_bee
0.000	0.000	94.883	5.022	0.094	0.000	0.000	0.000	0.000	0.000	0.040	my8014_rel.cz10a_bee
0.000	0.000	95.375	4.547	0.078	0.000	0.000	0.000	0.000	0.000	0.058	my8020_rel.cz10a_bee
0.000	0.000	99.358	0.633	0.008	0.000	0.000	0.000	0.000	0.000	0.058	my8028_rel.cz10a_bee
0.000	0.000	96.878	3.108	0.011	0.003	0.000	0.000	0.000	0.000	0.105	my8035_rel.cz10a_bee
0.000	0.000	97.939	2.044	0.017	0.000	0.000	0.000	0.000	0.000	0.033	my8035_rel.cz10aps0_bee
0.000	0.000	98.414	1.569	0.017	0.000	0.000	0.000	0.000	0.000	0.043	my8035_rel_lessps.cz10a_bee
0.000	0.000	98.308	1.675	0.017	0.000	0.000	0.000	0.000	0.000	0.039	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	96.892	3.092	0.017	0.000	0.000	0.000	0.000	0.000	0.050	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	93.753	6.147	0.100	0.000	0.000	0.000	0.000	0.000	0.040	my5621_rel.cz10a_bee
0.000	0.000	94.183	5.783	0.033	0.000	0.000	0.000	0.000	0.000	0.045	my5631_rel.cz10a_bee
0.000	0.000	92.797	7.078	0.125	0.000	0.000	0.000	0.000	0.000	0.040	my5641_rel.cz10a_bee
0.000	0.000	92.183	7.550	0.267	0.000	0.000	0.000	0.000	0.000	0.041	my5651_rel.cz10a_bee
0.000	0.000	99.694	0.303	0.003	0.000	0.000	0.000	0.000	0.000	0.040	my5710_rel.cz10a_bee
0.000	0.000	99.764	0.233	0.003	0.000	0.000	0.000	0.000	0.000	0.048	my5720_rel.cz10a_bee
0.000	0.000	99.486	0.511	0.003	0.000	0.000	0.000	0.000	0.000	0.038	my5730_rel.cz10a_bee
0.000	0.000	99.608	0.389	0.003	0.000	0.000	0.000	0.000	0.000	0.043	my5744_rel.cz10a_bee
0.000	0.000	96.144	3.819	0.036	0.000	0.000	0.000	0.000	0.000	0.047	my8013_rel.cz10a_bee
0.000	0.000	95.872	4.069	0.058	0.000	0.000	0.000	0.000	0.000	0.040	my8014_rel.cz10a_bee
0.000	0.000	96.219	3.722	0.058	0.000	0.000	0.000	0.000	0.000	0.049	my8020_rel.cz10a_bee
0.000	0.000	99.781	0.217	0.003	0.000	0.000	0.000	0.000	0.000	0.049	my8028_rel.cz10a_bee
0.000	0.000	99.511	0.478	0.008	0.003	0.000	0.000	0.000	0.000	0.104	my8035_rel.cz10a_bee
0.000	0.000	99.664	0.331	0.006	0.000	0.000	0.000	0.000	0.000	0.041	my8035_rel.cz10aps0_bee
0.000	0.000	99.594	0.397	0.008	0.000	0.000	0.000	0.000	0.000	0.051	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.725	0.261	0.014	0.000	0.000	0.000	0.000	0.000	0.048	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.694	0.294	0.011	0.000	0.000	0.000	0.000	0.000	0.041	my8036_rel.cz10a_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client
Legend for results is here.
Each entry lists the percentage of responses that fit in that bucket (slower than max time for previous bucket, faster than min time for next bucket).

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
93.392	6.599	0.008	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my5621_rel.cz10a_bee
92.745	7.245	0.009	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5631_rel.cz10a_bee
93.194	6.797	0.008	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5641_rel.cz10a_bee
92.595	7.396	0.008	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5651_rel.cz10a_bee
83.235	16.755	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5710_rel.cz10a_bee
82.878	17.112	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5720_rel.cz10a_bee
81.611	18.378	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my5730_rel.cz10a_bee
80.690	19.301	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my5744_rel.cz10a_bee
38.397	61.582	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8013_rel.cz10a_bee
21.895	78.100	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8014_rel.cz10a_bee
20.027	79.966	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8020_rel.cz10a_bee
14.620	85.373	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8028_rel.cz10a_bee
10.592	89.399	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8035_rel.cz10a_bee
10.225	89.766	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8035_rel.cz10aps0_bee
10.658	89.333	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8035_rel_lessps.cz10a_bee
14.265	85.728	0.008	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8035_rel_lessps.cz10aps0_bee
11.392	88.599	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8036_rel.cz10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	93.325	6.497	0.178	0.000	0.000	0.000	0.000	0.000	0.040	my5621_rel.cz10a_bee
0.000	0.000	91.333	8.381	0.286	0.000	0.000	0.000	0.000	0.000	0.039	my5631_rel.cz10a_bee
0.000	0.000	92.222	7.636	0.142	0.000	0.000	0.000	0.000	0.000	0.045	my5641_rel.cz10a_bee
0.000	0.000	89.864	9.836	0.300	0.000	0.000	0.000	0.000	0.000	0.040	my5651_rel.cz10a_bee
0.000	0.000	99.386	0.608	0.006	0.000	0.000	0.000	0.000	0.000	0.046	my5710_rel.cz10a_bee
0.000	0.000	99.358	0.639	0.003	0.000	0.000	0.000	0.000	0.000	0.040	my5720_rel.cz10a_bee
0.000	0.000	99.325	0.672	0.003	0.000	0.000	0.000	0.000	0.000	0.049	my5730_rel.cz10a_bee
0.000	0.000	99.389	0.608	0.003	0.000	0.000	0.000	0.000	0.000	0.050	my5744_rel.cz10a_bee
0.000	0.000	94.908	5.036	0.056	0.000	0.000	0.000	0.000	0.000	0.049	my8013_rel.cz10a_bee
0.000	0.000	94.867	5.067	0.067	0.000	0.000	0.000	0.000	0.000	0.049	my8014_rel.cz10a_bee
0.000	0.000	95.178	4.758	0.064	0.000	0.000	0.000	0.000	0.000	0.058	my8020_rel.cz10a_bee
0.000	0.000	99.158	0.836	0.006	0.000	0.000	0.000	0.000	0.000	0.057	my8028_rel.cz10a_bee
0.000	0.000	96.847	3.144	0.008	0.000	0.000	0.000	0.000	0.000	0.041	my8035_rel.cz10a_bee
0.000	0.000	97.772	2.217	0.011	0.000	0.000	0.000	0.000	0.000	0.041	my8035_rel.cz10aps0_bee
0.000	0.000	98.344	1.644	0.011	0.000	0.000	0.000	0.000	0.000	0.051	my8035_rel_lessps.cz10a_bee
0.000	0.000	98.356	1.633	0.008	0.003	0.000	0.000	0.000	0.000	0.103	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	96.381	3.600	0.019	0.000	0.000	0.000	0.000	0.000	0.048	my8036_rel.cz10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	93.903	5.956	0.142	0.000	0.000	0.000	0.000	0.000	0.037	my5621_rel.cz10a_bee
0.000	0.000	92.900	6.914	0.186	0.000	0.000	0.000	0.000	0.000	0.040	my5631_rel.cz10a_bee
0.000	0.000	93.542	6.356	0.103	0.000	0.000	0.000	0.000	0.000	0.045	my5641_rel.cz10a_bee
0.000	0.000	91.600	8.181	0.219	0.000	0.000	0.000	0.000	0.000	0.038	my5651_rel.cz10a_bee
0.000	0.000	99.631	0.364	0.006	0.000	0.000	0.000	0.000	0.000	0.049	my5710_rel.cz10a_bee
0.000	0.000	99.608	0.389	0.003	0.000	0.000	0.000	0.000	0.000	0.041	my5720_rel.cz10a_bee
0.000	0.000	99.564	0.433	0.003	0.000	0.000	0.000	0.000	0.000	0.047	my5730_rel.cz10a_bee
0.000	0.000	99.614	0.383	0.003	0.000	0.000	0.000	0.000	0.000	0.047	my5744_rel.cz10a_bee
0.000	0.000	96.786	3.175	0.039	0.000	0.000	0.000	0.000	0.000	0.048	my8013_rel.cz10a_bee
0.000	0.000	95.894	4.053	0.053	0.000	0.000	0.000	0.000	0.000	0.046	my8014_rel.cz10a_bee
0.000	0.000	96.242	3.731	0.028	0.000	0.000	0.000	0.000	0.000	0.049	my8020_rel.cz10a_bee
0.000	0.000	99.644	0.353	0.003	0.000	0.000	0.000	0.000	0.000	0.047	my8028_rel.cz10a_bee
0.000	0.000	99.683	0.308	0.008	0.000	0.000	0.000	0.000	0.000	0.050	my8035_rel.cz10a_bee
0.000	0.000	99.694	0.297	0.008	0.000	0.000	0.000	0.000	0.000	0.049	my8035_rel.cz10aps0_bee
0.000	0.000	99.775	0.217	0.008	0.000	0.000	0.000	0.000	0.000	0.041	my8035_rel_lessps.cz10a_bee
0.000	0.000	99.736	0.258	0.003	0.003	0.000	0.000	0.000	0.000	0.104	my8035_rel_lessps.cz10aps0_bee
0.000	0.000	99.444	0.539	0.017	0.000	0.000	0.000	0.000	0.000	0.038	my8036_rel.cz10a_bee

Introduction

Contents

Summary

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6

l.i0

l.x

l.i1

l.i2

qr100.L1

qp100.L2

qr500.L3

qp500.L4

qr1000.L5

qp1000.L6