Introduction

This is a report for the insert benchmark with 30M docs and 1 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 16G RAM and an NVMe SSD. It is described here as the Beelink. The benchmark was run with 1 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 1 table. It loads 30M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40m+10m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
ma101107_rel.cz11a_bee 837991304351906611136356537293516381835743824
ma101107_rel.cz11b_bee 835651304351773010941367035883621379135783768
ma101107_rel.cz11c_bee 842701304351721910799359936443568372435543919
ma101107_rel.cz11d_bee 837991304351917511198361437203580380235973807
ma110401_rel.cz11b_bee 821921282061777010799366737283593383536183836
ma110401_rel.cz11c_bee 831021282061726410707364235973622384936453836
my8036_rel.cz11a_bee 56604136987168358643364228423674283837232885
my8036_rel.cz11b_bee 5681830832136427027353228763634282337012942
my8036_rel.cz11c_bee 5618021614149097770358028373558290836772938
my8036_rel.cz11d_bee 57034137615169068650360428083575283035982867

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
ma101107_rel.cz11a_bee 1.001.001.001.001.001.001.001.001.001.00
ma101107_rel.cz11b_bee 1.001.000.930.981.030.961.030.991.000.99
ma101107_rel.cz11c_bee 1.011.000.900.971.010.981.010.980.991.02
ma101107_rel.cz11d_bee 1.001.001.011.011.011.001.021.001.011.00
ma110401_rel.cz11b_bee 0.980.980.930.971.031.001.021.001.011.00
ma110401_rel.cz11c_bee 0.990.980.910.961.020.961.031.011.021.00
my8036_rel.cz11a_bee 0.681.050.880.781.020.761.040.741.040.75
my8036_rel.cz11b_bee 0.680.240.720.630.990.771.030.741.040.77
my8036_rel.cz11c_bee 0.670.170.780.701.000.761.010.761.030.77
my8036_rel.cz11d_bee 0.681.060.890.781.010.751.020.741.010.75

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
ma101107_rel.cz11a_bee100100499499998998
ma101107_rel.cz11b_bee100100499499998998
ma101107_rel.cz11c_bee100100499499998998
ma101107_rel.cz11d_bee100100499499998998
ma110401_rel.cz11b_bee100100499499998998
ma110401_rel.cz11c_bee100100499499998998
my8036_rel.cz11a_bee100100499499998998
my8036_rel.cz11b_bee100100499499998998
my8036_rel.cz11c_bee100100499499998998
my8036_rel.cz11d_bee100100499499998998
target10010050050010001000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee10.96488.7240.1970.1110.0050.182
ma101107_rel.cz11b_bee9.94389.7440.1970.1110.0050.229
ma101107_rel.cz11c_bee12.06387.6250.1850.1210.0050.251
ma101107_rel.cz11d_bee10.12089.5680.1840.1220.0050.190
ma110401_rel.cz11b_bee2.68896.9980.1870.1220.0050.206
ma110401_rel.cz11c_bee4.37495.3130.1900.1190.0050.204
my8036_rel.cz11a_bee99.4130.4550.1310.0010.086
my8036_rel.cz11b_bee99.3970.4630.1390.0010.108
my8036_rel.cz11c_bee99.3950.4480.1510.0050.095
my8036_rel.cz11d_bee99.4210.4430.1350.0010.088

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
83799	0	0	0.0	266.2	21.6	0.000	0.000	0.003	0.264	11299	25.8	0.135	25	2.0	17.8	2.4	0.182	84803	71353	ma101107_rel.cz11a_bee
83565	0	0	0.0	262.2	21.5	0.000	0.000	0.003	0.264	11334	25.9	0.136	25	2.0	17.8	2.4	0.229	84504	70719	ma101107_rel.cz11b_bee
84270	0	0	0.0	54.6	21.5	0.000	0.000	0.001	0.262	11219	26.0	0.133	25	2.0	17.8	2.4	0.251	84902	70520	ma101107_rel.cz11c_bee
83799	0	0	0.0	265.5	21.6	0.000	0.000	0.003	0.263	11312	25.8	0.135	25	2.0	17.8	2.4	0.190	84506	70520	ma101107_rel.cz11d_bee
82192	0	0	0.0	252.5	21.1	0.000	0.000	0.003	0.262	11329	25.9	0.138	25	2.0	17.8	2.3	0.206	82810	69657	ma110401_rel.cz11b_bee
83102	0	0	0.0	52.5	21.2	0.000	0.000	0.001	0.262	11328	25.9	0.136	25	2.0	17.8	2.3	0.204	83805	68653	ma110401_rel.cz11c_bee
56604	0	0	0.0	247.7	18.9	0.000	0.000	0.004	0.342	6537	20.8	0.115	29	2.0	17.6	3.0	0.086	56637	52440	my8036_rel.cz11a_bee
56818	0	0	0.0	286.0	19.1	0.000	0.000	0.005	0.343	6881	21.6	0.121	30	2.0	17.6	3.1	0.108	57135	51742	my8036_rel.cz11b_bee
56180	0	0	0.0	220.5	18.9	0.000	0.000	0.004	0.344	7337	22.3	0.131	32	2.0	17.6	3.0	0.095	56835	50343	my8036_rel.cz11c_bee
57034	0	0	0.0	249.5	19.1	0.000	0.000	0.004	0.342	6573	20.7	0.115	29	2.0	17.6	3.1	0.088	57135	53341	my8036_rel.cz11d_bee

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
130435	0	0	0.0	823.0	111.7	0.000	0.000	0.006	0.877	3016	12.1	0.023	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11a_bee
130435	0	0	0.0	817.1	111.0	0.000	0.000	0.006	0.872	3151	12.1	0.024	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11b_bee
130435	0	0	0.0	272.3	111.0	0.000	0.000	0.002	0.872	3240	12.2	0.025	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11c_bee
130435	0	0	0.0	814.4	110.7	0.000	0.000	0.006	0.869	3054	12.1	0.023	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11d_bee
128206	0	0	0.0	807.7	109.8	0.000	0.000	0.006	0.877	2916	12.1	0.023	8	4.5	20.3	3.8	0.002	NA	NA	ma110401_rel.cz11b_bee
128206	0	0	0.0	270.9	109.8	0.000	0.000	0.002	0.877	3184	12.0	0.025	7	4.5	20.3	3.8	0.002	NA	NA	ma110401_rel.cz11c_bee
136987	0	705	44.6	2524.3	150.7	0.005	0.333	0.018	1.127	9433	43.3	0.069	25	4.5	20.1	5.3	0.003	NA	NA	my8036_rel.cz11a_bee
30832	0	156	9.9	820.3	36.1	0.005	0.328	0.027	1.200	5284	10.8	0.171	28	4.5	20.1	5.4	0.003	NA	NA	my8036_rel.cz11b_bee
21614	0	109	6.9	573.2	25.3	0.005	0.328	0.027	1.200	4920	7.9	0.228	29	4.5	20.1	5.4	0.003	NA	NA	my8036_rel.cz11c_bee
137615	0	705	44.6	2596.0	151.8	0.005	0.332	0.019	1.130	9518	43.7	0.069	25	4.5	20.1	5.3	0.003	NA	NA	my8036_rel.cz11d_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee95.9144.0100.075nonzerononzero0.263
ma101107_rel.cz11b_bee94.2875.2200.4890.0040.235
ma101107_rel.cz11c_bee94.1495.0840.7510.015nonzero0.314
ma101107_rel.cz11d_bee95.9164.0120.071nonzero0.117
ma110401_rel.cz11b_bee94.3015.2110.4850.0040.189
ma110401_rel.cz11c_bee93.9665.2890.7320.0120.0010.451
my8036_rel.cz11a_bee95.8883.9540.1560.0020.105
my8036_rel.cz11b_bee88.75610.1081.1250.0110.191
my8036_rel.cz11c_bee91.6477.7250.5790.0440.0040.0011.066
my8036_rel.cz11d_bee95.9493.8950.1540.0020.104

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee97.3122.6490.039nonzero0.255
ma101107_rel.cz11b_bee96.1313.4700.3960.0030.234
ma101107_rel.cz11c_bee95.9163.4580.6130.013nonzero0.269
ma101107_rel.cz11d_bee97.3012.6560.0430.063
ma110401_rel.cz11b_bee96.0233.5870.3880.0030.188
ma110401_rel.cz11c_bee95.7093.6750.6050.011nonzero0.424
my8036_rel.cz11a_bee97.6762.2740.0490.0010.105
my8036_rel.cz11b_bee92.5136.8420.6380.0070.105
my8036_rel.cz11c_bee94.9744.7520.2540.0160.0040.0011.049
my8036_rel.cz11d_bee97.6082.3430.0470.0020.104

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19066	0	754	2.9	2800.7	102.6	0.040	0.158	0.147	5.511	50067	34.8	2.626	146	6.2	22.0	6.1	0.263	20328	5294	ma101107_rel.cz11a_bee
17730	0	698	2.7	2643.1	95.4	0.039	0.158	0.149	5.509	46805	32.9	2.640	148	6.2	22.0	6.1	0.235	18430	5294	ma101107_rel.cz11b_bee
17219	0	677	2.6	2422.3	92.4	0.039	0.157	0.141	5.496	42314	32.5	2.457	151	6.1	22.0	6.1	0.314	17281	4897	ma101107_rel.cz11c_bee
19175	0	756	3.0	2809.4	103.0	0.039	0.158	0.147	5.502	50335	34.9	2.625	146	6.2	22.0	6.1	0.117	20427	5294	ma101107_rel.cz11d_bee
17770	0	685	2.7	2634.6	95.1	0.039	0.154	0.148	5.483	46630	32.8	2.624	148	6.2	22.0	6.1	0.189	18380	5194	ma110401_rel.cz11b_bee
17264	0	663	2.6	2422.0	92.6	0.038	0.154	0.140	5.492	42459	32.3	2.459	150	6.2	22.0	6.1	0.451	17780	4895	ma110401_rel.cz11c_bee
16835	0	61	1.0	2782.0	102.0	0.004	0.058	0.165	6.206	38919	38.5	2.312	183	6.5	22.4	7.9	0.105	17580	5244	my8036_rel.cz11a_bee
13642	0	40	0.6	1602.6	60.8	0.003	0.047	0.117	4.563	34147	37.2	2.503	218	6.1	21.8	7.3	0.191	14041	3995	my8036_rel.cz11b_bee
14909	0	6	0.3	982.0	48.3	0.000	0.018	0.066	3.314	33407	36.8	2.241	197	6.3	22.1	6.9	1.066	16432	2547	my8036_rel.cz11c_bee
16906	0	61	1.0	2752.6	101.3	0.004	0.058	0.163	6.135	38939	38.6	2.303	183	6.5	22.4	7.9	0.104	17580	5244	my8036_rel.cz11d_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee0.38499.4650.1310.021nonzerononzero0.065
ma101107_rel.cz11b_bee0.51899.2600.1170.1020.0020.063
ma101107_rel.cz11c_bee0.34499.4110.1130.1220.009nonzero0.106
ma101107_rel.cz11d_bee0.42899.4150.1350.0210.0010.063
ma110401_rel.cz11b_bee0.35899.4240.1110.1040.003nonzero0.064
ma110401_rel.cz11c_bee0.70899.0440.1160.1240.008nonzero0.093
my8036_rel.cz11a_bee99.3840.3600.2540.002nonzero0.102
my8036_rel.cz11b_bee98.0230.8840.9970.0930.0020.107
my8036_rel.cz11c_bee98.7930.5240.6560.0250.0020.118
my8036_rel.cz11d_bee99.3750.3690.2540.0020.0010.102

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee3.06096.7860.1340.020nonzerononzero0.065
ma101107_rel.cz11b_bee2.74897.0430.1130.0940.0020.063
ma101107_rel.cz11c_bee3.08296.6850.1120.1130.008nonzero0.106
ma101107_rel.cz11d_bee2.95196.8910.1370.0210.0010.063
ma110401_rel.cz11b_bee1.12998.6520.1170.0980.003nonzero0.064
ma110401_rel.cz11c_bee1.40698.3540.1160.1170.007nonzero0.067
my8036_rel.cz11a_bee99.5450.2040.2490.002nonzero0.102
my8036_rel.cz11b_bee98.4080.5420.9650.0810.0030.102
my8036_rel.cz11c_bee99.0370.2800.6610.0210.0010.108
my8036_rel.cz11d_bee99.5470.2040.2460.0020.0010.102

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
11136	0	1774	6.9	1327.5	50.6	0.159	0.637	0.119	4.652	62221	35.3	5.587	254	6.2	22.0	6.1	0.065	11163	9794	ma101107_rel.cz11a_bee
10941	0	1744	6.8	1335.0	50.0	0.159	0.638	0.122	4.677	61253	35.0	5.599	256	6.2	22.0	6.1	0.063	11043	9394	ma101107_rel.cz11b_bee
10799	0	1722	6.7	1264.2	49.2	0.159	0.638	0.117	4.668	58906	34.7	5.455	257	6.1	22.0	6.1	0.106	11038	8365	ma101107_rel.cz11c_bee
11198	0	1786	7.0	1355.9	51.5	0.159	0.638	0.121	4.712	62617	35.4	5.592	253	6.2	22.0	6.1	0.063	11223	10149	ma101107_rel.cz11d_bee
10799	0	1719	6.7	1320.2	49.4	0.159	0.637	0.122	4.680	60542	34.8	5.606	258	6.2	22.0	6.1	0.064	10913	9004	ma110401_rel.cz11b_bee
10707	0	1702	6.6	1253.1	48.8	0.159	0.636	0.117	4.666	58604	34.6	5.474	259	6.2	22.0	6.1	0.093	10918	8426	ma110401_rel.cz11c_bee
8643	0	0	0.0	1481.9	50.5	0.000	0.000	0.171	5.978	51714	35.6	5.983	330	6.5	22.4	7.9	0.102	8659	7781	my8036_rel.cz11a_bee
7027	0	0	0.0	1429.2	41.4	0.000	0.000	0.203	6.034	45076	36.5	6.414	416	6.1	21.8	7.3	0.107	7062	5594	my8036_rel.cz11b_bee
7770	0	0	0.0	978.9	30.4	0.000	0.000	0.126	4.009	46777	34.0	6.020	350	6.3	22.1	6.8	0.118	7841	6209	my8036_rel.cz11c_bee
8650	0	0	0.0	1469.8	50.2	0.000	0.000	0.170	5.939	51900	35.6	6.000	329	6.5	22.4	7.9	0.102	8669	7771	my8036_rel.cz11d_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee54.96045.040nonzerononzero0.005
ma101107_rel.cz11b_bee59.64340.3560.001nonzero0.012
ma101107_rel.cz11c_bee56.06443.935nonzerononzerononzero0.016
ma101107_rel.cz11d_bee57.71542.284nonzero0.004
ma110401_rel.cz11b_bee60.35339.646nonzerononzero0.004
ma110401_rel.cz11c_bee59.24940.751nonzerononzero0.014
my8036_rel.cz11a_bee59.84240.1570.001nonzero0.005
my8036_rel.cz11b_bee53.78346.217nonzerononzero0.007
my8036_rel.cz11c_bee56.10943.8910.001nonzerononzero0.050
my8036_rel.cz11d_bee56.26943.7300.001nonzero0.005

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee53.30646.6670.0280.024
ma101107_rel.cz11b_bee53.19446.7780.0280.044
ma101107_rel.cz11c_bee53.02846.9720.012
ma101107_rel.cz11d_bee53.27846.6940.0280.026
ma110401_rel.cz11b_bee53.25046.7220.0280.020
ma110401_rel.cz11c_bee53.30646.6940.012
my8036_rel.cz11a_bee98.8891.0830.0280.026
my8036_rel.cz11b_bee99.5280.4720.015
my8036_rel.cz11c_bee99.2780.6670.0280.0280.085
my8036_rel.cz11d_bee99.4720.5280.014

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee53.36146.6390.012
ma101107_rel.cz11b_bee53.22246.7500.0280.017
ma101107_rel.cz11c_bee53.02846.9720.012
ma101107_rel.cz11d_bee53.27846.7220.012
ma110401_rel.cz11b_bee53.30646.6940.012
ma110401_rel.cz11c_bee53.27846.7220.013
my8036_rel.cz11a_bee99.0280.9440.0280.019
my8036_rel.cz11b_bee99.6670.3330.013
my8036_rel.cz11c_bee99.4170.4720.0560.0560.091
my8036_rel.cz11d_bee99.5000.5000.015

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	3565	3	0.0	8.0	0.3	0.001	0.004	0.080	2.955	13852	12.8	3.886	287	6.2	22.0	6.1	0.005	3532	3388	ma101107_rel.cz11a_bee
100	3670	3	0.0	8.1	0.3	0.001	0.003	0.082	2.954	14267	12.8	3.888	279	6.2	22.0	6.1	0.012	3627	3452	ma101107_rel.cz11b_bee
100	3599	3	0.0	8.1	0.3	0.001	0.003	0.081	2.963	13976	12.9	3.884	287	6.1	22.0	6.1	0.016	3564	3404	ma101107_rel.cz11c_bee
100	3614	3	0.0	8.0	0.3	0.001	0.004	0.080	2.954	14052	12.9	3.888	286	6.2	22.0	6.1	0.004	3595	3436	ma101107_rel.cz11d_bee
100	3667	3	0.0	8.2	0.3	0.001	0.003	0.082	2.944	14247	13.0	3.885	284	6.2	22.0	6.1	0.004	3644	3484	ma110401_rel.cz11b_bee
100	3642	3	0.0	8.1	0.3	0.001	0.003	0.081	2.962	14149	12.8	3.885	281	6.2	22.0	6.1	0.014	3612	3468	ma110401_rel.cz11c_bee
100	3642	0	0.0	165.3	4.2	0.000	0.000	1.657	42.812	14954	13.2	4.105	290	6.5	22.4	7.9	0.005	3612	3436	my8036_rel.cz11a_bee
100	3532	0	0.0	36.6	0.8	0.000	0.000	0.367	7.985	14170	12.9	4.012	292	6.1	21.8	7.3	0.007	3516	3388	my8036_rel.cz11b_bee
100	3580	0	0.0	111.3	2.0	0.000	0.000	1.115	20.356	14750	13.6	4.120	304	6.3	22.1	6.8	0.050	3547	3356	my8036_rel.cz11c_bee
100	3604	0	0.0	152.7	3.9	0.000	0.000	1.530	39.549	14767	13.0	4.097	289	6.5	22.4	7.9	0.005	3564	3356	my8036_rel.cz11d_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee74.19025.8090.002nonzero0.005
ma101107_rel.cz11b_bee64.67235.3260.002nonzero0.005
ma101107_rel.cz11c_bee65.69234.3070.001nonzero0.005
ma101107_rel.cz11d_bee65.84634.1520.001nonzero0.005
ma110401_rel.cz11b_bee77.68622.3120.002nonzero0.007
ma110401_rel.cz11c_bee63.74336.2560.001nonzero0.004
my8036_rel.cz11a_bee10.87089.1280.002nonzero0.004
my8036_rel.cz11b_bee13.68786.3110.001nonzero0.005
my8036_rel.cz11c_bee12.59087.4080.0020.003
my8036_rel.cz11d_bee9.53490.4640.0020.004

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee53.19446.8060.012
ma101107_rel.cz11b_bee53.00047.0000.012
ma101107_rel.cz11c_bee53.41746.5830.012
ma101107_rel.cz11d_bee52.94447.0560.012
ma110401_rel.cz11b_bee53.30646.6940.012
ma110401_rel.cz11c_bee53.00047.0000.012
my8036_rel.cz11a_bee99.6390.3610.016
my8036_rel.cz11b_bee99.6940.3060.009
my8036_rel.cz11c_bee99.3060.6670.0280.018
my8036_rel.cz11d_bee99.7220.2500.0280.021

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee53.33346.6670.012
ma101107_rel.cz11b_bee53.08346.9170.012
ma101107_rel.cz11c_bee53.41746.5830.012
ma101107_rel.cz11d_bee53.00047.0000.012
ma110401_rel.cz11b_bee53.33346.6670.012
ma110401_rel.cz11c_bee53.11146.8890.012
my8036_rel.cz11a_bee99.8060.1940.008
my8036_rel.cz11b_bee99.7500.2500.009
my8036_rel.cz11c_bee99.4720.5280.013
my8036_rel.cz11d_bee99.8060.1940.014

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	3729	3	0.0	19.6	0.6	0.001	0.003	0.196	6.478	15342	14.1	4.114	302	6.2	22.0	6.1	0.005	3548	3324	ma101107_rel.cz11a_bee
100	3588	3	0.0	19.9	0.6	0.001	0.004	0.200	6.476	14763	14.3	4.115	319	6.2	22.0	6.1	0.005	3484	3308	ma101107_rel.cz11b_bee
100	3644	3	0.0	25.6	0.8	0.001	0.003	0.257	8.239	14988	14.3	4.114	314	6.1	22.0	6.1	0.005	3500	3324	ma101107_rel.cz11c_bee
100	3720	3	0.0	13.8	0.5	0.001	0.003	0.138	4.716	15277	14.1	4.107	303	6.2	22.0	6.1	0.005	3532	3324	ma101107_rel.cz11d_bee
100	3728	3	0.0	14.0	0.5	0.001	0.003	0.140	4.715	15297	14.3	4.103	307	6.2	22.0	6.1	0.007	3580	3355	ma110401_rel.cz11b_bee
100	3597	3	0.0	19.8	0.6	0.001	0.003	0.198	6.484	14778	14.1	4.108	314	6.2	22.0	6.1	0.004	3500	3307	ma110401_rel.cz11c_bee
100	2842	0	0.0	40.9	1.1	0.000	0.000	0.409	10.861	12111	13.3	4.261	374	6.5	22.4	7.9	0.004	2748	2605	my8036_rel.cz11a_bee
100	2876	0	0.0	14.2	0.3	0.000	0.000	0.142	2.970	12190	13.3	4.238	370	6.1	21.8	7.3	0.005	2750	2621	my8036_rel.cz11b_bee
100	2837	0	0.0	19.1	0.3	0.000	0.000	0.191	2.984	12066	13.1	4.253	369	6.3	22.1	6.8	0.003	2733	2589	my8036_rel.cz11c_bee
100	2808	0	0.0	42.5	1.1	0.000	0.000	0.426	11.402	11973	13.3	4.264	379	6.5	22.4	7.9	0.004	2717	2589	my8036_rel.cz11d_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee51.80448.1950.001nonzero0.004
ma101107_rel.cz11b_bee57.65042.3480.001nonzero0.012
ma101107_rel.cz11c_bee55.02644.9730.001nonzero0.004
ma101107_rel.cz11d_bee55.79644.2030.001nonzero0.006
ma110401_rel.cz11b_bee56.84343.1560.0010.003
ma110401_rel.cz11c_bee58.08741.9120.001nonzero0.010
my8036_rel.cz11a_bee60.66539.3340.0010.003
my8036_rel.cz11b_bee58.98941.0100.001nonzero0.013
my8036_rel.cz11c_bee53.49046.5070.0020.001nonzero0.052
my8036_rel.cz11d_bee54.74145.2580.001nonzero0.005

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee90.0619.9390.012
ma101107_rel.cz11b_bee90.1289.8720.012
ma101107_rel.cz11c_bee90.0179.9830.013
ma101107_rel.cz11d_bee90.1069.8940.012
ma110401_rel.cz11b_bee90.1229.8780.012
ma110401_rel.cz11c_bee90.1119.8890.014
my8036_rel.cz11a_bee98.9391.0440.0170.026
my8036_rel.cz11b_bee99.1830.7890.0280.037
my8036_rel.cz11c_bee98.8720.9500.1500.0280.081
my8036_rel.cz11d_bee99.1940.7890.0170.025

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee90.5119.4890.012
ma101107_rel.cz11b_bee90.5509.4500.012
ma101107_rel.cz11c_bee90.6009.4000.013
ma101107_rel.cz11d_bee90.5399.4610.012
ma110401_rel.cz11b_bee90.5839.4170.014
ma110401_rel.cz11c_bee90.5449.4560.013
my8036_rel.cz11a_bee99.5280.4610.0110.024
my8036_rel.cz11b_bee99.5060.4330.0610.048
my8036_rel.cz11c_bee99.3170.5220.1560.0060.075
my8036_rel.cz11d_bee99.7110.2780.0110.023

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	3516	17	0.1	2.6	0.6	0.005	0.020	0.005	1.143	13857	13.7	3.941	312	6.2	22.0	6.1	0.004	3500	3372	ma101107_rel.cz11a_bee
499	3621	17	0.1	7.4	0.7	0.005	0.019	0.015	1.433	14282	13.8	3.944	305	6.2	22.0	6.1	0.012	3595	3452	ma101107_rel.cz11b_bee
499	3568	18	0.1	4.5	0.6	0.005	0.020	0.009	1.260	14070	13.7	3.943	307	6.1	22.0	6.1	0.004	3548	3420	ma101107_rel.cz11c_bee
499	3580	17	0.1	2.6	0.6	0.005	0.019	0.005	1.142	14098	14.0	3.938	313	6.2	22.0	6.1	0.006	3548	3404	ma101107_rel.cz11d_bee
499	3593	17	0.1	3.1	0.6	0.005	0.019	0.006	1.165	14154	13.6	3.939	303	6.2	22.0	6.1	0.003	3580	3452	ma110401_rel.cz11b_bee
499	3622	17	0.1	8.5	0.7	0.005	0.019	0.017	1.499	14286	13.8	3.945	305	6.2	22.0	6.1	0.010	3596	3468	ma110401_rel.cz11c_bee
499	3674	0	0.0	90.4	2.8	0.000	0.000	0.181	5.826	15439	14.2	4.203	309	6.5	22.4	7.9	0.003	3643	3420	my8036_rel.cz11a_bee
499	3634	0	0.0	128.2	3.3	0.000	0.000	0.257	6.864	15551	14.4	4.280	317	6.1	21.8	7.3	0.013	3596	3404	my8036_rel.cz11b_bee
499	3558	0	0.0	154.7	3.4	0.000	0.000	0.310	6.927	15506	15.1	4.358	340	6.3	22.1	6.8	0.052	3516	3324	my8036_rel.cz11c_bee
499	3575	0	0.0	92.0	2.9	0.000	0.000	0.184	5.940	15070	14.1	4.215	316	6.5	22.4	7.9	0.005	3548	3356	my8036_rel.cz11d_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee79.06220.9370.002nonzero0.005
ma101107_rel.cz11b_bee75.39424.6040.002nonzero0.009
ma101107_rel.cz11c_bee72.27927.7190.002nonzerononzero0.018
ma101107_rel.cz11d_bee75.60024.3970.003nonzero0.009
ma110401_rel.cz11b_bee81.11418.8840.002nonzero0.005
ma110401_rel.cz11c_bee81.59118.4070.002nonzero0.005
my8036_rel.cz11a_bee11.39488.6010.004nonzero0.007
my8036_rel.cz11b_bee9.75690.2400.004nonzerononzero0.028
my8036_rel.cz11c_bee18.21981.7760.005nonzero0.007
my8036_rel.cz11d_bee11.49588.5000.005nonzero0.006

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee90.0619.9390.013
ma101107_rel.cz11b_bee90.1009.8940.0060.022
ma101107_rel.cz11c_bee90.0179.9500.0330.030
ma101107_rel.cz11d_bee90.00010.0000.013
ma110401_rel.cz11b_bee89.96710.0330.014
ma110401_rel.cz11c_bee90.0069.9830.0110.023
my8036_rel.cz11a_bee99.0170.9500.0280.0060.105
my8036_rel.cz11b_bee98.5561.3170.1280.062
my8036_rel.cz11c_bee98.8281.0220.1170.0330.086
my8036_rel.cz11d_bee98.8611.1280.0110.025

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee90.4729.5280.012
ma101107_rel.cz11b_bee90.5179.4830.013
ma101107_rel.cz11c_bee90.4569.5330.0110.020
ma101107_rel.cz11d_bee90.4179.5830.014
ma110401_rel.cz11b_bee90.4399.5560.0060.021
ma110401_rel.cz11c_bee90.4679.5280.0060.019
my8036_rel.cz11a_bee99.7610.2280.0060.0060.103
my8036_rel.cz11b_bee99.2890.5610.1500.039
my8036_rel.cz11c_bee99.4890.3940.1060.0110.085
my8036_rel.cz11d_bee99.6560.3440.015

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	3818	18	0.1	78.6	2.7	0.005	0.018	0.157	5.556	16307	15.6	4.271	327	6.2	22.0	6.1	0.005	3612	3343	ma101107_rel.cz11a_bee
499	3791	18	0.1	79.9	2.7	0.005	0.019	0.160	5.549	16196	15.4	4.272	325	6.2	22.0	6.1	0.009	3580	3340	ma101107_rel.cz11b_bee
499	3724	18	0.1	78.0	2.7	0.005	0.019	0.156	5.555	15838	15.8	4.253	339	6.1	22.0	6.1	0.018	3564	3324	ma101107_rel.cz11c_bee
499	3802	18	0.1	78.8	2.7	0.005	0.018	0.158	5.559	16242	15.5	4.271	326	6.2	22.0	6.1	0.009	3580	3308	ma101107_rel.cz11d_bee
499	3835	17	0.1	80.7	2.7	0.005	0.018	0.162	5.595	16376	15.6	4.270	325	6.2	22.0	6.1	0.005	3627	3356	ma110401_rel.cz11b_bee
499	3849	18	0.1	78.0	2.7	0.005	0.018	0.156	5.551	16342	15.8	4.246	328	6.2	22.0	6.1	0.005	3628	3373	ma110401_rel.cz11c_bee
499	2838	0	0.0	97.5	3.0	0.000	0.000	0.195	6.212	12874	14.2	4.536	400	6.5	22.4	7.9	0.007	2733	2589	my8036_rel.cz11a_bee
499	2823	0	0.0	130.4	3.4	0.000	0.000	0.261	6.976	13037	15.1	4.617	428	6.1	21.8	7.3	0.028	2734	2589	my8036_rel.cz11b_bee
499	2908	0	0.0	156.8	3.4	0.000	0.000	0.314	7.033	13652	15.4	4.694	424	6.3	22.1	6.8	0.007	2797	2591	my8036_rel.cz11c_bee
499	2830	0	0.0	107.1	3.3	0.000	0.000	0.215	6.706	12871	14.3	4.548	404	6.5	22.4	7.9	0.006	2735	2573	my8036_rel.cz11d_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee55.29944.6960.0050.0010.007
ma101107_rel.cz11b_bee56.04243.9530.0030.0020.013
ma101107_rel.cz11c_bee53.79946.1950.0030.003nonzero0.038
ma101107_rel.cz11d_bee56.32843.6680.0030.0010.011
ma110401_rel.cz11b_bee58.14241.8540.0030.0010.014
ma110401_rel.cz11c_bee59.08640.9100.0030.001nonzero0.035
my8036_rel.cz11a_bee62.29837.6990.003nonzero0.005
my8036_rel.cz11b_bee61.15538.8400.004nonzerononzero0.048
my8036_rel.cz11c_bee59.49240.5020.0040.001nonzero0.061
my8036_rel.cz11d_bee55.18344.8140.003nonzero0.005

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee94.9755.0220.0030.029
ma101107_rel.cz11b_bee95.0254.9670.0080.039
ma101107_rel.cz11c_bee94.9615.0000.0390.045
ma101107_rel.cz11d_bee95.0194.9780.0030.028
ma110401_rel.cz11b_bee95.0614.9280.0110.032
ma110401_rel.cz11c_bee95.0004.9780.0220.051
my8036_rel.cz11a_bee97.4192.5690.0110.026
my8036_rel.cz11b_bee97.2062.6390.1530.0030.093
my8036_rel.cz11c_bee96.8612.7640.3280.0470.109
my8036_rel.cz11d_bee97.8722.1170.0110.026

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee95.1364.8610.0030.028
ma101107_rel.cz11b_bee95.1674.8280.0060.028
ma101107_rel.cz11c_bee95.1364.8440.0170.0030.070
ma101107_rel.cz11d_bee95.1194.8780.0030.028
ma110401_rel.cz11b_bee95.1834.8060.0110.030
ma110401_rel.cz11c_bee95.1534.8310.0170.040
my8036_rel.cz11a_bee99.3920.6060.0030.025
my8036_rel.cz11b_bee98.9720.9170.1110.061
my8036_rel.cz11c_bee99.0580.6830.2140.0440.092
my8036_rel.cz11d_bee99.4750.5220.0030.024

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	3574	35	0.1	89.1	3.5	0.010	0.039	0.089	3.581	14887	14.9	4.165	334	6.2	22.0	6.1	0.007	3548	3404	ma101107_rel.cz11a_bee
998	3578	35	0.1	90.6	3.5	0.010	0.039	0.091	3.584	14895	14.8	4.163	331	6.2	22.0	6.1	0.013	3563	3404	ma101107_rel.cz11b_bee
998	3554	35	0.1	86.9	3.5	0.010	0.039	0.087	3.583	14709	14.9	4.139	335	6.1	22.0	6.1	0.038	3532	3356	ma101107_rel.cz11c_bee
998	3597	35	0.1	87.7	3.5	0.010	0.039	0.088	3.552	14953	15.0	4.157	334	6.2	22.0	6.1	0.011	3564	3420	ma101107_rel.cz11d_bee
998	3618	35	0.1	94.7	3.6	0.010	0.039	0.095	3.713	15105	14.9	4.175	329	6.2	22.0	6.1	0.014	3580	3420	ma110401_rel.cz11b_bee
998	3645	35	0.1	86.9	3.5	0.010	0.038	0.087	3.572	15057	14.9	4.131	327	6.2	22.0	6.1	0.035	3612	3468	ma110401_rel.cz11c_bee
998	3723	0	0.0	215.0	6.7	0.000	0.000	0.215	6.823	16821	15.2	4.518	327	6.5	22.4	7.9	0.005	3692	3436	my8036_rel.cz11a_bee
998	3701	0	0.0	202.2	5.6	0.000	0.000	0.203	5.754	16914	15.9	4.570	344	6.1	21.8	7.3	0.048	3660	3436	my8036_rel.cz11b_bee
998	3677	0	0.0	252.5	5.8	0.000	0.000	0.253	5.988	17311	16.9	4.708	368	6.3	22.1	6.8	0.061	3614	3374	my8036_rel.cz11c_bee
998	3598	0	0.0	219.9	6.8	0.000	0.000	0.220	6.947	16363	15.2	4.547	338	6.5	22.4	8.0	0.005	3564	3340	my8036_rel.cz11d_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee79.12220.8760.002nonzero0.004
ma101107_rel.cz11b_bee74.85625.1410.003nonzero0.011
ma101107_rel.cz11c_bee78.69621.3020.002nonzero0.004
ma101107_rel.cz11d_bee75.27024.7270.002nonzero0.005
ma110401_rel.cz11b_bee80.54919.4480.003nonzero0.006
ma110401_rel.cz11c_bee78.20721.7910.002nonzero0.008
my8036_rel.cz11a_bee17.09782.8910.012nonzero0.007
my8036_rel.cz11b_bee20.59579.3930.011nonzero0.008
my8036_rel.cz11c_bee22.71977.2690.012nonzero0.007
my8036_rel.cz11d_bee15.75684.2340.009nonzero0.008

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee95.0394.9560.0060.028
ma101107_rel.cz11b_bee95.0114.9830.0060.039
ma101107_rel.cz11c_bee94.9285.0500.0220.060
ma101107_rel.cz11d_bee95.0584.9390.0030.037
ma110401_rel.cz11b_bee95.0084.9830.0080.042
ma110401_rel.cz11c_bee95.0394.9420.0190.048
my8036_rel.cz11a_bee96.7563.2220.0220.031
my8036_rel.cz11b_bee96.8393.0140.1440.0030.103
my8036_rel.cz11c_bee96.0923.4810.3920.0360.088
my8036_rel.cz11d_bee97.8782.1140.0080.031

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma101107_rel.cz11a_bee95.1944.8060.012
ma101107_rel.cz11b_bee95.1364.8610.0030.028
ma101107_rel.cz11c_bee95.1034.8720.0250.027
ma101107_rel.cz11d_bee95.1694.8280.0030.026
ma110401_rel.cz11b_bee95.1694.8220.0080.042
ma110401_rel.cz11c_bee95.1584.8360.0060.033
my8036_rel.cz11a_bee99.3580.6280.0140.030
my8036_rel.cz11b_bee98.9890.8860.1220.0030.102
my8036_rel.cz11c_bee98.5581.1110.2860.0440.119
my8036_rel.cz11d_bee99.6500.3440.0060.030

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	3824	35	0.1	88.6	3.5	0.009	0.036	0.089	3.566	16846	16.3	4.405	341	6.2	22.0	6.1	0.004	3627	3324	ma101107_rel.cz11a_bee
998	3768	35	0.1	90.0	3.5	0.009	0.037	0.090	3.566	16600	16.5	4.406	350	6.2	22.0	6.1	0.011	3580	3308	ma101107_rel.cz11b_bee
998	3919	34	0.1	86.6	3.5	0.009	0.035	0.087	3.562	17122	16.2	4.369	331	6.1	22.0	6.1	0.004	3724	3324	ma101107_rel.cz11c_bee
998	3807	35	0.1	89.0	3.5	0.009	0.036	0.089	3.573	16754	16.3	4.401	343	6.2	22.0	6.1	0.005	3596	3308	ma101107_rel.cz11d_bee
998	3836	35	0.1	92.1	3.5	0.009	0.036	0.092	3.629	16918	16.4	4.411	342	6.2	22.0	6.1	0.006	3628	3356	ma110401_rel.cz11b_bee
998	3836	34	0.1	86.6	3.5	0.009	0.036	0.087	3.555	16780	16.2	4.374	338	6.2	22.0	6.1	0.008	3628	3340	ma110401_rel.cz11c_bee
998	2885	0	0.0	213.9	6.6	0.000	0.000	0.214	6.791	14241	15.4	4.937	427	6.5	22.4	7.9	0.007	2798	2605	my8036_rel.cz11a_bee
998	2942	0	0.0	228.2	6.2	0.000	0.000	0.229	6.327	14759	16.5	5.017	449	6.1	21.8	7.3	0.008	2877	2605	my8036_rel.cz11b_bee
998	2938	0	0.0	276.3	6.3	0.000	0.000	0.277	6.443	15249	17.8	5.190	485	6.3	22.1	6.8	0.007	2877	2605	my8036_rel.cz11c_bee
998	2867	0	0.0	212.3	6.6	0.000	0.000	0.213	6.737	14152	15.4	4.936	430	6.5	22.4	8.0	0.008	2783	2589	my8036_rel.cz11d_bee

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
83799	0	0	0.0	266.2	21.6	0.000	0.000	0.003	0.264	11299	25.8	0.135	25	2.0	17.8	2.4	0.182	84803	71353	ma101107_rel.cz11a_bee
83565	0	0	0.0	262.2	21.5	0.000	0.000	0.003	0.264	11334	25.9	0.136	25	2.0	17.8	2.4	0.229	84504	70719	ma101107_rel.cz11b_bee
84270	0	0	0.0	54.6	21.5	0.000	0.000	0.001	0.262	11219	26.0	0.133	25	2.0	17.8	2.4	0.251	84902	70520	ma101107_rel.cz11c_bee
83799	0	0	0.0	265.5	21.6	0.000	0.000	0.003	0.263	11312	25.8	0.135	25	2.0	17.8	2.4	0.190	84506	70520	ma101107_rel.cz11d_bee
82192	0	0	0.0	252.5	21.1	0.000	0.000	0.003	0.262	11329	25.9	0.138	25	2.0	17.8	2.3	0.206	82810	69657	ma110401_rel.cz11b_bee
83102	0	0	0.0	52.5	21.2	0.000	0.000	0.001	0.262	11328	25.9	0.136	25	2.0	17.8	2.3	0.204	83805	68653	ma110401_rel.cz11c_bee
56604	0	0	0.0	247.7	18.9	0.000	0.000	0.004	0.342	6537	20.8	0.115	29	2.0	17.6	3.0	0.086	56637	52440	my8036_rel.cz11a_bee
56818	0	0	0.0	286.0	19.1	0.000	0.000	0.005	0.343	6881	21.6	0.121	30	2.0	17.6	3.1	0.108	57135	51742	my8036_rel.cz11b_bee
56180	0	0	0.0	220.5	18.9	0.000	0.000	0.004	0.344	7337	22.3	0.131	32	2.0	17.6	3.0	0.095	56835	50343	my8036_rel.cz11c_bee
57034	0	0	0.0	249.5	19.1	0.000	0.000	0.004	0.342	6573	20.7	0.115	29	2.0	17.6	3.1	0.088	57135	53341	my8036_rel.cz11d_bee

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
130435	0	0	0.0	823.0	111.7	0.000	0.000	0.006	0.877	3016	12.1	0.023	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11a_bee
130435	0	0	0.0	817.1	111.0	0.000	0.000	0.006	0.872	3151	12.1	0.024	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11b_bee
130435	0	0	0.0	272.3	111.0	0.000	0.000	0.002	0.872	3240	12.2	0.025	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11c_bee
130435	0	0	0.0	814.4	110.7	0.000	0.000	0.006	0.869	3054	12.1	0.023	7	4.5	20.3	3.8	0.002	NA	NA	ma101107_rel.cz11d_bee
128206	0	0	0.0	807.7	109.8	0.000	0.000	0.006	0.877	2916	12.1	0.023	8	4.5	20.3	3.8	0.002	NA	NA	ma110401_rel.cz11b_bee
128206	0	0	0.0	270.9	109.8	0.000	0.000	0.002	0.877	3184	12.0	0.025	7	4.5	20.3	3.8	0.002	NA	NA	ma110401_rel.cz11c_bee
136987	0	705	44.6	2524.3	150.7	0.005	0.333	0.018	1.127	9433	43.3	0.069	25	4.5	20.1	5.3	0.003	NA	NA	my8036_rel.cz11a_bee
30832	0	156	9.9	820.3	36.1	0.005	0.328	0.027	1.200	5284	10.8	0.171	28	4.5	20.1	5.4	0.003	NA	NA	my8036_rel.cz11b_bee
21614	0	109	6.9	573.2	25.3	0.005	0.328	0.027	1.200	4920	7.9	0.228	29	4.5	20.1	5.4	0.003	NA	NA	my8036_rel.cz11c_bee
137615	0	705	44.6	2596.0	151.8	0.005	0.332	0.019	1.130	9518	43.7	0.069	25	4.5	20.1	5.3	0.003	NA	NA	my8036_rel.cz11d_bee

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19066	0	754	2.9	2800.7	102.6	0.040	0.158	0.147	5.511	50067	34.8	2.626	146	6.2	22.0	6.1	0.263	20328	5294	ma101107_rel.cz11a_bee
17730	0	698	2.7	2643.1	95.4	0.039	0.158	0.149	5.509	46805	32.9	2.640	148	6.2	22.0	6.1	0.235	18430	5294	ma101107_rel.cz11b_bee
17219	0	677	2.6	2422.3	92.4	0.039	0.157	0.141	5.496	42314	32.5	2.457	151	6.1	22.0	6.1	0.314	17281	4897	ma101107_rel.cz11c_bee
19175	0	756	3.0	2809.4	103.0	0.039	0.158	0.147	5.502	50335	34.9	2.625	146	6.2	22.0	6.1	0.117	20427	5294	ma101107_rel.cz11d_bee
17770	0	685	2.7	2634.6	95.1	0.039	0.154	0.148	5.483	46630	32.8	2.624	148	6.2	22.0	6.1	0.189	18380	5194	ma110401_rel.cz11b_bee
17264	0	663	2.6	2422.0	92.6	0.038	0.154	0.140	5.492	42459	32.3	2.459	150	6.2	22.0	6.1	0.451	17780	4895	ma110401_rel.cz11c_bee
16835	0	61	1.0	2782.0	102.0	0.004	0.058	0.165	6.206	38919	38.5	2.312	183	6.5	22.4	7.9	0.105	17580	5244	my8036_rel.cz11a_bee
13642	0	40	0.6	1602.6	60.8	0.003	0.047	0.117	4.563	34147	37.2	2.503	218	6.1	21.8	7.3	0.191	14041	3995	my8036_rel.cz11b_bee
14909	0	6	0.3	982.0	48.3	0.000	0.018	0.066	3.314	33407	36.8	2.241	197	6.3	22.1	6.9	1.066	16432	2547	my8036_rel.cz11c_bee
16906	0	61	1.0	2752.6	101.3	0.004	0.058	0.163	6.135	38939	38.6	2.303	183	6.5	22.4	7.9	0.104	17580	5244	my8036_rel.cz11d_bee

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
11136	0	1774	6.9	1327.5	50.6	0.159	0.637	0.119	4.652	62221	35.3	5.587	254	6.2	22.0	6.1	0.065	11163	9794	ma101107_rel.cz11a_bee
10941	0	1744	6.8	1335.0	50.0	0.159	0.638	0.122	4.677	61253	35.0	5.599	256	6.2	22.0	6.1	0.063	11043	9394	ma101107_rel.cz11b_bee
10799	0	1722	6.7	1264.2	49.2	0.159	0.638	0.117	4.668	58906	34.7	5.455	257	6.1	22.0	6.1	0.106	11038	8365	ma101107_rel.cz11c_bee
11198	0	1786	7.0	1355.9	51.5	0.159	0.638	0.121	4.712	62617	35.4	5.592	253	6.2	22.0	6.1	0.063	11223	10149	ma101107_rel.cz11d_bee
10799	0	1719	6.7	1320.2	49.4	0.159	0.637	0.122	4.680	60542	34.8	5.606	258	6.2	22.0	6.1	0.064	10913	9004	ma110401_rel.cz11b_bee
10707	0	1702	6.6	1253.1	48.8	0.159	0.636	0.117	4.666	58604	34.6	5.474	259	6.2	22.0	6.1	0.093	10918	8426	ma110401_rel.cz11c_bee
8643	0	0	0.0	1481.9	50.5	0.000	0.000	0.171	5.978	51714	35.6	5.983	330	6.5	22.4	7.9	0.102	8659	7781	my8036_rel.cz11a_bee
7027	0	0	0.0	1429.2	41.4	0.000	0.000	0.203	6.034	45076	36.5	6.414	416	6.1	21.8	7.3	0.107	7062	5594	my8036_rel.cz11b_bee
7770	0	0	0.0	978.9	30.4	0.000	0.000	0.126	4.009	46777	34.0	6.020	350	6.3	22.1	6.8	0.118	7841	6209	my8036_rel.cz11c_bee
8650	0	0	0.0	1469.8	50.2	0.000	0.000	0.170	5.939	51900	35.6	6.000	329	6.5	22.4	7.9	0.102	8669	7771	my8036_rel.cz11d_bee

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	3565	3	0.0	8.0	0.3	0.001	0.004	0.080	2.955	13852	12.8	3.886	287	6.2	22.0	6.1	0.005	3532	3388	ma101107_rel.cz11a_bee
100	3670	3	0.0	8.1	0.3	0.001	0.003	0.082	2.954	14267	12.8	3.888	279	6.2	22.0	6.1	0.012	3627	3452	ma101107_rel.cz11b_bee
100	3599	3	0.0	8.1	0.3	0.001	0.003	0.081	2.963	13976	12.9	3.884	287	6.1	22.0	6.1	0.016	3564	3404	ma101107_rel.cz11c_bee
100	3614	3	0.0	8.0	0.3	0.001	0.004	0.080	2.954	14052	12.9	3.888	286	6.2	22.0	6.1	0.004	3595	3436	ma101107_rel.cz11d_bee
100	3667	3	0.0	8.2	0.3	0.001	0.003	0.082	2.944	14247	13.0	3.885	284	6.2	22.0	6.1	0.004	3644	3484	ma110401_rel.cz11b_bee
100	3642	3	0.0	8.1	0.3	0.001	0.003	0.081	2.962	14149	12.8	3.885	281	6.2	22.0	6.1	0.014	3612	3468	ma110401_rel.cz11c_bee
100	3642	0	0.0	165.3	4.2	0.000	0.000	1.657	42.812	14954	13.2	4.105	290	6.5	22.4	7.9	0.005	3612	3436	my8036_rel.cz11a_bee
100	3532	0	0.0	36.6	0.8	0.000	0.000	0.367	7.985	14170	12.9	4.012	292	6.1	21.8	7.3	0.007	3516	3388	my8036_rel.cz11b_bee
100	3580	0	0.0	111.3	2.0	0.000	0.000	1.115	20.356	14750	13.6	4.120	304	6.3	22.1	6.8	0.050	3547	3356	my8036_rel.cz11c_bee
100	3604	0	0.0	152.7	3.9	0.000	0.000	1.530	39.549	14767	13.0	4.097	289	6.5	22.4	7.9	0.005	3564	3356	my8036_rel.cz11d_bee

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	3729	3	0.0	19.6	0.6	0.001	0.003	0.196	6.478	15342	14.1	4.114	302	6.2	22.0	6.1	0.005	3548	3324	ma101107_rel.cz11a_bee
100	3588	3	0.0	19.9	0.6	0.001	0.004	0.200	6.476	14763	14.3	4.115	319	6.2	22.0	6.1	0.005	3484	3308	ma101107_rel.cz11b_bee
100	3644	3	0.0	25.6	0.8	0.001	0.003	0.257	8.239	14988	14.3	4.114	314	6.1	22.0	6.1	0.005	3500	3324	ma101107_rel.cz11c_bee
100	3720	3	0.0	13.8	0.5	0.001	0.003	0.138	4.716	15277	14.1	4.107	303	6.2	22.0	6.1	0.005	3532	3324	ma101107_rel.cz11d_bee
100	3728	3	0.0	14.0	0.5	0.001	0.003	0.140	4.715	15297	14.3	4.103	307	6.2	22.0	6.1	0.007	3580	3355	ma110401_rel.cz11b_bee
100	3597	3	0.0	19.8	0.6	0.001	0.003	0.198	6.484	14778	14.1	4.108	314	6.2	22.0	6.1	0.004	3500	3307	ma110401_rel.cz11c_bee
100	2842	0	0.0	40.9	1.1	0.000	0.000	0.409	10.861	12111	13.3	4.261	374	6.5	22.4	7.9	0.004	2748	2605	my8036_rel.cz11a_bee
100	2876	0	0.0	14.2	0.3	0.000	0.000	0.142	2.970	12190	13.3	4.238	370	6.1	21.8	7.3	0.005	2750	2621	my8036_rel.cz11b_bee
100	2837	0	0.0	19.1	0.3	0.000	0.000	0.191	2.984	12066	13.1	4.253	369	6.3	22.1	6.8	0.003	2733	2589	my8036_rel.cz11c_bee
100	2808	0	0.0	42.5	1.1	0.000	0.000	0.426	11.402	11973	13.3	4.264	379	6.5	22.4	7.9	0.004	2717	2589	my8036_rel.cz11d_bee

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	3516	17	0.1	2.6	0.6	0.005	0.020	0.005	1.143	13857	13.7	3.941	312	6.2	22.0	6.1	0.004	3500	3372	ma101107_rel.cz11a_bee
499	3621	17	0.1	7.4	0.7	0.005	0.019	0.015	1.433	14282	13.8	3.944	305	6.2	22.0	6.1	0.012	3595	3452	ma101107_rel.cz11b_bee
499	3568	18	0.1	4.5	0.6	0.005	0.020	0.009	1.260	14070	13.7	3.943	307	6.1	22.0	6.1	0.004	3548	3420	ma101107_rel.cz11c_bee
499	3580	17	0.1	2.6	0.6	0.005	0.019	0.005	1.142	14098	14.0	3.938	313	6.2	22.0	6.1	0.006	3548	3404	ma101107_rel.cz11d_bee
499	3593	17	0.1	3.1	0.6	0.005	0.019	0.006	1.165	14154	13.6	3.939	303	6.2	22.0	6.1	0.003	3580	3452	ma110401_rel.cz11b_bee
499	3622	17	0.1	8.5	0.7	0.005	0.019	0.017	1.499	14286	13.8	3.945	305	6.2	22.0	6.1	0.010	3596	3468	ma110401_rel.cz11c_bee
499	3674	0	0.0	90.4	2.8	0.000	0.000	0.181	5.826	15439	14.2	4.203	309	6.5	22.4	7.9	0.003	3643	3420	my8036_rel.cz11a_bee
499	3634	0	0.0	128.2	3.3	0.000	0.000	0.257	6.864	15551	14.4	4.280	317	6.1	21.8	7.3	0.013	3596	3404	my8036_rel.cz11b_bee
499	3558	0	0.0	154.7	3.4	0.000	0.000	0.310	6.927	15506	15.1	4.358	340	6.3	22.1	6.8	0.052	3516	3324	my8036_rel.cz11c_bee
499	3575	0	0.0	92.0	2.9	0.000	0.000	0.184	5.940	15070	14.1	4.215	316	6.5	22.4	7.9	0.005	3548	3356	my8036_rel.cz11d_bee

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	3818	18	0.1	78.6	2.7	0.005	0.018	0.157	5.556	16307	15.6	4.271	327	6.2	22.0	6.1	0.005	3612	3343	ma101107_rel.cz11a_bee
499	3791	18	0.1	79.9	2.7	0.005	0.019	0.160	5.549	16196	15.4	4.272	325	6.2	22.0	6.1	0.009	3580	3340	ma101107_rel.cz11b_bee
499	3724	18	0.1	78.0	2.7	0.005	0.019	0.156	5.555	15838	15.8	4.253	339	6.1	22.0	6.1	0.018	3564	3324	ma101107_rel.cz11c_bee
499	3802	18	0.1	78.8	2.7	0.005	0.018	0.158	5.559	16242	15.5	4.271	326	6.2	22.0	6.1	0.009	3580	3308	ma101107_rel.cz11d_bee
499	3835	17	0.1	80.7	2.7	0.005	0.018	0.162	5.595	16376	15.6	4.270	325	6.2	22.0	6.1	0.005	3627	3356	ma110401_rel.cz11b_bee
499	3849	18	0.1	78.0	2.7	0.005	0.018	0.156	5.551	16342	15.8	4.246	328	6.2	22.0	6.1	0.005	3628	3373	ma110401_rel.cz11c_bee
499	2838	0	0.0	97.5	3.0	0.000	0.000	0.195	6.212	12874	14.2	4.536	400	6.5	22.4	7.9	0.007	2733	2589	my8036_rel.cz11a_bee
499	2823	0	0.0	130.4	3.4	0.000	0.000	0.261	6.976	13037	15.1	4.617	428	6.1	21.8	7.3	0.028	2734	2589	my8036_rel.cz11b_bee
499	2908	0	0.0	156.8	3.4	0.000	0.000	0.314	7.033	13652	15.4	4.694	424	6.3	22.1	6.8	0.007	2797	2591	my8036_rel.cz11c_bee
499	2830	0	0.0	107.1	3.3	0.000	0.000	0.215	6.706	12871	14.3	4.548	404	6.5	22.4	7.9	0.006	2735	2573	my8036_rel.cz11d_bee

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	3574	35	0.1	89.1	3.5	0.010	0.039	0.089	3.581	14887	14.9	4.165	334	6.2	22.0	6.1	0.007	3548	3404	ma101107_rel.cz11a_bee
998	3578	35	0.1	90.6	3.5	0.010	0.039	0.091	3.584	14895	14.8	4.163	331	6.2	22.0	6.1	0.013	3563	3404	ma101107_rel.cz11b_bee
998	3554	35	0.1	86.9	3.5	0.010	0.039	0.087	3.583	14709	14.9	4.139	335	6.1	22.0	6.1	0.038	3532	3356	ma101107_rel.cz11c_bee
998	3597	35	0.1	87.7	3.5	0.010	0.039	0.088	3.552	14953	15.0	4.157	334	6.2	22.0	6.1	0.011	3564	3420	ma101107_rel.cz11d_bee
998	3618	35	0.1	94.7	3.6	0.010	0.039	0.095	3.713	15105	14.9	4.175	329	6.2	22.0	6.1	0.014	3580	3420	ma110401_rel.cz11b_bee
998	3645	35	0.1	86.9	3.5	0.010	0.038	0.087	3.572	15057	14.9	4.131	327	6.2	22.0	6.1	0.035	3612	3468	ma110401_rel.cz11c_bee
998	3723	0	0.0	215.0	6.7	0.000	0.000	0.215	6.823	16821	15.2	4.518	327	6.5	22.4	7.9	0.005	3692	3436	my8036_rel.cz11a_bee
998	3701	0	0.0	202.2	5.6	0.000	0.000	0.203	5.754	16914	15.9	4.570	344	6.1	21.8	7.3	0.048	3660	3436	my8036_rel.cz11b_bee
998	3677	0	0.0	252.5	5.8	0.000	0.000	0.253	5.988	17311	16.9	4.708	368	6.3	22.1	6.8	0.061	3614	3374	my8036_rel.cz11c_bee
998	3598	0	0.0	219.9	6.8	0.000	0.000	0.220	6.947	16363	15.2	4.547	338	6.5	22.4	8.0	0.005	3564	3340	my8036_rel.cz11d_bee

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	3824	35	0.1	88.6	3.5	0.009	0.036	0.089	3.566	16846	16.3	4.405	341	6.2	22.0	6.1	0.004	3627	3324	ma101107_rel.cz11a_bee
998	3768	35	0.1	90.0	3.5	0.009	0.037	0.090	3.566	16600	16.5	4.406	350	6.2	22.0	6.1	0.011	3580	3308	ma101107_rel.cz11b_bee
998	3919	34	0.1	86.6	3.5	0.009	0.035	0.087	3.562	17122	16.2	4.369	331	6.1	22.0	6.1	0.004	3724	3324	ma101107_rel.cz11c_bee
998	3807	35	0.1	89.0	3.5	0.009	0.036	0.089	3.573	16754	16.3	4.401	343	6.2	22.0	6.1	0.005	3596	3308	ma101107_rel.cz11d_bee
998	3836	35	0.1	92.1	3.5	0.009	0.036	0.092	3.629	16918	16.4	4.411	342	6.2	22.0	6.1	0.006	3628	3356	ma110401_rel.cz11b_bee
998	3836	34	0.1	86.6	3.5	0.009	0.036	0.087	3.555	16780	16.2	4.374	338	6.2	22.0	6.1	0.008	3628	3340	ma110401_rel.cz11c_bee
998	2885	0	0.0	213.9	6.6	0.000	0.000	0.214	6.791	14241	15.4	4.937	427	6.5	22.4	7.9	0.007	2798	2605	my8036_rel.cz11a_bee
998	2942	0	0.0	228.2	6.2	0.000	0.000	0.229	6.327	14759	16.5	5.017	449	6.1	21.8	7.3	0.008	2877	2605	my8036_rel.cz11b_bee
998	2938	0	0.0	276.3	6.3	0.000	0.000	0.277	6.443	15249	17.8	5.190	485	6.3	22.1	6.8	0.007	2877	2605	my8036_rel.cz11c_bee
998	2867	0	0.0	212.3	6.6	0.000	0.000	0.213	6.737	14152	15.4	4.936	430	6.5	22.4	8.0	0.008	2783	2589	my8036_rel.cz11d_bee

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	10.964	88.724	0.197	0.111	0.005	0.000	0.000	0.000	0.000	0.182	ma101107_rel.cz11a_bee
0.000	9.943	89.744	0.197	0.111	0.005	0.000	0.000	0.000	0.000	0.229	ma101107_rel.cz11b_bee
0.000	12.063	87.625	0.185	0.121	0.005	0.000	0.000	0.000	0.000	0.251	ma101107_rel.cz11c_bee
0.000	10.120	89.568	0.184	0.122	0.005	0.000	0.000	0.000	0.000	0.190	ma101107_rel.cz11d_bee
0.000	2.688	96.998	0.187	0.122	0.005	0.000	0.000	0.000	0.000	0.206	ma110401_rel.cz11b_bee
0.000	4.374	95.313	0.190	0.119	0.005	0.000	0.000	0.000	0.000	0.204	ma110401_rel.cz11c_bee
0.000	0.000	99.413	0.455	0.131	0.001	0.000	0.000	0.000	0.000	0.086	my8036_rel.cz11a_bee
0.000	0.000	99.397	0.463	0.139	0.001	0.000	0.000	0.000	0.000	0.108	my8036_rel.cz11b_bee
0.000	0.000	99.395	0.448	0.151	0.005	0.000	0.000	0.000	0.000	0.095	my8036_rel.cz11c_bee
0.000	0.000	99.421	0.443	0.135	0.001	0.000	0.000	0.000	0.000	0.088	my8036_rel.cz11d_bee

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	95.914	4.010	0.075	nonzero	nonzero	0.000	0.000	0.000	0.263	ma101107_rel.cz11a_bee
0.000	0.000	94.287	5.220	0.489	0.004	0.000	0.000	0.000	0.000	0.235	ma101107_rel.cz11b_bee
0.000	0.000	94.149	5.084	0.751	0.015	nonzero	0.000	0.000	0.000	0.314	ma101107_rel.cz11c_bee
0.000	0.000	95.916	4.012	0.071	nonzero	0.000	0.000	0.000	0.000	0.117	ma101107_rel.cz11d_bee
0.000	0.000	94.301	5.211	0.485	0.004	0.000	0.000	0.000	0.000	0.189	ma110401_rel.cz11b_bee
0.000	0.000	93.966	5.289	0.732	0.012	0.001	0.000	0.000	0.000	0.451	ma110401_rel.cz11c_bee
0.000	0.000	95.888	3.954	0.156	0.002	0.000	0.000	0.000	0.000	0.105	my8036_rel.cz11a_bee
0.000	0.000	88.756	10.108	1.125	0.011	0.000	0.000	0.000	0.000	0.191	my8036_rel.cz11b_bee
0.000	0.000	91.647	7.725	0.579	0.044	0.004	0.001	0.000	0.000	1.066	my8036_rel.cz11c_bee
0.000	0.000	95.949	3.895	0.154	0.002	0.000	0.000	0.000	0.000	0.104	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	97.312	2.649	0.039	nonzero	0.000	0.000	0.000	0.000	0.255	ma101107_rel.cz11a_bee
0.000	0.000	96.131	3.470	0.396	0.003	0.000	0.000	0.000	0.000	0.234	ma101107_rel.cz11b_bee
0.000	0.000	95.916	3.458	0.613	0.013	nonzero	0.000	0.000	0.000	0.269	ma101107_rel.cz11c_bee
0.000	0.000	97.301	2.656	0.043	0.000	0.000	0.000	0.000	0.000	0.063	ma101107_rel.cz11d_bee
0.000	0.000	96.023	3.587	0.388	0.003	0.000	0.000	0.000	0.000	0.188	ma110401_rel.cz11b_bee
0.000	0.000	95.709	3.675	0.605	0.011	nonzero	0.000	0.000	0.000	0.424	ma110401_rel.cz11c_bee
0.000	0.000	97.676	2.274	0.049	0.001	0.000	0.000	0.000	0.000	0.105	my8036_rel.cz11a_bee
0.000	0.000	92.513	6.842	0.638	0.007	0.000	0.000	0.000	0.000	0.105	my8036_rel.cz11b_bee
0.000	0.000	94.974	4.752	0.254	0.016	0.004	0.001	0.000	0.000	1.049	my8036_rel.cz11c_bee
0.000	0.000	97.608	2.343	0.047	0.002	0.000	0.000	0.000	0.000	0.104	my8036_rel.cz11d_bee

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.384	99.465	0.131	0.021	nonzero	nonzero	0.000	0.000	0.000	0.000	0.065	ma101107_rel.cz11a_bee
0.518	99.260	0.117	0.102	0.002	0.000	0.000	0.000	0.000	0.000	0.063	ma101107_rel.cz11b_bee
0.344	99.411	0.113	0.122	0.009	nonzero	0.000	0.000	0.000	0.000	0.106	ma101107_rel.cz11c_bee
0.428	99.415	0.135	0.021	0.001	0.000	0.000	0.000	0.000	0.000	0.063	ma101107_rel.cz11d_bee
0.358	99.424	0.111	0.104	0.003	nonzero	0.000	0.000	0.000	0.000	0.064	ma110401_rel.cz11b_bee
0.708	99.044	0.116	0.124	0.008	nonzero	0.000	0.000	0.000	0.000	0.093	ma110401_rel.cz11c_bee
0.000	99.384	0.360	0.254	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11a_bee
0.000	98.023	0.884	0.997	0.093	0.002	0.000	0.000	0.000	0.000	0.107	my8036_rel.cz11b_bee
0.000	98.793	0.524	0.656	0.025	0.002	0.000	0.000	0.000	0.000	0.118	my8036_rel.cz11c_bee
0.000	99.375	0.369	0.254	0.002	0.001	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
3.060	96.786	0.134	0.020	nonzero	nonzero	0.000	0.000	0.000	0.000	0.065	ma101107_rel.cz11a_bee
2.748	97.043	0.113	0.094	0.002	0.000	0.000	0.000	0.000	0.000	0.063	ma101107_rel.cz11b_bee
3.082	96.685	0.112	0.113	0.008	nonzero	0.000	0.000	0.000	0.000	0.106	ma101107_rel.cz11c_bee
2.951	96.891	0.137	0.021	0.001	0.000	0.000	0.000	0.000	0.000	0.063	ma101107_rel.cz11d_bee
1.129	98.652	0.117	0.098	0.003	nonzero	0.000	0.000	0.000	0.000	0.064	ma110401_rel.cz11b_bee
1.406	98.354	0.116	0.117	0.007	nonzero	0.000	0.000	0.000	0.000	0.067	ma110401_rel.cz11c_bee
0.000	99.545	0.204	0.249	0.002	nonzero	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11a_bee
0.000	98.408	0.542	0.965	0.081	0.003	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11b_bee
0.000	99.037	0.280	0.661	0.021	0.001	0.000	0.000	0.000	0.000	0.108	my8036_rel.cz11c_bee
0.000	99.547	0.204	0.246	0.002	0.001	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11d_bee

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
54.960	45.040	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma101107_rel.cz11a_bee
59.643	40.356	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11b_bee
56.064	43.935	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	ma101107_rel.cz11c_bee
57.715	42.284	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma101107_rel.cz11d_bee
60.353	39.646	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma110401_rel.cz11b_bee
59.249	40.751	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma110401_rel.cz11c_bee
59.842	40.157	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8036_rel.cz11a_bee
53.783	46.217	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8036_rel.cz11b_bee
56.109	43.891	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.050	my8036_rel.cz11c_bee
56.269	43.730	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8036_rel.cz11d_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	53.306	46.667	0.028	0.000	0.000	0.000	0.000	0.000	0.024	ma101107_rel.cz11a_bee
0.000	0.000	53.194	46.778	0.028	0.000	0.000	0.000	0.000	0.000	0.044	ma101107_rel.cz11b_bee
0.000	0.000	53.028	46.972	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11c_bee
0.000	0.000	53.278	46.694	0.028	0.000	0.000	0.000	0.000	0.000	0.026	ma101107_rel.cz11d_bee
0.000	0.000	53.250	46.722	0.028	0.000	0.000	0.000	0.000	0.000	0.020	ma110401_rel.cz11b_bee
0.000	0.000	53.306	46.694	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11c_bee
0.000	0.000	98.889	1.083	0.028	0.000	0.000	0.000	0.000	0.000	0.026	my8036_rel.cz11a_bee
0.000	0.000	99.528	0.472	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8036_rel.cz11b_bee
0.000	0.000	99.278	0.667	0.028	0.028	0.000	0.000	0.000	0.000	0.085	my8036_rel.cz11c_bee
0.000	0.000	99.472	0.528	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	53.361	46.639	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11a_bee
0.000	0.000	53.222	46.750	0.028	0.000	0.000	0.000	0.000	0.000	0.017	ma101107_rel.cz11b_bee
0.000	0.000	53.028	46.972	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11c_bee
0.000	0.000	53.278	46.722	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11d_bee
0.000	0.000	53.306	46.694	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11b_bee
0.000	0.000	53.278	46.722	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma110401_rel.cz11c_bee
0.000	0.000	99.028	0.944	0.028	0.000	0.000	0.000	0.000	0.000	0.019	my8036_rel.cz11a_bee
0.000	0.000	99.667	0.333	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8036_rel.cz11b_bee
0.000	0.000	99.417	0.472	0.056	0.056	0.000	0.000	0.000	0.000	0.091	my8036_rel.cz11c_bee
0.000	0.000	99.500	0.500	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8036_rel.cz11d_bee

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
74.190	25.809	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma101107_rel.cz11a_bee
64.672	35.326	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma101107_rel.cz11b_bee
65.692	34.307	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma101107_rel.cz11c_bee
65.846	34.152	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma101107_rel.cz11d_bee
77.686	22.312	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma110401_rel.cz11b_bee
63.743	36.256	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma110401_rel.cz11c_bee
10.870	89.128	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8036_rel.cz11a_bee
13.687	86.311	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8036_rel.cz11b_bee
12.590	87.408	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8036_rel.cz11c_bee
9.534	90.464	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8036_rel.cz11d_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	53.194	46.806	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11a_bee
0.000	0.000	53.000	47.000	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11b_bee
0.000	0.000	53.417	46.583	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11c_bee
0.000	0.000	52.944	47.056	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11d_bee
0.000	0.000	53.306	46.694	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11b_bee
0.000	0.000	53.000	47.000	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11c_bee
0.000	0.000	99.639	0.361	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8036_rel.cz11a_bee
0.000	0.000	99.694	0.306	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8036_rel.cz11b_bee
0.000	0.000	99.306	0.667	0.028	0.000	0.000	0.000	0.000	0.000	0.018	my8036_rel.cz11c_bee
0.000	0.000	99.722	0.250	0.028	0.000	0.000	0.000	0.000	0.000	0.021	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	53.333	46.667	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11a_bee
0.000	0.000	53.083	46.917	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11b_bee
0.000	0.000	53.417	46.583	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11c_bee
0.000	0.000	53.000	47.000	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11d_bee
0.000	0.000	53.333	46.667	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11b_bee
0.000	0.000	53.111	46.889	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11c_bee
0.000	0.000	99.806	0.194	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8036_rel.cz11a_bee
0.000	0.000	99.750	0.250	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8036_rel.cz11b_bee
0.000	0.000	99.472	0.528	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8036_rel.cz11c_bee
0.000	0.000	99.806	0.194	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8036_rel.cz11d_bee

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
51.804	48.195	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma101107_rel.cz11a_bee
57.650	42.348	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11b_bee
55.026	44.973	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma101107_rel.cz11c_bee
55.796	44.203	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma101107_rel.cz11d_bee
56.843	43.156	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	ma110401_rel.cz11b_bee
58.087	41.912	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.010	ma110401_rel.cz11c_bee
60.665	39.334	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8036_rel.cz11a_bee
58.989	41.010	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8036_rel.cz11b_bee
53.490	46.507	0.002	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.052	my8036_rel.cz11c_bee
54.741	45.258	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8036_rel.cz11d_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	90.061	9.939	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11a_bee
0.000	0.000	90.128	9.872	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11b_bee
0.000	0.000	90.017	9.983	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11c_bee
0.000	0.000	90.106	9.894	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11d_bee
0.000	0.000	90.122	9.878	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11b_bee
0.000	0.000	90.111	9.889	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma110401_rel.cz11c_bee
0.000	0.000	98.939	1.044	0.017	0.000	0.000	0.000	0.000	0.000	0.026	my8036_rel.cz11a_bee
0.000	0.000	99.183	0.789	0.028	0.000	0.000	0.000	0.000	0.000	0.037	my8036_rel.cz11b_bee
0.000	0.000	98.872	0.950	0.150	0.028	0.000	0.000	0.000	0.000	0.081	my8036_rel.cz11c_bee
0.000	0.000	99.194	0.789	0.017	0.000	0.000	0.000	0.000	0.000	0.025	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	90.511	9.489	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11a_bee
0.000	0.000	90.550	9.450	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11b_bee
0.000	0.000	90.600	9.400	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11c_bee
0.000	0.000	90.539	9.461	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11d_bee
0.000	0.000	90.583	9.417	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma110401_rel.cz11b_bee
0.000	0.000	90.544	9.456	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma110401_rel.cz11c_bee
0.000	0.000	99.528	0.461	0.011	0.000	0.000	0.000	0.000	0.000	0.024	my8036_rel.cz11a_bee
0.000	0.000	99.506	0.433	0.061	0.000	0.000	0.000	0.000	0.000	0.048	my8036_rel.cz11b_bee
0.000	0.000	99.317	0.522	0.156	0.006	0.000	0.000	0.000	0.000	0.075	my8036_rel.cz11c_bee
0.000	0.000	99.711	0.278	0.011	0.000	0.000	0.000	0.000	0.000	0.023	my8036_rel.cz11d_bee

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
79.062	20.937	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma101107_rel.cz11a_bee
75.394	24.604	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma101107_rel.cz11b_bee
72.279	27.719	0.002	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma101107_rel.cz11c_bee
75.600	24.397	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	ma101107_rel.cz11d_bee
81.114	18.884	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma110401_rel.cz11b_bee
81.591	18.407	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma110401_rel.cz11c_bee
11.394	88.601	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8036_rel.cz11a_bee
9.756	90.240	0.004	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	my8036_rel.cz11b_bee
18.219	81.776	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8036_rel.cz11c_bee
11.495	88.500	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8036_rel.cz11d_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	90.061	9.939	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11a_bee
0.000	0.000	90.100	9.894	0.006	0.000	0.000	0.000	0.000	0.000	0.022	ma101107_rel.cz11b_bee
0.000	0.000	90.017	9.950	0.033	0.000	0.000	0.000	0.000	0.000	0.030	ma101107_rel.cz11c_bee
0.000	0.000	90.000	10.000	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11d_bee
0.000	0.000	89.967	10.033	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma110401_rel.cz11b_bee
0.000	0.000	90.006	9.983	0.011	0.000	0.000	0.000	0.000	0.000	0.023	ma110401_rel.cz11c_bee
0.000	0.000	99.017	0.950	0.028	0.006	0.000	0.000	0.000	0.000	0.105	my8036_rel.cz11a_bee
0.000	0.000	98.556	1.317	0.128	0.000	0.000	0.000	0.000	0.000	0.062	my8036_rel.cz11b_bee
0.000	0.000	98.828	1.022	0.117	0.033	0.000	0.000	0.000	0.000	0.086	my8036_rel.cz11c_bee
0.000	0.000	98.861	1.128	0.011	0.000	0.000	0.000	0.000	0.000	0.025	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	90.472	9.528	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11a_bee
0.000	0.000	90.517	9.483	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11b_bee
0.000	0.000	90.456	9.533	0.011	0.000	0.000	0.000	0.000	0.000	0.020	ma101107_rel.cz11c_bee
0.000	0.000	90.417	9.583	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma101107_rel.cz11d_bee
0.000	0.000	90.439	9.556	0.006	0.000	0.000	0.000	0.000	0.000	0.021	ma110401_rel.cz11b_bee
0.000	0.000	90.467	9.528	0.006	0.000	0.000	0.000	0.000	0.000	0.019	ma110401_rel.cz11c_bee
0.000	0.000	99.761	0.228	0.006	0.006	0.000	0.000	0.000	0.000	0.103	my8036_rel.cz11a_bee
0.000	0.000	99.289	0.561	0.150	0.000	0.000	0.000	0.000	0.000	0.039	my8036_rel.cz11b_bee
0.000	0.000	99.489	0.394	0.106	0.011	0.000	0.000	0.000	0.000	0.085	my8036_rel.cz11c_bee
0.000	0.000	99.656	0.344	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my8036_rel.cz11d_bee

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
55.299	44.696	0.005	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.007	ma101107_rel.cz11a_bee
56.042	43.953	0.003	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11b_bee
53.799	46.195	0.003	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.038	ma101107_rel.cz11c_bee
56.328	43.668	0.003	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma101107_rel.cz11d_bee
58.142	41.854	0.003	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.014	ma110401_rel.cz11b_bee
59.086	40.910	0.003	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.035	ma110401_rel.cz11c_bee
62.298	37.699	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8036_rel.cz11a_bee
61.155	38.840	0.004	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.048	my8036_rel.cz11b_bee
59.492	40.502	0.004	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.061	my8036_rel.cz11c_bee
55.183	44.814	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8036_rel.cz11d_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	94.975	5.022	0.003	0.000	0.000	0.000	0.000	0.000	0.029	ma101107_rel.cz11a_bee
0.000	0.000	95.025	4.967	0.008	0.000	0.000	0.000	0.000	0.000	0.039	ma101107_rel.cz11b_bee
0.000	0.000	94.961	5.000	0.039	0.000	0.000	0.000	0.000	0.000	0.045	ma101107_rel.cz11c_bee
0.000	0.000	95.019	4.978	0.003	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11d_bee
0.000	0.000	95.061	4.928	0.011	0.000	0.000	0.000	0.000	0.000	0.032	ma110401_rel.cz11b_bee
0.000	0.000	95.000	4.978	0.022	0.000	0.000	0.000	0.000	0.000	0.051	ma110401_rel.cz11c_bee
0.000	0.000	97.419	2.569	0.011	0.000	0.000	0.000	0.000	0.000	0.026	my8036_rel.cz11a_bee
0.000	0.000	97.206	2.639	0.153	0.003	0.000	0.000	0.000	0.000	0.093	my8036_rel.cz11b_bee
0.000	0.000	96.861	2.764	0.328	0.047	0.000	0.000	0.000	0.000	0.109	my8036_rel.cz11c_bee
0.000	0.000	97.872	2.117	0.011	0.000	0.000	0.000	0.000	0.000	0.026	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	95.136	4.861	0.003	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11a_bee
0.000	0.000	95.167	4.828	0.006	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11b_bee
0.000	0.000	95.136	4.844	0.017	0.003	0.000	0.000	0.000	0.000	0.070	ma101107_rel.cz11c_bee
0.000	0.000	95.119	4.878	0.003	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11d_bee
0.000	0.000	95.183	4.806	0.011	0.000	0.000	0.000	0.000	0.000	0.030	ma110401_rel.cz11b_bee
0.000	0.000	95.153	4.831	0.017	0.000	0.000	0.000	0.000	0.000	0.040	ma110401_rel.cz11c_bee
0.000	0.000	99.392	0.606	0.003	0.000	0.000	0.000	0.000	0.000	0.025	my8036_rel.cz11a_bee
0.000	0.000	98.972	0.917	0.111	0.000	0.000	0.000	0.000	0.000	0.061	my8036_rel.cz11b_bee
0.000	0.000	99.058	0.683	0.214	0.044	0.000	0.000	0.000	0.000	0.092	my8036_rel.cz11c_bee
0.000	0.000	99.475	0.522	0.003	0.000	0.000	0.000	0.000	0.000	0.024	my8036_rel.cz11d_bee

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
79.122	20.876	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma101107_rel.cz11a_bee
74.856	25.141	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma101107_rel.cz11b_bee
78.696	21.302	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma101107_rel.cz11c_bee
75.270	24.727	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma101107_rel.cz11d_bee
80.549	19.448	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	ma110401_rel.cz11b_bee
78.207	21.791	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma110401_rel.cz11c_bee
17.097	82.891	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8036_rel.cz11a_bee
20.595	79.393	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8036_rel.cz11b_bee
22.719	77.269	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8036_rel.cz11c_bee
15.756	84.234	0.009	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8036_rel.cz11d_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	95.039	4.956	0.006	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11a_bee
0.000	0.000	95.011	4.983	0.006	0.000	0.000	0.000	0.000	0.000	0.039	ma101107_rel.cz11b_bee
0.000	0.000	94.928	5.050	0.022	0.000	0.000	0.000	0.000	0.000	0.060	ma101107_rel.cz11c_bee
0.000	0.000	95.058	4.939	0.003	0.000	0.000	0.000	0.000	0.000	0.037	ma101107_rel.cz11d_bee
0.000	0.000	95.008	4.983	0.008	0.000	0.000	0.000	0.000	0.000	0.042	ma110401_rel.cz11b_bee
0.000	0.000	95.039	4.942	0.019	0.000	0.000	0.000	0.000	0.000	0.048	ma110401_rel.cz11c_bee
0.000	0.000	96.756	3.222	0.022	0.000	0.000	0.000	0.000	0.000	0.031	my8036_rel.cz11a_bee
0.000	0.000	96.839	3.014	0.144	0.003	0.000	0.000	0.000	0.000	0.103	my8036_rel.cz11b_bee
0.000	0.000	96.092	3.481	0.392	0.036	0.000	0.000	0.000	0.000	0.088	my8036_rel.cz11c_bee
0.000	0.000	97.878	2.114	0.008	0.000	0.000	0.000	0.000	0.000	0.031	my8036_rel.cz11d_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	95.194	4.806	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11a_bee
0.000	0.000	95.136	4.861	0.003	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11b_bee
0.000	0.000	95.103	4.872	0.025	0.000	0.000	0.000	0.000	0.000	0.027	ma101107_rel.cz11c_bee
0.000	0.000	95.169	4.828	0.003	0.000	0.000	0.000	0.000	0.000	0.026	ma101107_rel.cz11d_bee
0.000	0.000	95.169	4.822	0.008	0.000	0.000	0.000	0.000	0.000	0.042	ma110401_rel.cz11b_bee
0.000	0.000	95.158	4.836	0.006	0.000	0.000	0.000	0.000	0.000	0.033	ma110401_rel.cz11c_bee
0.000	0.000	99.358	0.628	0.014	0.000	0.000	0.000	0.000	0.000	0.030	my8036_rel.cz11a_bee
0.000	0.000	98.989	0.886	0.122	0.003	0.000	0.000	0.000	0.000	0.102	my8036_rel.cz11b_bee
0.000	0.000	98.558	1.111	0.286	0.044	0.000	0.000	0.000	0.000	0.119	my8036_rel.cz11c_bee
0.000	0.000	99.650	0.344	0.006	0.000	0.000	0.000	0.000	0.000	0.030	my8036_rel.cz11d_bee