Introduction

This is a report for the insert benchmark with 4000M docs and 20 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server is an ax162-s from Hetzner (see here) with 48 cores, AMD SMT disabled, 128G RAM and ext4 using 2 NVMe devices with SW RAID 1. The benchmark was run with 20 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables with a table per client. It loads 200M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 4m+1m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is larger than memory. Clients and the DBMS share one server.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my8039_rel_o2nofp.cz11a_nocb_c32r128 14357501324942894645291809501743915612963421016456833
my8039_rel_o2nofp.cz11a_c32r128 143420613531801616256821835381720316079690331196648645
ma101109_rel_withdbg.cz11a_c32r128 28105715735646122681217638117765948246840990445145
ma110403_rel_withdbg.cz11b_c32r128 28469815232296262761317700817688803296488915845399

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my8039_rel_o2nofp.cz11a_nocb_c32r128 1.001.001.001.001.001.001.001.001.001.00
my8039_rel_o2nofp.cz11a_c32r128 1.001.021.811.251.010.991.031.421.181.27
ma101109_rel_withdbg.cz11a_c32r128 0.201.190.681.500.971.020.611.080.970.75
ma110403_rel_withdbg.cz11b_c32r128 0.201.150.701.680.981.010.511.020.900.79

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
my8039_rel_o2nofp.cz11a_nocb_c32r1281977197698799885180006890
my8039_rel_o2nofp.cz11a_c32r12819771977988598851976912609
ma101109_rel_withdbg.cz11a_c32r128197619768411377162354249
ma110403_rel_withdbg.cz11b_c32r128197619768459390963194254
target2000200010000100002000020000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1280.09999.7890.0600.0130.0390.241
my8039_rel_o2nofp.cz11a_c32r1280.08699.8020.0600.0140.0380.228
ma101109_rel_withdbg.cz11a_c32r1280.0740.25599.4270.0430.1080.0940.666
ma110403_rel_withdbg.cz11b_c32r1280.0660.26399.4210.0510.1060.0940.677

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1435750	0	4	0.0	9764.0	534.0	0.000	0.000	0.007	0.381	295680	55.1	0.206	18	262.3	362.8	108.6	0.241	75019	62233	my8039_rel_o2nofp.cz11a_nocb_c32r128
1434206	0	4	0.0	9732.3	532.7	0.000	0.000	0.007	0.380	295453	55.2	0.206	18	262.3	362.8	108.6	0.228	74720	62333	my8039_rel_o2nofp.cz11a_c32r128
281057	0	2614	10.2	1995.5	84.6	0.009	0.037	0.007	0.308	251834	50.5	0.896	86	263.2	365.2	101.4	0.666	14684	200	ma101109_rel_withdbg.cz11a_c32r128
284698	0	2649	10.4	2030.6	85.8	0.009	0.037	0.007	0.309	256608	50.4	0.901	85	263.2	365.2	101.4	0.677	14884	200	ma110403_rel_withdbg.cz11b_c32r128

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1324942	0	33429	1929.3	39549.1	1738.6	0.025	1.491	0.030	1.344	193323	56.1	0.146	20	603.6	704.2	104.9	0.022	NA	NA	my8039_rel_o2nofp.cz11a_nocb_c32r128
1353180	0	34149	1971.3	40424.4	1776.7	0.025	1.492	0.030	1.344	193770	57.0	0.143	20	603.6	704.2	104.9	0.017	NA	NA	my8039_rel_o2nofp.cz11a_c32r128
1573564	0	17191	1407.8	18209.2	1551.0	0.011	0.916	0.012	1.009	78106	23.7	0.050	7	557.5	659.5	101.8	0.002	NA	NA	ma101109_rel_withdbg.cz11a_c32r128
1523229	0	16614	1355.4	19282.1	1511.1	0.011	0.911	0.013	1.016	83878	24.2	0.055	8	557.5	659.5	101.8	0.002	NA	NA	ma110403_rel_withdbg.cz11b_c32r128

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12817.79681.8830.3210.489
my8039_rel_o2nofp.cz11a_c32r1280.10514.23238.03747.2860.3400.499
ma101109_rel_withdbg.cz11a_c32r1281.20416.00957.84224.9420.0010.0010.002128.400
ma110403_rel_withdbg.cz11b_c32r1281.91715.31157.80424.9500.0080.0050.005104.927

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1280.24038.56761.1930.0010.294
my8039_rel_o2nofp.cz11a_c32r12818.77619.59329.07632.5560.194
ma101109_rel_withdbg.cz11a_c32r1289.95924.43343.13022.4750.0010.0010.00287.473
ma110403_rel_withdbg.cz11b_c32r12810.03219.98045.90424.0730.0060.0030.002102.879

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
8946	0	50536	789.7	68019.4	1794.6	5.649	90.386	7.603	205.404	363105	14.4	40.586	773	814.0	918.2	107.6	0.489	400	300	my8039_rel_o2nofp.cz11a_nocb_c32r128
16162	0	36368	568.3	53216.8	1514.8	2.250	36.005	3.293	95.980	333511	20.7	20.636	615	818.4	935.0	107.6	0.499	699	300	my8039_rel_o2nofp.cz11a_c32r128
6122	0	36608	568.0	35668.6	973.6	5.980	95.006	5.826	162.858	862195	14.3	140.840	1121	723.7	826.3	100.5	128.400	300	0	ma101109_rel_withdbg.cz11a_c32r128
6262	0	38408	596.0	37589.9	1007.8	6.133	97.454	6.003	164.789	868728	13.6	138.726	1042	725.0	827.7	100.5	104.927	300	0	ma110403_rel_withdbg.cz11b_c32r128

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12866.48831.5421.9700.136
my8039_rel_o2nofp.cz11a_c32r1280.08372.40027.3110.2060.167
ma101109_rel_withdbg.cz11a_c32r1280.0126.98570.90420.6641.4130.0210.0012.729
ma110403_rel_withdbg.cz11b_c32r1280.03115.90960.03223.8060.2140.006nonzerononzero4.100

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12869.23629.7780.9860.136
my8039_rel_o2nofp.cz11a_c32r1280.26073.20026.4590.0800.167
ma101109_rel_withdbg.cz11a_c32r128nonzero0.07217.62966.99714.0441.2520.005nonzero2.727
ma110403_rel_withdbg.cz11b_c32r1280.08625.39554.24120.0770.1970.004nonzerononzero4.100

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
4529	0	44886	701.3	56388.1	1591.3	9.911	158.577	12.451	359.794	352666	15.3	77.870	1622	814.0	915.3	106.0	0.136	140	75	my8039_rel_o2nofp.cz11a_nocb_c32r128
5682	0	38736	605.3	50136.5	1439.4	6.818	109.082	8.824	259.410	335921	17.3	59.122	1462	818.4	932.1	106.0	0.167	140	80	my8039_rel_o2nofp.cz11a_c32r128
6812	0	38701	586.1	31995.9	891.4	5.681	88.108	4.697	134.004	902625	15.7	132.507	1106	723.7	826.3	100.5	2.729	445	65	ma101109_rel_withdbg.cz11a_c32r128
7613	0	40314	608.8	33481.0	935.0	5.295	81.892	4.398	125.764	996146	16.3	130.845	1028	725.0	827.7	100.5	4.100	469	85	ma110403_rel_withdbg.cz11b_c32r128

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12899.8340.1630.002nonzerononzero0.031
my8039_rel_o2nofp.cz11a_c32r12899.8890.1070.003nonzero0.013
ma101109_rel_withdbg.cz11a_c32r12899.6330.3300.0340.003nonzero0.027
ma110403_rel_withdbg.cz11b_c32r12899.5840.3750.0390.002nonzerononzero0.154

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12882.81217.1880.052
my8039_rel_o2nofp.cz11a_c32r12895.1744.8260.037
ma101109_rel_withdbg.cz11a_c32r12834.19665.8030.0010.065
ma110403_rel_withdbg.cz11b_c32r12833.22866.3190.4530.198

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12894.9835.0170.036
my8039_rel_o2nofp.cz11a_c32r12891.6068.3940.013
ma101109_rel_withdbg.cz11a_c32r12873.41526.5850.055
ma110403_rel_withdbg.cz11b_c32r12868.75631.1040.1400.193

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1977	180950	8357	130.6	9281.8	266.4	0.046	0.739	4.695	138.009	735420	44.8	4.064	119	814.0	915.3	106.0	0.031	9174	8587	my8039_rel_o2nofp.cz11a_nocb_c32r128
1977	183538	8290	129.5	9300.2	267.9	0.045	0.723	4.704	138.770	746909	45.3	4.070	118	818.4	932.1	106.0	0.013	9366	8711	my8039_rel_o2nofp.cz11a_c32r128
1976	176381	9250	143.4	5991.3	168.0	0.052	0.833	3.032	87.084	733626	44.2	4.159	120	723.7	826.3	100.4	0.027	8950	7419	ma101109_rel_withdbg.cz11a_c32r128
1976	177008	9276	143.7	5988.0	168.4	0.052	0.832	3.031	87.268	738233	44.2	4.171	120	725.0	827.7	100.4	0.154	9017	7544	ma110403_rel_withdbg.cz11b_c32r128

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1280.00252.58646.6350.777nonzero0.023
my8039_rel_o2nofp.cz11a_c32r1280.00351.04048.1220.836nonzero0.017
ma101109_rel_withdbg.cz11a_c32r1280.00555.34744.1530.4330.0600.0020.251
ma110403_rel_withdbg.cz11b_c32r1280.00655.84843.6070.4700.0660.003nonzero0.301

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1283.77195.5670.6620.154
my8039_rel_o2nofp.cz11a_c32r12842.80757.1650.0280.084
ma101109_rel_withdbg.cz11a_c32r1280.20787.78211.3780.6330.401
ma110403_rel_withdbg.cz11b_c32r1280.23988.95410.3100.4970.437

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12846.58353.3350.0820.094
my8039_rel_o2nofp.cz11a_c32r12882.58817.4130.013
ma101109_rel_withdbg.cz11a_c32r1280.33590.3149.2860.0650.336
ma110403_rel_withdbg.cz11b_c32r1280.36990.6048.8720.1540.437

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1976	17439	128161	2002.5	17556.8	490.1	7.349	117.588	8.886	254.019	377469	16.6	21.646	457	814.0	915.3	106.0	0.023	911	336	my8039_rel_o2nofp.cz11a_nocb_c32r128
1977	17203	126426	1975.4	17480.6	490.4	7.349	117.583	8.842	254.000	373425	16.7	21.707	466	818.4	932.1	106.1	0.017	911	368	my8039_rel_o2nofp.cz11a_c32r128
1976	17765	130543	2038.6	12551.9	345.3	7.348	117.507	6.353	178.982	519686	15.8	29.254	427	723.7	826.3	100.4	0.251	943	192	ma101109_rel_withdbg.cz11a_c32r128
1976	17688	129650	2024.7	12430.2	343.0	7.330	117.209	6.291	177.771	515228	15.6	29.128	423	725.0	827.7	100.4	0.301	943	176	ma110403_rel_withdbg.cz11b_c32r128

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12899.0220.9580.0180.003nonzero0.027
my8039_rel_o2nofp.cz11a_c32r12899.2840.6870.0270.002nonzero0.031
ma101109_rel_withdbg.cz11a_c32r12893.2585.4001.1170.1580.0600.0060.0010.385
ma110403_rel_withdbg.cz11b_c32r12892.5175.8711.1890.2690.1450.008nonzero0.410

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12812.62586.7250.6500.109
my8039_rel_o2nofp.cz11a_c32r12816.75082.2191.0310.117
ma101109_rel_withdbg.cz11a_c32r1286.01151.98425.44416.5610.979
ma110403_rel_withdbg.cz11b_c32r1287.52144.04735.46712.9640.973

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12827.21072.7820.0080.084
my8039_rel_o2nofp.cz11a_c32r12842.73656.8120.4520.049
ma101109_rel_withdbg.cz11a_c32r12824.11739.48922.09214.3010.949
ma110403_rel_withdbg.cz11b_c32r12817.32339.46431.55811.6540.970

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9879	156129	40957	640.0	53062.6	1384.9	0.262	4.197	5.371	143.551	813315	54.6	5.209	168	814.0	915.3	106.0	0.027	7863	6969	my8039_rel_o2nofp.cz11a_nocb_c32r128
9885	160796	37394	584.3	45903.2	1278.1	0.233	3.721	4.644	132.408	814123	54.9	5.063	164	818.4	932.1	106.1	0.031	8135	7163	my8039_rel_o2nofp.cz11a_c32r128
8411	94824	35558	550.5	34632.1	955.3	0.375	5.945	4.117	116.300	1061765	41.6	11.197	211	724.0	826.6	100.6	0.385	4715	2573	ma101109_rel_withdbg.cz11a_c32r128
8459	80329	34911	540.7	32875.5	909.2	0.435	6.893	3.887	110.068	1098327	37.5	13.673	224	725.3	828.0	100.6	0.410	3773	1711	ma110403_rel_withdbg.cz11b_c32r128

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1282.02071.34726.5750.0580.038
my8039_rel_o2nofp.cz11a_c32r128nonzero7.35183.3129.3260.0110.026
ma101109_rel_withdbg.cz11a_c32r128nonzero8.19777.84411.6712.2760.0080.0040.350
ma110403_rel_withdbg.cz11b_c32r128nonzero8.27575.88513.4882.3350.0110.0050.364

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1280.48184.64114.8780.156
my8039_rel_o2nofp.cz11a_c32r12812.87186.9980.1310.135
ma101109_rel_withdbg.cz11a_c32r1280.00411.72420.34167.9310.793
ma110403_rel_withdbg.cz11b_c32r1280.01714.39721.06664.5200.872

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1281.30597.6891.0070.109
my8039_rel_o2nofp.cz11a_c32r12828.84870.0281.1240.050
ma101109_rel_withdbg.cz11a_c32r1280.04912.99925.15261.8000.718
ma110403_rel_withdbg.cz11b_c32r1280.05315.60722.18862.1520.728

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9885	6342	101749	1589.8	68089.4	1668.7	16.043	256.683	6.888	172.875	451846	20.7	71.242	1567	814.0	915.3	106.0	0.038	320	176	my8039_rel_o2nofp.cz11a_nocb_c32r128
9885	9033	108421	1694.1	47732.9	1328.5	12.003	192.052	4.829	137.630	426771	22.5	47.247	1196	818.4	932.1	106.0	0.026	463	240	my8039_rel_o2nofp.cz11a_c32r128
3771	6840	85557	1334.7	28539.1	789.8	12.508	199.817	7.568	214.463	1097140	19.3	160.401	1354	724.1	826.8	100.6	0.350	368	48	ma101109_rel_withdbg.cz11a_c32r128
3909	6488	82583	1288.1	29008.2	804.7	12.729	203.319	7.421	210.803	1098779	19.0	169.366	1406	725.3	828.0	100.6	0.364	336	64	ma110403_rel_withdbg.cz11b_c32r128

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r12890.4878.1721.3290.0110.0010.062
my8039_rel_o2nofp.cz11a_c32r12895.9843.1160.8870.013nonzero0.029
ma101109_rel_withdbg.cz11a_c32r12892.7435.5831.4320.2180.0220.002nonzero0.357
ma110403_rel_withdbg.cz11b_c32r12892.5345.7531.3430.3100.0580.002nonzero0.365

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1280.22080.26719.512nonzero0.273
my8039_rel_o2nofp.cz11a_c32r128nonzero35.22464.7400.0360.099
ma101109_rel_withdbg.cz11a_c32r1280.89316.80055.61326.6940.949
ma110403_rel_withdbg.cz11b_c32r1281.33917.44054.36226.8590.847

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r1280.42883.63215.9400.181
my8039_rel_o2nofp.cz11a_c32r12827.50869.4733.0190.053
ma101109_rel_withdbg.cz11a_c32r12810.27316.49248.57124.6640.919
ma110403_rel_withdbg.cz11b_c32r1287.57017.88148.54326.0060.841

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
18000	101645	61806	965.7	86723.3	2085.2	0.608	9.729	4.818	118.624	736844	56.8	7.249	268	814.0	917.0	106.0	0.062	4956	4189	my8039_rel_o2nofp.cz11a_nocb_c32r128
19769	119664	36933	577.1	48339.8	1389.8	0.309	4.938	2.445	71.989	678256	59.3	5.668	238	818.4	932.9	106.0	0.029	5929	5114	my8039_rel_o2nofp.cz11a_c32r128
6235	99044	34701	538.7	33275.5	921.0	0.350	5.570	5.337	151.270	1094931	43.9	11.055	213	724.1	826.9	100.7	0.357	4555	2493	ma101109_rel_withdbg.cz11a_c32r128
6319	91584	35759	555.2	33619.7	934.0	0.390	6.208	5.320	151.347	1130405	41.7	12.343	219	725.3	828.1	100.7	0.365	4475	1998	ma110403_rel_withdbg.cz11b_c32r128

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r128nonzero1.35281.13617.5090.0030.037
my8039_rel_o2nofp.cz11a_c32r128nonzero4.86085.3749.7500.0150.061
ma101109_rel_withdbg.cz11a_c32r128nonzero6.75873.15715.2764.7770.0310.0030.348
ma110403_rel_withdbg.cz11b_c32r128nonzero7.56972.44916.1553.7940.0290.0040.365

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r128100.0000.241
my8039_rel_o2nofp.cz11a_c32r128nonzero7.31229.46763.2200.0010.265
ma101109_rel_withdbg.cz11a_c32r1280.01718.91926.38754.6770.814
ma110403_rel_withdbg.cz11b_c32r1280.01018.28426.76454.9420.796

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8039_rel_o2nofp.cz11a_nocb_c32r128100.0000.231
my8039_rel_o2nofp.cz11a_c32r1282.43719.88321.14656.5340.254
ma101109_rel_withdbg.cz11a_c32r1280.08020.47031.57647.8750.806
ma110403_rel_withdbg.cz11b_c32r1280.04419.52427.86552.5670.751

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
6890	6833	105196	1643.7	58597.3	1615.2	15.395	246.315	8.505	240.051	467126	19.8	68.360	1391	814.0	917.7	106.0	0.037	352	256	my8039_rel_o2nofp.cz11a_nocb_c32r128
12609	8645	106609	1665.8	47165.1	1337.3	12.331	197.304	3.740	108.604	464367	26.9	53.713	1494	818.4	934.5	106.0	0.061	448	240	my8039_rel_o2nofp.cz11a_c32r128
4249	5145	68951	1075.1	26209.6	724.2	13.403	213.993	6.168	174.533	1213545	19.4	235.887	1810	724.1	826.9	100.6	0.348	208	32	ma101109_rel_withdbg.cz11a_c32r128
4254	5399	72009	1122.9	27554.0	763.9	13.337	212.961	6.477	183.867	1177901	19.1	218.154	1698	725.4	828.2	100.6	0.365	224	48	ma110403_rel_withdbg.cz11b_c32r128

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1435750	0	4	0.0	9764.0	534.0	0.000	0.000	0.007	0.381	295680	55.1	0.206	18	262.3	362.8	108.6	0.241	75019	62233	my8039_rel_o2nofp.cz11a_nocb_c32r128
1434206	0	4	0.0	9732.3	532.7	0.000	0.000	0.007	0.380	295453	55.2	0.206	18	262.3	362.8	108.6	0.228	74720	62333	my8039_rel_o2nofp.cz11a_c32r128
281057	0	2614	10.2	1995.5	84.6	0.009	0.037	0.007	0.308	251834	50.5	0.896	86	263.2	365.2	101.4	0.666	14684	200	ma101109_rel_withdbg.cz11a_c32r128
284698	0	2649	10.4	2030.6	85.8	0.009	0.037	0.007	0.309	256608	50.4	0.901	85	263.2	365.2	101.4	0.677	14884	200	ma110403_rel_withdbg.cz11b_c32r128

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1324942	0	33429	1929.3	39549.1	1738.6	0.025	1.491	0.030	1.344	193323	56.1	0.146	20	603.6	704.2	104.9	0.022	NA	NA	my8039_rel_o2nofp.cz11a_nocb_c32r128
1353180	0	34149	1971.3	40424.4	1776.7	0.025	1.492	0.030	1.344	193770	57.0	0.143	20	603.6	704.2	104.9	0.017	NA	NA	my8039_rel_o2nofp.cz11a_c32r128
1573564	0	17191	1407.8	18209.2	1551.0	0.011	0.916	0.012	1.009	78106	23.7	0.050	7	557.5	659.5	101.8	0.002	NA	NA	ma101109_rel_withdbg.cz11a_c32r128
1523229	0	16614	1355.4	19282.1	1511.1	0.011	0.911	0.013	1.016	83878	24.2	0.055	8	557.5	659.5	101.8	0.002	NA	NA	ma110403_rel_withdbg.cz11b_c32r128

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
8946	0	50536	789.7	68019.4	1794.6	5.649	90.386	7.603	205.404	363105	14.4	40.586	773	814.0	918.2	107.6	0.489	400	300	my8039_rel_o2nofp.cz11a_nocb_c32r128
16162	0	36368	568.3	53216.8	1514.8	2.250	36.005	3.293	95.980	333511	20.7	20.636	615	818.4	935.0	107.6	0.499	699	300	my8039_rel_o2nofp.cz11a_c32r128
6122	0	36608	568.0	35668.6	973.6	5.980	95.006	5.826	162.858	862195	14.3	140.840	1121	723.7	826.3	100.5	128.400	300	0	ma101109_rel_withdbg.cz11a_c32r128
6262	0	38408	596.0	37589.9	1007.8	6.133	97.454	6.003	164.789	868728	13.6	138.726	1042	725.0	827.7	100.5	104.927	300	0	ma110403_rel_withdbg.cz11b_c32r128

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
4529	0	44886	701.3	56388.1	1591.3	9.911	158.577	12.451	359.794	352666	15.3	77.870	1622	814.0	915.3	106.0	0.136	140	75	my8039_rel_o2nofp.cz11a_nocb_c32r128
5682	0	38736	605.3	50136.5	1439.4	6.818	109.082	8.824	259.410	335921	17.3	59.122	1462	818.4	932.1	106.0	0.167	140	80	my8039_rel_o2nofp.cz11a_c32r128
6812	0	38701	586.1	31995.9	891.4	5.681	88.108	4.697	134.004	902625	15.7	132.507	1106	723.7	826.3	100.5	2.729	445	65	ma101109_rel_withdbg.cz11a_c32r128
7613	0	40314	608.8	33481.0	935.0	5.295	81.892	4.398	125.764	996146	16.3	130.845	1028	725.0	827.7	100.5	4.100	469	85	ma110403_rel_withdbg.cz11b_c32r128

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1977	180950	8357	130.6	9281.8	266.4	0.046	0.739	4.695	138.009	735420	44.8	4.064	119	814.0	915.3	106.0	0.031	9174	8587	my8039_rel_o2nofp.cz11a_nocb_c32r128
1977	183538	8290	129.5	9300.2	267.9	0.045	0.723	4.704	138.770	746909	45.3	4.070	118	818.4	932.1	106.0	0.013	9366	8711	my8039_rel_o2nofp.cz11a_c32r128
1976	176381	9250	143.4	5991.3	168.0	0.052	0.833	3.032	87.084	733626	44.2	4.159	120	723.7	826.3	100.4	0.027	8950	7419	ma101109_rel_withdbg.cz11a_c32r128
1976	177008	9276	143.7	5988.0	168.4	0.052	0.832	3.031	87.268	738233	44.2	4.171	120	725.0	827.7	100.4	0.154	9017	7544	ma110403_rel_withdbg.cz11b_c32r128

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1976	17439	128161	2002.5	17556.8	490.1	7.349	117.588	8.886	254.019	377469	16.6	21.646	457	814.0	915.3	106.0	0.023	911	336	my8039_rel_o2nofp.cz11a_nocb_c32r128
1977	17203	126426	1975.4	17480.6	490.4	7.349	117.583	8.842	254.000	373425	16.7	21.707	466	818.4	932.1	106.1	0.017	911	368	my8039_rel_o2nofp.cz11a_c32r128
1976	17765	130543	2038.6	12551.9	345.3	7.348	117.507	6.353	178.982	519686	15.8	29.254	427	723.7	826.3	100.4	0.251	943	192	ma101109_rel_withdbg.cz11a_c32r128
1976	17688	129650	2024.7	12430.2	343.0	7.330	117.209	6.291	177.771	515228	15.6	29.128	423	725.0	827.7	100.4	0.301	943	176	ma110403_rel_withdbg.cz11b_c32r128

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9879	156129	40957	640.0	53062.6	1384.9	0.262	4.197	5.371	143.551	813315	54.6	5.209	168	814.0	915.3	106.0	0.027	7863	6969	my8039_rel_o2nofp.cz11a_nocb_c32r128
9885	160796	37394	584.3	45903.2	1278.1	0.233	3.721	4.644	132.408	814123	54.9	5.063	164	818.4	932.1	106.1	0.031	8135	7163	my8039_rel_o2nofp.cz11a_c32r128
8411	94824	35558	550.5	34632.1	955.3	0.375	5.945	4.117	116.300	1061765	41.6	11.197	211	724.0	826.6	100.6	0.385	4715	2573	ma101109_rel_withdbg.cz11a_c32r128
8459	80329	34911	540.7	32875.5	909.2	0.435	6.893	3.887	110.068	1098327	37.5	13.673	224	725.3	828.0	100.6	0.410	3773	1711	ma110403_rel_withdbg.cz11b_c32r128

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9885	6342	101749	1589.8	68089.4	1668.7	16.043	256.683	6.888	172.875	451846	20.7	71.242	1567	814.0	915.3	106.0	0.038	320	176	my8039_rel_o2nofp.cz11a_nocb_c32r128
9885	9033	108421	1694.1	47732.9	1328.5	12.003	192.052	4.829	137.630	426771	22.5	47.247	1196	818.4	932.1	106.0	0.026	463	240	my8039_rel_o2nofp.cz11a_c32r128
3771	6840	85557	1334.7	28539.1	789.8	12.508	199.817	7.568	214.463	1097140	19.3	160.401	1354	724.1	826.8	100.6	0.350	368	48	ma101109_rel_withdbg.cz11a_c32r128
3909	6488	82583	1288.1	29008.2	804.7	12.729	203.319	7.421	210.803	1098779	19.0	169.366	1406	725.3	828.0	100.6	0.364	336	64	ma110403_rel_withdbg.cz11b_c32r128

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
18000	101645	61806	965.7	86723.3	2085.2	0.608	9.729	4.818	118.624	736844	56.8	7.249	268	814.0	917.0	106.0	0.062	4956	4189	my8039_rel_o2nofp.cz11a_nocb_c32r128
19769	119664	36933	577.1	48339.8	1389.8	0.309	4.938	2.445	71.989	678256	59.3	5.668	238	818.4	932.9	106.0	0.029	5929	5114	my8039_rel_o2nofp.cz11a_c32r128
6235	99044	34701	538.7	33275.5	921.0	0.350	5.570	5.337	151.270	1094931	43.9	11.055	213	724.1	826.9	100.7	0.357	4555	2493	ma101109_rel_withdbg.cz11a_c32r128
6319	91584	35759	555.2	33619.7	934.0	0.390	6.208	5.320	151.347	1130405	41.7	12.343	219	725.3	828.1	100.7	0.365	4475	1998	ma110403_rel_withdbg.cz11b_c32r128

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
6890	6833	105196	1643.7	58597.3	1615.2	15.395	246.315	8.505	240.051	467126	19.8	68.360	1391	814.0	917.7	106.0	0.037	352	256	my8039_rel_o2nofp.cz11a_nocb_c32r128
12609	8645	106609	1665.8	47165.1	1337.3	12.331	197.304	3.740	108.604	464367	26.9	53.713	1494	818.4	934.5	106.0	0.061	448	240	my8039_rel_o2nofp.cz11a_c32r128
4249	5145	68951	1075.1	26209.6	724.2	13.403	213.993	6.168	174.533	1213545	19.4	235.887	1810	724.1	826.9	100.6	0.348	208	32	ma101109_rel_withdbg.cz11a_c32r128
4254	5399	72009	1122.9	27554.0	763.9	13.337	212.961	6.477	183.867	1177901	19.1	218.154	1698	725.4	828.2	100.6	0.365	224	48	ma110403_rel_withdbg.cz11b_c32r128

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.099	99.789	0.060	0.013	0.039	0.000	0.000	0.000	0.000	0.241	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.086	99.802	0.060	0.014	0.038	0.000	0.000	0.000	0.000	0.228	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.074	0.255	99.427	0.043	0.108	0.094	0.000	0.000	0.000	0.666	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.066	0.263	99.421	0.051	0.106	0.094	0.000	0.000	0.000	0.677	ma110403_rel_withdbg.cz11b_c32r128

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.000	17.796	81.883	0.321	0.000	0.000	0.000	0.489	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	0.105	14.232	38.037	47.286	0.340	0.000	0.000	0.000	0.499	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	1.204	16.009	57.842	24.942	0.001	0.001	0.002	128.400	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	1.917	15.311	57.804	24.950	0.008	0.005	0.005	104.927	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.240	38.567	61.193	0.001	0.000	0.000	0.000	0.294	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	18.776	19.593	29.076	32.556	0.000	0.000	0.000	0.000	0.194	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	9.959	24.433	43.130	22.475	0.001	0.001	0.002	87.473	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	10.032	19.980	45.904	24.073	0.006	0.003	0.002	102.879	ma110403_rel_withdbg.cz11b_c32r128

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	66.488	31.542	1.970	0.000	0.000	0.000	0.000	0.136	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	0.083	72.400	27.311	0.206	0.000	0.000	0.000	0.000	0.167	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.012	6.985	70.904	20.664	1.413	0.021	0.001	0.000	0.000	2.729	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.031	15.909	60.032	23.806	0.214	0.006	nonzero	nonzero	0.000	4.100	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	69.236	29.778	0.986	0.000	0.000	0.000	0.000	0.136	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	0.260	73.200	26.459	0.080	0.000	0.000	0.000	0.000	0.167	my8039_rel_o2nofp.cz11a_c32r128
nonzero	0.072	17.629	66.997	14.044	1.252	0.005	nonzero	0.000	0.000	2.727	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.086	25.395	54.241	20.077	0.197	0.004	nonzero	nonzero	0.000	4.100	ma110403_rel_withdbg.cz11b_c32r128

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.834	0.163	0.002	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	my8039_rel_o2nofp.cz11a_nocb_c32r128
99.889	0.107	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8039_rel_o2nofp.cz11a_c32r128
99.633	0.330	0.034	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	ma101109_rel_withdbg.cz11a_c32r128
99.584	0.375	0.039	0.002	nonzero	nonzero	0.000	0.000	0.000	0.000	0.154	ma110403_rel_withdbg.cz11b_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	82.812	17.188	0.000	0.000	0.000	0.000	0.000	0.052	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	0.000	95.174	4.826	0.000	0.000	0.000	0.000	0.000	0.037	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	34.196	65.803	0.001	0.000	0.000	0.000	0.000	0.065	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	33.228	66.319	0.453	0.000	0.000	0.000	0.000	0.198	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	94.983	5.017	0.000	0.000	0.000	0.000	0.000	0.036	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	91.606	8.394	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	73.415	26.585	0.000	0.000	0.000	0.000	0.000	0.055	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	68.756	31.104	0.140	0.000	0.000	0.000	0.000	0.193	ma110403_rel_withdbg.cz11b_c32r128

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.002	52.586	46.635	0.777	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.003	51.040	48.122	0.836	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my8039_rel_o2nofp.cz11a_c32r128
0.005	55.347	44.153	0.433	0.060	0.002	0.000	0.000	0.000	0.000	0.251	ma101109_rel_withdbg.cz11a_c32r128
0.006	55.848	43.607	0.470	0.066	0.003	nonzero	0.000	0.000	0.000	0.301	ma110403_rel_withdbg.cz11b_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	3.771	95.567	0.662	0.000	0.000	0.000	0.000	0.154	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	0.000	42.807	57.165	0.028	0.000	0.000	0.000	0.000	0.084	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	0.207	87.782	11.378	0.633	0.000	0.000	0.000	0.401	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	0.239	88.954	10.310	0.497	0.000	0.000	0.000	0.437	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	46.583	53.335	0.082	0.000	0.000	0.000	0.000	0.094	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	82.588	17.413	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	0.335	90.314	9.286	0.065	0.000	0.000	0.000	0.336	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	0.369	90.604	8.872	0.154	0.000	0.000	0.000	0.437	ma110403_rel_withdbg.cz11b_c32r128

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.022	0.958	0.018	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	my8039_rel_o2nofp.cz11a_nocb_c32r128
99.284	0.687	0.027	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	my8039_rel_o2nofp.cz11a_c32r128
93.258	5.400	1.117	0.158	0.060	0.006	0.001	0.000	0.000	0.000	0.385	ma101109_rel_withdbg.cz11a_c32r128
92.517	5.871	1.189	0.269	0.145	0.008	nonzero	0.000	0.000	0.000	0.410	ma110403_rel_withdbg.cz11b_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	12.625	86.725	0.650	0.000	0.000	0.000	0.000	0.109	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	0.000	16.750	82.219	1.031	0.000	0.000	0.000	0.000	0.117	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	6.011	51.984	25.444	16.561	0.000	0.000	0.000	0.979	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	7.521	44.047	35.467	12.964	0.000	0.000	0.000	0.973	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	27.210	72.782	0.008	0.000	0.000	0.000	0.000	0.084	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	42.736	56.812	0.452	0.000	0.000	0.000	0.000	0.000	0.049	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	24.117	39.489	22.092	14.301	0.000	0.000	0.000	0.949	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	17.323	39.464	31.558	11.654	0.000	0.000	0.000	0.970	ma110403_rel_withdbg.cz11b_c32r128

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.020	71.347	26.575	0.058	0.000	0.000	0.000	0.000	0.000	0.038	my8039_rel_o2nofp.cz11a_nocb_c32r128
nonzero	7.351	83.312	9.326	0.011	0.000	0.000	0.000	0.000	0.000	0.026	my8039_rel_o2nofp.cz11a_c32r128
nonzero	8.197	77.844	11.671	2.276	0.008	0.004	0.000	0.000	0.000	0.350	ma101109_rel_withdbg.cz11a_c32r128
nonzero	8.275	75.885	13.488	2.335	0.011	0.005	0.000	0.000	0.000	0.364	ma110403_rel_withdbg.cz11b_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.481	84.641	14.878	0.000	0.000	0.000	0.000	0.156	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	0.000	12.871	86.998	0.131	0.000	0.000	0.000	0.000	0.135	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	0.004	11.724	20.341	67.931	0.000	0.000	0.000	0.793	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	0.017	14.397	21.066	64.520	0.000	0.000	0.000	0.872	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	1.305	97.689	1.007	0.000	0.000	0.000	0.000	0.109	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	28.848	70.028	1.124	0.000	0.000	0.000	0.000	0.000	0.050	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	0.049	12.999	25.152	61.800	0.000	0.000	0.000	0.718	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	0.053	15.607	22.188	62.152	0.000	0.000	0.000	0.728	ma110403_rel_withdbg.cz11b_c32r128

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
90.487	8.172	1.329	0.011	0.001	0.000	0.000	0.000	0.000	0.000	0.062	my8039_rel_o2nofp.cz11a_nocb_c32r128
95.984	3.116	0.887	0.013	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	my8039_rel_o2nofp.cz11a_c32r128
92.743	5.583	1.432	0.218	0.022	0.002	nonzero	0.000	0.000	0.000	0.357	ma101109_rel_withdbg.cz11a_c32r128
92.534	5.753	1.343	0.310	0.058	0.002	nonzero	0.000	0.000	0.000	0.365	ma110403_rel_withdbg.cz11b_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.220	80.267	19.512	nonzero	0.000	0.000	0.000	0.273	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	nonzero	35.224	64.740	0.036	0.000	0.000	0.000	0.000	0.099	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	0.893	16.800	55.613	26.694	0.000	0.000	0.000	0.949	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	1.339	17.440	54.362	26.859	0.000	0.000	0.000	0.847	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.428	83.632	15.940	0.000	0.000	0.000	0.000	0.181	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	27.508	69.473	3.019	0.000	0.000	0.000	0.000	0.000	0.053	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	10.273	16.492	48.571	24.664	0.000	0.000	0.000	0.919	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	7.570	17.881	48.543	26.006	0.000	0.000	0.000	0.841	ma110403_rel_withdbg.cz11b_c32r128

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
nonzero	1.352	81.136	17.509	0.003	0.000	0.000	0.000	0.000	0.000	0.037	my8039_rel_o2nofp.cz11a_nocb_c32r128
nonzero	4.860	85.374	9.750	0.015	0.000	0.000	0.000	0.000	0.000	0.061	my8039_rel_o2nofp.cz11a_c32r128
nonzero	6.758	73.157	15.276	4.777	0.031	0.003	0.000	0.000	0.000	0.348	ma101109_rel_withdbg.cz11a_c32r128
nonzero	7.569	72.449	16.155	3.794	0.029	0.004	0.000	0.000	0.000	0.365	ma110403_rel_withdbg.cz11b_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.000	0.000	100.000	0.000	0.000	0.000	0.000	0.241	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	nonzero	7.312	29.467	63.220	0.001	0.000	0.000	0.000	0.265	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	0.017	18.919	26.387	54.677	0.000	0.000	0.000	0.814	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	0.010	18.284	26.764	54.942	0.000	0.000	0.000	0.796	ma110403_rel_withdbg.cz11b_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.000	0.000	100.000	0.000	0.000	0.000	0.000	0.231	my8039_rel_o2nofp.cz11a_nocb_c32r128
0.000	0.000	2.437	19.883	21.146	56.534	0.000	0.000	0.000	0.000	0.254	my8039_rel_o2nofp.cz11a_c32r128
0.000	0.000	0.000	0.080	20.470	31.576	47.875	0.000	0.000	0.000	0.806	ma101109_rel_withdbg.cz11a_c32r128
0.000	0.000	0.000	0.044	19.524	27.865	52.567	0.000	0.000	0.000	0.751	ma110403_rel_withdbg.cz11b_c32r128