Introduction

This is a report for the insert benchmark with 48M docs and 4 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 32G RAM and an NVMe SSD. It is described here as the ASUS PN53. The benchmark was run with 4 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 4 tables with a table per client. It loads 12M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40 rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
ma100244_rel.cz11apur1_c8r32 5161299230796327228318351823031533522292423276228626
ma100339_rel.cz11apur1_c8r32 4615388888915877033195340852909832559279323181327463
ma100433_rel.cz11apur1_c8r32 4528308888915860833195333182821531687272433091926799
ma100524_rel.cz11apur1_c8r32 4363647741955909532553331802839032803281173244828001
ma100617_rel.cz11apur1_c8r32 4705887741956139132258331432826432893280383247127770
ma101107_rel.cz11apur1_c8r32 4660197741956253034115329212814232371278363197727367
ma110401_rel.cz11bpur1_c8r32 4705886956545945232620327742796032452277403193127384

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
ma100244_rel.cz11apur1_c8r32 1.001.001.001.001.001.001.001.001.001.00
ma100339_rel.cz11apur1_c8r32 0.890.960.931.170.970.960.970.960.970.96
ma100433_rel.cz11apur1_c8r32 0.880.960.931.170.950.930.950.930.940.94
ma100524_rel.cz11apur1_c8r32 0.850.840.931.150.940.940.980.960.990.98
ma100617_rel.cz11apur1_c8r32 0.910.840.971.140.940.930.980.960.990.97
ma101107_rel.cz11apur1_c8r32 0.900.840.991.200.940.930.970.950.980.96
ma110401_rel.cz11bpur1_c8r32 0.910.750.941.150.930.920.970.950.970.96

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
ma100244_rel.cz11apur1_c8r323993991994199439893989
ma100339_rel.cz11apur1_c8r323993991994199439873989
ma100433_rel.cz11apur1_c8r323993991994199339893989
ma100524_rel.cz11apur1_c8r323993991994199439893989
ma100617_rel.cz11apur1_c8r323993991994199439873987
ma101107_rel.cz11apur1_c8r323993991993199439893989
ma110401_rel.cz11bpur1_c8r323993991994199439873987
target4004002000200040004000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3297.4702.1960.3070.0110.0160.153
ma100339_rel.cz11apur1_c8r3294.6295.0170.3210.0170.0160.136
ma100433_rel.cz11apur1_c8r3295.2714.3700.3280.0140.0160.131
ma100524_rel.cz11apur1_c8r3291.7257.6600.4840.1000.0310.126
ma100617_rel.cz11apur1_c8r3292.3577.2970.3110.0170.0180.181
ma101107_rel.cz11apur1_c8r3289.15210.5080.3050.0180.0170.182
ma110401_rel.cz11bpur1_c8r3289.6709.9940.3080.0120.0170.229

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
516129	0	1	0.0	2419.2	161.0	0.000	0.000	0.005	0.319	49142	71.1	0.095	11	3.2	34.0	4.1	0.153	150889	127264	ma100244_rel.cz11apur1_c8r32
461538	0	1	0.0	2431.2	157.4	0.000	0.000	0.005	0.349	38966	77.2	0.084	13	3.2	34.0	3.7	0.136	131660	108114	ma100339_rel.cz11apur1_c8r32
452830	0	1	0.0	2432.8	156.4	0.000	0.000	0.005	0.354	37185	72.8	0.082	13	3.2	34.0	NA	0.131	130996	109683	ma100433_rel.cz11apur1_c8r32
436364	0	0	0.0	3059.0	130.3	0.000	0.000	0.007	0.306	50283	68.6	0.115	13	3.2	34.0	3.4	0.126	124964	101929	ma100524_rel.cz11apur1_c8r32
470588	0	0	0.0	1799.3	115.4	0.000	0.000	0.004	0.251	52695	74.4	0.112	13	3.2	34.0	3.5	0.181	135191	108608	ma100617_rel.cz11apur1_c8r32
466019	0	0	0.0	1888.0	120.0	0.000	0.000	0.004	0.264	48154	73.5	0.103	13	3.2	34.0	3.5	0.182	133358	109184	ma101107_rel.cz11apur1_c8r32
470588	0	0	0.0	1890.0	119.9	0.000	0.000	0.004	0.261	49993	73.8	0.106	13	3.2	34.0	3.5	0.229	132559	100694	ma110401_rel.cz11bpur1_c8r32

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
923079	0	0	0.0	8655.1	739.8	0.000	0.000	0.009	0.821	34651	44.5	0.038	4	7.3	38.1	5.2	0.001	NA	NA	ma100244_rel.cz11apur1_c8r32
888891	0	0	0.0	8561.6	728.1	0.000	0.000	0.010	0.839	29937	45.1	0.034	4	7.3	38.1	5.1	0.002	NA	NA	ma100339_rel.cz11apur1_c8r32
888891	0	0	0.0	8628.1	731.4	0.000	0.000	0.010	0.843	30646	45.1	0.034	4	7.2	38.0	NA	0.002	NA	NA	ma100433_rel.cz11apur1_c8r32
774195	0	0	0.0	4353.6	538.2	0.000	0.000	0.006	0.712	883	44.3	0.001	5	7.2	38.0	7.5	0.001	NA	NA	ma100524_rel.cz11apur1_c8r32
774195	0	0	0.0	6980.5	581.3	0.000	0.000	0.009	0.769	12515	44.9	0.016	5	7.2	38.0	7.3	0.001	NA	NA	ma100617_rel.cz11apur1_c8r32
774195	0	0	0.0	6633.6	568.1	0.000	0.000	0.009	0.751	11080	45.1	0.014	5	7.2	38.0	7.1	0.001	NA	NA	ma101107_rel.cz11apur1_c8r32
695654	0	0	0.0	6391.3	533.4	0.000	0.000	0.009	0.785	11455	44.4	0.016	5	7.2	38.0	6.6	1.843	NA	NA	ma110401_rel.cz11bpur1_c8r32

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r320.09689.9379.5090.1310.1770.1510.276
ma100339_rel.cz11apur1_c8r320.55891.4477.3650.0910.2690.2700.339
ma100433_rel.cz11apur1_c8r320.36091.7697.2360.0870.2320.3170.274
ma100524_rel.cz11apur1_c8r321.88896.0851.2720.0520.3770.327nonzero1.037
ma100617_rel.cz11apur1_c8r326.27491.5051.4940.0660.0870.5740.361
ma101107_rel.cz11apur1_c8r326.03391.7721.5270.0570.0570.5540.323
ma110401_rel.cz11bpur1_c8r3214.16982.9651.9530.2520.0770.5840.390

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r324.37485.6509.5270.1220.1920.1360.267
ma100339_rel.cz11apur1_c8r3216.74375.2927.3390.0860.3200.2200.271
ma100433_rel.cz11apur1_c8r3217.10975.0677.1910.0840.2910.2590.274
ma100524_rel.cz11apur1_c8r3228.16369.8701.2200.0430.5520.1520.424
ma100617_rel.cz11apur1_c8r3239.14958.7081.4250.0580.1140.5460.294
ma101107_rel.cz11apur1_c8r3234.69663.2061.4400.0480.0680.5420.322
ma110401_rel.cz11bpur1_c8r3242.33554.9531.8270.2260.0870.5720.372

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
63272	0	0	0.0	11376.7	352.0	0.000	0.000	0.180	5.697	49140	62.0	0.777	78	14.3	47.0	16.9	0.276	19436	150	ma100244_rel.cz11apur1_c8r32
58770	0	0	0.0	9314.6	294.0	0.000	0.000	0.158	5.123	43311	53.5	0.737	73	12.8	44.9	14.7	0.339	19979	150	ma100339_rel.cz11apur1_c8r32
58608	0	0	0.0	9654.0	303.0	0.000	0.000	0.165	5.293	44675	53.3	0.762	73	12.8	44.9	NA	0.274	20029	150	ma100433_rel.cz11apur1_c8r32
59095	0	0	0.0	8997.9	264.2	0.000	0.000	0.152	4.578	60471	50.0	1.023	68	12.8	45.0	14.0	1.037	9490	150	ma100524_rel.cz11apur1_c8r32
61391	0	0	0.0	5016.3	154.7	0.000	0.000	0.082	2.580	51880	48.4	0.845	63	12.9	45.0	14.2	0.361	12936	150	ma100617_rel.cz11apur1_c8r32
62530	0	1502	5.9	5446.6	168.8	0.024	0.096	0.087	2.764	53375	49.0	0.854	63	12.8	45.0	14.2	0.323	18138	150	ma101107_rel.cz11apur1_c8r32
59452	0	1471	5.7	5380.3	160.8	0.025	0.099	0.090	2.770	52506	46.2	0.883	62	12.9	45.0	14.2	0.390	14485	150	ma110401_rel.cz11bpur1_c8r32

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3224.68871.9261.0881.5860.7090.0020.145
ma100339_rel.cz11apur1_c8r3227.45969.6921.0711.3490.4260.0020.153
ma100433_rel.cz11apur1_c8r3226.57070.5821.0691.3450.4330.0020.151
ma100524_rel.cz11apur1_c8r3226.77671.1451.1510.1440.7820.0020.146
ma100617_rel.cz11apur1_c8r3226.80971.3270.9170.1250.8190.0030.181
ma101107_rel.cz11apur1_c8r3211.98086.3051.0310.1840.4970.0030.146
ma110401_rel.cz11bpur1_c8r3217.77780.3420.9130.3470.6180.0030.142

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3225.95970.6791.0721.5790.7090.0020.144
ma100339_rel.cz11apur1_c8r3228.88868.2121.1291.3430.4260.0020.159
ma100433_rel.cz11apur1_c8r3228.44368.6611.1221.3400.4320.0020.144
ma100524_rel.cz11apur1_c8r3229.17868.7811.1250.1330.7820.0020.146
ma100617_rel.cz11apur1_c8r3229.82468.3300.9010.1220.8200.0030.180
ma101107_rel.cz11apur1_c8r3216.43481.8541.0310.1810.4970.0030.146
ma110401_rel.cz11bpur1_c8r3221.80276.3480.9120.3180.6170.0030.142

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
28318	0	0	0.0	10126.4	312.7	0.000	0.000	0.358	11.306	98112	62.5	3.465	177	14.3	47.0	17.1	0.145	9410	180	ma100244_rel.cz11apur1_c8r32
33195	0	0	0.0	7941.8	258.1	0.000	0.000	0.239	7.960	103697	67.5	3.124	163	12.8	44.9	15.0	0.153	9812	180	ma100339_rel.cz11apur1_c8r32
33195	0	0	0.0	7946.5	257.1	0.000	0.000	0.239	7.932	103857	67.3	3.129	162	12.8	44.9	NA	0.151	9874	180	ma100433_rel.cz11apur1_c8r32
32553	0	0	0.0	10540.9	311.1	0.000	0.000	0.324	9.786	133146	64.7	4.090	159	12.8	45.0	14.1	0.146	9070	185	ma100524_rel.cz11apur1_c8r32
32258	0	0	0.0	3902.7	133.6	0.000	0.000	0.121	4.240	114329	60.2	3.544	149	12.9	45.0	14.2	0.181	12477	155	ma100617_rel.cz11apur1_c8r32
34115	0	4682	18.3	4205.9	144.1	0.137	0.549	0.123	4.325	142515	66.0	4.177	155	12.8	45.0	14.2	0.146	11088	160	ma101107_rel.cz11apur1_c8r32
32620	0	4426	17.3	4138.9	137.4	0.136	0.543	0.127	4.315	136772	62.3	4.193	153	12.9	45.0	14.2	0.142	11007	165	ma110401_rel.cz11bpur1_c8r32

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3299.9770.0210.001nonzerononzero0.022
ma100339_rel.cz11apur1_c8r3299.9750.0230.002nonzerononzero0.021
ma100433_rel.cz11apur1_c8r3299.9700.0290.001nonzerononzero0.021
ma100524_rel.cz11apur1_c8r3299.9920.007nonzero0.002
ma100617_rel.cz11apur1_c8r3299.9920.008nonzerononzero0.004
ma101107_rel.cz11apur1_c8r3299.9920.0080.0010.003
ma110401_rel.cz11bpur1_c8r3299.9920.0070.0010.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r320.79295.9933.0280.1880.027
ma100339_rel.cz11apur1_c8r321.50095.4242.8610.2150.025
ma100433_rel.cz11apur1_c8r320.88995.9383.0210.1530.027
ma100524_rel.cz11apur1_c8r326.61193.3890.003
ma100617_rel.cz11apur1_c8r3211.88988.1040.0070.005
ma101107_rel.cz11apur1_c8r321.42457.02841.5490.012
ma110401_rel.cz11bpur1_c8r321.14652.66046.1940.012

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3246.11850.9582.7920.1320.036
ma100339_rel.cz11apur1_c8r3277.38219.9792.5000.1390.026
ma100433_rel.cz11apur1_c8r3282.61114.7222.6040.0620.024
ma100524_rel.cz11apur1_c8r3280.29219.7080.003
ma100617_rel.cz11apur1_c8r3250.84749.1460.0070.005
ma101107_rel.cz11apur1_c8r3213.51444.94441.5420.012
ma110401_rel.cz11bpur1_c8r3210.63243.18846.1810.011

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	35182	0	0.0	3335.0	92.8	0.000	0.000	8.363	238.366	143533	53.2	4.080	121	14.3	47.0	17.1	0.022	8841	8711	ma100244_rel.cz11apur1_c8r32
399	34085	0	0.0	3378.4	94.1	0.000	0.000	8.471	241.749	139620	52.8	4.096	124	12.8	44.9	15.0	0.021	8535	8407	ma100339_rel.cz11apur1_c8r32
399	33318	0	0.0	3388.2	94.4	0.000	0.000	8.496	242.434	137162	53.0	4.117	127	12.8	44.9	NA	0.021	8343	8231	ma100433_rel.cz11apur1_c8r32
399	33180	0	0.0	6.2	0.6	0.000	0.000	0.015	1.471	126833	52.1	3.823	126	12.8	45.0	14.0	0.002	8327	8266	ma100524_rel.cz11apur1_c8r32
399	33143	0	0.0	11.5	0.6	0.000	0.000	0.029	1.624	126751	52.3	3.824	126	12.9	45.0	13.9	0.004	8279	8183	ma100617_rel.cz11apur1_c8r32
399	32921	8	0.0	5.3	0.5	0.000	0.001	0.013	1.198	125819	52.1	3.822	127	12.8	45.0	13.9	0.003	8247	8122	ma101107_rel.cz11apur1_c8r32
399	32774	8	0.0	11.8	0.6	0.000	0.001	0.030	1.655	125317	52.2	3.824	127	12.9	45.0	13.9	0.002	8170	8087	ma110401_rel.cz11bpur1_c8r32

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3299.9830.017nonzerononzero0.008
ma100339_rel.cz11apur1_c8r3299.9690.0300.001nonzerononzero0.026
ma100433_rel.cz11apur1_c8r3299.9580.0410.001nonzerononzero0.020
ma100524_rel.cz11apur1_c8r3299.9590.041nonzero0.002
ma100617_rel.cz11apur1_c8r3299.9420.0570.0010.003
ma101107_rel.cz11apur1_c8r3299.9390.061nonzero0.002
ma110401_rel.cz11bpur1_c8r3299.9370.0610.0020.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r320.20196.4933.1530.1530.032
ma100339_rel.cz11apur1_c8r320.47296.2783.0140.2360.036
ma100433_rel.cz11apur1_c8r320.06996.8262.9720.1320.035
ma100524_rel.cz11apur1_c8r323.59096.4030.0070.004
ma100617_rel.cz11apur1_c8r3210.27889.7220.004
ma101107_rel.cz11apur1_c8r3211.36187.2501.3890.013
ma110401_rel.cz11bpur1_c8r320.52154.15345.3260.012

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3238.39658.8612.5760.1670.028
ma100339_rel.cz11apur1_c8r3276.16021.1882.5350.1180.028
ma100433_rel.cz11apur1_c8r3269.03528.2642.6040.0970.028
ma100524_rel.cz11apur1_c8r3269.75030.2500.003
ma100617_rel.cz11apur1_c8r3256.55643.4440.004
ma101107_rel.cz11apur1_c8r3268.29930.2501.4510.012
ma110401_rel.cz11bpur1_c8r325.72948.61145.6600.012

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	30315	0	0.0	3322.7	92.5	0.000	0.000	8.336	237.620	130053	52.9	4.290	140	14.3	47.0	17.0	0.008	7624	7544	ma100244_rel.cz11apur1_c8r32
399	29098	0	0.0	3300.2	91.9	0.000	0.000	8.269	235.717	125162	52.6	4.301	145	12.8	44.9	14.9	0.026	7272	7192	ma100339_rel.cz11apur1_c8r32
399	28215	0	0.0	3300.4	91.9	0.000	0.000	8.276	235.902	121963	52.6	4.323	149	12.8	44.9	NA	0.020	7064	6984	ma100433_rel.cz11apur1_c8r32
399	28390	0	0.0	4.9	0.4	0.000	0.000	0.012	1.062	113168	52.0	3.986	147	12.8	45.0	14.1	0.002	7096	7032	ma100524_rel.cz11apur1_c8r32
399	28264	0	0.0	20.9	0.9	0.000	0.000	0.053	2.231	112779	51.9	3.990	147	12.9	45.0	13.9	0.003	7080	7000	ma100617_rel.cz11apur1_c8r32
399	28142	0	0.0	23.7	1.0	0.000	0.000	0.059	2.440	112321	52.0	3.991	148	12.8	45.0	13.9	0.002	7032	6953	ma101107_rel.cz11apur1_c8r32
399	27960	8	0.0	11.5	0.6	0.000	0.001	0.029	1.567	111543	51.9	3.989	149	12.9	45.0	13.9	0.002	6987	6907	ma110401_rel.cz11bpur1_c8r32

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3299.9140.0760.0090.002nonzero0.032
ma100339_rel.cz11apur1_c8r3299.9000.0870.0110.002nonzero0.040
ma100433_rel.cz11apur1_c8r3299.8800.1080.0100.002nonzero0.038
ma100524_rel.cz11apur1_c8r3299.9690.0250.006nonzero0.012
ma100617_rel.cz11apur1_c8r3299.9650.0270.008nonzerononzero0.016
ma101107_rel.cz11apur1_c8r3299.9540.0360.010nonzerononzero0.022
ma110401_rel.cz11bpur1_c8r3299.9500.0380.013nonzerononzero0.016

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r325.38884.3389.6790.5960.051
ma100339_rel.cz11apur1_c8r327.28282.3719.8040.5430.052
ma100433_rel.cz11apur1_c8r326.33583.2379.8600.5680.053
ma100524_rel.cz11apur1_c8r3217.24380.9961.7490.0130.037
ma100617_rel.cz11apur1_c8r3215.61181.7682.6060.0150.038
ma101107_rel.cz11apur1_c8r327.58786.1716.2290.0130.028
ma110401_rel.cz11bpur1_c8r322.46187.37510.1430.0210.062

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3263.84727.5258.1530.4750.057
ma100339_rel.cz11apur1_c8r3277.99013.4338.1650.4110.048
ma100433_rel.cz11apur1_c8r3276.27115.0248.2790.4260.049
ma100524_rel.cz11apur1_c8r3281.99716.7241.2680.0110.037
ma100617_rel.cz11apur1_c8r3252.21045.8071.9690.0140.036
ma101107_rel.cz11apur1_c8r3238.82855.5605.6030.0100.027
ma110401_rel.cz11bpur1_c8r3217.33973.4609.1880.0140.032

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	33522	0	0.0	11977.1	334.2	0.000	0.000	6.005	171.613	160252	56.9	4.781	136	14.3	47.0	17.1	0.032	8311	8167	ma100244_rel.cz11apur1_c8r32
1994	32559	0	0.0	11955.6	333.7	0.000	0.000	5.995	171.312	157021	56.5	4.823	139	12.8	44.9	14.9	0.040	8135	7975	ma100339_rel.cz11apur1_c8r32
1994	31687	0	0.0	11962.3	333.8	0.000	0.000	5.998	171.402	154521	56.4	4.876	142	12.8	44.9	NA	0.038	7898	7752	ma100433_rel.cz11apur1_c8r32
1994	32803	0	0.0	18.6	2.1	0.000	0.000	0.009	1.054	124895	53.3	3.807	130	12.8	45.0	14.0	0.012	8218	8135	ma100524_rel.cz11apur1_c8r32
1994	32893	0	0.0	161.1	5.9	0.000	0.000	0.081	3.013	126160	53.4	3.836	130	12.9	45.0	13.9	0.016	8215	7986	ma100617_rel.cz11apur1_c8r32
1993	32371	57	0.2	162.1	5.9	0.002	0.007	0.081	3.047	124628	53.3	3.850	132	12.8	45.0	13.9	0.022	8087	7895	ma101107_rel.cz11apur1_c8r32
1994	32452	57	0.2	168.2	6.0	0.002	0.007	0.084	3.056	124845	53.3	3.847	131	12.9	45.0	13.9	0.016	8103	7817	ma110401_rel.cz11bpur1_c8r32

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3299.9400.0550.005nonzerononzero0.024
ma100339_rel.cz11apur1_c8r3299.9220.0720.0050.001nonzero0.032
ma100433_rel.cz11apur1_c8r3299.9140.0800.0050.001nonzero0.027
ma100524_rel.cz11apur1_c8r3299.9450.0510.004nonzero0.012
ma100617_rel.cz11apur1_c8r3299.9180.0770.005nonzero0.012
ma101107_rel.cz11apur1_c8r3299.8870.0970.016nonzero0.008
ma110401_rel.cz11bpur1_c8r3299.8890.0960.015nonzero0.011

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r324.62985.9158.8720.5830.050
ma100339_rel.cz11apur1_c8r324.75885.4589.2570.5260.048
ma100433_rel.cz11apur1_c8r322.91986.5819.8490.6510.052
ma100524_rel.cz11apur1_c8r3214.34284.4041.2460.0080.038
ma100617_rel.cz11apur1_c8r3221.18678.3170.4850.0130.039
ma101107_rel.cz11apur1_c8r320.66189.00610.3220.0110.029
ma110401_rel.cz11bpur1_c8r321.19687.91810.8670.0190.032

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3261.36930.5997.5990.4330.050
ma100339_rel.cz11apur1_c8r3271.97119.7477.8320.4500.048
ma100433_rel.cz11apur1_c8r3270.62620.5358.3690.4690.040
ma100524_rel.cz11apur1_c8r3279.99419.0430.9540.0080.038
ma100617_rel.cz11apur1_c8r3258.82540.7350.4310.0100.039
ma101107_rel.cz11apur1_c8r3214.15676.5969.2380.0110.029
ma110401_rel.cz11bpur1_c8r3213.90875.98110.1000.0110.032

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	29242	0	0.0	12062.0	336.6	0.000	0.000	6.048	172.826	149452	56.6	5.111	155	14.3	47.0	17.1	0.024	7274	7176	ma100244_rel.cz11apur1_c8r32
1994	27932	0	0.0	12067.3	336.8	0.000	0.000	6.051	172.908	144540	56.5	5.175	162	12.8	44.9	14.9	0.032	6969	6873	ma100339_rel.cz11apur1_c8r32
1993	27243	0	0.0	12075.6	337.0	0.000	0.000	6.058	173.123	142493	56.5	5.230	166	12.8	44.9	NA	0.027	6809	6715	ma100433_rel.cz11apur1_c8r32
1994	28117	0	0.0	18.6	2.1	0.000	0.000	0.009	1.061	111640	53.1	3.971	151	12.8	45.0	14.0	0.012	7032	6969	ma100524_rel.cz11apur1_c8r32
1994	28038	0	0.0	165.2	6.0	0.000	0.000	0.083	3.055	112582	53.2	4.015	152	12.9	45.0	13.9	0.012	7017	6905	ma100617_rel.cz11apur1_c8r32
1994	27836	57	0.2	165.1	6.0	0.002	0.008	0.083	3.065	111952	53.1	4.022	153	12.8	45.0	13.9	0.008	6953	6841	ma101107_rel.cz11apur1_c8r32
1994	27740	56	0.2	170.7	6.0	0.002	0.008	0.086	3.083	111581	53.1	4.022	153	12.9	45.0	13.9	0.011	6936	6811	ma110401_rel.cz11bpur1_c8r32

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3299.8240.1460.0260.004nonzero0.035
ma100339_rel.cz11apur1_c8r3299.7980.1720.0260.004nonzero0.057
ma100433_rel.cz11apur1_c8r3299.7350.2320.0300.004nonzero0.040
ma100524_rel.cz11apur1_c8r3299.9210.0620.0150.002nonzero0.022
ma100617_rel.cz11apur1_c8r3299.9020.0810.0160.001nonzero0.032
ma101107_rel.cz11apur1_c8r3299.9310.0570.012nonzero0.012
ma110401_rel.cz11bpur1_c8r3299.9420.0500.0080.001nonzero0.031

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r324.22283.29911.8970.5830.050
ma100339_rel.cz11apur1_c8r325.96082.24711.2980.4940.059
ma100433_rel.cz11apur1_c8r326.62182.25110.7330.3950.041
ma100524_rel.cz11apur1_c8r3210.36985.0964.4600.0750.052
ma100617_rel.cz11apur1_c8r3218.75878.4472.7670.0290.044
ma101107_rel.cz11apur1_c8r3218.16378.8033.0260.0080.033
ma110401_rel.cz11bpur1_c8r3232.20465.6332.1310.0320.032

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3258.36131.4489.7270.4640.044
ma100339_rel.cz11apur1_c8r3272.66617.8799.0560.3990.052
ma100433_rel.cz11apur1_c8r3275.70815.3398.6960.2580.043
ma100524_rel.cz11apur1_c8r3269.35127.0283.5510.0700.042
ma100617_rel.cz11apur1_c8r3261.04936.5192.4060.0270.042
ma101107_rel.cz11apur1_c8r3264.86232.6602.4730.0060.032
ma110401_rel.cz11bpur1_c8r3270.38927.7871.8080.0160.032

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	32762	0	0.0	13960.8	391.1	0.000	0.000	3.500	100.405	161908	58.8	4.942	144	14.3	47.0	17.1	0.035	8151	7800	ma100244_rel.cz11apur1_c8r32
3987	31813	0	0.0	13983.9	391.8	0.000	0.000	3.508	100.637	158983	58.5	4.997	147	12.8	44.9	14.9	0.057	7912	7704	ma100339_rel.cz11apur1_c8r32
3989	30919	0	0.0	13779.8	386.1	0.000	0.000	3.455	99.118	156058	58.3	5.047	151	12.8	44.9	NA	0.040	7736	7544	ma100433_rel.cz11apur1_c8r32
3989	32448	0	0.0	36.5	4.2	0.000	0.000	0.009	1.073	123061	54.6	3.793	135	12.8	45.0	14.0	0.022	8135	7997	ma100524_rel.cz11apur1_c8r32
3987	32471	0	0.0	417.7	14.2	0.000	0.000	0.105	3.657	125657	54.8	3.870	135	12.9	45.0	14.0	0.032	8151	7962	ma100617_rel.cz11apur1_c8r32
3989	31977	147	0.6	429.1	14.6	0.005	0.018	0.108	3.754	124707	54.7	3.900	137	12.8	45.0	13.9	0.012	8007	7832	ma101107_rel.cz11apur1_c8r32
3987	31931	125	0.5	446.8	14.8	0.004	0.016	0.112	3.794	124722	54.6	3.906	137	12.9	45.0	13.9	0.031	8039	7816	ma110401_rel.cz11bpur1_c8r32

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3299.8580.1260.0150.002nonzero0.034
ma100339_rel.cz11apur1_c8r3299.8350.1460.0160.002nonzero0.022
ma100433_rel.cz11apur1_c8r3299.8340.1490.0160.002nonzero0.036
ma100524_rel.cz11apur1_c8r3299.8890.0930.0160.002nonzero0.018
ma100617_rel.cz11apur1_c8r3299.8850.1030.011nonzerononzero0.028
ma101107_rel.cz11apur1_c8r3299.8730.1170.010nonzerononzero0.016
ma110401_rel.cz11bpur1_c8r3299.8760.1130.010nonzero0.016

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r325.60083.40510.4380.5580.055
ma100339_rel.cz11apur1_c8r325.73682.47011.2430.5510.057
ma100433_rel.cz11apur1_c8r324.29584.27110.8980.5360.057
ma100524_rel.cz11apur1_c8r326.12688.7045.0840.0860.044
ma100617_rel.cz11apur1_c8r3215.14482.5672.2730.0170.041
ma101107_rel.cz11apur1_c8r3213.89783.9362.1620.0060.035
ma110401_rel.cz11bpur1_c8r3219.47277.9062.5940.0270.033

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
ma100244_rel.cz11apur1_c8r3263.26927.8088.4970.4260.059
ma100339_rel.cz11apur1_c8r3271.81218.7719.0030.4140.058
ma100433_rel.cz11apur1_c8r3271.83719.0318.7300.4010.0010.066
ma100524_rel.cz11apur1_c8r3263.87831.8134.2310.0780.048
ma100617_rel.cz11apur1_c8r3260.30437.6332.0400.0230.043
ma101107_rel.cz11apur1_c8r3261.24036.8501.9070.0030.034
ma110401_rel.cz11bpur1_c8r3260.48137.2932.2140.0120.033

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	28626	0	0.0	14207.2	398.0	0.000	0.000	3.562	102.163	151989	58.8	5.309	164	14.3	47.0	17.1	0.034	7130	7000	ma100244_rel.cz11apur1_c8r32
3989	27463	0	0.0	14140.0	396.1	0.000	0.000	3.545	101.696	147459	58.6	5.369	171	12.8	44.9	15.0	0.022	6857	6722	ma100339_rel.cz11apur1_c8r32
3989	26799	0	0.0	14070.1	394.2	0.000	0.000	3.527	101.190	145589	58.6	5.433	175	12.8	44.9	NA	0.036	6683	6553	ma100433_rel.cz11apur1_c8r32
3989	28001	0	0.0	37.1	4.2	0.000	0.000	0.009	1.087	110768	54.7	3.956	156	12.8	45.0	14.0	0.018	6989	6905	ma100524_rel.cz11apur1_c8r32
3987	27770	0	0.0	355.4	12.5	0.000	0.000	0.089	3.210	112308	54.7	4.044	158	12.9	45.0	14.0	0.028	6953	6825	ma100617_rel.cz11apur1_c8r32
3989	27367	153	0.6	357.9	12.7	0.006	0.022	0.090	3.251	111758	54.8	4.084	160	12.8	45.0	13.9	0.016	6857	6745	ma101107_rel.cz11apur1_c8r32
3987	27384	149	0.6	358.5	12.5	0.005	0.022	0.090	3.203	111875	54.7	4.085	160	12.9	45.0	13.9	0.016	6841	6731	ma110401_rel.cz11bpur1_c8r32

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
516129	0	1	0.0	2419.2	161.0	0.000	0.000	0.005	0.319	49142	71.1	0.095	11	3.2	34.0	4.1	0.153	150889	127264	ma100244_rel.cz11apur1_c8r32
461538	0	1	0.0	2431.2	157.4	0.000	0.000	0.005	0.349	38966	77.2	0.084	13	3.2	34.0	3.7	0.136	131660	108114	ma100339_rel.cz11apur1_c8r32
452830	0	1	0.0	2432.8	156.4	0.000	0.000	0.005	0.354	37185	72.8	0.082	13	3.2	34.0	NA	0.131	130996	109683	ma100433_rel.cz11apur1_c8r32
436364	0	0	0.0	3059.0	130.3	0.000	0.000	0.007	0.306	50283	68.6	0.115	13	3.2	34.0	3.4	0.126	124964	101929	ma100524_rel.cz11apur1_c8r32
470588	0	0	0.0	1799.3	115.4	0.000	0.000	0.004	0.251	52695	74.4	0.112	13	3.2	34.0	3.5	0.181	135191	108608	ma100617_rel.cz11apur1_c8r32
466019	0	0	0.0	1888.0	120.0	0.000	0.000	0.004	0.264	48154	73.5	0.103	13	3.2	34.0	3.5	0.182	133358	109184	ma101107_rel.cz11apur1_c8r32
470588	0	0	0.0	1890.0	119.9	0.000	0.000	0.004	0.261	49993	73.8	0.106	13	3.2	34.0	3.5	0.229	132559	100694	ma110401_rel.cz11bpur1_c8r32

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
923079	0	0	0.0	8655.1	739.8	0.000	0.000	0.009	0.821	34651	44.5	0.038	4	7.3	38.1	5.2	0.001	NA	NA	ma100244_rel.cz11apur1_c8r32
888891	0	0	0.0	8561.6	728.1	0.000	0.000	0.010	0.839	29937	45.1	0.034	4	7.3	38.1	5.1	0.002	NA	NA	ma100339_rel.cz11apur1_c8r32
888891	0	0	0.0	8628.1	731.4	0.000	0.000	0.010	0.843	30646	45.1	0.034	4	7.2	38.0	NA	0.002	NA	NA	ma100433_rel.cz11apur1_c8r32
774195	0	0	0.0	4353.6	538.2	0.000	0.000	0.006	0.712	883	44.3	0.001	5	7.2	38.0	7.5	0.001	NA	NA	ma100524_rel.cz11apur1_c8r32
774195	0	0	0.0	6980.5	581.3	0.000	0.000	0.009	0.769	12515	44.9	0.016	5	7.2	38.0	7.3	0.001	NA	NA	ma100617_rel.cz11apur1_c8r32
774195	0	0	0.0	6633.6	568.1	0.000	0.000	0.009	0.751	11080	45.1	0.014	5	7.2	38.0	7.1	0.001	NA	NA	ma101107_rel.cz11apur1_c8r32
695654	0	0	0.0	6391.3	533.4	0.000	0.000	0.009	0.785	11455	44.4	0.016	5	7.2	38.0	6.6	1.843	NA	NA	ma110401_rel.cz11bpur1_c8r32

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
63272	0	0	0.0	11376.7	352.0	0.000	0.000	0.180	5.697	49140	62.0	0.777	78	14.3	47.0	16.9	0.276	19436	150	ma100244_rel.cz11apur1_c8r32
58770	0	0	0.0	9314.6	294.0	0.000	0.000	0.158	5.123	43311	53.5	0.737	73	12.8	44.9	14.7	0.339	19979	150	ma100339_rel.cz11apur1_c8r32
58608	0	0	0.0	9654.0	303.0	0.000	0.000	0.165	5.293	44675	53.3	0.762	73	12.8	44.9	NA	0.274	20029	150	ma100433_rel.cz11apur1_c8r32
59095	0	0	0.0	8997.9	264.2	0.000	0.000	0.152	4.578	60471	50.0	1.023	68	12.8	45.0	14.0	1.037	9490	150	ma100524_rel.cz11apur1_c8r32
61391	0	0	0.0	5016.3	154.7	0.000	0.000	0.082	2.580	51880	48.4	0.845	63	12.9	45.0	14.2	0.361	12936	150	ma100617_rel.cz11apur1_c8r32
62530	0	1502	5.9	5446.6	168.8	0.024	0.096	0.087	2.764	53375	49.0	0.854	63	12.8	45.0	14.2	0.323	18138	150	ma101107_rel.cz11apur1_c8r32
59452	0	1471	5.7	5380.3	160.8	0.025	0.099	0.090	2.770	52506	46.2	0.883	62	12.9	45.0	14.2	0.390	14485	150	ma110401_rel.cz11bpur1_c8r32

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
28318	0	0	0.0	10126.4	312.7	0.000	0.000	0.358	11.306	98112	62.5	3.465	177	14.3	47.0	17.1	0.145	9410	180	ma100244_rel.cz11apur1_c8r32
33195	0	0	0.0	7941.8	258.1	0.000	0.000	0.239	7.960	103697	67.5	3.124	163	12.8	44.9	15.0	0.153	9812	180	ma100339_rel.cz11apur1_c8r32
33195	0	0	0.0	7946.5	257.1	0.000	0.000	0.239	7.932	103857	67.3	3.129	162	12.8	44.9	NA	0.151	9874	180	ma100433_rel.cz11apur1_c8r32
32553	0	0	0.0	10540.9	311.1	0.000	0.000	0.324	9.786	133146	64.7	4.090	159	12.8	45.0	14.1	0.146	9070	185	ma100524_rel.cz11apur1_c8r32
32258	0	0	0.0	3902.7	133.6	0.000	0.000	0.121	4.240	114329	60.2	3.544	149	12.9	45.0	14.2	0.181	12477	155	ma100617_rel.cz11apur1_c8r32
34115	0	4682	18.3	4205.9	144.1	0.137	0.549	0.123	4.325	142515	66.0	4.177	155	12.8	45.0	14.2	0.146	11088	160	ma101107_rel.cz11apur1_c8r32
32620	0	4426	17.3	4138.9	137.4	0.136	0.543	0.127	4.315	136772	62.3	4.193	153	12.9	45.0	14.2	0.142	11007	165	ma110401_rel.cz11bpur1_c8r32

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	35182	0	0.0	3335.0	92.8	0.000	0.000	8.363	238.366	143533	53.2	4.080	121	14.3	47.0	17.1	0.022	8841	8711	ma100244_rel.cz11apur1_c8r32
399	34085	0	0.0	3378.4	94.1	0.000	0.000	8.471	241.749	139620	52.8	4.096	124	12.8	44.9	15.0	0.021	8535	8407	ma100339_rel.cz11apur1_c8r32
399	33318	0	0.0	3388.2	94.4	0.000	0.000	8.496	242.434	137162	53.0	4.117	127	12.8	44.9	NA	0.021	8343	8231	ma100433_rel.cz11apur1_c8r32
399	33180	0	0.0	6.2	0.6	0.000	0.000	0.015	1.471	126833	52.1	3.823	126	12.8	45.0	14.0	0.002	8327	8266	ma100524_rel.cz11apur1_c8r32
399	33143	0	0.0	11.5	0.6	0.000	0.000	0.029	1.624	126751	52.3	3.824	126	12.9	45.0	13.9	0.004	8279	8183	ma100617_rel.cz11apur1_c8r32
399	32921	8	0.0	5.3	0.5	0.000	0.001	0.013	1.198	125819	52.1	3.822	127	12.8	45.0	13.9	0.003	8247	8122	ma101107_rel.cz11apur1_c8r32
399	32774	8	0.0	11.8	0.6	0.000	0.001	0.030	1.655	125317	52.2	3.824	127	12.9	45.0	13.9	0.002	8170	8087	ma110401_rel.cz11bpur1_c8r32

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
399	30315	0	0.0	3322.7	92.5	0.000	0.000	8.336	237.620	130053	52.9	4.290	140	14.3	47.0	17.0	0.008	7624	7544	ma100244_rel.cz11apur1_c8r32
399	29098	0	0.0	3300.2	91.9	0.000	0.000	8.269	235.717	125162	52.6	4.301	145	12.8	44.9	14.9	0.026	7272	7192	ma100339_rel.cz11apur1_c8r32
399	28215	0	0.0	3300.4	91.9	0.000	0.000	8.276	235.902	121963	52.6	4.323	149	12.8	44.9	NA	0.020	7064	6984	ma100433_rel.cz11apur1_c8r32
399	28390	0	0.0	4.9	0.4	0.000	0.000	0.012	1.062	113168	52.0	3.986	147	12.8	45.0	14.1	0.002	7096	7032	ma100524_rel.cz11apur1_c8r32
399	28264	0	0.0	20.9	0.9	0.000	0.000	0.053	2.231	112779	51.9	3.990	147	12.9	45.0	13.9	0.003	7080	7000	ma100617_rel.cz11apur1_c8r32
399	28142	0	0.0	23.7	1.0	0.000	0.000	0.059	2.440	112321	52.0	3.991	148	12.8	45.0	13.9	0.002	7032	6953	ma101107_rel.cz11apur1_c8r32
399	27960	8	0.0	11.5	0.6	0.000	0.001	0.029	1.567	111543	51.9	3.989	149	12.9	45.0	13.9	0.002	6987	6907	ma110401_rel.cz11bpur1_c8r32

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	33522	0	0.0	11977.1	334.2	0.000	0.000	6.005	171.613	160252	56.9	4.781	136	14.3	47.0	17.1	0.032	8311	8167	ma100244_rel.cz11apur1_c8r32
1994	32559	0	0.0	11955.6	333.7	0.000	0.000	5.995	171.312	157021	56.5	4.823	139	12.8	44.9	14.9	0.040	8135	7975	ma100339_rel.cz11apur1_c8r32
1994	31687	0	0.0	11962.3	333.8	0.000	0.000	5.998	171.402	154521	56.4	4.876	142	12.8	44.9	NA	0.038	7898	7752	ma100433_rel.cz11apur1_c8r32
1994	32803	0	0.0	18.6	2.1	0.000	0.000	0.009	1.054	124895	53.3	3.807	130	12.8	45.0	14.0	0.012	8218	8135	ma100524_rel.cz11apur1_c8r32
1994	32893	0	0.0	161.1	5.9	0.000	0.000	0.081	3.013	126160	53.4	3.836	130	12.9	45.0	13.9	0.016	8215	7986	ma100617_rel.cz11apur1_c8r32
1993	32371	57	0.2	162.1	5.9	0.002	0.007	0.081	3.047	124628	53.3	3.850	132	12.8	45.0	13.9	0.022	8087	7895	ma101107_rel.cz11apur1_c8r32
1994	32452	57	0.2	168.2	6.0	0.002	0.007	0.084	3.056	124845	53.3	3.847	131	12.9	45.0	13.9	0.016	8103	7817	ma110401_rel.cz11bpur1_c8r32

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1994	29242	0	0.0	12062.0	336.6	0.000	0.000	6.048	172.826	149452	56.6	5.111	155	14.3	47.0	17.1	0.024	7274	7176	ma100244_rel.cz11apur1_c8r32
1994	27932	0	0.0	12067.3	336.8	0.000	0.000	6.051	172.908	144540	56.5	5.175	162	12.8	44.9	14.9	0.032	6969	6873	ma100339_rel.cz11apur1_c8r32
1993	27243	0	0.0	12075.6	337.0	0.000	0.000	6.058	173.123	142493	56.5	5.230	166	12.8	44.9	NA	0.027	6809	6715	ma100433_rel.cz11apur1_c8r32
1994	28117	0	0.0	18.6	2.1	0.000	0.000	0.009	1.061	111640	53.1	3.971	151	12.8	45.0	14.0	0.012	7032	6969	ma100524_rel.cz11apur1_c8r32
1994	28038	0	0.0	165.2	6.0	0.000	0.000	0.083	3.055	112582	53.2	4.015	152	12.9	45.0	13.9	0.012	7017	6905	ma100617_rel.cz11apur1_c8r32
1994	27836	57	0.2	165.1	6.0	0.002	0.008	0.083	3.065	111952	53.1	4.022	153	12.8	45.0	13.9	0.008	6953	6841	ma101107_rel.cz11apur1_c8r32
1994	27740	56	0.2	170.7	6.0	0.002	0.008	0.086	3.083	111581	53.1	4.022	153	12.9	45.0	13.9	0.011	6936	6811	ma110401_rel.cz11bpur1_c8r32

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	32762	0	0.0	13960.8	391.1	0.000	0.000	3.500	100.405	161908	58.8	4.942	144	14.3	47.0	17.1	0.035	8151	7800	ma100244_rel.cz11apur1_c8r32
3987	31813	0	0.0	13983.9	391.8	0.000	0.000	3.508	100.637	158983	58.5	4.997	147	12.8	44.9	14.9	0.057	7912	7704	ma100339_rel.cz11apur1_c8r32
3989	30919	0	0.0	13779.8	386.1	0.000	0.000	3.455	99.118	156058	58.3	5.047	151	12.8	44.9	NA	0.040	7736	7544	ma100433_rel.cz11apur1_c8r32
3989	32448	0	0.0	36.5	4.2	0.000	0.000	0.009	1.073	123061	54.6	3.793	135	12.8	45.0	14.0	0.022	8135	7997	ma100524_rel.cz11apur1_c8r32
3987	32471	0	0.0	417.7	14.2	0.000	0.000	0.105	3.657	125657	54.8	3.870	135	12.9	45.0	14.0	0.032	8151	7962	ma100617_rel.cz11apur1_c8r32
3989	31977	147	0.6	429.1	14.6	0.005	0.018	0.108	3.754	124707	54.7	3.900	137	12.8	45.0	13.9	0.012	8007	7832	ma101107_rel.cz11apur1_c8r32
3987	31931	125	0.5	446.8	14.8	0.004	0.016	0.112	3.794	124722	54.6	3.906	137	12.9	45.0	13.9	0.031	8039	7816	ma110401_rel.cz11bpur1_c8r32

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3989	28626	0	0.0	14207.2	398.0	0.000	0.000	3.562	102.163	151989	58.8	5.309	164	14.3	47.0	17.1	0.034	7130	7000	ma100244_rel.cz11apur1_c8r32
3989	27463	0	0.0	14140.0	396.1	0.000	0.000	3.545	101.696	147459	58.6	5.369	171	12.8	44.9	15.0	0.022	6857	6722	ma100339_rel.cz11apur1_c8r32
3989	26799	0	0.0	14070.1	394.2	0.000	0.000	3.527	101.190	145589	58.6	5.433	175	12.8	44.9	NA	0.036	6683	6553	ma100433_rel.cz11apur1_c8r32
3989	28001	0	0.0	37.1	4.2	0.000	0.000	0.009	1.087	110768	54.7	3.956	156	12.8	45.0	14.0	0.018	6989	6905	ma100524_rel.cz11apur1_c8r32
3987	27770	0	0.0	355.4	12.5	0.000	0.000	0.089	3.210	112308	54.7	4.044	158	12.9	45.0	14.0	0.028	6953	6825	ma100617_rel.cz11apur1_c8r32
3989	27367	153	0.6	357.9	12.7	0.006	0.022	0.090	3.251	111758	54.8	4.084	160	12.8	45.0	13.9	0.016	6857	6745	ma101107_rel.cz11apur1_c8r32
3987	27384	149	0.6	358.5	12.5	0.005	0.022	0.090	3.203	111875	54.7	4.085	160	12.9	45.0	13.9	0.016	6841	6731	ma110401_rel.cz11bpur1_c8r32

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	97.470	2.196	0.307	0.011	0.016	0.000	0.000	0.000	0.000	0.153	ma100244_rel.cz11apur1_c8r32
0.000	94.629	5.017	0.321	0.017	0.016	0.000	0.000	0.000	0.000	0.136	ma100339_rel.cz11apur1_c8r32
0.000	95.271	4.370	0.328	0.014	0.016	0.000	0.000	0.000	0.000	0.131	ma100433_rel.cz11apur1_c8r32
0.000	91.725	7.660	0.484	0.100	0.031	0.000	0.000	0.000	0.000	0.126	ma100524_rel.cz11apur1_c8r32
0.000	92.357	7.297	0.311	0.017	0.018	0.000	0.000	0.000	0.000	0.181	ma100617_rel.cz11apur1_c8r32
0.000	89.152	10.508	0.305	0.018	0.017	0.000	0.000	0.000	0.000	0.182	ma101107_rel.cz11apur1_c8r32
0.000	89.670	9.994	0.308	0.012	0.017	0.000	0.000	0.000	0.000	0.229	ma110401_rel.cz11bpur1_c8r32

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.096	89.937	9.509	0.131	0.177	0.151	0.000	0.000	0.000	0.276	ma100244_rel.cz11apur1_c8r32
0.000	0.558	91.447	7.365	0.091	0.269	0.270	0.000	0.000	0.000	0.339	ma100339_rel.cz11apur1_c8r32
0.000	0.360	91.769	7.236	0.087	0.232	0.317	0.000	0.000	0.000	0.274	ma100433_rel.cz11apur1_c8r32
0.000	1.888	96.085	1.272	0.052	0.377	0.327	nonzero	0.000	0.000	1.037	ma100524_rel.cz11apur1_c8r32
0.000	6.274	91.505	1.494	0.066	0.087	0.574	0.000	0.000	0.000	0.361	ma100617_rel.cz11apur1_c8r32
0.000	6.033	91.772	1.527	0.057	0.057	0.554	0.000	0.000	0.000	0.323	ma101107_rel.cz11apur1_c8r32
0.000	14.169	82.965	1.953	0.252	0.077	0.584	0.000	0.000	0.000	0.390	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.374	85.650	9.527	0.122	0.192	0.136	0.000	0.000	0.000	0.267	ma100244_rel.cz11apur1_c8r32
0.000	16.743	75.292	7.339	0.086	0.320	0.220	0.000	0.000	0.000	0.271	ma100339_rel.cz11apur1_c8r32
0.000	17.109	75.067	7.191	0.084	0.291	0.259	0.000	0.000	0.000	0.274	ma100433_rel.cz11apur1_c8r32
0.000	28.163	69.870	1.220	0.043	0.552	0.152	0.000	0.000	0.000	0.424	ma100524_rel.cz11apur1_c8r32
0.000	39.149	58.708	1.425	0.058	0.114	0.546	0.000	0.000	0.000	0.294	ma100617_rel.cz11apur1_c8r32
0.000	34.696	63.206	1.440	0.048	0.068	0.542	0.000	0.000	0.000	0.322	ma101107_rel.cz11apur1_c8r32
0.000	42.335	54.953	1.827	0.226	0.087	0.572	0.000	0.000	0.000	0.372	ma110401_rel.cz11bpur1_c8r32

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
24.688	71.926	1.088	1.586	0.709	0.002	0.000	0.000	0.000	0.000	0.145	ma100244_rel.cz11apur1_c8r32
27.459	69.692	1.071	1.349	0.426	0.002	0.000	0.000	0.000	0.000	0.153	ma100339_rel.cz11apur1_c8r32
26.570	70.582	1.069	1.345	0.433	0.002	0.000	0.000	0.000	0.000	0.151	ma100433_rel.cz11apur1_c8r32
26.776	71.145	1.151	0.144	0.782	0.002	0.000	0.000	0.000	0.000	0.146	ma100524_rel.cz11apur1_c8r32
26.809	71.327	0.917	0.125	0.819	0.003	0.000	0.000	0.000	0.000	0.181	ma100617_rel.cz11apur1_c8r32
11.980	86.305	1.031	0.184	0.497	0.003	0.000	0.000	0.000	0.000	0.146	ma101107_rel.cz11apur1_c8r32
17.777	80.342	0.913	0.347	0.618	0.003	0.000	0.000	0.000	0.000	0.142	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
25.959	70.679	1.072	1.579	0.709	0.002	0.000	0.000	0.000	0.000	0.144	ma100244_rel.cz11apur1_c8r32
28.888	68.212	1.129	1.343	0.426	0.002	0.000	0.000	0.000	0.000	0.159	ma100339_rel.cz11apur1_c8r32
28.443	68.661	1.122	1.340	0.432	0.002	0.000	0.000	0.000	0.000	0.144	ma100433_rel.cz11apur1_c8r32
29.178	68.781	1.125	0.133	0.782	0.002	0.000	0.000	0.000	0.000	0.146	ma100524_rel.cz11apur1_c8r32
29.824	68.330	0.901	0.122	0.820	0.003	0.000	0.000	0.000	0.000	0.180	ma100617_rel.cz11apur1_c8r32
16.434	81.854	1.031	0.181	0.497	0.003	0.000	0.000	0.000	0.000	0.146	ma101107_rel.cz11apur1_c8r32
21.802	76.348	0.912	0.318	0.617	0.003	0.000	0.000	0.000	0.000	0.142	ma110401_rel.cz11bpur1_c8r32

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.977	0.021	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma100244_rel.cz11apur1_c8r32
99.975	0.023	0.002	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.021	ma100339_rel.cz11apur1_c8r32
99.970	0.029	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.021	ma100433_rel.cz11apur1_c8r32
99.992	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	ma100524_rel.cz11apur1_c8r32
99.992	0.008	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100617_rel.cz11apur1_c8r32
99.992	0.008	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	ma101107_rel.cz11apur1_c8r32
99.992	0.007	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	ma110401_rel.cz11bpur1_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.792	95.993	3.028	0.188	0.000	0.000	0.000	0.000	0.000	0.027	ma100244_rel.cz11apur1_c8r32
0.000	1.500	95.424	2.861	0.215	0.000	0.000	0.000	0.000	0.000	0.025	ma100339_rel.cz11apur1_c8r32
0.000	0.889	95.938	3.021	0.153	0.000	0.000	0.000	0.000	0.000	0.027	ma100433_rel.cz11apur1_c8r32
0.000	6.611	93.389	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	ma100524_rel.cz11apur1_c8r32
0.000	11.889	88.104	0.007	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma100617_rel.cz11apur1_c8r32
0.000	1.424	57.028	41.549	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11apur1_c8r32
0.000	1.146	52.660	46.194	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	46.118	50.958	2.792	0.132	0.000	0.000	0.000	0.000	0.000	0.036	ma100244_rel.cz11apur1_c8r32
0.000	77.382	19.979	2.500	0.139	0.000	0.000	0.000	0.000	0.000	0.026	ma100339_rel.cz11apur1_c8r32
0.000	82.611	14.722	2.604	0.062	0.000	0.000	0.000	0.000	0.000	0.024	ma100433_rel.cz11apur1_c8r32
0.000	80.292	19.708	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	ma100524_rel.cz11apur1_c8r32
0.000	50.847	49.146	0.007	0.000	0.000	0.000	0.000	0.000	0.000	0.005	ma100617_rel.cz11apur1_c8r32
0.000	13.514	44.944	41.542	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11apur1_c8r32
0.000	10.632	43.188	46.181	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma110401_rel.cz11bpur1_c8r32

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.983	0.017	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma100244_rel.cz11apur1_c8r32
99.969	0.030	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	ma100339_rel.cz11apur1_c8r32
99.958	0.041	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	ma100433_rel.cz11apur1_c8r32
99.959	0.041	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	ma100524_rel.cz11apur1_c8r32
99.942	0.057	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	ma100617_rel.cz11apur1_c8r32
99.939	0.061	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	ma101107_rel.cz11apur1_c8r32
99.937	0.061	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	ma110401_rel.cz11bpur1_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.201	96.493	3.153	0.153	0.000	0.000	0.000	0.000	0.000	0.032	ma100244_rel.cz11apur1_c8r32
0.000	0.472	96.278	3.014	0.236	0.000	0.000	0.000	0.000	0.000	0.036	ma100339_rel.cz11apur1_c8r32
0.000	0.069	96.826	2.972	0.132	0.000	0.000	0.000	0.000	0.000	0.035	ma100433_rel.cz11apur1_c8r32
0.000	3.590	96.403	0.007	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100524_rel.cz11apur1_c8r32
0.000	10.278	89.722	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100617_rel.cz11apur1_c8r32
0.000	11.361	87.250	1.389	0.000	0.000	0.000	0.000	0.000	0.000	0.013	ma101107_rel.cz11apur1_c8r32
0.000	0.521	54.153	45.326	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	38.396	58.861	2.576	0.167	0.000	0.000	0.000	0.000	0.000	0.028	ma100244_rel.cz11apur1_c8r32
0.000	76.160	21.188	2.535	0.118	0.000	0.000	0.000	0.000	0.000	0.028	ma100339_rel.cz11apur1_c8r32
0.000	69.035	28.264	2.604	0.097	0.000	0.000	0.000	0.000	0.000	0.028	ma100433_rel.cz11apur1_c8r32
0.000	69.750	30.250	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	ma100524_rel.cz11apur1_c8r32
0.000	56.556	43.444	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	ma100617_rel.cz11apur1_c8r32
0.000	68.299	30.250	1.451	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11apur1_c8r32
0.000	5.729	48.611	45.660	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma110401_rel.cz11bpur1_c8r32

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.914	0.076	0.009	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.032	ma100244_rel.cz11apur1_c8r32
99.900	0.087	0.011	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	ma100339_rel.cz11apur1_c8r32
99.880	0.108	0.010	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.038	ma100433_rel.cz11apur1_c8r32
99.969	0.025	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma100524_rel.cz11apur1_c8r32
99.965	0.027	0.008	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	ma100617_rel.cz11apur1_c8r32
99.954	0.036	0.010	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma101107_rel.cz11apur1_c8r32
99.950	0.038	0.013	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	ma110401_rel.cz11bpur1_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	5.388	84.338	9.679	0.596	0.000	0.000	0.000	0.000	0.000	0.051	ma100244_rel.cz11apur1_c8r32
0.000	7.282	82.371	9.804	0.543	0.000	0.000	0.000	0.000	0.000	0.052	ma100339_rel.cz11apur1_c8r32
0.000	6.335	83.237	9.860	0.568	0.000	0.000	0.000	0.000	0.000	0.053	ma100433_rel.cz11apur1_c8r32
0.000	17.243	80.996	1.749	0.013	0.000	0.000	0.000	0.000	0.000	0.037	ma100524_rel.cz11apur1_c8r32
0.000	15.611	81.768	2.606	0.015	0.000	0.000	0.000	0.000	0.000	0.038	ma100617_rel.cz11apur1_c8r32
0.000	7.587	86.171	6.229	0.013	0.000	0.000	0.000	0.000	0.000	0.028	ma101107_rel.cz11apur1_c8r32
0.000	2.461	87.375	10.143	0.021	0.000	0.000	0.000	0.000	0.000	0.062	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	63.847	27.525	8.153	0.475	0.000	0.000	0.000	0.000	0.000	0.057	ma100244_rel.cz11apur1_c8r32
0.000	77.990	13.433	8.165	0.411	0.000	0.000	0.000	0.000	0.000	0.048	ma100339_rel.cz11apur1_c8r32
0.000	76.271	15.024	8.279	0.426	0.000	0.000	0.000	0.000	0.000	0.049	ma100433_rel.cz11apur1_c8r32
0.000	81.997	16.724	1.268	0.011	0.000	0.000	0.000	0.000	0.000	0.037	ma100524_rel.cz11apur1_c8r32
0.000	52.210	45.807	1.969	0.014	0.000	0.000	0.000	0.000	0.000	0.036	ma100617_rel.cz11apur1_c8r32
0.000	38.828	55.560	5.603	0.010	0.000	0.000	0.000	0.000	0.000	0.027	ma101107_rel.cz11apur1_c8r32
0.000	17.339	73.460	9.188	0.014	0.000	0.000	0.000	0.000	0.000	0.032	ma110401_rel.cz11bpur1_c8r32

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.940	0.055	0.005	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	ma100244_rel.cz11apur1_c8r32
99.922	0.072	0.005	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.032	ma100339_rel.cz11apur1_c8r32
99.914	0.080	0.005	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	ma100433_rel.cz11apur1_c8r32
99.945	0.051	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma100524_rel.cz11apur1_c8r32
99.918	0.077	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma100617_rel.cz11apur1_c8r32
99.887	0.097	0.016	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	ma101107_rel.cz11apur1_c8r32
99.889	0.096	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	ma110401_rel.cz11bpur1_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.629	85.915	8.872	0.583	0.000	0.000	0.000	0.000	0.000	0.050	ma100244_rel.cz11apur1_c8r32
0.000	4.758	85.458	9.257	0.526	0.000	0.000	0.000	0.000	0.000	0.048	ma100339_rel.cz11apur1_c8r32
0.000	2.919	86.581	9.849	0.651	0.000	0.000	0.000	0.000	0.000	0.052	ma100433_rel.cz11apur1_c8r32
0.000	14.342	84.404	1.246	0.008	0.000	0.000	0.000	0.000	0.000	0.038	ma100524_rel.cz11apur1_c8r32
0.000	21.186	78.317	0.485	0.013	0.000	0.000	0.000	0.000	0.000	0.039	ma100617_rel.cz11apur1_c8r32
0.000	0.661	89.006	10.322	0.011	0.000	0.000	0.000	0.000	0.000	0.029	ma101107_rel.cz11apur1_c8r32
0.000	1.196	87.918	10.867	0.019	0.000	0.000	0.000	0.000	0.000	0.032	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	61.369	30.599	7.599	0.433	0.000	0.000	0.000	0.000	0.000	0.050	ma100244_rel.cz11apur1_c8r32
0.000	71.971	19.747	7.832	0.450	0.000	0.000	0.000	0.000	0.000	0.048	ma100339_rel.cz11apur1_c8r32
0.000	70.626	20.535	8.369	0.469	0.000	0.000	0.000	0.000	0.000	0.040	ma100433_rel.cz11apur1_c8r32
0.000	79.994	19.043	0.954	0.008	0.000	0.000	0.000	0.000	0.000	0.038	ma100524_rel.cz11apur1_c8r32
0.000	58.825	40.735	0.431	0.010	0.000	0.000	0.000	0.000	0.000	0.039	ma100617_rel.cz11apur1_c8r32
0.000	14.156	76.596	9.238	0.011	0.000	0.000	0.000	0.000	0.000	0.029	ma101107_rel.cz11apur1_c8r32
0.000	13.908	75.981	10.100	0.011	0.000	0.000	0.000	0.000	0.000	0.032	ma110401_rel.cz11bpur1_c8r32

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.824	0.146	0.026	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.035	ma100244_rel.cz11apur1_c8r32
99.798	0.172	0.026	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.057	ma100339_rel.cz11apur1_c8r32
99.735	0.232	0.030	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	ma100433_rel.cz11apur1_c8r32
99.921	0.062	0.015	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma100524_rel.cz11apur1_c8r32
99.902	0.081	0.016	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.032	ma100617_rel.cz11apur1_c8r32
99.931	0.057	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	ma101107_rel.cz11apur1_c8r32
99.942	0.050	0.008	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	ma110401_rel.cz11bpur1_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.222	83.299	11.897	0.583	0.000	0.000	0.000	0.000	0.000	0.050	ma100244_rel.cz11apur1_c8r32
0.000	5.960	82.247	11.298	0.494	0.000	0.000	0.000	0.000	0.000	0.059	ma100339_rel.cz11apur1_c8r32
0.000	6.621	82.251	10.733	0.395	0.000	0.000	0.000	0.000	0.000	0.041	ma100433_rel.cz11apur1_c8r32
0.000	10.369	85.096	4.460	0.075	0.000	0.000	0.000	0.000	0.000	0.052	ma100524_rel.cz11apur1_c8r32
0.000	18.758	78.447	2.767	0.029	0.000	0.000	0.000	0.000	0.000	0.044	ma100617_rel.cz11apur1_c8r32
0.000	18.163	78.803	3.026	0.008	0.000	0.000	0.000	0.000	0.000	0.033	ma101107_rel.cz11apur1_c8r32
0.000	32.204	65.633	2.131	0.032	0.000	0.000	0.000	0.000	0.000	0.032	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	58.361	31.448	9.727	0.464	0.000	0.000	0.000	0.000	0.000	0.044	ma100244_rel.cz11apur1_c8r32
0.000	72.666	17.879	9.056	0.399	0.000	0.000	0.000	0.000	0.000	0.052	ma100339_rel.cz11apur1_c8r32
0.000	75.708	15.339	8.696	0.258	0.000	0.000	0.000	0.000	0.000	0.043	ma100433_rel.cz11apur1_c8r32
0.000	69.351	27.028	3.551	0.070	0.000	0.000	0.000	0.000	0.000	0.042	ma100524_rel.cz11apur1_c8r32
0.000	61.049	36.519	2.406	0.027	0.000	0.000	0.000	0.000	0.000	0.042	ma100617_rel.cz11apur1_c8r32
0.000	64.862	32.660	2.473	0.006	0.000	0.000	0.000	0.000	0.000	0.032	ma101107_rel.cz11apur1_c8r32
0.000	70.389	27.787	1.808	0.016	0.000	0.000	0.000	0.000	0.000	0.032	ma110401_rel.cz11bpur1_c8r32

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.858	0.126	0.015	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.034	ma100244_rel.cz11apur1_c8r32
99.835	0.146	0.016	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	ma100339_rel.cz11apur1_c8r32
99.834	0.149	0.016	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	ma100433_rel.cz11apur1_c8r32
99.889	0.093	0.016	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	ma100524_rel.cz11apur1_c8r32
99.885	0.103	0.011	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	ma100617_rel.cz11apur1_c8r32
99.873	0.117	0.010	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	ma101107_rel.cz11apur1_c8r32
99.876	0.113	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.016	ma110401_rel.cz11bpur1_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	5.600	83.405	10.438	0.558	0.000	0.000	0.000	0.000	0.000	0.055	ma100244_rel.cz11apur1_c8r32
0.000	5.736	82.470	11.243	0.551	0.000	0.000	0.000	0.000	0.000	0.057	ma100339_rel.cz11apur1_c8r32
0.000	4.295	84.271	10.898	0.536	0.000	0.000	0.000	0.000	0.000	0.057	ma100433_rel.cz11apur1_c8r32
0.000	6.126	88.704	5.084	0.086	0.000	0.000	0.000	0.000	0.000	0.044	ma100524_rel.cz11apur1_c8r32
0.000	15.144	82.567	2.273	0.017	0.000	0.000	0.000	0.000	0.000	0.041	ma100617_rel.cz11apur1_c8r32
0.000	13.897	83.936	2.162	0.006	0.000	0.000	0.000	0.000	0.000	0.035	ma101107_rel.cz11apur1_c8r32
0.000	19.472	77.906	2.594	0.027	0.000	0.000	0.000	0.000	0.000	0.033	ma110401_rel.cz11bpur1_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	63.269	27.808	8.497	0.426	0.000	0.000	0.000	0.000	0.000	0.059	ma100244_rel.cz11apur1_c8r32
0.000	71.812	18.771	9.003	0.414	0.000	0.000	0.000	0.000	0.000	0.058	ma100339_rel.cz11apur1_c8r32
0.000	71.837	19.031	8.730	0.401	0.001	0.000	0.000	0.000	0.000	0.066	ma100433_rel.cz11apur1_c8r32
0.000	63.878	31.813	4.231	0.078	0.000	0.000	0.000	0.000	0.000	0.048	ma100524_rel.cz11apur1_c8r32
0.000	60.304	37.633	2.040	0.023	0.000	0.000	0.000	0.000	0.000	0.043	ma100617_rel.cz11apur1_c8r32
0.000	61.240	36.850	1.907	0.003	0.000	0.000	0.000	0.000	0.000	0.034	ma101107_rel.cz11apur1_c8r32
0.000	60.481	37.293	2.214	0.012	0.000	0.000	0.000	0.000	0.000	0.033	ma110401_rel.cz11bpur1_c8r32