Introduction

This is a report for the insert benchmark with 30M docs and 1 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 32G RAM and an NVMe SSD. It is described here as the PN53. The benchmark was run with 1 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 1 table. It loads 30M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40m+10m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached by InnoDB. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my5651_rel_o2nofp.cz12a_c8r32 1840491463423350123364131801118413204111121309111167
my5744_rel_o2nofp.cz12a_c8r32 1639342222233809525189109869415109269387109589351
my8043_rel_o2nofp.cz12a_c8r32 1107013658553469220121914469529124698091226942
my8406_rel_o2nofp.cz12a_c8r32 1107013703723451220040890668068908678988736824
my9400_rel_o2nofp.cz12a_c8r32 1098903703723463220325918569929178697391316975

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my5651_rel_o2nofp.cz12a_c8r32 1.001.001.001.001.001.001.001.001.001.00
my5744_rel_o2nofp.cz12a_c8r32 0.891.521.141.080.830.840.830.840.840.84
my8043_rel_o2nofp.cz12a_c8r32 0.602.501.040.860.690.620.690.630.700.62
my8406_rel_o2nofp.cz12a_c8r32 0.602.531.030.860.680.610.670.610.680.61
my9400_rel_o2nofp.cz12a_c8r32 0.602.531.030.870.700.630.700.630.700.62

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
my5651_rel_o2nofp.cz12a_c8r3210010050050010001000
my5744_rel_o2nofp.cz12a_c8r3210010050050010001000
my8043_rel_o2nofp.cz12a_c8r3210010050050010001000
my8406_rel_o2nofp.cz12a_c8r321001005005001000999
my9400_rel_o2nofp.cz12a_c8r321001005005001000999
target10010050050010001000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3299.7250.2190.0340.0210.0020.175
my5744_rel_o2nofp.cz12a_c8r3299.7020.1090.0610.1270.0010.165
my8043_rel_o2nofp.cz12a_c8r3299.4730.3350.0580.1320.0020.078
my8406_rel_o2nofp.cz12a_c8r3299.4700.3370.0600.1310.0020.093
my9400_rel_o2nofp.cz12a_c8r3299.4520.3550.0600.1310.0020.078

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
184049	0	1617	6.3	495.6	45.9	0.009	0.035	0.003	0.255	24185	20.3	0.131	9	2.0	32.5	3.5	0.175	185670	153878	my5651_rel_o2nofp.cz12a_c8r32
163934	0	0	0.0	503.2	42.4	0.000	0.000	0.003	0.265	19031	20.0	0.116	10	2.0	32.5	4.0	0.165	165267	137281	my5744_rel_o2nofp.cz12a_c8r32
110701	0	0	0.0	411.0	31.6	0.000	0.000	0.004	0.293	13713	17.1	0.124	12	2.0	32.6	4.3	0.078	111588	102981	my8043_rel_o2nofp.cz12a_c8r32
110701	0	0	0.0	406.0	31.4	0.000	0.000	0.004	0.291	13677	17.1	0.124	12	2.0	34.0	4.2	0.093	111079	101788	my8406_rel_o2nofp.cz12a_c8r32
109890	0	0	0.0	406.3	31.4	0.000	0.000	0.004	0.293	13688	17.2	0.125	13	2.0	34.0	4.3	0.078	110880	102081	my9400_rel_o2nofp.cz12a_c8r32

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
146342	0	27	0.1	2290.6	159.2	0.000	0.001	0.016	1.114	1579	10.4	0.011	6	4.2	34.7	5.2	0.001	NA	NA	my5651_rel_o2nofp.cz12a_c8r32
222223	0	0	0.0	3992.0	227.2	0.000	0.000	0.018	1.047	12129	11.9	0.055	4	4.6	35.1	5.5	0.001	NA	NA	my5744_rel_o2nofp.cz12a_c8r32
365855	0	1	0.0	11127.0	466.0	0.000	0.000	0.030	1.304	24775	40.1	0.068	9	4.5	35.1	5.0	0.002	NA	NA	my8043_rel_o2nofp.cz12a_c8r32
370372	0	1	0.0	11793.1	478.0	0.000	0.000	0.032	1.321	26220	39.7	0.071	9	4.5	36.5	5.1	0.002	NA	NA	my8406_rel_o2nofp.cz12a_c8r32
370372	0	1	0.0	11722.1	476.8	0.000	0.000	0.032	1.318	25827	39.7	0.070	9	4.5	36.5	5.1	0.001	NA	NA	my9400_rel_o2nofp.cz12a_c8r32

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3211.50286.5991.7270.1700.0020.081
my5744_rel_o2nofp.cz12a_c8r3213.39886.0070.5530.0400.0010.121
my8043_rel_o2nofp.cz12a_c8r3299.3650.5510.0820.001nonzero0.324
my8406_rel_o2nofp.cz12a_c8r3299.3690.5490.0820.001nonzero0.349
my9400_rel_o2nofp.cz12a_c8r3299.3470.5680.0830.001nonzero0.340

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3278.04620.8530.9680.1320.0010.075
my5744_rel_o2nofp.cz12a_c8r3267.44932.3800.1570.0120.0010.121
my8043_rel_o2nofp.cz12a_c8r3282.94616.8710.1650.0180.001nonzero0.342
my8406_rel_o2nofp.cz12a_c8r3281.79218.0400.1500.017nonzerononzero0.307
my9400_rel_o2nofp.cz12a_c8r3285.14814.6650.1680.0190.0010.113

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
33501	0	854	3.3	2497.8	108.9	0.026	0.102	0.075	3.328	34445	40.1	1.028	96	6.2	36.7	7.8	0.081	35545	9249	my5651_rel_o2nofp.cz12a_c8r32
38095	0	0	0.0	2892.9	125.6	0.000	0.000	0.076	3.377	24210	47.1	0.636	99	6.2	36.8	8.2	0.121	39695	10448	my5744_rel_o2nofp.cz12a_c8r32
34692	0	126	2.0	2790.0	115.9	0.004	0.058	0.080	3.420	43716	36.2	1.260	83	6.8	37.8	9.4	0.324	35896	5599	my8043_rel_o2nofp.cz12a_c8r32
34512	0	126	2.0	2673.7	112.8	0.004	0.058	0.077	3.348	43268	35.9	1.254	83	6.8	43.1	9.4	0.349	35846	5649	my8406_rel_o2nofp.cz12a_c8r32
34632	0	126	2.0	2750.7	114.9	0.004	0.058	0.079	3.396	43468	35.8	1.255	83	6.8	43.1	9.4	0.340	35846	5649	my9400_rel_o2nofp.cz12a_c8r32

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3288.93810.9380.0170.0970.009nonzero0.074
my5744_rel_o2nofp.cz12a_c8r3293.3626.5810.0450.011nonzerononzero0.114
my8043_rel_o2nofp.cz12a_c8r3281.66218.3070.0230.0070.001nonzero0.101
my8406_rel_o2nofp.cz12a_c8r3281.47518.4950.0230.0060.001nonzero0.101
my9400_rel_o2nofp.cz12a_c8r3281.88318.0870.0220.0080.001nonzero0.117

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3297.2982.5780.0170.0980.008nonzero0.074
my5744_rel_o2nofp.cz12a_c8r3294.2735.7010.0180.009nonzerononzero0.114
my8043_rel_o2nofp.cz12a_c8r3295.4014.5730.0180.0060.001nonzero0.102
my8406_rel_o2nofp.cz12a_c8r3294.8575.1190.0170.0060.001nonzero0.101
my9400_rel_o2nofp.cz12a_c8r3295.6934.2820.0180.007nonzerononzero0.119

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
23364	0	4148	16.2	1680.6	69.3	0.178	0.710	0.072	3.036	202942	43.7	8.686	150	6.2	36.7	7.8	0.074	23428	22108	my5651_rel_o2nofp.cz12a_c8r32
25189	0	0	0.0	1889.8	78.0	0.000	0.000	0.075	3.169	113442	41.9	4.504	133	6.2	36.8	8.3	0.114	25327	22698	my5744_rel_o2nofp.cz12a_c8r32
20121	0	0	0.0	1664.6	67.2	0.000	0.000	0.083	3.418	105937	34.5	5.265	137	6.8	37.8	9.4	0.101	20222	18813	my8043_rel_o2nofp.cz12a_c8r32
20040	0	0	0.0	1603.2	65.4	0.000	0.000	0.080	3.343	105007	34.5	5.240	138	6.8	45.0	9.4	0.101	20108	18882	my8406_rel_o2nofp.cz12a_c8r32
20325	0	0	0.0	1681.3	67.9	0.000	0.000	0.083	3.420	106731	34.7	5.251	137	6.8	45.0	9.4	0.117	20388	18623	my9400_rel_o2nofp.cz12a_c8r32

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3299.9630.0310.0020.005nonzero0.024
my5744_rel_o2nofp.cz12a_c8r3299.9860.013nonzerononzero0.010
my8043_rel_o2nofp.cz12a_c8r3299.9680.032nonzerononzero0.004
my8406_rel_o2nofp.cz12a_c8r3299.9680.032nonzero0.001
my9400_rel_o2nofp.cz12a_c8r3299.9660.034nonzerononzero0.008

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r320.33349.58344.6115.4440.0280.070
my5744_rel_o2nofp.cz12a_c8r324.30695.6110.0830.010
my8043_rel_o2nofp.cz12a_c8r3291.1118.8890.011
my8406_rel_o2nofp.cz12a_c8r3291.9728.0000.0280.050
my9400_rel_o2nofp.cz12a_c8r3280.25019.5000.2500.058

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r323.19445.97247.8612.9720.064
my5744_rel_o2nofp.cz12a_c8r3256.19443.7500.0560.010
my8043_rel_o2nofp.cz12a_c8r3232.11159.2228.6670.011
my8406_rel_o2nofp.cz12a_c8r3233.94458.1397.8890.0280.056
my9400_rel_o2nofp.cz12a_c8r3233.50046.72219.6940.0830.050

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	13180	4	0.0	736.4	20.3	0.000	0.001	7.371	207.710	75694	12.4	5.743	75	6.2	36.7	7.9	0.024	13198	12814	my5651_rel_o2nofp.cz12a_c8r32
100	10986	0	0.0	184.0	5.0	0.000	0.000	1.840	51.606	63071	13.2	5.741	96	6.2	36.8	8.3	0.010	10990	10846	my5744_rel_o2nofp.cz12a_c8r32
100	9144	0	0.0	173.1	4.8	0.000	0.000	1.732	49.011	52870	12.4	5.782	108	6.8	37.8	9.5	0.004	9151	9070	my8043_rel_o2nofp.cz12a_c8r32
100	8906	0	0.0	155.1	4.3	0.000	0.000	1.553	43.987	51512	13.2	5.784	119	6.8	45.0	9.4	0.001	8911	8798	my8406_rel_o2nofp.cz12a_c8r32
100	9185	0	0.0	195.2	5.4	0.000	0.000	1.952	55.221	53124	12.4	5.784	108	6.8	45.0	9.5	0.008	9183	9071	my9400_rel_o2nofp.cz12a_c8r32

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3299.9610.0340.0020.004nonzero0.020
my5744_rel_o2nofp.cz12a_c8r3299.9830.017nonzero0.002
my8043_rel_o2nofp.cz12a_c8r3299.9150.085nonzero0.001
my8406_rel_o2nofp.cz12a_c8r3299.9040.096nonzero0.001
my9400_rel_o2nofp.cz12a_c8r3299.9060.094nonzero0.001

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r320.05651.91744.3613.6670.061
my5744_rel_o2nofp.cz12a_c8r32100.0000.002
my8043_rel_o2nofp.cz12a_c8r3290.5009.5000.011
my8406_rel_o2nofp.cz12a_c8r3291.3338.6670.011
my9400_rel_o2nofp.cz12a_c8r3291.4448.5280.0280.022

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r320.88950.47247.1111.5280.053
my5744_rel_o2nofp.cz12a_c8r3244.47255.5280.002
my8043_rel_o2nofp.cz12a_c8r324.52886.0009.4720.011
my8406_rel_o2nofp.cz12a_c8r324.97286.4178.6110.011
my9400_rel_o2nofp.cz12a_c8r326.36185.1678.4440.0280.021

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	11184	4	0.0	728.9	20.1	0.000	0.001	7.289	205.506	64880	12.7	5.801	91	6.2	36.7	7.9	0.020	11183	10942	my5651_rel_o2nofp.cz12a_c8r32
100	9415	0	0.0	34.5	0.9	0.000	0.000	0.345	9.043	54615	12.5	5.801	106	6.2	36.8	8.3	0.002	9422	9311	my5744_rel_o2nofp.cz12a_c8r32
100	6952	0	0.0	48.3	1.3	0.000	0.000	0.483	13.714	40652	12.5	5.848	144	6.8	37.8	9.5	0.001	6943	6910	my8043_rel_o2nofp.cz12a_c8r32
100	6806	0	0.0	33.5	0.9	0.000	0.000	0.335	9.534	39804	12.9	5.848	152	6.8	45.0	9.4	0.001	6815	6735	my8406_rel_o2nofp.cz12a_c8r32
100	6992	0	0.0	39.2	1.1	0.000	0.000	0.392	10.818	40865	12.4	5.845	142	6.8	45.1	9.5	0.001	6991	6927	my9400_rel_o2nofp.cz12a_c8r32

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3299.9680.0280.0010.002nonzero0.023
my5744_rel_o2nofp.cz12a_c8r3299.9830.017nonzero0.003
my8043_rel_o2nofp.cz12a_c8r3299.9620.038nonzero0.003
my8406_rel_o2nofp.cz12a_c8r3299.9590.041nonzero0.002
my9400_rel_o2nofp.cz12a_c8r3299.9650.035nonzero0.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3213.27276.5289.9220.2780.059
my5744_rel_o2nofp.cz12a_c8r3216.78983.2110.002
my8043_rel_o2nofp.cz12a_c8r3298.1221.8720.0060.020
my8406_rel_o2nofp.cz12a_c8r3298.1331.8610.0060.021
my9400_rel_o2nofp.cz12a_c8r3299.9940.0060.011

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3222.85666.9399.9780.2280.046
my5744_rel_o2nofp.cz12a_c8r3288.97211.0280.002
my8043_rel_o2nofp.cz12a_c8r3274.12224.0001.8720.0060.020
my8406_rel_o2nofp.cz12a_c8r3274.56123.5781.8610.011
my9400_rel_o2nofp.cz12a_c8r3284.66115.3330.0060.011

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
500	13204	16	0.1	401.6	11.5	0.001	0.005	0.804	23.562	76089	13.2	5.762	80	6.2	36.7	7.9	0.023	13230	12895	my5651_rel_o2nofp.cz12a_c8r32
500	10926	0	0.0	83.6	2.6	0.000	0.000	0.167	5.296	62889	13.3	5.756	97	6.2	36.8	8.3	0.003	10927	10798	my5744_rel_o2nofp.cz12a_c8r32
500	9124	0	0.0	69.2	2.2	0.000	0.000	0.138	4.565	52995	12.7	5.808	111	6.8	37.8	9.5	0.003	9119	9039	my8043_rel_o2nofp.cz12a_c8r32
500	8908	0	0.0	67.9	2.2	0.000	0.000	0.136	4.501	51760	13.2	5.810	119	6.8	45.1	9.4	0.002	8910	8814	my8406_rel_o2nofp.cz12a_c8r32
500	9178	0	0.0	74.2	2.4	0.000	0.000	0.149	4.914	53336	12.7	5.811	111	6.8	45.1	9.5	0.002	9183	9086	my9400_rel_o2nofp.cz12a_c8r32

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3299.9540.0430.0010.0020.010
my5744_rel_o2nofp.cz12a_c8r3299.9780.022nonzero0.002
my8043_rel_o2nofp.cz12a_c8r3299.8890.111nonzero0.002
my8406_rel_o2nofp.cz12a_c8r3299.8710.128nonzero0.002
my9400_rel_o2nofp.cz12a_c8r3299.8900.110nonzero0.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3213.57877.2229.1280.0720.017
my5744_rel_o2nofp.cz12a_c8r3211.57288.4170.0110.010
my8043_rel_o2nofp.cz12a_c8r3298.0671.9330.011
my8406_rel_o2nofp.cz12a_c8r3298.1281.8720.011
my9400_rel_o2nofp.cz12a_c8r3298.1111.8830.0060.020

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3222.18968.5789.2110.0220.017
my5744_rel_o2nofp.cz12a_c8r3287.61712.3780.0060.010
my8043_rel_o2nofp.cz12a_c8r3249.06749.0061.9280.011
my8406_rel_o2nofp.cz12a_c8r3251.71746.4111.8720.011
my9400_rel_o2nofp.cz12a_c8r3253.51744.6001.8780.0060.020

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
500	11112	16	0.1	7.1	0.6	0.001	0.006	0.014	1.176	64712	12.5	5.824	90	6.2	36.7	7.9	0.010	11118	10958	my5651_rel_o2nofp.cz12a_c8r32
500	9387	0	0.0	30.2	1.1	0.000	0.000	0.060	2.286	54557	12.6	5.812	107	6.2	36.8	8.3	0.002	9375	9279	my5744_rel_o2nofp.cz12a_c8r32
500	6980	0	0.0	39.3	1.4	0.000	0.000	0.079	2.948	41152	12.5	5.896	143	6.8	37.8	9.5	0.002	6975	6927	my8043_rel_o2nofp.cz12a_c8r32
500	6789	0	0.0	36.1	1.3	0.000	0.000	0.072	2.747	40054	13.0	5.900	153	6.8	45.2	9.4	0.002	6783	6719	my8406_rel_o2nofp.cz12a_c8r32
500	6973	0	0.0	33.9	1.3	0.000	0.000	0.068	2.646	41112	12.6	5.896	145	6.8	45.2	9.5	0.002	6975	6911	my9400_rel_o2nofp.cz12a_c8r32

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3299.9600.0350.0020.003nonzero0.019
my5744_rel_o2nofp.cz12a_c8r3299.9790.021nonzerononzero0.007
my8043_rel_o2nofp.cz12a_c8r3299.9570.043nonzero0.002
my8406_rel_o2nofp.cz12a_c8r3299.9540.046nonzero0.002
my9400_rel_o2nofp.cz12a_c8r3299.9570.043nonzero0.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3216.35076.6066.7750.2690.047
my5744_rel_o2nofp.cz12a_c8r3231.66968.3310.003
my8043_rel_o2nofp.cz12a_c8r3299.0810.9170.0030.020
my8406_rel_o2nofp.cz12a_c8r3299.9860.0110.0030.041
my9400_rel_o2nofp.cz12a_c8r3299.1390.8560.0060.045

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3229.59763.5976.6000.2060.042
my5744_rel_o2nofp.cz12a_c8r3293.4066.5940.002
my8043_rel_o2nofp.cz12a_c8r3284.67214.4110.9140.0030.020
my8406_rel_o2nofp.cz12a_c8r3274.10025.8940.0030.0030.034
my9400_rel_o2nofp.cz12a_c8r3285.28313.8580.8560.0030.051

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1000	13091	32	0.1	622.0	18.0	0.002	0.010	0.622	18.466	75852	13.5	5.794	83	6.2	36.7	7.9	0.019	13102	12526	my5651_rel_o2nofp.cz12a_c8r32
1000	10958	0	0.0	97.1	3.4	0.000	0.000	0.097	3.494	63244	14.2	5.772	104	6.2	36.8	8.3	0.007	10958	10846	my5744_rel_o2nofp.cz12a_c8r32
1000	9122	0	0.0	96.2	3.5	0.000	0.000	0.096	3.541	53472	13.4	5.862	118	6.8	37.8	9.5	0.002	9119	9039	my8043_rel_o2nofp.cz12a_c8r32
1000	8873	0	0.0	99.5	3.6	0.000	0.000	0.100	3.649	52083	13.9	5.870	125	6.8	45.4	9.4	0.002	8863	8783	my8406_rel_o2nofp.cz12a_c8r32
1000	9131	0	0.0	99.8	3.6	0.000	0.000	0.100	3.643	53524	13.4	5.862	117	6.8	45.4	9.5	0.002	9134	9038	my9400_rel_o2nofp.cz12a_c8r32

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3299.9400.0570.0010.0020.010
my5744_rel_o2nofp.cz12a_c8r3299.9720.028nonzero0.002
my8043_rel_o2nofp.cz12a_c8r3299.8780.122nonzero0.002
my8406_rel_o2nofp.cz12a_c8r3299.8570.143nonzero0.002
my9400_rel_o2nofp.cz12a_c8r3299.8710.129nonzero0.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3218.35076.9144.7080.0280.018
my5744_rel_o2nofp.cz12a_c8r3225.84474.1470.0080.011
my8043_rel_o2nofp.cz12a_c8r3299.0440.9530.0030.021
my8406_rel_o2nofp.cz12a_c8r3299.9920.0060.0030.043
my9400_rel_o2nofp.cz12a_c8r3299.0920.9030.0060.048

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c8r3233.24262.0364.7060.0170.017
my5744_rel_o2nofp.cz12a_c8r3292.5197.4750.0060.010
my8043_rel_o2nofp.cz12a_c8r3270.83928.2060.9530.0030.020
my8406_rel_o2nofp.cz12a_c8r3269.61430.3810.0030.0030.049
my9400_rel_o2nofp.cz12a_c8r3272.18326.9580.8530.0060.055

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1000	11167	31	0.1	17.8	1.3	0.003	0.011	0.018	1.326	65396	13.6	5.856	97	6.2	36.7	7.8	0.010	11166	11022	my5651_rel_o2nofp.cz12a_c8r32
1000	9351	0	0.0	70.5	2.7	0.000	0.000	0.070	2.738	54575	13.4	5.836	115	6.2	36.8	8.3	0.002	9343	9247	my5744_rel_o2nofp.cz12a_c8r32
1000	6942	0	0.0	89.8	3.3	0.000	0.000	0.090	3.367	41426	13.2	5.967	152	6.8	37.8	9.5	0.002	6943	6895	my8043_rel_o2nofp.cz12a_c8r32
999	6824	0	0.0	88.8	3.3	0.000	0.000	0.089	3.342	40785	13.5	5.977	158	6.8	45.6	9.4	0.002	6831	6751	my8406_rel_o2nofp.cz12a_c8r32
999	6975	0	0.0	93.6	3.4	0.000	0.000	0.094	3.484	41647	13.4	5.971	154	6.8	45.6	9.5	0.002	6975	6927	my9400_rel_o2nofp.cz12a_c8r32

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
184049	0	1617	6.3	495.6	45.9	0.009	0.035	0.003	0.255	24185	20.3	0.131	9	2.0	32.5	3.5	0.175	185670	153878	my5651_rel_o2nofp.cz12a_c8r32
163934	0	0	0.0	503.2	42.4	0.000	0.000	0.003	0.265	19031	20.0	0.116	10	2.0	32.5	4.0	0.165	165267	137281	my5744_rel_o2nofp.cz12a_c8r32
110701	0	0	0.0	411.0	31.6	0.000	0.000	0.004	0.293	13713	17.1	0.124	12	2.0	32.6	4.3	0.078	111588	102981	my8043_rel_o2nofp.cz12a_c8r32
110701	0	0	0.0	406.0	31.4	0.000	0.000	0.004	0.291	13677	17.1	0.124	12	2.0	34.0	4.2	0.093	111079	101788	my8406_rel_o2nofp.cz12a_c8r32
109890	0	0	0.0	406.3	31.4	0.000	0.000	0.004	0.293	13688	17.2	0.125	13	2.0	34.0	4.3	0.078	110880	102081	my9400_rel_o2nofp.cz12a_c8r32

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
146342	0	27	0.1	2290.6	159.2	0.000	0.001	0.016	1.114	1579	10.4	0.011	6	4.2	34.7	5.2	0.001	NA	NA	my5651_rel_o2nofp.cz12a_c8r32
222223	0	0	0.0	3992.0	227.2	0.000	0.000	0.018	1.047	12129	11.9	0.055	4	4.6	35.1	5.5	0.001	NA	NA	my5744_rel_o2nofp.cz12a_c8r32
365855	0	1	0.0	11127.0	466.0	0.000	0.000	0.030	1.304	24775	40.1	0.068	9	4.5	35.1	5.0	0.002	NA	NA	my8043_rel_o2nofp.cz12a_c8r32
370372	0	1	0.0	11793.1	478.0	0.000	0.000	0.032	1.321	26220	39.7	0.071	9	4.5	36.5	5.1	0.002	NA	NA	my8406_rel_o2nofp.cz12a_c8r32
370372	0	1	0.0	11722.1	476.8	0.000	0.000	0.032	1.318	25827	39.7	0.070	9	4.5	36.5	5.1	0.001	NA	NA	my9400_rel_o2nofp.cz12a_c8r32

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
33501	0	854	3.3	2497.8	108.9	0.026	0.102	0.075	3.328	34445	40.1	1.028	96	6.2	36.7	7.8	0.081	35545	9249	my5651_rel_o2nofp.cz12a_c8r32
38095	0	0	0.0	2892.9	125.6	0.000	0.000	0.076	3.377	24210	47.1	0.636	99	6.2	36.8	8.2	0.121	39695	10448	my5744_rel_o2nofp.cz12a_c8r32
34692	0	126	2.0	2790.0	115.9	0.004	0.058	0.080	3.420	43716	36.2	1.260	83	6.8	37.8	9.4	0.324	35896	5599	my8043_rel_o2nofp.cz12a_c8r32
34512	0	126	2.0	2673.7	112.8	0.004	0.058	0.077	3.348	43268	35.9	1.254	83	6.8	43.1	9.4	0.349	35846	5649	my8406_rel_o2nofp.cz12a_c8r32
34632	0	126	2.0	2750.7	114.9	0.004	0.058	0.079	3.396	43468	35.8	1.255	83	6.8	43.1	9.4	0.340	35846	5649	my9400_rel_o2nofp.cz12a_c8r32

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
23364	0	4148	16.2	1680.6	69.3	0.178	0.710	0.072	3.036	202942	43.7	8.686	150	6.2	36.7	7.8	0.074	23428	22108	my5651_rel_o2nofp.cz12a_c8r32
25189	0	0	0.0	1889.8	78.0	0.000	0.000	0.075	3.169	113442	41.9	4.504	133	6.2	36.8	8.3	0.114	25327	22698	my5744_rel_o2nofp.cz12a_c8r32
20121	0	0	0.0	1664.6	67.2	0.000	0.000	0.083	3.418	105937	34.5	5.265	137	6.8	37.8	9.4	0.101	20222	18813	my8043_rel_o2nofp.cz12a_c8r32
20040	0	0	0.0	1603.2	65.4	0.000	0.000	0.080	3.343	105007	34.5	5.240	138	6.8	45.0	9.4	0.101	20108	18882	my8406_rel_o2nofp.cz12a_c8r32
20325	0	0	0.0	1681.3	67.9	0.000	0.000	0.083	3.420	106731	34.7	5.251	137	6.8	45.0	9.4	0.117	20388	18623	my9400_rel_o2nofp.cz12a_c8r32

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	13180	4	0.0	736.4	20.3	0.000	0.001	7.371	207.710	75694	12.4	5.743	75	6.2	36.7	7.9	0.024	13198	12814	my5651_rel_o2nofp.cz12a_c8r32
100	10986	0	0.0	184.0	5.0	0.000	0.000	1.840	51.606	63071	13.2	5.741	96	6.2	36.8	8.3	0.010	10990	10846	my5744_rel_o2nofp.cz12a_c8r32
100	9144	0	0.0	173.1	4.8	0.000	0.000	1.732	49.011	52870	12.4	5.782	108	6.8	37.8	9.5	0.004	9151	9070	my8043_rel_o2nofp.cz12a_c8r32
100	8906	0	0.0	155.1	4.3	0.000	0.000	1.553	43.987	51512	13.2	5.784	119	6.8	45.0	9.4	0.001	8911	8798	my8406_rel_o2nofp.cz12a_c8r32
100	9185	0	0.0	195.2	5.4	0.000	0.000	1.952	55.221	53124	12.4	5.784	108	6.8	45.0	9.5	0.008	9183	9071	my9400_rel_o2nofp.cz12a_c8r32

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	11184	4	0.0	728.9	20.1	0.000	0.001	7.289	205.506	64880	12.7	5.801	91	6.2	36.7	7.9	0.020	11183	10942	my5651_rel_o2nofp.cz12a_c8r32
100	9415	0	0.0	34.5	0.9	0.000	0.000	0.345	9.043	54615	12.5	5.801	106	6.2	36.8	8.3	0.002	9422	9311	my5744_rel_o2nofp.cz12a_c8r32
100	6952	0	0.0	48.3	1.3	0.000	0.000	0.483	13.714	40652	12.5	5.848	144	6.8	37.8	9.5	0.001	6943	6910	my8043_rel_o2nofp.cz12a_c8r32
100	6806	0	0.0	33.5	0.9	0.000	0.000	0.335	9.534	39804	12.9	5.848	152	6.8	45.0	9.4	0.001	6815	6735	my8406_rel_o2nofp.cz12a_c8r32
100	6992	0	0.0	39.2	1.1	0.000	0.000	0.392	10.818	40865	12.4	5.845	142	6.8	45.1	9.5	0.001	6991	6927	my9400_rel_o2nofp.cz12a_c8r32

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
500	13204	16	0.1	401.6	11.5	0.001	0.005	0.804	23.562	76089	13.2	5.762	80	6.2	36.7	7.9	0.023	13230	12895	my5651_rel_o2nofp.cz12a_c8r32
500	10926	0	0.0	83.6	2.6	0.000	0.000	0.167	5.296	62889	13.3	5.756	97	6.2	36.8	8.3	0.003	10927	10798	my5744_rel_o2nofp.cz12a_c8r32
500	9124	0	0.0	69.2	2.2	0.000	0.000	0.138	4.565	52995	12.7	5.808	111	6.8	37.8	9.5	0.003	9119	9039	my8043_rel_o2nofp.cz12a_c8r32
500	8908	0	0.0	67.9	2.2	0.000	0.000	0.136	4.501	51760	13.2	5.810	119	6.8	45.1	9.4	0.002	8910	8814	my8406_rel_o2nofp.cz12a_c8r32
500	9178	0	0.0	74.2	2.4	0.000	0.000	0.149	4.914	53336	12.7	5.811	111	6.8	45.1	9.5	0.002	9183	9086	my9400_rel_o2nofp.cz12a_c8r32

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
500	11112	16	0.1	7.1	0.6	0.001	0.006	0.014	1.176	64712	12.5	5.824	90	6.2	36.7	7.9	0.010	11118	10958	my5651_rel_o2nofp.cz12a_c8r32
500	9387	0	0.0	30.2	1.1	0.000	0.000	0.060	2.286	54557	12.6	5.812	107	6.2	36.8	8.3	0.002	9375	9279	my5744_rel_o2nofp.cz12a_c8r32
500	6980	0	0.0	39.3	1.4	0.000	0.000	0.079	2.948	41152	12.5	5.896	143	6.8	37.8	9.5	0.002	6975	6927	my8043_rel_o2nofp.cz12a_c8r32
500	6789	0	0.0	36.1	1.3	0.000	0.000	0.072	2.747	40054	13.0	5.900	153	6.8	45.2	9.4	0.002	6783	6719	my8406_rel_o2nofp.cz12a_c8r32
500	6973	0	0.0	33.9	1.3	0.000	0.000	0.068	2.646	41112	12.6	5.896	145	6.8	45.2	9.5	0.002	6975	6911	my9400_rel_o2nofp.cz12a_c8r32

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1000	13091	32	0.1	622.0	18.0	0.002	0.010	0.622	18.466	75852	13.5	5.794	83	6.2	36.7	7.9	0.019	13102	12526	my5651_rel_o2nofp.cz12a_c8r32
1000	10958	0	0.0	97.1	3.4	0.000	0.000	0.097	3.494	63244	14.2	5.772	104	6.2	36.8	8.3	0.007	10958	10846	my5744_rel_o2nofp.cz12a_c8r32
1000	9122	0	0.0	96.2	3.5	0.000	0.000	0.096	3.541	53472	13.4	5.862	118	6.8	37.8	9.5	0.002	9119	9039	my8043_rel_o2nofp.cz12a_c8r32
1000	8873	0	0.0	99.5	3.6	0.000	0.000	0.100	3.649	52083	13.9	5.870	125	6.8	45.4	9.4	0.002	8863	8783	my8406_rel_o2nofp.cz12a_c8r32
1000	9131	0	0.0	99.8	3.6	0.000	0.000	0.100	3.643	53524	13.4	5.862	117	6.8	45.4	9.5	0.002	9134	9038	my9400_rel_o2nofp.cz12a_c8r32

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1000	11167	31	0.1	17.8	1.3	0.003	0.011	0.018	1.326	65396	13.6	5.856	97	6.2	36.7	7.8	0.010	11166	11022	my5651_rel_o2nofp.cz12a_c8r32
1000	9351	0	0.0	70.5	2.7	0.000	0.000	0.070	2.738	54575	13.4	5.836	115	6.2	36.8	8.3	0.002	9343	9247	my5744_rel_o2nofp.cz12a_c8r32
1000	6942	0	0.0	89.8	3.3	0.000	0.000	0.090	3.367	41426	13.2	5.967	152	6.8	37.8	9.5	0.002	6943	6895	my8043_rel_o2nofp.cz12a_c8r32
999	6824	0	0.0	88.8	3.3	0.000	0.000	0.089	3.342	40785	13.5	5.977	158	6.8	45.6	9.4	0.002	6831	6751	my8406_rel_o2nofp.cz12a_c8r32
999	6975	0	0.0	93.6	3.4	0.000	0.000	0.094	3.484	41647	13.4	5.971	154	6.8	45.6	9.5	0.002	6975	6927	my9400_rel_o2nofp.cz12a_c8r32

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	99.725	0.219	0.034	0.021	0.002	0.000	0.000	0.000	0.000	0.175	my5651_rel_o2nofp.cz12a_c8r32
0.000	99.702	0.109	0.061	0.127	0.001	0.000	0.000	0.000	0.000	0.165	my5744_rel_o2nofp.cz12a_c8r32
0.000	99.473	0.335	0.058	0.132	0.002	0.000	0.000	0.000	0.000	0.078	my8043_rel_o2nofp.cz12a_c8r32
0.000	99.470	0.337	0.060	0.131	0.002	0.000	0.000	0.000	0.000	0.093	my8406_rel_o2nofp.cz12a_c8r32
0.000	99.452	0.355	0.060	0.131	0.002	0.000	0.000	0.000	0.000	0.078	my9400_rel_o2nofp.cz12a_c8r32

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	11.502	86.599	1.727	0.170	0.002	0.000	0.000	0.000	0.000	0.081	my5651_rel_o2nofp.cz12a_c8r32
0.000	13.398	86.007	0.553	0.040	0.001	0.000	0.000	0.000	0.000	0.121	my5744_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.365	0.551	0.082	0.001	nonzero	0.000	0.000	0.000	0.324	my8043_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.369	0.549	0.082	0.001	nonzero	0.000	0.000	0.000	0.349	my8406_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.347	0.568	0.083	0.001	nonzero	0.000	0.000	0.000	0.340	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	78.046	20.853	0.968	0.132	0.001	0.000	0.000	0.000	0.000	0.075	my5651_rel_o2nofp.cz12a_c8r32
0.000	67.449	32.380	0.157	0.012	0.001	0.000	0.000	0.000	0.000	0.121	my5744_rel_o2nofp.cz12a_c8r32
0.000	82.946	16.871	0.165	0.018	0.001	nonzero	0.000	0.000	0.000	0.342	my8043_rel_o2nofp.cz12a_c8r32
0.000	81.792	18.040	0.150	0.017	nonzero	nonzero	0.000	0.000	0.000	0.307	my8406_rel_o2nofp.cz12a_c8r32
0.000	85.148	14.665	0.168	0.019	0.001	0.000	0.000	0.000	0.000	0.113	my9400_rel_o2nofp.cz12a_c8r32

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
88.938	10.938	0.017	0.097	0.009	nonzero	0.000	0.000	0.000	0.000	0.074	my5651_rel_o2nofp.cz12a_c8r32
93.362	6.581	0.045	0.011	nonzero	nonzero	0.000	0.000	0.000	0.000	0.114	my5744_rel_o2nofp.cz12a_c8r32
81.662	18.307	0.023	0.007	0.001	nonzero	0.000	0.000	0.000	0.000	0.101	my8043_rel_o2nofp.cz12a_c8r32
81.475	18.495	0.023	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.101	my8406_rel_o2nofp.cz12a_c8r32
81.883	18.087	0.022	0.008	0.001	nonzero	0.000	0.000	0.000	0.000	0.117	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
97.298	2.578	0.017	0.098	0.008	nonzero	0.000	0.000	0.000	0.000	0.074	my5651_rel_o2nofp.cz12a_c8r32
94.273	5.701	0.018	0.009	nonzero	nonzero	0.000	0.000	0.000	0.000	0.114	my5744_rel_o2nofp.cz12a_c8r32
95.401	4.573	0.018	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.102	my8043_rel_o2nofp.cz12a_c8r32
94.857	5.119	0.017	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.101	my8406_rel_o2nofp.cz12a_c8r32
95.693	4.282	0.018	0.007	nonzero	nonzero	0.000	0.000	0.000	0.000	0.119	my9400_rel_o2nofp.cz12a_c8r32

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.963	0.031	0.002	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	my5651_rel_o2nofp.cz12a_c8r32
99.986	0.013	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5744_rel_o2nofp.cz12a_c8r32
99.968	0.032	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8043_rel_o2nofp.cz12a_c8r32
99.968	0.032	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.001	my8406_rel_o2nofp.cz12a_c8r32
99.966	0.034	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my9400_rel_o2nofp.cz12a_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.333	49.583	44.611	5.444	0.028	0.000	0.000	0.000	0.000	0.070	my5651_rel_o2nofp.cz12a_c8r32
0.000	4.306	95.611	0.083	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5744_rel_o2nofp.cz12a_c8r32
0.000	0.000	91.111	8.889	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8043_rel_o2nofp.cz12a_c8r32
0.000	0.000	91.972	8.000	0.028	0.000	0.000	0.000	0.000	0.000	0.050	my8406_rel_o2nofp.cz12a_c8r32
0.000	0.000	80.250	19.500	0.250	0.000	0.000	0.000	0.000	0.000	0.058	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	3.194	45.972	47.861	2.972	0.000	0.000	0.000	0.000	0.000	0.064	my5651_rel_o2nofp.cz12a_c8r32
0.000	56.194	43.750	0.056	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5744_rel_o2nofp.cz12a_c8r32
0.000	32.111	59.222	8.667	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8043_rel_o2nofp.cz12a_c8r32
0.000	33.944	58.139	7.889	0.028	0.000	0.000	0.000	0.000	0.000	0.056	my8406_rel_o2nofp.cz12a_c8r32
0.000	33.500	46.722	19.694	0.083	0.000	0.000	0.000	0.000	0.000	0.050	my9400_rel_o2nofp.cz12a_c8r32

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.961	0.034	0.002	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	my5651_rel_o2nofp.cz12a_c8r32
99.983	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
99.915	0.085	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.001	my8043_rel_o2nofp.cz12a_c8r32
99.904	0.096	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.001	my8406_rel_o2nofp.cz12a_c8r32
99.906	0.094	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.001	my9400_rel_o2nofp.cz12a_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.056	51.917	44.361	3.667	0.000	0.000	0.000	0.000	0.000	0.061	my5651_rel_o2nofp.cz12a_c8r32
0.000	0.000	100.000	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
0.000	0.000	90.500	9.500	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8043_rel_o2nofp.cz12a_c8r32
0.000	0.000	91.333	8.667	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8406_rel_o2nofp.cz12a_c8r32
0.000	0.000	91.444	8.528	0.028	0.000	0.000	0.000	0.000	0.000	0.022	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.889	50.472	47.111	1.528	0.000	0.000	0.000	0.000	0.000	0.053	my5651_rel_o2nofp.cz12a_c8r32
0.000	44.472	55.528	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
0.000	4.528	86.000	9.472	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8043_rel_o2nofp.cz12a_c8r32
0.000	4.972	86.417	8.611	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8406_rel_o2nofp.cz12a_c8r32
0.000	6.361	85.167	8.444	0.028	0.000	0.000	0.000	0.000	0.000	0.021	my9400_rel_o2nofp.cz12a_c8r32

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.968	0.028	0.001	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.023	my5651_rel_o2nofp.cz12a_c8r32
99.983	0.017	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my5744_rel_o2nofp.cz12a_c8r32
99.962	0.038	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8043_rel_o2nofp.cz12a_c8r32
99.959	0.041	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8406_rel_o2nofp.cz12a_c8r32
99.965	0.035	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my9400_rel_o2nofp.cz12a_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	13.272	76.528	9.922	0.278	0.000	0.000	0.000	0.000	0.000	0.059	my5651_rel_o2nofp.cz12a_c8r32
0.000	16.789	83.211	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
0.000	0.000	98.122	1.872	0.006	0.000	0.000	0.000	0.000	0.000	0.020	my8043_rel_o2nofp.cz12a_c8r32
0.000	0.000	98.133	1.861	0.006	0.000	0.000	0.000	0.000	0.000	0.021	my8406_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.994	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	22.856	66.939	9.978	0.228	0.000	0.000	0.000	0.000	0.000	0.046	my5651_rel_o2nofp.cz12a_c8r32
0.000	88.972	11.028	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
0.000	74.122	24.000	1.872	0.006	0.000	0.000	0.000	0.000	0.000	0.020	my8043_rel_o2nofp.cz12a_c8r32
0.000	74.561	23.578	1.861	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8406_rel_o2nofp.cz12a_c8r32
0.000	84.661	15.333	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my9400_rel_o2nofp.cz12a_c8r32

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.954	0.043	0.001	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5651_rel_o2nofp.cz12a_c8r32
99.978	0.022	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
99.889	0.111	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8043_rel_o2nofp.cz12a_c8r32
99.871	0.128	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8406_rel_o2nofp.cz12a_c8r32
99.890	0.110	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my9400_rel_o2nofp.cz12a_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	13.578	77.222	9.128	0.072	0.000	0.000	0.000	0.000	0.000	0.017	my5651_rel_o2nofp.cz12a_c8r32
0.000	11.572	88.417	0.011	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5744_rel_o2nofp.cz12a_c8r32
0.000	0.000	98.067	1.933	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8043_rel_o2nofp.cz12a_c8r32
0.000	0.000	98.128	1.872	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8406_rel_o2nofp.cz12a_c8r32
0.000	0.000	98.111	1.883	0.006	0.000	0.000	0.000	0.000	0.000	0.020	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	22.189	68.578	9.211	0.022	0.000	0.000	0.000	0.000	0.000	0.017	my5651_rel_o2nofp.cz12a_c8r32
0.000	87.617	12.378	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5744_rel_o2nofp.cz12a_c8r32
0.000	49.067	49.006	1.928	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8043_rel_o2nofp.cz12a_c8r32
0.000	51.717	46.411	1.872	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8406_rel_o2nofp.cz12a_c8r32
0.000	53.517	44.600	1.878	0.006	0.000	0.000	0.000	0.000	0.000	0.020	my9400_rel_o2nofp.cz12a_c8r32

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.960	0.035	0.002	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	my5651_rel_o2nofp.cz12a_c8r32
99.979	0.021	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5744_rel_o2nofp.cz12a_c8r32
99.957	0.043	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8043_rel_o2nofp.cz12a_c8r32
99.954	0.046	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8406_rel_o2nofp.cz12a_c8r32
99.957	0.043	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my9400_rel_o2nofp.cz12a_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	16.350	76.606	6.775	0.269	0.000	0.000	0.000	0.000	0.000	0.047	my5651_rel_o2nofp.cz12a_c8r32
0.000	31.669	68.331	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my5744_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.081	0.917	0.003	0.000	0.000	0.000	0.000	0.000	0.020	my8043_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.986	0.011	0.003	0.000	0.000	0.000	0.000	0.000	0.041	my8406_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.139	0.856	0.006	0.000	0.000	0.000	0.000	0.000	0.045	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	29.597	63.597	6.600	0.206	0.000	0.000	0.000	0.000	0.000	0.042	my5651_rel_o2nofp.cz12a_c8r32
0.000	93.406	6.594	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
0.000	84.672	14.411	0.914	0.003	0.000	0.000	0.000	0.000	0.000	0.020	my8043_rel_o2nofp.cz12a_c8r32
0.000	74.100	25.894	0.003	0.003	0.000	0.000	0.000	0.000	0.000	0.034	my8406_rel_o2nofp.cz12a_c8r32
0.000	85.283	13.858	0.856	0.003	0.000	0.000	0.000	0.000	0.000	0.051	my9400_rel_o2nofp.cz12a_c8r32

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.940	0.057	0.001	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5651_rel_o2nofp.cz12a_c8r32
99.972	0.028	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c8r32
99.878	0.122	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8043_rel_o2nofp.cz12a_c8r32
99.857	0.143	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8406_rel_o2nofp.cz12a_c8r32
99.871	0.129	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my9400_rel_o2nofp.cz12a_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	18.350	76.914	4.708	0.028	0.000	0.000	0.000	0.000	0.000	0.018	my5651_rel_o2nofp.cz12a_c8r32
0.000	25.844	74.147	0.008	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my5744_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.044	0.953	0.003	0.000	0.000	0.000	0.000	0.000	0.021	my8043_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.992	0.006	0.003	0.000	0.000	0.000	0.000	0.000	0.043	my8406_rel_o2nofp.cz12a_c8r32
0.000	0.000	99.092	0.903	0.006	0.000	0.000	0.000	0.000	0.000	0.048	my9400_rel_o2nofp.cz12a_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	33.242	62.036	4.706	0.017	0.000	0.000	0.000	0.000	0.000	0.017	my5651_rel_o2nofp.cz12a_c8r32
0.000	92.519	7.475	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my5744_rel_o2nofp.cz12a_c8r32
0.000	70.839	28.206	0.953	0.003	0.000	0.000	0.000	0.000	0.000	0.020	my8043_rel_o2nofp.cz12a_c8r32
0.000	69.614	30.381	0.003	0.003	0.000	0.000	0.000	0.000	0.000	0.049	my8406_rel_o2nofp.cz12a_c8r32
0.000	72.183	26.958	0.853	0.006	0.000	0.000	0.000	0.000	0.000	0.055	my9400_rel_o2nofp.cz12a_c8r32