Introduction

This is a report for the insert benchmark with 80M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has is a c2d-standard-30 with HT off, 16 cores, 64G RAM, Ubuntu 22.04 and ext4 using SW RAID 0 and 2 NVMe devices. The benchmark was run with 8 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 table with a table per client. It loads 10M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40m+10m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached by InnoDB. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my8028_rel_o2nofp.cz11a_c24r64 66666760150412407955710564894521355878445385488043616
my8032_rel_o2nofp.cz11a_c24r64 64000058823611080351414525004199351768413915071941380
my8036_rel_o2nofp.cz11a_c24r64 64000060606111432651914590424227058495416905738341724
my8037_rel_o2nofp.cz11a_c24r64 64000059701611494252459591154241658621417535756841877
my8038_rel_o2nofp.cz11a_c24r64 64000059259311387952151588134235658290424495733841754

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my8028_rel_o2nofp.cz11a_c24r64 1.001.001.001.001.001.001.001.001.001.00
my8032_rel_o2nofp.cz11a_c24r64 0.960.980.890.920.930.930.930.930.920.95
my8036_rel_o2nofp.cz11a_c24r64 0.961.010.920.931.050.931.050.941.050.96
my8037_rel_o2nofp.cz11a_c24r64 0.960.990.930.941.050.941.050.941.050.96
my8038_rel_o2nofp.cz11a_c24r64 0.960.990.920.941.040.941.040.951.040.96

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
my8028_rel_o2nofp.cz11a_c24r647967963982398279657960
my8032_rel_o2nofp.cz11a_c24r647967963980398079607960
my8036_rel_o2nofp.cz11a_c24r647967963980398079657960
my8037_rel_o2nofp.cz11a_c24r647967963980398079607960
my8038_rel_o2nofp.cz11a_c24r647967963978398079607960
target8008004000400080008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6492.1307.7630.0610.0270.0050.0140.480
my8032_rel_o2nofp.cz11a_c24r6472.53027.3270.0850.0370.0070.0140.476
my8036_rel_o2nofp.cz11a_c24r6472.66227.2050.0770.0350.0070.0140.497
my8037_rel_o2nofp.cz11a_c24r6478.94820.9210.0670.0420.0090.0140.488
my8038_rel_o2nofp.cz11a_c24r6477.62722.2360.0800.0370.0070.0140.496

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
666667	0	0	0.0	1521.9	188.7	0.000	0.000	0.002	0.290	146990	62.5	0.220	15	5.3	55.9	9.2	0.480	103390	54941	my8028_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1376.2	175.7	0.000	0.000	0.002	0.281	114429	62.0	0.179	16	5.3	55.9	8.9	0.476	95198	53842	my8032_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1579.7	181.4	0.000	0.000	0.002	0.290	123770	62.0	0.193	16	5.3	55.9	8.9	0.497	95798	54758	my8036_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1589.2	181.8	0.000	0.000	0.002	0.291	120028	61.6	0.188	15	5.3	55.9	8.9	0.488	95327	54342	my8037_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1588.5	181.7	0.000	0.000	0.002	0.291	111105	61.9	0.174	15	5.3	55.9	8.9	0.496	96197	61633	my8038_rel_o2nofp.cz11a_c24r64

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
601504	0	3487	210.9	13418.9	641.6	0.006	0.359	0.022	1.092	41678	40.1	0.069	11	12.1	62.7	14.5	0.001	NA	NA	my8028_rel_o2nofp.cz11a_c24r64
588236	0	3367	203.2	13532.4	627.7	0.006	0.354	0.023	1.093	41016	48.4	0.070	13	12.1	62.7	13.9	0.002	NA	NA	my8032_rel_o2nofp.cz11a_c24r64
606061	0	3488	210.9	13509.1	641.5	0.006	0.356	0.022	1.084	39920	48.7	0.066	13	12.1	62.7	14.1	0.002	NA	NA	my8036_rel_o2nofp.cz11a_c24r64
597016	0	3488	210.8	13286.7	640.5	0.006	0.362	0.022	1.099	40304	47.8	0.068	13	12.1	62.7	14.2	0.002	NA	NA	my8037_rel_o2nofp.cz11a_c24r64
592593	0	3367	203.2	13482.3	626.1	0.006	0.351	0.023	1.082	40364	48.1	0.068	13	12.1	62.7	14.2	0.002	NA	NA	my8038_rel_o2nofp.cz11a_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r640.00184.97614.7480.2310.0270.0160.739
my8032_rel_o2nofp.cz11a_c24r6476.78822.8380.3220.0350.0180.925
my8036_rel_o2nofp.cz11a_c24r64nonzero79.75019.8760.3210.0340.0190.792
my8037_rel_o2nofp.cz11a_c24r6480.21619.4070.3200.0380.018nonzero1.242
my8038_rel_o2nofp.cz11a_c24r6479.37820.2550.3150.0340.0180.833

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r640.39089.24910.1480.1780.0200.0140.738
my8032_rel_o2nofp.cz11a_c24r640.01982.96816.7240.2480.0260.0160.784
my8036_rel_o2nofp.cz11a_c24r640.04385.12414.5400.2500.0260.0160.788
my8037_rel_o2nofp.cz11a_c24r640.07085.46414.1750.2450.0300.0160.699
my8038_rel_o2nofp.cz11a_c24r640.05684.77414.8860.2430.0260.0150.828

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
124079	0	150	2.3	7001.0	327.8	0.001	0.019	0.056	2.705	183903	78.2	1.482	101	17.7	68.5	21.8	0.739	16037	7991	my8028_rel_o2nofp.cz11a_c24r64
110803	0	134	2.1	7878.6	375.0	0.001	0.019	0.071	3.466	181093	78.6	1.634	113	17.5	68.2	21.5	0.925	14435	5744	my8032_rel_o2nofp.cz11a_c24r64
114326	0	138	2.2	8076.7	384.9	0.001	0.019	0.071	3.447	180392	77.8	1.578	109	17.6	68.3	21.6	0.792	14934	5944	my8036_rel_o2nofp.cz11a_c24r64
114942	0	139	2.2	8087.0	386.5	0.001	0.019	0.070	3.443	180773	77.6	1.573	108	17.3	68.1	21.4	1.242	15038	6293	my8037_rel_o2nofp.cz11a_c24r64
113879	0	137	2.1	8052.7	383.5	0.001	0.019	0.071	3.448	178950	77.8	1.571	109	17.5	68.3	21.5	0.833	14937	6045	my8038_rel_o2nofp.cz11a_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r641.51287.32711.0730.0610.0220.0010.0030.569
my8032_rel_o2nofp.cz11a_c24r640.08884.35015.4410.0850.0310.0010.0030.550
my8036_rel_o2nofp.cz11a_c24r640.18685.26914.4310.0790.0310.0020.0030.544
my8037_rel_o2nofp.cz11a_c24r640.23785.76813.8790.0830.0290.0020.0030.571
my8038_rel_o2nofp.cz11a_c24r640.19785.53314.1500.0850.0310.0010.0030.557

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r641.74087.54610.6300.0600.022nonzero0.0030.568
my8032_rel_o2nofp.cz11a_c24r640.06984.86614.9460.0840.0310.0010.0030.548
my8036_rel_o2nofp.cz11a_c24r640.23185.90313.7540.0770.0300.0020.0030.544
my8037_rel_o2nofp.cz11a_c24r640.31886.34413.2220.0820.0290.0020.0030.569
my8038_rel_o2nofp.cz11a_c24r640.22986.13113.5220.0840.0300.0010.0030.555

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
55710	0	0	0.0	3963.9	172.2	0.000	0.000	0.071	3.165	274061	71.5	4.919	205	17.7	68.5	21.8	0.569	7103	4167	my8028_rel_o2nofp.cz11a_c24r64
51414	0	0	0.0	4514.0	196.2	0.000	0.000	0.088	3.907	260901	72.1	5.075	224	17.5	68.2	21.5	0.550	6533	3996	my8032_rel_o2nofp.cz11a_c24r64
51914	0	0	0.0	4551.9	197.6	0.000	0.000	0.088	3.897	261852	71.4	5.044	220	17.6	68.3	21.6	0.544	6618	3782	my8036_rel_o2nofp.cz11a_c24r64
52459	0	0	0.0	4580.7	199.2	0.000	0.000	0.087	3.889	263807	71.5	5.029	218	17.3	68.1	21.4	0.571	6694	3501	my8037_rel_o2nofp.cz11a_c24r64
52151	0	0	0.0	4549.2	197.7	0.000	0.000	0.087	3.882	265104	71.3	5.083	219	17.5	68.3	21.5	0.557	6638	3706	my8038_rel_o2nofp.cz11a_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6499.9540.0450.001nonzero0.007
my8032_rel_o2nofp.cz11a_c24r6499.9430.0560.001nonzero0.007
my8036_rel_o2nofp.cz11a_c24r6499.9660.0330.001nonzero0.012
my8037_rel_o2nofp.cz11a_c24r6499.9640.0360.001nonzero0.013
my8038_rel_o2nofp.cz11a_c24r6499.9650.0340.001nonzero0.006

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6498.5281.4720.010
my8032_rel_o2nofp.cz11a_c24r6496.8193.1770.0030.018
my8036_rel_o2nofp.cz11a_c24r6497.3472.6530.014
my8037_rel_o2nofp.cz11a_c24r6498.3301.6700.009
my8038_rel_o2nofp.cz11a_c24r6498.1771.8230.009

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r641.87897.4410.6810.011
my8032_rel_o2nofp.cz11a_c24r640.01097.9692.0210.012
my8036_rel_o2nofp.cz11a_c24r640.50797.9381.5560.013
my8037_rel_o2nofp.cz11a_c24r640.59798.4550.9480.010
my8038_rel_o2nofp.cz11a_c24r640.44198.6040.9550.009

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	56489	0	0.0	862.0	24.4	0.000	0.000	1.083	31.429	210804	50.3	3.732	142	17.7	68.5	21.8	0.007	7112	6841	my8028_rel_o2nofp.cz11a_c24r64
796	52500	0	0.0	827.9	23.6	0.000	0.000	1.040	30.375	195903	50.3	3.732	153	17.5	68.2	21.5	0.007	6601	6409	my8032_rel_o2nofp.cz11a_c24r64
796	59042	0	0.0	778.2	22.2	0.000	0.000	0.978	28.622	219902	50.2	3.725	136	17.6	68.3	21.6	0.012	7432	7198	my8036_rel_o2nofp.cz11a_c24r64
796	59115	0	0.0	1002.1	28.5	0.000	0.000	1.259	36.656	219994	50.3	3.721	136	17.3	68.1	21.4	0.013	7480	7224	my8037_rel_o2nofp.cz11a_c24r64
796	58813	0	0.0	953.3	27.1	0.000	0.000	1.198	34.910	218660	50.3	3.718	137	17.5	68.3	21.5	0.006	7416	7176	my8038_rel_o2nofp.cz11a_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6499.0950.8950.010nonzero0.004
my8032_rel_o2nofp.cz11a_c24r6498.4421.5470.011nonzero0.004
my8036_rel_o2nofp.cz11a_c24r6498.5021.4880.010nonzero0.004
my8037_rel_o2nofp.cz11a_c24r6498.4991.4910.0100.004
my8038_rel_o2nofp.cz11a_c24r6498.5291.4610.010nonzero0.004

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6499.7670.2330.005
my8032_rel_o2nofp.cz11a_c24r6499.2780.7220.007
my8036_rel_o2nofp.cz11a_c24r6499.5970.4030.008
my8037_rel_o2nofp.cz11a_c24r6499.6770.3230.006
my8038_rel_o2nofp.cz11a_c24r6499.3510.6490.006

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r640.66099.2740.0660.005
my8032_rel_o2nofp.cz11a_c24r6499.7640.2360.006
my8036_rel_o2nofp.cz11a_c24r640.03899.8120.1490.008
my8037_rel_o2nofp.cz11a_c24r640.04999.8510.1010.006
my8038_rel_o2nofp.cz11a_c24r640.00799.7220.2710.005

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	45213	0	0.0	93.0	3.1	0.000	0.000	0.117	3.961	176538	48.9	3.905	173	17.7	68.5	21.8	0.004	5705	5562	my8028_rel_o2nofp.cz11a_c24r64
796	41993	0	0.0	90.5	3.2	0.000	0.000	0.114	4.113	163104	48.8	3.884	186	17.5	68.2	21.5	0.004	5274	5161	my8032_rel_o2nofp.cz11a_c24r64
796	42270	0	0.0	96.8	3.4	0.000	0.000	0.122	4.369	164523	48.7	3.892	184	17.6	68.5	21.6	0.004	5307	5194	my8036_rel_o2nofp.cz11a_c24r64
796	42416	0	0.0	109.5	3.7	0.000	0.000	0.138	4.768	165233	48.7	3.896	184	17.3	68.2	21.4	0.004	5335	5210	my8037_rel_o2nofp.cz11a_c24r64
796	42356	0	0.0	93.7	3.3	0.000	0.000	0.118	4.186	165046	48.8	3.897	184	17.5	68.3	21.5	0.004	5323	5194	my8038_rel_o2nofp.cz11a_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6499.9010.0800.0180.001nonzero0.017
my8032_rel_o2nofp.cz11a_c24r6499.8620.1180.0190.001nonzero0.020
my8036_rel_o2nofp.cz11a_c24r6499.9210.0630.0160.001nonzero0.020
my8037_rel_o2nofp.cz11a_c24r6499.9200.0630.0150.001nonzero0.025
my8038_rel_o2nofp.cz11a_c24r6499.9190.0650.0150.001nonzero0.017

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6485.61214.3050.0830.030
my8032_rel_o2nofp.cz11a_c24r6483.92815.9050.1670.033
my8036_rel_o2nofp.cz11a_c24r6482.87417.0000.1260.028
my8037_rel_o2nofp.cz11a_c24r6484.20415.6930.1030.026
my8038_rel_o2nofp.cz11a_c24r6485.99913.9260.0750.028

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r642.36788.8938.7100.0300.030
my8032_rel_o2nofp.cz11a_c24r640.04589.63910.2310.0850.028
my8036_rel_o2nofp.cz11a_c24r640.32488.87910.7350.0620.024
my8037_rel_o2nofp.cz11a_c24r640.46089.47610.0320.0330.021
my8038_rel_o2nofp.cz11a_c24r640.70590.4338.8330.0280.023

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3982	55878	0	0.0	381.5	14.0	0.000	0.000	0.096	3.607	205372	51.6	3.675	148	17.7	68.5	21.8	0.017	7000	6755	my8028_rel_o2nofp.cz11a_c24r64
3980	51768	0	0.0	590.2	20.9	0.000	0.000	0.148	5.365	190246	51.9	3.675	160	17.5	68.2	21.5	0.020	6489	6219	my8032_rel_o2nofp.cz11a_c24r64
3980	58495	0	0.0	591.9	20.9	0.000	0.000	0.149	5.370	214464	51.8	3.666	142	17.6	68.5	21.6	0.020	7306	7053	my8036_rel_o2nofp.cz11a_c24r64
3980	58621	0	0.0	587.4	20.8	0.000	0.000	0.148	5.348	215022	51.8	3.668	141	17.3	68.2	21.4	0.025	7336	7081	my8037_rel_o2nofp.cz11a_c24r64
3978	58290	0	0.0	582.3	20.6	0.000	0.000	0.146	5.298	213267	51.8	3.659	142	17.5	68.3	21.5	0.017	7320	7037	my8038_rel_o2nofp.cz11a_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6498.3361.5880.0740.0010.014
my8032_rel_o2nofp.cz11a_c24r6497.7872.1380.0730.002nonzero0.016
my8036_rel_o2nofp.cz11a_c24r6497.7602.1690.0690.0020.016
my8037_rel_o2nofp.cz11a_c24r6497.8332.0960.0700.002nonzero0.017
my8038_rel_o2nofp.cz11a_c24r6498.0001.9290.0700.0020.016

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6491.3028.6930.0050.020
my8032_rel_o2nofp.cz11a_c24r6483.59616.3760.0280.022
my8036_rel_o2nofp.cz11a_c24r6487.18612.7970.0170.022
my8037_rel_o2nofp.cz11a_c24r6487.24412.7340.0220.020
my8038_rel_o2nofp.cz11a_c24r6488.55211.4290.0190.022

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r640.43394.4325.1330.0020.019
my8032_rel_o2nofp.cz11a_c24r640.01189.05610.9190.0140.024
my8036_rel_o2nofp.cz11a_c24r640.06791.6978.2280.0080.020
my8037_rel_o2nofp.cz11a_c24r640.17791.6638.1510.0090.020
my8038_rel_o2nofp.cz11a_c24r640.08492.7597.1480.0090.025

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3982	44538	0	0.0	495.6	17.2	0.000	0.000	0.124	4.429	174628	50.2	3.921	180	17.7	68.5	21.8	0.014	5580	5423	my8028_rel_o2nofp.cz11a_c24r64
3980	41391	0	0.0	594.1	20.9	0.000	0.000	0.149	5.384	155599	50.5	3.759	195	17.5	68.2	21.5	0.016	5194	5004	my8032_rel_o2nofp.cz11a_c24r64
3980	41690	0	0.0	598.2	21.1	0.000	0.000	0.150	5.437	158359	50.4	3.799	193	17.6	68.6	21.6	0.016	5242	5067	my8036_rel_o2nofp.cz11a_c24r64
3980	41753	0	0.0	599.6	21.2	0.000	0.000	0.151	5.453	157945	50.4	3.783	193	17.3	68.4	21.4	0.017	5239	5068	my8037_rel_o2nofp.cz11a_c24r64
3980	42449	0	0.0	588.8	20.8	0.000	0.000	0.148	5.353	162639	50.5	3.831	190	17.5	68.3	21.5	0.016	5322	5097	my8038_rel_o2nofp.cz11a_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6499.6810.2650.0500.004nonzero0.026
my8032_rel_o2nofp.cz11a_c24r6499.4930.4460.0560.005nonzero0.034
my8036_rel_o2nofp.cz11a_c24r6499.7440.2120.0410.003nonzero0.027
my8037_rel_o2nofp.cz11a_c24r6499.7510.2060.0400.003nonzero0.032
my8038_rel_o2nofp.cz11a_c24r6499.7580.1960.0420.004nonzero0.027

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r64nonzero78.15621.2450.5990.034
my8032_rel_o2nofp.cz11a_c24r6478.61120.9580.4310.035
my8036_rel_o2nofp.cz11a_c24r6479.06820.5050.4270.039
my8037_rel_o2nofp.cz11a_c24r6480.16219.4130.4250.034
my8038_rel_o2nofp.cz11a_c24r6475.74523.5400.7150.039

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r641.08581.91016.5920.4140.035
my8032_rel_o2nofp.cz11a_c24r640.12882.97716.5910.3030.036
my8036_rel_o2nofp.cz11a_c24r640.41683.17516.0860.3230.036
my8037_rel_o2nofp.cz11a_c24r640.55484.14514.9850.3160.037
my8038_rel_o2nofp.cz11a_c24r640.26980.45018.7670.5140.040

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7965	54880	0	0.0	767.8	28.5	0.000	0.000	0.096	3.665	200089	53.3	3.646	155	17.7	68.5	21.8	0.026	6952	6409	my8028_rel_o2nofp.cz11a_c24r64
7960	50719	0	0.0	952.9	35.8	0.000	0.000	0.120	4.601	185040	53.9	3.648	170	17.5	68.2	21.5	0.034	6393	5914	my8032_rel_o2nofp.cz11a_c24r64
7965	57383	0	0.0	953.6	35.8	0.000	0.000	0.120	4.606	207441	53.8	3.615	150	17.6	68.6	21.6	0.027	7240	6665	my8036_rel_o2nofp.cz11a_c24r64
7960	57568	0	0.0	956.7	35.8	0.000	0.000	0.120	4.609	208733	53.9	3.626	150	17.3	68.4	21.4	0.032	7291	6729	my8037_rel_o2nofp.cz11a_c24r64
7960	57338	0	0.0	950.1	35.7	0.000	0.000	0.119	4.597	207485	53.9	3.619	150	17.5	68.3	21.5	0.027	7226	6665	my8038_rel_o2nofp.cz11a_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6497.7682.0980.1290.006nonzero0.024
my8032_rel_o2nofp.cz11a_c24r6497.9221.9800.0910.006nonzero0.025
my8036_rel_o2nofp.cz11a_c24r6498.0641.8400.0900.006nonzero0.024
my8037_rel_o2nofp.cz11a_c24r6497.9011.9860.1070.006nonzero0.027
my8038_rel_o2nofp.cz11a_c24r6497.9881.9050.1000.006nonzero0.036

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r6481.59418.2470.1600.029
my8032_rel_o2nofp.cz11a_c24r6478.49921.0650.4360.037
my8036_rel_o2nofp.cz11a_c24r6479.72020.0060.2750.035
my8037_rel_o2nofp.cz11a_c24r6476.18223.4080.4110.034
my8038_rel_o2nofp.cz11a_c24r6477.34122.2470.4130.039

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my8028_rel_o2nofp.cz11a_c24r640.41185.67113.8070.1100.027
my8032_rel_o2nofp.cz11a_c24r640.02483.19716.4970.2830.035
my8036_rel_o2nofp.cz11a_c24r640.15784.19515.4640.1830.032
my8037_rel_o2nofp.cz11a_c24r640.04181.04118.6230.2940.030
my8038_rel_o2nofp.cz11a_c24r640.07182.29817.3320.2990.035

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	43616	0	0.0	785.4	29.0	0.000	0.000	0.099	3.725	166333	51.9	3.814	190	17.7	68.5	21.8	0.024	5452	5265	my8028_rel_o2nofp.cz11a_c24r64
7960	41380	0	0.0	978.6	36.5	0.000	0.000	0.123	4.695	148324	52.9	3.584	205	17.5	68.2	21.5	0.025	5195	4955	my8032_rel_o2nofp.cz11a_c24r64
7960	41724	0	0.0	979.3	36.6	0.000	0.000	0.123	4.705	149673	52.8	3.587	202	17.6	68.8	21.6	0.024	5259	5019	my8036_rel_o2nofp.cz11a_c24r64
7960	41877	0	0.0	985.6	36.7	0.000	0.000	0.124	4.715	152525	52.8	3.642	202	17.3	68.5	21.4	0.027	5242	4971	my8037_rel_o2nofp.cz11a_c24r64
7960	41754	0	0.0	978.3	36.4	0.000	0.000	0.123	4.684	151286	52.7	3.623	202	17.5	68.3	21.5	0.036	5258	5020	my8038_rel_o2nofp.cz11a_c24r64

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
666667	0	0	0.0	1521.9	188.7	0.000	0.000	0.002	0.290	146990	62.5	0.220	15	5.3	55.9	9.2	0.480	103390	54941	my8028_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1376.2	175.7	0.000	0.000	0.002	0.281	114429	62.0	0.179	16	5.3	55.9	8.9	0.476	95198	53842	my8032_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1579.7	181.4	0.000	0.000	0.002	0.290	123770	62.0	0.193	16	5.3	55.9	8.9	0.497	95798	54758	my8036_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1589.2	181.8	0.000	0.000	0.002	0.291	120028	61.6	0.188	15	5.3	55.9	8.9	0.488	95327	54342	my8037_rel_o2nofp.cz11a_c24r64
640000	0	0	0.0	1588.5	181.7	0.000	0.000	0.002	0.291	111105	61.9	0.174	15	5.3	55.9	8.9	0.496	96197	61633	my8038_rel_o2nofp.cz11a_c24r64

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
601504	0	3487	210.9	13418.9	641.6	0.006	0.359	0.022	1.092	41678	40.1	0.069	11	12.1	62.7	14.5	0.001	NA	NA	my8028_rel_o2nofp.cz11a_c24r64
588236	0	3367	203.2	13532.4	627.7	0.006	0.354	0.023	1.093	41016	48.4	0.070	13	12.1	62.7	13.9	0.002	NA	NA	my8032_rel_o2nofp.cz11a_c24r64
606061	0	3488	210.9	13509.1	641.5	0.006	0.356	0.022	1.084	39920	48.7	0.066	13	12.1	62.7	14.1	0.002	NA	NA	my8036_rel_o2nofp.cz11a_c24r64
597016	0	3488	210.8	13286.7	640.5	0.006	0.362	0.022	1.099	40304	47.8	0.068	13	12.1	62.7	14.2	0.002	NA	NA	my8037_rel_o2nofp.cz11a_c24r64
592593	0	3367	203.2	13482.3	626.1	0.006	0.351	0.023	1.082	40364	48.1	0.068	13	12.1	62.7	14.2	0.002	NA	NA	my8038_rel_o2nofp.cz11a_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
124079	0	150	2.3	7001.0	327.8	0.001	0.019	0.056	2.705	183903	78.2	1.482	101	17.7	68.5	21.8	0.739	16037	7991	my8028_rel_o2nofp.cz11a_c24r64
110803	0	134	2.1	7878.6	375.0	0.001	0.019	0.071	3.466	181093	78.6	1.634	113	17.5	68.2	21.5	0.925	14435	5744	my8032_rel_o2nofp.cz11a_c24r64
114326	0	138	2.2	8076.7	384.9	0.001	0.019	0.071	3.447	180392	77.8	1.578	109	17.6	68.3	21.6	0.792	14934	5944	my8036_rel_o2nofp.cz11a_c24r64
114942	0	139	2.2	8087.0	386.5	0.001	0.019	0.070	3.443	180773	77.6	1.573	108	17.3	68.1	21.4	1.242	15038	6293	my8037_rel_o2nofp.cz11a_c24r64
113879	0	137	2.1	8052.7	383.5	0.001	0.019	0.071	3.448	178950	77.8	1.571	109	17.5	68.3	21.5	0.833	14937	6045	my8038_rel_o2nofp.cz11a_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
55710	0	0	0.0	3963.9	172.2	0.000	0.000	0.071	3.165	274061	71.5	4.919	205	17.7	68.5	21.8	0.569	7103	4167	my8028_rel_o2nofp.cz11a_c24r64
51414	0	0	0.0	4514.0	196.2	0.000	0.000	0.088	3.907	260901	72.1	5.075	224	17.5	68.2	21.5	0.550	6533	3996	my8032_rel_o2nofp.cz11a_c24r64
51914	0	0	0.0	4551.9	197.6	0.000	0.000	0.088	3.897	261852	71.4	5.044	220	17.6	68.3	21.6	0.544	6618	3782	my8036_rel_o2nofp.cz11a_c24r64
52459	0	0	0.0	4580.7	199.2	0.000	0.000	0.087	3.889	263807	71.5	5.029	218	17.3	68.1	21.4	0.571	6694	3501	my8037_rel_o2nofp.cz11a_c24r64
52151	0	0	0.0	4549.2	197.7	0.000	0.000	0.087	3.882	265104	71.3	5.083	219	17.5	68.3	21.5	0.557	6638	3706	my8038_rel_o2nofp.cz11a_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	56489	0	0.0	862.0	24.4	0.000	0.000	1.083	31.429	210804	50.3	3.732	142	17.7	68.5	21.8	0.007	7112	6841	my8028_rel_o2nofp.cz11a_c24r64
796	52500	0	0.0	827.9	23.6	0.000	0.000	1.040	30.375	195903	50.3	3.732	153	17.5	68.2	21.5	0.007	6601	6409	my8032_rel_o2nofp.cz11a_c24r64
796	59042	0	0.0	778.2	22.2	0.000	0.000	0.978	28.622	219902	50.2	3.725	136	17.6	68.3	21.6	0.012	7432	7198	my8036_rel_o2nofp.cz11a_c24r64
796	59115	0	0.0	1002.1	28.5	0.000	0.000	1.259	36.656	219994	50.3	3.721	136	17.3	68.1	21.4	0.013	7480	7224	my8037_rel_o2nofp.cz11a_c24r64
796	58813	0	0.0	953.3	27.1	0.000	0.000	1.198	34.910	218660	50.3	3.718	137	17.5	68.3	21.5	0.006	7416	7176	my8038_rel_o2nofp.cz11a_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	45213	0	0.0	93.0	3.1	0.000	0.000	0.117	3.961	176538	48.9	3.905	173	17.7	68.5	21.8	0.004	5705	5562	my8028_rel_o2nofp.cz11a_c24r64
796	41993	0	0.0	90.5	3.2	0.000	0.000	0.114	4.113	163104	48.8	3.884	186	17.5	68.2	21.5	0.004	5274	5161	my8032_rel_o2nofp.cz11a_c24r64
796	42270	0	0.0	96.8	3.4	0.000	0.000	0.122	4.369	164523	48.7	3.892	184	17.6	68.5	21.6	0.004	5307	5194	my8036_rel_o2nofp.cz11a_c24r64
796	42416	0	0.0	109.5	3.7	0.000	0.000	0.138	4.768	165233	48.7	3.896	184	17.3	68.2	21.4	0.004	5335	5210	my8037_rel_o2nofp.cz11a_c24r64
796	42356	0	0.0	93.7	3.3	0.000	0.000	0.118	4.186	165046	48.8	3.897	184	17.5	68.3	21.5	0.004	5323	5194	my8038_rel_o2nofp.cz11a_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3982	55878	0	0.0	381.5	14.0	0.000	0.000	0.096	3.607	205372	51.6	3.675	148	17.7	68.5	21.8	0.017	7000	6755	my8028_rel_o2nofp.cz11a_c24r64
3980	51768	0	0.0	590.2	20.9	0.000	0.000	0.148	5.365	190246	51.9	3.675	160	17.5	68.2	21.5	0.020	6489	6219	my8032_rel_o2nofp.cz11a_c24r64
3980	58495	0	0.0	591.9	20.9	0.000	0.000	0.149	5.370	214464	51.8	3.666	142	17.6	68.5	21.6	0.020	7306	7053	my8036_rel_o2nofp.cz11a_c24r64
3980	58621	0	0.0	587.4	20.8	0.000	0.000	0.148	5.348	215022	51.8	3.668	141	17.3	68.2	21.4	0.025	7336	7081	my8037_rel_o2nofp.cz11a_c24r64
3978	58290	0	0.0	582.3	20.6	0.000	0.000	0.146	5.298	213267	51.8	3.659	142	17.5	68.3	21.5	0.017	7320	7037	my8038_rel_o2nofp.cz11a_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3982	44538	0	0.0	495.6	17.2	0.000	0.000	0.124	4.429	174628	50.2	3.921	180	17.7	68.5	21.8	0.014	5580	5423	my8028_rel_o2nofp.cz11a_c24r64
3980	41391	0	0.0	594.1	20.9	0.000	0.000	0.149	5.384	155599	50.5	3.759	195	17.5	68.2	21.5	0.016	5194	5004	my8032_rel_o2nofp.cz11a_c24r64
3980	41690	0	0.0	598.2	21.1	0.000	0.000	0.150	5.437	158359	50.4	3.799	193	17.6	68.6	21.6	0.016	5242	5067	my8036_rel_o2nofp.cz11a_c24r64
3980	41753	0	0.0	599.6	21.2	0.000	0.000	0.151	5.453	157945	50.4	3.783	193	17.3	68.4	21.4	0.017	5239	5068	my8037_rel_o2nofp.cz11a_c24r64
3980	42449	0	0.0	588.8	20.8	0.000	0.000	0.148	5.353	162639	50.5	3.831	190	17.5	68.3	21.5	0.016	5322	5097	my8038_rel_o2nofp.cz11a_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7965	54880	0	0.0	767.8	28.5	0.000	0.000	0.096	3.665	200089	53.3	3.646	155	17.7	68.5	21.8	0.026	6952	6409	my8028_rel_o2nofp.cz11a_c24r64
7960	50719	0	0.0	952.9	35.8	0.000	0.000	0.120	4.601	185040	53.9	3.648	170	17.5	68.2	21.5	0.034	6393	5914	my8032_rel_o2nofp.cz11a_c24r64
7965	57383	0	0.0	953.6	35.8	0.000	0.000	0.120	4.606	207441	53.8	3.615	150	17.6	68.6	21.6	0.027	7240	6665	my8036_rel_o2nofp.cz11a_c24r64
7960	57568	0	0.0	956.7	35.8	0.000	0.000	0.120	4.609	208733	53.9	3.626	150	17.3	68.4	21.4	0.032	7291	6729	my8037_rel_o2nofp.cz11a_c24r64
7960	57338	0	0.0	950.1	35.7	0.000	0.000	0.119	4.597	207485	53.9	3.619	150	17.5	68.3	21.5	0.027	7226	6665	my8038_rel_o2nofp.cz11a_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	43616	0	0.0	785.4	29.0	0.000	0.000	0.099	3.725	166333	51.9	3.814	190	17.7	68.5	21.8	0.024	5452	5265	my8028_rel_o2nofp.cz11a_c24r64
7960	41380	0	0.0	978.6	36.5	0.000	0.000	0.123	4.695	148324	52.9	3.584	205	17.5	68.2	21.5	0.025	5195	4955	my8032_rel_o2nofp.cz11a_c24r64
7960	41724	0	0.0	979.3	36.6	0.000	0.000	0.123	4.705	149673	52.8	3.587	202	17.6	68.8	21.6	0.024	5259	5019	my8036_rel_o2nofp.cz11a_c24r64
7960	41877	0	0.0	985.6	36.7	0.000	0.000	0.124	4.715	152525	52.8	3.642	202	17.3	68.5	21.4	0.027	5242	4971	my8037_rel_o2nofp.cz11a_c24r64
7960	41754	0	0.0	978.3	36.4	0.000	0.000	0.123	4.684	151286	52.7	3.623	202	17.5	68.3	21.5	0.036	5258	5020	my8038_rel_o2nofp.cz11a_c24r64

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	92.130	7.763	0.061	0.027	0.005	0.014	0.000	0.000	0.000	0.480	my8028_rel_o2nofp.cz11a_c24r64
0.000	72.530	27.327	0.085	0.037	0.007	0.014	0.000	0.000	0.000	0.476	my8032_rel_o2nofp.cz11a_c24r64
0.000	72.662	27.205	0.077	0.035	0.007	0.014	0.000	0.000	0.000	0.497	my8036_rel_o2nofp.cz11a_c24r64
0.000	78.948	20.921	0.067	0.042	0.009	0.014	0.000	0.000	0.000	0.488	my8037_rel_o2nofp.cz11a_c24r64
0.000	77.627	22.236	0.080	0.037	0.007	0.014	0.000	0.000	0.000	0.496	my8038_rel_o2nofp.cz11a_c24r64

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.001	84.976	14.748	0.231	0.027	0.016	0.000	0.000	0.000	0.739	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	76.788	22.838	0.322	0.035	0.018	0.000	0.000	0.000	0.925	my8032_rel_o2nofp.cz11a_c24r64
0.000	nonzero	79.750	19.876	0.321	0.034	0.019	0.000	0.000	0.000	0.792	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.000	80.216	19.407	0.320	0.038	0.018	nonzero	0.000	0.000	1.242	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.000	79.378	20.255	0.315	0.034	0.018	0.000	0.000	0.000	0.833	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.390	89.249	10.148	0.178	0.020	0.014	0.000	0.000	0.000	0.738	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.019	82.968	16.724	0.248	0.026	0.016	0.000	0.000	0.000	0.784	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.043	85.124	14.540	0.250	0.026	0.016	0.000	0.000	0.000	0.788	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.070	85.464	14.175	0.245	0.030	0.016	0.000	0.000	0.000	0.699	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.056	84.774	14.886	0.243	0.026	0.015	0.000	0.000	0.000	0.828	my8038_rel_o2nofp.cz11a_c24r64

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
1.512	87.327	11.073	0.061	0.022	0.001	0.003	0.000	0.000	0.000	0.569	my8028_rel_o2nofp.cz11a_c24r64
0.088	84.350	15.441	0.085	0.031	0.001	0.003	0.000	0.000	0.000	0.550	my8032_rel_o2nofp.cz11a_c24r64
0.186	85.269	14.431	0.079	0.031	0.002	0.003	0.000	0.000	0.000	0.544	my8036_rel_o2nofp.cz11a_c24r64
0.237	85.768	13.879	0.083	0.029	0.002	0.003	0.000	0.000	0.000	0.571	my8037_rel_o2nofp.cz11a_c24r64
0.197	85.533	14.150	0.085	0.031	0.001	0.003	0.000	0.000	0.000	0.557	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
1.740	87.546	10.630	0.060	0.022	nonzero	0.003	0.000	0.000	0.000	0.568	my8028_rel_o2nofp.cz11a_c24r64
0.069	84.866	14.946	0.084	0.031	0.001	0.003	0.000	0.000	0.000	0.548	my8032_rel_o2nofp.cz11a_c24r64
0.231	85.903	13.754	0.077	0.030	0.002	0.003	0.000	0.000	0.000	0.544	my8036_rel_o2nofp.cz11a_c24r64
0.318	86.344	13.222	0.082	0.029	0.002	0.003	0.000	0.000	0.000	0.569	my8037_rel_o2nofp.cz11a_c24r64
0.229	86.131	13.522	0.084	0.030	0.001	0.003	0.000	0.000	0.000	0.555	my8038_rel_o2nofp.cz11a_c24r64

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.954	0.045	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8028_rel_o2nofp.cz11a_c24r64
99.943	0.056	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8032_rel_o2nofp.cz11a_c24r64
99.966	0.033	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8036_rel_o2nofp.cz11a_c24r64
99.964	0.036	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8037_rel_o2nofp.cz11a_c24r64
99.965	0.034	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8038_rel_o2nofp.cz11a_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	98.528	1.472	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	96.819	3.177	0.003	0.000	0.000	0.000	0.000	0.000	0.018	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.000	97.347	2.653	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.000	98.330	1.670	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.000	98.177	1.823	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.878	97.441	0.681	0.000	0.000	0.000	0.000	0.000	0.000	0.011	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.010	97.969	2.021	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.507	97.938	1.556	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.597	98.455	0.948	0.000	0.000	0.000	0.000	0.000	0.000	0.010	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.441	98.604	0.955	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8038_rel_o2nofp.cz11a_c24r64

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.095	0.895	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8028_rel_o2nofp.cz11a_c24r64
98.442	1.547	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8032_rel_o2nofp.cz11a_c24r64
98.502	1.488	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8036_rel_o2nofp.cz11a_c24r64
98.499	1.491	0.010	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8037_rel_o2nofp.cz11a_c24r64
98.529	1.461	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8038_rel_o2nofp.cz11a_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	99.767	0.233	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	99.278	0.722	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.000	99.597	0.403	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.000	99.677	0.323	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.000	99.351	0.649	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.660	99.274	0.066	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	99.764	0.236	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.038	99.812	0.149	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.049	99.851	0.101	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.007	99.722	0.271	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8038_rel_o2nofp.cz11a_c24r64

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.901	0.080	0.018	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my8028_rel_o2nofp.cz11a_c24r64
99.862	0.118	0.019	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	my8032_rel_o2nofp.cz11a_c24r64
99.921	0.063	0.016	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	my8036_rel_o2nofp.cz11a_c24r64
99.920	0.063	0.015	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	my8037_rel_o2nofp.cz11a_c24r64
99.919	0.065	0.015	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my8038_rel_o2nofp.cz11a_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	85.612	14.305	0.083	0.000	0.000	0.000	0.000	0.000	0.030	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	83.928	15.905	0.167	0.000	0.000	0.000	0.000	0.000	0.033	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.000	82.874	17.000	0.126	0.000	0.000	0.000	0.000	0.000	0.028	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.000	84.204	15.693	0.103	0.000	0.000	0.000	0.000	0.000	0.026	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.000	85.999	13.926	0.075	0.000	0.000	0.000	0.000	0.000	0.028	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.367	88.893	8.710	0.030	0.000	0.000	0.000	0.000	0.000	0.030	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.045	89.639	10.231	0.085	0.000	0.000	0.000	0.000	0.000	0.028	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.324	88.879	10.735	0.062	0.000	0.000	0.000	0.000	0.000	0.024	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.460	89.476	10.032	0.033	0.000	0.000	0.000	0.000	0.000	0.021	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.705	90.433	8.833	0.028	0.000	0.000	0.000	0.000	0.000	0.023	my8038_rel_o2nofp.cz11a_c24r64

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.336	1.588	0.074	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8028_rel_o2nofp.cz11a_c24r64
97.787	2.138	0.073	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	my8032_rel_o2nofp.cz11a_c24r64
97.760	2.169	0.069	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8036_rel_o2nofp.cz11a_c24r64
97.833	2.096	0.070	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my8037_rel_o2nofp.cz11a_c24r64
98.000	1.929	0.070	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8038_rel_o2nofp.cz11a_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	91.302	8.693	0.005	0.000	0.000	0.000	0.000	0.000	0.020	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	83.596	16.376	0.028	0.000	0.000	0.000	0.000	0.000	0.022	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.000	87.186	12.797	0.017	0.000	0.000	0.000	0.000	0.000	0.022	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.000	87.244	12.734	0.022	0.000	0.000	0.000	0.000	0.000	0.020	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.000	88.552	11.429	0.019	0.000	0.000	0.000	0.000	0.000	0.022	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.433	94.432	5.133	0.002	0.000	0.000	0.000	0.000	0.000	0.019	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.011	89.056	10.919	0.014	0.000	0.000	0.000	0.000	0.000	0.024	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.067	91.697	8.228	0.008	0.000	0.000	0.000	0.000	0.000	0.020	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.177	91.663	8.151	0.009	0.000	0.000	0.000	0.000	0.000	0.020	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.084	92.759	7.148	0.009	0.000	0.000	0.000	0.000	0.000	0.025	my8038_rel_o2nofp.cz11a_c24r64

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.681	0.265	0.050	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	my8028_rel_o2nofp.cz11a_c24r64
99.493	0.446	0.056	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.034	my8032_rel_o2nofp.cz11a_c24r64
99.744	0.212	0.041	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	my8036_rel_o2nofp.cz11a_c24r64
99.751	0.206	0.040	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.032	my8037_rel_o2nofp.cz11a_c24r64
99.758	0.196	0.042	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	my8038_rel_o2nofp.cz11a_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	nonzero	78.156	21.245	0.599	0.000	0.000	0.000	0.000	0.000	0.034	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	78.611	20.958	0.431	0.000	0.000	0.000	0.000	0.000	0.035	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.000	79.068	20.505	0.427	0.000	0.000	0.000	0.000	0.000	0.039	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.000	80.162	19.413	0.425	0.000	0.000	0.000	0.000	0.000	0.034	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.000	75.745	23.540	0.715	0.000	0.000	0.000	0.000	0.000	0.039	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.085	81.910	16.592	0.414	0.000	0.000	0.000	0.000	0.000	0.035	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.128	82.977	16.591	0.303	0.000	0.000	0.000	0.000	0.000	0.036	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.416	83.175	16.086	0.323	0.000	0.000	0.000	0.000	0.000	0.036	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.554	84.145	14.985	0.316	0.000	0.000	0.000	0.000	0.000	0.037	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.269	80.450	18.767	0.514	0.000	0.000	0.000	0.000	0.000	0.040	my8038_rel_o2nofp.cz11a_c24r64

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
97.768	2.098	0.129	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	my8028_rel_o2nofp.cz11a_c24r64
97.922	1.980	0.091	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	my8032_rel_o2nofp.cz11a_c24r64
98.064	1.840	0.090	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	my8036_rel_o2nofp.cz11a_c24r64
97.901	1.986	0.107	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	my8037_rel_o2nofp.cz11a_c24r64
97.988	1.905	0.100	0.006	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	my8038_rel_o2nofp.cz11a_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	81.594	18.247	0.160	0.000	0.000	0.000	0.000	0.000	0.029	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.000	78.499	21.065	0.436	0.000	0.000	0.000	0.000	0.000	0.037	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.000	79.720	20.006	0.275	0.000	0.000	0.000	0.000	0.000	0.035	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.000	76.182	23.408	0.411	0.000	0.000	0.000	0.000	0.000	0.034	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.000	77.341	22.247	0.413	0.000	0.000	0.000	0.000	0.000	0.039	my8038_rel_o2nofp.cz11a_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.411	85.671	13.807	0.110	0.000	0.000	0.000	0.000	0.000	0.027	my8028_rel_o2nofp.cz11a_c24r64
0.000	0.024	83.197	16.497	0.283	0.000	0.000	0.000	0.000	0.000	0.035	my8032_rel_o2nofp.cz11a_c24r64
0.000	0.157	84.195	15.464	0.183	0.000	0.000	0.000	0.000	0.000	0.032	my8036_rel_o2nofp.cz11a_c24r64
0.000	0.041	81.041	18.623	0.294	0.000	0.000	0.000	0.000	0.000	0.030	my8037_rel_o2nofp.cz11a_c24r64
0.000	0.071	82.298	17.332	0.299	0.000	0.000	0.000	0.000	0.000	0.035	my8038_rel_o2nofp.cz11a_c24r64