Introduction

This is a report for the insert benchmark with 4000M docs and 20 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server is an ax162-s from Hetzner (see here) with 48 cores, AMD SMT disabled, 128G RAM and ext4 using 2 NVMe devices with SW RAID 1. The benchmark was run with 20 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables with a table per client. It loads 200M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 4m+1m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is larger than memory. Clients and the DBMS share one server.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
pg158_o2nofp.cx9a2a_c32r128 19890602673797246612599370777916132962957122135523273
pg164_o2nofp.cx9a2a_c32r128 20040082875629243312389371220937633135261192134973580
pg17beta3_o2nofp.cx9a2a_c32r128 20263423392706245252404372839919133103760132131363481
pg17rc1_o2nofp.cx9a2a_c32r128 20397763436426243162453376989906033120759942125703463

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
pg158_o2nofp.cx9a2a_c32r128 1.001.001.001.001.001.001.001.001.001.00
pg164_o2nofp.cx9a2a_c32r128 1.011.080.990.921.001.021.011.071.001.09
pg17beta3_o2nofp.cx9a2a_c32r128 1.021.270.990.921.011.001.001.051.001.06
pg17rc1_o2nofp.cx9a2a_c32r128 1.031.290.990.941.020.991.001.051.001.06

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
pg158_o2nofp.cx9a2a_c32r12819771977980498631905819180
pg164_o2nofp.cx9a2a_c32r12819771977986898741871119544
pg17beta3_o2nofp.cx9a2a_c32r12819761976984798791869219231
pg17rc1_o2nofp.cx9a2a_c32r12819771977983698411874019210
target2000200010000100002000020000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12887.80911.9790.1050.0890.0120.005nonzero1.421
pg164_o2nofp.cx9a2a_c32r12888.49211.2700.1270.0940.0120.005nonzero2.357
pg17beta3_o2nofp.cx9a2a_c32r12889.34410.3900.1500.0970.0130.005nonzero1.931
pg17rc1_o2nofp.cx9a2a_c32r12889.9879.7540.1390.0980.0160.006nonzero1.330

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1989060	0	1724	13.5	8354.0	796.4	0.001	0.007	0.004	0.410	363377	57.4	0.183	14	382.7	478.8	6.9	1.421	107058	34962	pg158_o2nofp.cx9a2a_c32r128
2004008	0	1712	13.4	8441.4	806.0	0.001	0.007	0.004	0.412	370269	57.4	0.185	14	382.7	478.8	11.7	2.357	108383	35561	pg164_o2nofp.cx9a2a_c32r128
2026342	0	1701	13.7	8542.2	813.8	0.001	0.007	0.004	0.411	369422	57.0	0.182	14	382.7	478.8	95.4	1.931	109848	27470	pg17beta3_o2nofp.cx9a2a_c32r128
2039776	0	1732	13.9	8560.9	819.2	0.001	0.007	0.004	0.411	362999	57.3	0.178	13	382.7	478.8	97.2	1.330	110081	39857	pg17rc1_o2nofp.cx9a2a_c32r128

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
2673797	0	14849	943.0	7784.5	858.6	0.006	0.361	0.003	0.329	150424	20.6	0.056	4	768.4	864.5	52.1	0.013	NA	NA	pg158_o2nofp.cx9a2a_c32r128
2875629	0	14480	915.2	7489.3	821.6	0.005	0.326	0.003	0.293	156963	21.3	0.055	4	768.4	864.5	30.9	0.437	NA	NA	pg164_o2nofp.cx9a2a_c32r128
3392706	0	11078	1077.5	8622.4	964.1	0.003	0.325	0.003	0.291	89452	23.8	0.026	3	768.4	863.7	31.2	0.071	NA	NA	pg17beta3_o2nofp.cx9a2a_c32r128
3436426	0	11401	1091.1	8913.6	983.6	0.003	0.325	0.003	0.293	89973	23.7	0.026	3	768.4	863.7	39.3	0.003	NA	NA	pg17rc1_o2nofp.cx9a2a_c32r128

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12821.00770.3928.3520.1260.1223.352
pg164_o2nofp.cx9a2a_c32r12821.84570.0897.8710.0860.1092.887
pg17beta3_o2nofp.cx9a2a_c32r12819.95070.8598.9790.1040.108nonzero4.374
pg17rc1_o2nofp.cx9a2a_c32r12821.12669.8988.7700.0940.1123.943

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r1282.3289.16226.83760.2591.3090.0430.0613.118
pg164_o2nofp.cx9a2a_c32r1282.3848.22519.98766.8302.4780.0340.0622.801
pg17beta3_o2nofp.cx9a2a_c32r1282.5308.78623.50962.6992.3600.0540.0613.033
pg17rc1_o2nofp.cx9a2a_c32r1282.5658.86121.65064.0392.7780.0490.0593.310

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
24661	0	31064	247.5	36812.6	807.2	1.260	10.279	1.493	33.516	90983	29.5	3.689	574	781.5	916.0	1.8	3.352	1299	0	pg158_o2nofp.cx9a2a_c32r128
24331	0	30718	244.9	36189.2	799.0	1.263	10.307	1.487	33.626	85551	30.6	3.516	604	781.5	877.6	2.0	2.887	1249	0	pg164_o2nofp.cx9a2a_c32r128
24525	0	31028	247.3	36654.9	801.5	1.265	10.324	1.495	33.465	85903	29.9	3.503	585	781.5	877.6	85.0	4.374	1199	0	pg17beta3_o2nofp.cx9a2a_c32r128
24316	0	30740	245.9	36359.7	797.3	1.264	10.355	1.495	33.577	85245	30.4	3.506	600	781.5	877.6	87.0	3.943	1249	0	pg17rc1_o2nofp.cx9a2a_c32r128

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r128nonzero37.78661.8780.2350.0400.0300.0270.0042.449
pg164_o2nofp.cx9a2a_c32r1280.10034.70564.8490.1510.1520.0180.0200.006nonzero4.228
pg17beta3_o2nofp.cx9a2a_c32r128nonzero42.80257.0960.0330.0290.0160.0200.0043.570
pg17rc1_o2nofp.cx9a2a_c32r1280.04040.58259.1360.0820.1100.0220.0220.0063.845

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r1280.0430.090nonzero0.08099.7850.0010.001nonzero1.053
pg164_o2nofp.cx9a2a_c32r1280.2272.7761.8920.13794.9650.0020.001nonzero1.605
pg17beta3_o2nofp.cx9a2a_c32r1280.06699.9330.001nonzero0.673
pg17rc1_o2nofp.cx9a2a_c32r1280.0971.5620.3230.05697.9610.0010.001nonzero1.920

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
2599	0	3236	28.4	4787.0	75.4	1.245	11.171	1.842	29.724	21387	30.3	8.229	5596	784.9	880.9	21.1	2.449	225	170	pg158_o2nofp.cx9a2a_c32r128
2389	0	3109	31.9	4693.4	74.9	1.302	13.655	1.965	32.130	19720	24.8	8.256	4984	784.8	880.9	3.6	4.228	215	180	pg164_o2nofp.cx9a2a_c32r128
2404	0	2925	23.3	4476.8	70.5	1.217	9.933	1.862	30.037	17975	30.6	7.477	6110	784.9	880.9	83.6	3.570	215	180	pg17beta3_o2nofp.cx9a2a_c32r128
2453	0	3078	26.8	4751.3	75.3	1.255	11.201	1.937	31.423	18439	26.8	7.516	5244	784.8	880.9	85.1	3.845	120	105	pg17rc1_o2nofp.cx9a2a_c32r128

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12899.9920.0070.001nonzerononzero0.017
pg164_o2nofp.cx9a2a_c32r12899.9930.0060.001nonzerononzerononzero0.084
pg17beta3_o2nofp.cx9a2a_c32r12899.9920.0070.001nonzerononzerononzero0.074
pg17rc1_o2nofp.cx9a2a_c32r12899.9930.0060.001nonzerononzero0.043

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12896.8793.0900.0310.212
pg164_o2nofp.cx9a2a_c32r12898.1881.7440.0670.0010.299
pg17beta3_o2nofp.cx9a2a_c32r12898.7751.2180.0070.104
pg17rc1_o2nofp.cx9a2a_c32r12898.7711.1210.0940.0140.769

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12842.20357.7100.0750.0130.019
pg164_o2nofp.cx9a2a_c32r12844.32555.4280.0820.1640.0010.080
pg17beta3_o2nofp.cx9a2a_c32r12844.77555.1290.0540.0420.030
pg17rc1_o2nofp.cx9a2a_c32r12848.04651.7420.0850.1260.0010.105

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1977	370777	2634	21.2	1370.6	37.3	0.007	0.059	0.693	19.322	1410562	43.1	3.804	56	785.0	881.0	96.3	0.017	18930	17038	pg158_o2nofp.cx9a2a_c32r128
1977	371220	2714	21.9	1263.6	36.3	0.007	0.060	0.639	18.811	1412498	42.9	3.805	55	784.9	881.0	94.5	0.084	18652	17086	pg164_o2nofp.cx9a2a_c32r128
1976	372839	2723	22.1	1211.3	35.8	0.007	0.061	0.613	18.542	1419178	43.0	3.806	55	785.0	881.0	94.5	0.074	19147	17277	pg17beta3_o2nofp.cx9a2a_c32r128
1977	376989	2718	21.9	1261.4	36.3	0.007	0.059	0.638	18.827	1434874	42.8	3.806	54	785.0	881.0	96.0	0.043	19147	17405	pg17rc1_o2nofp.cx9a2a_c32r128

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r128nonzero3.01993.9200.6742.3810.0030.0020.0023.858
pg164_o2nofp.cx9a2a_c32r128nonzero2.95194.2940.3732.3790.0010.0010.0013.464
pg17beta3_o2nofp.cx9a2a_c32r128nonzero3.01594.2340.3192.4240.0050.0010.001nonzero4.227
pg17rc1_o2nofp.cx9a2a_c32r128nonzero3.00894.2320.3532.3960.0050.0020.003nonzero4.902

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12863.61535.5260.2820.3060.2713.653
pg164_o2nofp.cx9a2a_c32r12861.71837.7220.1670.2190.1742.600
pg17beta3_o2nofp.cx9a2a_c32r12864.80834.5310.2140.1630.2720.0134.061
pg17rc1_o2nofp.cx9a2a_c32r12865.57833.1780.3790.4180.4150.0324.781

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12892.9693.3433.6350.0070.0280.0182.653
pg164_o2nofp.cx9a2a_c32r12894.3502.3073.2330.1060.0041.948
pg17beta3_o2nofp.cx9a2a_c32r12893.2643.0333.6360.0060.0360.0251.840
pg17rc1_o2nofp.cx9a2a_c32r12893.3693.2213.2630.0400.0570.0470.0034.676

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1977	9161	127620	1002.0	6634.6	76.4	13.930	112.003	3.356	39.589	288312	22.7	31.471	1189	785.1	881.2	91.7	3.858	480	32	pg158_o2nofp.cx9a2a_c32r128
1977	9376	130459	1024.4	6731.4	77.2	13.914	111.876	3.405	39.987	294200	23.2	31.377	1188	785.0	881.0	43.6	3.464	480	160	pg164_o2nofp.cx9a2a_c32r128
1976	9191	128073	1005.7	6833.4	77.8	13.934	112.045	3.459	40.316	288923	23.5	31.435	1227	785.1	881.1	90.9	4.227	479	i_qps	pg17beta3_o2nofp.cx9a2a_c32r128
1977	9060	126266	991.5	6753.3	77.2	13.937	112.063	3.416	40.010	285487	22.8	31.511	1208	785.1	881.1	92.2	4.902	479	0	pg17rc1_o2nofp.cx9a2a_c32r128

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12899.9540.0360.0070.0020.001nonzerononzerononzerononzero4.152
pg164_o2nofp.cx9a2a_c32r12899.9650.0280.0050.0010.001nonzerononzerononzero1.517
pg17beta3_o2nofp.cx9a2a_c32r12899.9630.0290.0060.0020.001nonzerononzerononzero2.765
pg17rc1_o2nofp.cx9a2a_c32r12899.9640.0280.0060.0010.001nonzerononzerononzero1.642

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12873.56825.2910.5200.4500.1660.0054.628
pg164_o2nofp.cx9a2a_c32r12886.59212.6620.3440.3310.0722.536
pg17beta3_o2nofp.cx9a2a_c32r12884.96814.1010.4270.3830.1180.0044.394
pg17rc1_o2nofp.cx9a2a_c32r12883.94715.2070.3520.3630.1313.832

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12829.98668.0061.9290.0260.0310.0210.0014.199
pg164_o2nofp.cx9a2a_c32r12834.30164.5641.1170.0050.0090.0041.875
pg17beta3_o2nofp.cx9a2a_c32r12834.18264.3341.4650.0080.0090.002nonzero4.341
pg17rc1_o2nofp.cx9a2a_c32r12839.72258.9931.2640.0060.0120.0033.566

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9804	329629	13733	110.7	14315.1	240.4	0.042	0.344	1.460	25.114	1241708	48.8	3.767	71	785.7	881.8	89.4	4.152	16686	14129	pg158_o2nofp.cx9a2a_c32r128
9868	331352	13813	111.5	14416.8	242.1	0.042	0.345	1.461	25.119	1247923	48.8	3.766	71	785.4	881.4	85.8	1.517	16942	14400	pg164_o2nofp.cx9a2a_c32r128
9847	331037	13777	111.3	14431.6	242.1	0.042	0.344	1.466	25.181	1245582	49.0	3.763	71	785.5	881.5	85.6	2.765	16958	14304	pg17beta3_o2nofp.cx9a2a_c32r128
9836	331207	13775	111.1	14361.1	241.4	0.042	0.344	1.460	25.132	1248427	48.7	3.769	71	785.5	881.6	86.4	1.642	16979	14480	pg17rc1_o2nofp.cx9a2a_c32r128

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r1280.25693.4601.9744.2840.0140.0110.0012.426
pg164_o2nofp.cx9a2a_c32r1280.30094.6110.9824.0850.0100.011nonzero1.429
pg17beta3_o2nofp.cx9a2a_c32r1280.28494.3561.1344.2070.0110.0070.0012.506
pg17rc1_o2nofp.cx9a2a_c32r1280.30294.3831.1434.1440.0160.0110.0023.977

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12849.77349.4230.4660.2960.0422.198
pg164_o2nofp.cx9a2a_c32r12848.94950.4210.3050.3080.0171.562
pg17beta3_o2nofp.cx9a2a_c32r12847.62351.8410.2890.2270.0202.215
pg17rc1_o2nofp.cx9a2a_c32r12844.61654.5550.4540.3280.0460.0014.110

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12877.17122.4780.1520.1790.0192.059
pg164_o2nofp.cx9a2a_c32r12871.76327.8550.1940.1830.0041.549
pg17beta3_o2nofp.cx9a2a_c32r12872.86726.8980.0800.1500.0051.287
pg17rc1_o2nofp.cx9a2a_c32r12875.16124.4730.1500.2070.0093.613

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9863	5712	100880	792.0	22402.2	301.5	17.660	141.982	2.271	31.304	234702	35.5	41.086	2983	786.5	882.6	36.9	2.426	304	80	pg158_o2nofp.cx9a2a_c32r128
9874	6119	106649	837.7	22506.0	302.7	17.429	140.187	2.279	31.394	246124	36.1	40.223	2832	785.9	881.9	23.8	1.429	320	96	pg164_o2nofp.cx9a2a_c32r128
9879	6013	105182	826.2	22426.2	301.7	17.492	140.702	2.270	31.275	242100	36.6	40.262	2922	785.9	882.0	24.8	2.506	304	96	pg17beta3_o2nofp.cx9a2a_c32r128
9841	5994	104656	822.1	22339.4	300.3	17.459	140.437	2.270	31.249	241320	35.7	40.257	2859	786.0	882.1	26.4	3.977	320	47	pg17rc1_o2nofp.cx9a2a_c32r128

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12899.5570.3410.0470.0380.016nonzerononzerononzero2.567
pg164_o2nofp.cx9a2a_c32r12899.6070.2990.0370.0380.019nonzerononzerononzero2.733
pg17beta3_o2nofp.cx9a2a_c32r12899.6010.3050.0380.0380.018nonzerononzerononzero3.785
pg17rc1_o2nofp.cx9a2a_c32r12899.5920.3120.0380.0390.019nonzerononzerononzerononzero4.278

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12842.82547.8529.1370.0920.0932.682
pg164_o2nofp.cx9a2a_c32r12842.61445.91211.2680.0920.1120.0024.800
pg17beta3_o2nofp.cx9a2a_c32r12841.98847.33310.4920.0750.1100.0024.371
pg17rc1_o2nofp.cx9a2a_c32r12841.65647.17511.0040.0680.0890.0085.394

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12842.26056.0351.6140.0340.0572.617
pg164_o2nofp.cx9a2a_c32r12839.88557.5542.4680.0440.0483.443
pg17beta3_o2nofp.cx9a2a_c32r12837.44360.0422.4360.0360.0443.954
pg17rc1_o2nofp.cx9a2a_c32r12836.80860.4272.6990.0260.040nonzero4.269

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19058	213552	25378	204.4	27097.7	573.0	0.119	0.980	1.422	30.786	721669	63.3	3.379	142	789.4	885.4	81.4	2.567	11428	448	pg158_o2nofp.cx9a2a_c32r128
18711	213497	24913	200.7	26872.2	568.7	0.117	0.963	1.436	31.121	713162	63.4	3.340	143	788.6	935.6	81.1	2.733	11379	1135	pg164_o2nofp.cx9a2a_c32r128
18692	213136	24939	200.8	26846.5	560.6	0.117	0.965	1.436	30.713	709000	63.4	3.327	143	788.8	884.8	79.4	3.785	11257	1550	pg17beta3_o2nofp.cx9a2a_c32r128
18740	212570	24984	201.3	26861.6	563.8	0.118	0.970	1.433	30.807	706415	63.6	3.323	144	788.6	884.7	77.9	4.278	11168	1071	pg17rc1_o2nofp.cx9a2a_c32r128

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r1280.00374.19718.4707.2350.0580.0290.0070.0014.481
pg164_o2nofp.cx9a2a_c32r1280.00378.15214.9086.8680.0400.0250.0042.820
pg17beta3_o2nofp.cx9a2a_c32r1280.00477.51115.3867.0210.0490.0240.005nonzero5.414
pg17rc1_o2nofp.cx9a2a_c32r1280.00476.95215.9117.0560.0480.0240.0050.0016.066

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r12811.43382.3385.9120.2410.0700.0064.510
pg164_o2nofp.cx9a2a_c32r12814.73681.0713.9190.2370.0362.874
pg17beta3_o2nofp.cx9a2a_c32r12814.97379.1185.6530.1990.0540.0035.445
pg17rc1_o2nofp.cx9a2a_c32r12814.12679.8475.7550.2100.0570.0066.937

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg158_o2nofp.cx9a2a_c32r1280.02799.0310.7090.1960.0350.0014.291
pg164_o2nofp.cx9a2a_c32r1280.02099.0190.7440.1930.0242.747
pg17beta3_o2nofp.cx9a2a_c32r1280.00898.7651.0330.1580.0330.0035.403
pg17rc1_o2nofp.cx9a2a_c32r1280.01298.7971.0010.1630.028nonzero5.230

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19180	3273	84472	663.5	39473.1	582.2	25.809	207.586	2.058	31.085	214641	57.2	65.581	8389	793.7	889.7	62.8	4.481	176	0	pg158_o2nofp.cx9a2a_c32r128
19544	3580	89856	705.6	40087.5	587.5	25.102	201.848	2.051	30.783	217084	59.6	60.645	7992	792.9	889.0	59.2	2.820	192	48	pg164_o2nofp.cx9a2a_c32r128
19231	3481	87773	689.2	40013.1	587.3	25.215	202.754	2.081	31.274	211410	59.5	60.733	8205	793.1	889.2	59.9	5.414	176	16	pg17beta3_o2nofp.cx9a2a_c32r128
19210	3463	87323	685.7	39761.2	584.5	25.217	202.770	2.070	31.158	210401	59.1	60.760	8192	792.9	889.0	59.1	6.066	176	i_qps	pg17rc1_o2nofp.cx9a2a_c32r128

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1989060	0	1724	13.5	8354.0	796.4	0.001	0.007	0.004	0.410	363377	57.4	0.183	14	382.7	478.8	6.9	1.421	107058	34962	pg158_o2nofp.cx9a2a_c32r128
2004008	0	1712	13.4	8441.4	806.0	0.001	0.007	0.004	0.412	370269	57.4	0.185	14	382.7	478.8	11.7	2.357	108383	35561	pg164_o2nofp.cx9a2a_c32r128
2026342	0	1701	13.7	8542.2	813.8	0.001	0.007	0.004	0.411	369422	57.0	0.182	14	382.7	478.8	95.4	1.931	109848	27470	pg17beta3_o2nofp.cx9a2a_c32r128
2039776	0	1732	13.9	8560.9	819.2	0.001	0.007	0.004	0.411	362999	57.3	0.178	13	382.7	478.8	97.2	1.330	110081	39857	pg17rc1_o2nofp.cx9a2a_c32r128

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
2673797	0	14849	943.0	7784.5	858.6	0.006	0.361	0.003	0.329	150424	20.6	0.056	4	768.4	864.5	52.1	0.013	NA	NA	pg158_o2nofp.cx9a2a_c32r128
2875629	0	14480	915.2	7489.3	821.6	0.005	0.326	0.003	0.293	156963	21.3	0.055	4	768.4	864.5	30.9	0.437	NA	NA	pg164_o2nofp.cx9a2a_c32r128
3392706	0	11078	1077.5	8622.4	964.1	0.003	0.325	0.003	0.291	89452	23.8	0.026	3	768.4	863.7	31.2	0.071	NA	NA	pg17beta3_o2nofp.cx9a2a_c32r128
3436426	0	11401	1091.1	8913.6	983.6	0.003	0.325	0.003	0.293	89973	23.7	0.026	3	768.4	863.7	39.3	0.003	NA	NA	pg17rc1_o2nofp.cx9a2a_c32r128

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
24661	0	31064	247.5	36812.6	807.2	1.260	10.279	1.493	33.516	90983	29.5	3.689	574	781.5	916.0	1.8	3.352	1299	0	pg158_o2nofp.cx9a2a_c32r128
24331	0	30718	244.9	36189.2	799.0	1.263	10.307	1.487	33.626	85551	30.6	3.516	604	781.5	877.6	2.0	2.887	1249	0	pg164_o2nofp.cx9a2a_c32r128
24525	0	31028	247.3	36654.9	801.5	1.265	10.324	1.495	33.465	85903	29.9	3.503	585	781.5	877.6	85.0	4.374	1199	0	pg17beta3_o2nofp.cx9a2a_c32r128
24316	0	30740	245.9	36359.7	797.3	1.264	10.355	1.495	33.577	85245	30.4	3.506	600	781.5	877.6	87.0	3.943	1249	0	pg17rc1_o2nofp.cx9a2a_c32r128

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
2599	0	3236	28.4	4787.0	75.4	1.245	11.171	1.842	29.724	21387	30.3	8.229	5596	784.9	880.9	21.1	2.449	225	170	pg158_o2nofp.cx9a2a_c32r128
2389	0	3109	31.9	4693.4	74.9	1.302	13.655	1.965	32.130	19720	24.8	8.256	4984	784.8	880.9	3.6	4.228	215	180	pg164_o2nofp.cx9a2a_c32r128
2404	0	2925	23.3	4476.8	70.5	1.217	9.933	1.862	30.037	17975	30.6	7.477	6110	784.9	880.9	83.6	3.570	215	180	pg17beta3_o2nofp.cx9a2a_c32r128
2453	0	3078	26.8	4751.3	75.3	1.255	11.201	1.937	31.423	18439	26.8	7.516	5244	784.8	880.9	85.1	3.845	120	105	pg17rc1_o2nofp.cx9a2a_c32r128

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1977	370777	2634	21.2	1370.6	37.3	0.007	0.059	0.693	19.322	1410562	43.1	3.804	56	785.0	881.0	96.3	0.017	18930	17038	pg158_o2nofp.cx9a2a_c32r128
1977	371220	2714	21.9	1263.6	36.3	0.007	0.060	0.639	18.811	1412498	42.9	3.805	55	784.9	881.0	94.5	0.084	18652	17086	pg164_o2nofp.cx9a2a_c32r128
1976	372839	2723	22.1	1211.3	35.8	0.007	0.061	0.613	18.542	1419178	43.0	3.806	55	785.0	881.0	94.5	0.074	19147	17277	pg17beta3_o2nofp.cx9a2a_c32r128
1977	376989	2718	21.9	1261.4	36.3	0.007	0.059	0.638	18.827	1434874	42.8	3.806	54	785.0	881.0	96.0	0.043	19147	17405	pg17rc1_o2nofp.cx9a2a_c32r128

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1977	9161	127620	1002.0	6634.6	76.4	13.930	112.003	3.356	39.589	288312	22.7	31.471	1189	785.1	881.2	91.7	3.858	480	32	pg158_o2nofp.cx9a2a_c32r128
1977	9376	130459	1024.4	6731.4	77.2	13.914	111.876	3.405	39.987	294200	23.2	31.377	1188	785.0	881.0	43.6	3.464	480	160	pg164_o2nofp.cx9a2a_c32r128
1976	9191	128073	1005.7	6833.4	77.8	13.934	112.045	3.459	40.316	288923	23.5	31.435	1227	785.1	881.1	90.9	4.227	479	i_qps	pg17beta3_o2nofp.cx9a2a_c32r128
1977	9060	126266	991.5	6753.3	77.2	13.937	112.063	3.416	40.010	285487	22.8	31.511	1208	785.1	881.1	92.2	4.902	479	0	pg17rc1_o2nofp.cx9a2a_c32r128

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9804	329629	13733	110.7	14315.1	240.4	0.042	0.344	1.460	25.114	1241708	48.8	3.767	71	785.7	881.8	89.4	4.152	16686	14129	pg158_o2nofp.cx9a2a_c32r128
9868	331352	13813	111.5	14416.8	242.1	0.042	0.345	1.461	25.119	1247923	48.8	3.766	71	785.4	881.4	85.8	1.517	16942	14400	pg164_o2nofp.cx9a2a_c32r128
9847	331037	13777	111.3	14431.6	242.1	0.042	0.344	1.466	25.181	1245582	49.0	3.763	71	785.5	881.5	85.6	2.765	16958	14304	pg17beta3_o2nofp.cx9a2a_c32r128
9836	331207	13775	111.1	14361.1	241.4	0.042	0.344	1.460	25.132	1248427	48.7	3.769	71	785.5	881.6	86.4	1.642	16979	14480	pg17rc1_o2nofp.cx9a2a_c32r128

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
9863	5712	100880	792.0	22402.2	301.5	17.660	141.982	2.271	31.304	234702	35.5	41.086	2983	786.5	882.6	36.9	2.426	304	80	pg158_o2nofp.cx9a2a_c32r128
9874	6119	106649	837.7	22506.0	302.7	17.429	140.187	2.279	31.394	246124	36.1	40.223	2832	785.9	881.9	23.8	1.429	320	96	pg164_o2nofp.cx9a2a_c32r128
9879	6013	105182	826.2	22426.2	301.7	17.492	140.702	2.270	31.275	242100	36.6	40.262	2922	785.9	882.0	24.8	2.506	304	96	pg17beta3_o2nofp.cx9a2a_c32r128
9841	5994	104656	822.1	22339.4	300.3	17.459	140.437	2.270	31.249	241320	35.7	40.257	2859	786.0	882.1	26.4	3.977	320	47	pg17rc1_o2nofp.cx9a2a_c32r128

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19058	213552	25378	204.4	27097.7	573.0	0.119	0.980	1.422	30.786	721669	63.3	3.379	142	789.4	885.4	81.4	2.567	11428	448	pg158_o2nofp.cx9a2a_c32r128
18711	213497	24913	200.7	26872.2	568.7	0.117	0.963	1.436	31.121	713162	63.4	3.340	143	788.6	935.6	81.1	2.733	11379	1135	pg164_o2nofp.cx9a2a_c32r128
18692	213136	24939	200.8	26846.5	560.6	0.117	0.965	1.436	30.713	709000	63.4	3.327	143	788.8	884.8	79.4	3.785	11257	1550	pg17beta3_o2nofp.cx9a2a_c32r128
18740	212570	24984	201.3	26861.6	563.8	0.118	0.970	1.433	30.807	706415	63.6	3.323	144	788.6	884.7	77.9	4.278	11168	1071	pg17rc1_o2nofp.cx9a2a_c32r128

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
19180	3273	84472	663.5	39473.1	582.2	25.809	207.586	2.058	31.085	214641	57.2	65.581	8389	793.7	889.7	62.8	4.481	176	0	pg158_o2nofp.cx9a2a_c32r128
19544	3580	89856	705.6	40087.5	587.5	25.102	201.848	2.051	30.783	217084	59.6	60.645	7992	792.9	889.0	59.2	2.820	192	48	pg164_o2nofp.cx9a2a_c32r128
19231	3481	87773	689.2	40013.1	587.3	25.215	202.754	2.081	31.274	211410	59.5	60.733	8205	793.1	889.2	59.9	5.414	176	16	pg17beta3_o2nofp.cx9a2a_c32r128
19210	3463	87323	685.7	39761.2	584.5	25.217	202.770	2.070	31.158	210401	59.1	60.760	8192	792.9	889.0	59.1	6.066	176	i_qps	pg17rc1_o2nofp.cx9a2a_c32r128

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	87.809	11.979	0.105	0.089	0.012	0.005	nonzero	0.000	0.000	1.421	pg158_o2nofp.cx9a2a_c32r128
0.000	88.492	11.270	0.127	0.094	0.012	0.005	nonzero	0.000	0.000	2.357	pg164_o2nofp.cx9a2a_c32r128
0.000	89.344	10.390	0.150	0.097	0.013	0.005	nonzero	0.000	0.000	1.931	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	89.987	9.754	0.139	0.098	0.016	0.006	nonzero	0.000	0.000	1.330	pg17rc1_o2nofp.cx9a2a_c32r128

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	21.007	70.392	8.352	0.126	0.122	0.000	0.000	3.352	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	21.845	70.089	7.871	0.086	0.109	0.000	0.000	2.887	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	19.950	70.859	8.979	0.104	0.108	nonzero	0.000	4.374	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	21.126	69.898	8.770	0.094	0.112	0.000	0.000	3.943	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.328	9.162	26.837	60.259	1.309	0.043	0.061	0.000	0.000	3.118	pg158_o2nofp.cx9a2a_c32r128
0.000	2.384	8.225	19.987	66.830	2.478	0.034	0.062	0.000	0.000	2.801	pg164_o2nofp.cx9a2a_c32r128
0.000	2.530	8.786	23.509	62.699	2.360	0.054	0.061	0.000	0.000	3.033	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	2.565	8.861	21.650	64.039	2.778	0.049	0.059	0.000	0.000	3.310	pg17rc1_o2nofp.cx9a2a_c32r128

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
nonzero	37.786	61.878	0.235	0.040	0.030	0.027	0.004	0.000	0.000	2.449	pg158_o2nofp.cx9a2a_c32r128
0.100	34.705	64.849	0.151	0.152	0.018	0.020	0.006	nonzero	0.000	4.228	pg164_o2nofp.cx9a2a_c32r128
nonzero	42.802	57.096	0.033	0.029	0.016	0.020	0.004	0.000	0.000	3.570	pg17beta3_o2nofp.cx9a2a_c32r128
0.040	40.582	59.136	0.082	0.110	0.022	0.022	0.006	0.000	0.000	3.845	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.043	0.090	nonzero	0.080	99.785	0.001	0.001	nonzero	0.000	0.000	1.053	pg158_o2nofp.cx9a2a_c32r128
0.227	2.776	1.892	0.137	94.965	0.002	0.001	nonzero	0.000	0.000	1.605	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	0.066	99.933	0.001	nonzero	0.000	0.000	0.000	0.673	pg17beta3_o2nofp.cx9a2a_c32r128
0.097	1.562	0.323	0.056	97.961	0.001	0.001	nonzero	0.000	0.000	1.920	pg17rc1_o2nofp.cx9a2a_c32r128

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.992	0.007	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	pg158_o2nofp.cx9a2a_c32r128
99.993	0.006	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.084	pg164_o2nofp.cx9a2a_c32r128
99.992	0.007	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.074	pg17beta3_o2nofp.cx9a2a_c32r128
99.993	0.006	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.043	pg17rc1_o2nofp.cx9a2a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	96.879	3.090	0.031	0.000	0.000	0.000	0.000	0.212	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	98.188	1.744	0.067	0.001	0.000	0.000	0.000	0.299	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	98.775	1.218	0.007	0.000	0.000	0.000	0.000	0.104	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	98.771	1.121	0.094	0.014	0.000	0.000	0.000	0.769	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	42.203	57.710	0.075	0.013	0.000	0.000	0.000	0.000	0.000	0.019	pg158_o2nofp.cx9a2a_c32r128
0.000	44.325	55.428	0.082	0.164	0.001	0.000	0.000	0.000	0.000	0.080	pg164_o2nofp.cx9a2a_c32r128
0.000	44.775	55.129	0.054	0.042	0.000	0.000	0.000	0.000	0.000	0.030	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	48.046	51.742	0.085	0.126	0.001	0.000	0.000	0.000	0.000	0.105	pg17rc1_o2nofp.cx9a2a_c32r128

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
nonzero	3.019	93.920	0.674	2.381	0.003	0.002	0.002	0.000	0.000	3.858	pg158_o2nofp.cx9a2a_c32r128
nonzero	2.951	94.294	0.373	2.379	0.001	0.001	0.001	0.000	0.000	3.464	pg164_o2nofp.cx9a2a_c32r128
nonzero	3.015	94.234	0.319	2.424	0.005	0.001	0.001	nonzero	0.000	4.227	pg17beta3_o2nofp.cx9a2a_c32r128
nonzero	3.008	94.232	0.353	2.396	0.005	0.002	0.003	nonzero	0.000	4.902	pg17rc1_o2nofp.cx9a2a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	63.615	35.526	0.282	0.306	0.271	0.000	0.000	3.653	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	61.718	37.722	0.167	0.219	0.174	0.000	0.000	2.600	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	64.808	34.531	0.214	0.163	0.272	0.013	0.000	4.061	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	65.578	33.178	0.379	0.418	0.415	0.032	0.000	4.781	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	92.969	3.343	3.635	0.007	0.028	0.018	0.000	0.000	2.653	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	94.350	2.307	3.233	0.000	0.106	0.004	0.000	0.000	1.948	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	93.264	3.033	3.636	0.006	0.036	0.025	0.000	0.000	1.840	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	93.369	3.221	3.263	0.040	0.057	0.047	0.003	0.000	4.676	pg17rc1_o2nofp.cx9a2a_c32r128

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.954	0.036	0.007	0.002	0.001	nonzero	nonzero	nonzero	nonzero	0.000	4.152	pg158_o2nofp.cx9a2a_c32r128
99.965	0.028	0.005	0.001	0.001	nonzero	nonzero	nonzero	0.000	0.000	1.517	pg164_o2nofp.cx9a2a_c32r128
99.963	0.029	0.006	0.002	0.001	nonzero	nonzero	nonzero	0.000	0.000	2.765	pg17beta3_o2nofp.cx9a2a_c32r128
99.964	0.028	0.006	0.001	0.001	nonzero	nonzero	nonzero	0.000	0.000	1.642	pg17rc1_o2nofp.cx9a2a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	73.568	25.291	0.520	0.450	0.166	0.005	0.000	4.628	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	86.592	12.662	0.344	0.331	0.072	0.000	0.000	2.536	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	84.968	14.101	0.427	0.383	0.118	0.004	0.000	4.394	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	83.947	15.207	0.352	0.363	0.131	0.000	0.000	3.832	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	29.986	68.006	1.929	0.026	0.031	0.021	0.001	0.000	4.199	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	34.301	64.564	1.117	0.005	0.009	0.004	0.000	0.000	1.875	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	34.182	64.334	1.465	0.008	0.009	0.002	nonzero	0.000	4.341	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	39.722	58.993	1.264	0.006	0.012	0.003	0.000	0.000	3.566	pg17rc1_o2nofp.cx9a2a_c32r128

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.256	93.460	1.974	4.284	0.014	0.011	0.001	0.000	0.000	2.426	pg158_o2nofp.cx9a2a_c32r128
0.000	0.300	94.611	0.982	4.085	0.010	0.011	nonzero	0.000	0.000	1.429	pg164_o2nofp.cx9a2a_c32r128
0.000	0.284	94.356	1.134	4.207	0.011	0.007	0.001	0.000	0.000	2.506	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.302	94.383	1.143	4.144	0.016	0.011	0.002	0.000	0.000	3.977	pg17rc1_o2nofp.cx9a2a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	49.773	49.423	0.466	0.296	0.042	0.000	0.000	2.198	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	48.949	50.421	0.305	0.308	0.017	0.000	0.000	1.562	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	47.623	51.841	0.289	0.227	0.020	0.000	0.000	2.215	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	44.616	54.555	0.454	0.328	0.046	0.001	0.000	4.110	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	77.171	22.478	0.152	0.179	0.019	0.000	0.000	2.059	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	71.763	27.855	0.194	0.183	0.004	0.000	0.000	1.549	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	72.867	26.898	0.080	0.150	0.005	0.000	0.000	1.287	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	75.161	24.473	0.150	0.207	0.009	0.000	0.000	3.613	pg17rc1_o2nofp.cx9a2a_c32r128

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.557	0.341	0.047	0.038	0.016	nonzero	nonzero	nonzero	0.000	0.000	2.567	pg158_o2nofp.cx9a2a_c32r128
99.607	0.299	0.037	0.038	0.019	nonzero	nonzero	nonzero	0.000	0.000	2.733	pg164_o2nofp.cx9a2a_c32r128
99.601	0.305	0.038	0.038	0.018	nonzero	nonzero	nonzero	0.000	0.000	3.785	pg17beta3_o2nofp.cx9a2a_c32r128
99.592	0.312	0.038	0.039	0.019	nonzero	nonzero	nonzero	nonzero	0.000	4.278	pg17rc1_o2nofp.cx9a2a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	42.825	47.852	9.137	0.092	0.093	0.000	0.000	2.682	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	42.614	45.912	11.268	0.092	0.112	0.002	0.000	4.800	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	41.988	47.333	10.492	0.075	0.110	0.002	0.000	4.371	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	41.656	47.175	11.004	0.068	0.089	0.008	0.000	5.394	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	42.260	56.035	1.614	0.034	0.057	0.000	0.000	2.617	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	39.885	57.554	2.468	0.044	0.048	0.000	0.000	3.443	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	37.443	60.042	2.436	0.036	0.044	0.000	0.000	3.954	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	36.808	60.427	2.699	0.026	0.040	nonzero	0.000	4.269	pg17rc1_o2nofp.cx9a2a_c32r128

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.003	74.197	18.470	7.235	0.058	0.029	0.007	0.001	0.000	4.481	pg158_o2nofp.cx9a2a_c32r128
0.000	0.003	78.152	14.908	6.868	0.040	0.025	0.004	0.000	0.000	2.820	pg164_o2nofp.cx9a2a_c32r128
0.000	0.004	77.511	15.386	7.021	0.049	0.024	0.005	nonzero	0.000	5.414	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.004	76.952	15.911	7.056	0.048	0.024	0.005	0.001	0.000	6.066	pg17rc1_o2nofp.cx9a2a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	11.433	82.338	5.912	0.241	0.070	0.006	0.000	4.510	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	14.736	81.071	3.919	0.237	0.036	0.000	0.000	2.874	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	14.973	79.118	5.653	0.199	0.054	0.003	0.000	5.445	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	14.126	79.847	5.755	0.210	0.057	0.006	0.000	6.937	pg17rc1_o2nofp.cx9a2a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.027	99.031	0.709	0.196	0.035	0.001	0.000	4.291	pg158_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	0.020	99.019	0.744	0.193	0.024	0.000	0.000	2.747	pg164_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	0.008	98.765	1.033	0.158	0.033	0.003	0.000	5.403	pg17beta3_o2nofp.cx9a2a_c32r128
0.000	0.000	0.000	0.012	98.797	1.001	0.163	0.028	nonzero	0.000	5.230	pg17rc1_o2nofp.cx9a2a_c32r128