Introduction

This is a report for the insert benchmark with 50M docs and 1 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 32G RAM and an NVMe SSD. It is described here as the ASUS PN53. The benchmark was run with 1 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 1 table. It loads 50M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 40m+10m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 3600s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
pg163_def.cx9a2_c8r32 149254384616128621409154936240137696191140836268
pg163_def.cx9a2vic_c8r32 138504378789109681237144665765131135729133615642
pg163_def.cx9a2nofpw_c8r32 149700381680123571407153496200133646135138896140
pg163_def.cx9a2nofpwvic_c8r32 137741378789116241278143885749130995715134825714

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
pg163_def.cx9a2_c8r32 1.001.001.001.001.001.001.001.001.001.00
pg163_def.cx9a2vic_c8r32 0.930.980.850.880.930.920.950.930.950.90
pg163_def.cx9a2nofpw_c8r32 1.000.990.961.000.990.990.970.990.990.98
pg163_def.cx9a2nofpwvic_c8r32 0.920.980.900.910.930.920.950.920.960.91

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
pg163_def.cx9a2_c8r32100100499499999999
pg163_def.cx9a2vic_c8r32100100499499999999
pg163_def.cx9a2nofpw_c8r32100100499499999999
pg163_def.cx9a2nofpwvic_c8r32100100499499999999
target10010050050010001000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.9290.0710.002
pg163_def.cx9a2vic_c8r3299.9170.0830.003
pg163_def.cx9a2nofpw_c8r3299.9350.0650.002
pg163_def.cx9a2nofpwvic_c8r3299.9160.0840.002

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
149254	0	0	0.0	552.7	63.4	0.000	0.000	0.004	0.435	18645	22.5	0.125	12	4.8	13.0	0.4	0.002	149938	148637	pg163_def.cx9a2_c8r32
138504	0	0	0.0	517.2	59.6	0.000	0.000	0.004	0.440	17375	21.1	0.125	12	4.8	13.0	0.0	0.003	139051	137580	pg163_def.cx9a2vic_c8r32
149700	0	0	0.0	552.8	63.4	0.000	0.000	0.004	0.434	18581	22.6	0.124	12	4.8	13.0	0.4	0.002	149939	148737	pg163_def.cx9a2nofpw_c8r32
137741	0	0	0.0	512.1	58.9	0.000	0.000	0.004	0.438	17194	20.9	0.125	12	4.8	13.0	0.4	0.002	137652	136246	pg163_def.cx9a2nofpwvic_c8r32

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
384616	0	0	0.0	961.3	118.8	0.000	0.000	0.002	0.316	678	11.7	0.002	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2_c8r32
378789	0	0	0.0	951.9	117.7	0.000	0.000	0.003	0.318	637	11.3	0.002	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2vic_c8r32
381680	0	0	0.0	959.3	118.6	0.000	0.000	0.003	0.318	609	11.8	0.002	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2nofpw_c8r32
378789	0	0	0.0	917.6	113.5	0.000	0.000	0.002	0.307	545	11.6	0.001	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2nofpwvic_c8r32

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3221.57778.4170.0050.0020.020
pg163_def.cx9a2vic_c8r323.20996.790nonzero0.005
pg163_def.cx9a2nofpw_c8r3221.31378.687nonzero0.011
pg163_def.cx9a2nofpwvic_c8r321.16598.835nonzero0.014

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3214.85030.12655.0220.0020.020
pg163_def.cx9a2vic_c8r3212.35625.04862.595nonzero0.017
pg163_def.cx9a2nofpw_c8r3214.84137.94247.2170.012
pg163_def.cx9a2nofpwvic_c8r3212.28334.43753.2790.015

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
12862	0	0	0.0	185.7	20.4	0.000	0.000	0.014	1.625	6894	18.8	0.536	117	12.3	48.9	11.0	0.020	9043	6296	pg163_def.cx9a2_c8r32
10968	0	0	0.0	172.6	18.0	0.000	0.000	0.016	1.685	5711	20.1	0.521	147	12.2	45.6	8.8	0.005	8141	5647	pg163_def.cx9a2vic_c8r32
12357	0	0	0.0	148.0	16.0	0.000	0.000	0.012	1.322	6546	18.4	0.530	119	12.3	42.7	9.6	0.011	8491	4547	pg163_def.cx9a2nofpw_c8r32
11624	0	0	0.0	148.3	15.0	0.000	0.000	0.013	1.322	5983	20.8	0.515	143	12.2	41.5	9.7	0.014	9439	6243	pg163_def.cx9a2nofpwvic_c8r32

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3226.04073.9600.001nonzero0.005
pg163_def.cx9a2vic_c8r3216.79883.2010.0010.002
pg163_def.cx9a2nofpw_c8r3224.05575.9440.0010.002
pg163_def.cx9a2nofpwvic_c8r3212.68787.3110.0020.002

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r320.87516.65233.45149.0220.013
pg163_def.cx9a2vic_c8r321.22514.17833.77450.824nonzero0.016
pg163_def.cx9a2nofpw_c8r320.62816.61535.69547.0620.010
pg163_def.cx9a2nofpwvic_c8r320.6978.62545.60545.073nonzero0.018

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1409	0	0	0.0	62.3	5.7	0.000	0.000	0.044	4.144	6882	14.4	4.884	817	12.7	46.7	0.1	0.005	1034	744	pg163_def.cx9a2_c8r32
1237	0	0	0.0	64.1	5.2	0.000	0.000	0.052	4.286	5839	15.7	4.718	1015	12.6	44.7	11.8	0.002	964	644	pg163_def.cx9a2vic_c8r32
1407	0	0	0.0	47.8	3.8	0.000	0.000	0.034	2.786	6874	14.4	4.886	819	12.7	43.1	0.8	0.002	1059	739	pg163_def.cx9a2nofpw_c8r32
1278	0	0	0.0	40.5	3.8	0.000	0.000	0.032	3.013	6022	15.8	4.712	989	12.6	42.0	0.4	0.002	945	654	pg163_def.cx9a2nofpwvic_c8r32

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r32100.000nonzerononzero0.002
pg163_def.cx9a2vic_c8r3299.9810.019nonzerononzero0.005
pg163_def.cx9a2nofpw_c8r32100.000nonzerononzero0.002
pg163_def.cx9a2nofpwvic_c8r3299.9810.019nonzero0.001

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.9720.0280.006
pg163_def.cx9a2vic_c8r3299.9720.0280.006
pg163_def.cx9a2nofpw_c8r3210.81989.1670.0140.005
pg163_def.cx9a2nofpwvic_c8r3299.9720.0280.005

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3224.22275.7780.004
pg163_def.cx9a2vic_c8r3222.23677.7640.004
pg163_def.cx9a2nofpw_c8r3229.40370.5970.003
pg163_def.cx9a2nofpwvic_c8r3222.29277.7080.003

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	15493	0	0.0	52.1	1.4	0.000	0.000	0.522	14.811	59342	12.8	3.830	66	12.7	42.8	0.5	0.002	15503	15183	pg163_def.cx9a2_c8r32
100	14466	0	0.0	51.9	1.4	0.000	0.000	0.520	14.864	55423	11.2	3.831	62	12.7	39.0	0.5	0.005	14351	13997	pg163_def.cx9a2vic_c8r32
100	15349	0	0.0	46.0	0.6	0.000	0.000	0.461	6.572	58812	12.8	3.832	67	12.7	41.8	0.5	0.002	15343	15039	pg163_def.cx9a2nofpw_c8r32
100	14388	0	0.0	45.9	0.6	0.000	0.000	0.460	6.622	55106	11.2	3.830	62	12.7	40.1	0.5	0.001	14220	13917	pg163_def.cx9a2nofpwvic_c8r32

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.9850.015nonzero0.002
pg163_def.cx9a2vic_c8r3295.9234.077nonzero0.002
pg163_def.cx9a2nofpw_c8r3299.9860.014nonzero0.003
pg163_def.cx9a2nofpwvic_c8r3295.8284.172nonzero0.001

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.9720.0280.006
pg163_def.cx9a2vic_c8r3299.9720.0280.005
pg163_def.cx9a2nofpw_c8r3299.9860.0140.005
pg163_def.cx9a2nofpwvic_c8r3299.9720.0280.005

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3292.0287.9720.011
pg163_def.cx9a2vic_c8r3295.7644.2360.011
pg163_def.cx9a2nofpw_c8r3297.0282.9720.011
pg163_def.cx9a2nofpwvic_c8r3296.6253.3750.011

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	6240	0	0.0	84.3	1.8	0.000	0.000	0.844	18.825	25342	13.4	4.062	172	12.7	39.8	0.4	0.002	6233	6153	pg163_def.cx9a2_c8r32
100	5765	0	0.0	84.0	1.8	0.000	0.000	0.842	18.898	23444	13.0	4.067	180	12.7	36.1	0.5	0.002	5769	5658	pg163_def.cx9a2vic_c8r32
100	6200	0	0.0	78.4	1.0	0.000	0.000	0.785	10.544	25177	13.4	4.061	173	12.7	41.7	3.0	0.003	6201	6137	pg163_def.cx9a2nofpw_c8r32
100	5749	0	0.0	78.1	1.0	0.000	0.000	0.783	10.581	23373	13.0	4.066	181	12.7	40.0	0.5	0.001	5753	5631	pg163_def.cx9a2nofpwvic_c8r32

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.9990.001nonzerononzerononzero0.019
pg163_def.cx9a2vic_c8r3299.9800.020nonzerononzerononzero0.025
pg163_def.cx9a2nofpw_c8r3299.9990.001nonzerononzero0.005
pg163_def.cx9a2nofpwvic_c8r3299.9810.019nonzerononzero0.005

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3215.25084.6970.0360.0170.032
pg163_def.cx9a2vic_c8r320.31199.6390.0170.0330.027
pg163_def.cx9a2nofpw_c8r3243.96956.0250.0060.005
pg163_def.cx9a2nofpwvic_c8r320.74299.2530.0060.005

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r320.80630.68668.4890.0190.021
pg163_def.cx9a2vic_c8r320.94727.17271.8500.0310.026
pg163_def.cx9a2nofpw_c8r321.02232.09766.8810.015
pg163_def.cx9a2nofpwvic_c8r320.58326.95072.4670.014

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	13769	0	0.0	89.5	4.4	0.000	0.000	0.179	9.008	52919	13.3	3.843	77	12.8	35.4	2.2	0.019	13729	12786	pg163_def.cx9a2_c8r32
499	13113	0	0.0	89.5	4.4	0.000	0.000	0.179	9.045	50385	12.1	3.842	74	12.9	32.9	10.0	0.025	13073	12130	pg163_def.cx9a2vic_c8r32
499	13364	0	0.0	68.0	1.9	0.000	0.000	0.136	3.972	51362	13.2	3.843	79	12.8	41.3	10.5	0.005	13345	12435	pg163_def.cx9a2nofpw_c8r32
499	13099	0	0.0	67.9	2.0	0.000	0.000	0.136	4.015	50343	12.2	3.843	75	12.9	39.7	6.1	0.005	13065	12146	pg163_def.cx9a2nofpwvic_c8r32

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.9710.029nonzero0.002
pg163_def.cx9a2vic_c8r3295.8874.113nonzero0.002
pg163_def.cx9a2nofpw_c8r3299.9700.030nonzero0.002
pg163_def.cx9a2nofpwvic_c8r3295.8334.167nonzero0.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3212.01787.9810.0030.006
pg163_def.cx9a2vic_c8r320.33999.6560.0060.006
pg163_def.cx9a2nofpw_c8r3219.94480.0530.0030.006
pg163_def.cx9a2nofpwvic_c8r320.66999.3250.0060.006

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r328.79463.70027.5060.007
pg163_def.cx9a2vic_c8r326.61958.54234.8390.007
pg163_def.cx9a2nofpw_c8r328.83962.85828.3030.007
pg163_def.cx9a2nofpwvic_c8r327.10859.04433.8470.007

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	6191	0	0.0	70.6	3.3	0.000	0.000	0.141	6.801	25286	13.7	4.084	177	12.8	32.9	0.8	0.002	6185	6108	pg163_def.cx9a2_c8r32
499	5729	0	0.0	70.2	3.3	0.000	0.000	0.141	6.810	23427	13.8	4.089	193	12.9	32.9	6.1	0.002	5736	5614	pg163_def.cx9a2vic_c8r32
499	6135	0	0.0	62.7	2.4	0.000	0.000	0.126	4.946	25057	13.5	4.084	176	12.8	40.4	6.1	0.002	6137	6057	pg163_def.cx9a2nofpw_c8r32
499	5715	0	0.0	62.4	2.4	0.000	0.000	0.125	4.977	23371	13.9	4.089	195	12.9	38.8	1.0	0.002	5720	5608	pg163_def.cx9a2nofpwvic_c8r32

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.999nonzero0.001nonzero0.013
pg163_def.cx9a2vic_c8r3299.9750.0240.001nonzero0.013
pg163_def.cx9a2nofpw_c8r3299.999nonzero0.001nonzero0.013
pg163_def.cx9a2nofpwvic_c8r3299.9750.0240.001nonzero0.012

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3237.29762.7000.0030.006
pg163_def.cx9a2vic_c8r325.82694.1710.0030.006
pg163_def.cx9a2nofpw_c8r3246.98653.0120.0010.005
pg163_def.cx9a2nofpwvic_c8r326.20793.7900.0030.005

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r329.98641.21948.7930.0010.021
pg163_def.cx9a2vic_c8r328.07239.26552.6610.0010.019
pg163_def.cx9a2nofpw_c8r329.81841.08649.0940.0010.020
pg163_def.cx9a2nofpwvic_c8r327.93139.10352.9650.0010.019

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
999	14083	0	0.0	75.8	4.8	0.000	0.000	0.076	4.917	54368	14.0	3.861	80	12.9	32.9	3.0	0.013	13937	12722	pg163_def.cx9a2_c8r32
999	13361	0	0.0	75.4	4.8	0.000	0.000	0.075	4.913	51575	13.1	3.860	78	13.0	33.0	11.9	0.013	13318	12098	pg163_def.cx9a2vic_c8r32
999	13889	0	0.0	58.4	2.9	0.000	0.000	0.059	2.987	53638	13.9	3.862	80	12.9	39.2	3.0	0.013	13745	12530	pg163_def.cx9a2nofpw_c8r32
999	13482	0	0.0	58.1	2.9	0.000	0.000	0.058	2.984	52046	13.1	3.860	78	13.0	37.6	10.7	0.012	13470	12239	pg163_def.cx9a2nofpwvic_c8r32

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3299.9560.044nonzerononzerononzero0.033
pg163_def.cx9a2vic_c8r3295.7444.256nonzero0.002
pg163_def.cx9a2nofpw_c8r3299.9500.050nonzero0.002
pg163_def.cx9a2nofpwvic_c8r3295.8664.133nonzero0.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r3218.24981.7420.0060.0040.022
pg163_def.cx9a2vic_c8r322.93997.0510.0060.0040.019
pg163_def.cx9a2nofpw_c8r3224.67275.3260.0010.005
pg163_def.cx9a2nofpwvic_c8r322.19297.8060.0030.005

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_def.cx9a2_c8r324.84962.71432.4350.0030.019
pg163_def.cx9a2vic_c8r324.14452.78943.0640.0030.018
pg163_def.cx9a2nofpw_c8r324.78962.14933.0620.009
pg163_def.cx9a2nofpwvic_c8r324.13153.14442.7250.009

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
999	6268	0	0.0	57.7	4.8	0.000	0.000	0.058	4.967	25846	14.4	4.123	184	12.9	32.9	6.4	0.033	6268	6153	pg163_def.cx9a2_c8r32
999	5642	0	0.0	57.4	4.8	0.000	0.000	0.057	4.968	23321	14.6	4.133	207	13.0	33.0	6.4	0.002	5642	5530	pg163_def.cx9a2vic_c8r32
999	6140	0	0.0	41.6	3.1	0.000	0.000	0.042	3.194	25312	14.4	4.123	188	13.0	37.6	10.6	0.002	6137	6073	pg163_def.cx9a2nofpw_c8r32
999	5714	0	0.0	41.3	3.1	0.000	0.000	0.041	3.174	23596	14.6	4.130	204	13.0	35.9	6.4	0.002	5720	5594	pg163_def.cx9a2nofpwvic_c8r32

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
149254	0	0	0.0	552.7	63.4	0.000	0.000	0.004	0.435	18645	22.5	0.125	12	4.8	13.0	0.4	0.002	149938	148637	pg163_def.cx9a2_c8r32
138504	0	0	0.0	517.2	59.6	0.000	0.000	0.004	0.440	17375	21.1	0.125	12	4.8	13.0	0.0	0.003	139051	137580	pg163_def.cx9a2vic_c8r32
149700	0	0	0.0	552.8	63.4	0.000	0.000	0.004	0.434	18581	22.6	0.124	12	4.8	13.0	0.4	0.002	149939	148737	pg163_def.cx9a2nofpw_c8r32
137741	0	0	0.0	512.1	58.9	0.000	0.000	0.004	0.438	17194	20.9	0.125	12	4.8	13.0	0.4	0.002	137652	136246	pg163_def.cx9a2nofpwvic_c8r32

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
384616	0	0	0.0	961.3	118.8	0.000	0.000	0.002	0.316	678	11.7	0.002	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2_c8r32
378789	0	0	0.0	951.9	117.7	0.000	0.000	0.003	0.318	637	11.3	0.002	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2vic_c8r32
381680	0	0	0.0	959.3	118.6	0.000	0.000	0.003	0.318	609	11.8	0.002	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2nofpw_c8r32
378789	0	0	0.0	917.6	113.5	0.000	0.000	0.002	0.307	545	11.6	0.001	2	9.6	22.2	5.0	0.002	NA	NA	pg163_def.cx9a2nofpwvic_c8r32

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
12862	0	0	0.0	185.7	20.4	0.000	0.000	0.014	1.625	6894	18.8	0.536	117	12.3	48.9	11.0	0.020	9043	6296	pg163_def.cx9a2_c8r32
10968	0	0	0.0	172.6	18.0	0.000	0.000	0.016	1.685	5711	20.1	0.521	147	12.2	45.6	8.8	0.005	8141	5647	pg163_def.cx9a2vic_c8r32
12357	0	0	0.0	148.0	16.0	0.000	0.000	0.012	1.322	6546	18.4	0.530	119	12.3	42.7	9.6	0.011	8491	4547	pg163_def.cx9a2nofpw_c8r32
11624	0	0	0.0	148.3	15.0	0.000	0.000	0.013	1.322	5983	20.8	0.515	143	12.2	41.5	9.7	0.014	9439	6243	pg163_def.cx9a2nofpwvic_c8r32

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1409	0	0	0.0	62.3	5.7	0.000	0.000	0.044	4.144	6882	14.4	4.884	817	12.7	46.7	0.1	0.005	1034	744	pg163_def.cx9a2_c8r32
1237	0	0	0.0	64.1	5.2	0.000	0.000	0.052	4.286	5839	15.7	4.718	1015	12.6	44.7	11.8	0.002	964	644	pg163_def.cx9a2vic_c8r32
1407	0	0	0.0	47.8	3.8	0.000	0.000	0.034	2.786	6874	14.4	4.886	819	12.7	43.1	0.8	0.002	1059	739	pg163_def.cx9a2nofpw_c8r32
1278	0	0	0.0	40.5	3.8	0.000	0.000	0.032	3.013	6022	15.8	4.712	989	12.6	42.0	0.4	0.002	945	654	pg163_def.cx9a2nofpwvic_c8r32

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	15493	0	0.0	52.1	1.4	0.000	0.000	0.522	14.811	59342	12.8	3.830	66	12.7	42.8	0.5	0.002	15503	15183	pg163_def.cx9a2_c8r32
100	14466	0	0.0	51.9	1.4	0.000	0.000	0.520	14.864	55423	11.2	3.831	62	12.7	39.0	0.5	0.005	14351	13997	pg163_def.cx9a2vic_c8r32
100	15349	0	0.0	46.0	0.6	0.000	0.000	0.461	6.572	58812	12.8	3.832	67	12.7	41.8	0.5	0.002	15343	15039	pg163_def.cx9a2nofpw_c8r32
100	14388	0	0.0	45.9	0.6	0.000	0.000	0.460	6.622	55106	11.2	3.830	62	12.7	40.1	0.5	0.001	14220	13917	pg163_def.cx9a2nofpwvic_c8r32

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	6240	0	0.0	84.3	1.8	0.000	0.000	0.844	18.825	25342	13.4	4.062	172	12.7	39.8	0.4	0.002	6233	6153	pg163_def.cx9a2_c8r32
100	5765	0	0.0	84.0	1.8	0.000	0.000	0.842	18.898	23444	13.0	4.067	180	12.7	36.1	0.5	0.002	5769	5658	pg163_def.cx9a2vic_c8r32
100	6200	0	0.0	78.4	1.0	0.000	0.000	0.785	10.544	25177	13.4	4.061	173	12.7	41.7	3.0	0.003	6201	6137	pg163_def.cx9a2nofpw_c8r32
100	5749	0	0.0	78.1	1.0	0.000	0.000	0.783	10.581	23373	13.0	4.066	181	12.7	40.0	0.5	0.001	5753	5631	pg163_def.cx9a2nofpwvic_c8r32

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	13769	0	0.0	89.5	4.4	0.000	0.000	0.179	9.008	52919	13.3	3.843	77	12.8	35.4	2.2	0.019	13729	12786	pg163_def.cx9a2_c8r32
499	13113	0	0.0	89.5	4.4	0.000	0.000	0.179	9.045	50385	12.1	3.842	74	12.9	32.9	10.0	0.025	13073	12130	pg163_def.cx9a2vic_c8r32
499	13364	0	0.0	68.0	1.9	0.000	0.000	0.136	3.972	51362	13.2	3.843	79	12.8	41.3	10.5	0.005	13345	12435	pg163_def.cx9a2nofpw_c8r32
499	13099	0	0.0	67.9	2.0	0.000	0.000	0.136	4.015	50343	12.2	3.843	75	12.9	39.7	6.1	0.005	13065	12146	pg163_def.cx9a2nofpwvic_c8r32

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	6191	0	0.0	70.6	3.3	0.000	0.000	0.141	6.801	25286	13.7	4.084	177	12.8	32.9	0.8	0.002	6185	6108	pg163_def.cx9a2_c8r32
499	5729	0	0.0	70.2	3.3	0.000	0.000	0.141	6.810	23427	13.8	4.089	193	12.9	32.9	6.1	0.002	5736	5614	pg163_def.cx9a2vic_c8r32
499	6135	0	0.0	62.7	2.4	0.000	0.000	0.126	4.946	25057	13.5	4.084	176	12.8	40.4	6.1	0.002	6137	6057	pg163_def.cx9a2nofpw_c8r32
499	5715	0	0.0	62.4	2.4	0.000	0.000	0.125	4.977	23371	13.9	4.089	195	12.9	38.8	1.0	0.002	5720	5608	pg163_def.cx9a2nofpwvic_c8r32

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
999	14083	0	0.0	75.8	4.8	0.000	0.000	0.076	4.917	54368	14.0	3.861	80	12.9	32.9	3.0	0.013	13937	12722	pg163_def.cx9a2_c8r32
999	13361	0	0.0	75.4	4.8	0.000	0.000	0.075	4.913	51575	13.1	3.860	78	13.0	33.0	11.9	0.013	13318	12098	pg163_def.cx9a2vic_c8r32
999	13889	0	0.0	58.4	2.9	0.000	0.000	0.059	2.987	53638	13.9	3.862	80	12.9	39.2	3.0	0.013	13745	12530	pg163_def.cx9a2nofpw_c8r32
999	13482	0	0.0	58.1	2.9	0.000	0.000	0.058	2.984	52046	13.1	3.860	78	13.0	37.6	10.7	0.012	13470	12239	pg163_def.cx9a2nofpwvic_c8r32

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
999	6268	0	0.0	57.7	4.8	0.000	0.000	0.058	4.967	25846	14.4	4.123	184	12.9	32.9	6.4	0.033	6268	6153	pg163_def.cx9a2_c8r32
999	5642	0	0.0	57.4	4.8	0.000	0.000	0.057	4.968	23321	14.6	4.133	207	13.0	33.0	6.4	0.002	5642	5530	pg163_def.cx9a2vic_c8r32
999	6140	0	0.0	41.6	3.1	0.000	0.000	0.042	3.194	25312	14.4	4.123	188	13.0	37.6	10.6	0.002	6137	6073	pg163_def.cx9a2nofpw_c8r32
999	5714	0	0.0	41.3	3.1	0.000	0.000	0.041	3.174	23596	14.6	4.130	204	13.0	35.9	6.4	0.002	5720	5594	pg163_def.cx9a2nofpwvic_c8r32

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	99.929	0.071	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2_c8r32
0.000	99.917	0.083	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	pg163_def.cx9a2vic_c8r32
0.000	99.935	0.065	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpw_c8r32
0.000	99.916	0.084	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpwvic_c8r32

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	21.577	78.417	0.005	0.002	0.000	0.000	0.000	0.000	0.000	0.020	pg163_def.cx9a2_c8r32
0.000	3.209	96.790	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2vic_c8r32
0.000	21.313	78.687	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	pg163_def.cx9a2nofpw_c8r32
0.000	1.165	98.835	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.014	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	14.850	30.126	55.022	0.002	0.000	0.000	0.000	0.000	0.000	0.020	pg163_def.cx9a2_c8r32
0.000	12.356	25.048	62.595	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	pg163_def.cx9a2vic_c8r32
0.000	14.841	37.942	47.217	0.000	0.000	0.000	0.000	0.000	0.000	0.012	pg163_def.cx9a2nofpw_c8r32
0.000	12.283	34.437	53.279	0.000	0.000	0.000	0.000	0.000	0.000	0.015	pg163_def.cx9a2nofpwvic_c8r32

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
26.040	73.960	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2_c8r32
16.798	83.201	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2vic_c8r32
24.055	75.944	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpw_c8r32
12.687	87.311	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.875	16.652	33.451	49.022	0.000	0.000	0.000	0.000	0.000	0.000	0.013	pg163_def.cx9a2_c8r32
1.225	14.178	33.774	50.824	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	pg163_def.cx9a2vic_c8r32
0.628	16.615	35.695	47.062	0.000	0.000	0.000	0.000	0.000	0.000	0.010	pg163_def.cx9a2nofpw_c8r32
0.697	8.625	45.605	45.073	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	pg163_def.cx9a2nofpwvic_c8r32

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
100.000	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2_c8r32
99.981	0.019	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2vic_c8r32
100.000	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpw_c8r32
99.981	0.019	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.001	pg163_def.cx9a2nofpwvic_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	99.972	0.028	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2_c8r32
0.000	0.000	99.972	0.028	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2vic_c8r32
0.000	10.819	89.167	0.014	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpw_c8r32
0.000	0.000	99.972	0.028	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	24.222	75.778	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	pg163_def.cx9a2_c8r32
0.000	22.236	77.764	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	pg163_def.cx9a2vic_c8r32
0.000	29.403	70.597	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	pg163_def.cx9a2nofpw_c8r32
0.000	22.292	77.708	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	pg163_def.cx9a2nofpwvic_c8r32

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.985	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2_c8r32
95.923	4.077	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2vic_c8r32
99.986	0.014	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	pg163_def.cx9a2nofpw_c8r32
95.828	4.172	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.001	pg163_def.cx9a2nofpwvic_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	99.972	0.028	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2_c8r32
0.000	0.000	99.972	0.028	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2vic_c8r32
0.000	0.000	99.986	0.014	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpw_c8r32
0.000	0.000	99.972	0.028	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	92.028	7.972	0.000	0.000	0.000	0.000	0.000	0.000	0.011	pg163_def.cx9a2_c8r32
0.000	0.000	95.764	4.236	0.000	0.000	0.000	0.000	0.000	0.000	0.011	pg163_def.cx9a2vic_c8r32
0.000	0.000	97.028	2.972	0.000	0.000	0.000	0.000	0.000	0.000	0.011	pg163_def.cx9a2nofpw_c8r32
0.000	0.000	96.625	3.375	0.000	0.000	0.000	0.000	0.000	0.000	0.011	pg163_def.cx9a2nofpwvic_c8r32

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.999	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	pg163_def.cx9a2_c8r32
99.980	0.020	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	pg163_def.cx9a2vic_c8r32
99.999	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpw_c8r32
99.981	0.019	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpwvic_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	15.250	84.697	0.036	0.017	0.000	0.000	0.000	0.000	0.000	0.032	pg163_def.cx9a2_c8r32
0.000	0.311	99.639	0.017	0.033	0.000	0.000	0.000	0.000	0.000	0.027	pg163_def.cx9a2vic_c8r32
0.000	43.969	56.025	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpw_c8r32
0.000	0.742	99.253	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.806	30.686	68.489	0.019	0.000	0.000	0.000	0.000	0.000	0.021	pg163_def.cx9a2_c8r32
0.000	0.947	27.172	71.850	0.031	0.000	0.000	0.000	0.000	0.000	0.026	pg163_def.cx9a2vic_c8r32
0.000	1.022	32.097	66.881	0.000	0.000	0.000	0.000	0.000	0.000	0.015	pg163_def.cx9a2nofpw_c8r32
0.000	0.583	26.950	72.467	0.000	0.000	0.000	0.000	0.000	0.000	0.014	pg163_def.cx9a2nofpwvic_c8r32

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.971	0.029	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2_c8r32
95.887	4.113	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2vic_c8r32
99.970	0.030	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpw_c8r32
95.833	4.167	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpwvic_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	12.017	87.981	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2_c8r32
0.000	0.339	99.656	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2vic_c8r32
0.000	19.944	80.053	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2nofpw_c8r32
0.000	0.669	99.325	0.006	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	8.794	63.700	27.506	0.000	0.000	0.000	0.000	0.000	0.000	0.007	pg163_def.cx9a2_c8r32
0.000	6.619	58.542	34.839	0.000	0.000	0.000	0.000	0.000	0.000	0.007	pg163_def.cx9a2vic_c8r32
0.000	8.839	62.858	28.303	0.000	0.000	0.000	0.000	0.000	0.000	0.007	pg163_def.cx9a2nofpw_c8r32
0.000	7.108	59.044	33.847	0.000	0.000	0.000	0.000	0.000	0.000	0.007	pg163_def.cx9a2nofpwvic_c8r32

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.999	nonzero	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.013	pg163_def.cx9a2_c8r32
99.975	0.024	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.013	pg163_def.cx9a2vic_c8r32
99.999	nonzero	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.013	pg163_def.cx9a2nofpw_c8r32
99.975	0.024	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	pg163_def.cx9a2nofpwvic_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	37.297	62.700	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2_c8r32
0.000	5.826	94.171	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.006	pg163_def.cx9a2vic_c8r32
0.000	46.986	53.012	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpw_c8r32
0.000	6.207	93.790	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	9.986	41.219	48.793	0.001	0.000	0.000	0.000	0.000	0.000	0.021	pg163_def.cx9a2_c8r32
0.000	8.072	39.265	52.661	0.001	0.000	0.000	0.000	0.000	0.000	0.019	pg163_def.cx9a2vic_c8r32
0.000	9.818	41.086	49.094	0.001	0.000	0.000	0.000	0.000	0.000	0.020	pg163_def.cx9a2nofpw_c8r32
0.000	7.931	39.103	52.965	0.001	0.000	0.000	0.000	0.000	0.000	0.019	pg163_def.cx9a2nofpwvic_c8r32

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.956	0.044	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	pg163_def.cx9a2_c8r32
95.744	4.256	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2vic_c8r32
99.950	0.050	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpw_c8r32
95.866	4.133	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	pg163_def.cx9a2nofpwvic_c8r32

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	18.249	81.742	0.006	0.004	0.000	0.000	0.000	0.000	0.000	0.022	pg163_def.cx9a2_c8r32
0.000	2.939	97.051	0.006	0.004	0.000	0.000	0.000	0.000	0.000	0.019	pg163_def.cx9a2vic_c8r32
0.000	24.672	75.326	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpw_c8r32
0.000	2.192	97.806	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.005	pg163_def.cx9a2nofpwvic_c8r32

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.849	62.714	32.435	0.003	0.000	0.000	0.000	0.000	0.000	0.019	pg163_def.cx9a2_c8r32
0.000	4.144	52.789	43.064	0.003	0.000	0.000	0.000	0.000	0.000	0.018	pg163_def.cx9a2vic_c8r32
0.000	4.789	62.149	33.062	0.000	0.000	0.000	0.000	0.000	0.000	0.009	pg163_def.cx9a2nofpw_c8r32
0.000	4.131	53.144	42.725	0.000	0.000	0.000	0.000	0.000	0.000	0.009	pg163_def.cx9a2nofpwvic_c8r32