Introduction

This is a report for the insert benchmark with 1024M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has is a c2d-standard-30 with HT off, 16 cores, 64G RAM, Ubuntu 22.04 and ext4 using SW RAID 0 and 2 NVMe devices. The benchmark was run with 8 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 table with a table per client. It loads 128M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 4m+1m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is larger than memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
pg163_o2nofp.cx9a2a_nojit_c24r64 9922481358090264241665987604801924714120763853341
pg17beta1_o2nofp.cx9a2a_nojit_c24r64 9552241389417269361314991264790924974099750573319
pg17beta2_o2nofp.cx9a2a_nojit_c24r64 9543341391304259321304994344783925574096755272962

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
pg163_o2nofp.cx9a2a_nojit_c24r64 1.001.001.001.001.001.001.001.001.001.00
pg17beta1_o2nofp.cx9a2a_nojit_c24r64 0.961.021.020.791.001.001.000.990.980.99
pg17beta2_o2nofp.cx9a2a_nojit_c24r64 0.961.020.980.781.011.001.000.990.990.89

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
pg163_o2nofp.cx9a2a_nojit_c24r647967963980398079607960
pg17beta1_o2nofp.cx9a2a_nojit_c24r647967963980398079607960
pg17beta2_o2nofp.cx9a2a_nojit_c24r647967963978397879607960
target8008004000400080008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6497.0812.8250.0500.0220.0060.0170.929
pg17beta1_o2nofp.cx9a2a_nojit_c24r6491.6318.2740.0450.0270.0070.017nonzero1.165
pg17beta2_o2nofp.cx9a2a_nojit_c24r6491.3338.5770.0410.0260.0070.0170.918

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
992248	0	414	3.3	2308.9	410.9	0.000	0.003	0.002	0.424	87101	71.9	0.088	12	98.0	162.0	6.7	0.929	139850	19885	pg163_o2nofp.cx9a2a_nojit_c24r64
955224	0	403	3.2	2286.6	396.3	0.000	0.003	0.002	0.425	86109	68.5	0.090	11	98.0	162.0	46.3	1.165	133456	19079	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
954334	0	400	3.2	2268.3	395.4	0.000	0.003	0.002	0.424	85828	68.6	0.090	12	98.0	162.0	46.7	0.918	132358	19579	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1358090	0	2929	607.9	1461.4	402.8	0.002	0.458	0.001	0.304	21532	25.0	0.016	3	196.7	260.8	4.1	0.051	NA	NA	pg163_o2nofp.cx9a2a_nojit_c24r64
1389417	0	2914	609.7	1471.6	412.6	0.002	0.449	0.001	0.304	8564	25.0	0.006	3	196.7	260.8	28.2	0.091	NA	NA	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
1391304	0	2913	609.8	1438.9	413.6	0.002	0.449	0.001	0.304	8637	25.7	0.006	3	196.7	260.8	22.7	0.036	NA	NA	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r640.71084.37414.7620.1530.0010.365
pg17beta1_o2nofp.cx9a2a_nojit_c24r640.46980.41918.8630.248nonzero0.326
pg17beta2_o2nofp.cx9a2a_nojit_c24r640.09583.31216.4160.177nonzero0.362

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r644.08514.97265.61915.2870.0370.203
pg17beta1_o2nofp.cx9a2a_nojit_c24r644.47616.60168.53310.3080.0820.253
pg17beta2_o2nofp.cx9a2a_nojit_c24r643.88115.41867.07113.5770.0540.223

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
26424	0	16358	134.8	24201.7	519.0	0.619	5.224	0.916	20.113	42967	44.7	1.626	271	202.0	266.0	48.6	0.365	3099	1898	pg163_o2nofp.cx9a2a_nojit_c24r64
26936	0	17192	160.4	25988.2	551.3	0.638	6.099	0.965	20.960	43316	43.3	1.608	257	201.9	265.9	48.7	0.326	3846	1948	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
25932	0	16140	133.9	24564.0	518.2	0.622	5.287	0.947	20.461	41795	44.0	1.612	271	202.0	266.0	48.7	0.362	3499	2248	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r641.02767.06131.8980.0110.0020.0010.177
pg17beta1_o2nofp.cx9a2a_nojit_c24r641.61869.38628.9920.0030.014
pg17beta2_o2nofp.cx9a2a_nojit_c24r640.20466.41733.3740.0050.012

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r640.2403.8280.01446.34849.5690.0010.124
pg17beta1_o2nofp.cx9a2a_nojit_c24r6411.35114.36674.283nonzero0.124
pg17beta2_o2nofp.cx9a2a_nojit_c24r648.79991.2000.0010.125

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1665	0	958	10.9	2014.1	38.0	0.575	6.701	1.210	23.361	9767	35.7	5.866	3430	203.3	267.3	26.4	0.177	305	275	pg163_o2nofp.cx9a2a_nojit_c24r64
1314	0	710	5.9	1553.6	28.9	0.541	4.586	1.182	22.514	6911	32.1	5.259	3909	203.0	267.1	48.7	0.014	1569	1009	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
1304	0	733	6.1	1604.1	29.8	0.562	4.758	1.230	23.435	6755	43.0	5.181	5276	203.3	267.3	48.7	0.012	140	125	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6499.9540.046nonzerononzero0.004
pg17beta1_o2nofp.cx9a2a_nojit_c24r6499.9550.045nonzerononzero0.004
pg17beta2_o2nofp.cx9a2a_nojit_c24r6499.9560.044nonzerononzero0.004

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6499.9760.0240.019
pg17beta1_o2nofp.cx9a2a_nojit_c24r640.01498.5381.4480.030
pg17beta2_o2nofp.cx9a2a_nojit_c24r6499.9690.0310.018

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6461.90638.0940.004
pg17beta1_o2nofp.cx9a2a_nojit_c24r6457.07342.9270.003
pg17beta2_o2nofp.cx9a2a_nojit_c24r6455.86544.1350.004

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	98760	540	4.8	458.0	14.5	0.005	0.050	0.575	18.710	371002	48.7	3.757	79	203.3	267.4	48.6	0.004	12438	12019	pg163_o2nofp.cx9a2a_nojit_c24r64
796	99126	534	4.7	458.1	14.6	0.005	0.048	0.575	18.721	371867	48.7	3.751	79	203.1	266.2	48.7	0.004	12483	11976	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
796	99434	541	4.7	452.0	14.5	0.005	0.049	0.568	18.663	372831	48.7	3.750	78	203.3	267.4	48.7	0.004	12578	12147	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r640.0046.55193.2570.188nonzero0.020
pg17beta1_o2nofp.cx9a2a_nojit_c24r640.0036.32993.4620.206nonzero0.017
pg17beta2_o2nofp.cx9a2a_nojit_c24r640.0036.25493.5680.1750.010

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r643.50796.4930.037
pg17beta1_o2nofp.cx9a2a_nojit_c24r643.58796.4130.032
pg17beta2_o2nofp.cx9a2a_nojit_c24r643.60196.3990.031

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r640.83399.1320.0350.012
pg17beta1_o2nofp.cx9a2a_nojit_c24r640.05299.8990.0490.012
pg17beta2_o2nofp.cx9a2a_nojit_c24r640.02899.9310.0420.011

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	4801	39615	312.0	2581.4	30.0	8.251	66.538	3.243	38.547	95454	13.9	19.882	463	203.4	266.9	48.6	0.020	639	288	pg163_o2nofp.cx9a2a_nojit_c24r64
796	4790	39608	311.0	2580.4	30.0	8.270	66.497	3.242	38.548	95341	14.1	19.906	471	203.1	266.2	48.7	0.017	624	272	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
796	4783	39535	310.4	2583.4	30.0	8.267	66.470	3.245	38.574	95155	14.1	19.896	472	203.4	264.4	48.7	0.010	623	288	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6499.8000.1940.0050.001nonzerononzero0.103
pg17beta1_o2nofp.cx9a2a_nojit_c24r6499.8090.1850.0050.001nonzerononzero0.105
pg17beta2_o2nofp.cx9a2a_nojit_c24r6499.8000.1930.0060.001nonzerononzero0.084

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r640.00175.53324.4600.0070.092
pg17beta1_o2nofp.cx9a2a_nojit_c24r6476.22623.7620.0110.084
pg17beta2_o2nofp.cx9a2a_nojit_c24r6475.31124.6740.0150.087

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6450.19248.7071.1010.056
pg17beta1_o2nofp.cx9a2a_nojit_c24r6444.96754.1330.9000.046
pg17beta2_o2nofp.cx9a2a_nojit_c24r6444.22054.3371.4420.0010.081

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	92471	3982	33.8	3578.6	74.8	0.043	0.374	0.899	19.233	338963	52.3	3.666	90	203.6	267.6	48.6	0.103	11667	10484	pg163_o2nofp.cx9a2a_nojit_c24r64
3980	92497	3976	33.7	3579.0	74.6	0.043	0.373	0.899	19.181	337593	52.4	3.650	91	203.4	267.4	48.7	0.105	11715	10660	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
3978	92557	3975	33.7	3569.5	75.9	0.043	0.372	0.897	19.530	337103	52.4	3.642	91	203.6	267.6	48.7	0.084	11683	10516	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r640.0012.40297.1610.4350.0020.044
pg17beta1_o2nofp.cx9a2a_nojit_c24r640.0012.28897.2560.4530.0010.055
pg17beta2_o2nofp.cx9a2a_nojit_c24r640.0012.26697.2980.4330.0020.048

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r643.86496.1360.059
pg17beta1_o2nofp.cx9a2a_nojit_c24r643.93396.0670.059
pg17beta2_o2nofp.cx9a2a_nojit_c24r643.88296.1180.057

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r647.31592.6580.0270.052
pg17beta1_o2nofp.cx9a2a_nojit_c24r645.81694.1260.0580.051
pg17beta2_o2nofp.cx9a2a_nojit_c24r647.02092.9130.0670.052

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	4120	43905	346.9	8939.9	111.5	10.657	86.238	2.246	28.683	100988	18.7	24.513	726	203.8	267.8	48.6	0.044	543	272	pg163_o2nofp.cx9a2a_nojit_c24r64
3980	4099	43812	345.3	8931.2	111.4	10.690	86.260	2.244	28.671	100195	19.0	24.446	742	203.7	267.7	48.7	0.055	528	272	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
3978	4096	43697	344.3	8932.0	111.4	10.668	86.077	2.245	28.672	99931	19.0	24.397	742	203.8	267.9	48.7	0.048	527	272	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6498.9720.9850.0310.0100.002nonzerononzero0.351
pg17beta1_o2nofp.cx9a2a_nojit_c24r6498.8951.0570.0350.0110.002nonzerononzero0.374
pg17beta2_o2nofp.cx9a2a_nojit_c24r6498.9031.0480.0360.0110.002nonzerononzero0.357

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r64nonzero80.06319.8690.0670.142
pg17beta1_o2nofp.cx9a2a_nojit_c24r640.00280.36219.5360.1000.146
pg17beta2_o2nofp.cx9a2a_nojit_c24r640.00179.92620.0060.0670.200

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r6477.68222.2040.1140.102
pg17beta1_o2nofp.cx9a2a_nojit_c24r6468.99430.8260.1800.115
pg17beta2_o2nofp.cx9a2a_nojit_c24r6467.79232.0310.1770.122

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	76385	6217	54.1	8368.9	157.8	0.081	0.725	1.051	20.296	261026	61.9	3.417	130	204.8	268.8	48.6	0.351	9638	7895	pg163_o2nofp.cx9a2a_nojit_c24r64
7960	75057	6213	54.1	8374.4	157.9	0.083	0.738	1.052	20.317	253617	62.7	3.379	134	204.8	268.9	48.7	0.374	9513	7624	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
7960	75527	6222	54.0	8361.7	157.9	0.082	0.732	1.050	20.311	254643	62.8	3.372	133	205.0	269.1	48.7	0.357	9551	7719	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r64nonzero0.50597.3822.1020.010nonzero0.080
pg17beta1_o2nofp.cx9a2a_nojit_c24r64nonzero0.47797.2762.2360.011nonzero0.078
pg17beta2_o2nofp.cx9a2a_nojit_c24r64nonzero0.36191.8377.7860.0150.001nonzero0.561

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r643.20996.7770.0140.103
pg17beta1_o2nofp.cx9a2a_nojit_c24r643.26196.7300.0080.098
pg17beta2_o2nofp.cx9a2a_nojit_c24r643.32296.6520.0250.0020.389

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg163_o2nofp.cx9a2a_nojit_c24r647.36892.6290.0030.118
pg17beta1_o2nofp.cx9a2a_nojit_c24r640.35799.6400.0030.121
pg17beta2_o2nofp.cx9a2a_nojit_c24r640.49799.4890.0110.0030.0011.066

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	3341	47205	373.2	15317.0	211.8	14.129	114.383	1.924	27.244	99999	37.0	29.930	1772	206.6	270.6	48.7	0.080	432	256	pg163_o2nofp.cx9a2a_nojit_c24r64
7960	3319	47074	371.4	15296.3	211.6	14.183	114.575	1.922	27.225	97463	38.6	29.365	1861	206.7	270.8	48.7	0.078	432	256	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
7960	2962	43827	346.2	15059.7	209.5	14.795	119.659	1.892	26.947	91128	37.6	30.763	2031	206.9	270.9	48.7	0.561	400	240	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
992248	0	414	3.3	2308.9	410.9	0.000	0.003	0.002	0.424	87101	71.9	0.088	12	98.0	162.0	6.7	0.929	139850	19885	pg163_o2nofp.cx9a2a_nojit_c24r64
955224	0	403	3.2	2286.6	396.3	0.000	0.003	0.002	0.425	86109	68.5	0.090	11	98.0	162.0	46.3	1.165	133456	19079	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
954334	0	400	3.2	2268.3	395.4	0.000	0.003	0.002	0.424	85828	68.6	0.090	12	98.0	162.0	46.7	0.918	132358	19579	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1358090	0	2929	607.9	1461.4	402.8	0.002	0.458	0.001	0.304	21532	25.0	0.016	3	196.7	260.8	4.1	0.051	NA	NA	pg163_o2nofp.cx9a2a_nojit_c24r64
1389417	0	2914	609.7	1471.6	412.6	0.002	0.449	0.001	0.304	8564	25.0	0.006	3	196.7	260.8	28.2	0.091	NA	NA	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
1391304	0	2913	609.8	1438.9	413.6	0.002	0.449	0.001	0.304	8637	25.7	0.006	3	196.7	260.8	22.7	0.036	NA	NA	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
26424	0	16358	134.8	24201.7	519.0	0.619	5.224	0.916	20.113	42967	44.7	1.626	271	202.0	266.0	48.6	0.365	3099	1898	pg163_o2nofp.cx9a2a_nojit_c24r64
26936	0	17192	160.4	25988.2	551.3	0.638	6.099	0.965	20.960	43316	43.3	1.608	257	201.9	265.9	48.7	0.326	3846	1948	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
25932	0	16140	133.9	24564.0	518.2	0.622	5.287	0.947	20.461	41795	44.0	1.612	271	202.0	266.0	48.7	0.362	3499	2248	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1665	0	958	10.9	2014.1	38.0	0.575	6.701	1.210	23.361	9767	35.7	5.866	3430	203.3	267.3	26.4	0.177	305	275	pg163_o2nofp.cx9a2a_nojit_c24r64
1314	0	710	5.9	1553.6	28.9	0.541	4.586	1.182	22.514	6911	32.1	5.259	3909	203.0	267.1	48.7	0.014	1569	1009	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
1304	0	733	6.1	1604.1	29.8	0.562	4.758	1.230	23.435	6755	43.0	5.181	5276	203.3	267.3	48.7	0.012	140	125	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	98760	540	4.8	458.0	14.5	0.005	0.050	0.575	18.710	371002	48.7	3.757	79	203.3	267.4	48.6	0.004	12438	12019	pg163_o2nofp.cx9a2a_nojit_c24r64
796	99126	534	4.7	458.1	14.6	0.005	0.048	0.575	18.721	371867	48.7	3.751	79	203.1	266.2	48.7	0.004	12483	11976	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
796	99434	541	4.7	452.0	14.5	0.005	0.049	0.568	18.663	372831	48.7	3.750	78	203.3	267.4	48.7	0.004	12578	12147	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	4801	39615	312.0	2581.4	30.0	8.251	66.538	3.243	38.547	95454	13.9	19.882	463	203.4	266.9	48.6	0.020	639	288	pg163_o2nofp.cx9a2a_nojit_c24r64
796	4790	39608	311.0	2580.4	30.0	8.270	66.497	3.242	38.548	95341	14.1	19.906	471	203.1	266.2	48.7	0.017	624	272	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
796	4783	39535	310.4	2583.4	30.0	8.267	66.470	3.245	38.574	95155	14.1	19.896	472	203.4	264.4	48.7	0.010	623	288	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	92471	3982	33.8	3578.6	74.8	0.043	0.374	0.899	19.233	338963	52.3	3.666	90	203.6	267.6	48.6	0.103	11667	10484	pg163_o2nofp.cx9a2a_nojit_c24r64
3980	92497	3976	33.7	3579.0	74.6	0.043	0.373	0.899	19.181	337593	52.4	3.650	91	203.4	267.4	48.7	0.105	11715	10660	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
3978	92557	3975	33.7	3569.5	75.9	0.043	0.372	0.897	19.530	337103	52.4	3.642	91	203.6	267.6	48.7	0.084	11683	10516	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	4120	43905	346.9	8939.9	111.5	10.657	86.238	2.246	28.683	100988	18.7	24.513	726	203.8	267.8	48.6	0.044	543	272	pg163_o2nofp.cx9a2a_nojit_c24r64
3980	4099	43812	345.3	8931.2	111.4	10.690	86.260	2.244	28.671	100195	19.0	24.446	742	203.7	267.7	48.7	0.055	528	272	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
3978	4096	43697	344.3	8932.0	111.4	10.668	86.077	2.245	28.672	99931	19.0	24.397	742	203.8	267.9	48.7	0.048	527	272	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	76385	6217	54.1	8368.9	157.8	0.081	0.725	1.051	20.296	261026	61.9	3.417	130	204.8	268.8	48.6	0.351	9638	7895	pg163_o2nofp.cx9a2a_nojit_c24r64
7960	75057	6213	54.1	8374.4	157.9	0.083	0.738	1.052	20.317	253617	62.7	3.379	134	204.8	268.9	48.7	0.374	9513	7624	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
7960	75527	6222	54.0	8361.7	157.9	0.082	0.732	1.050	20.311	254643	62.8	3.372	133	205.0	269.1	48.7	0.357	9551	7719	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	3341	47205	373.2	15317.0	211.8	14.129	114.383	1.924	27.244	99999	37.0	29.930	1772	206.6	270.6	48.7	0.080	432	256	pg163_o2nofp.cx9a2a_nojit_c24r64
7960	3319	47074	371.4	15296.3	211.6	14.183	114.575	1.922	27.225	97463	38.6	29.365	1861	206.7	270.8	48.7	0.078	432	256	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
7960	2962	43827	346.2	15059.7	209.5	14.795	119.659	1.892	26.947	91128	37.6	30.763	2031	206.9	270.9	48.7	0.561	400	240	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	97.081	2.825	0.050	0.022	0.006	0.017	0.000	0.000	0.000	0.929	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	91.631	8.274	0.045	0.027	0.007	0.017	nonzero	0.000	0.000	1.165	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	91.333	8.577	0.041	0.026	0.007	0.017	0.000	0.000	0.000	0.918	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.710	84.374	14.762	0.153	0.001	0.000	0.000	0.000	0.365	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.469	80.419	18.863	0.248	nonzero	0.000	0.000	0.000	0.326	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.095	83.312	16.416	0.177	nonzero	0.000	0.000	0.000	0.362	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.085	14.972	65.619	15.287	0.037	0.000	0.000	0.000	0.000	0.203	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	4.476	16.601	68.533	10.308	0.082	0.000	0.000	0.000	0.000	0.253	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	3.881	15.418	67.071	13.577	0.054	0.000	0.000	0.000	0.000	0.223	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
1.027	67.061	31.898	0.011	0.002	0.001	0.000	0.000	0.000	0.000	0.177	pg163_o2nofp.cx9a2a_nojit_c24r64
1.618	69.386	28.992	0.003	0.000	0.000	0.000	0.000	0.000	0.000	0.014	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.204	66.417	33.374	0.005	0.000	0.000	0.000	0.000	0.000	0.000	0.012	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.240	3.828	0.014	46.348	49.569	0.001	0.000	0.000	0.000	0.000	0.124	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	11.351	14.366	74.283	nonzero	0.000	0.000	0.000	0.000	0.124	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	8.799	91.200	0.001	0.000	0.000	0.000	0.000	0.125	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.954	0.046	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	pg163_o2nofp.cx9a2a_nojit_c24r64
99.955	0.045	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
99.956	0.044	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	99.976	0.024	0.000	0.000	0.000	0.000	0.000	0.019	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.014	98.538	1.448	0.000	0.000	0.000	0.000	0.000	0.030	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	99.969	0.031	0.000	0.000	0.000	0.000	0.000	0.018	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	61.906	38.094	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	57.073	42.927	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	55.865	44.135	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.004	6.551	93.257	0.188	nonzero	0.000	0.000	0.000	0.000	0.000	0.020	pg163_o2nofp.cx9a2a_nojit_c24r64
0.003	6.329	93.462	0.206	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.003	6.254	93.568	0.175	0.000	0.000	0.000	0.000	0.000	0.000	0.010	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	3.507	96.493	0.000	0.000	0.000	0.000	0.000	0.037	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	3.587	96.413	0.000	0.000	0.000	0.000	0.000	0.032	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	3.601	96.399	0.000	0.000	0.000	0.000	0.000	0.031	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.833	99.132	0.035	0.000	0.000	0.000	0.000	0.000	0.000	0.012	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.052	99.899	0.049	0.000	0.000	0.000	0.000	0.000	0.000	0.012	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.028	99.931	0.042	0.000	0.000	0.000	0.000	0.000	0.000	0.011	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.800	0.194	0.005	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.103	pg163_o2nofp.cx9a2a_nojit_c24r64
99.809	0.185	0.005	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.105	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
99.800	0.193	0.006	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.084	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.001	75.533	24.460	0.007	0.000	0.000	0.000	0.000	0.092	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	76.226	23.762	0.011	0.000	0.000	0.000	0.000	0.084	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	75.311	24.674	0.015	0.000	0.000	0.000	0.000	0.087	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	50.192	48.707	1.101	0.000	0.000	0.000	0.000	0.000	0.056	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	44.967	54.133	0.900	0.000	0.000	0.000	0.000	0.000	0.046	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	44.220	54.337	1.442	0.001	0.000	0.000	0.000	0.000	0.081	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.001	2.402	97.161	0.435	0.002	0.000	0.000	0.000	0.000	0.000	0.044	pg163_o2nofp.cx9a2a_nojit_c24r64
0.001	2.288	97.256	0.453	0.001	0.000	0.000	0.000	0.000	0.000	0.055	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.001	2.266	97.298	0.433	0.002	0.000	0.000	0.000	0.000	0.000	0.048	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	3.864	96.136	0.000	0.000	0.000	0.000	0.000	0.059	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	3.933	96.067	0.000	0.000	0.000	0.000	0.000	0.059	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	3.882	96.118	0.000	0.000	0.000	0.000	0.000	0.057	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	7.315	92.658	0.027	0.000	0.000	0.000	0.000	0.000	0.052	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	5.816	94.126	0.058	0.000	0.000	0.000	0.000	0.000	0.051	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	7.020	92.913	0.067	0.000	0.000	0.000	0.000	0.000	0.052	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.972	0.985	0.031	0.010	0.002	nonzero	nonzero	0.000	0.000	0.000	0.351	pg163_o2nofp.cx9a2a_nojit_c24r64
98.895	1.057	0.035	0.011	0.002	nonzero	nonzero	0.000	0.000	0.000	0.374	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
98.903	1.048	0.036	0.011	0.002	nonzero	nonzero	0.000	0.000	0.000	0.357	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	nonzero	80.063	19.869	0.067	0.000	0.000	0.000	0.000	0.142	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.002	80.362	19.536	0.100	0.000	0.000	0.000	0.000	0.146	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.001	79.926	20.006	0.067	0.000	0.000	0.000	0.000	0.200	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	77.682	22.204	0.114	0.000	0.000	0.000	0.000	0.102	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	68.994	30.826	0.180	0.000	0.000	0.000	0.000	0.115	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	67.792	32.031	0.177	0.000	0.000	0.000	0.000	0.122	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
nonzero	0.505	97.382	2.102	0.010	nonzero	0.000	0.000	0.000	0.000	0.080	pg163_o2nofp.cx9a2a_nojit_c24r64
nonzero	0.477	97.276	2.236	0.011	nonzero	0.000	0.000	0.000	0.000	0.078	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
nonzero	0.361	91.837	7.786	0.015	0.001	nonzero	0.000	0.000	0.000	0.561	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	3.209	96.777	0.014	0.000	0.000	0.000	0.000	0.103	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	3.261	96.730	0.008	0.000	0.000	0.000	0.000	0.098	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	3.322	96.652	0.025	0.002	0.000	0.000	0.000	0.389	pg17beta2_o2nofp.cx9a2a_nojit_c24r64

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	7.368	92.629	0.003	0.000	0.000	0.000	0.000	0.118	pg163_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	0.357	99.640	0.003	0.000	0.000	0.000	0.000	0.121	pg17beta1_o2nofp.cx9a2a_nojit_c24r64
0.000	0.000	0.000	0.497	99.489	0.011	0.003	0.001	0.000	0.000	1.066	pg17beta2_o2nofp.cx9a2a_nojit_c24r64