Introduction

This is a report for the insert benchmark with 160M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server is a c2-standard-30 from GCP with 15 cores, hyperthreads disabled, Ubuntu 22.04 and XFS using SW RAID 0 over 4 local SSDs. The benchmark was run with 8 clients and there were 1, 2 or 3 connections per client. It uses 8 tables with a client per table. It loads 20M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 50m+50m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1200s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
fbmy8028_rel_221222.cza1_gcp_c2s30 5479457655519044642395254213585626636341502491432088
fbmy8028_rel_221222.cza1ps0_gcp_c2s30 5498287655519096143173291353794329140360162565033919
fbmy8032_rel_221222.cza1_gcp_c2s30 5177997843148948541026266303426926751326252544030619
fbmy8032_rel_221222.cza1ps0_gcp_c2s30 5351177881788968642150288923654228280349262661132651

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
fbmy8028_rel_221222.cza1_gcp_c2s30 1.001.001.001.001.001.001.001.001.001.00
fbmy8028_rel_221222.cza1ps0_gcp_c2s30 1.001.001.011.021.151.061.091.051.031.06
fbmy8032_rel_221222.cza1_gcp_c2s30 0.941.020.990.971.050.961.000.961.020.95
fbmy8032_rel_221222.cza1ps0_gcp_c2s30 0.981.030.990.991.141.021.061.021.071.02

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
fbmy8028_rel_221222.cza1_gcp_c2s307947943970397079477947
fbmy8028_rel_221222.cza1ps0_gcp_c2s307937933970397079477947
fbmy8032_rel_221222.cza1_gcp_c2s307937943970397079477947
fbmy8032_rel_221222.cza1ps0_gcp_c2s307937933970397079477947
target8008004000400080008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s308.67491.1880.1150.0070.0130.0040.326
fbmy8028_rel_221222.cza1ps0_gcp_c2s3010.76989.0870.1220.0060.0110.0050.398
fbmy8032_rel_221222.cza1_gcp_c2s303.89495.9650.1210.0040.0140.0030.383
fbmy8032_rel_221222.cza1ps0_gcp_c2s308.41291.4280.1370.0060.0130.0040.312

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
547945	0	0	0.0	461.8	126.6	0.000	0.000	0.001	0.237	62995	73.1	0.115	20	4.7	6.4	1.6	0.326	73420	51544	fbmy8028_rel_221222.cza1_gcp_c2s30
549828	0	0	0.0	481.9	129.1	0.000	0.000	0.001	0.240	63116	73.1	0.115	20	4.7	6.3	1.4	0.398	73621	48448	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
517799	0	0	0.0	445.8	121.7	0.000	0.000	0.001	0.241	60620	72.5	0.117	21	4.6	6.3	1.7	0.383	70323	43952	fbmy8032_rel_221222.cza1_gcp_c2s30
535117	0	0	0.0	468.6	128.0	0.000	0.000	0.001	0.245	62213	73.1	0.116	20	4.6	6.3	1.5	0.312	72921	48747	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
765551	0	1	0.1	284.1	107.7	0.000	0.000	0.000	0.144	1331	50.1	0.002	10	10.5	12.2	12.9	0.003	NA	NA	fbmy8028_rel_221222.cza1_gcp_c2s30
765551	0	1	0.1	289.6	106.7	0.000	0.000	0.000	0.143	1471	49.6	0.002	10	10.5	12.1	12.7	0.002	NA	NA	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
784314	0	1	0.1	291.0	109.9	0.000	0.000	0.000	0.144	1842	50.4	0.002	10	10.4	12.1	13.0	0.003	NA	NA	fbmy8032_rel_221222.cza1_gcp_c2s30
788178	0	1	0.1	292.4	111.0	0.000	0.000	0.000	0.144	1696	50.2	0.002	10	10.5	12.1	12.8	0.003	NA	NA	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.01137.47462.3910.1030.0150.0050.638
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.01238.57661.2920.1010.0130.0060.880
fbmy8032_rel_221222.cza1_gcp_c2s300.01235.97963.8860.1040.0150.0040.567
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.01436.07063.7920.1040.0150.0050.661

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.02040.68159.1810.0980.0150.0050.635
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.02441.89557.9650.0970.0130.0060.880
fbmy8032_rel_221222.cza1_gcp_c2s300.01338.35361.5130.1020.0150.0040.566
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.01738.46361.4010.1000.0150.0040.663

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
90446	0	4	0.4	589.3	165.4	0.000	0.004	0.007	1.873	54752	64.2	0.605	106	13.3	13.9	50.5	0.638	11438	8041	fbmy8028_rel_221222.cza1_gcp_c2s30
90961	0	4	0.3	587.6	165.8	0.000	0.004	0.006	1.867	55566	63.7	0.611	105	12.7	13.3	51.2	0.880	11587	8090	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
89485	0	4	0.4	574.0	162.9	0.000	0.004	0.006	1.864	54201	64.7	0.606	108	12.9	13.5	51.5	0.567	11341	8191	fbmy8032_rel_221222.cza1_gcp_c2s30
89686	0	4	0.4	589.3	165.3	0.000	0.004	0.007	1.887	54413	64.2	0.607	107	12.3	12.9	50.2	0.661	11388	8341	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.01682.28217.5920.1040.0030.002nonzero0.325
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.02183.87315.9990.1020.0030.002nonzero0.311
fbmy8032_rel_221222.cza1_gcp_c2s300.00278.66121.2180.1140.0030.002nonzero0.704
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.01081.77818.1020.1050.0020.002nonzero0.333

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s30nonzero75.13724.7490.1080.0030.003nonzero0.325
fbmy8028_rel_221222.cza1ps0_gcp_c2s30nonzero77.20422.6850.1050.0030.003nonzero0.312
fbmy8032_rel_221222.cza1_gcp_c2s3070.72929.1490.1170.0030.002nonzero0.704
fbmy8032_rel_221222.cza1ps0_gcp_c2s3074.38325.5050.1070.0030.002nonzero0.331

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
42395	0	0	0.0	330.9	74.4	0.000	0.000	0.008	1.797	230357	68.6	5.434	243	12.3	12.6	62.2	0.325	5574	3191	fbmy8028_rel_221222.cza1_gcp_c2s30
43173	0	0	0.0	336.9	74.5	0.000	0.000	0.008	1.767	236220	67.8	5.471	236	12.1	12.3	62.3	0.311	5681	3291	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
41026	0	0	0.0	320.5	70.7	0.000	0.000	0.008	1.766	222150	68.7	5.415	251	11.8	12.1	62.4	0.704	5379	3082	fbmy8032_rel_221222.cza1_gcp_c2s30
42150	0	0	0.0	326.6	73.3	0.000	0.000	0.008	1.781	231898	67.7	5.502	241	12.9	13.1	62.0	0.333	5534	3231	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3077.12618.2014.673nonzerononzero0.054
fbmy8028_rel_221222.cza1ps0_gcp_c2s3076.20323.2660.531nonzerononzero0.040
fbmy8032_rel_221222.cza1_gcp_c2s3070.83928.4030.758nonzerononzero0.051
fbmy8032_rel_221222.cza1ps0_gcp_c2s3068.92531.0400.035nonzerononzero0.045

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s305.55794.4380.0050.004
fbmy8028_rel_221222.cza1ps0_gcp_c2s304.85495.1300.0160.005
fbmy8032_rel_221222.cza1_gcp_c2s300.50099.0990.4010.006
fbmy8032_rel_221222.cza1ps0_gcp_c2s301.31297.6821.0050.008

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3019.22980.7710.002
fbmy8028_rel_221222.cza1ps0_gcp_c2s3016.03683.9480.0160.004
fbmy8032_rel_221222.cza1_gcp_c2s303.64696.0940.2600.005
fbmy8032_rel_221222.cza1ps0_gcp_c2s305.33393.9060.7600.013

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	25421	0	0.0	19.7	4.5	0.000	0.000	0.025	5.760	98445	53.4	3.873	315	11.4	11.8	64.0	0.054	2558	2333	fbmy8028_rel_221222.cza1_gcp_c2s30
793	29135	0	0.0	14.1	3.0	0.000	0.000	0.018	3.830	112671	52.8	3.867	272	11.5	11.9	63.7	0.040	4523	2158	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
793	26630	0	0.0	15.0	3.2	0.000	0.000	0.019	4.072	103061	53.5	3.870	301	11.4	11.8	63.8	0.051	3708	3388	fbmy8032_rel_221222.cza1_gcp_c2s30
793	28892	0	0.0	14.6	3.0	0.000	0.000	0.018	3.831	111864	52.9	3.872	275	11.4	11.8	63.3	0.045	3230	3005	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3096.5903.4090.001nonzerononzero0.031
fbmy8028_rel_221222.cza1ps0_gcp_c2s3097.6222.3760.001nonzerononzero0.018
fbmy8032_rel_221222.cza1_gcp_c2s3095.0904.9090.001nonzerononzero0.028
fbmy8032_rel_221222.cza1ps0_gcp_c2s3096.9243.0740.001nonzerononzero0.019

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.36595.5364.0990.012
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.93898.8910.1720.007
fbmy8032_rel_221222.cza1_gcp_c2s300.18898.8120.9900.0100.016
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.33997.3542.3070.015

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s303.62093.0893.2920.011
fbmy8028_rel_221222.cza1ps0_gcp_c2s308.11591.7140.1720.011
fbmy8032_rel_221222.cza1_gcp_c2s303.00096.1610.8230.0160.016
fbmy8032_rel_221222.cza1ps0_gcp_c2s302.57895.5571.8650.014

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	35856	0	0.0	13.9	3.8	0.000	0.000	0.018	4.919	147622	54.2	4.117	227	11.4	12.1	74.8	0.031	4539	3820	fbmy8028_rel_221222.cza1_gcp_c2s30
793	37943	0	0.0	13.4	3.6	0.000	0.000	0.017	4.620	156354	53.5	4.121	212	11.5	12.1	74.8	0.018	4827	4155	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
794	34269	0	0.0	12.4	3.2	0.000	0.000	0.016	4.154	140576	53.9	4.102	236	11.4	12.1	74.3	0.028	4317	3741	fbmy8032_rel_221222.cza1_gcp_c2s30
793	36542	0	0.0	13.4	3.6	0.000	0.000	0.017	4.621	150522	53.3	4.119	219	11.4	12.0	74.5	0.019	4653	3964	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3070.09725.8544.0490.001nonzerononzero0.071
fbmy8028_rel_221222.cza1ps0_gcp_c2s3072.50926.5580.933nonzerononzero0.064
fbmy8032_rel_221222.cza1_gcp_c2s3069.56727.6122.8200.001nonzerononzero0.071
fbmy8032_rel_221222.cza1ps0_gcp_c2s3071.70327.6280.6680.001nonzero0.060

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s302.70477.36619.9030.0270.021
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.57278.50819.8970.0230.021
fbmy8032_rel_221222.cza1_gcp_c2s300.42773.36726.1680.0390.024
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.64572.01927.3240.0130.018

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s306.40174.95418.6160.0280.0010.069
fbmy8028_rel_221222.cza1ps0_gcp_c2s304.84476.47318.6540.0290.027
fbmy8032_rel_221222.cza1_gcp_c2s301.86173.09325.0100.0350.023
fbmy8032_rel_221222.cza1ps0_gcp_c2s302.24371.55026.1960.0110.022

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	26636	0	0.0	59.4	19.2	0.000	0.000	0.015	4.948	103838	57.0	3.898	321	11.4	13.0	79.5	0.071	3724	3228	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	29140	0	0.0	56.0	18.5	0.000	0.000	0.014	4.772	113428	56.3	3.893	290	11.4	13.1	79.4	0.064	3468	2925	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3970	26751	0	0.0	55.5	17.6	0.000	0.000	0.014	4.529	104103	56.9	3.892	319	11.4	13.1	79.2	0.071	3772	3085	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	28280	0	0.0	55.0	17.8	0.000	0.000	0.014	4.590	110106	56.3	3.893	299	11.5	13.1	78.9	0.060	4523	3708	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3091.7198.2710.010nonzerononzero0.026
fbmy8028_rel_221222.cza1ps0_gcp_c2s3094.0175.9760.007nonzero0.016
fbmy8032_rel_221222.cza1_gcp_c2s3087.49912.4900.011nonzero0.016
fbmy8032_rel_221222.cza1ps0_gcp_c2s3092.7567.2340.009nonzerononzero0.025

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.84374.62824.5120.0170.019
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.10684.18014.7030.0100.037
fbmy8032_rel_221222.cza1_gcp_c2s300.13278.18121.6630.0240.031
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.37275.10224.5090.0170.042

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s303.86272.93923.1800.0190.019
fbmy8028_rel_221222.cza1ps0_gcp_c2s304.56981.65013.7680.0140.057
fbmy8032_rel_221222.cza1_gcp_c2s301.36178.32920.2890.0210.029
fbmy8032_rel_221222.cza1ps0_gcp_c2s302.18274.60123.2040.0130.058

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	34150	0	0.0	60.9	18.8	0.000	0.000	0.015	4.845	143903	57.5	4.214	253	11.5	12.3	81.6	0.026	4363	3868	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	36016	0	0.0	60.1	18.0	0.000	0.000	0.015	4.649	151594	56.6	4.209	236	11.5	12.2	81.0	0.016	4603	4012	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3970	32625	0	0.0	62.1	18.3	0.000	0.000	0.016	4.719	136727	57.6	4.191	265	11.6	12.3	81.7	0.016	4171	3676	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	34926	0	0.0	60.6	18.4	0.000	0.000	0.015	4.758	146720	56.8	4.201	244	11.6	12.3	81.3	0.025	4461	3821	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3068.26829.6162.1140.001nonzerononzero0.075
fbmy8028_rel_221222.cza1ps0_gcp_c2s3069.05129.6741.2730.001nonzerononzero0.078
fbmy8032_rel_221222.cza1_gcp_c2s3068.96528.8922.1420.001nonzerononzero0.066
fbmy8032_rel_221222.cza1ps0_gcp_c2s3070.15527.2482.5950.001nonzerononzero0.075

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.24255.26744.4390.0520.027
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.62355.77643.5600.0420.024
fbmy8032_rel_221222.cza1_gcp_c2s300.07657.08642.7780.0600.038
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.22656.04543.6830.0460.027

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s301.39755.76142.7960.0450.0010.072
fbmy8028_rel_221222.cza1ps0_gcp_c2s302.11055.98241.8630.0450.0010.075
fbmy8032_rel_221222.cza1_gcp_c2s300.57058.48940.8790.0620.059
fbmy8032_rel_221222.cza1ps0_gcp_c2s301.00856.69042.2590.0440.060

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	24914	0	0.0	117.8	34.3	0.000	0.000	0.015	4.413	97655	61.1	3.920	368	12.1	13.0	81.9	0.075	3374	2701	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	25650	0	0.0	121.9	35.2	0.000	0.000	0.015	4.531	100566	60.5	3.921	354	11.8	12.6	81.3	0.078	3197	2557	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7947	25440	0	0.0	118.7	33.8	0.000	0.000	0.015	4.356	99211	61.3	3.900	361	12.1	13.0	82.0	0.066	2973	2381	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	26611	0	0.0	122.5	36.1	0.000	0.000	0.015	4.651	104201	60.6	3.916	342	12.1	13.0	81.6	0.075	3390	2542	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3081.17018.7930.0350.0010.0010.039
fbmy8028_rel_221222.cza1ps0_gcp_c2s3087.13512.8300.033nonzero0.0010.039
fbmy8032_rel_221222.cza1_gcp_c2s3073.10926.8530.0360.0010.0010.045
fbmy8032_rel_221222.cza1ps0_gcp_c2s3083.04416.9190.0350.0010.0010.039

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.15254.93344.8790.0360.037
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.25155.52744.1830.0390.041
fbmy8032_rel_221222.cza1_gcp_c2s300.06855.66544.2190.0480.039
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.07455.04644.8190.0600.029

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s301.37155.70342.8810.0450.063
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.55756.35342.0520.0370.0010.073
fbmy8032_rel_221222.cza1_gcp_c2s300.51357.26842.1720.0460.057
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.78356.09443.0650.0570.062

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	32088	0	0.0	123.1	34.8	0.000	0.000	0.015	4.489	137623	61.6	4.289	288	12.3	13.3	84.3	0.039	4091	3516	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	33919	0	0.0	119.3	34.3	0.000	0.000	0.015	4.423	145468	60.6	4.289	268	12.3	13.3	83.3	0.039	4315	3657	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7947	30619	0	0.0	120.2	33.5	0.000	0.000	0.015	4.320	130493	61.9	4.262	303	12.2	13.2	83.5	0.045	3868	3292	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	32651	0	0.0	123.3	35.6	0.000	0.000	0.016	4.591	139961	61.0	4.287	280	12.2	13.2	83.7	0.039	4140	3452	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
547945	0	0	0.0	461.8	126.6	0.000	0.000	0.001	0.237	62995	73.1	0.115	20	4.7	6.4	1.6	0.326	73420	51544	fbmy8028_rel_221222.cza1_gcp_c2s30
549828	0	0	0.0	481.9	129.1	0.000	0.000	0.001	0.240	63116	73.1	0.115	20	4.7	6.3	1.4	0.398	73621	48448	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
517799	0	0	0.0	445.8	121.7	0.000	0.000	0.001	0.241	60620	72.5	0.117	21	4.6	6.3	1.7	0.383	70323	43952	fbmy8032_rel_221222.cza1_gcp_c2s30
535117	0	0	0.0	468.6	128.0	0.000	0.000	0.001	0.245	62213	73.1	0.116	20	4.6	6.3	1.5	0.312	72921	48747	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
765551	0	1	0.1	284.1	107.7	0.000	0.000	0.000	0.144	1331	50.1	0.002	10	10.5	12.2	12.9	0.003	NA	NA	fbmy8028_rel_221222.cza1_gcp_c2s30
765551	0	1	0.1	289.6	106.7	0.000	0.000	0.000	0.143	1471	49.6	0.002	10	10.5	12.1	12.7	0.002	NA	NA	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
784314	0	1	0.1	291.0	109.9	0.000	0.000	0.000	0.144	1842	50.4	0.002	10	10.4	12.1	13.0	0.003	NA	NA	fbmy8032_rel_221222.cza1_gcp_c2s30
788178	0	1	0.1	292.4	111.0	0.000	0.000	0.000	0.144	1696	50.2	0.002	10	10.5	12.1	12.8	0.003	NA	NA	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
90446	0	4	0.4	589.3	165.4	0.000	0.004	0.007	1.873	54752	64.2	0.605	106	13.3	13.9	50.5	0.638	11438	8041	fbmy8028_rel_221222.cza1_gcp_c2s30
90961	0	4	0.3	587.6	165.8	0.000	0.004	0.006	1.867	55566	63.7	0.611	105	12.7	13.3	51.2	0.880	11587	8090	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
89485	0	4	0.4	574.0	162.9	0.000	0.004	0.006	1.864	54201	64.7	0.606	108	12.9	13.5	51.5	0.567	11341	8191	fbmy8032_rel_221222.cza1_gcp_c2s30
89686	0	4	0.4	589.3	165.3	0.000	0.004	0.007	1.887	54413	64.2	0.607	107	12.3	12.9	50.2	0.661	11388	8341	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
42395	0	0	0.0	330.9	74.4	0.000	0.000	0.008	1.797	230357	68.6	5.434	243	12.3	12.6	62.2	0.325	5574	3191	fbmy8028_rel_221222.cza1_gcp_c2s30
43173	0	0	0.0	336.9	74.5	0.000	0.000	0.008	1.767	236220	67.8	5.471	236	12.1	12.3	62.3	0.311	5681	3291	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
41026	0	0	0.0	320.5	70.7	0.000	0.000	0.008	1.766	222150	68.7	5.415	251	11.8	12.1	62.4	0.704	5379	3082	fbmy8032_rel_221222.cza1_gcp_c2s30
42150	0	0	0.0	326.6	73.3	0.000	0.000	0.008	1.781	231898	67.7	5.502	241	12.9	13.1	62.0	0.333	5534	3231	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	25421	0	0.0	19.7	4.5	0.000	0.000	0.025	5.760	98445	53.4	3.873	315	11.4	11.8	64.0	0.054	2558	2333	fbmy8028_rel_221222.cza1_gcp_c2s30
793	29135	0	0.0	14.1	3.0	0.000	0.000	0.018	3.830	112671	52.8	3.867	272	11.5	11.9	63.7	0.040	4523	2158	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
793	26630	0	0.0	15.0	3.2	0.000	0.000	0.019	4.072	103061	53.5	3.870	301	11.4	11.8	63.8	0.051	3708	3388	fbmy8032_rel_221222.cza1_gcp_c2s30
793	28892	0	0.0	14.6	3.0	0.000	0.000	0.018	3.831	111864	52.9	3.872	275	11.4	11.8	63.3	0.045	3230	3005	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	35856	0	0.0	13.9	3.8	0.000	0.000	0.018	4.919	147622	54.2	4.117	227	11.4	12.1	74.8	0.031	4539	3820	fbmy8028_rel_221222.cza1_gcp_c2s30
793	37943	0	0.0	13.4	3.6	0.000	0.000	0.017	4.620	156354	53.5	4.121	212	11.5	12.1	74.8	0.018	4827	4155	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
794	34269	0	0.0	12.4	3.2	0.000	0.000	0.016	4.154	140576	53.9	4.102	236	11.4	12.1	74.3	0.028	4317	3741	fbmy8032_rel_221222.cza1_gcp_c2s30
793	36542	0	0.0	13.4	3.6	0.000	0.000	0.017	4.621	150522	53.3	4.119	219	11.4	12.0	74.5	0.019	4653	3964	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	26636	0	0.0	59.4	19.2	0.000	0.000	0.015	4.948	103838	57.0	3.898	321	11.4	13.0	79.5	0.071	3724	3228	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	29140	0	0.0	56.0	18.5	0.000	0.000	0.014	4.772	113428	56.3	3.893	290	11.4	13.1	79.4	0.064	3468	2925	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3970	26751	0	0.0	55.5	17.6	0.000	0.000	0.014	4.529	104103	56.9	3.892	319	11.4	13.1	79.2	0.071	3772	3085	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	28280	0	0.0	55.0	17.8	0.000	0.000	0.014	4.590	110106	56.3	3.893	299	11.5	13.1	78.9	0.060	4523	3708	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	34150	0	0.0	60.9	18.8	0.000	0.000	0.015	4.845	143903	57.5	4.214	253	11.5	12.3	81.6	0.026	4363	3868	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	36016	0	0.0	60.1	18.0	0.000	0.000	0.015	4.649	151594	56.6	4.209	236	11.5	12.2	81.0	0.016	4603	4012	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3970	32625	0	0.0	62.1	18.3	0.000	0.000	0.016	4.719	136727	57.6	4.191	265	11.6	12.3	81.7	0.016	4171	3676	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	34926	0	0.0	60.6	18.4	0.000	0.000	0.015	4.758	146720	56.8	4.201	244	11.6	12.3	81.3	0.025	4461	3821	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	24914	0	0.0	117.8	34.3	0.000	0.000	0.015	4.413	97655	61.1	3.920	368	12.1	13.0	81.9	0.075	3374	2701	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	25650	0	0.0	121.9	35.2	0.000	0.000	0.015	4.531	100566	60.5	3.921	354	11.8	12.6	81.3	0.078	3197	2557	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7947	25440	0	0.0	118.7	33.8	0.000	0.000	0.015	4.356	99211	61.3	3.900	361	12.1	13.0	82.0	0.066	2973	2381	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	26611	0	0.0	122.5	36.1	0.000	0.000	0.015	4.651	104201	60.6	3.916	342	12.1	13.0	81.6	0.075	3390	2542	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	32088	0	0.0	123.1	34.8	0.000	0.000	0.015	4.489	137623	61.6	4.289	288	12.3	13.3	84.3	0.039	4091	3516	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	33919	0	0.0	119.3	34.3	0.000	0.000	0.015	4.423	145468	60.6	4.289	268	12.3	13.3	83.3	0.039	4315	3657	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7947	30619	0	0.0	120.2	33.5	0.000	0.000	0.015	4.320	130493	61.9	4.262	303	12.2	13.2	83.5	0.045	3868	3292	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	32651	0	0.0	123.3	35.6	0.000	0.000	0.016	4.591	139961	61.0	4.287	280	12.2	13.2	83.7	0.039	4140	3452	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	8.674	91.188	0.115	0.007	0.013	0.004	0.000	0.000	0.000	0.326	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	10.769	89.087	0.122	0.006	0.011	0.005	0.000	0.000	0.000	0.398	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	3.894	95.965	0.121	0.004	0.014	0.003	0.000	0.000	0.000	0.383	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	8.412	91.428	0.137	0.006	0.013	0.004	0.000	0.000	0.000	0.312	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.011	37.474	62.391	0.103	0.015	0.005	0.000	0.000	0.000	0.638	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.012	38.576	61.292	0.101	0.013	0.006	0.000	0.000	0.000	0.880	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.012	35.979	63.886	0.104	0.015	0.004	0.000	0.000	0.000	0.567	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.014	36.070	63.792	0.104	0.015	0.005	0.000	0.000	0.000	0.661	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.020	40.681	59.181	0.098	0.015	0.005	0.000	0.000	0.000	0.635	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.024	41.895	57.965	0.097	0.013	0.006	0.000	0.000	0.000	0.880	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.013	38.353	61.513	0.102	0.015	0.004	0.000	0.000	0.000	0.566	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.017	38.463	61.401	0.100	0.015	0.004	0.000	0.000	0.000	0.663	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.016	82.282	17.592	0.104	0.003	0.002	nonzero	0.000	0.000	0.000	0.325	fbmy8028_rel_221222.cza1_gcp_c2s30
0.021	83.873	15.999	0.102	0.003	0.002	nonzero	0.000	0.000	0.000	0.311	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.002	78.661	21.218	0.114	0.003	0.002	nonzero	0.000	0.000	0.000	0.704	fbmy8032_rel_221222.cza1_gcp_c2s30
0.010	81.778	18.102	0.105	0.002	0.002	nonzero	0.000	0.000	0.000	0.333	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
nonzero	75.137	24.749	0.108	0.003	0.003	nonzero	0.000	0.000	0.000	0.325	fbmy8028_rel_221222.cza1_gcp_c2s30
nonzero	77.204	22.685	0.105	0.003	0.003	nonzero	0.000	0.000	0.000	0.312	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	70.729	29.149	0.117	0.003	0.002	nonzero	0.000	0.000	0.000	0.704	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	74.383	25.505	0.107	0.003	0.002	nonzero	0.000	0.000	0.000	0.331	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
77.126	18.201	4.673	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.054	fbmy8028_rel_221222.cza1_gcp_c2s30
76.203	23.266	0.531	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
70.839	28.403	0.758	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.051	fbmy8032_rel_221222.cza1_gcp_c2s30
68.925	31.040	0.035	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.045	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	5.557	94.438	0.005	0.000	0.000	0.000	0.000	0.000	0.000	0.004	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	4.854	95.130	0.016	0.000	0.000	0.000	0.000	0.000	0.000	0.005	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.500	99.099	0.401	0.000	0.000	0.000	0.000	0.000	0.000	0.006	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	1.312	97.682	1.005	0.000	0.000	0.000	0.000	0.000	0.000	0.008	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	19.229	80.771	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	16.036	83.948	0.016	0.000	0.000	0.000	0.000	0.000	0.000	0.004	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	3.646	96.094	0.260	0.000	0.000	0.000	0.000	0.000	0.000	0.005	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	5.333	93.906	0.760	0.000	0.000	0.000	0.000	0.000	0.000	0.013	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
96.590	3.409	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	fbmy8028_rel_221222.cza1_gcp_c2s30
97.622	2.376	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.018	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
95.090	4.909	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	fbmy8032_rel_221222.cza1_gcp_c2s30
96.924	3.074	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.019	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.365	95.536	4.099	0.000	0.000	0.000	0.000	0.000	0.000	0.012	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.938	98.891	0.172	0.000	0.000	0.000	0.000	0.000	0.000	0.007	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.188	98.812	0.990	0.010	0.000	0.000	0.000	0.000	0.000	0.016	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.339	97.354	2.307	0.000	0.000	0.000	0.000	0.000	0.000	0.015	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	3.620	93.089	3.292	0.000	0.000	0.000	0.000	0.000	0.000	0.011	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	8.115	91.714	0.172	0.000	0.000	0.000	0.000	0.000	0.000	0.011	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	3.000	96.161	0.823	0.016	0.000	0.000	0.000	0.000	0.000	0.016	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	2.578	95.557	1.865	0.000	0.000	0.000	0.000	0.000	0.000	0.014	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
70.097	25.854	4.049	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.071	fbmy8028_rel_221222.cza1_gcp_c2s30
72.509	26.558	0.933	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.064	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
69.567	27.612	2.820	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.071	fbmy8032_rel_221222.cza1_gcp_c2s30
71.703	27.628	0.668	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.060	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.704	77.366	19.903	0.027	0.000	0.000	0.000	0.000	0.000	0.021	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.572	78.508	19.897	0.023	0.000	0.000	0.000	0.000	0.000	0.021	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.427	73.367	26.168	0.039	0.000	0.000	0.000	0.000	0.000	0.024	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.645	72.019	27.324	0.013	0.000	0.000	0.000	0.000	0.000	0.018	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	6.401	74.954	18.616	0.028	0.001	0.000	0.000	0.000	0.000	0.069	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	4.844	76.473	18.654	0.029	0.000	0.000	0.000	0.000	0.000	0.027	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	1.861	73.093	25.010	0.035	0.000	0.000	0.000	0.000	0.000	0.023	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	2.243	71.550	26.196	0.011	0.000	0.000	0.000	0.000	0.000	0.022	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
91.719	8.271	0.010	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	fbmy8028_rel_221222.cza1_gcp_c2s30
94.017	5.976	0.007	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.016	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
87.499	12.490	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.016	fbmy8032_rel_221222.cza1_gcp_c2s30
92.756	7.234	0.009	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.843	74.628	24.512	0.017	0.000	0.000	0.000	0.000	0.000	0.019	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.106	84.180	14.703	0.010	0.000	0.000	0.000	0.000	0.000	0.037	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.132	78.181	21.663	0.024	0.000	0.000	0.000	0.000	0.000	0.031	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.372	75.102	24.509	0.017	0.000	0.000	0.000	0.000	0.000	0.042	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	3.862	72.939	23.180	0.019	0.000	0.000	0.000	0.000	0.000	0.019	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	4.569	81.650	13.768	0.014	0.000	0.000	0.000	0.000	0.000	0.057	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	1.361	78.329	20.289	0.021	0.000	0.000	0.000	0.000	0.000	0.029	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	2.182	74.601	23.204	0.013	0.000	0.000	0.000	0.000	0.000	0.058	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
68.268	29.616	2.114	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.075	fbmy8028_rel_221222.cza1_gcp_c2s30
69.051	29.674	1.273	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.078	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
68.965	28.892	2.142	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.066	fbmy8032_rel_221222.cza1_gcp_c2s30
70.155	27.248	2.595	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.075	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.242	55.267	44.439	0.052	0.000	0.000	0.000	0.000	0.000	0.027	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.623	55.776	43.560	0.042	0.000	0.000	0.000	0.000	0.000	0.024	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.076	57.086	42.778	0.060	0.000	0.000	0.000	0.000	0.000	0.038	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.226	56.045	43.683	0.046	0.000	0.000	0.000	0.000	0.000	0.027	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.397	55.761	42.796	0.045	0.001	0.000	0.000	0.000	0.000	0.072	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	2.110	55.982	41.863	0.045	0.001	0.000	0.000	0.000	0.000	0.075	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.570	58.489	40.879	0.062	0.000	0.000	0.000	0.000	0.000	0.059	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	1.008	56.690	42.259	0.044	0.000	0.000	0.000	0.000	0.000	0.060	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
81.170	18.793	0.035	0.001	0.001	0.000	0.000	0.000	0.000	0.000	0.039	fbmy8028_rel_221222.cza1_gcp_c2s30
87.135	12.830	0.033	nonzero	0.001	0.000	0.000	0.000	0.000	0.000	0.039	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
73.109	26.853	0.036	0.001	0.001	0.000	0.000	0.000	0.000	0.000	0.045	fbmy8032_rel_221222.cza1_gcp_c2s30
83.044	16.919	0.035	0.001	0.001	0.000	0.000	0.000	0.000	0.000	0.039	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.152	54.933	44.879	0.036	0.000	0.000	0.000	0.000	0.000	0.037	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.251	55.527	44.183	0.039	0.000	0.000	0.000	0.000	0.000	0.041	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.068	55.665	44.219	0.048	0.000	0.000	0.000	0.000	0.000	0.039	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.074	55.046	44.819	0.060	0.000	0.000	0.000	0.000	0.000	0.029	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.371	55.703	42.881	0.045	0.000	0.000	0.000	0.000	0.000	0.063	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.557	56.353	42.052	0.037	0.001	0.000	0.000	0.000	0.000	0.073	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.513	57.268	42.172	0.046	0.000	0.000	0.000	0.000	0.000	0.057	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.783	56.094	43.065	0.057	0.000	0.000	0.000	0.000	0.000	0.062	fbmy8032_rel_221222.cza1ps0_gcp_c2s30