Introduction

This is a report for the insert benchmark with 160M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server is a c2-standard-30 from GCP with 15 cores, hyperthreads disabled, Ubuntu 22.04 and XFS using SW RAID 0 over 4 local SSDs. The benchmark was run with 8 clients and there were 1, 2 or 3 connections per client. It uses 8 tables with a client per table. It loads 20M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 50m+50m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1200s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
fbmy8028_rel_221222.cza1_gcp_c2s30 5369137582948953641195244143510222244333402315131341
fbmy8028_rel_221222.cza1ps0_gcp_c2s30 5479457692318966141841277293680123478348992242032535
fbmy8032_rel_221222.cza1_gcp_c2s30 5144697767008803339960247783347623576318682300829824
fbmy8032_rel_221222.cza1ps0_gcp_c2s30 5315617843148876641110276053598124829343672477832212

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
fbmy8028_rel_221222.cza1_gcp_c2s30 1.001.001.001.001.001.001.001.001.001.00
fbmy8028_rel_221222.cza1ps0_gcp_c2s30 1.021.011.001.021.141.051.061.050.971.04
fbmy8032_rel_221222.cza1_gcp_c2s30 0.961.020.980.971.010.951.060.960.990.95
fbmy8032_rel_221222.cza1ps0_gcp_c2s30 0.991.030.991.001.131.031.121.031.071.03

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
fbmy8028_rel_221222.cza1_gcp_c2s307947943970397079477947
fbmy8028_rel_221222.cza1ps0_gcp_c2s307937943970397079477947
fbmy8032_rel_221222.cza1_gcp_c2s307947943967396779407940
fbmy8032_rel_221222.cza1ps0_gcp_c2s307937933970397079477947
target8008004000400080008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s307.25492.6070.1160.0070.0120.0040.333
fbmy8028_rel_221222.cza1ps0_gcp_c2s3010.19389.6520.1320.0070.0110.0060.333
fbmy8032_rel_221222.cza1_gcp_c2s302.93796.9170.1220.0070.0150.0030.337
fbmy8032_rel_221222.cza1ps0_gcp_c2s307.80392.0520.1220.0060.0150.0020.371

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
536913	0	0	0.0	458.8	123.4	0.000	0.000	0.001	0.235	61941	73.2	0.115	20	4.7	6.4	1.7	0.333	72321	50345	fbmy8028_rel_221222.cza1_gcp_c2s30
547945	0	0	0.0	471.9	126.0	0.000	0.000	0.001	0.235	63150	73.1	0.115	20	4.7	6.3	1.4	0.333	74219	46749	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
514469	0	0	0.0	442.3	119.0	0.000	0.000	0.001	0.237	59687	72.3	0.116	21	4.6	6.4	1.7	0.337	70622	46949	fbmy8032_rel_221222.cza1_gcp_c2s30
531561	0	0	0.0	458.5	121.9	0.000	0.000	0.001	0.235	61755	72.4	0.116	20	4.6	6.3	1.5	0.371	72022	48348	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
758294	0	1	0.1	291.1	106.3	0.000	0.000	0.000	0.144	1428	48.6	0.002	10	10.4	12.0	13.2	0.003	NA	NA	fbmy8028_rel_221222.cza1_gcp_c2s30
769231	0	1	0.1	299.4	107.2	0.000	0.000	0.000	0.143	1576	49.8	0.002	10	10.5	12.1	12.8	0.002	NA	NA	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
776700	0	1	0.1	292.9	108.0	0.000	0.000	0.000	0.142	1776	50.0	0.002	10	10.4	12.2	13.1	0.003	NA	NA	fbmy8032_rel_221222.cza1_gcp_c2s30
784314	0	1	0.1	297.7	110.5	0.000	0.000	0.000	0.144	1920	50.2	0.002	10	10.4	12.1	12.8	0.003	NA	NA	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.01535.08764.7760.1030.0140.0040.467
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.01535.60764.2560.1040.0120.0060.700
fbmy8032_rel_221222.cza1_gcp_c2s300.00333.12466.7550.0980.0140.005nonzero1.012
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.00933.94365.9270.1020.0140.0050.388

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.01938.36361.5020.0980.0140.0040.477
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.02238.86560.9950.0990.0120.0060.701
fbmy8032_rel_221222.cza1_gcp_c2s300.00535.49564.3870.0940.0140.005nonzero1.011
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.01136.68263.1910.0970.0140.0050.386

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
89536	0	4	0.4	565.2	159.5	0.000	0.004	0.006	1.824	54886	63.3	0.613	106	13.1	13.6	51.7	0.467	11437	7941	fbmy8028_rel_221222.cza1_gcp_c2s30
89661	0	4	0.4	578.1	163.8	0.000	0.004	0.006	1.870	55123	63.5	0.615	106	12.1	12.7	50.4	0.700	11437	8090	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
88033	0	4	0.4	568.6	161.6	0.000	0.004	0.006	1.880	53274	64.5	0.605	110	14.8	15.5	51.7	1.012	11192	7792	fbmy8032_rel_221222.cza1_gcp_c2s30
88766	0	4	0.4	581.8	164.8	0.000	0.004	0.007	1.901	54416	63.8	0.613	108	13.3	13.9	51.1	0.388	11288	8091	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.00379.35020.5360.1060.0030.0020.0010.311
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.01180.82819.0540.1020.0030.0020.0010.334
fbmy8032_rel_221222.cza1_gcp_c2s300.00175.37824.4990.1180.0030.001nonzero0.315
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.00578.81521.0630.1120.0030.002nonzero0.302

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3071.21328.6710.1100.0030.0020.0010.312
fbmy8028_rel_221222.cza1ps0_gcp_c2s3073.27526.6140.1060.0030.0020.0010.333
fbmy8032_rel_221222.cza1_gcp_c2s3066.44733.4280.1200.0030.001nonzero0.286
fbmy8032_rel_221222.cza1ps0_gcp_c2s3070.82129.0600.1130.0030.002nonzero0.300

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
41195	0	0	0.0	318.3	71.8	0.000	0.000	0.008	1.785	224513	68.3	5.450	249	12.0	12.3	62.3	0.311	5394	3082	fbmy8028_rel_221222.cza1_gcp_c2s30
41841	0	0	0.0	325.2	75.0	0.000	0.000	0.008	1.835	229800	67.6	5.492	242	11.9	12.1	62.1	0.334	5476	3172	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
39960	0	0	0.0	308.4	70.3	0.000	0.000	0.008	1.802	217218	68.4	5.436	257	12.0	12.3	62.4	0.315	5241	3061	fbmy8032_rel_221222.cza1_gcp_c2s30
41110	0	0	0.0	320.4	70.1	0.000	0.000	0.008	1.747	226774	67.6	5.516	247	12.2	12.5	62.4	0.302	5369	3117	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3068.63429.3152.051nonzerononzero0.040
fbmy8028_rel_221222.cza1ps0_gcp_c2s3067.02732.0900.883nonzerononzero0.055
fbmy8032_rel_221222.cza1_gcp_c2s3067.40130.1732.426nonzerononzero0.029
fbmy8032_rel_221222.cza1ps0_gcp_c2s3069.47026.3444.186nonzerononzero0.044

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.37098.8750.7550.009
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.49596.0782.4220.0050.020
fbmy8032_rel_221222.cza1_gcp_c2s300.45399.2190.3280.005
fbmy8032_rel_221222.cza1ps0_gcp_c2s301.95398.0260.0210.008

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s304.22495.2600.5100.0050.019
fbmy8028_rel_221222.cza1ps0_gcp_c2s306.32891.8331.8390.008
fbmy8032_rel_221222.cza1_gcp_c2s302.59997.1300.2710.015
fbmy8032_rel_221222.cza1ps0_gcp_c2s307.19392.7710.0310.0050.017

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	24414	0	0.0	15.1	3.3	0.000	0.000	0.019	4.258	94704	53.2	3.879	327	11.4	11.8	63.5	0.040	3676	3388	fbmy8028_rel_221222.cza1_gcp_c2s30
793	27729	0	0.0	14.3	3.0	0.000	0.000	0.018	3.881	107594	52.8	3.880	286	11.4	11.8	63.2	0.055	2701	2461	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
794	24778	0	0.0	12.1	2.5	0.000	0.000	0.015	3.192	96044	53.0	3.876	321	11.4	11.8	63.6	0.029	3021	2765	fbmy8032_rel_221222.cza1_gcp_c2s30
793	27605	0	0.0	15.9	3.5	0.000	0.000	0.020	4.570	107111	52.9	3.880	287	11.4	11.8	63.9	0.044	4091	3693	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3095.8414.1570.001nonzero0.0010.020
fbmy8028_rel_221222.cza1ps0_gcp_c2s3097.0012.9970.001nonzero0.0010.039
fbmy8032_rel_221222.cza1_gcp_c2s3093.3396.6590.001nonzero0.0010.021
fbmy8032_rel_221222.cza1ps0_gcp_c2s3096.3773.6210.001nonzero0.0010.034

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.53199.3180.1510.006
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.90198.5520.5470.006
fbmy8032_rel_221222.cza1_gcp_c2s300.30299.2080.4900.008
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.34498.5101.1460.007

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s306.39693.4380.1670.006
fbmy8028_rel_221222.cza1ps0_gcp_c2s308.32891.2920.3800.014
fbmy8032_rel_221222.cza1_gcp_c2s303.05796.4790.4640.008
fbmy8032_rel_221222.cza1ps0_gcp_c2s304.39194.7550.8540.012

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	35102	0	0.0	12.5	3.3	0.000	0.000	0.016	4.265	145619	54.0	4.148	231	11.4	12.0	74.5	0.020	4443	3757	fbmy8028_rel_221222.cza1_gcp_c2s30
794	36801	0	0.0	12.8	3.4	0.000	0.000	0.016	4.410	153033	53.2	4.158	217	11.4	12.0	73.7	0.039	4651	4028	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
794	33476	0	0.0	11.5	2.8	0.000	0.000	0.015	3.658	138206	53.9	4.128	242	11.5	12.1	73.8	0.021	4205	3596	fbmy8032_rel_221222.cza1_gcp_c2s30
793	35981	0	0.0	13.8	3.8	0.000	0.000	0.017	4.855	149559	53.2	4.157	222	11.4	12.0	74.9	0.034	4587	3932	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3068.84526.9094.2460.001nonzero0.060
fbmy8028_rel_221222.cza1ps0_gcp_c2s3067.99729.1312.8720.001nonzerononzero0.072
fbmy8032_rel_221222.cza1_gcp_c2s3070.73225.3813.8860.001nonzero0.061
fbmy8032_rel_221222.cza1ps0_gcp_c2s3067.38129.9722.6470.001nonzero0.061

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.72175.79323.4720.0150.022
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.97372.48226.5220.0230.022
fbmy8032_rel_221222.cza1_gcp_c2s300.34274.06725.5520.0400.020
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.57277.04522.3600.0230.021

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s302.64975.25422.0820.0150.023
fbmy8028_rel_221222.cza1ps0_gcp_c2s303.76571.08925.1300.0170.023
fbmy8032_rel_221222.cza1_gcp_c2s301.41874.32324.2160.0440.030
fbmy8032_rel_221222.cza1ps0_gcp_c2s302.04876.84221.0890.0220.026

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	22244	0	0.0	53.8	17.8	0.000	0.000	0.014	4.598	87081	56.7	3.915	382	11.4	13.1	79.4	0.060	3069	2606	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	23478	0	0.0	59.0	19.4	0.000	0.000	0.015	4.994	92048	56.2	3.921	359	11.4	13.1	79.1	0.072	3037	2269	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3967	23576	0	0.0	55.2	18.2	0.000	0.000	0.014	4.708	92281	56.8	3.914	361	11.5	13.2	78.7	0.061	3932	2493	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	24829	0	0.0	58.0	18.7	0.000	0.000	0.015	4.823	97213	56.2	3.915	340	11.5	13.2	79.5	0.061	3788	3196	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3089.77710.2110.011nonzerononzero0.024
fbmy8028_rel_221222.cza1ps0_gcp_c2s3092.2837.7080.010nonzero0.012
fbmy8032_rel_221222.cza1_gcp_c2s3083.84116.1450.013nonzero0.015
fbmy8032_rel_221222.cza1ps0_gcp_c2s3091.5158.4740.011nonzero0.009

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.26370.12329.5990.0160.020
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.51672.10027.3810.0030.018
fbmy8032_rel_221222.cza1_gcp_c2s300.02764.30035.6530.0200.022
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.22171.62028.1390.0210.033

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s302.03269.91528.0300.0220.0010.069
fbmy8028_rel_221222.cza1ps0_gcp_c2s302.44971.89825.6490.0040.019
fbmy8032_rel_221222.cza1_gcp_c2s300.59665.17434.2160.0150.024
fbmy8032_rel_221222.cza1ps0_gcp_c2s301.66171.95926.3630.0170.026

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	33340	0	0.0	58.6	17.9	0.000	0.000	0.015	4.613	141677	57.4	4.249	258	11.6	12.3	81.2	0.024	4251	3708	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	34899	0	0.0	62.2	19.1	0.000	0.000	0.016	4.932	148721	56.7	4.261	244	11.5	12.3	81.5	0.012	4475	3852	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3967	31868	0	0.0	63.4	18.6	0.000	0.000	0.016	4.798	134512	57.7	4.221	272	11.6	12.3	81.4	0.015	4044	3484	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	34367	0	0.0	61.1	17.7	0.000	0.000	0.015	4.573	145842	56.7	4.244	247	11.6	12.3	81.0	0.009	4428	3852	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3066.28929.0764.6340.001nonzerononzero0.080
fbmy8028_rel_221222.cza1ps0_gcp_c2s3067.71525.8966.3880.001nonzerononzero0.071
fbmy8032_rel_221222.cza1_gcp_c2s3067.67526.8765.4480.001nonzerononzero0.074
fbmy8032_rel_221222.cza1ps0_gcp_c2s3069.33624.8135.8500.001nonzerononzero0.068

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.14453.64246.1570.0570.030
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.46457.19342.3120.0310.027
fbmy8032_rel_221222.cza1_gcp_c2s300.05256.13143.7850.0320.028
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.13653.77946.0430.0410.046

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s301.04254.51544.3830.0610.030
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.73957.49740.7470.0170.0010.065
fbmy8032_rel_221222.cza1_gcp_c2s300.44957.25542.2700.0260.031
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.81954.66444.4820.0350.0010.067

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	23151	0	0.0	124.1	36.2	0.000	0.000	0.016	4.667	91296	61.3	3.943	397	12.2	13.1	81.9	0.080	3294	2270	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	22420	0	0.0	119.5	33.5	0.000	0.000	0.015	4.315	88856	60.3	3.963	403	12.2	13.0	81.2	0.071	3292	2541	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7940	23008	0	0.0	120.0	34.2	0.000	0.000	0.015	4.405	90647	61.2	3.940	399	12.1	13.0	81.7	0.074	3037	2365	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	24778	0	0.0	118.6	33.8	0.000	0.000	0.015	4.359	97497	60.4	3.935	366	12.1	13.0	81.8	0.068	3468	2685	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3077.96821.9930.0380.0010.0010.042
fbmy8028_rel_221222.cza1ps0_gcp_c2s3082.15217.8100.036nonzero0.0010.042
fbmy8032_rel_221222.cza1_gcp_c2s3066.70833.2480.0420.0010.0010.042
fbmy8032_rel_221222.cza1ps0_gcp_c2s3081.52518.4370.036nonzero0.0010.042

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.06752.31547.5860.0320.042
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.13154.20345.6240.0420.041
fbmy8032_rel_221222.cza1_gcp_c2s300.01150.97248.9650.0520.041
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.04753.37246.5430.0380.029

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.85753.68545.4240.0330.0010.074
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.18555.06743.6980.0490.042
fbmy8032_rel_221222.cza1_gcp_c2s300.23152.48847.2190.0610.0010.065
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.71654.79944.4410.0430.0010.070

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	31341	0	0.0	118.5	34.8	0.000	0.000	0.015	4.480	135937	61.6	4.337	295	12.3	13.3	83.3	0.042	3948	3390	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	32535	0	0.0	126.3	35.7	0.000	0.000	0.016	4.596	141789	61.1	4.358	282	12.2	13.2	83.7	0.042	4123	3388	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7940	29824	0	0.0	124.9	35.0	0.000	0.000	0.016	4.517	128712	62.0	4.316	312	12.3	13.2	83.7	0.042	3756	3101	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	32212	0	0.0	119.0	34.5	0.000	0.000	0.015	4.441	139819	60.8	4.341	283	12.2	13.2	83.7	0.042	4091	3532	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
536913	0	0	0.0	458.8	123.4	0.000	0.000	0.001	0.235	61941	73.2	0.115	20	4.7	6.4	1.7	0.333	72321	50345	fbmy8028_rel_221222.cza1_gcp_c2s30
547945	0	0	0.0	471.9	126.0	0.000	0.000	0.001	0.235	63150	73.1	0.115	20	4.7	6.3	1.4	0.333	74219	46749	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
514469	0	0	0.0	442.3	119.0	0.000	0.000	0.001	0.237	59687	72.3	0.116	21	4.6	6.4	1.7	0.337	70622	46949	fbmy8032_rel_221222.cza1_gcp_c2s30
531561	0	0	0.0	458.5	121.9	0.000	0.000	0.001	0.235	61755	72.4	0.116	20	4.6	6.3	1.5	0.371	72022	48348	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
758294	0	1	0.1	291.1	106.3	0.000	0.000	0.000	0.144	1428	48.6	0.002	10	10.4	12.0	13.2	0.003	NA	NA	fbmy8028_rel_221222.cza1_gcp_c2s30
769231	0	1	0.1	299.4	107.2	0.000	0.000	0.000	0.143	1576	49.8	0.002	10	10.5	12.1	12.8	0.002	NA	NA	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
776700	0	1	0.1	292.9	108.0	0.000	0.000	0.000	0.142	1776	50.0	0.002	10	10.4	12.2	13.1	0.003	NA	NA	fbmy8032_rel_221222.cza1_gcp_c2s30
784314	0	1	0.1	297.7	110.5	0.000	0.000	0.000	0.144	1920	50.2	0.002	10	10.4	12.1	12.8	0.003	NA	NA	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
89536	0	4	0.4	565.2	159.5	0.000	0.004	0.006	1.824	54886	63.3	0.613	106	13.1	13.6	51.7	0.467	11437	7941	fbmy8028_rel_221222.cza1_gcp_c2s30
89661	0	4	0.4	578.1	163.8	0.000	0.004	0.006	1.870	55123	63.5	0.615	106	12.1	12.7	50.4	0.700	11437	8090	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
88033	0	4	0.4	568.6	161.6	0.000	0.004	0.006	1.880	53274	64.5	0.605	110	14.8	15.5	51.7	1.012	11192	7792	fbmy8032_rel_221222.cza1_gcp_c2s30
88766	0	4	0.4	581.8	164.8	0.000	0.004	0.007	1.901	54416	63.8	0.613	108	13.3	13.9	51.1	0.388	11288	8091	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
41195	0	0	0.0	318.3	71.8	0.000	0.000	0.008	1.785	224513	68.3	5.450	249	12.0	12.3	62.3	0.311	5394	3082	fbmy8028_rel_221222.cza1_gcp_c2s30
41841	0	0	0.0	325.2	75.0	0.000	0.000	0.008	1.835	229800	67.6	5.492	242	11.9	12.1	62.1	0.334	5476	3172	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
39960	0	0	0.0	308.4	70.3	0.000	0.000	0.008	1.802	217218	68.4	5.436	257	12.0	12.3	62.4	0.315	5241	3061	fbmy8032_rel_221222.cza1_gcp_c2s30
41110	0	0	0.0	320.4	70.1	0.000	0.000	0.008	1.747	226774	67.6	5.516	247	12.2	12.5	62.4	0.302	5369	3117	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	24414	0	0.0	15.1	3.3	0.000	0.000	0.019	4.258	94704	53.2	3.879	327	11.4	11.8	63.5	0.040	3676	3388	fbmy8028_rel_221222.cza1_gcp_c2s30
793	27729	0	0.0	14.3	3.0	0.000	0.000	0.018	3.881	107594	52.8	3.880	286	11.4	11.8	63.2	0.055	2701	2461	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
794	24778	0	0.0	12.1	2.5	0.000	0.000	0.015	3.192	96044	53.0	3.876	321	11.4	11.8	63.6	0.029	3021	2765	fbmy8032_rel_221222.cza1_gcp_c2s30
793	27605	0	0.0	15.9	3.5	0.000	0.000	0.020	4.570	107111	52.9	3.880	287	11.4	11.8	63.9	0.044	4091	3693	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
794	35102	0	0.0	12.5	3.3	0.000	0.000	0.016	4.265	145619	54.0	4.148	231	11.4	12.0	74.5	0.020	4443	3757	fbmy8028_rel_221222.cza1_gcp_c2s30
794	36801	0	0.0	12.8	3.4	0.000	0.000	0.016	4.410	153033	53.2	4.158	217	11.4	12.0	73.7	0.039	4651	4028	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
794	33476	0	0.0	11.5	2.8	0.000	0.000	0.015	3.658	138206	53.9	4.128	242	11.5	12.1	73.8	0.021	4205	3596	fbmy8032_rel_221222.cza1_gcp_c2s30
793	35981	0	0.0	13.8	3.8	0.000	0.000	0.017	4.855	149559	53.2	4.157	222	11.4	12.0	74.9	0.034	4587	3932	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	22244	0	0.0	53.8	17.8	0.000	0.000	0.014	4.598	87081	56.7	3.915	382	11.4	13.1	79.4	0.060	3069	2606	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	23478	0	0.0	59.0	19.4	0.000	0.000	0.015	4.994	92048	56.2	3.921	359	11.4	13.1	79.1	0.072	3037	2269	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3967	23576	0	0.0	55.2	18.2	0.000	0.000	0.014	4.708	92281	56.8	3.914	361	11.5	13.2	78.7	0.061	3932	2493	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	24829	0	0.0	58.0	18.7	0.000	0.000	0.015	4.823	97213	56.2	3.915	340	11.5	13.2	79.5	0.061	3788	3196	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3970	33340	0	0.0	58.6	17.9	0.000	0.000	0.015	4.613	141677	57.4	4.249	258	11.6	12.3	81.2	0.024	4251	3708	fbmy8028_rel_221222.cza1_gcp_c2s30
3970	34899	0	0.0	62.2	19.1	0.000	0.000	0.016	4.932	148721	56.7	4.261	244	11.5	12.3	81.5	0.012	4475	3852	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3967	31868	0	0.0	63.4	18.6	0.000	0.000	0.016	4.798	134512	57.7	4.221	272	11.6	12.3	81.4	0.015	4044	3484	fbmy8032_rel_221222.cza1_gcp_c2s30
3970	34367	0	0.0	61.1	17.7	0.000	0.000	0.015	4.573	145842	56.7	4.244	247	11.6	12.3	81.0	0.009	4428	3852	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	23151	0	0.0	124.1	36.2	0.000	0.000	0.016	4.667	91296	61.3	3.943	397	12.2	13.1	81.9	0.080	3294	2270	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	22420	0	0.0	119.5	33.5	0.000	0.000	0.015	4.315	88856	60.3	3.963	403	12.2	13.0	81.2	0.071	3292	2541	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7940	23008	0	0.0	120.0	34.2	0.000	0.000	0.015	4.405	90647	61.2	3.940	399	12.1	13.0	81.7	0.074	3037	2365	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	24778	0	0.0	118.6	33.8	0.000	0.000	0.015	4.359	97497	60.4	3.935	366	12.1	13.0	81.8	0.068	3468	2685	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7947	31341	0	0.0	118.5	34.8	0.000	0.000	0.015	4.480	135937	61.6	4.337	295	12.3	13.3	83.3	0.042	3948	3390	fbmy8028_rel_221222.cza1_gcp_c2s30
7947	32535	0	0.0	126.3	35.7	0.000	0.000	0.016	4.596	141789	61.1	4.358	282	12.2	13.2	83.7	0.042	4123	3388	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7940	29824	0	0.0	124.9	35.0	0.000	0.000	0.016	4.517	128712	62.0	4.316	312	12.3	13.2	83.7	0.042	3756	3101	fbmy8032_rel_221222.cza1_gcp_c2s30
7947	32212	0	0.0	119.0	34.5	0.000	0.000	0.015	4.441	139819	60.8	4.341	283	12.2	13.2	83.7	0.042	4091	3532	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	7.254	92.607	0.116	0.007	0.012	0.004	0.000	0.000	0.000	0.333	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	10.193	89.652	0.132	0.007	0.011	0.006	0.000	0.000	0.000	0.333	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	2.937	96.917	0.122	0.007	0.015	0.003	0.000	0.000	0.000	0.337	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	7.803	92.052	0.122	0.006	0.015	0.002	0.000	0.000	0.000	0.371	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.015	35.087	64.776	0.103	0.014	0.004	0.000	0.000	0.000	0.467	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.015	35.607	64.256	0.104	0.012	0.006	0.000	0.000	0.000	0.700	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.003	33.124	66.755	0.098	0.014	0.005	nonzero	0.000	0.000	1.012	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.009	33.943	65.927	0.102	0.014	0.005	0.000	0.000	0.000	0.388	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.019	38.363	61.502	0.098	0.014	0.004	0.000	0.000	0.000	0.477	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.022	38.865	60.995	0.099	0.012	0.006	0.000	0.000	0.000	0.701	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.005	35.495	64.387	0.094	0.014	0.005	nonzero	0.000	0.000	1.011	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.011	36.682	63.191	0.097	0.014	0.005	0.000	0.000	0.000	0.386	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.003	79.350	20.536	0.106	0.003	0.002	0.001	0.000	0.000	0.000	0.311	fbmy8028_rel_221222.cza1_gcp_c2s30
0.011	80.828	19.054	0.102	0.003	0.002	0.001	0.000	0.000	0.000	0.334	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.001	75.378	24.499	0.118	0.003	0.001	nonzero	0.000	0.000	0.000	0.315	fbmy8032_rel_221222.cza1_gcp_c2s30
0.005	78.815	21.063	0.112	0.003	0.002	nonzero	0.000	0.000	0.000	0.302	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	71.213	28.671	0.110	0.003	0.002	0.001	0.000	0.000	0.000	0.312	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	73.275	26.614	0.106	0.003	0.002	0.001	0.000	0.000	0.000	0.333	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	66.447	33.428	0.120	0.003	0.001	nonzero	0.000	0.000	0.000	0.286	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	70.821	29.060	0.113	0.003	0.002	nonzero	0.000	0.000	0.000	0.300	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
68.634	29.315	2.051	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.040	fbmy8028_rel_221222.cza1_gcp_c2s30
67.027	32.090	0.883	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.055	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
67.401	30.173	2.426	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	fbmy8032_rel_221222.cza1_gcp_c2s30
69.470	26.344	4.186	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.044	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.370	98.875	0.755	0.000	0.000	0.000	0.000	0.000	0.000	0.009	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.495	96.078	2.422	0.005	0.000	0.000	0.000	0.000	0.000	0.020	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.453	99.219	0.328	0.000	0.000	0.000	0.000	0.000	0.000	0.005	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	1.953	98.026	0.021	0.000	0.000	0.000	0.000	0.000	0.000	0.008	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.224	95.260	0.510	0.005	0.000	0.000	0.000	0.000	0.000	0.019	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	6.328	91.833	1.839	0.000	0.000	0.000	0.000	0.000	0.000	0.008	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	2.599	97.130	0.271	0.000	0.000	0.000	0.000	0.000	0.000	0.015	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	7.193	92.771	0.031	0.005	0.000	0.000	0.000	0.000	0.000	0.017	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
95.841	4.157	0.001	nonzero	0.001	0.000	0.000	0.000	0.000	0.000	0.020	fbmy8028_rel_221222.cza1_gcp_c2s30
97.001	2.997	0.001	nonzero	0.001	0.000	0.000	0.000	0.000	0.000	0.039	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
93.339	6.659	0.001	nonzero	0.001	0.000	0.000	0.000	0.000	0.000	0.021	fbmy8032_rel_221222.cza1_gcp_c2s30
96.377	3.621	0.001	nonzero	0.001	0.000	0.000	0.000	0.000	0.000	0.034	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.531	99.318	0.151	0.000	0.000	0.000	0.000	0.000	0.000	0.006	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.901	98.552	0.547	0.000	0.000	0.000	0.000	0.000	0.000	0.006	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.302	99.208	0.490	0.000	0.000	0.000	0.000	0.000	0.000	0.008	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.344	98.510	1.146	0.000	0.000	0.000	0.000	0.000	0.000	0.007	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	6.396	93.438	0.167	0.000	0.000	0.000	0.000	0.000	0.000	0.006	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	8.328	91.292	0.380	0.000	0.000	0.000	0.000	0.000	0.000	0.014	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	3.057	96.479	0.464	0.000	0.000	0.000	0.000	0.000	0.000	0.008	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	4.391	94.755	0.854	0.000	0.000	0.000	0.000	0.000	0.000	0.012	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
68.845	26.909	4.246	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.060	fbmy8028_rel_221222.cza1_gcp_c2s30
67.997	29.131	2.872	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.072	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
70.732	25.381	3.886	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.061	fbmy8032_rel_221222.cza1_gcp_c2s30
67.381	29.972	2.647	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.061	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.721	75.793	23.472	0.015	0.000	0.000	0.000	0.000	0.000	0.022	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.973	72.482	26.522	0.023	0.000	0.000	0.000	0.000	0.000	0.022	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.342	74.067	25.552	0.040	0.000	0.000	0.000	0.000	0.000	0.020	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.572	77.045	22.360	0.023	0.000	0.000	0.000	0.000	0.000	0.021	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.649	75.254	22.082	0.015	0.000	0.000	0.000	0.000	0.000	0.023	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	3.765	71.089	25.130	0.017	0.000	0.000	0.000	0.000	0.000	0.023	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	1.418	74.323	24.216	0.044	0.000	0.000	0.000	0.000	0.000	0.030	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	2.048	76.842	21.089	0.022	0.000	0.000	0.000	0.000	0.000	0.026	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
89.777	10.211	0.011	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	fbmy8028_rel_221222.cza1_gcp_c2s30
92.283	7.708	0.010	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.012	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
83.841	16.145	0.013	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.015	fbmy8032_rel_221222.cza1_gcp_c2s30
91.515	8.474	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.263	70.123	29.599	0.016	0.000	0.000	0.000	0.000	0.000	0.020	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.516	72.100	27.381	0.003	0.000	0.000	0.000	0.000	0.000	0.018	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.027	64.300	35.653	0.020	0.000	0.000	0.000	0.000	0.000	0.022	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.221	71.620	28.139	0.021	0.000	0.000	0.000	0.000	0.000	0.033	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.032	69.915	28.030	0.022	0.001	0.000	0.000	0.000	0.000	0.069	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	2.449	71.898	25.649	0.004	0.000	0.000	0.000	0.000	0.000	0.019	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.596	65.174	34.216	0.015	0.000	0.000	0.000	0.000	0.000	0.024	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	1.661	71.959	26.363	0.017	0.000	0.000	0.000	0.000	0.000	0.026	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
66.289	29.076	4.634	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.080	fbmy8028_rel_221222.cza1_gcp_c2s30
67.715	25.896	6.388	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.071	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
67.675	26.876	5.448	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.074	fbmy8032_rel_221222.cza1_gcp_c2s30
69.336	24.813	5.850	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.068	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.144	53.642	46.157	0.057	0.000	0.000	0.000	0.000	0.000	0.030	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.464	57.193	42.312	0.031	0.000	0.000	0.000	0.000	0.000	0.027	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.052	56.131	43.785	0.032	0.000	0.000	0.000	0.000	0.000	0.028	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.136	53.779	46.043	0.041	0.000	0.000	0.000	0.000	0.000	0.046	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.042	54.515	44.383	0.061	0.000	0.000	0.000	0.000	0.000	0.030	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.739	57.497	40.747	0.017	0.001	0.000	0.000	0.000	0.000	0.065	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.449	57.255	42.270	0.026	0.000	0.000	0.000	0.000	0.000	0.031	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.819	54.664	44.482	0.035	0.001	0.000	0.000	0.000	0.000	0.067	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
77.968	21.993	0.038	0.001	0.001	0.000	0.000	0.000	0.000	0.000	0.042	fbmy8028_rel_221222.cza1_gcp_c2s30
82.152	17.810	0.036	nonzero	0.001	0.000	0.000	0.000	0.000	0.000	0.042	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
66.708	33.248	0.042	0.001	0.001	0.000	0.000	0.000	0.000	0.000	0.042	fbmy8032_rel_221222.cza1_gcp_c2s30
81.525	18.437	0.036	nonzero	0.001	0.000	0.000	0.000	0.000	0.000	0.042	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.067	52.315	47.586	0.032	0.000	0.000	0.000	0.000	0.000	0.042	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.131	54.203	45.624	0.042	0.000	0.000	0.000	0.000	0.000	0.041	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.011	50.972	48.965	0.052	0.000	0.000	0.000	0.000	0.000	0.041	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.047	53.372	46.543	0.038	0.000	0.000	0.000	0.000	0.000	0.029	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.857	53.685	45.424	0.033	0.001	0.000	0.000	0.000	0.000	0.074	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.185	55.067	43.698	0.049	0.000	0.000	0.000	0.000	0.000	0.042	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.231	52.488	47.219	0.061	0.001	0.000	0.000	0.000	0.000	0.065	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.716	54.799	44.441	0.043	0.001	0.000	0.000	0.000	0.000	0.070	fbmy8032_rel_221222.cza1ps0_gcp_c2s30