Introduction

This is a report for the insert benchmark with 4000M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server is a c2-standard-30 from GCP with 15 cores, hyperthreads disabled, Ubuntu 22.04 and XFS using SW RAID 0 over 4 local SSDs. The benchmark was run with 8 clients and there were 1, 2 or 3 connections per client. It uses 8 tables with a client per table. It loads 20M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 50m+50m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1200s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached in memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
fbmy8028_rel_221222.cza1_gcp_c2s30 511117679117808493748811858497711846503782174913
fbmy8028_rel_221222.cza1ps0_gcp_c2s30 522944664231809513762912958493214116504495844887
fbmy8032_rel_221222.cza1_gcp_c2s30 489476667223797413651312085492812362503685274802
fbmy8032_rel_221222.cza1ps0_gcp_c2s30 500375678081794043668013213492214002508488704873

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
fbmy8028_rel_221222.cza1_gcp_c2s30 1.001.001.001.001.001.001.001.001.001.00
fbmy8028_rel_221222.cza1ps0_gcp_c2s30 1.020.981.001.001.090.991.191.001.170.99
fbmy8032_rel_221222.cza1_gcp_c2s30 0.960.980.990.971.020.991.041.001.040.98
fbmy8032_rel_221222.cza1ps0_gcp_c2s30 0.981.000.980.981.110.991.181.011.080.99

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
fbmy8028_rel_221222.cza1_gcp_c2s307967963980397879607960
fbmy8028_rel_221222.cza1ps0_gcp_c2s307967963980397879607960
fbmy8032_rel_221222.cza1_gcp_c2s307967963978397879657960
fbmy8032_rel_221222.cza1ps0_gcp_c2s307967963978397879607960
target8008004000400080008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s305.82294.0250.1250.0100.0160.0040.412
fbmy8028_rel_221222.cza1ps0_gcp_c2s308.25891.5840.1290.0100.0160.0030.452
fbmy8032_rel_221222.cza1_gcp_c2s303.01296.8400.1170.0100.0170.0030.410
fbmy8032_rel_221222.cza1ps0_gcp_c2s304.89994.9460.1270.0090.0160.0030.424

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
511117	0	0	0.0	517.7	120.4	0.000	0.000	0.001	0.241	65582	72.5	0.128	21	114.6	114.8	26.5	0.412	65253	42653	fbmy8028_rel_221222.cza1_gcp_c2s30
522944	0	0	0.0	533.1	119.9	0.000	0.000	0.001	0.235	67513	72.7	0.129	21	114.5	114.7	26.4	0.452	66127	42953	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
489476	0	0	0.0	500.1	112.8	0.000	0.000	0.001	0.236	62475	71.3	0.128	22	114.2	114.5	26.5	0.410	62432	41655	fbmy8032_rel_221222.cza1_gcp_c2s30
500375	0	0	0.0	508.1	115.5	0.000	0.000	0.001	0.236	64254	72.1	0.128	22	114.7	115.0	26.3	0.424	63230	42553	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
679117	0	836	146.4	273.6	80.7	0.001	0.221	0.000	0.122	2330	50.0	0.003	11	255.8	256.1	93.9	0.002	NA	NA	fbmy8028_rel_221222.cza1_gcp_c2s30
664231	0	738	131.3	266.7	77.5	0.001	0.202	0.000	0.119	2271	49.8	0.003	11	255.7	255.9	93.6	0.002	NA	NA	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
667223	0	788	140.0	266.0	77.6	0.001	0.215	0.000	0.119	2534	49.8	0.004	11	255.4	255.6	94.0	0.004	NA	NA	fbmy8032_rel_221222.cza1_gcp_c2s30
678081	0	780	137.8	273.9	80.5	0.001	0.208	0.000	0.122	2695	49.9	0.004	11	255.9	256.2	93.7	0.002	NA	NA	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.00229.94669.8740.1600.0130.0040.886
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.01329.45970.3690.1430.0120.0050.817
fbmy8032_rel_221222.cza1_gcp_c2s300.00627.86971.9340.1760.0120.0030.658
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.00627.22472.6110.1430.0130.003nonzero1.844

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.00626.82272.8590.2840.0240.0040.889
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.01826.97072.7200.2670.0200.0050.821
fbmy8032_rel_221222.cza1_gcp_c2s300.00925.41274.2620.2930.0210.0040.652
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.01024.73774.9720.2570.0210.003nonzero1.846

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
80849	0	493	13.9	715.7	148.4	0.006	0.176	0.009	1.880	49832	71.5	0.616	133	282.1	283.0	92.7	0.886	10139	6842	fbmy8028_rel_221222.cza1_gcp_c2s30
80951	0	495	13.4	708.0	152.7	0.006	0.169	0.009	1.932	50642	70.9	0.626	131	279.9	280.9	92.4	0.817	10239	6792	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
79741	0	460	13.0	713.8	145.8	0.006	0.167	0.009	1.872	49273	71.4	0.618	134	279.5	280.4	92.8	0.658	10039	6942	fbmy8032_rel_221222.cza1_gcp_c2s30
79404	0	461	13.5	706.3	147.1	0.006	0.174	0.009	1.896	48866	71.5	0.615	135	279.7	280.7	92.5	1.844	10039	6595	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.00370.09329.7380.1560.0080.001nonzero0.423
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.01170.42629.4020.1520.0070.001nonzero0.265
fbmy8032_rel_221222.cza1_gcp_c2s300.00165.57634.2590.1570.0070.0010.242
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.00466.55233.2740.1620.0070.0010.228

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3058.12441.6870.1760.0120.002nonzero0.423
fbmy8028_rel_221222.cza1ps0_gcp_c2s3058.73641.0780.1730.0110.002nonzero0.267
fbmy8032_rel_221222.cza1_gcp_c2s3052.96646.8480.1750.0110.001nonzero0.266
fbmy8032_rel_221222.cza1ps0_gcp_c2s3054.27245.5350.1800.0110.0010.227

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
37488	0	203	6.2	411.4	77.7	0.005	0.171	0.011	2.123	198775	70.6	5.302	282	280.0	280.3	81.6	0.423	4911	2842	fbmy8028_rel_221222.cza1_gcp_c2s30
37629	0	195	6.2	413.0	80.5	0.005	0.168	0.011	2.191	202558	70.1	5.383	279	280.5	280.8	81.1	0.265	4935	2847	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
36513	0	202	5.8	401.0	79.0	0.006	0.163	0.011	2.214	194760	70.7	5.334	290	279.8	280.1	81.6	0.242	4840	2753	fbmy8032_rel_221222.cza1_gcp_c2s30
36680	0	200	6.2	407.0	78.3	0.005	0.172	0.011	2.186	197381	70.3	5.381	287	280.2	280.5	81.6	0.228	4795	2832	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3066.16412.44619.8861.4980.007nonzero0.097
fbmy8028_rel_221222.cza1ps0_gcp_c2s3068.34114.28715.4631.8460.063nonzero0.116
fbmy8032_rel_221222.cza1_gcp_c2s3066.62716.09215.4891.7780.014nonzero0.117
fbmy8032_rel_221222.cza1ps0_gcp_c2s3068.00315.01815.2001.7710.008nonzero0.116

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.60899.3650.0280.013
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.04298.8020.1560.013
fbmy8032_rel_221222.cza1_gcp_c2s300.46999.3720.1460.0140.020
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.51499.4550.0310.005

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s303.49396.4550.0520.010
fbmy8028_rel_221222.cza1ps0_gcp_c2s303.96595.8960.1390.015
fbmy8032_rel_221222.cza1_gcp_c2s301.13298.6740.1810.0140.019
fbmy8032_rel_221222.cza1ps0_gcp_c2s302.29997.6530.0450.0030.025

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	11858	100	4.5	46.5	9.3	0.008	0.393	0.058	11.999	47348	55.7	3.993	705	271.4	271.9	81.0	0.097	991	463	fbmy8028_rel_221222.cza1_gcp_c2s30
796	12958	98	4.5	56.0	13.1	0.008	0.355	0.070	16.857	51982	56.1	4.012	649	271.5	272.0	81.3	0.116	1119	448	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
796	12085	91	4.3	52.5	10.8	0.008	0.367	0.066	13.841	48241	56.0	3.992	695	272.2	272.7	81.7	0.117	1486	384	fbmy8032_rel_221222.cza1_gcp_c2s30
796	13213	90	4.3	52.6	11.5	0.007	0.336	0.066	14.863	52892	55.6	4.003	631	271.4	271.9	81.2	0.116	1470	591	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s305.14194.7510.0990.0090.045
fbmy8028_rel_221222.cza1ps0_gcp_c2s304.82795.0700.0950.009nonzero0.077
fbmy8032_rel_221222.cza1_gcp_c2s304.76095.1340.0960.0100.054
fbmy8032_rel_221222.cza1ps0_gcp_c2s304.71795.1790.0950.0090.051

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.26074.47625.2640.013
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.17467.86531.9510.0100.027
fbmy8032_rel_221222.cza1_gcp_c2s300.02184.76715.2120.009
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.13986.18113.6700.0100.046

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.67074.49024.8370.0030.028
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.54567.62531.8090.0210.023
fbmy8032_rel_221222.cza1_gcp_c2s300.22684.66715.1080.010
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.69485.59013.6880.0280.047

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	4977	32363	240.1	33.4	5.5	6.503	49.402	0.042	7.135	82760	19.2	16.628	579	271.6	272.5	94.5	0.045	655	432	fbmy8028_rel_221222.cza1_gcp_c2s30
796	4932	32225	241.5	35.2	5.8	6.534	50.145	0.044	7.494	82462	18.9	16.720	575	271.7	272.5	94.8	0.077	655	432	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
796	4928	32013	236.4	29.6	4.8	6.496	49.111	0.037	6.149	82045	19.3	16.648	587	272.4	273.3	93.8	0.054	655	432	fbmy8032_rel_221222.cza1_gcp_c2s30
796	4922	32179	241.7	34.8	6.0	6.538	50.284	0.044	7.683	82492	19.2	16.762	585	271.6	272.4	96.4	0.051	639	432	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3058.71612.97128.2910.021nonzerononzero0.124
fbmy8028_rel_221222.cza1ps0_gcp_c2s3060.69122.27416.9370.098nonzerononzero0.124
fbmy8032_rel_221222.cza1_gcp_c2s3062.60312.79524.5790.023nonzerononzero0.124
fbmy8032_rel_221222.cza1ps0_gcp_c2s3063.91815.34120.6200.121nonzerononzero0.127

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.79289.13810.0470.0240.024
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.48781.46617.0090.0370.029
fbmy8032_rel_221222.cza1_gcp_c2s300.13783.17816.6370.0470.029
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.39780.35119.2310.0220.027

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s302.85887.4739.6500.0190.027
fbmy8028_rel_221222.cza1ps0_gcp_c2s303.33880.38616.2430.0330.0010.123
fbmy8032_rel_221222.cza1_gcp_c2s301.27382.82315.8720.0330.021
fbmy8032_rel_221222.cza1ps0_gcp_c2s301.88779.56118.5350.0170.035

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	11846	76	2.0	141.1	34.1	0.006	0.174	0.035	8.765	50228	59.4	4.240	752	273.4	273.8	86.5	0.124	1311	1103	fbmy8028_rel_221222.cza1_gcp_c2s30
3980	14116	80	2.2	137.9	33.0	0.006	0.159	0.035	8.486	59322	58.9	4.202	626	274.1	274.5	86.6	0.124	1470	1167	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3978	12362	76	2.3	116.6	26.5	0.006	0.187	0.029	6.818	51772	58.2	4.188	706	273.5	273.9	85.1	0.124	1438	1215	fbmy8032_rel_221222.cza1_gcp_c2s30
3978	14002	68	2.1	136.8	32.9	0.005	0.150	0.034	8.469	58541	59.1	4.181	633	272.7	273.1	84.7	0.127	1439	1199	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s304.98594.8030.2020.010nonzero0.091
fbmy8028_rel_221222.cza1ps0_gcp_c2s305.14394.6610.1860.011nonzero0.098
fbmy8032_rel_221222.cza1_gcp_c2s304.84094.9850.1670.0080.056
fbmy8032_rel_221222.cza1ps0_gcp_c2s305.34694.4810.1640.008nonzero0.089

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.03365.32634.6080.0330.046
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.14275.01024.8270.0200.047
fbmy8032_rel_221222.cza1_gcp_c2s300.03089.21510.7440.0100.049
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.01368.23631.7350.0150.034

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.22465.48434.2580.0340.045
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.64475.05224.2830.0180.0020.124
fbmy8032_rel_221222.cza1_gcp_c2s300.56989.23910.1760.0150.0010.087
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.12868.89230.9580.0220.056

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3978	5037	30908	228.3	170.0	28.1	6.137	46.423	0.043	7.227	84075	26.6	16.693	792	273.9	275.9	85.2	0.091	639	575	fbmy8028_rel_221222.cza1_gcp_c2s30
3978	5044	30901	227.9	164.9	26.9	6.126	46.265	0.041	6.925	84164	26.0	16.684	773	275.2	277.2	85.2	0.098	639	575	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3978	5036	30722	224.9	137.0	22.3	6.101	45.733	0.034	5.737	83239	25.7	16.530	766	275.8	277.8	85.7	0.056	639	575	fbmy8032_rel_221222.cza1_gcp_c2s30
3978	5084	30985	226.9	134.1	21.9	6.094	45.698	0.034	5.627	84317	25.6	16.584	755	274.3	276.3	85.4	0.089	640	575	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s3048.93519.56431.3400.1600.001nonzero0.130
fbmy8028_rel_221222.cza1ps0_gcp_c2s3052.15918.28229.2130.3440.001nonzero0.131
fbmy8032_rel_221222.cza1_gcp_c2s3056.04312.76230.9510.2420.001nonzero0.129
fbmy8032_rel_221222.cza1ps0_gcp_c2s3059.1538.42932.2950.1240.001nonzero0.128

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.13062.96036.8320.0780.034
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.50374.56024.8760.0610.032
fbmy8032_rel_221222.cza1_gcp_c2s300.00763.60836.3000.0840.039
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.02362.62437.2800.0700.0020.076

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.69263.53235.6990.0770.036
fbmy8028_rel_221222.cza1ps0_gcp_c2s301.96074.06423.9180.0590.037
fbmy8032_rel_221222.cza1_gcp_c2s300.19464.75734.9620.086nonzero0.119
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.34863.28336.2960.0700.0020.089

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	8217	87	3.8	164.5	34.7	0.011	0.471	0.021	4.467	37266	61.4	4.535	1121	276.2	277.4	84.6	0.130	1119	879	fbmy8028_rel_221222.cza1_gcp_c2s30
7960	9584	92	3.8	158.9	34.5	0.010	0.403	0.020	4.442	42866	61.4	4.473	961	276.5	277.7	84.8	0.131	1135	927	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7965	8527	84	3.6	160.8	33.7	0.010	0.431	0.020	4.328	38192	61.5	4.479	1082	276.6	277.8	84.8	0.129	959	783	fbmy8032_rel_221222.cza1_gcp_c2s30
7960	8870	82	3.1	164.2	33.7	0.009	0.361	0.021	4.336	39823	61.3	4.490	1037	275.8	276.9	84.7	0.128	975	799	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s304.21595.5500.2230.012nonzero0.085
fbmy8028_rel_221222.cza1ps0_gcp_c2s304.19295.5340.2610.013nonzero0.113
fbmy8032_rel_221222.cza1_gcp_c2s303.50496.2240.2610.011nonzero0.108
fbmy8032_rel_221222.cza1ps0_gcp_c2s304.11995.6000.2680.013nonzero0.115

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.05567.26532.6410.0390.052
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.02446.80453.1230.0490.049
fbmy8032_rel_221222.cza1_gcp_c2s3049.54350.4080.0500.054
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.00143.94755.9970.0560.044

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy8028_rel_221222.cza1_gcp_c2s300.47867.28632.1850.050nonzero0.067
fbmy8028_rel_221222.cza1ps0_gcp_c2s300.17447.00352.7620.060nonzero0.076
fbmy8032_rel_221222.cza1_gcp_c2s300.01750.20449.7180.0600.0010.094
fbmy8032_rel_221222.cza1ps0_gcp_c2s300.04544.61555.2740.065nonzero0.074

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	4913	30614	227.5	144.4	22.9	6.231	47.412	0.018	2.941	85272	29.0	17.357	885	277.5	277.9	85.9	0.085	639	543	fbmy8028_rel_221222.cza1_gcp_c2s30
7960	4887	30436	225.8	158.4	24.1	6.228	47.325	0.020	3.106	85628	28.9	17.522	887	277.1	277.5	85.6	0.113	623	543	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7960	4802	30008	225.2	141.5	21.0	6.249	48.014	0.018	2.707	84178	30.0	17.530	937	277.3	277.7	86.5	0.108	623	527	fbmy8032_rel_221222.cza1_gcp_c2s30
7960	4873	30331	225.4	144.4	21.3	6.224	47.369	0.018	2.744	85077	29.7	17.458	914	277.0	277.4	85.6	0.115	623	527	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
511117	0	0	0.0	517.7	120.4	0.000	0.000	0.001	0.241	65582	72.5	0.128	21	114.6	114.8	26.5	0.412	65253	42653	fbmy8028_rel_221222.cza1_gcp_c2s30
522944	0	0	0.0	533.1	119.9	0.000	0.000	0.001	0.235	67513	72.7	0.129	21	114.5	114.7	26.4	0.452	66127	42953	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
489476	0	0	0.0	500.1	112.8	0.000	0.000	0.001	0.236	62475	71.3	0.128	22	114.2	114.5	26.5	0.410	62432	41655	fbmy8032_rel_221222.cza1_gcp_c2s30
500375	0	0	0.0	508.1	115.5	0.000	0.000	0.001	0.236	64254	72.1	0.128	22	114.7	115.0	26.3	0.424	63230	42553	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
679117	0	836	146.4	273.6	80.7	0.001	0.221	0.000	0.122	2330	50.0	0.003	11	255.8	256.1	93.9	0.002	NA	NA	fbmy8028_rel_221222.cza1_gcp_c2s30
664231	0	738	131.3	266.7	77.5	0.001	0.202	0.000	0.119	2271	49.8	0.003	11	255.7	255.9	93.6	0.002	NA	NA	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
667223	0	788	140.0	266.0	77.6	0.001	0.215	0.000	0.119	2534	49.8	0.004	11	255.4	255.6	94.0	0.004	NA	NA	fbmy8032_rel_221222.cza1_gcp_c2s30
678081	0	780	137.8	273.9	80.5	0.001	0.208	0.000	0.122	2695	49.9	0.004	11	255.9	256.2	93.7	0.002	NA	NA	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
80849	0	493	13.9	715.7	148.4	0.006	0.176	0.009	1.880	49832	71.5	0.616	133	282.1	283.0	92.7	0.886	10139	6842	fbmy8028_rel_221222.cza1_gcp_c2s30
80951	0	495	13.4	708.0	152.7	0.006	0.169	0.009	1.932	50642	70.9	0.626	131	279.9	280.9	92.4	0.817	10239	6792	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
79741	0	460	13.0	713.8	145.8	0.006	0.167	0.009	1.872	49273	71.4	0.618	134	279.5	280.4	92.8	0.658	10039	6942	fbmy8032_rel_221222.cza1_gcp_c2s30
79404	0	461	13.5	706.3	147.1	0.006	0.174	0.009	1.896	48866	71.5	0.615	135	279.7	280.7	92.5	1.844	10039	6595	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
37488	0	203	6.2	411.4	77.7	0.005	0.171	0.011	2.123	198775	70.6	5.302	282	280.0	280.3	81.6	0.423	4911	2842	fbmy8028_rel_221222.cza1_gcp_c2s30
37629	0	195	6.2	413.0	80.5	0.005	0.168	0.011	2.191	202558	70.1	5.383	279	280.5	280.8	81.1	0.265	4935	2847	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
36513	0	202	5.8	401.0	79.0	0.006	0.163	0.011	2.214	194760	70.7	5.334	290	279.8	280.1	81.6	0.242	4840	2753	fbmy8032_rel_221222.cza1_gcp_c2s30
36680	0	200	6.2	407.0	78.3	0.005	0.172	0.011	2.186	197381	70.3	5.381	287	280.2	280.5	81.6	0.228	4795	2832	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	11858	100	4.5	46.5	9.3	0.008	0.393	0.058	11.999	47348	55.7	3.993	705	271.4	271.9	81.0	0.097	991	463	fbmy8028_rel_221222.cza1_gcp_c2s30
796	12958	98	4.5	56.0	13.1	0.008	0.355	0.070	16.857	51982	56.1	4.012	649	271.5	272.0	81.3	0.116	1119	448	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
796	12085	91	4.3	52.5	10.8	0.008	0.367	0.066	13.841	48241	56.0	3.992	695	272.2	272.7	81.7	0.117	1486	384	fbmy8032_rel_221222.cza1_gcp_c2s30
796	13213	90	4.3	52.6	11.5	0.007	0.336	0.066	14.863	52892	55.6	4.003	631	271.4	271.9	81.2	0.116	1470	591	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
796	4977	32363	240.1	33.4	5.5	6.503	49.402	0.042	7.135	82760	19.2	16.628	579	271.6	272.5	94.5	0.045	655	432	fbmy8028_rel_221222.cza1_gcp_c2s30
796	4932	32225	241.5	35.2	5.8	6.534	50.145	0.044	7.494	82462	18.9	16.720	575	271.7	272.5	94.8	0.077	655	432	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
796	4928	32013	236.4	29.6	4.8	6.496	49.111	0.037	6.149	82045	19.3	16.648	587	272.4	273.3	93.8	0.054	655	432	fbmy8032_rel_221222.cza1_gcp_c2s30
796	4922	32179	241.7	34.8	6.0	6.538	50.284	0.044	7.683	82492	19.2	16.762	585	271.6	272.4	96.4	0.051	639	432	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3980	11846	76	2.0	141.1	34.1	0.006	0.174	0.035	8.765	50228	59.4	4.240	752	273.4	273.8	86.5	0.124	1311	1103	fbmy8028_rel_221222.cza1_gcp_c2s30
3980	14116	80	2.2	137.9	33.0	0.006	0.159	0.035	8.486	59322	58.9	4.202	626	274.1	274.5	86.6	0.124	1470	1167	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3978	12362	76	2.3	116.6	26.5	0.006	0.187	0.029	6.818	51772	58.2	4.188	706	273.5	273.9	85.1	0.124	1438	1215	fbmy8032_rel_221222.cza1_gcp_c2s30
3978	14002	68	2.1	136.8	32.9	0.005	0.150	0.034	8.469	58541	59.1	4.181	633	272.7	273.1	84.7	0.127	1439	1199	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3978	5037	30908	228.3	170.0	28.1	6.137	46.423	0.043	7.227	84075	26.6	16.693	792	273.9	275.9	85.2	0.091	639	575	fbmy8028_rel_221222.cza1_gcp_c2s30
3978	5044	30901	227.9	164.9	26.9	6.126	46.265	0.041	6.925	84164	26.0	16.684	773	275.2	277.2	85.2	0.098	639	575	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
3978	5036	30722	224.9	137.0	22.3	6.101	45.733	0.034	5.737	83239	25.7	16.530	766	275.8	277.8	85.7	0.056	639	575	fbmy8032_rel_221222.cza1_gcp_c2s30
3978	5084	30985	226.9	134.1	21.9	6.094	45.698	0.034	5.627	84317	25.6	16.584	755	274.3	276.3	85.4	0.089	640	575	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	8217	87	3.8	164.5	34.7	0.011	0.471	0.021	4.467	37266	61.4	4.535	1121	276.2	277.4	84.6	0.130	1119	879	fbmy8028_rel_221222.cza1_gcp_c2s30
7960	9584	92	3.8	158.9	34.5	0.010	0.403	0.020	4.442	42866	61.4	4.473	961	276.5	277.7	84.8	0.131	1135	927	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7965	8527	84	3.6	160.8	33.7	0.010	0.431	0.020	4.328	38192	61.5	4.479	1082	276.6	277.8	84.8	0.129	959	783	fbmy8032_rel_221222.cza1_gcp_c2s30
7960	8870	82	3.1	164.2	33.7	0.009	0.361	0.021	4.336	39823	61.3	4.490	1037	275.8	276.9	84.7	0.128	975	799	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7960	4913	30614	227.5	144.4	22.9	6.231	47.412	0.018	2.941	85272	29.0	17.357	885	277.5	277.9	85.9	0.085	639	543	fbmy8028_rel_221222.cza1_gcp_c2s30
7960	4887	30436	225.8	158.4	24.1	6.228	47.325	0.020	3.106	85628	28.9	17.522	887	277.1	277.5	85.6	0.113	623	543	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
7960	4802	30008	225.2	141.5	21.0	6.249	48.014	0.018	2.707	84178	30.0	17.530	937	277.3	277.7	86.5	0.108	623	527	fbmy8032_rel_221222.cza1_gcp_c2s30
7960	4873	30331	225.4	144.4	21.3	6.224	47.369	0.018	2.744	85077	29.7	17.458	914	277.0	277.4	85.6	0.115	623	527	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	5.822	94.025	0.125	0.010	0.016	0.004	0.000	0.000	0.000	0.412	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	8.258	91.584	0.129	0.010	0.016	0.003	0.000	0.000	0.000	0.452	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	3.012	96.840	0.117	0.010	0.017	0.003	0.000	0.000	0.000	0.410	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	4.899	94.946	0.127	0.009	0.016	0.003	0.000	0.000	0.000	0.424	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.002	29.946	69.874	0.160	0.013	0.004	0.000	0.000	0.000	0.886	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.013	29.459	70.369	0.143	0.012	0.005	0.000	0.000	0.000	0.817	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.006	27.869	71.934	0.176	0.012	0.003	0.000	0.000	0.000	0.658	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.006	27.224	72.611	0.143	0.013	0.003	nonzero	0.000	0.000	1.844	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.006	26.822	72.859	0.284	0.024	0.004	0.000	0.000	0.000	0.889	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.018	26.970	72.720	0.267	0.020	0.005	0.000	0.000	0.000	0.821	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.009	25.412	74.262	0.293	0.021	0.004	0.000	0.000	0.000	0.652	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.010	24.737	74.972	0.257	0.021	0.003	nonzero	0.000	0.000	1.846	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.003	70.093	29.738	0.156	0.008	0.001	nonzero	0.000	0.000	0.000	0.423	fbmy8028_rel_221222.cza1_gcp_c2s30
0.011	70.426	29.402	0.152	0.007	0.001	nonzero	0.000	0.000	0.000	0.265	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.001	65.576	34.259	0.157	0.007	0.001	0.000	0.000	0.000	0.000	0.242	fbmy8032_rel_221222.cza1_gcp_c2s30
0.004	66.552	33.274	0.162	0.007	0.001	0.000	0.000	0.000	0.000	0.228	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	58.124	41.687	0.176	0.012	0.002	nonzero	0.000	0.000	0.000	0.423	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	58.736	41.078	0.173	0.011	0.002	nonzero	0.000	0.000	0.000	0.267	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	52.966	46.848	0.175	0.011	0.001	nonzero	0.000	0.000	0.000	0.266	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	54.272	45.535	0.180	0.011	0.001	0.000	0.000	0.000	0.000	0.227	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
66.164	12.446	19.886	1.498	0.007	nonzero	0.000	0.000	0.000	0.000	0.097	fbmy8028_rel_221222.cza1_gcp_c2s30
68.341	14.287	15.463	1.846	0.063	nonzero	0.000	0.000	0.000	0.000	0.116	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
66.627	16.092	15.489	1.778	0.014	nonzero	0.000	0.000	0.000	0.000	0.117	fbmy8032_rel_221222.cza1_gcp_c2s30
68.003	15.018	15.200	1.771	0.008	nonzero	0.000	0.000	0.000	0.000	0.116	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.608	99.365	0.028	0.000	0.000	0.000	0.000	0.000	0.000	0.013	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.042	98.802	0.156	0.000	0.000	0.000	0.000	0.000	0.000	0.013	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.469	99.372	0.146	0.014	0.000	0.000	0.000	0.000	0.000	0.020	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.514	99.455	0.031	0.000	0.000	0.000	0.000	0.000	0.000	0.005	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	3.493	96.455	0.052	0.000	0.000	0.000	0.000	0.000	0.000	0.010	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	3.965	95.896	0.139	0.000	0.000	0.000	0.000	0.000	0.000	0.015	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	1.132	98.674	0.181	0.014	0.000	0.000	0.000	0.000	0.000	0.019	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	2.299	97.653	0.045	0.003	0.000	0.000	0.000	0.000	0.000	0.025	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	5.141	94.751	0.099	0.009	0.000	0.000	0.000	0.000	0.000	0.045	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	4.827	95.070	0.095	0.009	nonzero	0.000	0.000	0.000	0.000	0.077	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	4.760	95.134	0.096	0.010	0.000	0.000	0.000	0.000	0.000	0.054	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	4.717	95.179	0.095	0.009	0.000	0.000	0.000	0.000	0.000	0.051	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.260	74.476	25.264	0.000	0.000	0.000	0.000	0.000	0.000	0.013	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.174	67.865	31.951	0.010	0.000	0.000	0.000	0.000	0.000	0.027	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.021	84.767	15.212	0.000	0.000	0.000	0.000	0.000	0.000	0.009	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.139	86.181	13.670	0.010	0.000	0.000	0.000	0.000	0.000	0.046	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.670	74.490	24.837	0.003	0.000	0.000	0.000	0.000	0.000	0.028	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.545	67.625	31.809	0.021	0.000	0.000	0.000	0.000	0.000	0.023	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.226	84.667	15.108	0.000	0.000	0.000	0.000	0.000	0.000	0.010	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.694	85.590	13.688	0.028	0.000	0.000	0.000	0.000	0.000	0.047	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
58.716	12.971	28.291	0.021	nonzero	nonzero	0.000	0.000	0.000	0.000	0.124	fbmy8028_rel_221222.cza1_gcp_c2s30
60.691	22.274	16.937	0.098	nonzero	nonzero	0.000	0.000	0.000	0.000	0.124	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
62.603	12.795	24.579	0.023	nonzero	nonzero	0.000	0.000	0.000	0.000	0.124	fbmy8032_rel_221222.cza1_gcp_c2s30
63.918	15.341	20.620	0.121	nonzero	nonzero	0.000	0.000	0.000	0.000	0.127	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.792	89.138	10.047	0.024	0.000	0.000	0.000	0.000	0.000	0.024	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.487	81.466	17.009	0.037	0.000	0.000	0.000	0.000	0.000	0.029	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.137	83.178	16.637	0.047	0.000	0.000	0.000	0.000	0.000	0.029	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.397	80.351	19.231	0.022	0.000	0.000	0.000	0.000	0.000	0.027	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	2.858	87.473	9.650	0.019	0.000	0.000	0.000	0.000	0.000	0.027	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	3.338	80.386	16.243	0.033	0.001	0.000	0.000	0.000	0.000	0.123	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	1.273	82.823	15.872	0.033	0.000	0.000	0.000	0.000	0.000	0.021	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	1.887	79.561	18.535	0.017	0.000	0.000	0.000	0.000	0.000	0.035	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.985	94.803	0.202	0.010	nonzero	0.000	0.000	0.000	0.000	0.091	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	5.143	94.661	0.186	0.011	nonzero	0.000	0.000	0.000	0.000	0.098	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	4.840	94.985	0.167	0.008	0.000	0.000	0.000	0.000	0.000	0.056	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	5.346	94.481	0.164	0.008	nonzero	0.000	0.000	0.000	0.000	0.089	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.033	65.326	34.608	0.033	0.000	0.000	0.000	0.000	0.000	0.046	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.142	75.010	24.827	0.020	0.000	0.000	0.000	0.000	0.000	0.047	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.030	89.215	10.744	0.010	0.000	0.000	0.000	0.000	0.000	0.049	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.013	68.236	31.735	0.015	0.000	0.000	0.000	0.000	0.000	0.034	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.224	65.484	34.258	0.034	0.000	0.000	0.000	0.000	0.000	0.045	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.644	75.052	24.283	0.018	0.002	0.000	0.000	0.000	0.000	0.124	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.569	89.239	10.176	0.015	0.001	0.000	0.000	0.000	0.000	0.087	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.128	68.892	30.958	0.022	0.000	0.000	0.000	0.000	0.000	0.056	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
48.935	19.564	31.340	0.160	0.001	nonzero	0.000	0.000	0.000	0.000	0.130	fbmy8028_rel_221222.cza1_gcp_c2s30
52.159	18.282	29.213	0.344	0.001	nonzero	0.000	0.000	0.000	0.000	0.131	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
56.043	12.762	30.951	0.242	0.001	nonzero	0.000	0.000	0.000	0.000	0.129	fbmy8032_rel_221222.cza1_gcp_c2s30
59.153	8.429	32.295	0.124	0.001	nonzero	0.000	0.000	0.000	0.000	0.128	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.130	62.960	36.832	0.078	0.000	0.000	0.000	0.000	0.000	0.034	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.503	74.560	24.876	0.061	0.000	0.000	0.000	0.000	0.000	0.032	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.007	63.608	36.300	0.084	0.000	0.000	0.000	0.000	0.000	0.039	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.023	62.624	37.280	0.070	0.002	0.000	0.000	0.000	0.000	0.076	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.692	63.532	35.699	0.077	0.000	0.000	0.000	0.000	0.000	0.036	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	1.960	74.064	23.918	0.059	0.000	0.000	0.000	0.000	0.000	0.037	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.194	64.757	34.962	0.086	nonzero	0.000	0.000	0.000	0.000	0.119	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.348	63.283	36.296	0.070	0.002	0.000	0.000	0.000	0.000	0.089	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.215	95.550	0.223	0.012	nonzero	0.000	0.000	0.000	0.000	0.085	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	4.192	95.534	0.261	0.013	nonzero	0.000	0.000	0.000	0.000	0.113	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	3.504	96.224	0.261	0.011	nonzero	0.000	0.000	0.000	0.000	0.108	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	4.119	95.600	0.268	0.013	nonzero	0.000	0.000	0.000	0.000	0.115	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.055	67.265	32.641	0.039	0.000	0.000	0.000	0.000	0.000	0.052	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.024	46.804	53.123	0.049	0.000	0.000	0.000	0.000	0.000	0.049	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.000	49.543	50.408	0.050	0.000	0.000	0.000	0.000	0.000	0.054	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.001	43.947	55.997	0.056	0.000	0.000	0.000	0.000	0.000	0.044	fbmy8032_rel_221222.cza1ps0_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.478	67.286	32.185	0.050	nonzero	0.000	0.000	0.000	0.000	0.067	fbmy8028_rel_221222.cza1_gcp_c2s30
0.000	0.174	47.003	52.762	0.060	nonzero	0.000	0.000	0.000	0.000	0.076	fbmy8028_rel_221222.cza1ps0_gcp_c2s30
0.000	0.017	50.204	49.718	0.060	0.001	0.000	0.000	0.000	0.000	0.094	fbmy8032_rel_221222.cza1_gcp_c2s30
0.000	0.045	44.615	55.274	0.065	nonzero	0.000	0.000	0.000	0.000	0.074	fbmy8032_rel_221222.cza1ps0_gcp_c2s30