Introduction

This is a report for the insert benchmark with 160M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server is a c2-standard-30 from GCP with 15 cores, hyperthreads disabled, 120G RAM, XFS + SW RAID 0 on 4 NVMe devices (1.5TB). The benchmark was run with 8 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). There are 8 tables, client per table. It loads 20M rows per table without secondary indexes, creates secondary indexes, then inserts 200M rows with a delete per insert to avoid growing the table. It then does 3 read+write tests for 3600s each that do queries as fast as possible with 100, 500 and then 1000 inserts/second/client concurrent with the queries and 1000 deletes/second to avoid growing the table. The database is cached by MyRocks and the only IO is for writes.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0 and l.i1, indexed docs (or rows) /s for l.x and queries/s for q*.2. The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1q100.1q500.1q1000.1
fbmy5635_rel_202104072149.cy9c5_gcp_c2s30 61776172772789797373803637435236
fbmy5635_rel_202203072101.cy9c5_gcp_c2s30 60836573778888334371413616034858
fbmy5635_rel_202205192101.cy9c5_gcp_c2s30 60836573778887303364053558734424
fbmy5635_rel_202208092101.cy9c5_gcp_c2s30 59925174120487117368163573834686
fbmy5635_rel_202210112144.cy9c5_gcp_c2s30 60606174813187734364813543634240
fbmy5635_rel_202302162102.cy9c5_gcp_c2s30 64516171473286221361643474133346
fbmy5635_rel_202304122154.cy9c5_gcp_c2s30 64257072117186575364183504933421
fbmy5635_rel_202305292102.cy9c5_gcp_c2s30 63492171473286290362913522133780
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30 64516171155686370382873729235811

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1q100.1q500.1q1000.1
fbmy5635_rel_202104072149.cy9c5_gcp_c2s30 1.001.001.001.001.001.00
fbmy5635_rel_202203072101.cy9c5_gcp_c2s30 0.981.010.980.990.990.99
fbmy5635_rel_202205192101.cy9c5_gcp_c2s30 0.981.010.970.970.980.98
fbmy5635_rel_202208092101.cy9c5_gcp_c2s30 0.971.020.970.980.980.98
fbmy5635_rel_202210112144.cy9c5_gcp_c2s30 0.981.030.980.980.970.97
fbmy5635_rel_202302162102.cy9c5_gcp_c2s30 1.040.980.960.970.960.95
fbmy5635_rel_202304122154.cy9c5_gcp_c2s30 1.040.990.960.970.960.95
fbmy5635_rel_202305292102.cy9c5_gcp_c2s30 1.030.980.960.970.970.96
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30 1.040.980.961.021.031.02

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsq100.1q500.1q1000.1
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3079739877973
fbmy5635_rel_202203072101.cy9c5_gcp_c2s3079739887973
fbmy5635_rel_202205192101.cy9c5_gcp_c2s3079739877973
fbmy5635_rel_202208092101.cy9c5_gcp_c2s3079739877973
fbmy5635_rel_202210112144.cy9c5_gcp_c2s3079839877973
fbmy5635_rel_202302162102.cy9c5_gcp_c2s3079739877976
fbmy5635_rel_202304122154.cy9c5_gcp_c2s3079639847971
fbmy5635_rel_202305292102.cy9c5_gcp_c2s3079639877976
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3079739887973
target80040008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3027.49972.4720.0130.0020.0130.0010.305
fbmy5635_rel_202203072101.cy9c5_gcp_c2s3021.04178.9260.0170.0010.0130.0010.307
fbmy5635_rel_202205192101.cy9c5_gcp_c2s3020.32679.6450.0150.0010.0140.250
fbmy5635_rel_202208092101.cy9c5_gcp_c2s3017.50782.4610.0150.0030.0120.0020.354
fbmy5635_rel_202210112144.cy9c5_gcp_c2s3018.83681.1340.0140.0020.0120.0020.367
fbmy5635_rel_202302162102.cy9c5_gcp_c2s3040.17059.7990.0150.0020.0140.248
fbmy5635_rel_202304122154.cy9c5_gcp_c2s3040.40559.5660.0140.0020.0140.251
fbmy5635_rel_202305292102.cy9c5_gcp_c2s3033.09466.8790.0120.0010.0130.0010.290
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3041.08458.8910.0100.0010.014nonzero0.326

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
617761	0	0	0.0	628.9	185.1	0.000	0.000	0.001	0.307	76723	73.4	0.124	18	5.2	6.9	NA	0.305	82110	61331	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
608365	0	0	0.0	636.1	182.0	0.000	0.000	0.001	0.306	74130	73.4	0.122	18	5.2	6.7	NA	0.307	81450	56039	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
608365	0	0	0.0	637.4	182.9	0.000	0.000	0.001	0.308	72413	73.6	0.119	18	5.4	6.9	NA	0.250	81809	57537	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
599251	0	0	0.0	629.1	178.3	0.000	0.000	0.001	0.305	71771	73.2	0.120	18	5.4	6.9	NA	0.354	80611	53362	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
606061	0	0	0.0	643.4	180.2	0.000	0.000	0.001	0.304	72261	73.7	0.119	18	5.4	6.9	NA	0.367	81211	54341	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
645161	0	0	0.0	547.5	147.6	0.000	0.000	0.001	0.234	74260	72.8	0.115	17	5.0	6.5	NA	0.248	87106	66228	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
642570	0	0	0.0	562.5	150.6	0.000	0.000	0.001	0.240	74268	73.1	0.116	17	5.1	6.6	NA	0.251	88104	62232	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
634921	0	0	0.0	542.3	144.7	0.000	0.000	0.001	0.233	72536	73.0	0.114	17	5.1	6.6	NA	0.290	86406	59734	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
645161	0	0	0.0	548.4	146.0	0.000	0.000	0.001	0.232	73870	72.9	0.114	17	5.0	6.5	NA	0.326	89103	61452	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
727727	0	1	0.1	279.7	98.1	0.000	0.000	0.000	0.138	1020	49.0	0.001	10	10.9	12.5	NA	0.002	NA	NA	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
737788	0	1	0.1	291.3	101.4	0.000	0.000	0.000	0.141	1105	49.0	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
737788	0	1	0.1	295.0	102.7	0.000	0.000	0.000	0.142	995	49.3	0.001	10	10.9	12.4	NA	0.002	NA	NA	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
741204	0	1	0.1	298.7	103.3	0.000	0.000	0.000	0.143	1007	49.2	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
748131	0	1	0.1	301.0	104.9	0.000	0.000	0.000	0.144	1134	49.6	0.002	10	10.9	12.4	NA	0.002	NA	NA	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
714732	0	1	0.1	267.6	95.5	0.000	0.000	0.000	0.137	1093	49.0	0.002	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
721171	0	1	0.1	270.5	96.4	0.000	0.000	0.000	0.137	1054	48.6	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
714732	0	1	0.1	268.4	97.1	0.000	0.000	0.000	0.139	1032	49.1	0.001	10	10.9	12.4	NA	0.002	NA	NA	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
711556	0	1	0.1	266.4	93.8	0.000	0.000	0.000	0.135	1014	48.5	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s300.03635.86264.0110.0750.0130.0010.403
fbmy5635_rel_202203072101.cy9c5_gcp_c2s300.01930.72769.1630.0760.0140.0010.465
fbmy5635_rel_202205192101.cy9c5_gcp_c2s300.01029.11770.7820.0770.0130.0010.357
fbmy5635_rel_202208092101.cy9c5_gcp_c2s300.01128.51171.3890.0750.0140.0010.440
fbmy5635_rel_202210112144.cy9c5_gcp_c2s300.00829.68070.2230.0750.0130.0010.403
fbmy5635_rel_202302162102.cy9c5_gcp_c2s300.02330.06269.8120.0900.0120.0010.423
fbmy5635_rel_202304122154.cy9c5_gcp_c2s300.03129.63870.2250.0920.0140.0010.352
fbmy5635_rel_202305292102.cy9c5_gcp_c2s300.02229.64270.2290.0950.0110.0010.386
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s300.01030.89568.9900.0910.0130.0010.382

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s300.03533.02266.8470.0800.0140.0010.403
fbmy5635_rel_202203072101.cy9c5_gcp_c2s300.01931.72568.1630.0780.0140.0010.463
fbmy5635_rel_202205192101.cy9c5_gcp_c2s300.00929.91969.9770.0790.0130.0010.359
fbmy5635_rel_202208092101.cy9c5_gcp_c2s300.01129.83470.0640.0770.0130.0010.440
fbmy5635_rel_202210112144.cy9c5_gcp_c2s300.00730.83869.0630.0770.0130.0010.402
fbmy5635_rel_202302162102.cy9c5_gcp_c2s300.01928.79071.0840.0940.0130.0010.425
fbmy5635_rel_202304122154.cy9c5_gcp_c2s300.03029.58570.2760.0940.0140.0010.353
fbmy5635_rel_202305292102.cy9c5_gcp_c2s300.02229.85870.0110.0960.0110.0010.387
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s300.00828.82871.0540.0960.0130.0010.381

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
89797	0	1	0.3	612.8	128.6	0.000	0.004	0.007	1.467	65814	54.8	0.733	92	13.0	13.1	NA	0.403	11392	8391	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
88334	0	1	0.3	603.0	128.5	0.000	0.004	0.007	1.490	65178	54.6	0.738	93	14.7	14.8	NA	0.465	11238	8341	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
87303	0	1	0.3	596.6	126.6	0.000	0.004	0.007	1.485	64492	54.6	0.739	94	14.6	14.7	NA	0.357	11088	8141	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
87117	0	1	0.3	596.5	125.1	0.000	0.004	0.007	1.471	64355	54.7	0.739	94	13.3	13.4	NA	0.440	11087	8145	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
87734	0	1	0.3	603.5	123.9	0.000	0.004	0.007	1.446	64461	54.8	0.735	94	15.1	15.2	NA	0.403	11138	8191	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
86221	0	3	0.3	545.5	128.1	0.000	0.004	0.006	1.521	58691	57.3	0.681	100	13.7	13.9	NA	0.423	10991	7991	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
86575	0	3	0.4	552.4	126.7	0.000	0.004	0.006	1.499	58678	57.5	0.678	100	13.6	13.8	NA	0.352	11038	7991	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
86290	0	1	0.3	543.1	125.4	0.000	0.004	0.006	1.488	57989	58.5	0.672	102	15.8	16.0	NA	0.386	10988	7991	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
86370	0	2	0.3	545.7	124.1	0.000	0.004	0.006	1.472	58525	57.9	0.678	101	13.6	13.7	NA	0.382	10988	8041	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q100.1

q100.1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3098.1821.8170.001nonzerononzero0.029
fbmy5635_rel_202203072101.cy9c5_gcp_c2s3098.1171.8820.001nonzerononzero0.026
fbmy5635_rel_202205192101.cy9c5_gcp_c2s3097.2842.7150.001nonzerononzero0.026
fbmy5635_rel_202208092101.cy9c5_gcp_c2s3097.6262.3730.001nonzerononzero0.025
fbmy5635_rel_202210112144.cy9c5_gcp_c2s3097.2962.7030.001nonzero0.005
fbmy5635_rel_202302162102.cy9c5_gcp_c2s3096.5393.4600.001nonzerononzero0.029
fbmy5635_rel_202304122154.cy9c5_gcp_c2s3097.2002.7990.001nonzero0.011
fbmy5635_rel_202305292102.cy9c5_gcp_c2s3096.6583.3410.001nonzerononzero0.022
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3097.8772.1210.001nonzerononzerononzerononzero0.424

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s303.84496.1160.0360.0030.026
fbmy5635_rel_202203072101.cy9c5_gcp_c2s301.46598.5190.0120.0030.021
fbmy5635_rel_202205192101.cy9c5_gcp_c2s300.86199.1090.0280.0020.017
fbmy5635_rel_202208092101.cy9c5_gcp_c2s300.46999.4760.0490.0070.020
fbmy5635_rel_202210112144.cy9c5_gcp_c2s300.25999.7050.0330.0030.023
fbmy5635_rel_202302162102.cy9c5_gcp_c2s3010.69389.2880.0160.0030.050
fbmy5635_rel_202304122154.cy9c5_gcp_c2s304.15195.7950.0430.0100.034
fbmy5635_rel_202305292102.cy9c5_gcp_c2s301.81998.1180.0560.0070.034
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s309.91389.9830.0820.0230.035

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s301.71798.2240.0570.0020.027
fbmy5635_rel_202203072101.cy9c5_gcp_c2s302.37097.5680.0540.0090.021
fbmy5635_rel_202205192101.cy9c5_gcp_c2s301.33998.6300.0300.0020.017
fbmy5635_rel_202208092101.cy9c5_gcp_c2s300.61399.3330.0470.0070.022
fbmy5635_rel_202210112144.cy9c5_gcp_c2s300.68299.2470.0660.0050.022
fbmy5635_rel_202302162102.cy9c5_gcp_c2s303.25796.6940.0450.0030.049
fbmy5635_rel_202304122154.cy9c5_gcp_c2s303.96995.9320.0900.0090.030
fbmy5635_rel_202305292102.cy9c5_gcp_c2s303.40896.4980.0890.0050.034
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s307.07592.7800.1230.0230.037

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
797	37380	0	0.0	13.1	1.3	0.000	0.000	0.016	1.722	146825	53.3	3.928	214	12.3	12.9	NA	0.029	4715	4219	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
797	37141	0	0.0	13.3	1.3	0.000	0.000	0.017	1.643	145570	53.4	3.919	216	12.0	12.7	NA	0.026	4619	4237	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
797	36405	0	0.0	14.2	1.4	0.000	0.000	0.018	1.844	142926	53.4	3.926	220	12.1	12.8	NA	0.026	4520	4125	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
797	36816	0	0.0	15.8	1.4	0.000	0.000	0.020	1.787	144366	53.4	3.921	218	12.3	13.0	NA	0.025	4603	4045	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
798	36481	0	0.0	15.9	1.5	0.000	0.000	0.020	1.864	143052	53.4	3.921	220	12.3	13.0	NA	0.005	4555	4123	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
797	36164	1	0.2	11.4	1.1	0.000	0.006	0.014	1.406	140911	53.3	3.896	221	13.1	13.9	NA	0.029	4509	3932	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
796	36418	2	0.3	11.6	1.1	0.000	0.008	0.015	1.422	141683	53.2	3.890	219	13.0	13.8	NA	0.011	4603	4123	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
796	36291	2	0.2	12.3	1.2	0.000	0.007	0.015	1.565	141557	53.4	3.901	221	13.0	13.8	NA	0.022	4539	3996	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
797	38287	2	0.2	10.3	1.0	0.000	0.006	0.013	1.306	147967	53.3	3.865	209	13.0	13.8	NA	0.424	4779	3868	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q500.1

q500.1: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3096.0153.9830.003nonzerononzero0.031
fbmy5635_rel_202203072101.cy9c5_gcp_c2s3095.6454.3530.003nonzerononzerononzero0.144
fbmy5635_rel_202205192101.cy9c5_gcp_c2s3094.3905.6060.004nonzerononzero0.039
fbmy5635_rel_202208092101.cy9c5_gcp_c2s3095.1094.8880.003nonzerononzero0.033
fbmy5635_rel_202210112144.cy9c5_gcp_c2s3094.3175.6800.003nonzero0.014
fbmy5635_rel_202302162102.cy9c5_gcp_c2s3090.7829.2130.005nonzerononzero0.028
fbmy5635_rel_202304122154.cy9c5_gcp_c2s3091.9638.0310.005nonzerononzero0.016
fbmy5635_rel_202305292102.cy9c5_gcp_c2s3092.0857.9100.005nonzero0.015
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3096.0193.9770.004nonzero0.014

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3015.57784.4030.020nonzero0.025
fbmy5635_rel_202203072101.cy9c5_gcp_c2s307.12692.8510.0220.0010.025
fbmy5635_rel_202205192101.cy9c5_gcp_c2s303.12596.2530.6190.0020.020
fbmy5635_rel_202208092101.cy9c5_gcp_c2s302.92097.0390.0390.0020.032
fbmy5635_rel_202210112144.cy9c5_gcp_c2s301.99597.9520.0520.0010.038
fbmy5635_rel_202302162102.cy9c5_gcp_c2s308.67090.8580.4660.0050.0010.096
fbmy5635_rel_202304122154.cy9c5_gcp_c2s305.32792.5002.1660.0070.024
fbmy5635_rel_202305292102.cy9c5_gcp_c2s304.24895.1850.5620.0040.022
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3023.06376.8320.1010.0050.063

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3011.63688.3060.0550.0030.040
fbmy5635_rel_202203072101.cy9c5_gcp_c2s307.19792.7160.0830.003nonzero0.064
fbmy5635_rel_202205192101.cy9c5_gcp_c2s303.82795.5140.6540.0050.052
fbmy5635_rel_202208092101.cy9c5_gcp_c2s305.03094.9060.0600.0030.047
fbmy5635_rel_202210112144.cy9c5_gcp_c2s303.65396.2700.0730.0030.038
fbmy5635_rel_202302162102.cy9c5_gcp_c2s307.60791.9300.4550.0070.0010.096
fbmy5635_rel_202304122154.cy9c5_gcp_c2s308.99188.9492.0500.0090.049
fbmy5635_rel_202305292102.cy9c5_gcp_c2s307.70991.7480.5380.0060.027
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3027.15472.7330.1070.0060.062

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3987	36374	0	0.0	38.9	6.0	0.000	0.000	0.010	1.541	144177	55.3	3.964	228	12.3	14.0	NA	0.031	4557	3964	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
3988	36160	0	0.0	37.7	6.3	0.000	0.000	0.009	1.625	143230	55.3	3.961	229	12.1	13.9	NA	0.144	4541	3948	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
3987	35587	0	0.0	39.4	6.1	0.000	0.000	0.010	1.570	141119	55.4	3.965	234	12.2	14.0	NA	0.039	4477	3900	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
3987	35738	0	0.0	39.7	6.3	0.000	0.000	0.010	1.626	141869	55.4	3.970	233	12.2	14.0	NA	0.033	4507	3901	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
3987	35436	0	0.0	40.2	6.1	0.000	0.000	0.010	1.558	140744	55.3	3.972	234	12.3	14.1	NA	0.014	4443	3868	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
3987	34741	0	0.0	36.4	5.5	0.000	0.000	0.009	1.401	136408	55.5	3.926	240	13.3	15.1	NA	0.028	4379	3676	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
3984	35049	0	0.0	36.9	5.7	0.000	0.000	0.009	1.457	137597	55.6	3.926	238	13.3	15.1	NA	0.016	4397	3676	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
3987	35221	0	0.0	36.0	5.7	0.000	0.000	0.009	1.457	138275	55.7	3.926	237	13.1	14.9	NA	0.015	4443	3740	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
3988	37292	0	0.0	37.1	5.5	0.000	0.000	0.009	1.425	144789	55.6	3.883	224	13.1	15.0	NA	0.014	4683	3932	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q1000.1

q1000.1: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3090.8189.1750.006nonzerononzero0.045
fbmy5635_rel_202203072101.cy9c5_gcp_c2s3090.0999.8950.006nonzerononzero0.043
fbmy5635_rel_202205192101.cy9c5_gcp_c2s3088.87411.1190.006nonzerononzero0.044
fbmy5635_rel_202208092101.cy9c5_gcp_c2s3089.51510.4780.006nonzerononzero0.049
fbmy5635_rel_202210112144.cy9c5_gcp_c2s3088.28011.7130.006nonzerononzero0.043
fbmy5635_rel_202302162102.cy9c5_gcp_c2s3082.36117.6190.020nonzerononzero0.048
fbmy5635_rel_202304122154.cy9c5_gcp_c2s3082.80317.1760.020nonzerononzero0.043
fbmy5635_rel_202305292102.cy9c5_gcp_c2s3084.30315.6710.026nonzerononzero0.049
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3090.5099.4810.010nonzerononzero0.031

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s3010.92289.0090.0670.0020.019
fbmy5635_rel_202203072101.cy9c5_gcp_c2s304.33295.5770.0880.0030.044
fbmy5635_rel_202205192101.cy9c5_gcp_c2s303.62696.2960.0740.0030.040
fbmy5635_rel_202208092101.cy9c5_gcp_c2s302.04597.5260.4250.0040.043
fbmy5635_rel_202210112144.cy9c5_gcp_c2s301.66898.2680.0630.0010.043
fbmy5635_rel_202302162102.cy9c5_gcp_c2s303.80268.49627.6730.0290.044
fbmy5635_rel_202304122154.cy9c5_gcp_c2s302.74067.12030.1100.0310.050
fbmy5635_rel_202305292102.cy9c5_gcp_c2s300.97054.19244.7730.0640.042
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3013.33783.4143.2430.0050.034

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
fbmy5635_rel_202104072149.cy9c5_gcp_c2s308.68391.1680.1420.0070.043
fbmy5635_rel_202203072101.cy9c5_gcp_c2s305.44894.4140.1300.0080.046
fbmy5635_rel_202205192101.cy9c5_gcp_c2s304.49195.3820.1200.0070.045
fbmy5635_rel_202208092101.cy9c5_gcp_c2s303.01096.5490.4340.0070.042
fbmy5635_rel_202210112144.cy9c5_gcp_c2s302.64997.2310.1140.0070.046
fbmy5635_rel_202302162102.cy9c5_gcp_c2s304.74368.09327.1340.0310.050
fbmy5635_rel_202304122154.cy9c5_gcp_c2s304.25566.84928.8650.0320.049
fbmy5635_rel_202305292102.cy9c5_gcp_c2s301.90955.40642.6210.0650.046
fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s3016.71780.0433.2300.0090.051

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7973	35236	0	0.0	74.5	13.5	0.000	0.000	0.009	1.736	141159	58.0	4.006	247	12.2	14.1	NA	0.045	4443	3836	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
7973	34858	0	0.0	73.3	13.6	0.000	0.000	0.009	1.752	139900	58.0	4.013	250	12.4	14.3	NA	0.043	4395	3805	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
7973	34424	0	0.0	71.5	13.5	0.000	0.000	0.009	1.728	138045	58.0	4.010	253	12.3	14.2	NA	0.044	4331	3724	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
7973	34686	0	0.0	75.4	13.2	0.000	0.000	0.009	1.694	138932	58.2	4.005	252	12.4	14.3	NA	0.049	4395	3804	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
7973	34240	0	0.0	75.6	13.6	0.000	0.000	0.009	1.749	137782	58.1	4.024	255	12.4	14.3	NA	0.043	4299	3676	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
7976	33346	0	0.0	68.0	12.2	0.000	0.000	0.009	1.565	131489	58.5	3.943	263	13.4	15.4	NA	0.048	4219	3502	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
7971	33421	0	0.0	68.6	12.1	0.000	0.000	0.009	1.552	131777	58.6	3.943	263	13.2	13.3	NA	0.043	4219	3484	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
7976	33780	0	0.0	68.8	12.0	0.000	0.000	0.009	1.541	132629	58.7	3.926	261	13.3	13.4	NA	0.049	4253	3484	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
7973	35811	0	0.0	69.8	12.7	0.000	0.000	0.009	1.625	139551	58.5	3.897	245	13.6	15.6	NA	0.031	4539	3724	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
617761	0	0	0.0	628.9	185.1	0.000	0.000	0.001	0.307	76723	73.4	0.124	18	5.2	6.9	NA	0.305	82110	61331	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
608365	0	0	0.0	636.1	182.0	0.000	0.000	0.001	0.306	74130	73.4	0.122	18	5.2	6.7	NA	0.307	81450	56039	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
608365	0	0	0.0	637.4	182.9	0.000	0.000	0.001	0.308	72413	73.6	0.119	18	5.4	6.9	NA	0.250	81809	57537	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
599251	0	0	0.0	629.1	178.3	0.000	0.000	0.001	0.305	71771	73.2	0.120	18	5.4	6.9	NA	0.354	80611	53362	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
606061	0	0	0.0	643.4	180.2	0.000	0.000	0.001	0.304	72261	73.7	0.119	18	5.4	6.9	NA	0.367	81211	54341	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
645161	0	0	0.0	547.5	147.6	0.000	0.000	0.001	0.234	74260	72.8	0.115	17	5.0	6.5	NA	0.248	87106	66228	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
642570	0	0	0.0	562.5	150.6	0.000	0.000	0.001	0.240	74268	73.1	0.116	17	5.1	6.6	NA	0.251	88104	62232	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
634921	0	0	0.0	542.3	144.7	0.000	0.000	0.001	0.233	72536	73.0	0.114	17	5.1	6.6	NA	0.290	86406	59734	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
645161	0	0	0.0	548.4	146.0	0.000	0.000	0.001	0.232	73870	72.9	0.114	17	5.0	6.5	NA	0.326	89103	61452	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
727727	0	1	0.1	279.7	98.1	0.000	0.000	0.000	0.138	1020	49.0	0.001	10	10.9	12.5	NA	0.002	NA	NA	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
737788	0	1	0.1	291.3	101.4	0.000	0.000	0.000	0.141	1105	49.0	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
737788	0	1	0.1	295.0	102.7	0.000	0.000	0.000	0.142	995	49.3	0.001	10	10.9	12.4	NA	0.002	NA	NA	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
741204	0	1	0.1	298.7	103.3	0.000	0.000	0.000	0.143	1007	49.2	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
748131	0	1	0.1	301.0	104.9	0.000	0.000	0.000	0.144	1134	49.6	0.002	10	10.9	12.4	NA	0.002	NA	NA	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
714732	0	1	0.1	267.6	95.5	0.000	0.000	0.000	0.137	1093	49.0	0.002	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
721171	0	1	0.1	270.5	96.4	0.000	0.000	0.000	0.137	1054	48.6	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
714732	0	1	0.1	268.4	97.1	0.000	0.000	0.000	0.139	1032	49.1	0.001	10	10.9	12.4	NA	0.002	NA	NA	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
711556	0	1	0.1	266.4	93.8	0.000	0.000	0.000	0.135	1014	48.5	0.001	10	10.8	12.3	NA	0.002	NA	NA	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
89797	0	1	0.3	612.8	128.6	0.000	0.004	0.007	1.467	65814	54.8	0.733	92	13.0	13.1	NA	0.403	11392	8391	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
88334	0	1	0.3	603.0	128.5	0.000	0.004	0.007	1.490	65178	54.6	0.738	93	14.7	14.8	NA	0.465	11238	8341	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
87303	0	1	0.3	596.6	126.6	0.000	0.004	0.007	1.485	64492	54.6	0.739	94	14.6	14.7	NA	0.357	11088	8141	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
87117	0	1	0.3	596.5	125.1	0.000	0.004	0.007	1.471	64355	54.7	0.739	94	13.3	13.4	NA	0.440	11087	8145	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
87734	0	1	0.3	603.5	123.9	0.000	0.004	0.007	1.446	64461	54.8	0.735	94	15.1	15.2	NA	0.403	11138	8191	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
86221	0	3	0.3	545.5	128.1	0.000	0.004	0.006	1.521	58691	57.3	0.681	100	13.7	13.9	NA	0.423	10991	7991	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
86575	0	3	0.4	552.4	126.7	0.000	0.004	0.006	1.499	58678	57.5	0.678	100	13.6	13.8	NA	0.352	11038	7991	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
86290	0	1	0.3	543.1	125.4	0.000	0.004	0.006	1.488	57989	58.5	0.672	102	15.8	16.0	NA	0.386	10988	7991	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
86370	0	2	0.3	545.7	124.1	0.000	0.004	0.006	1.472	58525	57.9	0.678	101	13.6	13.7	NA	0.382	10988	8041	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q100.1

q100.1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
797	37380	0	0.0	13.1	1.3	0.000	0.000	0.016	1.722	146825	53.3	3.928	214	12.3	12.9	NA	0.029	4715	4219	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
797	37141	0	0.0	13.3	1.3	0.000	0.000	0.017	1.643	145570	53.4	3.919	216	12.0	12.7	NA	0.026	4619	4237	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
797	36405	0	0.0	14.2	1.4	0.000	0.000	0.018	1.844	142926	53.4	3.926	220	12.1	12.8	NA	0.026	4520	4125	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
797	36816	0	0.0	15.8	1.4	0.000	0.000	0.020	1.787	144366	53.4	3.921	218	12.3	13.0	NA	0.025	4603	4045	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
798	36481	0	0.0	15.9	1.5	0.000	0.000	0.020	1.864	143052	53.4	3.921	220	12.3	13.0	NA	0.005	4555	4123	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
797	36164	1	0.2	11.4	1.1	0.000	0.006	0.014	1.406	140911	53.3	3.896	221	13.1	13.9	NA	0.029	4509	3932	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
796	36418	2	0.3	11.6	1.1	0.000	0.008	0.015	1.422	141683	53.2	3.890	219	13.0	13.8	NA	0.011	4603	4123	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
796	36291	2	0.2	12.3	1.2	0.000	0.007	0.015	1.565	141557	53.4	3.901	221	13.0	13.8	NA	0.022	4539	3996	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
797	38287	2	0.2	10.3	1.0	0.000	0.006	0.013	1.306	147967	53.3	3.865	209	13.0	13.8	NA	0.424	4779	3868	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q500.1

q500.1: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3987	36374	0	0.0	38.9	6.0	0.000	0.000	0.010	1.541	144177	55.3	3.964	228	12.3	14.0	NA	0.031	4557	3964	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
3988	36160	0	0.0	37.7	6.3	0.000	0.000	0.009	1.625	143230	55.3	3.961	229	12.1	13.9	NA	0.144	4541	3948	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
3987	35587	0	0.0	39.4	6.1	0.000	0.000	0.010	1.570	141119	55.4	3.965	234	12.2	14.0	NA	0.039	4477	3900	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
3987	35738	0	0.0	39.7	6.3	0.000	0.000	0.010	1.626	141869	55.4	3.970	233	12.2	14.0	NA	0.033	4507	3901	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
3987	35436	0	0.0	40.2	6.1	0.000	0.000	0.010	1.558	140744	55.3	3.972	234	12.3	14.1	NA	0.014	4443	3868	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
3987	34741	0	0.0	36.4	5.5	0.000	0.000	0.009	1.401	136408	55.5	3.926	240	13.3	15.1	NA	0.028	4379	3676	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
3984	35049	0	0.0	36.9	5.7	0.000	0.000	0.009	1.457	137597	55.6	3.926	238	13.3	15.1	NA	0.016	4397	3676	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
3987	35221	0	0.0	36.0	5.7	0.000	0.000	0.009	1.457	138275	55.7	3.926	237	13.1	14.9	NA	0.015	4443	3740	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
3988	37292	0	0.0	37.1	5.5	0.000	0.000	0.009	1.425	144789	55.6	3.883	224	13.1	15.0	NA	0.014	4683	3932	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q1000.1

q1000.1: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
7973	35236	0	0.0	74.5	13.5	0.000	0.000	0.009	1.736	141159	58.0	4.006	247	12.2	14.1	NA	0.045	4443	3836	160m.fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
7973	34858	0	0.0	73.3	13.6	0.000	0.000	0.009	1.752	139900	58.0	4.013	250	12.4	14.3	NA	0.043	4395	3805	160m.fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
7973	34424	0	0.0	71.5	13.5	0.000	0.000	0.009	1.728	138045	58.0	4.010	253	12.3	14.2	NA	0.044	4331	3724	160m.fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
7973	34686	0	0.0	75.4	13.2	0.000	0.000	0.009	1.694	138932	58.2	4.005	252	12.4	14.3	NA	0.049	4395	3804	160m.fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
7973	34240	0	0.0	75.6	13.6	0.000	0.000	0.009	1.749	137782	58.1	4.024	255	12.4	14.3	NA	0.043	4299	3676	160m.fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
7976	33346	0	0.0	68.0	12.2	0.000	0.000	0.009	1.565	131489	58.5	3.943	263	13.4	15.4	NA	0.048	4219	3502	160m.fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
7971	33421	0	0.0	68.6	12.1	0.000	0.000	0.009	1.552	131777	58.6	3.943	263	13.2	13.3	NA	0.043	4219	3484	160m.fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
7976	33780	0	0.0	68.8	12.0	0.000	0.000	0.009	1.541	132629	58.7	3.926	261	13.3	13.4	NA	0.049	4253	3484	160m.fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
7973	35811	0	0.0	69.8	12.7	0.000	0.000	0.009	1.625	139551	58.5	3.897	245	13.6	15.6	NA	0.031	4539	3724	160m.fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	27.499	72.472	0.013	0.002	0.013	0.001	0.000	0.000	0.000	0.305	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	21.041	78.926	0.017	0.001	0.013	0.001	0.000	0.000	0.000	0.307	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	20.326	79.645	0.015	0.001	0.014	0.000	0.000	0.000	0.000	0.250	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	17.507	82.461	0.015	0.003	0.012	0.002	0.000	0.000	0.000	0.354	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	18.836	81.134	0.014	0.002	0.012	0.002	0.000	0.000	0.000	0.367	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	40.170	59.799	0.015	0.002	0.014	0.000	0.000	0.000	0.000	0.248	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	40.405	59.566	0.014	0.002	0.014	0.000	0.000	0.000	0.000	0.251	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	33.094	66.879	0.012	0.001	0.013	0.001	0.000	0.000	0.000	0.290	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	41.084	58.891	0.010	0.001	0.014	nonzero	0.000	0.000	0.000	0.326	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.036	35.862	64.011	0.075	0.013	0.001	0.000	0.000	0.000	0.403	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	0.019	30.727	69.163	0.076	0.014	0.001	0.000	0.000	0.000	0.465	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	0.010	29.117	70.782	0.077	0.013	0.001	0.000	0.000	0.000	0.357	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	0.011	28.511	71.389	0.075	0.014	0.001	0.000	0.000	0.000	0.440	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	0.008	29.680	70.223	0.075	0.013	0.001	0.000	0.000	0.000	0.403	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	0.023	30.062	69.812	0.090	0.012	0.001	0.000	0.000	0.000	0.423	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	0.031	29.638	70.225	0.092	0.014	0.001	0.000	0.000	0.000	0.352	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	0.022	29.642	70.229	0.095	0.011	0.001	0.000	0.000	0.000	0.386	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	0.010	30.895	68.990	0.091	0.013	0.001	0.000	0.000	0.000	0.382	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.035	33.022	66.847	0.080	0.014	0.001	0.000	0.000	0.000	0.403	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	0.019	31.725	68.163	0.078	0.014	0.001	0.000	0.000	0.000	0.463	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	0.009	29.919	69.977	0.079	0.013	0.001	0.000	0.000	0.000	0.359	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	0.011	29.834	70.064	0.077	0.013	0.001	0.000	0.000	0.000	0.440	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	0.007	30.838	69.063	0.077	0.013	0.001	0.000	0.000	0.000	0.402	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	0.019	28.790	71.084	0.094	0.013	0.001	0.000	0.000	0.000	0.425	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	0.030	29.585	70.276	0.094	0.014	0.001	0.000	0.000	0.000	0.353	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	0.022	29.858	70.011	0.096	0.011	0.001	0.000	0.000	0.000	0.387	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	0.008	28.828	71.054	0.096	0.013	0.001	0.000	0.000	0.000	0.381	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q100.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
98.182	1.817	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
98.117	1.882	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
97.284	2.715	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.026	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
97.626	2.373	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
97.296	2.703	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
96.539	3.460	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.029	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
97.200	2.799	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.011	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
96.658	3.341	0.001	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
97.877	2.121	0.001	nonzero	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.424	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	3.844	96.116	0.036	0.003	0.000	0.000	0.000	0.000	0.000	0.026	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	1.465	98.519	0.012	0.003	0.000	0.000	0.000	0.000	0.000	0.021	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	0.861	99.109	0.028	0.002	0.000	0.000	0.000	0.000	0.000	0.017	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	0.469	99.476	0.049	0.007	0.000	0.000	0.000	0.000	0.000	0.020	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	0.259	99.705	0.033	0.003	0.000	0.000	0.000	0.000	0.000	0.023	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	10.693	89.288	0.016	0.003	0.000	0.000	0.000	0.000	0.000	0.050	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	4.151	95.795	0.043	0.010	0.000	0.000	0.000	0.000	0.000	0.034	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	1.819	98.118	0.056	0.007	0.000	0.000	0.000	0.000	0.000	0.034	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	9.913	89.983	0.082	0.023	0.000	0.000	0.000	0.000	0.000	0.035	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.717	98.224	0.057	0.002	0.000	0.000	0.000	0.000	0.000	0.027	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	2.370	97.568	0.054	0.009	0.000	0.000	0.000	0.000	0.000	0.021	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	1.339	98.630	0.030	0.002	0.000	0.000	0.000	0.000	0.000	0.017	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	0.613	99.333	0.047	0.007	0.000	0.000	0.000	0.000	0.000	0.022	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	0.682	99.247	0.066	0.005	0.000	0.000	0.000	0.000	0.000	0.022	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	3.257	96.694	0.045	0.003	0.000	0.000	0.000	0.000	0.000	0.049	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	3.969	95.932	0.090	0.009	0.000	0.000	0.000	0.000	0.000	0.030	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	3.408	96.498	0.089	0.005	0.000	0.000	0.000	0.000	0.000	0.034	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	7.075	92.780	0.123	0.023	0.000	0.000	0.000	0.000	0.000	0.037	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q500.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
96.015	3.983	0.003	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
95.645	4.353	0.003	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.144	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
94.390	5.606	0.004	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.039	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
95.109	4.888	0.003	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.033	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
94.317	5.680	0.003	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.014	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
90.782	9.213	0.005	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
91.963	8.031	0.005	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.016	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
92.085	7.910	0.005	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.015	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
96.019	3.977	0.004	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.014	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	15.577	84.403	0.020	nonzero	0.000	0.000	0.000	0.000	0.000	0.025	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	7.126	92.851	0.022	0.001	0.000	0.000	0.000	0.000	0.000	0.025	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	3.125	96.253	0.619	0.002	0.000	0.000	0.000	0.000	0.000	0.020	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	2.920	97.039	0.039	0.002	0.000	0.000	0.000	0.000	0.000	0.032	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	1.995	97.952	0.052	0.001	0.000	0.000	0.000	0.000	0.000	0.038	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	8.670	90.858	0.466	0.005	0.001	0.000	0.000	0.000	0.000	0.096	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	5.327	92.500	2.166	0.007	0.000	0.000	0.000	0.000	0.000	0.024	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	4.248	95.185	0.562	0.004	0.000	0.000	0.000	0.000	0.000	0.022	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	23.063	76.832	0.101	0.005	0.000	0.000	0.000	0.000	0.000	0.063	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	11.636	88.306	0.055	0.003	0.000	0.000	0.000	0.000	0.000	0.040	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	7.197	92.716	0.083	0.003	nonzero	0.000	0.000	0.000	0.000	0.064	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	3.827	95.514	0.654	0.005	0.000	0.000	0.000	0.000	0.000	0.052	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	5.030	94.906	0.060	0.003	0.000	0.000	0.000	0.000	0.000	0.047	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	3.653	96.270	0.073	0.003	0.000	0.000	0.000	0.000	0.000	0.038	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	7.607	91.930	0.455	0.007	0.001	0.000	0.000	0.000	0.000	0.096	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	8.991	88.949	2.050	0.009	0.000	0.000	0.000	0.000	0.000	0.049	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	7.709	91.748	0.538	0.006	0.000	0.000	0.000	0.000	0.000	0.027	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	27.154	72.733	0.107	0.006	0.000	0.000	0.000	0.000	0.000	0.062	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

q1000.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
90.818	9.175	0.006	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.045	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
90.099	9.895	0.006	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.043	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
88.874	11.119	0.006	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.044	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
89.515	10.478	0.006	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.049	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
88.280	11.713	0.006	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.043	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
82.361	17.619	0.020	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.048	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
82.803	17.176	0.020	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.043	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
84.303	15.671	0.026	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.049	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
90.509	9.481	0.010	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.031	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	10.922	89.009	0.067	0.002	0.000	0.000	0.000	0.000	0.000	0.019	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	4.332	95.577	0.088	0.003	0.000	0.000	0.000	0.000	0.000	0.044	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	3.626	96.296	0.074	0.003	0.000	0.000	0.000	0.000	0.000	0.040	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	2.045	97.526	0.425	0.004	0.000	0.000	0.000	0.000	0.000	0.043	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	1.668	98.268	0.063	0.001	0.000	0.000	0.000	0.000	0.000	0.043	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	3.802	68.496	27.673	0.029	0.000	0.000	0.000	0.000	0.000	0.044	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	2.740	67.120	30.110	0.031	0.000	0.000	0.000	0.000	0.000	0.050	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	0.970	54.192	44.773	0.064	0.000	0.000	0.000	0.000	0.000	0.042	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	13.337	83.414	3.243	0.005	0.000	0.000	0.000	0.000	0.000	0.034	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	8.683	91.168	0.142	0.007	0.000	0.000	0.000	0.000	0.000	0.043	fbmy5635_rel_202104072149.cy9c5_gcp_c2s30
0.000	5.448	94.414	0.130	0.008	0.000	0.000	0.000	0.000	0.000	0.046	fbmy5635_rel_202203072101.cy9c5_gcp_c2s30
0.000	4.491	95.382	0.120	0.007	0.000	0.000	0.000	0.000	0.000	0.045	fbmy5635_rel_202205192101.cy9c5_gcp_c2s30
0.000	3.010	96.549	0.434	0.007	0.000	0.000	0.000	0.000	0.000	0.042	fbmy5635_rel_202208092101.cy9c5_gcp_c2s30
0.000	2.649	97.231	0.114	0.007	0.000	0.000	0.000	0.000	0.000	0.046	fbmy5635_rel_202210112144.cy9c5_gcp_c2s30
0.000	4.743	68.093	27.134	0.031	0.000	0.000	0.000	0.000	0.000	0.050	fbmy5635_rel_202302162102.cy9c5_gcp_c2s30
0.000	4.255	66.849	28.865	0.032	0.000	0.000	0.000	0.000	0.000	0.049	fbmy5635_rel_202304122154.cy9c5_gcp_c2s30
0.000	1.909	55.406	42.621	0.065	0.000	0.000	0.000	0.000	0.000	0.046	fbmy5635_rel_202305292102.cy9c5_gcp_c2s30
0.000	16.717	80.043	3.230	0.009	0.000	0.000	0.000	0.000	0.000	0.051	fbmy5635_rel_jun23_7e40af67.cy9c5_gcp_c2s30