Introduction

This is a report for the insert benchmark with 4000M docs and 8 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server is a c2-standard-30 with 15 cores, hyperthreads disabled, 120G RAM and XFS with SW RAID 0 across 4 NVMe SSD. The benchmark was run with 8 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables, 1 per client. It loads 500M rows per table without secondary indexes, creates secondary indexes, then inserts 60M rows per table with a delete per insert to avoid growing the table. It then does 3 read+write tests for 7200s each that do queries as fast as possible with 100, 500 and then 1000 inserts/second/client concurrent with the queries. There are also deletes to match the inserts and avoid growing the table. The database is larger than memory. Clients and the DBMS share one server. The per-database configs are in the per-database subdirectories here.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0 and l.i1, indexed docs (or rows) /s for l.x and queries/s for q*.2. The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1q100.1q500.1q1000.1
pg152_o3_native_lto.cx7a28_gcp_c2s30 11210761529675132321036988632160529
pg153_o3_native_lto.cx7a28_gcp_c2s30 11077261522108119101048499424073961
pg154_o3_native_lto.cx7a28_gcp_c2s30 10940921546829104641065049067279373
pg16beta1_o3_native_lto.cx7a28_gcp_c2s30 10925981626057108661038819230668307
pg16beta2_o3_native_lto.cx7a28_gcp_c2s30 10982981662552100771044848950274568
pg16beta3_o3_native_lto.cx7a28_gcp_c2s30 11055831631362104811023818528770070
pg16rc1_o3_native_lto.cx7a28_gcp_c2s30 11108021654301127771036908312257132
pg160_o3_native_lto.cx7a28_gcp_c2s30 10940921646132101571033889214767567

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1q100.1q500.1q1000.1
pg152_o3_native_lto.cx7a28_gcp_c2s30 1.001.001.001.001.001.00
pg153_o3_native_lto.cx7a28_gcp_c2s30 0.991.000.901.011.091.22
pg154_o3_native_lto.cx7a28_gcp_c2s30 0.981.010.791.031.051.31
pg16beta1_o3_native_lto.cx7a28_gcp_c2s30 0.971.060.821.001.071.13
pg16beta2_o3_native_lto.cx7a28_gcp_c2s30 0.981.090.761.011.041.23
pg16beta3_o3_native_lto.cx7a28_gcp_c2s30 0.991.070.790.990.991.16
pg16rc1_o3_native_lto.cx7a28_gcp_c2s30 0.991.080.971.000.960.94
pg160_o3_native_lto.cx7a28_gcp_c2s30 0.981.080.771.001.071.12

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsq100.1q500.1q1000.1
pg152_o3_native_lto.cx7a28_gcp_c2s3079839925880
pg153_o3_native_lto.cx7a28_gcp_c2s3079839925735
pg154_o3_native_lto.cx7a28_gcp_c2s3079839925135
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3079839927059
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3079839925074
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3079839925124
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3079839925666
pg160_o3_native_lto.cx7a28_gcp_c2s3079839925734
target80040008000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3097.1142.8450.0280.0070.0040.0010.538
pg153_o3_native_lto.cx7a28_gcp_c2s3097.3132.6490.0270.0070.0040.0010.525
pg154_o3_native_lto.cx7a28_gcp_c2s3097.4092.5480.0280.0090.0050.0010.696
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3097.2862.6700.0300.0090.0040.0010.466
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3097.3732.5920.0260.0060.003nonzero0.416
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3097.2322.7180.0310.0130.0050.001nonzero1.448
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3097.4122.5470.0280.0080.004nonzero0.811
pg160_o3_native_lto.cx7a28_gcp_c2s3097.3772.5840.0270.0060.0050.0010.690

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1121076	0	546	4.3	1463.9	284.8	0.000	0.004	0.001	0.260	91873	85.0	0.082	11	382.7	414.8	7.9	0.538	144039	77132	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
1107726	0	543	4.3	1469.1	285.9	0.000	0.004	0.001	0.264	91485	85.0	0.083	12	382.7	414.8	6.4	0.525	141938	72521	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
1094092	0	547	4.3	1440.5	277.8	0.000	0.004	0.001	0.260	92312	84.1	0.084	12	382.7	414.8	5.0	0.696	140647	65629	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
1092598	0	544	4.3	1452.6	281.8	0.000	0.004	0.001	0.264	90976	84.4	0.083	12	382.7	414.8	9.9	0.466	140248	74218	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
1098298	0	551	4.3	1442.3	279.2	0.001	0.004	0.001	0.260	91909	84.7	0.084	12	382.7	414.8	3.9	0.416	140447	86706	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
1105583	0	546	4.3	1457.7	284.1	0.000	0.004	0.001	0.263	91339	84.4	0.083	11	382.7	414.8	7.9	1.448	142345	64730	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
1110802	0	546	4.3	1460.8	284.5	0.000	0.004	0.001	0.262	92094	84.9	0.083	11	382.7	414.8	9.6	0.811	142246	79114	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
1094092	0	534	4.2	1446.3	277.9	0.000	0.004	0.001	0.260	91996	84.4	0.084	12	382.7	414.8	4.5	0.690	140347	67227	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1529675	0	3573	734.0	1315.6	285.2	0.002	0.491	0.001	0.191	35450	35.1	0.023	3	735.2	767.0	56.8	0.002	NA	NA	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
1522108	0	3594	743.5	1294.0	285.6	0.002	0.500	0.001	0.192	35959	34.6	0.024	3	735.2	767.0	56.9	0.002	NA	NA	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
1546829	0	3613	745.9	1321.9	291.1	0.002	0.494	0.001	0.193	34858	34.8	0.023	3	735.2	767.0	57.2	0.002	NA	NA	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
1626057	0	2910	650.5	1377.7	307.8	0.002	0.410	0.001	0.194	45051	36.2	0.028	3	735.2	767.2	56.8	0.002	NA	NA	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
1662552	0	2902	653.1	1413.5	315.6	0.002	0.402	0.001	0.194	44054	36.5	0.026	3	735.2	767.1	56.7	0.002	NA	NA	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
1631362	0	2897	648.5	1387.0	312.8	0.002	0.407	0.001	0.196	44184	36.1	0.027	3	735.2	767.2	56.7	0.002	NA	NA	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
1654301	0	2879	650.5	1394.8	313.9	0.002	0.403	0.001	0.194	44489	36.3	0.027	3	735.2	767.2	56.8	0.002	NA	NA	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
1646132	0	2845	649.4	1400.8	312.2	0.002	0.404	0.001	0.194	43392	36.4	0.026	3	735.2	767.0	57.0	0.027	NA	NA	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3030.69547.32421.9110.0680.003nonzero1.241
pg153_o3_native_lto.cx7a28_gcp_c2s3052.23128.30119.4290.0360.003nonzero1.463
pg154_o3_native_lto.cx7a28_gcp_c2s3041.98437.24520.7250.0440.001nonzero1.546
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3044.75734.80120.3870.0520.0020.803
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3047.91533.13718.8710.0760.002nonzero1.316
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3050.41930.71918.7960.0650.002nonzero1.155
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3036.04142.69121.1870.0780.002nonzero1.162
pg160_o3_native_lto.cx7a28_gcp_c2s3058.39126.67114.8720.0640.002nonzero1.017

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3071.5652.9950.9112.8869.37112.0460.2260.615
pg153_o3_native_lto.cx7a28_gcp_c2s3074.4422.0780.7072.5757.93712.1710.090nonzero1.022
pg154_o3_native_lto.cx7a28_gcp_c2s3074.2052.6170.6582.2749.41310.8250.0070.520
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3071.8244.0341.0283.24110.0219.7360.1160.581
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3073.2624.4460.5671.8367.56512.2260.0980.777
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3075.3523.7280.4921.7277.37111.3210.0080.601
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3070.8583.8700.4931.69210.64712.4380.0020.458
pg160_o3_native_lto.cx7a28_gcp_c2s3076.3421.4080.6662.1127.50911.7700.1920.893

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
13232	0	10482	124.8	21520.6	358.8	0.792	9.662	1.626	27.768	28006	42.2	2.117	478	780.9	813.0	56.6	1.241	649	400	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
11910	0	7217	86.9	16055.6	292.6	0.606	7.472	1.348	25.153	20809	39.0	1.747	491	782.6	814.7	70.6	1.463	549	350	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
10464	0	7671	91.8	15703.2	275.4	0.733	8.987	1.501	26.947	20875	33.9	1.995	486	785.2	817.3	67.8	1.546	2448	200	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
10866	0	7326	91.4	16156.2	277.8	0.674	8.616	1.487	26.176	20628	33.5	1.898	462	777.9	810.0	70.3	0.803	1149	200	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
10077	0	6559	82.4	13919.1	264.9	0.651	8.372	1.381	26.919	18522	34.5	1.838	514	789.6	821.7	58.7	1.316	849	499	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
10481	0	6562	79.2	14182.9	268.1	0.626	7.737	1.353	26.193	18673	31.1	1.782	445	784.5	816.6	68.9	1.155	499	350	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
12777	0	9706	113.0	19989.6	340.0	0.760	9.058	1.565	27.247	26201	38.8	2.051	456	780.7	812.8	70.9	1.162	749	499	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
10157	0	5275	67.4	12426.0	249.6	0.519	6.792	1.223	25.166	16020	29.7	1.577	439	784.8	816.8	70.5	1.017	200	150	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

q100.1

q100.1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3099.8980.1010.001nonzerononzerononzero0.072
pg153_o3_native_lto.cx7a28_gcp_c2s3099.9020.0970.001nonzerononzerononzero0.240
pg154_o3_native_lto.cx7a28_gcp_c2s3099.9020.0970.001nonzerononzerononzero0.180
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3099.9160.0830.001nonzerononzerononzero0.142
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3099.8930.1060.001nonzerononzerononzero0.065
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3099.8860.1130.001nonzerononzerononzero0.133
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3099.9120.0870.001nonzerononzerononzero0.141
pg160_o3_native_lto.cx7a28_gcp_c2s3099.8800.1190.001nonzerononzerononzero0.152

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3026.70173.2890.0100.168
pg153_o3_native_lto.cx7a28_gcp_c2s300.24926.75372.9890.0060.0030.312
pg154_o3_native_lto.cx7a28_gcp_c2s302.17621.98975.8320.0030.075
pg16beta1_o3_native_lto.cx7a28_gcp_c2s301.21818.28880.4880.0050.0010.397
pg16beta2_o3_native_lto.cx7a28_gcp_c2s304.42812.39483.1750.0030.072
pg16beta3_o3_native_lto.cx7a28_gcp_c2s302.43916.64580.9090.0070.111
pg16rc1_o3_native_lto.cx7a28_gcp_c2s302.85420.48476.6580.0030.153
pg160_o3_native_lto.cx7a28_gcp_c2s300.39818.64480.9460.0110.086

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3029.44723.99511.46222.53312.5630.057
pg153_o3_native_lto.cx7a28_gcp_c2s3040.57927.17517.92414.3170.0040.020
pg154_o3_native_lto.cx7a28_gcp_c2s3039.34227.77717.06115.8150.0050.025
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3031.41025.56922.40620.6070.0080.024
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3036.29930.66716.44416.5860.0050.021
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3031.83122.77316.04616.84612.5030.0010.083
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3046.85429.5525.7365.35812.4990.0010.086
pg160_o3_native_lto.cx7a28_gcp_c2s3030.74725.50011.15520.06712.5310.0010.076

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
798	103698	1379	11.6	1864.2	26.1	0.013	0.114	2.335	33.456	397881	53.7	3.837	78	781.1	813.2	70.9	0.072	12935	12375	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
798	104849	1365	11.4	1870.0	25.6	0.013	0.111	2.342	32.838	402327	53.2	3.837	76	782.8	814.9	70.9	0.240	13121	7608	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
798	106504	1413	11.8	1829.6	25.3	0.013	0.114	2.292	32.439	408625	53.2	3.837	75	785.3	817.3	70.9	0.180	13367	12999	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
798	103881	1363	11.4	1874.0	25.1	0.013	0.112	2.347	32.234	398677	53.3	3.838	77	778.2	810.3	70.9	0.142	12866	12178	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
798	104484	1425	11.9	1858.4	25.8	0.014	0.117	2.328	33.128	401017	53.2	3.838	76	789.7	821.7	70.9	0.065	13079	8970	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
798	102381	1422	11.9	1868.3	25.8	0.014	0.119	2.341	33.149	392966	53.6	3.838	79	784.6	816.6	70.9	0.133	12850	8007	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
798	103690	1377	11.6	1877.9	25.5	0.013	0.115	2.353	32.698	397823	53.9	3.837	78	780.9	813.0	70.9	0.141	12946	10425	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
798	103388	1444	12.1	1846.0	25.8	0.014	0.120	2.312	33.146	396733	53.6	3.837	78	784.9	816.9	70.9	0.152	12882	12626	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

q500.1

q500.1: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3099.8680.1290.0030.001nonzero0.027
pg153_o3_native_lto.cx7a28_gcp_c2s3099.8660.1290.0030.001nonzero0.028
pg154_o3_native_lto.cx7a28_gcp_c2s3099.8590.1380.0020.001nonzero0.028
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3099.8490.1460.0040.001nonzero0.027
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3099.8390.1580.0030.001nonzero0.028
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3099.8230.1730.0030.001nonzero0.027
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3099.8500.1470.0020.001nonzero0.027
pg160_o3_native_lto.cx7a28_gcp_c2s3099.8580.1360.0040.001nonzero0.032

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3018.77181.228nonzero0.102
pg153_o3_native_lto.cx7a28_gcp_c2s3019.58380.4160.0010.135
pg154_o3_native_lto.cx7a28_gcp_c2s3024.99575.0050.056
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3015.24284.758nonzero0.070
pg16beta2_o3_native_lto.cx7a28_gcp_c2s309.49490.5050.0010.075
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3016.66383.3350.0020.081
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3014.55385.4450.0010.070
pg160_o3_native_lto.cx7a28_gcp_c2s3022.40577.5940.0020.089

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3057.6067.9940.0965.65327.7670.8840.091
pg153_o3_native_lto.cx7a28_gcp_c2s3034.6796.9980.1858.90249.1910.0450.085
pg154_o3_native_lto.cx7a28_gcp_c2s3053.0677.9350.1547.48031.3650.051
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3037.1418.8360.1829.97043.8630.0080.077
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3055.91610.4520.1617.28526.1860.055
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3041.7648.3750.1547.14038.3684.1990.112
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3067.1368.0330.1382.80214.6357.2560.113
pg160_o3_native_lto.cx7a28_gcp_c2s3020.6626.8820.1229.14260.2922.9010.117

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3992	86321	5880	47.6	10356.4	132.2	0.068	0.565	2.595	33.904	331144	61.0	3.836	106	782.4	814.5	70.9	0.027	10357	9717	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
3992	94240	5897	47.7	10233.2	131.0	0.063	0.518	2.564	33.597	329653	64.1	3.498	102	783.9	816.0	0.5	0.028	11699	10165	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
3992	90672	5907	47.9	10246.8	131.8	0.065	0.541	2.567	33.801	343621	61.0	3.790	101	785.5	817.6	70.9	0.028	11571	9813	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
3992	92306	5873	47.5	10381.5	131.5	0.064	0.527	2.600	33.728	331215	62.7	3.588	102	780.1	812.1	70.9	0.027	11475	10069	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
3992	89502	5918	48.0	10267.1	132.9	0.066	0.550	2.572	34.089	341505	60.1	3.816	101	789.9	822.0	70.9	0.028	11299	9669	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
3992	85287	5893	47.8	10311.1	132.5	0.069	0.573	2.583	33.999	311037	64.1	3.647	113	785.0	817.1	70.9	0.027	10441	9482	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
3992	83122	5883	47.7	10431.1	131.1	0.071	0.588	2.613	33.617	323629	61.6	3.893	111	782.1	814.1	70.9	0.027	10133	9577	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
3992	92147	5902	47.8	10298.9	133.0	0.064	0.532	2.580	34.124	307816	67.3	3.340	110	785.4	817.4	70.9	0.032	11369	10293	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

q1000.1

q1000.1: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3099.7110.2850.0030.001nonzero0.028
pg153_o3_native_lto.cx7a28_gcp_c2s3099.6830.3110.0050.001nonzero0.036
pg154_o3_native_lto.cx7a28_gcp_c2s3099.7750.2180.0060.001nonzero0.032
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3099.6750.3190.0040.001nonzero0.028
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3099.7280.2660.0050.001nonzero0.028
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3099.6750.3200.0040.001nonzero0.046
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3099.7030.2930.0030.001nonzero0.058
pg160_o3_native_lto.cx7a28_gcp_c2s3099.6910.3020.0060.001nonzero0.036

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s30nonzero11.87888.1200.0010.122
pg153_o3_native_lto.cx7a28_gcp_c2s3022.96477.0360.0010.123
pg154_o3_native_lto.cx7a28_gcp_c2s3039.58060.4190.0010.081
pg16beta1_o3_native_lto.cx7a28_gcp_c2s309.82390.177nonzero0.070
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3029.87070.1270.0030.136
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3025.25474.7430.0020.091
pg16rc1_o3_native_lto.cx7a28_gcp_c2s300.33013.49786.1730.0010.115
pg160_o3_native_lto.cx7a28_gcp_c2s3021.62978.3650.0060.094

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
pg152_o3_native_lto.cx7a28_gcp_c2s3066.96522.5540.1470.0231.1649.1470.177
pg153_o3_native_lto.cx7a28_gcp_c2s3050.43219.9070.1280.0336.68522.8140.162
pg154_o3_native_lto.cx7a28_gcp_c2s3044.57315.6190.1410.02612.45727.1840.206
pg16beta1_o3_native_lto.cx7a28_gcp_c2s3064.91424.1770.1430.0206.3514.3950.147
pg16beta2_o3_native_lto.cx7a28_gcp_c2s3044.81723.8100.1350.0284.61726.593nonzero0.324
pg16beta3_o3_native_lto.cx7a28_gcp_c2s3052.12519.4860.1290.0281.83926.3930.202
pg16rc1_o3_native_lto.cx7a28_gcp_c2s3072.02118.2870.1440.0242.1797.3450.153
pg160_o3_native_lto.cx7a28_gcp_c2s3055.08620.7470.1270.0247.65916.3570.208

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
5880	60529	8738	71.2	15053.2	192.0	0.144	1.204	2.560	33.439	243176	51.9	4.017	129	785.4	817.4	70.9	0.028	9142	8758	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
5735	73961	8424	68.8	14413.1	183.7	0.114	0.953	2.513	32.796	249896	63.2	3.379	128	786.4	818.5	70.9	0.036	10149	8614	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
5135	79373	7504	61.5	12935.9	164.9	0.095	0.794	2.519	32.877	231731	62.9	2.920	119	787.0	819.1	70.9	0.032	12370	9478	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
7059	68307	10495	85.1	18096.3	228.8	0.154	1.275	2.564	33.194	269206	59.3	3.941	130	784.4	816.5	70.9	0.028	8854	8407	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
5074	74568	7425	60.9	12744.2	163.7	0.100	0.837	2.512	33.043	246082	61.8	3.300	124	791.0	823.0	70.9	0.028	10393	8535	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
5124	70070	7440	61.0	12882.4	165.6	0.106	0.892	2.514	33.091	241610	60.0	3.448	128	786.7	818.7	70.9	0.046	9929	8503	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
5666	57132	8381	68.4	14482.4	181.7	0.147	1.226	2.556	32.840	230832	49.2	4.040	129	785.4	817.5	70.9	0.058	9046	8790	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
5734	67567	8488	69.3	14592.5	187.0	0.126	1.050	2.545	33.403	243003	60.0	3.596	133	787.6	819.6	70.9	0.036	8822	8474	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1121076	0	546	4.3	1463.9	284.8	0.000	0.004	0.001	0.260	91873	85.0	0.082	11	382.7	414.8	7.9	0.538	144039	77132	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
1107726	0	543	4.3	1469.1	285.9	0.000	0.004	0.001	0.264	91485	85.0	0.083	12	382.7	414.8	6.4	0.525	141938	72521	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
1094092	0	547	4.3	1440.5	277.8	0.000	0.004	0.001	0.260	92312	84.1	0.084	12	382.7	414.8	5.0	0.696	140647	65629	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
1092598	0	544	4.3	1452.6	281.8	0.000	0.004	0.001	0.264	90976	84.4	0.083	12	382.7	414.8	9.9	0.466	140248	74218	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
1098298	0	551	4.3	1442.3	279.2	0.001	0.004	0.001	0.260	91909	84.7	0.084	12	382.7	414.8	3.9	0.416	140447	86706	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
1105583	0	546	4.3	1457.7	284.1	0.000	0.004	0.001	0.263	91339	84.4	0.083	11	382.7	414.8	7.9	1.448	142345	64730	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
1110802	0	546	4.3	1460.8	284.5	0.000	0.004	0.001	0.262	92094	84.9	0.083	11	382.7	414.8	9.6	0.811	142246	79114	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
1094092	0	534	4.2	1446.3	277.9	0.000	0.004	0.001	0.260	91996	84.4	0.084	12	382.7	414.8	4.5	0.690	140347	67227	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1529675	0	3573	734.0	1315.6	285.2	0.002	0.491	0.001	0.191	35450	35.1	0.023	3	735.2	767.0	56.8	0.002	NA	NA	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
1522108	0	3594	743.5	1294.0	285.6	0.002	0.500	0.001	0.192	35959	34.6	0.024	3	735.2	767.0	56.9	0.002	NA	NA	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
1546829	0	3613	745.9	1321.9	291.1	0.002	0.494	0.001	0.193	34858	34.8	0.023	3	735.2	767.0	57.2	0.002	NA	NA	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
1626057	0	2910	650.5	1377.7	307.8	0.002	0.410	0.001	0.194	45051	36.2	0.028	3	735.2	767.2	56.8	0.002	NA	NA	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
1662552	0	2902	653.1	1413.5	315.6	0.002	0.402	0.001	0.194	44054	36.5	0.026	3	735.2	767.1	56.7	0.002	NA	NA	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
1631362	0	2897	648.5	1387.0	312.8	0.002	0.407	0.001	0.196	44184	36.1	0.027	3	735.2	767.2	56.7	0.002	NA	NA	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
1654301	0	2879	650.5	1394.8	313.9	0.002	0.403	0.001	0.194	44489	36.3	0.027	3	735.2	767.2	56.8	0.002	NA	NA	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
1646132	0	2845	649.4	1400.8	312.2	0.002	0.404	0.001	0.194	43392	36.4	0.026	3	735.2	767.0	57.0	0.027	NA	NA	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

l.i1

l.i1: continue load after secondary indexes created

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
13232	0	10482	124.8	21520.6	358.8	0.792	9.662	1.626	27.768	28006	42.2	2.117	478	780.9	813.0	56.6	1.241	649	400	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
11910	0	7217	86.9	16055.6	292.6	0.606	7.472	1.348	25.153	20809	39.0	1.747	491	782.6	814.7	70.6	1.463	549	350	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
10464	0	7671	91.8	15703.2	275.4	0.733	8.987	1.501	26.947	20875	33.9	1.995	486	785.2	817.3	67.8	1.546	2448	200	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
10866	0	7326	91.4	16156.2	277.8	0.674	8.616	1.487	26.176	20628	33.5	1.898	462	777.9	810.0	70.3	0.803	1149	200	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
10077	0	6559	82.4	13919.1	264.9	0.651	8.372	1.381	26.919	18522	34.5	1.838	514	789.6	821.7	58.7	1.316	849	499	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
10481	0	6562	79.2	14182.9	268.1	0.626	7.737	1.353	26.193	18673	31.1	1.782	445	784.5	816.6	68.9	1.155	499	350	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
12777	0	9706	113.0	19989.6	340.0	0.760	9.058	1.565	27.247	26201	38.8	2.051	456	780.7	812.8	70.9	1.162	749	499	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
10157	0	5275	67.4	12426.0	249.6	0.519	6.792	1.223	25.166	16020	29.7	1.577	439	784.8	816.8	70.5	1.017	200	150	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

q100.1

q100.1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
798	103698	1379	11.6	1864.2	26.1	0.013	0.114	2.335	33.456	397881	53.7	3.837	78	781.1	813.2	70.9	0.072	12935	12375	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
798	104849	1365	11.4	1870.0	25.6	0.013	0.111	2.342	32.838	402327	53.2	3.837	76	782.8	814.9	70.9	0.240	13121	7608	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
798	106504	1413	11.8	1829.6	25.3	0.013	0.114	2.292	32.439	408625	53.2	3.837	75	785.3	817.3	70.9	0.180	13367	12999	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
798	103881	1363	11.4	1874.0	25.1	0.013	0.112	2.347	32.234	398677	53.3	3.838	77	778.2	810.3	70.9	0.142	12866	12178	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
798	104484	1425	11.9	1858.4	25.8	0.014	0.117	2.328	33.128	401017	53.2	3.838	76	789.7	821.7	70.9	0.065	13079	8970	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
798	102381	1422	11.9	1868.3	25.8	0.014	0.119	2.341	33.149	392966	53.6	3.838	79	784.6	816.6	70.9	0.133	12850	8007	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
798	103690	1377	11.6	1877.9	25.5	0.013	0.115	2.353	32.698	397823	53.9	3.837	78	780.9	813.0	70.9	0.141	12946	10425	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
798	103388	1444	12.1	1846.0	25.8	0.014	0.120	2.312	33.146	396733	53.6	3.837	78	784.9	816.9	70.9	0.152	12882	12626	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

q500.1

q500.1: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
3992	86321	5880	47.6	10356.4	132.2	0.068	0.565	2.595	33.904	331144	61.0	3.836	106	782.4	814.5	70.9	0.027	10357	9717	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
3992	94240	5897	47.7	10233.2	131.0	0.063	0.518	2.564	33.597	329653	64.1	3.498	102	783.9	816.0	0.5	0.028	11699	10165	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
3992	90672	5907	47.9	10246.8	131.8	0.065	0.541	2.567	33.801	343621	61.0	3.790	101	785.5	817.6	70.9	0.028	11571	9813	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
3992	92306	5873	47.5	10381.5	131.5	0.064	0.527	2.600	33.728	331215	62.7	3.588	102	780.1	812.1	70.9	0.027	11475	10069	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
3992	89502	5918	48.0	10267.1	132.9	0.066	0.550	2.572	34.089	341505	60.1	3.816	101	789.9	822.0	70.9	0.028	11299	9669	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
3992	85287	5893	47.8	10311.1	132.5	0.069	0.573	2.583	33.999	311037	64.1	3.647	113	785.0	817.1	70.9	0.027	10441	9482	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
3992	83122	5883	47.7	10431.1	131.1	0.071	0.588	2.613	33.617	323629	61.6	3.893	111	782.1	814.1	70.9	0.027	10133	9577	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
3992	92147	5902	47.8	10298.9	133.0	0.064	0.532	2.580	34.124	307816	67.3	3.340	110	785.4	817.4	70.9	0.032	11369	10293	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

q1000.1

q1000.1: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
5880	60529	8738	71.2	15053.2	192.0	0.144	1.204	2.560	33.439	243176	51.9	4.017	129	785.4	817.4	70.9	0.028	9142	8758	4000m.pg152_o3_native_lto.cx7a28_gcp_c2s30
5735	73961	8424	68.8	14413.1	183.7	0.114	0.953	2.513	32.796	249896	63.2	3.379	128	786.4	818.5	70.9	0.036	10149	8614	4000m.pg153_o3_native_lto.cx7a28_gcp_c2s30
5135	79373	7504	61.5	12935.9	164.9	0.095	0.794	2.519	32.877	231731	62.9	2.920	119	787.0	819.1	70.9	0.032	12370	9478	4000m.pg154_o3_native_lto.cx7a28_gcp_c2s30
7059	68307	10495	85.1	18096.3	228.8	0.154	1.275	2.564	33.194	269206	59.3	3.941	130	784.4	816.5	70.9	0.028	8854	8407	4000m.pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
5074	74568	7425	60.9	12744.2	163.7	0.100	0.837	2.512	33.043	246082	61.8	3.300	124	791.0	823.0	70.9	0.028	10393	8535	4000m.pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
5124	70070	7440	61.0	12882.4	165.6	0.106	0.892	2.514	33.091	241610	60.0	3.448	128	786.7	818.7	70.9	0.046	9929	8503	4000m.pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
5666	57132	8381	68.4	14482.4	181.7	0.147	1.226	2.556	32.840	230832	49.2	4.040	129	785.4	817.5	70.9	0.058	9046	8790	4000m.pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
5734	67567	8488	69.3	14592.5	187.0	0.126	1.050	2.545	33.403	243003	60.0	3.596	133	787.6	819.6	70.9	0.036	8822	8474	4000m.pg160_o3_native_lto.cx7a28_gcp_c2s30

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	97.114	2.845	0.028	0.007	0.004	0.001	0.000	0.000	0.000	0.538	pg152_o3_native_lto.cx7a28_gcp_c2s30
0.000	97.313	2.649	0.027	0.007	0.004	0.001	0.000	0.000	0.000	0.525	pg153_o3_native_lto.cx7a28_gcp_c2s30
0.000	97.409	2.548	0.028	0.009	0.005	0.001	0.000	0.000	0.000	0.696	pg154_o3_native_lto.cx7a28_gcp_c2s30
0.000	97.286	2.670	0.030	0.009	0.004	0.001	0.000	0.000	0.000	0.466	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
0.000	97.373	2.592	0.026	0.006	0.003	nonzero	0.000	0.000	0.000	0.416	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
0.000	97.232	2.718	0.031	0.013	0.005	0.001	nonzero	0.000	0.000	1.448	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
0.000	97.412	2.547	0.028	0.008	0.004	nonzero	0.000	0.000	0.000	0.811	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
0.000	97.377	2.584	0.027	0.006	0.005	0.001	0.000	0.000	0.000	0.690	pg160_o3_native_lto.cx7a28_gcp_c2s30

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	30.695	47.324	21.911	0.068	0.003	nonzero	0.000	0.000	1.241	pg152_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	52.231	28.301	19.429	0.036	0.003	nonzero	0.000	0.000	1.463	pg153_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	41.984	37.245	20.725	0.044	0.001	nonzero	0.000	0.000	1.546	pg154_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	44.757	34.801	20.387	0.052	0.002	0.000	0.000	0.000	0.803	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	47.915	33.137	18.871	0.076	0.002	nonzero	0.000	0.000	1.316	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	50.419	30.719	18.796	0.065	0.002	nonzero	0.000	0.000	1.155	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	36.041	42.691	21.187	0.078	0.002	nonzero	0.000	0.000	1.162	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	58.391	26.671	14.872	0.064	0.002	nonzero	0.000	0.000	1.017	pg160_o3_native_lto.cx7a28_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
71.565	2.995	0.911	2.886	9.371	12.046	0.226	0.000	0.000	0.000	0.615	pg152_o3_native_lto.cx7a28_gcp_c2s30
74.442	2.078	0.707	2.575	7.937	12.171	0.090	nonzero	0.000	0.000	1.022	pg153_o3_native_lto.cx7a28_gcp_c2s30
74.205	2.617	0.658	2.274	9.413	10.825	0.007	0.000	0.000	0.000	0.520	pg154_o3_native_lto.cx7a28_gcp_c2s30
71.824	4.034	1.028	3.241	10.021	9.736	0.116	0.000	0.000	0.000	0.581	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
73.262	4.446	0.567	1.836	7.565	12.226	0.098	0.000	0.000	0.000	0.777	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
75.352	3.728	0.492	1.727	7.371	11.321	0.008	0.000	0.000	0.000	0.601	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
70.858	3.870	0.493	1.692	10.647	12.438	0.002	0.000	0.000	0.000	0.458	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
76.342	1.408	0.666	2.112	7.509	11.770	0.192	0.000	0.000	0.000	0.893	pg160_o3_native_lto.cx7a28_gcp_c2s30

q100.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.898	0.101	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.072	pg152_o3_native_lto.cx7a28_gcp_c2s30
99.902	0.097	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.240	pg153_o3_native_lto.cx7a28_gcp_c2s30
99.902	0.097	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.180	pg154_o3_native_lto.cx7a28_gcp_c2s30
99.916	0.083	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.142	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
99.893	0.106	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.065	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
99.886	0.113	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.133	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
99.912	0.087	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.141	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
99.880	0.119	0.001	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.152	pg160_o3_native_lto.cx7a28_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	26.701	73.289	0.010	0.000	0.000	0.000	0.000	0.168	pg152_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.249	26.753	72.989	0.006	0.003	0.000	0.000	0.000	0.312	pg153_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	2.176	21.989	75.832	0.003	0.000	0.000	0.000	0.000	0.075	pg154_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	1.218	18.288	80.488	0.005	0.001	0.000	0.000	0.000	0.397	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	4.428	12.394	83.175	0.003	0.000	0.000	0.000	0.000	0.072	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	2.439	16.645	80.909	0.007	0.000	0.000	0.000	0.000	0.111	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	2.854	20.484	76.658	0.003	0.000	0.000	0.000	0.000	0.153	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.398	18.644	80.946	0.011	0.000	0.000	0.000	0.000	0.086	pg160_o3_native_lto.cx7a28_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
29.447	23.995	11.462	22.533	12.563	0.000	0.000	0.000	0.000	0.000	0.057	pg152_o3_native_lto.cx7a28_gcp_c2s30
40.579	27.175	17.924	14.317	0.004	0.000	0.000	0.000	0.000	0.000	0.020	pg153_o3_native_lto.cx7a28_gcp_c2s30
39.342	27.777	17.061	15.815	0.005	0.000	0.000	0.000	0.000	0.000	0.025	pg154_o3_native_lto.cx7a28_gcp_c2s30
31.410	25.569	22.406	20.607	0.008	0.000	0.000	0.000	0.000	0.000	0.024	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
36.299	30.667	16.444	16.586	0.005	0.000	0.000	0.000	0.000	0.000	0.021	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
31.831	22.773	16.046	16.846	12.503	0.001	0.000	0.000	0.000	0.000	0.083	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
46.854	29.552	5.736	5.358	12.499	0.001	0.000	0.000	0.000	0.000	0.086	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
30.747	25.500	11.155	20.067	12.531	0.001	0.000	0.000	0.000	0.000	0.076	pg160_o3_native_lto.cx7a28_gcp_c2s30

q500.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.868	0.129	0.003	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	pg152_o3_native_lto.cx7a28_gcp_c2s30
99.866	0.129	0.003	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	pg153_o3_native_lto.cx7a28_gcp_c2s30
99.859	0.138	0.002	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	pg154_o3_native_lto.cx7a28_gcp_c2s30
99.849	0.146	0.004	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
99.839	0.158	0.003	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
99.823	0.173	0.003	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
99.850	0.147	0.002	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.027	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
99.858	0.136	0.004	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.032	pg160_o3_native_lto.cx7a28_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	18.771	81.228	nonzero	0.000	0.000	0.000	0.000	0.102	pg152_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	19.583	80.416	0.001	0.000	0.000	0.000	0.000	0.135	pg153_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	24.995	75.005	0.000	0.000	0.000	0.000	0.000	0.056	pg154_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	15.242	84.758	nonzero	0.000	0.000	0.000	0.000	0.070	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	9.494	90.505	0.001	0.000	0.000	0.000	0.000	0.075	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	16.663	83.335	0.002	0.000	0.000	0.000	0.000	0.081	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	14.553	85.445	0.001	0.000	0.000	0.000	0.000	0.070	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	22.405	77.594	0.002	0.000	0.000	0.000	0.000	0.089	pg160_o3_native_lto.cx7a28_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
57.606	7.994	0.096	5.653	27.767	0.884	0.000	0.000	0.000	0.000	0.091	pg152_o3_native_lto.cx7a28_gcp_c2s30
34.679	6.998	0.185	8.902	49.191	0.045	0.000	0.000	0.000	0.000	0.085	pg153_o3_native_lto.cx7a28_gcp_c2s30
53.067	7.935	0.154	7.480	31.365	0.000	0.000	0.000	0.000	0.000	0.051	pg154_o3_native_lto.cx7a28_gcp_c2s30
37.141	8.836	0.182	9.970	43.863	0.008	0.000	0.000	0.000	0.000	0.077	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
55.916	10.452	0.161	7.285	26.186	0.000	0.000	0.000	0.000	0.000	0.055	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
41.764	8.375	0.154	7.140	38.368	4.199	0.000	0.000	0.000	0.000	0.112	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
67.136	8.033	0.138	2.802	14.635	7.256	0.000	0.000	0.000	0.000	0.113	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
20.662	6.882	0.122	9.142	60.292	2.901	0.000	0.000	0.000	0.000	0.117	pg160_o3_native_lto.cx7a28_gcp_c2s30

q1000.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.711	0.285	0.003	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	pg152_o3_native_lto.cx7a28_gcp_c2s30
99.683	0.311	0.005	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	pg153_o3_native_lto.cx7a28_gcp_c2s30
99.775	0.218	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.032	pg154_o3_native_lto.cx7a28_gcp_c2s30
99.675	0.319	0.004	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
99.728	0.266	0.005	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.028	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
99.675	0.320	0.004	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.046	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
99.703	0.293	0.003	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.058	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
99.691	0.302	0.006	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.036	pg160_o3_native_lto.cx7a28_gcp_c2s30

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	nonzero	11.878	88.120	0.001	0.000	0.000	0.000	0.000	0.122	pg152_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	22.964	77.036	0.001	0.000	0.000	0.000	0.000	0.123	pg153_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	39.580	60.419	0.001	0.000	0.000	0.000	0.000	0.081	pg154_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	9.823	90.177	nonzero	0.000	0.000	0.000	0.000	0.070	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	29.870	70.127	0.003	0.000	0.000	0.000	0.000	0.136	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	25.254	74.743	0.002	0.000	0.000	0.000	0.000	0.091	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.330	13.497	86.173	0.001	0.000	0.000	0.000	0.000	0.115	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
0.000	0.000	0.000	21.629	78.365	0.006	0.000	0.000	0.000	0.000	0.094	pg160_o3_native_lto.cx7a28_gcp_c2s30

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
66.965	22.554	0.147	0.023	1.164	9.147	0.000	0.000	0.000	0.000	0.177	pg152_o3_native_lto.cx7a28_gcp_c2s30
50.432	19.907	0.128	0.033	6.685	22.814	0.000	0.000	0.000	0.000	0.162	pg153_o3_native_lto.cx7a28_gcp_c2s30
44.573	15.619	0.141	0.026	12.457	27.184	0.000	0.000	0.000	0.000	0.206	pg154_o3_native_lto.cx7a28_gcp_c2s30
64.914	24.177	0.143	0.020	6.351	4.395	0.000	0.000	0.000	0.000	0.147	pg16beta1_o3_native_lto.cx7a28_gcp_c2s30
44.817	23.810	0.135	0.028	4.617	26.593	nonzero	0.000	0.000	0.000	0.324	pg16beta2_o3_native_lto.cx7a28_gcp_c2s30
52.125	19.486	0.129	0.028	1.839	26.393	0.000	0.000	0.000	0.000	0.202	pg16beta3_o3_native_lto.cx7a28_gcp_c2s30
72.021	18.287	0.144	0.024	2.179	7.345	0.000	0.000	0.000	0.000	0.153	pg16rc1_o3_native_lto.cx7a28_gcp_c2s30
55.086	20.747	0.127	0.024	7.659	16.357	0.000	0.000	0.000	0.000	0.208	pg160_o3_native_lto.cx7a28_gcp_c2s30