Introduction

This is a report for the insert benchmark with 800M docs and 1 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 8 AMD cores, 16G RAM and an NVMe SSD. It is described here as the Beelink. The benchmark was run with 1 client and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). There is 1 table. It loads 800M rows without secondary indexes, creates secondary indexes, then inserts 5M rows with a delete per insert to avoid growing the table. It then does 3 read+write tests for 1200s each that do queries as fast as possible with 100, 500 and then 1000 inserts/second/client concurrent with the queries and 1000 deletes/second to avoid growing the table. The database is larger than memory.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0 and l.i1, indexed docs (or rows) /s for l.x and queries/s for q100, q500, q1000. The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1q100.1q500.1q1000.1
my5621_rel.cy10a_bee 10108784918131510241132888
my5651_rel.cy10a_bee 9518185226130410261127880
my5710_rel.cy10a_bee 8620711800918239431109988
my5721_rel.cy10a_bee 8344611644618109411106983
my5732_rel.cy10a_bee 8283310762717619481087969
my5743_rel.cy10a_bee 8092210819517469261082970
my8013_rel.cy10a_bee 6581610566617309031046934
my8020_rel.cy10a_bee 6208310243217469791067975
my8027_rel.cy10a_bee 6086411384518369491039944
my8034_rel.cy10a_bee 5486610614217439291022924

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1q100.1q500.1q1000.1
my5621_rel.cy10a_bee 1.001.001.001.001.001.00
my5651_rel.cy10a_bee 0.941.000.991.001.000.99
my5710_rel.cy10a_bee 0.851.391.390.920.981.11
my5721_rel.cy10a_bee 0.831.371.380.920.981.11
my5732_rel.cy10a_bee 0.821.271.340.930.961.09
my5743_rel.cy10a_bee 0.801.271.330.900.961.09
my8013_rel.cy10a_bee 0.651.241.320.880.921.05
my8020_rel.cy10a_bee 0.611.211.330.960.941.10
my8027_rel.cy10a_bee 0.601.341.400.930.921.06
my8034_rel.cy10a_bee 0.541.251.330.910.901.04

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsq100.1q500.1q1000.1
my5621_rel.cy10a_bee100499998
my5651_rel.cy10a_bee100499998
my5710_rel.cy10a_bee100499998
my5721_rel.cy10a_bee100499998
my5732_rel.cy10a_bee100499998
my5743_rel.cy10a_bee100499998
my8013_rel.cy10a_bee100499998
my8020_rel.cy10a_bee100499998
my8027_rel.cy10a_bee100499998
my8034_rel.cy10a_bee100499997
target1005001000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee92.9816.8910.1070.0170.0040.176
my5651_rel.cy10a_bee83.65316.2050.0690.0700.0040.246
my5710_rel.cy10a_bee6.05593.6520.2860.0040.0030.135
my5721_rel.cy10a_bee0.65199.0470.2950.0050.0030.129
my5732_rel.cy10a_bee1.48498.1890.1890.1370.0030.136
my5743_rel.cy10a_bee0.33099.3380.1900.1400.0020.132
my8013_rel.cy10a_bee99.3350.4980.1640.003nonzero0.299
my8020_rel.cy10a_bee99.3020.5230.1710.0040.124
my8027_rel.cy10a_bee99.4550.3950.1460.0040.249
my8034_rel.cy10a_bee99.3580.4880.1500.0030.099

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
101087	0	886	3.5	491.7	36.1	0.009	0.035	0.005	0.366	12846	21.8	0.127	17	52.6	93.1	10.6	0.176	101587	85053	800m.my5621_rel.cy10a_bee
95181	0	834	3.3	461.3	34.0	0.009	0.035	0.005	0.366	12099	21.5	0.127	18	52.6	93.1	10.6	0.246	95630	77190	800m.my5651_rel.cy10a_bee
86207	0	0	0.0	431.3	30.9	0.000	0.000	0.005	0.367	9541	21.3	0.111	20	52.6	93.1	10.9	0.135	86477	74823	800m.my5710_rel.cy10a_bee
83446	0	0	0.0	419.7	29.9	0.000	0.000	0.005	0.367	9282	21.7	0.111	21	52.6	93.1	10.9	0.129	83718	72917	800m.my5721_rel.cy10a_bee
82833	0	0	0.0	416.6	29.7	0.000	0.000	0.005	0.367	9199	21.2	0.111	20	52.6	93.1	10.9	0.136	83143	72509	800m.my5732_rel.cy10a_bee
80922	0	0	0.0	407.1	29.0	0.000	0.000	0.005	0.367	9025	21.3	0.112	21	52.6	93.1	10.9	0.132	81108	72221	800m.my5743_rel.cy10a_bee
65816	0	0	0.0	369.9	25.6	0.000	0.000	0.006	0.398	53961	34.4	0.820	42	52.4	55.0	11.1	0.299	65829	59273	800m.my8013_rel.cy10a_bee
62083	0	0	0.0	388.9	23.5	0.000	0.000	0.006	0.387	17109	21.8	0.276	28	52.4	61.0	11.1	0.124	61978	54944	800m.my8020_rel.cy10a_bee
60864	0	0	0.0	377.9	23.0	0.000	0.000	0.006	0.387	7138	20.3	0.117	27	52.4	61.0	11.0	0.249	60934	54168	800m.my8027_rel.cy10a_bee
54866	0	0	0.0	341.2	20.9	0.000	0.000	0.006	0.390	6603	19.7	0.120	29	52.4	61.0	11.1	0.099	55039	49267	800m.my8034_rel.cy10a_bee

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
84918	0	559	80.9	699.7	102.5	0.007	0.975	0.008	1.236	1963	11.3	0.023	11	108.4	148.9	10.8	0.015	NA	NA	800m.my5621_rel.cy10a_bee
85226	0	559	81.2	701.0	102.9	0.007	0.976	0.008	1.236	1939	11.2	0.023	11	108.4	148.9	10.8	0.011	NA	NA	800m.my5651_rel.cy10a_bee
118009	0	718	110.7	981.7	132.8	0.006	0.961	0.008	1.152	6552	12.4	0.056	8	117.7	158.2	11.1	0.019	NA	NA	800m.my5710_rel.cy10a_bee
116446	0	702	109.2	975.0	131.1	0.006	0.960	0.008	1.153	6443	12.4	0.055	9	117.7	158.2	11.1	0.011	NA	NA	800m.my5721_rel.cy10a_bee
107627	0	656	101.0	899.5	121.1	0.006	0.961	0.008	1.152	6074	12.1	0.056	9	117.7	158.2	11.1	0.016	NA	NA	800m.my5732_rel.cy10a_bee
108195	0	656	101.5	897.5	121.6	0.006	0.960	0.008	1.151	6078	12.0	0.056	9	117.7	158.2	11.1	0.015	NA	NA	800m.my5743_rel.cy10a_bee
105666	0	623	99.0	752.8	118.5	0.006	0.960	0.007	1.149	9515	13.8	0.090	10	117.2	119.8	11.3	0.015	NA	NA	800m.my8013_rel.cy10a_bee
102432	0	610	96.1	827.4	114.9	0.006	0.960	0.008	1.148	6377	12.1	0.062	9	117.2	125.8	11.3	0.020	NA	NA	800m.my8020_rel.cy10a_bee
113845	0	1838	172.4	2205.6	153.3	0.016	1.550	0.019	1.378	8830	43.6	0.078	31	117.2	125.8	11.2	0.011	NA	NA	800m.my8027_rel.cy10a_bee
106142	0	1714	160.6	2062.4	142.8	0.016	1.550	0.019	1.378	8499	43.6	0.080	33	117.2	125.8	11.3	0.012	NA	NA	800m.my8034_rel.cy10a_bee

l.i1

l.i1: continue load after secondary indexes created. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee1.82887.64310.5270.0020.873
my5651_rel.cy10a_bee1.81587.16411.0160.0050.777
my5710_rel.cy10a_bee34.26860.1335.5960.0030.299
my5721_rel.cy10a_bee32.82261.6185.5570.0030.549
my5732_rel.cy10a_bee32.88960.7966.3120.0030.322
my5743_rel.cy10a_bee32.00661.5646.4280.0020.346
my8013_rel.cy10a_bee31.45761.7646.7760.0030.308
my8020_rel.cy10a_bee27.85665.6466.4960.0020.379
my8027_rel.cy10a_bee33.39760.8365.7660.0010.310
my8034_rel.cy10a_bee28.27365.4476.2790.0010.358

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee2.95191.0905.9550.0030.0010.733
my5651_rel.cy10a_bee3.29590.8455.8530.0060.0010.598
my5710_rel.cy10a_bee91.7568.0370.1990.0080.117
my5721_rel.cy10a_bee91.7598.0240.2060.0110.139
my5732_rel.cy10a_bee92.1317.6270.2380.0040.141
my5743_rel.cy10a_bee89.57410.1430.2760.0070.087
my8013_rel.cy10a_bee82.72615.2601.9760.0380.118
my8020_rel.cy10a_bee77.22721.4971.2500.0260.101
my8027_rel.cy10a_bee68.08831.5470.3590.0060.220
my8034_rel.cy10a_bee25.18774.4340.3770.0020.068

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1315	0	7588	118.0	9832.8	315.7	5.771	91.885	7.479	245.927	46337	14.7	35.245	894	146.1	186.7	10.5	0.873	1249	699	800m.my5621_rel.cy10a_bee
1304	0	7551	117.4	9869.9	314.1	5.790	92.183	7.568	246.645	45958	14.7	35.242	902	146.0	186.7	10.5	0.777	1249	649	800m.my5651_rel.cy10a_bee
1823	0	9116	142.4	12135.0	389.4	5.000	79.993	6.655	218.692	58191	22.9	31.914	1005	149.5	190.4	10.7	0.299	1698	749	800m.my5710_rel.cy10a_bee
1810	0	9166	143.2	12172.4	390.5	5.065	81.040	6.727	220.955	58720	22.9	32.449	1012	149.1	190.2	10.7	0.549	1698	749	800m.my5721_rel.cy10a_bee
1761	0	8896	139.0	11822.7	379.1	5.051	80.822	6.713	220.442	57149	22.3	32.450	1013	149.2	190.1	10.7	0.322	1599	699	800m.my5732_rel.cy10a_bee
1746	0	8824	137.9	11732.4	376.3	5.055	80.874	6.720	220.692	57680	22.4	33.039	1026	149.2	190.2	10.7	0.346	1599	699	800m.my5743_rel.cy10a_bee
1730	0	8713	136.1	12658.6	403.3	5.038	80.607	7.319	238.812	94914	34.0	54.879	1573	148.7	151.7	10.7	0.308	1598	749	800m.my8013_rel.cy10a_bee
1746	0	8907	139.2	14267.3	379.1	5.102	81.630	8.172	222.364	71840	17.9	41.150	820	148.4	157.4	10.5	0.379	1648	699	800m.my8020_rel.cy10a_bee
1836	0	9336	145.9	14956.3	397.7	5.086	81.382	8.148	221.896	65767	23.3	35.831	1016	148.4	157.4	10.7	0.310	1699	699	800m.my8027_rel.cy10a_bee
1743	0	8962	140.0	14525.6	397.6	5.143	82.283	8.335	233.629	60209	24.2	34.549	1111	148.2	157.2	10.7	0.358	1648	699	800m.my8034_rel.cy10a_bee

q100.1

q100.1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee28.91816.79452.7991.4800.0090.048
my5651_rel.cy10a_bee28.63617.04752.7821.5270.0090.048
my5710_rel.cy10a_bee12.00830.50155.3502.1300.0110.041
my5721_rel.cy10a_bee10.97031.39455.5492.0770.0100.046
my5732_rel.cy10a_bee9.24532.78855.9042.0530.0100.039
my5743_rel.cy10a_bee8.90632.90056.0172.1660.0110.046
my8013_rel.cy10a_bee15.89226.08155.4222.5900.0140.045
my8020_rel.cy10a_bee12.42929.79256.2721.4810.0270.051
my8027_rel.cy10a_bee3.68837.69056.9401.6600.022nonzero0.088
my8034_rel.cy10a_bee3.78537.29057.2211.6780.0250.060

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee0.91778.70820.3750.125
my5651_rel.cy10a_bee2.70860.87536.4170.125
my5710_rel.cy10a_bee21.70864.41713.8750.119
my5721_rel.cy10a_bee28.33359.37512.2920.105
my5732_rel.cy10a_bee40.08348.29211.6250.115
my5743_rel.cy10a_bee20.20865.00014.7920.104
my8013_rel.cy10a_bee37.75052.4179.8330.111
my8020_rel.cy10a_bee32.83364.4172.7500.110
my8027_rel.cy10a_bee38.87557.0424.0830.124
my8034_rel.cy10a_bee27.54269.0833.3750.121

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee9.54268.54221.9170.060
my5651_rel.cy10a_bee11.16767.70821.1250.052
my5710_rel.cy10a_bee52.75047.1670.0830.019
my5721_rel.cy10a_bee54.95845.0000.0420.018
my5732_rel.cy10a_bee56.62543.2500.1250.034
my5743_rel.cy10a_bee49.70849.9170.3750.036
my8013_rel.cy10a_bee69.66729.6250.7080.058
my8020_rel.cy10a_bee69.37530.1250.5000.038
my8027_rel.cy10a_bee40.20859.5420.2500.028
my8034_rel.cy10a_bee22.41776.1671.4170.042

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	1024	9884	154.4	5678.3	174.8	9.649	154.317	56.897	1793.718	39389	10.6	38.451	828	146.1	186.7	10.5	0.048	927	751	800m.my5621_rel.cy10a_bee
100	1026	9823	153.4	5659.0	172.6	9.574	153.116	56.704	1771.365	39216	10.5	38.222	819	146.0	186.7	10.5	0.048	911	751	800m.my5651_rel.cy10a_bee
100	943	11709	183.0	8438.2	241.6	12.419	198.696	84.721	2483.839	52656	16.7	55.844	1417	149.5	190.4	10.7	0.041	943	751	800m.my5710_rel.cy10a_bee
100	941	11483	179.4	8353.9	234.9	12.207	195.313	83.790	2413.037	52035	16.4	55.315	1395	149.1	190.2	10.7	0.046	927	783	800m.my5721_rel.cy10a_bee
100	948	11562	180.6	8016.4	236.3	12.201	195.214	80.325	2424.082	51507	16.6	54.356	1401	149.2	190.1	10.7	0.039	943	783	800m.my5732_rel.cy10a_bee
100	926	11453	178.9	8476.1	235.6	12.372	197.950	84.846	2415.415	52964	16.6	57.215	1435	149.2	190.2	10.7	0.046	927	799	800m.my5743_rel.cy10a_bee
100	903	11454	179.0	9544.8	281.9	12.685	202.958	95.735	2895.077	88273	29.6	97.756	2622	148.7	151.7	10.7	0.045	911	719	800m.my8013_rel.cy10a_bee
100	979	11641	181.9	9689.2	247.6	11.896	190.334	97.086	2540.620	59239	14.3	60.534	1169	148.4	157.4	10.5	0.051	975	815	800m.my8020_rel.cy10a_bee
100	949	11361	177.5	9569.9	244.8	11.974	191.592	95.795	2508.784	53723	17.4	56.622	1467	148.4	157.4	10.7	0.088	927	783	800m.my8027_rel.cy10a_bee
100	929	11196	174.9	9728.3	252.5	12.054	192.860	97.772	2598.095	52472	18.0	56.494	1550	148.2	157.2	10.7	0.060	927	704	800m.my8034_rel.cy10a_bee

q500.1

q500.1: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee32.56115.00851.6580.7680.0040.040
my5651_rel.cy10a_bee32.19115.22651.7900.7890.0040.042
my5710_rel.cy10a_bee14.76331.97952.2630.9900.0050.047
my5721_rel.cy10a_bee11.83834.71952.4990.9390.0040.040
my5732_rel.cy10a_bee10.00235.91053.1110.9720.0050.044
my5743_rel.cy10a_bee8.72537.03853.2700.9630.0040.052
my8013_rel.cy10a_bee12.32332.37954.2511.0410.0060.039
my8020_rel.cy10a_bee10.41634.49354.3320.7450.0130.047
my8027_rel.cy10a_bee4.12040.35654.6710.8400.014nonzero0.078
my8034_rel.cy10a_bee3.94440.33954.8470.8610.0100.049

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee1.62594.6583.7170.112
my5651_rel.cy10a_bee1.27594.2084.5170.127
my5710_rel.cy10a_bee49.61749.5080.8750.107
my5721_rel.cy10a_bee51.05048.2250.7250.095
my5732_rel.cy10a_bee64.02535.6750.3000.095
my5743_rel.cy10a_bee60.68339.0670.2500.088
my8013_rel.cy10a_bee40.75858.7580.4830.099
my8020_rel.cy10a_bee20.36779.5830.0500.090
my8027_rel.cy10a_bee46.97552.9170.1080.098
my8034_rel.cy10a_bee27.99272.0080.061

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee14.61780.0335.3420.0080.071
my5651_rel.cy10a_bee15.25079.0335.7000.0170.087
my5710_rel.cy10a_bee99.0170.9830.013
my5721_rel.cy10a_bee99.0170.9830.015
my5732_rel.cy10a_bee94.6585.3420.015
my5743_rel.cy10a_bee94.2835.7170.014
my8013_rel.cy10a_bee94.1335.2500.6170.052
my8020_rel.cy10a_bee91.4838.3420.1750.032
my8027_rel.cy10a_bee98.3001.7000.014
my8034_rel.cy10a_bee90.1259.8080.0670.026

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	1132	9376	146.3	4071.5	125.5	8.279	132.264	8.164	257.719	34456	10.4	30.425	735	146.1	186.7	10.5	0.040	1135	1054	800m.my5621_rel.cy10a_bee
499	1127	9338	145.7	4104.8	125.2	8.288	132.405	8.224	256.931	34312	10.4	30.451	738	146.0	186.7	10.5	0.042	1119	1055	800m.my5651_rel.cy10a_bee
499	1109	9338	145.9	4360.8	133.4	8.420	134.713	8.744	274.013	36054	11.6	32.507	837	149.5	190.4	10.7	0.047	1103	1052	800m.my5710_rel.cy10a_bee
499	1106	9301	145.3	4308.5	131.9	8.409	134.541	8.632	270.532	35848	11.6	32.409	839	149.1	190.2	10.7	0.040	1103	1039	800m.my5721_rel.cy10a_bee
499	1087	9223	144.1	4295.7	131.9	8.484	135.736	8.614	270.907	35553	11.6	32.701	854	149.2	190.1	10.7	0.044	1087	1023	800m.my5732_rel.cy10a_bee
499	1082	9203	143.8	4318.6	132.6	8.503	136.046	8.660	272.236	35900	11.7	33.170	865	149.2	190.2	10.7	0.052	1087	1023	800m.my5743_rel.cy10a_bee
499	1046	9079	141.9	4948.4	151.8	8.678	138.855	9.915	311.455	48708	15.9	46.557	1216	148.7	151.7	10.7	0.039	1055	974	800m.my8013_rel.cy10a_bee
499	1067	9146	142.9	5391.5	137.6	8.572	137.148	10.802	282.377	38075	11.2	35.684	840	148.4	157.4	10.5	0.047	1071	991	800m.my8020_rel.cy10a_bee
499	1039	9008	140.7	5353.3	136.8	8.672	138.757	10.734	280.861	37179	12.4	35.794	955	148.4	157.4	10.7	0.078	1039	975	800m.my8027_rel.cy10a_bee
499	1022	8905	139.1	5434.0	141.6	8.714	139.418	10.896	290.813	36638	12.9	35.850	1010	148.2	157.2	10.7	0.049	1023	959	800m.my8034_rel.cy10a_bee

q1000.1

q1000.1: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee22.00718.85556.8192.3090.0110.044
my5651_rel.cy10a_bee20.33620.39056.9182.3440.0110.044
my5710_rel.cy10a_bee13.36130.15354.5321.9430.0110.049
my5721_rel.cy10a_bee11.20032.05354.7881.9480.0100.043
my5732_rel.cy10a_bee9.78032.92255.3051.9820.0110.054
my5743_rel.cy10a_bee9.62533.11655.2482.0000.0110.043
my8013_rel.cy10a_bee14.02828.16555.4542.3390.0130.057
my8020_rel.cy10a_bee11.92730.20656.3351.4930.0390.051
my8027_rel.cy10a_bee3.85337.63756.8151.6610.034nonzero0.158
my8034_rel.cy10a_bee3.83237.23557.1641.7410.0290.049

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee12.85880.3086.8330.129
my5651_rel.cy10a_bee12.30481.1176.5790.131
my5710_rel.cy10a_bee70.18329.5170.3000.106
my5721_rel.cy10a_bee69.72929.9670.3040.126
my5732_rel.cy10a_bee72.85426.8960.2500.085
my5743_rel.cy10a_bee70.52529.2040.2710.095
my8013_rel.cy10a_bee60.33738.0121.6500.121
my8020_rel.cy10a_bee65.02133.2961.6830.120
my8027_rel.cy10a_bee84.97114.2500.7790.111
my8034_rel.cy10a_bee70.48727.6831.8290.139

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5621_rel.cy10a_bee7.02589.1543.8210.060
my5651_rel.cy10a_bee7.03789.0793.8830.052
my5710_rel.cy10a_bee96.7753.2000.0250.042
my5721_rel.cy10a_bee96.7923.1880.0210.031
my5732_rel.cy10a_bee96.2133.7580.0290.034
my5743_rel.cy10a_bee96.0753.9210.0040.016
my8013_rel.cy10a_bee96.7372.5250.7330.0040.083
my8020_rel.cy10a_bee93.8294.9421.2290.058
my8027_rel.cy10a_bee96.3123.4500.2370.059
my8034_rel.cy10a_bee74.46225.2330.3040.034

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	888	11453	178.5	7526.3	232.2	12.905	205.988	7.545	238.369	49378	15.6	55.637	1406	146.1	186.7	10.5	0.044	880	800	800m.my5621_rel.cy10a_bee
998	880	11408	177.8	7588.3	231.9	12.958	206.836	7.601	237.898	49126	15.5	55.800	1408	146.0	186.7	10.5	0.044	879	815	800m.my5651_rel.cy10a_bee
998	988	12060	188.4	7741.0	238.8	12.201	195.218	7.754	244.955	51964	17.0	52.573	1376	149.5	190.4	10.7	0.049	991	863	800m.my5710_rel.cy10a_bee
998	983	12018	187.8	7735.8	238.5	12.226	195.613	7.749	244.622	52008	17.1	52.907	1392	149.1	190.2	10.7	0.043	991	863	800m.my5721_rel.cy10a_bee
998	969	11944	186.6	7729.8	238.1	12.325	197.205	7.749	244.436	51956	17.1	53.613	1412	149.2	190.1	10.7	0.054	975	831	800m.my5732_rel.cy10a_bee
998	970	11944	186.6	7730.4	238.0	12.316	197.062	7.744	244.141	52646	17.3	54.286	1427	149.2	190.2	10.7	0.043	975	831	800m.my5743_rel.cy10a_bee
998	934	11777	184.0	8901.0	274.0	12.603	201.643	8.916	281.063	79967	26.4	85.572	2260	148.7	151.7	10.7	0.057	928	816	800m.my8013_rel.cy10a_bee
998	975	12007	187.6	9760.4	249.8	12.316	197.058	9.777	256.273	58512	15.7	60.019	1288	148.4	157.4	10.5	0.051	975	895	800m.my8020_rel.cy10a_bee
998	944	11858	185.3	9752.3	249.8	12.565	201.034	9.769	256.242	55493	17.8	58.798	1509	148.4	157.4	10.7	0.158	943	863	800m.my8027_rel.cy10a_bee
997	924	11733	183.3	9965.3	260.2	12.691	203.058	9.999	267.303	54779	19.0	59.253	1644	148.2	157.2	10.7	0.049	927	847	800m.my8034_rel.cy10a_bee

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
101087	0	886	3.5	491.7	36.1	0.009	0.035	0.005	0.366	12846	21.8	0.127	17	52.6	93.1	10.6	0.176	101587	85053	800m.my5621_rel.cy10a_bee
95181	0	834	3.3	461.3	34.0	0.009	0.035	0.005	0.366	12099	21.5	0.127	18	52.6	93.1	10.6	0.246	95630	77190	800m.my5651_rel.cy10a_bee
86207	0	0	0.0	431.3	30.9	0.000	0.000	0.005	0.367	9541	21.3	0.111	20	52.6	93.1	10.9	0.135	86477	74823	800m.my5710_rel.cy10a_bee
83446	0	0	0.0	419.7	29.9	0.000	0.000	0.005	0.367	9282	21.7	0.111	21	52.6	93.1	10.9	0.129	83718	72917	800m.my5721_rel.cy10a_bee
82833	0	0	0.0	416.6	29.7	0.000	0.000	0.005	0.367	9199	21.2	0.111	20	52.6	93.1	10.9	0.136	83143	72509	800m.my5732_rel.cy10a_bee
80922	0	0	0.0	407.1	29.0	0.000	0.000	0.005	0.367	9025	21.3	0.112	21	52.6	93.1	10.9	0.132	81108	72221	800m.my5743_rel.cy10a_bee
65816	0	0	0.0	369.9	25.6	0.000	0.000	0.006	0.398	53961	34.4	0.820	42	52.4	55.0	11.1	0.299	65829	59273	800m.my8013_rel.cy10a_bee
62083	0	0	0.0	388.9	23.5	0.000	0.000	0.006	0.387	17109	21.8	0.276	28	52.4	61.0	11.1	0.124	61978	54944	800m.my8020_rel.cy10a_bee
60864	0	0	0.0	377.9	23.0	0.000	0.000	0.006	0.387	7138	20.3	0.117	27	52.4	61.0	11.0	0.249	60934	54168	800m.my8027_rel.cy10a_bee
54866	0	0	0.0	341.2	20.9	0.000	0.000	0.006	0.390	6603	19.7	0.120	29	52.4	61.0	11.1	0.099	55039	49267	800m.my8034_rel.cy10a_bee

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
84918	0	559	80.9	699.7	102.5	0.007	0.975	0.008	1.236	1963	11.3	0.023	11	108.4	148.9	10.8	0.015	NA	NA	800m.my5621_rel.cy10a_bee
85226	0	559	81.2	701.0	102.9	0.007	0.976	0.008	1.236	1939	11.2	0.023	11	108.4	148.9	10.8	0.011	NA	NA	800m.my5651_rel.cy10a_bee
118009	0	718	110.7	981.7	132.8	0.006	0.961	0.008	1.152	6552	12.4	0.056	8	117.7	158.2	11.1	0.019	NA	NA	800m.my5710_rel.cy10a_bee
116446	0	702	109.2	975.0	131.1	0.006	0.960	0.008	1.153	6443	12.4	0.055	9	117.7	158.2	11.1	0.011	NA	NA	800m.my5721_rel.cy10a_bee
107627	0	656	101.0	899.5	121.1	0.006	0.961	0.008	1.152	6074	12.1	0.056	9	117.7	158.2	11.1	0.016	NA	NA	800m.my5732_rel.cy10a_bee
108195	0	656	101.5	897.5	121.6	0.006	0.960	0.008	1.151	6078	12.0	0.056	9	117.7	158.2	11.1	0.015	NA	NA	800m.my5743_rel.cy10a_bee
105666	0	623	99.0	752.8	118.5	0.006	0.960	0.007	1.149	9515	13.8	0.090	10	117.2	119.8	11.3	0.015	NA	NA	800m.my8013_rel.cy10a_bee
102432	0	610	96.1	827.4	114.9	0.006	0.960	0.008	1.148	6377	12.1	0.062	9	117.2	125.8	11.3	0.020	NA	NA	800m.my8020_rel.cy10a_bee
113845	0	1838	172.4	2205.6	153.3	0.016	1.550	0.019	1.378	8830	43.6	0.078	31	117.2	125.8	11.2	0.011	NA	NA	800m.my8027_rel.cy10a_bee
106142	0	1714	160.6	2062.4	142.8	0.016	1.550	0.019	1.378	8499	43.6	0.080	33	117.2	125.8	11.3	0.012	NA	NA	800m.my8034_rel.cy10a_bee

l.i1

l.i1: continue load after secondary indexes created

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1315	0	7588	118.0	9832.8	315.7	5.771	91.885	7.479	245.927	46337	14.7	35.245	894	146.1	186.7	10.5	0.873	1249	699	800m.my5621_rel.cy10a_bee
1304	0	7551	117.4	9869.9	314.1	5.790	92.183	7.568	246.645	45958	14.7	35.242	902	146.0	186.7	10.5	0.777	1249	649	800m.my5651_rel.cy10a_bee
1823	0	9116	142.4	12135.0	389.4	5.000	79.993	6.655	218.692	58191	22.9	31.914	1005	149.5	190.4	10.7	0.299	1698	749	800m.my5710_rel.cy10a_bee
1810	0	9166	143.2	12172.4	390.5	5.065	81.040	6.727	220.955	58720	22.9	32.449	1012	149.1	190.2	10.7	0.549	1698	749	800m.my5721_rel.cy10a_bee
1761	0	8896	139.0	11822.7	379.1	5.051	80.822	6.713	220.442	57149	22.3	32.450	1013	149.2	190.1	10.7	0.322	1599	699	800m.my5732_rel.cy10a_bee
1746	0	8824	137.9	11732.4	376.3	5.055	80.874	6.720	220.692	57680	22.4	33.039	1026	149.2	190.2	10.7	0.346	1599	699	800m.my5743_rel.cy10a_bee
1730	0	8713	136.1	12658.6	403.3	5.038	80.607	7.319	238.812	94914	34.0	54.879	1573	148.7	151.7	10.7	0.308	1598	749	800m.my8013_rel.cy10a_bee
1746	0	8907	139.2	14267.3	379.1	5.102	81.630	8.172	222.364	71840	17.9	41.150	820	148.4	157.4	10.5	0.379	1648	699	800m.my8020_rel.cy10a_bee
1836	0	9336	145.9	14956.3	397.7	5.086	81.382	8.148	221.896	65767	23.3	35.831	1016	148.4	157.4	10.7	0.310	1699	699	800m.my8027_rel.cy10a_bee
1743	0	8962	140.0	14525.6	397.6	5.143	82.283	8.335	233.629	60209	24.2	34.549	1111	148.2	157.2	10.7	0.358	1648	699	800m.my8034_rel.cy10a_bee

q100.1

q100.1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
100	1024	9884	154.4	5678.3	174.8	9.649	154.317	56.897	1793.718	39389	10.6	38.451	828	146.1	186.7	10.5	0.048	927	751	800m.my5621_rel.cy10a_bee
100	1026	9823	153.4	5659.0	172.6	9.574	153.116	56.704	1771.365	39216	10.5	38.222	819	146.0	186.7	10.5	0.048	911	751	800m.my5651_rel.cy10a_bee
100	943	11709	183.0	8438.2	241.6	12.419	198.696	84.721	2483.839	52656	16.7	55.844	1417	149.5	190.4	10.7	0.041	943	751	800m.my5710_rel.cy10a_bee
100	941	11483	179.4	8353.9	234.9	12.207	195.313	83.790	2413.037	52035	16.4	55.315	1395	149.1	190.2	10.7	0.046	927	783	800m.my5721_rel.cy10a_bee
100	948	11562	180.6	8016.4	236.3	12.201	195.214	80.325	2424.082	51507	16.6	54.356	1401	149.2	190.1	10.7	0.039	943	783	800m.my5732_rel.cy10a_bee
100	926	11453	178.9	8476.1	235.6	12.372	197.950	84.846	2415.415	52964	16.6	57.215	1435	149.2	190.2	10.7	0.046	927	799	800m.my5743_rel.cy10a_bee
100	903	11454	179.0	9544.8	281.9	12.685	202.958	95.735	2895.077	88273	29.6	97.756	2622	148.7	151.7	10.7	0.045	911	719	800m.my8013_rel.cy10a_bee
100	979	11641	181.9	9689.2	247.6	11.896	190.334	97.086	2540.620	59239	14.3	60.534	1169	148.4	157.4	10.5	0.051	975	815	800m.my8020_rel.cy10a_bee
100	949	11361	177.5	9569.9	244.8	11.974	191.592	95.795	2508.784	53723	17.4	56.622	1467	148.4	157.4	10.7	0.088	927	783	800m.my8027_rel.cy10a_bee
100	929	11196	174.9	9728.3	252.5	12.054	192.860	97.772	2598.095	52472	18.0	56.494	1550	148.2	157.2	10.7	0.060	927	704	800m.my8034_rel.cy10a_bee

q500.1

q500.1: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
499	1132	9376	146.3	4071.5	125.5	8.279	132.264	8.164	257.719	34456	10.4	30.425	735	146.1	186.7	10.5	0.040	1135	1054	800m.my5621_rel.cy10a_bee
499	1127	9338	145.7	4104.8	125.2	8.288	132.405	8.224	256.931	34312	10.4	30.451	738	146.0	186.7	10.5	0.042	1119	1055	800m.my5651_rel.cy10a_bee
499	1109	9338	145.9	4360.8	133.4	8.420	134.713	8.744	274.013	36054	11.6	32.507	837	149.5	190.4	10.7	0.047	1103	1052	800m.my5710_rel.cy10a_bee
499	1106	9301	145.3	4308.5	131.9	8.409	134.541	8.632	270.532	35848	11.6	32.409	839	149.1	190.2	10.7	0.040	1103	1039	800m.my5721_rel.cy10a_bee
499	1087	9223	144.1	4295.7	131.9	8.484	135.736	8.614	270.907	35553	11.6	32.701	854	149.2	190.1	10.7	0.044	1087	1023	800m.my5732_rel.cy10a_bee
499	1082	9203	143.8	4318.6	132.6	8.503	136.046	8.660	272.236	35900	11.7	33.170	865	149.2	190.2	10.7	0.052	1087	1023	800m.my5743_rel.cy10a_bee
499	1046	9079	141.9	4948.4	151.8	8.678	138.855	9.915	311.455	48708	15.9	46.557	1216	148.7	151.7	10.7	0.039	1055	974	800m.my8013_rel.cy10a_bee
499	1067	9146	142.9	5391.5	137.6	8.572	137.148	10.802	282.377	38075	11.2	35.684	840	148.4	157.4	10.5	0.047	1071	991	800m.my8020_rel.cy10a_bee
499	1039	9008	140.7	5353.3	136.8	8.672	138.757	10.734	280.861	37179	12.4	35.794	955	148.4	157.4	10.7	0.078	1039	975	800m.my8027_rel.cy10a_bee
499	1022	8905	139.1	5434.0	141.6	8.714	139.418	10.896	290.813	36638	12.9	35.850	1010	148.2	157.2	10.7	0.049	1023	959	800m.my8034_rel.cy10a_bee

q1000.1

q1000.1: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
998	888	11453	178.5	7526.3	232.2	12.905	205.988	7.545	238.369	49378	15.6	55.637	1406	146.1	186.7	10.5	0.044	880	800	800m.my5621_rel.cy10a_bee
998	880	11408	177.8	7588.3	231.9	12.958	206.836	7.601	237.898	49126	15.5	55.800	1408	146.0	186.7	10.5	0.044	879	815	800m.my5651_rel.cy10a_bee
998	988	12060	188.4	7741.0	238.8	12.201	195.218	7.754	244.955	51964	17.0	52.573	1376	149.5	190.4	10.7	0.049	991	863	800m.my5710_rel.cy10a_bee
998	983	12018	187.8	7735.8	238.5	12.226	195.613	7.749	244.622	52008	17.1	52.907	1392	149.1	190.2	10.7	0.043	991	863	800m.my5721_rel.cy10a_bee
998	969	11944	186.6	7729.8	238.1	12.325	197.205	7.749	244.436	51956	17.1	53.613	1412	149.2	190.1	10.7	0.054	975	831	800m.my5732_rel.cy10a_bee
998	970	11944	186.6	7730.4	238.0	12.316	197.062	7.744	244.141	52646	17.3	54.286	1427	149.2	190.2	10.7	0.043	975	831	800m.my5743_rel.cy10a_bee
998	934	11777	184.0	8901.0	274.0	12.603	201.643	8.916	281.063	79967	26.4	85.572	2260	148.7	151.7	10.7	0.057	928	816	800m.my8013_rel.cy10a_bee
998	975	12007	187.6	9760.4	249.8	12.316	197.058	9.777	256.273	58512	15.7	60.019	1288	148.4	157.4	10.5	0.051	975	895	800m.my8020_rel.cy10a_bee
998	944	11858	185.3	9752.3	249.8	12.565	201.034	9.769	256.242	55493	17.8	58.798	1509	148.4	157.4	10.7	0.158	943	863	800m.my8027_rel.cy10a_bee
997	924	11733	183.3	9965.3	260.2	12.691	203.058	9.999	267.303	54779	19.0	59.253	1644	148.2	157.2	10.7	0.049	927	847	800m.my8034_rel.cy10a_bee

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	92.981	6.891	0.107	0.017	0.004	0.000	0.000	0.000	0.000	0.176	my5621_rel.cy10a_bee
0.000	83.653	16.205	0.069	0.070	0.004	0.000	0.000	0.000	0.000	0.246	my5651_rel.cy10a_bee
0.000	6.055	93.652	0.286	0.004	0.003	0.000	0.000	0.000	0.000	0.135	my5710_rel.cy10a_bee
0.000	0.651	99.047	0.295	0.005	0.003	0.000	0.000	0.000	0.000	0.129	my5721_rel.cy10a_bee
0.000	1.484	98.189	0.189	0.137	0.003	0.000	0.000	0.000	0.000	0.136	my5732_rel.cy10a_bee
0.000	0.330	99.338	0.190	0.140	0.002	0.000	0.000	0.000	0.000	0.132	my5743_rel.cy10a_bee
0.000	0.000	99.335	0.498	0.164	0.003	nonzero	0.000	0.000	0.000	0.299	my8013_rel.cy10a_bee
0.000	0.000	99.302	0.523	0.171	0.004	0.000	0.000	0.000	0.000	0.124	my8020_rel.cy10a_bee
0.000	0.000	99.455	0.395	0.146	0.004	0.000	0.000	0.000	0.000	0.249	my8027_rel.cy10a_bee
0.000	0.000	99.358	0.488	0.150	0.003	0.000	0.000	0.000	0.000	0.099	my8034_rel.cy10a_bee

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	1.828	87.643	10.527	0.002	0.000	0.000	0.000	0.873	my5621_rel.cy10a_bee
0.000	0.000	0.000	1.815	87.164	11.016	0.005	0.000	0.000	0.000	0.777	my5651_rel.cy10a_bee
0.000	0.000	0.000	34.268	60.133	5.596	0.003	0.000	0.000	0.000	0.299	my5710_rel.cy10a_bee
0.000	0.000	0.000	32.822	61.618	5.557	0.003	0.000	0.000	0.000	0.549	my5721_rel.cy10a_bee
0.000	0.000	0.000	32.889	60.796	6.312	0.003	0.000	0.000	0.000	0.322	my5732_rel.cy10a_bee
0.000	0.000	0.000	32.006	61.564	6.428	0.002	0.000	0.000	0.000	0.346	my5743_rel.cy10a_bee
0.000	0.000	0.000	31.457	61.764	6.776	0.003	0.000	0.000	0.000	0.308	my8013_rel.cy10a_bee
0.000	0.000	0.000	27.856	65.646	6.496	0.002	0.000	0.000	0.000	0.379	my8020_rel.cy10a_bee
0.000	0.000	0.000	33.397	60.836	5.766	0.001	0.000	0.000	0.000	0.310	my8027_rel.cy10a_bee
0.000	0.000	0.000	28.273	65.447	6.279	0.001	0.000	0.000	0.000	0.358	my8034_rel.cy10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	2.951	91.090	5.955	0.003	0.001	0.000	0.000	0.000	0.733	my5621_rel.cy10a_bee
0.000	0.000	3.295	90.845	5.853	0.006	0.001	0.000	0.000	0.000	0.598	my5651_rel.cy10a_bee
0.000	0.000	91.756	8.037	0.199	0.008	0.000	0.000	0.000	0.000	0.117	my5710_rel.cy10a_bee
0.000	0.000	91.759	8.024	0.206	0.011	0.000	0.000	0.000	0.000	0.139	my5721_rel.cy10a_bee
0.000	0.000	92.131	7.627	0.238	0.004	0.000	0.000	0.000	0.000	0.141	my5732_rel.cy10a_bee
0.000	0.000	89.574	10.143	0.276	0.007	0.000	0.000	0.000	0.000	0.087	my5743_rel.cy10a_bee
0.000	0.000	82.726	15.260	1.976	0.038	0.000	0.000	0.000	0.000	0.118	my8013_rel.cy10a_bee
0.000	0.000	77.227	21.497	1.250	0.026	0.000	0.000	0.000	0.000	0.101	my8020_rel.cy10a_bee
0.000	0.000	68.088	31.547	0.359	0.006	0.000	0.000	0.000	0.000	0.220	my8027_rel.cy10a_bee
0.000	0.000	25.187	74.434	0.377	0.002	0.000	0.000	0.000	0.000	0.068	my8034_rel.cy10a_bee

q100.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
28.918	16.794	52.799	1.480	0.009	0.000	0.000	0.000	0.000	0.000	0.048	my5621_rel.cy10a_bee
28.636	17.047	52.782	1.527	0.009	0.000	0.000	0.000	0.000	0.000	0.048	my5651_rel.cy10a_bee
12.008	30.501	55.350	2.130	0.011	0.000	0.000	0.000	0.000	0.000	0.041	my5710_rel.cy10a_bee
10.970	31.394	55.549	2.077	0.010	0.000	0.000	0.000	0.000	0.000	0.046	my5721_rel.cy10a_bee
9.245	32.788	55.904	2.053	0.010	0.000	0.000	0.000	0.000	0.000	0.039	my5732_rel.cy10a_bee
8.906	32.900	56.017	2.166	0.011	0.000	0.000	0.000	0.000	0.000	0.046	my5743_rel.cy10a_bee
15.892	26.081	55.422	2.590	0.014	0.000	0.000	0.000	0.000	0.000	0.045	my8013_rel.cy10a_bee
12.429	29.792	56.272	1.481	0.027	0.000	0.000	0.000	0.000	0.000	0.051	my8020_rel.cy10a_bee
3.688	37.690	56.940	1.660	0.022	nonzero	0.000	0.000	0.000	0.000	0.088	my8027_rel.cy10a_bee
3.785	37.290	57.221	1.678	0.025	0.000	0.000	0.000	0.000	0.000	0.060	my8034_rel.cy10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	0.917	78.708	20.375	0.000	0.000	0.000	0.000	0.125	my5621_rel.cy10a_bee
0.000	0.000	0.000	2.708	60.875	36.417	0.000	0.000	0.000	0.000	0.125	my5651_rel.cy10a_bee
0.000	0.000	0.000	21.708	64.417	13.875	0.000	0.000	0.000	0.000	0.119	my5710_rel.cy10a_bee
0.000	0.000	0.000	28.333	59.375	12.292	0.000	0.000	0.000	0.000	0.105	my5721_rel.cy10a_bee
0.000	0.000	0.000	40.083	48.292	11.625	0.000	0.000	0.000	0.000	0.115	my5732_rel.cy10a_bee
0.000	0.000	0.000	20.208	65.000	14.792	0.000	0.000	0.000	0.000	0.104	my5743_rel.cy10a_bee
0.000	0.000	0.000	37.750	52.417	9.833	0.000	0.000	0.000	0.000	0.111	my8013_rel.cy10a_bee
0.000	0.000	0.000	32.833	64.417	2.750	0.000	0.000	0.000	0.000	0.110	my8020_rel.cy10a_bee
0.000	0.000	0.000	38.875	57.042	4.083	0.000	0.000	0.000	0.000	0.124	my8027_rel.cy10a_bee
0.000	0.000	0.000	27.542	69.083	3.375	0.000	0.000	0.000	0.000	0.121	my8034_rel.cy10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	9.542	68.542	21.917	0.000	0.000	0.000	0.000	0.000	0.060	my5621_rel.cy10a_bee
0.000	0.000	11.167	67.708	21.125	0.000	0.000	0.000	0.000	0.000	0.052	my5651_rel.cy10a_bee
0.000	0.000	52.750	47.167	0.083	0.000	0.000	0.000	0.000	0.000	0.019	my5710_rel.cy10a_bee
0.000	0.000	54.958	45.000	0.042	0.000	0.000	0.000	0.000	0.000	0.018	my5721_rel.cy10a_bee
0.000	0.000	56.625	43.250	0.125	0.000	0.000	0.000	0.000	0.000	0.034	my5732_rel.cy10a_bee
0.000	0.000	49.708	49.917	0.375	0.000	0.000	0.000	0.000	0.000	0.036	my5743_rel.cy10a_bee
0.000	0.000	69.667	29.625	0.708	0.000	0.000	0.000	0.000	0.000	0.058	my8013_rel.cy10a_bee
0.000	0.000	69.375	30.125	0.500	0.000	0.000	0.000	0.000	0.000	0.038	my8020_rel.cy10a_bee
0.000	0.000	40.208	59.542	0.250	0.000	0.000	0.000	0.000	0.000	0.028	my8027_rel.cy10a_bee
0.000	0.000	22.417	76.167	1.417	0.000	0.000	0.000	0.000	0.000	0.042	my8034_rel.cy10a_bee

q500.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
32.561	15.008	51.658	0.768	0.004	0.000	0.000	0.000	0.000	0.000	0.040	my5621_rel.cy10a_bee
32.191	15.226	51.790	0.789	0.004	0.000	0.000	0.000	0.000	0.000	0.042	my5651_rel.cy10a_bee
14.763	31.979	52.263	0.990	0.005	0.000	0.000	0.000	0.000	0.000	0.047	my5710_rel.cy10a_bee
11.838	34.719	52.499	0.939	0.004	0.000	0.000	0.000	0.000	0.000	0.040	my5721_rel.cy10a_bee
10.002	35.910	53.111	0.972	0.005	0.000	0.000	0.000	0.000	0.000	0.044	my5732_rel.cy10a_bee
8.725	37.038	53.270	0.963	0.004	0.000	0.000	0.000	0.000	0.000	0.052	my5743_rel.cy10a_bee
12.323	32.379	54.251	1.041	0.006	0.000	0.000	0.000	0.000	0.000	0.039	my8013_rel.cy10a_bee
10.416	34.493	54.332	0.745	0.013	0.000	0.000	0.000	0.000	0.000	0.047	my8020_rel.cy10a_bee
4.120	40.356	54.671	0.840	0.014	nonzero	0.000	0.000	0.000	0.000	0.078	my8027_rel.cy10a_bee
3.944	40.339	54.847	0.861	0.010	0.000	0.000	0.000	0.000	0.000	0.049	my8034_rel.cy10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	1.625	94.658	3.717	0.000	0.000	0.000	0.000	0.112	my5621_rel.cy10a_bee
0.000	0.000	0.000	1.275	94.208	4.517	0.000	0.000	0.000	0.000	0.127	my5651_rel.cy10a_bee
0.000	0.000	0.000	49.617	49.508	0.875	0.000	0.000	0.000	0.000	0.107	my5710_rel.cy10a_bee
0.000	0.000	0.000	51.050	48.225	0.725	0.000	0.000	0.000	0.000	0.095	my5721_rel.cy10a_bee
0.000	0.000	0.000	64.025	35.675	0.300	0.000	0.000	0.000	0.000	0.095	my5732_rel.cy10a_bee
0.000	0.000	0.000	60.683	39.067	0.250	0.000	0.000	0.000	0.000	0.088	my5743_rel.cy10a_bee
0.000	0.000	0.000	40.758	58.758	0.483	0.000	0.000	0.000	0.000	0.099	my8013_rel.cy10a_bee
0.000	0.000	0.000	20.367	79.583	0.050	0.000	0.000	0.000	0.000	0.090	my8020_rel.cy10a_bee
0.000	0.000	0.000	46.975	52.917	0.108	0.000	0.000	0.000	0.000	0.098	my8027_rel.cy10a_bee
0.000	0.000	0.000	27.992	72.008	0.000	0.000	0.000	0.000	0.000	0.061	my8034_rel.cy10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	14.617	80.033	5.342	0.008	0.000	0.000	0.000	0.000	0.071	my5621_rel.cy10a_bee
0.000	0.000	15.250	79.033	5.700	0.017	0.000	0.000	0.000	0.000	0.087	my5651_rel.cy10a_bee
0.000	0.000	99.017	0.983	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5710_rel.cy10a_bee
0.000	0.000	99.017	0.983	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my5721_rel.cy10a_bee
0.000	0.000	94.658	5.342	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my5732_rel.cy10a_bee
0.000	0.000	94.283	5.717	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my5743_rel.cy10a_bee
0.000	0.000	94.133	5.250	0.617	0.000	0.000	0.000	0.000	0.000	0.052	my8013_rel.cy10a_bee
0.000	0.000	91.483	8.342	0.175	0.000	0.000	0.000	0.000	0.000	0.032	my8020_rel.cy10a_bee
0.000	0.000	98.300	1.700	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8027_rel.cy10a_bee
0.000	0.000	90.125	9.808	0.067	0.000	0.000	0.000	0.000	0.000	0.026	my8034_rel.cy10a_bee

q1000.1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
22.007	18.855	56.819	2.309	0.011	0.000	0.000	0.000	0.000	0.000	0.044	my5621_rel.cy10a_bee
20.336	20.390	56.918	2.344	0.011	0.000	0.000	0.000	0.000	0.000	0.044	my5651_rel.cy10a_bee
13.361	30.153	54.532	1.943	0.011	0.000	0.000	0.000	0.000	0.000	0.049	my5710_rel.cy10a_bee
11.200	32.053	54.788	1.948	0.010	0.000	0.000	0.000	0.000	0.000	0.043	my5721_rel.cy10a_bee
9.780	32.922	55.305	1.982	0.011	0.000	0.000	0.000	0.000	0.000	0.054	my5732_rel.cy10a_bee
9.625	33.116	55.248	2.000	0.011	0.000	0.000	0.000	0.000	0.000	0.043	my5743_rel.cy10a_bee
14.028	28.165	55.454	2.339	0.013	0.000	0.000	0.000	0.000	0.000	0.057	my8013_rel.cy10a_bee
11.927	30.206	56.335	1.493	0.039	0.000	0.000	0.000	0.000	0.000	0.051	my8020_rel.cy10a_bee
3.853	37.637	56.815	1.661	0.034	nonzero	0.000	0.000	0.000	0.000	0.158	my8027_rel.cy10a_bee
3.832	37.235	57.164	1.741	0.029	0.000	0.000	0.000	0.000	0.000	0.049	my8034_rel.cy10a_bee

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	0.000	12.858	80.308	6.833	0.000	0.000	0.000	0.000	0.129	my5621_rel.cy10a_bee
0.000	0.000	0.000	12.304	81.117	6.579	0.000	0.000	0.000	0.000	0.131	my5651_rel.cy10a_bee
0.000	0.000	0.000	70.183	29.517	0.300	0.000	0.000	0.000	0.000	0.106	my5710_rel.cy10a_bee
0.000	0.000	0.000	69.729	29.967	0.304	0.000	0.000	0.000	0.000	0.126	my5721_rel.cy10a_bee
0.000	0.000	0.000	72.854	26.896	0.250	0.000	0.000	0.000	0.000	0.085	my5732_rel.cy10a_bee
0.000	0.000	0.000	70.525	29.204	0.271	0.000	0.000	0.000	0.000	0.095	my5743_rel.cy10a_bee
0.000	0.000	0.000	60.337	38.012	1.650	0.000	0.000	0.000	0.000	0.121	my8013_rel.cy10a_bee
0.000	0.000	0.000	65.021	33.296	1.683	0.000	0.000	0.000	0.000	0.120	my8020_rel.cy10a_bee
0.000	0.000	0.000	84.971	14.250	0.779	0.000	0.000	0.000	0.000	0.111	my8027_rel.cy10a_bee
0.000	0.000	0.000	70.487	27.683	1.829	0.000	0.000	0.000	0.000	0.139	my8034_rel.cy10a_bee

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	7.025	89.154	3.821	0.000	0.000	0.000	0.000	0.000	0.060	my5621_rel.cy10a_bee
0.000	0.000	7.037	89.079	3.883	0.000	0.000	0.000	0.000	0.000	0.052	my5651_rel.cy10a_bee
0.000	0.000	96.775	3.200	0.025	0.000	0.000	0.000	0.000	0.000	0.042	my5710_rel.cy10a_bee
0.000	0.000	96.792	3.188	0.021	0.000	0.000	0.000	0.000	0.000	0.031	my5721_rel.cy10a_bee
0.000	0.000	96.213	3.758	0.029	0.000	0.000	0.000	0.000	0.000	0.034	my5732_rel.cy10a_bee
0.000	0.000	96.075	3.921	0.004	0.000	0.000	0.000	0.000	0.000	0.016	my5743_rel.cy10a_bee
0.000	0.000	96.737	2.525	0.733	0.004	0.000	0.000	0.000	0.000	0.083	my8013_rel.cy10a_bee
0.000	0.000	93.829	4.942	1.229	0.000	0.000	0.000	0.000	0.000	0.058	my8020_rel.cy10a_bee
0.000	0.000	96.312	3.450	0.237	0.000	0.000	0.000	0.000	0.000	0.059	my8027_rel.cy10a_bee
0.000	0.000	74.462	25.233	0.304	0.000	0.000	0.000	0.000	0.000	0.034	my8034_rel.cy10a_bee