Introduction

This is a report for the insert benchmark with 120M docs and 12 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.

The test server has 32 cores, 128G RAM and 1 NVMe devices. The benchmark was run with 8 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables with a table per client. It loads 10M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 16m+4m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is cached. Clients and the DBMS share one server.

The tested DBMS are:


Contents


Summary

The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my5651_rel_o2nofp.cz12a_c32r128 5882354347837331040336124089106971121066104368116670101387
my5744_rel_o2nofp.cz12a_c32r128 681818176470710073465217103047907421020658965110014288393
my8043_rel_o2nofp.cz12a_c32r128 821918210526518028278688881136845187400679128602866977
my8044_rel_o2nofp.cz12a_c32r128 810811203390017843977295874316759786728669198536566041
my8406_rel_o2nofp.cz12a_c32r128 805369210526517663376190872076695686479662788548165549
my8407_rel_o2nofp.cz12a_c32r128 805369210526517712277046863496690085754662708453365565
my8407_rel_o2nofp.cz12a_nocb_c32r128 816326210526518045177046863676745585753668568464666022
my9400_rel_o2nofp.cz12a_c32r128 800000206896717614776190886046850787881678588667166970
my9500_rel_o2nofp.cz12a_c32r128 794702210526516053580537888226880888253680808699367396
my9500_rel_o2nofp.cz13a_c32r128 800000210526517663376433873626825586846677088560066827

This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.

dbmsl.i0l.xl.i1l.i2qr100qp100qr500qp500qr1000qp1000
my5651_rel_o2nofp.cz12a_c32r128 1.001.001.001.001.001.001.001.001.001.00
my5744_rel_o2nofp.cz12a_c32r128 1.164.061.371.620.830.850.840.860.860.87
my8043_rel_o2nofp.cz12a_c32r128 1.404.842.461.950.710.640.720.650.740.66
my8044_rel_o2nofp.cz12a_c32r128 1.384.682.431.920.700.630.720.640.730.65
my8406_rel_o2nofp.cz12a_c32r128 1.374.842.411.890.700.630.710.640.730.65
my8407_rel_o2nofp.cz12a_c32r128 1.374.842.421.910.700.630.710.630.720.65
my8407_rel_o2nofp.cz12a_nocb_c32r128 1.394.842.461.910.700.630.710.640.730.65
my9400_rel_o2nofp.cz12a_c32r128 1.364.762.401.890.710.640.730.650.740.66
my9500_rel_o2nofp.cz12a_c32r128 1.354.842.192.000.720.640.730.650.750.66
my9500_rel_o2nofp.cz13a_c32r128 1.364.842.411.890.700.640.720.650.730.66

This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.

dbmsqr100.L1qp100.L2qr500.L3qp500.L4qr1000.L5qp1000.L6
my5651_rel_o2nofp.cz12a_c32r12811931193596059601192711920
my5744_rel_o2nofp.cz12a_c32r12811921193596459641192711927
my8043_rel_o2nofp.cz12a_c32r12811921192596059601192011927
my8044_rel_o2nofp.cz12a_c32r12811931193596059641192711920
my8406_rel_o2nofp.cz12a_c32r12811931192596059641192711927
my8407_rel_o2nofp.cz12a_c32r12811931192596059641192711927
my8407_rel_o2nofp.cz12a_nocb_c32r12811931193596459601192011927
my9400_rel_o2nofp.cz12a_c32r12811921192596459641192011920
my9500_rel_o2nofp.cz12a_c32r12811931193596459601192011927
my9500_rel_o2nofp.cz13a_c32r12811921193596459641192011920
target12001200600060001200012000

l.i0

l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1285.14994.6040.0630.1640.0200.183
my5744_rel_o2nofp.cz12a_c32r1284.31895.5070.1480.0060.0210.148
my8043_rel_o2nofp.cz12a_c32r1280.50999.3960.0710.0030.0210.164
my8044_rel_o2nofp.cz12a_c32r1280.33099.5760.0700.0030.0210.162
my8406_rel_o2nofp.cz12a_c32r1280.15499.7550.0660.0040.0210.148
my8407_rel_o2nofp.cz12a_c32r1280.13999.7650.0700.0040.0210.165
my8407_rel_o2nofp.cz12a_nocb_c32r1280.22199.6860.0680.0040.0210.160
my9400_rel_o2nofp.cz12a_c32r1280.43299.4730.0700.0040.0210.162
my9500_rel_o2nofp.cz12a_c32r1280.11499.7600.0990.0050.0220.165
my9500_rel_o2nofp.cz13a_c32r1280.18099.7150.0750.0070.0220.168

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
588235	0	0	0.0	1479.3	144.1	0.000	0.000	0.003	0.251	70945	40.5	0.121	22	8.0	108.5	15.0	0.183	50994	42695	my5651_rel_o2nofp.cz12a_c32r128
681818	0	0	0.0	2172.5	181.4	0.000	0.000	0.003	0.272	83139	41.9	0.122	20	8.0	108.5	16.3	0.148	62392	53093	my5744_rel_o2nofp.cz12a_c32r128
821918	0	0	0.0	2714.0	230.4	0.000	0.000	0.003	0.287	140609	46.5	0.171	18	8.0	108.6	16.6	0.164	80490	69092	my8043_rel_o2nofp.cz12a_c32r128
810811	0	1	0.0	2689.5	229.2	0.000	0.000	0.003	0.289	139911	47.0	0.173	19	8.0	108.6	16.5	0.162	78990	69192	my8044_rel_o2nofp.cz12a_c32r128
805369	0	0	0.0	2670.5	224.1	0.000	0.000	0.003	0.285	137296	45.6	0.170	18	8.0	114.2	16.5	0.148	78091	67092	my8406_rel_o2nofp.cz12a_c32r128
805369	0	1	0.0	2672.4	224.1	0.000	0.000	0.003	0.285	136973	46.1	0.170	18	8.0	114.2	16.5	0.165	78091	67591	my8407_rel_o2nofp.cz12a_c32r128
816326	0	1	0.0	2690.5	229.2	0.000	0.000	0.003	0.287	141105	47.2	0.173	19	8.0	114.2	16.5	0.160	78790	66892	my8407_rel_o2nofp.cz12a_nocb_c32r128
800000	0	0	0.0	2660.2	223.8	0.000	0.000	0.003	0.286	136631	45.7	0.171	18	8.0	114.2	16.5	0.162	78289	67192	my9400_rel_o2nofp.cz12a_c32r128
794702	0	1	0.0	2673.0	225.8	0.000	0.000	0.003	0.291	145325	46.8	0.183	19	8.0	114.2	16.6	0.165	77391	67191	my9500_rel_o2nofp.cz12a_c32r128
800000	0	1	0.0	2672.2	224.2	0.000	0.000	0.003	0.287	136076	45.9	0.170	18	8.0	114.2	16.7	0.168	78491	66892	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.717	3.366	0.000	0.000	0.547	4.841	2689.5	234673	132.2	6.452	0.643	92.25	1.097	18.54	0.000	0.000	0.984	16.76	23.72	0.484	1.723	9.978		my8044_rel_o2nofp.cz12a_c32r128
0.680	3.120	0.000	0.000	0.575	4.560	2672.4	229528	131.7	6.475	0.674	90.24	1.233	36.35	0.000	0.000	1.028	24.49	23.40	0.485	1.839	9.752		my8407_rel_o2nofp.cz12a_c32r128
0.752	3.421	0.000	0.000	0.492	4.560	2690.5	234663	133.8	6.570	0.676	91.83	1.193	18.92	0.000	0.000	0.885	13.25	23.99	0.488	1.782	9.936		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.720	3.680	0.000	0.000	0.552	5.267	2673.0	231227	129.9	6.371	0.605	90.98	0.793	24.69	0.000	0.000	0.983	23.40	23.61	0.485	1.592	9.837		my9500_rel_o2nofp.cz12a_c32r128
0.720	3.360	0.000	0.000	0.759	4.433	2672.2	229541	130.9	6.536	0.670	90.39	1.493	9631.9	0.000	0.000	1.076	4897.2	23.30	0.483	1.853	9.829		my9500_rel_o2nofp.cz13a_c32r128

l.x

l.x: create secondary indexes.

Average throughput:

Image

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
434783	0	0	0.0	10249.1	503.1	0.000	0.000	0.024	1.185	24790	31.2	0.057	23	16.7	117.2	23.9	0.001	NA	NA	my5651_rel_o2nofp.cz12a_c32r128
1764707	0	0	0.0	29014.1	1529.7	0.000	0.000	0.016	0.888	167293	34.0	0.095	6	18.2	118.8	24.3	0.018	NA	NA	my5744_rel_o2nofp.cz12a_c32r128
2105265	0	34	0.9	65674.3	2502.7	0.000	0.000	0.031	1.217	97922	73.1	0.047	11	18.2	118.8	16.8	0.010	NA	NA	my8043_rel_o2nofp.cz12a_c32r128
2033900	0	54	1.6	63224.8	2465.6	0.000	0.001	0.031	1.241	89008	74.1	0.044	12	18.2	118.8	16.8	0.007	NA	NA	my8044_rel_o2nofp.cz12a_c32r128
2105265	0	37	0.9	65755.9	2505.8	0.000	0.000	0.031	1.219	99874	73.2	0.047	11	18.2	124.4	16.9	0.003	NA	NA	my8406_rel_o2nofp.cz12a_c32r128
2105265	0	50	1.3	66028.0	2509.9	0.000	0.001	0.031	1.221	95406	73.8	0.045	11	18.2	124.4	16.9	0.004	NA	NA	my8407_rel_o2nofp.cz12a_c32r128
2105265	0	54	1.6	65301.5	2498.6	0.000	0.001	0.031	1.215	95937	73.6	0.046	11	18.2	124.4	16.9	0.007	NA	NA	my8407_rel_o2nofp.cz12a_nocb_c32r128
2068967	0	48	1.4	64874.8	2491.9	0.000	0.001	0.031	1.233	95514	72.4	0.046	11	18.2	124.4	16.8	0.004	NA	NA	my9400_rel_o2nofp.cz12a_c32r128
2105265	0	47	1.2	66840.0	2522.4	0.000	0.001	0.032	1.227	98125	72.6	0.047	11	18.2	124.4	17.1	0.011	NA	NA	my9500_rel_o2nofp.cz12a_c32r128
2105265	0	50	1.4	65118.9	2496.7	0.000	0.001	0.031	1.214	93632	71.5	0.044	11	18.2	124.4	17.1	0.005	NA	NA	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
53.72	1662.2	0.000	0.000	0.439	30.91	63224.8	2524744	701.0	1.555	0.483	45.03	119.3	350217	0.018	0.029	1.860	2551.0	46.42	0.710	25.45	84.43		my8044_rel_o2nofp.cz12a_c32r128
49.49	1297.2	0.000	0.000	0.356	26.18	66028.0	2570177	710.2	1.529	0.460	43.80	108.0	354673	0.000	0.000	1.854	2798.4	46.50	0.660	26.04	84.61		my8407_rel_o2nofp.cz12a_c32r128
54.12	1667.3	0.000	0.000	0.396	30.31	65301.5	2558597	712.6	1.525	0.396	44.09	117.9	354767	0.000	0.000	1.731	2617.5	46.89	0.625	21.67	84.59		my8407_rel_o2nofp.cz12a_nocb_c32r128
46.84	1195.4	0.000	0.000	0.308	27.07	66840.0	2582925	735.7	1.550	0.480	43.29	114.9	354756	0.018	0.014	1.850	2708.9	46.73	0.836	27.79	84.73		my9500_rel_o2nofp.cz12a_c32r128
50.41	1467.8	0.000	0.000	0.329	28.48	65118.9	2556648	722.7	1.502	0.456	43.36	125.4	354224	0.000	0.000	1.740	2561.9	46.64	0.763	25.94	85.03		my9500_rel_o2nofp.cz13a_c32r128

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r128nonzero0.54797.2781.7800.3390.0530.002nonzero7.892
my5744_rel_o2nofp.cz12a_c32r1280.01212.44786.9490.2060.1320.2470.007nonzero5.749
my8043_rel_o2nofp.cz12a_c32r12888.02811.6730.2100.0770.012nonzero1.291
my8044_rel_o2nofp.cz12a_c32r12887.96911.7410.2090.0690.0100.0012.050
my8406_rel_o2nofp.cz12a_c32r12888.04611.6360.2250.0790.0130.0011.356
my8407_rel_o2nofp.cz12a_c32r12888.03111.6470.2270.0820.0120.0012.097
my8407_rel_o2nofp.cz12a_nocb_c32r12888.51511.2090.1780.0840.014nonzero1.059
my9400_rel_o2nofp.cz12a_c32r12888.01711.6690.2200.0810.013nonzero1.410
my9500_rel_o2nofp.cz12a_c32r12883.20916.4490.2410.0840.0160.0011.373
my9500_rel_o2nofp.cz13a_c32r12888.14511.5290.2280.0820.0150.0011.653

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.0021.24996.7481.6400.3110.0490.002nonzero4.268
my5744_rel_o2nofp.cz12a_c32r1280.08217.66081.7100.1820.1440.2180.004nonzero5.766
my8043_rel_o2nofp.cz12a_c32r1280.00988.29111.4040.1930.0910.0110.0011.305
my8044_rel_o2nofp.cz12a_c32r1280.00588.25711.4550.1960.0750.0090.0012.050
my8406_rel_o2nofp.cz12a_c32r1280.00588.37411.3170.2060.0840.0130.0011.120
my8407_rel_o2nofp.cz12a_c32r1280.00788.34311.3350.2140.0880.0130.0012.038
my8407_rel_o2nofp.cz12a_nocb_c32r1280.01188.76310.9970.1320.0800.015nonzero1.068
my9400_rel_o2nofp.cz12a_c32r1280.01188.37111.3260.1990.0800.013nonzero1.305
my9500_rel_o2nofp.cz12a_c32r1280.01983.67716.0760.1520.0640.0130.0011.322
my9500_rel_o2nofp.cz13a_c32r1280.01588.46111.1980.2220.0870.0160.0011.471

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
73310	0	1232	4.8	3521.7	150.4	0.017	0.067	0.048	2.101	110840	73.5	1.512	321	30.2	132.2	37.8	7.892	6549	200	my5651_rel_o2nofp.cz12a_c32r128
100734	0	0	0.0	4495.2	186.7	0.000	0.000	0.045	1.898	47808	76.4	0.475	243	30.7	132.7	39.3	5.749	9995	0	my5744_rel_o2nofp.cz12a_c32r128
180282	0	543	8.5	7521.2	330.2	0.003	0.048	0.042	1.875	210756	67.7	1.169	120	31.0	133.9	44.0	1.291	18148	2700	my8043_rel_o2nofp.cz12a_c32r128
178439	0	538	8.4	7422.6	325.0	0.003	0.048	0.042	1.865	208681	68.5	1.169	123	31.0	134.4	43.1	2.050	18248	2800	my8044_rel_o2nofp.cz12a_c32r128
176633	0	533	8.3	7418.7	324.7	0.003	0.048	0.042	1.882	207930	67.4	1.177	122	31.0	159.9	44.0	1.356	17948	2600	my8406_rel_o2nofp.cz12a_c32r128
177122	0	536	8.4	7462.9	327.1	0.003	0.048	0.042	1.891	208813	67.5	1.179	122	31.0	158.6	44.1	2.097	18148	2650	my8407_rel_o2nofp.cz12a_c32r128
180451	0	546	8.5	7518.2	330.0	0.003	0.048	0.042	1.872	211025	67.0	1.169	119	31.0	159.5	44.7	1.059	18548	2850	my8407_rel_o2nofp.cz12a_nocb_c32r128
176147	0	531	8.3	7378.9	322.2	0.003	0.048	0.042	1.873	207188	67.4	1.176	122	31.0	158.9	43.1	1.410	17893	3100	my9400_rel_o2nofp.cz12a_c32r128
160535	0	484	7.6	7264.3	316.9	0.003	0.048	0.045	2.022	226896	63.3	1.413	126	29.3	155.6	38.2	1.373	15288	2200	my9500_rel_o2nofp.cz12a_c32r128
176633	0	534	8.3	7427.1	324.9	0.003	0.048	0.042	1.883	206553	67.1	1.169	122	31.0	158.0	44.4	1.653	17948	2000	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
538.5	8613.7	0.000	0.000	0.701	9.924	7422.6	332750	81.41	1.056	4.940	45.55	0.581	4876.4	0.000	0.000	1.657	337.2	20.40	1.849	30.89	22.63		my8044_rel_o2nofp.cz12a_c32r128
536.0	8573.8	0.000	0.000	1.361	10.18	7462.9	334977	89.88	1.162	4.974	45.59	0.649	6741.9	0.000	0.000	1.360	442.6	20.37	1.765	33.54	23.70		my8407_rel_o2nofp.cz12a_c32r128
546.0	8732.9	0.000	0.000	0.919	10.25	7518.2	337879	91.99	1.177	4.644	45.73	0.727	6925.8	0.000	0.000	1.239	485.4	20.32	1.843	32.66	24.80		my8407_rel_o2nofp.cz12a_nocb_c32r128
484.4	7748.4	0.000	0.000	1.598	9.930	7264.3	324533	69.24	0.922	5.345	45.35	0.370	24.66	0.000	0.000	1.517	20.42	18.70	2.000	36.34	22.90		my9500_rel_o2nofp.cz12a_c32r128
533.6	8534.4	0.000	0.000	2.549	10.29	7427.1	332667	76.02	0.998	5.161	45.48	0.669	6742.2	0.000	0.000	1.336	555.2	19.72	1.887	35.22	24.22		my9500_rel_o2nofp.cz13a_c32r128

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.05930.59668.4930.2870.5560.0080.239
my5744_rel_o2nofp.cz12a_c32r1280.13586.62612.7830.0330.4170.0060.001nonzero1.226
my8043_rel_o2nofp.cz12a_c32r1280.06391.3157.9320.6710.0100.0080.0010.610
my8044_rel_o2nofp.cz12a_c32r1280.04990.8888.3220.7210.0120.0080.0010.472
my8406_rel_o2nofp.cz12a_c32r1280.03390.6678.5630.7140.0130.0080.0020.961
my8407_rel_o2nofp.cz12a_c32r1280.01190.8328.4660.6710.0110.0070.0010.530
my8407_rel_o2nofp.cz12a_nocb_c32r1280.03591.0578.1650.7210.0130.0080.0020.941
my9400_rel_o2nofp.cz12a_c32r1280.06290.6858.4830.7470.0120.0080.0010.863
my9500_rel_o2nofp.cz12a_c32r1280.02292.9446.4830.5270.0140.0090.0020.925
my9500_rel_o2nofp.cz13a_c32r1280.04390.7688.4550.7110.0130.0080.0020.917

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.06631.65767.4280.2860.5560.0080.239
my5744_rel_o2nofp.cz12a_c32r1280.12283.90015.5210.0340.4170.0060.001nonzero1.226
my8043_rel_o2nofp.cz12a_c32r1280.06091.9457.3440.6350.0090.0070.0010.594
my8044_rel_o2nofp.cz12a_c32r1280.06391.5397.6940.6840.0110.0080.0010.485
my8406_rel_o2nofp.cz12a_c32r1280.03991.3217.9460.6740.0110.0070.0020.977
my8407_rel_o2nofp.cz12a_c32r1280.01691.4647.8700.6320.0100.0070.0020.541
my8407_rel_o2nofp.cz12a_nocb_c32r1280.04991.6457.6030.6830.0110.0070.0020.938
my9400_rel_o2nofp.cz12a_c32r1280.09091.2837.8990.7090.0100.0080.0010.876
my9500_rel_o2nofp.cz12a_c32r1280.05193.2466.1890.4920.0120.0090.0020.927
my9500_rel_o2nofp.cz13a_c32r1280.04691.4127.8490.6730.0110.0080.0020.919

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
40336	0	5558	21.7	3232.3	131.6	0.138	0.551	0.080	3.340	276703	67.6	6.860	536	30.2	132.2	38.0	0.239	3685	165	my5651_rel_o2nofp.cz12a_c32r128
65217	0	0	0.0	5030.0	209.1	0.000	0.000	0.077	3.284	282521	67.5	4.332	331	30.7	132.7	39.8	1.226	6284	180	my5744_rel_o2nofp.cz12a_c32r128
78688	0	0	0.0	5993.1	255.6	0.000	0.000	0.076	3.326	421347	67.0	5.355	272	31.0	132.4	44.0	0.610	7629	1125	my8043_rel_o2nofp.cz12a_c32r128
77295	0	0	0.0	5889.1	251.6	0.000	0.000	0.076	3.333	415098	66.8	5.370	277	31.0	132.0	43.1	0.472	7519	1130	my8044_rel_o2nofp.cz12a_c32r128
76190	0	0	0.0	5861.3	249.5	0.000	0.000	0.077	3.354	410095	65.6	5.383	276	31.0	165.8	44.1	0.961	7464	1100	my8406_rel_o2nofp.cz12a_c32r128
77046	0	0	0.0	5934.3	252.5	0.000	0.000	0.077	3.356	416881	66.8	5.411	277	31.0	166.3	44.1	0.530	7499	1120	my8407_rel_o2nofp.cz12a_c32r128
77046	0	0	0.0	5910.1	252.0	0.000	0.000	0.077	3.350	416948	66.1	5.412	275	31.0	165.7	44.9	0.941	7569	1125	my8407_rel_o2nofp.cz12a_nocb_c32r128
76190	0	0	0.0	5845.0	249.0	0.000	0.000	0.077	3.347	410083	65.4	5.382	275	31.0	165.6	43.2	0.863	7493	1095	my9400_rel_o2nofp.cz12a_c32r128
80537	0	0	0.0	6022.8	261.5	0.000	0.000	0.075	3.325	443544	67.8	5.507	269	29.3	164.8	38.5	0.925	7539	1090	my9500_rel_o2nofp.cz12a_c32r128
76433	0	0	0.0	5883.2	250.6	0.000	0.000	0.077	3.357	416022	66.4	5.443	278	31.0	165.8	44.4	0.917	7444	1120	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.061	0.245	0.000	0.000	0.294	0.968	5889.1	257614	4.824	0.082	4.380	43.79	0.568	5136.7	0.000	0.000	0.753	436.0	13.18	1.758	25.79	14.66		my8044_rel_o2nofp.cz12a_c32r128
0.084	0.335	0.000	0.000	0.880	1.226	5934.3	258554	4.721	0.078	4.921	43.58	0.381	3344.7	0.000	0.000	1.141	316.6	12.87	1.972	29.07	15.80		my8407_rel_o2nofp.cz12a_c32r128
0.123	0.490	0.000	0.000	0.892	1.419	5910.1	258082	4.868	0.081	5.165	43.72	0.513	6174.5	0.000	0.000	1.973	766.1	13.00	2.168	30.68	16.16		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.116	0.464	0.000	0.000	1.789	1.244	6022.8	267786	4.034	0.066	5.870	44.48	0.318	23.66	0.000	0.000	1.151	22.78	13.01	2.248	35.13	17.55		my9500_rel_o2nofp.cz12a_c32r128
0.074	0.294	0.000	0.000	0.627	1.024	5883.2	256608	4.482	0.076	5.137	43.68	0.306	3321.7	0.000	0.000	0.882	397.4	13.08	2.028	30.00	16.52		my9500_rel_o2nofp.cz13a_c32r128

qr100.L1

qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12899.9800.0090.011nonzero0.007
my5744_rel_o2nofp.cz12a_c32r12899.9950.005nonzerononzerononzero0.024
my8043_rel_o2nofp.cz12a_c32r12899.9880.012nonzero0.003
my8044_rel_o2nofp.cz12a_c32r12899.9880.012nonzero0.002
my8406_rel_o2nofp.cz12a_c32r12899.9870.012nonzerononzerononzerononzerononzero0.274
my8407_rel_o2nofp.cz12a_c32r12899.9880.012nonzerononzerononzerononzero0.111
my8407_rel_o2nofp.cz12a_nocb_c32r12899.9870.013nonzerononzero0.004
my9400_rel_o2nofp.cz12a_c32r12899.9890.011nonzerononzerononzerononzero0.215
my9500_rel_o2nofp.cz12a_c32r12899.9870.013nonzerononzero0.005
my9500_rel_o2nofp.cz13a_c32r12899.9880.012nonzero0.003

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12896.0073.9930.012
my5744_rel_o2nofp.cz12a_c32r12899.6090.3870.0050.020
my8043_rel_o2nofp.cz12a_c32r12899.2200.7800.005
my8044_rel_o2nofp.cz12a_c32r12899.2310.7660.0020.020
my8406_rel_o2nofp.cz12a_c32r12898.9680.8150.1370.0600.0210.315
my8407_rel_o2nofp.cz12a_c32r12899.1810.7430.0370.0390.152
my8407_rel_o2nofp.cz12a_nocb_c32r12898.8591.1410.014
my9400_rel_o2nofp.cz12a_c32r12899.1900.2290.3380.2310.0120.349
my9500_rel_o2nofp.cz12a_c32r12899.4350.5620.0020.017
my9500_rel_o2nofp.cz13a_c32r12899.0810.9170.0020.017

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1284.47792.7552.7690.013
my5744_rel_o2nofp.cz12a_c32r1283.40596.2870.3060.0020.038
my8043_rel_o2nofp.cz12a_c32r1280.01299.2180.7710.005
my8044_rel_o2nofp.cz12a_c32r1280.00599.2520.7410.0020.018
my8406_rel_o2nofp.cz12a_c32r1280.00299.0160.7890.1250.0560.0120.303
my8407_rel_o2nofp.cz12a_c32r1280.00599.2550.6780.0320.0300.168
my8407_rel_o2nofp.cz12a_nocb_c32r1280.02198.9261.0510.0020.017
my9400_rel_o2nofp.cz12a_c32r1280.00299.2570.2180.2780.2410.0050.344
my9500_rel_o2nofp.cz12a_c32r12899.5210.4770.0020.019
my9500_rel_o2nofp.cz13a_c32r1280.00599.1000.8940.0020.019

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1193	124089	37	0.1	3826.9	107.0	0.000	0.001	3.209	91.880	712210	39.1	5.739	101	30.2	132.2	38.0	0.007	10399	10143	my5651_rel_o2nofp.cz12a_c32r128
1192	103047	0	0.0	1437.2	40.6	0.000	0.000	1.206	34.898	591672	39.3	5.742	122	30.7	132.7	39.8	0.024	8671	8559	my5744_rel_o2nofp.cz12a_c32r128
1192	88113	0	0.0	1455.2	41.3	0.000	0.000	1.221	35.468	509590	38.9	5.783	141	31.0	132.4	44.0	0.003	7407	7311	my8043_rel_o2nofp.cz12a_c32r128
1193	87431	0	0.0	1446.6	41.0	0.000	0.000	1.213	35.236	505409	38.9	5.781	142	31.0	132.0	43.1	0.002	7327	7231	my8044_rel_o2nofp.cz12a_c32r128
1193	87207	0	0.0	1390.2	39.5	0.000	0.000	1.166	33.891	504028	39.0	5.780	143	31.0	166.0	44.1	0.274	7311	7215	my8406_rel_o2nofp.cz12a_c32r128
1193	86349	0	0.0	1394.3	39.6	0.000	0.000	1.169	33.986	499119	38.8	5.780	144	31.0	166.5	44.1	0.111	7199	7119	my8407_rel_o2nofp.cz12a_c32r128
1193	86367	0	0.0	1333.5	37.9	0.000	0.000	1.118	32.533	499108	39.0	5.779	144	31.0	165.9	44.9	0.004	7279	7199	my8407_rel_o2nofp.cz12a_nocb_c32r128
1192	88604	0	0.0	1415.8	40.2	0.000	0.000	1.188	34.504	512226	38.9	5.781	140	31.0	165.9	43.2	0.215	7439	7327	my9400_rel_o2nofp.cz12a_c32r128
1193	88822	0	0.0	1428.9	40.5	0.000	0.000	1.198	34.813	513198	38.9	5.778	140	29.3	165.0	38.6	0.005	7407	7311	my9500_rel_o2nofp.cz12a_c32r128
1192	87362	0	0.0	1493.5	42.3	0.000	0.000	1.253	36.368	505179	39.0	5.783	143	31.0	166.0	44.4	0.003	7359	7279	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.000	0.000	0.000	0.000	0.000	0.000	1446.6	42026.4	1.122	0.271	0.700	30.55	0.013	0.060	0.000	0.000	0.069	0.265	2.566	0.850	2.057	2.122		my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	0.000	0.000	0.000	0.000	1394.3	40534.5	1.341	0.377	0.598	30.91	0.011	0.137	0.000	0.000	0.065	0.409	2.318	0.566	1.216	6.236		my8407_rel_o2nofp.cz12a_c32r128
0.002	0.007	0.000	0.000	0.017	0.033	1333.5	38802.0	1.375	0.431	0.613	31.19	0.024	0.095	0.000	0.000	0.139	0.453	2.168	0.639	0.978	9.892		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.001	0.004	0.000	0.000	0.017	0.022	1428.9	41521.6	1.154	0.263	1.175	30.46	0.014	0.716	0.000	0.000	0.133	3.462	2.516	0.933	2.485	2.469		my9500_rel_o2nofp.cz12a_c32r128
0.002	0.007	0.000	0.000	0.000	0.022	1493.5	43350.9	1.143	0.305	1.128	30.79	0.012	0.049	0.000	0.000	0.072	0.221	2.362	0.888	3.211	3.223		my9500_rel_o2nofp.cz13a_c32r128

qp100.L2

qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12899.9570.0290.0140.004
my5744_rel_o2nofp.cz12a_c32r12899.9850.015nonzero0.002
my8043_rel_o2nofp.cz12a_c32r12899.9600.040nonzero0.002
my8044_rel_o2nofp.cz12a_c32r12899.9580.042nonzero0.002
my8406_rel_o2nofp.cz12a_c32r12899.9550.045nonzero0.001
my8407_rel_o2nofp.cz12a_c32r12899.9580.042nonzerononzero0.004
my8407_rel_o2nofp.cz12a_nocb_c32r12899.9610.039nonzero0.003
my9400_rel_o2nofp.cz12a_c32r12899.9560.044nonzero0.004
my9500_rel_o2nofp.cz12a_c32r12899.9610.039nonzero0.003
my9500_rel_o2nofp.cz13a_c32r12899.9600.039nonzero0.003

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12894.2155.7850.007
my5744_rel_o2nofp.cz12a_c32r12899.9980.0020.004
my8043_rel_o2nofp.cz12a_c32r12898.9611.0390.007
my8044_rel_o2nofp.cz12a_c32r12898.9651.0350.005
my8406_rel_o2nofp.cz12a_c32r12899.0720.9280.016
my8407_rel_o2nofp.cz12a_c32r12899.1230.8770.016
my8407_rel_o2nofp.cz12a_nocb_c32r12899.9880.0120.012
my9400_rel_o2nofp.cz12a_c32r12898.6761.3240.015
my9500_rel_o2nofp.cz12a_c32r12898.9980.9930.0090.022
my9500_rel_o2nofp.cz13a_c32r12899.3010.6940.0050.019

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1281.28295.2823.4350.006
my5744_rel_o2nofp.cz12a_c32r1281.25998.7380.0020.004
my8043_rel_o2nofp.cz12a_c32r12898.9931.0070.006
my8044_rel_o2nofp.cz12a_c32r12898.9771.0230.005
my8406_rel_o2nofp.cz12a_c32r12899.1160.8840.013
my8407_rel_o2nofp.cz12a_c32r12899.1320.8680.013
my8407_rel_o2nofp.cz12a_nocb_c32r12899.9930.0070.014
my9400_rel_o2nofp.cz12a_c32r12898.7151.2820.0020.017
my9500_rel_o2nofp.cz12a_c32r12899.0300.9610.0090.018
my9500_rel_o2nofp.cz13a_c32r12899.3470.6480.0050.020

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1193	106971	38	0.1	16.9	1.4	0.000	0.001	0.014	1.205	619294	38.0	5.789	114	30.2	132.2	38.0	0.004	8927	8783	my5651_rel_o2nofp.cz12a_c32r128
1193	90742	0	0.0	120.2	4.1	0.000	0.000	0.101	3.504	525488	38.9	5.791	137	30.7	132.7	39.8	0.002	7615	7535	my5744_rel_o2nofp.cz12a_c32r128
1192	68451	0	0.0	145.8	4.9	0.000	0.000	0.122	4.214	398209	37.8	5.817	177	31.0	132.4	44.0	0.002	5727	5679	my8043_rel_o2nofp.cz12a_c32r128
1193	67597	0	0.0	119.2	4.1	0.000	0.000	0.100	3.541	392995	38.1	5.814	180	31.0	132.0	43.1	0.002	5647	5583	my8044_rel_o2nofp.cz12a_c32r128
1192	66956	0	0.0	96.2	3.6	0.000	0.000	0.081	3.060	389343	38.0	5.815	182	31.0	166.2	44.1	0.001	5615	5567	my8406_rel_o2nofp.cz12a_c32r128
1192	66900	0	0.0	127.5	4.4	0.000	0.000	0.107	3.773	389156	38.0	5.817	182	31.0	166.7	44.1	0.004	5599	5551	my8407_rel_o2nofp.cz12a_c32r128
1193	67455	0	0.0	135.0	4.6	0.000	0.000	0.113	3.962	392267	38.5	5.815	183	31.0	166.2	44.9	0.003	5663	5599	my8407_rel_o2nofp.cz12a_nocb_c32r128
1192	68507	0	0.0	136.2	4.7	0.000	0.000	0.114	4.004	398400	38.2	5.815	178	31.0	166.1	43.2	0.004	5743	5695	my9400_rel_o2nofp.cz12a_c32r128
1193	68808	0	0.0	105.4	3.8	0.000	0.000	0.088	3.279	399983	38.1	5.813	177	29.3	165.2	38.6	0.003	5775	5711	my9500_rel_o2nofp.cz12a_c32r128
1193	68255	0	0.0	114.9	4.0	0.000	0.000	0.096	3.426	396756	38.5	5.813	180	31.0	166.3	44.4	0.003	5711	5647	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.000	0.000	0.000	0.000	0.000	0.000	119.2	4223.6	1.080	0.929	0.402	35.73	0.006	0.024	0.000	0.000	0.030	0.122	2.466	0.536	0.048	4.767		my8044_rel_o2nofp.cz12a_c32r128
0.001	0.002	0.000	0.000	0.008	0.011	127.5	4497.3	1.378	1.081	0.461	35.30	0.010	0.042	0.000	0.000	0.047	0.188	2.036	0.770	0.062	2.138		my8407_rel_o2nofp.cz12a_c32r128
0.001	0.004	0.000	0.000	0.011	0.022	135.0	4725.5	1.351	1.004	0.344	35.02	0.011	0.044	0.000	0.000	0.046	0.188	2.433	0.502	0.048	10.83		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.002	0.009	0.000	0.000	0.008	0.033	105.4	3910.5	1.181	1.167	0.429	37.61	0.023	1.242	0.000	0.000	0.107	6.092	2.493	0.543	0.047	4.336		my9500_rel_o2nofp.cz12a_c32r128
0.001	0.002	0.000	0.000	0.008	0.011	114.9	4085.8	1.119	0.970	0.448	35.55	0.020	0.082	0.000	0.000	0.099	0.387	2.328	0.506	0.053	10.10		my9500_rel_o2nofp.cz13a_c32r128

qr500.L3

qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12899.8920.0920.0150.0010.007
my5744_rel_o2nofp.cz12a_c32r12899.9880.011nonzerononzero0.004
my8043_rel_o2nofp.cz12a_c32r12899.9780.022nonzero0.002
my8044_rel_o2nofp.cz12a_c32r12899.9780.021nonzero0.003
my8406_rel_o2nofp.cz12a_c32r12899.9720.027nonzero0.004
my8407_rel_o2nofp.cz12a_c32r12899.9740.026nonzero0.004
my8407_rel_o2nofp.cz12a_nocb_c32r12899.9750.025nonzero0.003
my9400_rel_o2nofp.cz12a_c32r12899.9770.023nonzero0.003
my9500_rel_o2nofp.cz12a_c32r12899.9790.020nonzerononzero0.085
my9500_rel_o2nofp.cz13a_c32r12899.9770.023nonzerononzerononzerononzero0.101

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.00373.54226.4440.0110.023
my5744_rel_o2nofp.cz12a_c32r128nonzero99.6610.3340.0050.024
my8043_rel_o2nofp.cz12a_c32r12899.8590.1370.0040.020
my8044_rel_o2nofp.cz12a_c32r12899.9030.0880.008nonzero0.066
my8406_rel_o2nofp.cz12a_c32r12899.6780.3120.0040.0060.138
my8407_rel_o2nofp.cz12a_c32r12899.6230.3720.0050.021
my8407_rel_o2nofp.cz12a_nocb_c32r12899.6620.3340.0030.020
my9400_rel_o2nofp.cz12a_c32r12899.6560.3400.0030.022
my9500_rel_o2nofp.cz12a_c32r12899.6540.3330.0130.029
my9500_rel_o2nofp.cz13a_c32r12899.9380.0330.0220.0070.137

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.04681.53918.4090.0060.024
my5744_rel_o2nofp.cz12a_c32r1280.30399.5480.1440.0050.024
my8043_rel_o2nofp.cz12a_c32r1280.00799.8980.0940.0010.019
my8044_rel_o2nofp.cz12a_c32r12899.9290.0630.007nonzero0.064
my8406_rel_o2nofp.cz12a_c32r1280.00199.7790.2100.0040.0060.133
my8407_rel_o2nofp.cz12a_c32r12899.7320.2650.0030.019
my8407_rel_o2nofp.cz12a_nocb_c32r1280.00699.7590.2320.0020.019
my9400_rel_o2nofp.cz12a_c32r1280.00799.7730.2160.0040.024
my9500_rel_o2nofp.cz12a_c32r128nonzero99.7710.2170.0120.031
my9500_rel_o2nofp.cz13a_c32r1280.00199.9580.0220.0140.0050.123

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
5960	121066	176	0.7	954.2	31.4	0.001	0.006	0.160	5.390	692345	41.8	5.719	110	30.2	132.2	38.1	0.007	10110	9903	my5651_rel_o2nofp.cz12a_c32r128
5964	102065	0	0.0	555.6	20.3	0.000	0.000	0.093	3.483	585184	41.4	5.733	130	30.7	132.7	39.9	0.004	8607	8479	my5744_rel_o2nofp.cz12a_c32r128
5960	87400	0	0.0	582.9	21.2	0.000	0.000	0.098	3.647	505466	40.4	5.783	148	31.0	132.4	44.0	0.002	7343	7279	my8043_rel_o2nofp.cz12a_c32r128
5960	86728	0	0.0	576.2	21.0	0.000	0.000	0.097	3.611	501690	40.6	5.785	150	31.0	132.0	43.1	0.003	7263	7199	my8044_rel_o2nofp.cz12a_c32r128
5960	86479	0	0.0	624.7	22.4	0.000	0.000	0.105	3.848	499725	40.8	5.779	151	31.0	167.2	44.1	0.004	7263	7199	my8406_rel_o2nofp.cz12a_c32r128
5960	85754	0	0.0	567.3	20.8	0.000	0.000	0.095	3.570	495664	40.8	5.780	152	31.0	167.8	44.1	0.004	7183	7119	my8407_rel_o2nofp.cz12a_c32r128
5964	85753	0	0.0	565.1	20.7	0.000	0.000	0.095	3.553	495830	40.8	5.782	152	31.0	167.2	44.9	0.003	7183	7119	my8407_rel_o2nofp.cz12a_nocb_c32r128
5964	87881	0	0.0	594.0	21.5	0.000	0.000	0.100	3.698	508097	40.4	5.782	147	31.0	167.1	43.2	0.003	7359	7295	my9400_rel_o2nofp.cz12a_c32r128
5964	88253	0	0.0	583.1	21.2	0.000	0.000	0.098	3.647	510113	40.1	5.780	145	29.3	166.3	38.6	0.085	7423	7343	my9500_rel_o2nofp.cz12a_c32r128
5964	86846	0	0.0	588.3	21.3	0.000	0.000	0.099	3.665	501711	40.8	5.777	150	31.0	167.3	44.4	0.101	7263	7199	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.002	0.009	0.000	0.000	0.011	0.044	576.2	21521.5	1.183	0.269	0.739	39.60	0.023	0.270	0.000	0.000	0.077	0.915	2.535	0.645	0.408	2.040		my8044_rel_o2nofp.cz12a_c32r128
0.003	0.013	0.000	0.000	0.010	0.055	567.3	21276.6	1.522	0.337	1.119	39.80	0.059	2.276	0.000	0.000	0.286	5.702	2.540	0.848	0.606	2.317		my8407_rel_o2nofp.cz12a_c32r128
0.006	0.022	0.000	0.000	0.022	0.099	565.1	21186.6	1.506	0.333	0.931	39.69	0.076	5.635	0.000	0.000	0.196	6.275	2.607	0.684	0.601	1.566		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.003	0.013	0.000	0.000	0.011	0.066	583.1	21748.6	1.277	0.262	0.698	39.06	0.047	7.096	0.000	0.000	0.148	19.19	3.112	0.698	0.403	1.192		my9500_rel_o2nofp.cz12a_c32r128
0.003	0.011	0.000	0.000	0.003	0.055	588.3	21855.0	1.175	0.239	0.676	38.58	0.060	0.606	0.000	0.000	0.366	1.164	2.530	0.628	0.370	2.671		my9500_rel_o2nofp.cz13a_c32r128

qp500.L4

qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12899.8600.1250.015nonzero0.008
my5744_rel_o2nofp.cz12a_c32r12899.9600.040nonzerononzerononzero0.022
my8043_rel_o2nofp.cz12a_c32r12899.8830.117nonzero0.002
my8044_rel_o2nofp.cz12a_c32r12899.8780.122nonzero0.002
my8406_rel_o2nofp.cz12a_c32r12899.8490.151nonzerononzero0.006
my8407_rel_o2nofp.cz12a_c32r12899.8560.143nonzero0.002
my8407_rel_o2nofp.cz12a_nocb_c32r12899.8630.136nonzero0.003
my9400_rel_o2nofp.cz12a_c32r12899.8410.1580.001nonzero0.005
my9500_rel_o2nofp.cz12a_c32r12899.8780.121nonzero0.004
my9500_rel_o2nofp.cz13a_c32r12899.8760.124nonzero0.002

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.00375.66024.2940.0160.0180.0090.703
my5744_rel_o2nofp.cz12a_c32r12899.6120.3770.0060.0060.142
my8043_rel_o2nofp.cz12a_c32r12899.8180.1810.0020.021
my8044_rel_o2nofp.cz12a_c32r12899.7790.2190.0030.028
my8406_rel_o2nofp.cz12a_c32r12899.7280.2650.0070.025
my8407_rel_o2nofp.cz12a_c32r12899.8940.1040.0030.023
my8407_rel_o2nofp.cz12a_nocb_c32r12899.7530.2410.0060.023
my9400_rel_o2nofp.cz12a_c32r12899.3560.6330.0110.026
my9500_rel_o2nofp.cz12a_c32r12899.4830.5000.0160.061
my9500_rel_o2nofp.cz13a_c32r12899.8230.1690.0080.029

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.04983.95615.9620.0100.0150.0080.709
my5744_rel_o2nofp.cz12a_c32r1281.63498.1860.1720.0040.0040.141
my8043_rel_o2nofp.cz12a_c32r1280.00499.8460.1470.0020.018
my8044_rel_o2nofp.cz12a_c32r12899.8290.1680.0030.021
my8406_rel_o2nofp.cz12a_c32r128nonzero99.8080.1870.0050.023
my8407_rel_o2nofp.cz12a_c32r12899.9270.0690.0040.026
my8407_rel_o2nofp.cz12a_nocb_c32r12899.8550.1400.0050.025
my9400_rel_o2nofp.cz12a_c32r12899.6620.3320.0060.024
my9500_rel_o2nofp.cz12a_c32r12899.6490.3370.0140.060
my9500_rel_o2nofp.cz13a_c32r12899.8620.1310.0070.024

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
5960	104368	183	0.7	2406.9	71.6	0.002	0.007	0.404	12.297	604467	41.2	5.792	126	30.2	132.2	38.1	0.008	8719	8511	my5651_rel_o2nofp.cz12a_c32r128
5964	89651	0	0.0	603.1	21.6	0.000	0.000	0.101	3.710	519451	40.9	5.794	146	30.7	132.7	39.9	0.022	7535	7407	my5744_rel_o2nofp.cz12a_c32r128
5960	67912	0	0.0	659.6	23.4	0.000	0.000	0.111	4.015	398529	39.8	5.868	188	31.0	132.4	44.0	0.002	5679	5631	my8043_rel_o2nofp.cz12a_c32r128
5964	66919	0	0.0	632.4	22.6	0.000	0.000	0.106	3.878	392660	39.7	5.868	190	31.0	132.0	43.1	0.002	5599	5535	my8044_rel_o2nofp.cz12a_c32r128
5964	66278	0	0.0	657.3	23.3	0.000	0.000	0.110	3.999	388674	39.4	5.864	190	31.0	168.3	44.1	0.006	5535	5487	my8406_rel_o2nofp.cz12a_c32r128
5964	66270	0	0.0	625.6	22.4	0.000	0.000	0.105	3.847	388866	39.5	5.868	191	31.0	168.9	44.1	0.002	5551	5487	my8407_rel_o2nofp.cz12a_c32r128
5960	66856	0	0.0	632.2	22.6	0.000	0.000	0.106	3.884	392473	39.9	5.870	191	31.0	168.3	44.9	0.003	5599	5551	my8407_rel_o2nofp.cz12a_nocb_c32r128
5964	67858	0	0.0	645.9	22.9	0.000	0.000	0.108	3.938	397182	39.8	5.853	188	31.0	168.2	43.2	0.005	5695	5631	my9400_rel_o2nofp.cz12a_c32r128
5960	68080	0	0.0	635.8	22.8	0.000	0.000	0.107	3.912	399199	39.9	5.864	188	29.3	167.4	38.7	0.004	5711	5647	my9500_rel_o2nofp.cz12a_c32r128
5964	67708	0	0.0	638.6	22.8	0.000	0.000	0.107	3.910	397112	39.9	5.865	189	31.0	168.4	44.4	0.002	5663	5615	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.002	0.007	0.000	0.000	0.008	0.033	632.4	23124.4	1.311	0.223	0.552	37.11	0.048	0.482	0.000	0.000	0.130	1.276	2.517	0.559	0.346	2.756		my8044_rel_o2nofp.cz12a_c32r128
0.004	0.018	0.000	0.000	0.017	0.077	625.6	22941.4	1.685	0.288	0.622	37.32	0.050	1.752	0.000	0.000	0.152	4.250	2.512	0.534	0.392	2.964		my8407_rel_o2nofp.cz12a_c32r128
0.003	0.011	0.000	0.000	0.015	0.044	632.2	23150.7	1.632	0.277	0.737	37.27	0.081	6.895	0.000	0.000	0.227	8.698	2.536	0.643	0.480	2.717		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.007	0.029	0.000	0.000	0.041	0.122	635.8	23316.6	1.561	0.252	0.716	37.03	0.044	5.622	0.000	0.000	0.161	16.38	2.616	0.650	0.439	1.639		my9500_rel_o2nofp.cz12a_c32r128
0.004	0.018	0.000	0.000	0.022	0.077	638.6	23319.2	1.080	0.176	0.845	36.84	0.061	0.614	0.000	0.000	0.159	1.232	2.572	0.769	0.535	1.651		my9500_rel_o2nofp.cz13a_c32r128

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12899.6980.2750.0250.002nonzerononzerononzero0.629
my5744_rel_o2nofp.cz12a_c32r12899.9690.0290.002nonzerononzerononzero0.100
my8043_rel_o2nofp.cz12a_c32r12899.9390.0590.002nonzero0.007
my8044_rel_o2nofp.cz12a_c32r12899.9430.0560.001nonzero0.005
my8406_rel_o2nofp.cz12a_c32r12899.9360.0630.001nonzero0.005
my8407_rel_o2nofp.cz12a_c32r12899.9350.0640.001nonzero0.007
my8407_rel_o2nofp.cz12a_nocb_c32r12899.9290.0690.002nonzerononzerononzero0.166
my9400_rel_o2nofp.cz12a_c32r12899.9360.0630.002nonzero0.006
my9500_rel_o2nofp.cz12a_c32r12899.9540.046nonzerononzerononzero0.048
my9500_rel_o2nofp.cz13a_c32r12899.9410.0580.001nonzero0.004

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.01351.07548.8020.0800.0180.0120.654
my5744_rel_o2nofp.cz12a_c32r128nonzero98.6691.3220.0060.0030.400
my8043_rel_o2nofp.cz12a_c32r12899.5890.3990.0120.060
my8044_rel_o2nofp.cz12a_c32r12899.7750.2130.0120.056
my8406_rel_o2nofp.cz12a_c32r12899.6890.2960.0150.036
my8407_rel_o2nofp.cz12a_c32r12899.5070.4810.011nonzero0.066
my8407_rel_o2nofp.cz12a_nocb_c32r12899.3440.5490.0610.0470.199
my9400_rel_o2nofp.cz12a_c32r12899.6030.3830.0140.030
my9500_rel_o2nofp.cz12a_c32r12899.8860.1000.0130.0010.081
my9500_rel_o2nofp.cz13a_c32r12899.7790.2100.0110.039

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.03262.64637.2370.0590.0150.0110.790
my5744_rel_o2nofp.cz12a_c32r1280.75098.1761.0660.0050.0030.400
my8043_rel_o2nofp.cz12a_c32r1280.00199.7780.2120.0100.060
my8044_rel_o2nofp.cz12a_c32r1280.00299.8840.1030.0110.056
my8406_rel_o2nofp.cz12a_c32r12899.8640.1240.0130.041
my8407_rel_o2nofp.cz12a_c32r128nonzero99.7510.2400.0090.056
my8407_rel_o2nofp.cz12a_nocb_c32r1280.01099.5630.3420.0480.0370.194
my9400_rel_o2nofp.cz12a_c32r128nonzero99.7920.1970.0110.031
my9500_rel_o2nofp.cz12a_c32r128nonzero99.9520.0360.0110.0010.078
my9500_rel_o2nofp.cz13a_c32r12899.8970.0950.0090.038

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
11927	116670	358	1.4	1547.0	52.9	0.003	0.012	0.130	4.540	664509	45.8	5.696	126	30.2	132.2	38.2	0.629	9759	9503	my5651_rel_o2nofp.cz12a_c32r128
11927	100142	0	0.0	1001.0	37.8	0.000	0.000	0.084	3.248	572429	44.3	5.716	142	30.7	132.7	40.0	0.100	8431	8239	my5744_rel_o2nofp.cz12a_c32r128
11920	86028	0	0.0	1026.3	38.9	0.000	0.000	0.086	3.341	498422	42.7	5.794	159	31.0	132.4	44.0	0.007	7215	7135	my8043_rel_o2nofp.cz12a_c32r128
11927	85365	0	0.0	1045.4	39.4	0.000	0.000	0.088	3.384	495270	42.7	5.802	160	31.0	132.0	43.1	0.005	7167	7087	my8044_rel_o2nofp.cz12a_c32r128
11927	85481	0	0.0	1024.2	38.8	0.000	0.000	0.086	3.334	495582	42.7	5.798	160	31.0	170.4	44.1	0.005	7167	7103	my8406_rel_o2nofp.cz12a_c32r128
11927	84533	0	0.0	1022.5	38.8	0.000	0.000	0.086	3.329	490053	42.7	5.797	162	31.0	171.0	44.1	0.007	7087	7023	my8407_rel_o2nofp.cz12a_c32r128
11920	84646	0	0.0	1025.4	38.8	0.000	0.000	0.086	3.336	491290	42.7	5.804	161	31.0	170.4	44.9	0.166	7135	6959	my8407_rel_o2nofp.cz12a_nocb_c32r128
11920	86671	0	0.0	1021.7	38.8	0.000	0.000	0.086	3.332	501745	42.7	5.789	158	31.0	170.3	43.2	0.006	7247	7183	my9400_rel_o2nofp.cz12a_c32r128
11920	86993	0	0.0	1037.4	39.3	0.000	0.000	0.087	3.375	506089	42.7	5.818	157	29.3	169.5	38.8	0.048	7343	7247	my9500_rel_o2nofp.cz12a_c32r128
11920	85600	0	0.0	1027.9	39.0	0.000	0.000	0.086	3.346	497092	42.7	5.807	160	31.0	170.5	44.4	0.004	7167	7102	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.004	0.015	0.000	0.000	0.014	0.077	1045.4	40359.5	1.556	0.151	0.837	38.74	0.045	0.471	0.000	0.000	0.111	0.907	2.601	0.733	0.865	2.222		my8044_rel_o2nofp.cz12a_c32r128
0.005	0.020	0.000	0.000	0.054	0.088	1022.5	39704.8	1.803	0.179	1.192	39.00	0.072	3.308	0.000	0.000	0.264	6.807	2.831	0.782	1.153	1.890		my8407_rel_o2nofp.cz12a_c32r128
0.008	0.031	0.000	0.000	0.028	0.155	1025.4	39765.9	1.784	0.179	1.193	38.95	0.099	7.882	0.000	0.000	0.386	8.636	3.647	0.946	1.268	2.470		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.010	0.040	0.000	0.000	0.041	0.199	1037.4	40229.9	1.659	0.164	0.813	38.95	0.072	13.95	0.000	0.000	0.171	32.09	2.577	0.606	0.831	2.019		my9500_rel_o2nofp.cz12a_c32r128
0.006	0.024	0.000	0.000	0.014	0.122	1027.9	39888.4	1.287	0.128	0.939	39.00	0.084	1.138	0.000	0.000	0.159	1.858	2.635	0.664	0.976	1.979		my9500_rel_o2nofp.cz13a_c32r128

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.

Average throughput:

Image

Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r12899.7060.2730.0200.001nonzero0.017
my5744_rel_o2nofp.cz12a_c32r12899.9190.0790.002nonzero0.007
my8043_rel_o2nofp.cz12a_c32r12899.7160.2830.001nonzero0.006
my8044_rel_o2nofp.cz12a_c32r12899.6910.3070.002nonzero0.006
my8406_rel_o2nofp.cz12a_c32r12899.6430.3550.002nonzero0.005
my8407_rel_o2nofp.cz12a_c32r12899.6620.3360.002nonzero0.009
my8407_rel_o2nofp.cz12a_nocb_c32r12899.6760.3220.002nonzero0.005
my9400_rel_o2nofp.cz12a_c32r12899.6840.3140.001nonzero0.004
my9500_rel_o2nofp.cz12a_c32r12899.7540.2450.001nonzero0.005
my9500_rel_o2nofp.cz13a_c32r12899.7170.2820.001nonzero0.006

Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.07368.10231.6630.1550.0060.0010.727
my5744_rel_o2nofp.cz12a_c32r1280.00198.6341.3560.0090.052
my8043_rel_o2nofp.cz12a_c32r12899.8030.1880.0090.0010.068
my8044_rel_o2nofp.cz12a_c32r12899.5710.4190.0100.032
my8406_rel_o2nofp.cz12a_c32r12899.6070.3810.0130.059
my8407_rel_o2nofp.cz12a_c32r12899.6110.3760.013nonzero0.072
my8407_rel_o2nofp.cz12a_nocb_c32r12899.3400.6510.009nonzero0.065
my9400_rel_o2nofp.cz12a_c32r12899.7310.2570.0120.057
my9500_rel_o2nofp.cz12a_c32r12899.6740.3140.0130.042
my9500_rel_o2nofp.cz13a_c32r12899.6420.3430.015nonzero0.074

Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.

dbms256us1ms4ms16ms64ms256ms1s4s16sgtmax
my5651_rel_o2nofp.cz12a_c32r1280.67776.11723.0660.1330.0060.0010.727
my5744_rel_o2nofp.cz12a_c32r1281.16397.7591.0690.0090.051
my8043_rel_o2nofp.cz12a_c32r1280.00199.8950.0970.007nonzero0.067
my8044_rel_o2nofp.cz12a_c32r128nonzero99.7730.2180.0080.036
my8406_rel_o2nofp.cz12a_c32r1280.00199.7920.1960.0110.059
my8407_rel_o2nofp.cz12a_c32r128nonzero99.8140.1750.0100.058
my8407_rel_o2nofp.cz12a_nocb_c32r1280.00199.6310.3600.007nonzero0.064
my9400_rel_o2nofp.cz12a_c32r12899.8760.1130.0100.057
my9500_rel_o2nofp.cz12a_c32r128nonzero99.8090.1790.0110.035
my9500_rel_o2nofp.cz13a_c32r12899.8370.1500.012nonzero0.073

Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
11920	101387	288	1.1	1637.2	55.4	0.003	0.011	0.137	4.761	584893	45.2	5.769	143	30.2	132.2	38.2	0.017	8511	8287	my5651_rel_o2nofp.cz12a_c32r128
11927	88393	0	0.0	1047.5	39.2	0.000	0.000	0.088	3.362	511078	43.7	5.782	158	30.7	132.7	40.1	0.007	7407	7215	my5744_rel_o2nofp.cz12a_c32r128
11927	66977	0	0.0	1087.3	40.7	0.000	0.000	0.091	3.490	395446	42.0	5.904	201	31.0	132.4	44.0	0.006	5599	5535	my8043_rel_o2nofp.cz12a_c32r128
11920	66041	0	0.0	1078.9	40.4	0.000	0.000	0.091	3.474	389873	42.6	5.904	206	31.0	132.0	43.1	0.006	5551	5487	my8044_rel_o2nofp.cz12a_c32r128
11927	65549	0	0.0	1082.3	40.5	0.000	0.000	0.091	3.477	386701	42.6	5.899	208	31.0	172.5	44.1	0.005	5487	5439	my8406_rel_o2nofp.cz12a_c32r128
11927	65565	0	0.0	1083.9	40.6	0.000	0.000	0.091	3.482	387497	42.7	5.910	208	31.0	173.1	44.1	0.009	5487	5423	my8407_rel_o2nofp.cz12a_c32r128
11927	66022	0	0.0	1084.6	40.5	0.000	0.000	0.091	3.478	389416	42.4	5.898	206	31.0	172.5	44.9	0.005	5519	5471	my8407_rel_o2nofp.cz12a_nocb_c32r128
11920	66970	0	0.0	1079.9	40.4	0.000	0.000	0.091	3.473	395143	42.5	5.900	203	31.0	172.4	43.2	0.004	5615	5551	my9400_rel_o2nofp.cz12a_c32r128
11927	67396	0	0.0	1089.3	40.7	0.000	0.000	0.091	3.492	397922	41.9	5.904	199	29.3	171.6	38.9	0.005	5679	5615	my9500_rel_o2nofp.cz12a_c32r128
11920	66827	0	0.0	1085.5	40.6	0.000	0.000	0.091	3.488	395155	42.7	5.913	204	31.0	172.6	44.4	0.006	5647	5567	my9500_rel_o2nofp.cz13a_c32r128

Average values from iostat.

r/s	rkB/s	rrqm/s	%rrqm	r_await	rareq-s	w/s	wkB/s	wrqm/s	%wrqm	w_await	wareq-s	d/s	dkB/s	drqm/s	%drqm	d_await	dareq-s	f/s	f_await	aqu-sz	%util	
0.003	0.013	0.000	0.000	0.019	0.066	1078.9	41413.8	1.356	0.124	0.624	38.35	0.056	0.641	0.000	0.000	0.150	1.489	2.612	0.480	0.675	1.749		my8044_rel_o2nofp.cz12a_c32r128
0.008	0.033	0.000	0.000	0.033	0.166	1083.9	41527.1	1.747	0.160	0.644	38.28	0.059	3.324	0.000	0.000	0.224	8.439	2.654	0.590	0.700	1.881		my8407_rel_o2nofp.cz12a_c32r128
0.010	0.042	0.000	0.000	0.050	0.199	1084.6	41479.3	1.734	0.158	0.609	38.20	0.113	9.596	0.000	0.000	0.152	10.25	2.655	0.468	0.661	1.750		my8407_rel_o2nofp.cz12a_nocb_c32r128
0.007	0.029	0.000	0.000	0.044	0.144	1089.3	41648.2	1.597	0.145	0.736	38.20	0.057	11.81	0.000	0.000	0.175	32.79	3.531	0.581	0.803	1.573		my9500_rel_o2nofp.cz12a_c32r128
0.009	0.035	0.000	0.000	0.014	0.166	1085.5	41580.3	1.537	0.140	0.718	38.26	0.078	1.006	0.000	0.000	0.227	1.726	2.614	0.613	0.780	2.411		my9500_rel_o2nofp.cz13a_c32r128

l.i0

l.i0: load without secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
588235	0	0	0.0	1479.3	144.1	0.000	0.000	0.003	0.251	70945	40.5	0.121	22	8.0	108.5	15.0	0.183	50994	42695	my5651_rel_o2nofp.cz12a_c32r128
681818	0	0	0.0	2172.5	181.4	0.000	0.000	0.003	0.272	83139	41.9	0.122	20	8.0	108.5	16.3	0.148	62392	53093	my5744_rel_o2nofp.cz12a_c32r128
821918	0	0	0.0	2714.0	230.4	0.000	0.000	0.003	0.287	140609	46.5	0.171	18	8.0	108.6	16.6	0.164	80490	69092	my8043_rel_o2nofp.cz12a_c32r128
810811	0	1	0.0	2689.5	229.2	0.000	0.000	0.003	0.289	139911	47.0	0.173	19	8.0	108.6	16.5	0.162	78990	69192	my8044_rel_o2nofp.cz12a_c32r128
805369	0	0	0.0	2670.5	224.1	0.000	0.000	0.003	0.285	137296	45.6	0.170	18	8.0	114.2	16.5	0.148	78091	67092	my8406_rel_o2nofp.cz12a_c32r128
805369	0	1	0.0	2672.4	224.1	0.000	0.000	0.003	0.285	136973	46.1	0.170	18	8.0	114.2	16.5	0.165	78091	67591	my8407_rel_o2nofp.cz12a_c32r128
816326	0	1	0.0	2690.5	229.2	0.000	0.000	0.003	0.287	141105	47.2	0.173	19	8.0	114.2	16.5	0.160	78790	66892	my8407_rel_o2nofp.cz12a_nocb_c32r128
800000	0	0	0.0	2660.2	223.8	0.000	0.000	0.003	0.286	136631	45.7	0.171	18	8.0	114.2	16.5	0.162	78289	67192	my9400_rel_o2nofp.cz12a_c32r128
794702	0	1	0.0	2673.0	225.8	0.000	0.000	0.003	0.291	145325	46.8	0.183	19	8.0	114.2	16.6	0.165	77391	67191	my9500_rel_o2nofp.cz12a_c32r128
800000	0	1	0.0	2672.2	224.2	0.000	0.000	0.003	0.287	136076	45.9	0.170	18	8.0	114.2	16.7	0.168	78491	66892	my9500_rel_o2nofp.cz13a_c32r128

l.x

l.x: create secondary indexes

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
434783	0	0	0.0	10249.1	503.1	0.000	0.000	0.024	1.185	24790	31.2	0.057	23	16.7	117.2	23.9	0.001	NA	NA	my5651_rel_o2nofp.cz12a_c32r128
1764707	0	0	0.0	29014.1	1529.7	0.000	0.000	0.016	0.888	167293	34.0	0.095	6	18.2	118.8	24.3	0.018	NA	NA	my5744_rel_o2nofp.cz12a_c32r128
2105265	0	34	0.9	65674.3	2502.7	0.000	0.000	0.031	1.217	97922	73.1	0.047	11	18.2	118.8	16.8	0.010	NA	NA	my8043_rel_o2nofp.cz12a_c32r128
2033900	0	54	1.6	63224.8	2465.6	0.000	0.001	0.031	1.241	89008	74.1	0.044	12	18.2	118.8	16.8	0.007	NA	NA	my8044_rel_o2nofp.cz12a_c32r128
2105265	0	37	0.9	65755.9	2505.8	0.000	0.000	0.031	1.219	99874	73.2	0.047	11	18.2	124.4	16.9	0.003	NA	NA	my8406_rel_o2nofp.cz12a_c32r128
2105265	0	50	1.3	66028.0	2509.9	0.000	0.001	0.031	1.221	95406	73.8	0.045	11	18.2	124.4	16.9	0.004	NA	NA	my8407_rel_o2nofp.cz12a_c32r128
2105265	0	54	1.6	65301.5	2498.6	0.000	0.001	0.031	1.215	95937	73.6	0.046	11	18.2	124.4	16.9	0.007	NA	NA	my8407_rel_o2nofp.cz12a_nocb_c32r128
2068967	0	48	1.4	64874.8	2491.9	0.000	0.001	0.031	1.233	95514	72.4	0.046	11	18.2	124.4	16.8	0.004	NA	NA	my9400_rel_o2nofp.cz12a_c32r128
2105265	0	47	1.2	66840.0	2522.4	0.000	0.001	0.032	1.227	98125	72.6	0.047	11	18.2	124.4	17.1	0.011	NA	NA	my9500_rel_o2nofp.cz12a_c32r128
2105265	0	50	1.4	65118.9	2496.7	0.000	0.001	0.031	1.214	93632	71.5	0.044	11	18.2	124.4	17.1	0.005	NA	NA	my9500_rel_o2nofp.cz13a_c32r128

l.i1

l.i1: continue load after secondary indexes created with 50 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
73310	0	1232	4.8	3521.7	150.4	0.017	0.067	0.048	2.101	110840	73.5	1.512	321	30.2	132.2	37.8	7.892	6549	200	my5651_rel_o2nofp.cz12a_c32r128
100734	0	0	0.0	4495.2	186.7	0.000	0.000	0.045	1.898	47808	76.4	0.475	243	30.7	132.7	39.3	5.749	9995	0	my5744_rel_o2nofp.cz12a_c32r128
180282	0	543	8.5	7521.2	330.2	0.003	0.048	0.042	1.875	210756	67.7	1.169	120	31.0	133.9	44.0	1.291	18148	2700	my8043_rel_o2nofp.cz12a_c32r128
178439	0	538	8.4	7422.6	325.0	0.003	0.048	0.042	1.865	208681	68.5	1.169	123	31.0	134.4	43.1	2.050	18248	2800	my8044_rel_o2nofp.cz12a_c32r128
176633	0	533	8.3	7418.7	324.7	0.003	0.048	0.042	1.882	207930	67.4	1.177	122	31.0	159.9	44.0	1.356	17948	2600	my8406_rel_o2nofp.cz12a_c32r128
177122	0	536	8.4	7462.9	327.1	0.003	0.048	0.042	1.891	208813	67.5	1.179	122	31.0	158.6	44.1	2.097	18148	2650	my8407_rel_o2nofp.cz12a_c32r128
180451	0	546	8.5	7518.2	330.0	0.003	0.048	0.042	1.872	211025	67.0	1.169	119	31.0	159.5	44.7	1.059	18548	2850	my8407_rel_o2nofp.cz12a_nocb_c32r128
176147	0	531	8.3	7378.9	322.2	0.003	0.048	0.042	1.873	207188	67.4	1.176	122	31.0	158.9	43.1	1.410	17893	3100	my9400_rel_o2nofp.cz12a_c32r128
160535	0	484	7.6	7264.3	316.9	0.003	0.048	0.045	2.022	226896	63.3	1.413	126	29.3	155.6	38.2	1.373	15288	2200	my9500_rel_o2nofp.cz12a_c32r128
176633	0	534	8.3	7427.1	324.9	0.003	0.048	0.042	1.883	206553	67.1	1.169	122	31.0	158.0	44.4	1.653	17948	2000	my9500_rel_o2nofp.cz13a_c32r128

l.i2

l.i2: continue load after secondary indexes created with 5 inserts per transaction

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
40336	0	5558	21.7	3232.3	131.6	0.138	0.551	0.080	3.340	276703	67.6	6.860	536	30.2	132.2	38.0	0.239	3685	165	my5651_rel_o2nofp.cz12a_c32r128
65217	0	0	0.0	5030.0	209.1	0.000	0.000	0.077	3.284	282521	67.5	4.332	331	30.7	132.7	39.8	1.226	6284	180	my5744_rel_o2nofp.cz12a_c32r128
78688	0	0	0.0	5993.1	255.6	0.000	0.000	0.076	3.326	421347	67.0	5.355	272	31.0	132.4	44.0	0.610	7629	1125	my8043_rel_o2nofp.cz12a_c32r128
77295	0	0	0.0	5889.1	251.6	0.000	0.000	0.076	3.333	415098	66.8	5.370	277	31.0	132.0	43.1	0.472	7519	1130	my8044_rel_o2nofp.cz12a_c32r128
76190	0	0	0.0	5861.3	249.5	0.000	0.000	0.077	3.354	410095	65.6	5.383	276	31.0	165.8	44.1	0.961	7464	1100	my8406_rel_o2nofp.cz12a_c32r128
77046	0	0	0.0	5934.3	252.5	0.000	0.000	0.077	3.356	416881	66.8	5.411	277	31.0	166.3	44.1	0.530	7499	1120	my8407_rel_o2nofp.cz12a_c32r128
77046	0	0	0.0	5910.1	252.0	0.000	0.000	0.077	3.350	416948	66.1	5.412	275	31.0	165.7	44.9	0.941	7569	1125	my8407_rel_o2nofp.cz12a_nocb_c32r128
76190	0	0	0.0	5845.0	249.0	0.000	0.000	0.077	3.347	410083	65.4	5.382	275	31.0	165.6	43.2	0.863	7493	1095	my9400_rel_o2nofp.cz12a_c32r128
80537	0	0	0.0	6022.8	261.5	0.000	0.000	0.075	3.325	443544	67.8	5.507	269	29.3	164.8	38.5	0.925	7539	1090	my9500_rel_o2nofp.cz12a_c32r128
76433	0	0	0.0	5883.2	250.6	0.000	0.000	0.077	3.357	416022	66.4	5.443	278	31.0	165.8	44.4	0.917	7444	1120	my9500_rel_o2nofp.cz13a_c32r128

qr100.L1

qr100.L1: range queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1193	124089	37	0.1	3826.9	107.0	0.000	0.001	3.209	91.880	712210	39.1	5.739	101	30.2	132.2	38.0	0.007	10399	10143	my5651_rel_o2nofp.cz12a_c32r128
1192	103047	0	0.0	1437.2	40.6	0.000	0.000	1.206	34.898	591672	39.3	5.742	122	30.7	132.7	39.8	0.024	8671	8559	my5744_rel_o2nofp.cz12a_c32r128
1192	88113	0	0.0	1455.2	41.3	0.000	0.000	1.221	35.468	509590	38.9	5.783	141	31.0	132.4	44.0	0.003	7407	7311	my8043_rel_o2nofp.cz12a_c32r128
1193	87431	0	0.0	1446.6	41.0	0.000	0.000	1.213	35.236	505409	38.9	5.781	142	31.0	132.0	43.1	0.002	7327	7231	my8044_rel_o2nofp.cz12a_c32r128
1193	87207	0	0.0	1390.2	39.5	0.000	0.000	1.166	33.891	504028	39.0	5.780	143	31.0	166.0	44.1	0.274	7311	7215	my8406_rel_o2nofp.cz12a_c32r128
1193	86349	0	0.0	1394.3	39.6	0.000	0.000	1.169	33.986	499119	38.8	5.780	144	31.0	166.5	44.1	0.111	7199	7119	my8407_rel_o2nofp.cz12a_c32r128
1193	86367	0	0.0	1333.5	37.9	0.000	0.000	1.118	32.533	499108	39.0	5.779	144	31.0	165.9	44.9	0.004	7279	7199	my8407_rel_o2nofp.cz12a_nocb_c32r128
1192	88604	0	0.0	1415.8	40.2	0.000	0.000	1.188	34.504	512226	38.9	5.781	140	31.0	165.9	43.2	0.215	7439	7327	my9400_rel_o2nofp.cz12a_c32r128
1193	88822	0	0.0	1428.9	40.5	0.000	0.000	1.198	34.813	513198	38.9	5.778	140	29.3	165.0	38.6	0.005	7407	7311	my9500_rel_o2nofp.cz12a_c32r128
1192	87362	0	0.0	1493.5	42.3	0.000	0.000	1.253	36.368	505179	39.0	5.783	143	31.0	166.0	44.4	0.003	7359	7279	my9500_rel_o2nofp.cz13a_c32r128

qp100.L2

qp100.L2: point queries with 100 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
1193	106971	38	0.1	16.9	1.4	0.000	0.001	0.014	1.205	619294	38.0	5.789	114	30.2	132.2	38.0	0.004	8927	8783	my5651_rel_o2nofp.cz12a_c32r128
1193	90742	0	0.0	120.2	4.1	0.000	0.000	0.101	3.504	525488	38.9	5.791	137	30.7	132.7	39.8	0.002	7615	7535	my5744_rel_o2nofp.cz12a_c32r128
1192	68451	0	0.0	145.8	4.9	0.000	0.000	0.122	4.214	398209	37.8	5.817	177	31.0	132.4	44.0	0.002	5727	5679	my8043_rel_o2nofp.cz12a_c32r128
1193	67597	0	0.0	119.2	4.1	0.000	0.000	0.100	3.541	392995	38.1	5.814	180	31.0	132.0	43.1	0.002	5647	5583	my8044_rel_o2nofp.cz12a_c32r128
1192	66956	0	0.0	96.2	3.6	0.000	0.000	0.081	3.060	389343	38.0	5.815	182	31.0	166.2	44.1	0.001	5615	5567	my8406_rel_o2nofp.cz12a_c32r128
1192	66900	0	0.0	127.5	4.4	0.000	0.000	0.107	3.773	389156	38.0	5.817	182	31.0	166.7	44.1	0.004	5599	5551	my8407_rel_o2nofp.cz12a_c32r128
1193	67455	0	0.0	135.0	4.6	0.000	0.000	0.113	3.962	392267	38.5	5.815	183	31.0	166.2	44.9	0.003	5663	5599	my8407_rel_o2nofp.cz12a_nocb_c32r128
1192	68507	0	0.0	136.2	4.7	0.000	0.000	0.114	4.004	398400	38.2	5.815	178	31.0	166.1	43.2	0.004	5743	5695	my9400_rel_o2nofp.cz12a_c32r128
1193	68808	0	0.0	105.4	3.8	0.000	0.000	0.088	3.279	399983	38.1	5.813	177	29.3	165.2	38.6	0.003	5775	5711	my9500_rel_o2nofp.cz12a_c32r128
1193	68255	0	0.0	114.9	4.0	0.000	0.000	0.096	3.426	396756	38.5	5.813	180	31.0	166.3	44.4	0.003	5711	5647	my9500_rel_o2nofp.cz13a_c32r128

qr500.L3

qr500.L3: range queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
5960	121066	176	0.7	954.2	31.4	0.001	0.006	0.160	5.390	692345	41.8	5.719	110	30.2	132.2	38.1	0.007	10110	9903	my5651_rel_o2nofp.cz12a_c32r128
5964	102065	0	0.0	555.6	20.3	0.000	0.000	0.093	3.483	585184	41.4	5.733	130	30.7	132.7	39.9	0.004	8607	8479	my5744_rel_o2nofp.cz12a_c32r128
5960	87400	0	0.0	582.9	21.2	0.000	0.000	0.098	3.647	505466	40.4	5.783	148	31.0	132.4	44.0	0.002	7343	7279	my8043_rel_o2nofp.cz12a_c32r128
5960	86728	0	0.0	576.2	21.0	0.000	0.000	0.097	3.611	501690	40.6	5.785	150	31.0	132.0	43.1	0.003	7263	7199	my8044_rel_o2nofp.cz12a_c32r128
5960	86479	0	0.0	624.7	22.4	0.000	0.000	0.105	3.848	499725	40.8	5.779	151	31.0	167.2	44.1	0.004	7263	7199	my8406_rel_o2nofp.cz12a_c32r128
5960	85754	0	0.0	567.3	20.8	0.000	0.000	0.095	3.570	495664	40.8	5.780	152	31.0	167.8	44.1	0.004	7183	7119	my8407_rel_o2nofp.cz12a_c32r128
5964	85753	0	0.0	565.1	20.7	0.000	0.000	0.095	3.553	495830	40.8	5.782	152	31.0	167.2	44.9	0.003	7183	7119	my8407_rel_o2nofp.cz12a_nocb_c32r128
5964	87881	0	0.0	594.0	21.5	0.000	0.000	0.100	3.698	508097	40.4	5.782	147	31.0	167.1	43.2	0.003	7359	7295	my9400_rel_o2nofp.cz12a_c32r128
5964	88253	0	0.0	583.1	21.2	0.000	0.000	0.098	3.647	510113	40.1	5.780	145	29.3	166.3	38.6	0.085	7423	7343	my9500_rel_o2nofp.cz12a_c32r128
5964	86846	0	0.0	588.3	21.3	0.000	0.000	0.099	3.665	501711	40.8	5.777	150	31.0	167.3	44.4	0.101	7263	7199	my9500_rel_o2nofp.cz13a_c32r128

qp500.L4

qp500.L4: point queries with 500 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
5960	104368	183	0.7	2406.9	71.6	0.002	0.007	0.404	12.297	604467	41.2	5.792	126	30.2	132.2	38.1	0.008	8719	8511	my5651_rel_o2nofp.cz12a_c32r128
5964	89651	0	0.0	603.1	21.6	0.000	0.000	0.101	3.710	519451	40.9	5.794	146	30.7	132.7	39.9	0.022	7535	7407	my5744_rel_o2nofp.cz12a_c32r128
5960	67912	0	0.0	659.6	23.4	0.000	0.000	0.111	4.015	398529	39.8	5.868	188	31.0	132.4	44.0	0.002	5679	5631	my8043_rel_o2nofp.cz12a_c32r128
5964	66919	0	0.0	632.4	22.6	0.000	0.000	0.106	3.878	392660	39.7	5.868	190	31.0	132.0	43.1	0.002	5599	5535	my8044_rel_o2nofp.cz12a_c32r128
5964	66278	0	0.0	657.3	23.3	0.000	0.000	0.110	3.999	388674	39.4	5.864	190	31.0	168.3	44.1	0.006	5535	5487	my8406_rel_o2nofp.cz12a_c32r128
5964	66270	0	0.0	625.6	22.4	0.000	0.000	0.105	3.847	388866	39.5	5.868	191	31.0	168.9	44.1	0.002	5551	5487	my8407_rel_o2nofp.cz12a_c32r128
5960	66856	0	0.0	632.2	22.6	0.000	0.000	0.106	3.884	392473	39.9	5.870	191	31.0	168.3	44.9	0.003	5599	5551	my8407_rel_o2nofp.cz12a_nocb_c32r128
5964	67858	0	0.0	645.9	22.9	0.000	0.000	0.108	3.938	397182	39.8	5.853	188	31.0	168.2	43.2	0.005	5695	5631	my9400_rel_o2nofp.cz12a_c32r128
5960	68080	0	0.0	635.8	22.8	0.000	0.000	0.107	3.912	399199	39.9	5.864	188	29.3	167.4	38.7	0.004	5711	5647	my9500_rel_o2nofp.cz12a_c32r128
5964	67708	0	0.0	638.6	22.8	0.000	0.000	0.107	3.910	397112	39.9	5.865	189	31.0	168.4	44.4	0.002	5663	5615	my9500_rel_o2nofp.cz13a_c32r128

qr1000.L5

qr1000.L5: range queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
11927	116670	358	1.4	1547.0	52.9	0.003	0.012	0.130	4.540	664509	45.8	5.696	126	30.2	132.2	38.2	0.629	9759	9503	my5651_rel_o2nofp.cz12a_c32r128
11927	100142	0	0.0	1001.0	37.8	0.000	0.000	0.084	3.248	572429	44.3	5.716	142	30.7	132.7	40.0	0.100	8431	8239	my5744_rel_o2nofp.cz12a_c32r128
11920	86028	0	0.0	1026.3	38.9	0.000	0.000	0.086	3.341	498422	42.7	5.794	159	31.0	132.4	44.0	0.007	7215	7135	my8043_rel_o2nofp.cz12a_c32r128
11927	85365	0	0.0	1045.4	39.4	0.000	0.000	0.088	3.384	495270	42.7	5.802	160	31.0	132.0	43.1	0.005	7167	7087	my8044_rel_o2nofp.cz12a_c32r128
11927	85481	0	0.0	1024.2	38.8	0.000	0.000	0.086	3.334	495582	42.7	5.798	160	31.0	170.4	44.1	0.005	7167	7103	my8406_rel_o2nofp.cz12a_c32r128
11927	84533	0	0.0	1022.5	38.8	0.000	0.000	0.086	3.329	490053	42.7	5.797	162	31.0	171.0	44.1	0.007	7087	7023	my8407_rel_o2nofp.cz12a_c32r128
11920	84646	0	0.0	1025.4	38.8	0.000	0.000	0.086	3.336	491290	42.7	5.804	161	31.0	170.4	44.9	0.166	7135	6959	my8407_rel_o2nofp.cz12a_nocb_c32r128
11920	86671	0	0.0	1021.7	38.8	0.000	0.000	0.086	3.332	501745	42.7	5.789	158	31.0	170.3	43.2	0.006	7247	7183	my9400_rel_o2nofp.cz12a_c32r128
11920	86993	0	0.0	1037.4	39.3	0.000	0.000	0.087	3.375	506089	42.7	5.818	157	29.3	169.5	38.8	0.048	7343	7247	my9500_rel_o2nofp.cz12a_c32r128
11920	85600	0	0.0	1027.9	39.0	0.000	0.000	0.086	3.346	497092	42.7	5.807	160	31.0	170.5	44.4	0.004	7167	7102	my9500_rel_o2nofp.cz13a_c32r128

qp1000.L6

qp1000.L6: point queries with 1000 insert/s per client

Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.

ips	qps	rps	rmbps	wps	wmbps	rpq	rkbpq	wpi	wkbpi	csps	cpups	cspq	cpupq	dbgb1	dbgb2	rss	maxop	p50	p99	tag
11920	101387	288	1.1	1637.2	55.4	0.003	0.011	0.137	4.761	584893	45.2	5.769	143	30.2	132.2	38.2	0.017	8511	8287	my5651_rel_o2nofp.cz12a_c32r128
11927	88393	0	0.0	1047.5	39.2	0.000	0.000	0.088	3.362	511078	43.7	5.782	158	30.7	132.7	40.1	0.007	7407	7215	my5744_rel_o2nofp.cz12a_c32r128
11927	66977	0	0.0	1087.3	40.7	0.000	0.000	0.091	3.490	395446	42.0	5.904	201	31.0	132.4	44.0	0.006	5599	5535	my8043_rel_o2nofp.cz12a_c32r128
11920	66041	0	0.0	1078.9	40.4	0.000	0.000	0.091	3.474	389873	42.6	5.904	206	31.0	132.0	43.1	0.006	5551	5487	my8044_rel_o2nofp.cz12a_c32r128
11927	65549	0	0.0	1082.3	40.5	0.000	0.000	0.091	3.477	386701	42.6	5.899	208	31.0	172.5	44.1	0.005	5487	5439	my8406_rel_o2nofp.cz12a_c32r128
11927	65565	0	0.0	1083.9	40.6	0.000	0.000	0.091	3.482	387497	42.7	5.910	208	31.0	173.1	44.1	0.009	5487	5423	my8407_rel_o2nofp.cz12a_c32r128
11927	66022	0	0.0	1084.6	40.5	0.000	0.000	0.091	3.478	389416	42.4	5.898	206	31.0	172.5	44.9	0.005	5519	5471	my8407_rel_o2nofp.cz12a_nocb_c32r128
11920	66970	0	0.0	1079.9	40.4	0.000	0.000	0.091	3.473	395143	42.5	5.900	203	31.0	172.4	43.2	0.004	5615	5551	my9400_rel_o2nofp.cz12a_c32r128
11927	67396	0	0.0	1089.3	40.7	0.000	0.000	0.091	3.492	397922	41.9	5.904	199	29.3	171.6	38.9	0.005	5679	5615	my9500_rel_o2nofp.cz12a_c32r128
11920	66827	0	0.0	1085.5	40.6	0.000	0.000	0.091	3.488	395155	42.7	5.913	204	31.0	172.6	44.4	0.006	5647	5567	my9500_rel_o2nofp.cz13a_c32r128

l.i0

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	5.149	94.604	0.063	0.164	0.020	0.000	0.000	0.000	0.000	0.183	my5651_rel_o2nofp.cz12a_c32r128
0.000	4.318	95.507	0.148	0.006	0.021	0.000	0.000	0.000	0.000	0.148	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.509	99.396	0.071	0.003	0.021	0.000	0.000	0.000	0.000	0.164	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.330	99.576	0.070	0.003	0.021	0.000	0.000	0.000	0.000	0.162	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.154	99.755	0.066	0.004	0.021	0.000	0.000	0.000	0.000	0.148	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.139	99.765	0.070	0.004	0.021	0.000	0.000	0.000	0.000	0.165	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.221	99.686	0.068	0.004	0.021	0.000	0.000	0.000	0.000	0.160	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.432	99.473	0.070	0.004	0.021	0.000	0.000	0.000	0.000	0.162	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.114	99.760	0.099	0.005	0.022	0.000	0.000	0.000	0.000	0.165	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.180	99.715	0.075	0.007	0.022	0.000	0.000	0.000	0.000	0.168	my9500_rel_o2nofp.cz13a_c32r128

l.x

TODO - determine whether there is data for create index response time


l.i1

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	nonzero	0.547	97.278	1.780	0.339	0.053	0.002	nonzero	0.000	7.892	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.012	12.447	86.949	0.206	0.132	0.247	0.007	nonzero	0.000	5.749	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	88.028	11.673	0.210	0.077	0.012	nonzero	0.000	0.000	1.291	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	87.969	11.741	0.209	0.069	0.010	0.001	0.000	0.000	2.050	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	88.046	11.636	0.225	0.079	0.013	0.001	0.000	0.000	1.356	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	88.031	11.647	0.227	0.082	0.012	0.001	0.000	0.000	2.097	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	88.515	11.209	0.178	0.084	0.014	nonzero	0.000	0.000	1.059	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	88.017	11.669	0.220	0.081	0.013	nonzero	0.000	0.000	1.410	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	83.209	16.449	0.241	0.084	0.016	0.001	0.000	0.000	1.373	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	88.145	11.529	0.228	0.082	0.015	0.001	0.000	0.000	1.653	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.002	1.249	96.748	1.640	0.311	0.049	0.002	nonzero	0.000	4.268	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.082	17.660	81.710	0.182	0.144	0.218	0.004	nonzero	0.000	5.766	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.009	88.291	11.404	0.193	0.091	0.011	0.001	0.000	0.000	1.305	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.005	88.257	11.455	0.196	0.075	0.009	0.001	0.000	0.000	2.050	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.005	88.374	11.317	0.206	0.084	0.013	0.001	0.000	0.000	1.120	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.007	88.343	11.335	0.214	0.088	0.013	0.001	0.000	0.000	2.038	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.011	88.763	10.997	0.132	0.080	0.015	nonzero	0.000	0.000	1.068	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.011	88.371	11.326	0.199	0.080	0.013	nonzero	0.000	0.000	1.305	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.019	83.677	16.076	0.152	0.064	0.013	0.001	0.000	0.000	1.322	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.015	88.461	11.198	0.222	0.087	0.016	0.001	0.000	0.000	1.471	my9500_rel_o2nofp.cz13a_c32r128

l.i2

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.059	30.596	68.493	0.287	0.556	0.008	0.000	0.000	0.000	0.000	0.239	my5651_rel_o2nofp.cz12a_c32r128
0.135	86.626	12.783	0.033	0.417	0.006	0.001	nonzero	0.000	0.000	1.226	my5744_rel_o2nofp.cz12a_c32r128
0.063	91.315	7.932	0.671	0.010	0.008	0.001	0.000	0.000	0.000	0.610	my8043_rel_o2nofp.cz12a_c32r128
0.049	90.888	8.322	0.721	0.012	0.008	0.001	0.000	0.000	0.000	0.472	my8044_rel_o2nofp.cz12a_c32r128
0.033	90.667	8.563	0.714	0.013	0.008	0.002	0.000	0.000	0.000	0.961	my8406_rel_o2nofp.cz12a_c32r128
0.011	90.832	8.466	0.671	0.011	0.007	0.001	0.000	0.000	0.000	0.530	my8407_rel_o2nofp.cz12a_c32r128
0.035	91.057	8.165	0.721	0.013	0.008	0.002	0.000	0.000	0.000	0.941	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.062	90.685	8.483	0.747	0.012	0.008	0.001	0.000	0.000	0.000	0.863	my9400_rel_o2nofp.cz12a_c32r128
0.022	92.944	6.483	0.527	0.014	0.009	0.002	0.000	0.000	0.000	0.925	my9500_rel_o2nofp.cz12a_c32r128
0.043	90.768	8.455	0.711	0.013	0.008	0.002	0.000	0.000	0.000	0.917	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.066	31.657	67.428	0.286	0.556	0.008	0.000	0.000	0.000	0.000	0.239	my5651_rel_o2nofp.cz12a_c32r128
0.122	83.900	15.521	0.034	0.417	0.006	0.001	nonzero	0.000	0.000	1.226	my5744_rel_o2nofp.cz12a_c32r128
0.060	91.945	7.344	0.635	0.009	0.007	0.001	0.000	0.000	0.000	0.594	my8043_rel_o2nofp.cz12a_c32r128
0.063	91.539	7.694	0.684	0.011	0.008	0.001	0.000	0.000	0.000	0.485	my8044_rel_o2nofp.cz12a_c32r128
0.039	91.321	7.946	0.674	0.011	0.007	0.002	0.000	0.000	0.000	0.977	my8406_rel_o2nofp.cz12a_c32r128
0.016	91.464	7.870	0.632	0.010	0.007	0.002	0.000	0.000	0.000	0.541	my8407_rel_o2nofp.cz12a_c32r128
0.049	91.645	7.603	0.683	0.011	0.007	0.002	0.000	0.000	0.000	0.938	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.090	91.283	7.899	0.709	0.010	0.008	0.001	0.000	0.000	0.000	0.876	my9400_rel_o2nofp.cz12a_c32r128
0.051	93.246	6.189	0.492	0.012	0.009	0.002	0.000	0.000	0.000	0.927	my9500_rel_o2nofp.cz12a_c32r128
0.046	91.412	7.849	0.673	0.011	0.008	0.002	0.000	0.000	0.000	0.919	my9500_rel_o2nofp.cz13a_c32r128

qr100.L1

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.980	0.009	0.011	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5651_rel_o2nofp.cz12a_c32r128
99.995	0.005	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.024	my5744_rel_o2nofp.cz12a_c32r128
99.988	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8043_rel_o2nofp.cz12a_c32r128
99.988	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8044_rel_o2nofp.cz12a_c32r128
99.987	0.012	nonzero	nonzero	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.274	my8406_rel_o2nofp.cz12a_c32r128
99.988	0.012	nonzero	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.111	my8407_rel_o2nofp.cz12a_c32r128
99.987	0.013	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8407_rel_o2nofp.cz12a_nocb_c32r128
99.989	0.011	nonzero	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.215	my9400_rel_o2nofp.cz12a_c32r128
99.987	0.013	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my9500_rel_o2nofp.cz12a_c32r128
99.988	0.012	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my9500_rel_o2nofp.cz13a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	96.007	3.993	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.609	0.387	0.005	0.000	0.000	0.000	0.000	0.000	0.020	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.220	0.780	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.231	0.766	0.002	0.000	0.000	0.000	0.000	0.000	0.020	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	98.968	0.815	0.137	0.060	0.021	0.000	0.000	0.000	0.315	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.181	0.743	0.037	0.039	0.000	0.000	0.000	0.000	0.152	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	98.859	1.141	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	99.190	0.229	0.338	0.231	0.012	0.000	0.000	0.000	0.349	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.435	0.562	0.002	0.000	0.000	0.000	0.000	0.000	0.017	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.081	0.917	0.002	0.000	0.000	0.000	0.000	0.000	0.017	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	4.477	92.755	2.769	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my5651_rel_o2nofp.cz12a_c32r128
0.000	3.405	96.287	0.306	0.002	0.000	0.000	0.000	0.000	0.000	0.038	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.012	99.218	0.771	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.005	99.252	0.741	0.002	0.000	0.000	0.000	0.000	0.000	0.018	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.002	99.016	0.789	0.125	0.056	0.012	0.000	0.000	0.000	0.303	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.005	99.255	0.678	0.032	0.030	0.000	0.000	0.000	0.000	0.168	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.021	98.926	1.051	0.002	0.000	0.000	0.000	0.000	0.000	0.017	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.002	99.257	0.218	0.278	0.241	0.005	0.000	0.000	0.000	0.344	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.521	0.477	0.002	0.000	0.000	0.000	0.000	0.000	0.019	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.005	99.100	0.894	0.002	0.000	0.000	0.000	0.000	0.000	0.019	my9500_rel_o2nofp.cz13a_c32r128

qp100.L2

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.957	0.029	0.014	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5651_rel_o2nofp.cz12a_c32r128
99.985	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my5744_rel_o2nofp.cz12a_c32r128
99.960	0.040	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8043_rel_o2nofp.cz12a_c32r128
99.958	0.042	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8044_rel_o2nofp.cz12a_c32r128
99.955	0.045	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.001	my8406_rel_o2nofp.cz12a_c32r128
99.958	0.042	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8407_rel_o2nofp.cz12a_c32r128
99.961	0.039	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8407_rel_o2nofp.cz12a_nocb_c32r128
99.956	0.044	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my9400_rel_o2nofp.cz12a_c32r128
99.961	0.039	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my9500_rel_o2nofp.cz12a_c32r128
99.960	0.039	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my9500_rel_o2nofp.cz13a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.000	94.215	5.785	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.998	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	98.961	1.039	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	98.965	1.035	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.072	0.928	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.123	0.877	0.000	0.000	0.000	0.000	0.000	0.000	0.016	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.988	0.012	0.000	0.000	0.000	0.000	0.000	0.000	0.012	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	98.676	1.324	0.000	0.000	0.000	0.000	0.000	0.000	0.015	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	98.998	0.993	0.009	0.000	0.000	0.000	0.000	0.000	0.022	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.301	0.694	0.005	0.000	0.000	0.000	0.000	0.000	0.019	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	1.282	95.282	3.435	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my5651_rel_o2nofp.cz12a_c32r128
0.000	1.259	98.738	0.002	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	98.993	1.007	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	98.977	1.023	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.116	0.884	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.132	0.868	0.000	0.000	0.000	0.000	0.000	0.000	0.013	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.993	0.007	0.000	0.000	0.000	0.000	0.000	0.000	0.014	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	98.715	1.282	0.002	0.000	0.000	0.000	0.000	0.000	0.017	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.030	0.961	0.009	0.000	0.000	0.000	0.000	0.000	0.018	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.347	0.648	0.005	0.000	0.000	0.000	0.000	0.000	0.020	my9500_rel_o2nofp.cz13a_c32r128

qr500.L3

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.892	0.092	0.015	0.001	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5651_rel_o2nofp.cz12a_c32r128
99.988	0.011	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my5744_rel_o2nofp.cz12a_c32r128
99.978	0.022	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8043_rel_o2nofp.cz12a_c32r128
99.978	0.021	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8044_rel_o2nofp.cz12a_c32r128
99.972	0.027	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8406_rel_o2nofp.cz12a_c32r128
99.974	0.026	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my8407_rel_o2nofp.cz12a_c32r128
99.975	0.025	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8407_rel_o2nofp.cz12a_nocb_c32r128
99.977	0.023	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my9400_rel_o2nofp.cz12a_c32r128
99.979	0.020	nonzero	0.000	0.000	nonzero	0.000	0.000	0.000	0.000	0.085	my9500_rel_o2nofp.cz12a_c32r128
99.977	0.023	nonzero	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.101	my9500_rel_o2nofp.cz13a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.003	73.542	26.444	0.011	0.000	0.000	0.000	0.000	0.000	0.023	my5651_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.661	0.334	0.005	0.000	0.000	0.000	0.000	0.000	0.024	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.859	0.137	0.004	0.000	0.000	0.000	0.000	0.000	0.020	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.903	0.088	0.008	nonzero	0.000	0.000	0.000	0.000	0.066	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.678	0.312	0.004	0.006	0.000	0.000	0.000	0.000	0.138	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.623	0.372	0.005	0.000	0.000	0.000	0.000	0.000	0.021	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.662	0.334	0.003	0.000	0.000	0.000	0.000	0.000	0.020	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	99.656	0.340	0.003	0.000	0.000	0.000	0.000	0.000	0.022	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.654	0.333	0.013	0.000	0.000	0.000	0.000	0.000	0.029	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.938	0.033	0.022	0.007	0.000	0.000	0.000	0.000	0.137	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.046	81.539	18.409	0.006	0.000	0.000	0.000	0.000	0.000	0.024	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.303	99.548	0.144	0.005	0.000	0.000	0.000	0.000	0.000	0.024	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.007	99.898	0.094	0.001	0.000	0.000	0.000	0.000	0.000	0.019	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.929	0.063	0.007	nonzero	0.000	0.000	0.000	0.000	0.064	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.001	99.779	0.210	0.004	0.006	0.000	0.000	0.000	0.000	0.133	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.732	0.265	0.003	0.000	0.000	0.000	0.000	0.000	0.019	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.006	99.759	0.232	0.002	0.000	0.000	0.000	0.000	0.000	0.019	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.007	99.773	0.216	0.004	0.000	0.000	0.000	0.000	0.000	0.024	my9400_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.771	0.217	0.012	0.000	0.000	0.000	0.000	0.000	0.031	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.001	99.958	0.022	0.014	0.005	0.000	0.000	0.000	0.000	0.123	my9500_rel_o2nofp.cz13a_c32r128

qp500.L4

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.860	0.125	0.015	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.008	my5651_rel_o2nofp.cz12a_c32r128
99.960	0.040	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.022	my5744_rel_o2nofp.cz12a_c32r128
99.883	0.117	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8043_rel_o2nofp.cz12a_c32r128
99.878	0.122	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8044_rel_o2nofp.cz12a_c32r128
99.849	0.151	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8406_rel_o2nofp.cz12a_c32r128
99.856	0.143	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my8407_rel_o2nofp.cz12a_c32r128
99.863	0.136	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.003	my8407_rel_o2nofp.cz12a_nocb_c32r128
99.841	0.158	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my9400_rel_o2nofp.cz12a_c32r128
99.878	0.121	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my9500_rel_o2nofp.cz12a_c32r128
99.876	0.124	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.002	my9500_rel_o2nofp.cz13a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.003	75.660	24.294	0.016	0.018	0.009	0.000	0.000	0.000	0.703	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.612	0.377	0.006	0.006	0.000	0.000	0.000	0.000	0.142	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.818	0.181	0.002	0.000	0.000	0.000	0.000	0.000	0.021	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.779	0.219	0.003	0.000	0.000	0.000	0.000	0.000	0.028	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.728	0.265	0.007	0.000	0.000	0.000	0.000	0.000	0.025	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.894	0.104	0.003	0.000	0.000	0.000	0.000	0.000	0.023	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.753	0.241	0.006	0.000	0.000	0.000	0.000	0.000	0.023	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	99.356	0.633	0.011	0.000	0.000	0.000	0.000	0.000	0.026	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.483	0.500	0.016	0.000	0.000	0.000	0.000	0.000	0.061	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.823	0.169	0.008	0.000	0.000	0.000	0.000	0.000	0.029	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.049	83.956	15.962	0.010	0.015	0.008	0.000	0.000	0.000	0.709	my5651_rel_o2nofp.cz12a_c32r128
0.000	1.634	98.186	0.172	0.004	0.004	0.000	0.000	0.000	0.000	0.141	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.004	99.846	0.147	0.002	0.000	0.000	0.000	0.000	0.000	0.018	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.829	0.168	0.003	0.000	0.000	0.000	0.000	0.000	0.021	my8044_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.808	0.187	0.005	0.000	0.000	0.000	0.000	0.000	0.023	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.927	0.069	0.004	0.000	0.000	0.000	0.000	0.000	0.026	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.855	0.140	0.005	0.000	0.000	0.000	0.000	0.000	0.025	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	99.662	0.332	0.006	0.000	0.000	0.000	0.000	0.000	0.024	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.649	0.337	0.014	0.000	0.000	0.000	0.000	0.000	0.060	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.862	0.131	0.007	0.000	0.000	0.000	0.000	0.000	0.024	my9500_rel_o2nofp.cz13a_c32r128

qr1000.L5

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.698	0.275	0.025	0.002	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.629	my5651_rel_o2nofp.cz12a_c32r128
99.969	0.029	0.002	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.100	my5744_rel_o2nofp.cz12a_c32r128
99.939	0.059	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8043_rel_o2nofp.cz12a_c32r128
99.943	0.056	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8044_rel_o2nofp.cz12a_c32r128
99.936	0.063	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8406_rel_o2nofp.cz12a_c32r128
99.935	0.064	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my8407_rel_o2nofp.cz12a_c32r128
99.929	0.069	0.002	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.166	my8407_rel_o2nofp.cz12a_nocb_c32r128
99.936	0.063	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my9400_rel_o2nofp.cz12a_c32r128
99.954	0.046	nonzero	nonzero	nonzero	0.000	0.000	0.000	0.000	0.000	0.048	my9500_rel_o2nofp.cz12a_c32r128
99.941	0.058	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my9500_rel_o2nofp.cz13a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.013	51.075	48.802	0.080	0.018	0.012	0.000	0.000	0.000	0.654	my5651_rel_o2nofp.cz12a_c32r128
0.000	nonzero	98.669	1.322	0.006	0.000	0.003	0.000	0.000	0.000	0.400	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.589	0.399	0.012	0.000	0.000	0.000	0.000	0.000	0.060	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.775	0.213	0.012	0.000	0.000	0.000	0.000	0.000	0.056	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.689	0.296	0.015	0.000	0.000	0.000	0.000	0.000	0.036	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.507	0.481	0.011	nonzero	0.000	0.000	0.000	0.000	0.066	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.344	0.549	0.061	0.047	0.000	0.000	0.000	0.000	0.199	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	99.603	0.383	0.014	0.000	0.000	0.000	0.000	0.000	0.030	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.886	0.100	0.013	0.001	0.000	0.000	0.000	0.000	0.081	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.779	0.210	0.011	0.000	0.000	0.000	0.000	0.000	0.039	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.032	62.646	37.237	0.059	0.015	0.011	0.000	0.000	0.000	0.790	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.750	98.176	1.066	0.005	0.000	0.003	0.000	0.000	0.000	0.400	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.001	99.778	0.212	0.010	0.000	0.000	0.000	0.000	0.000	0.060	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.002	99.884	0.103	0.011	0.000	0.000	0.000	0.000	0.000	0.056	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.864	0.124	0.013	0.000	0.000	0.000	0.000	0.000	0.041	my8406_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.751	0.240	0.009	0.000	0.000	0.000	0.000	0.000	0.056	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.010	99.563	0.342	0.048	0.037	0.000	0.000	0.000	0.000	0.194	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	nonzero	99.792	0.197	0.011	0.000	0.000	0.000	0.000	0.000	0.031	my9400_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.952	0.036	0.011	0.001	0.000	0.000	0.000	0.000	0.078	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.897	0.095	0.009	0.000	0.000	0.000	0.000	0.000	0.038	my9500_rel_o2nofp.cz13a_c32r128

qp1000.L6

Query response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
99.706	0.273	0.020	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.017	my5651_rel_o2nofp.cz12a_c32r128
99.919	0.079	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.007	my5744_rel_o2nofp.cz12a_c32r128
99.716	0.283	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8043_rel_o2nofp.cz12a_c32r128
99.691	0.307	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my8044_rel_o2nofp.cz12a_c32r128
99.643	0.355	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8406_rel_o2nofp.cz12a_c32r128
99.662	0.336	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.009	my8407_rel_o2nofp.cz12a_c32r128
99.676	0.322	0.002	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my8407_rel_o2nofp.cz12a_nocb_c32r128
99.684	0.314	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.004	my9400_rel_o2nofp.cz12a_c32r128
99.754	0.245	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.005	my9500_rel_o2nofp.cz12a_c32r128
99.717	0.282	0.001	nonzero	0.000	0.000	0.000	0.000	0.000	0.000	0.006	my9500_rel_o2nofp.cz13a_c32r128

Insert response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.073	68.102	31.663	0.155	0.006	0.001	0.000	0.000	0.000	0.727	my5651_rel_o2nofp.cz12a_c32r128
0.000	0.001	98.634	1.356	0.009	0.000	0.000	0.000	0.000	0.000	0.052	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.803	0.188	0.009	0.001	0.000	0.000	0.000	0.000	0.068	my8043_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.571	0.419	0.010	0.000	0.000	0.000	0.000	0.000	0.032	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.607	0.381	0.013	0.000	0.000	0.000	0.000	0.000	0.059	my8406_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.611	0.376	0.013	nonzero	0.000	0.000	0.000	0.000	0.072	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.340	0.651	0.009	nonzero	0.000	0.000	0.000	0.000	0.065	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	99.731	0.257	0.012	0.000	0.000	0.000	0.000	0.000	0.057	my9400_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.674	0.314	0.013	0.000	0.000	0.000	0.000	0.000	0.042	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.642	0.343	0.015	nonzero	0.000	0.000	0.000	0.000	0.074	my9500_rel_o2nofp.cz13a_c32r128

Delete response time histogram

256us	1ms	4ms	16ms	64ms	256ms	1s	4s	16s	gt	max	tag
0.000	0.677	76.117	23.066	0.133	0.006	0.001	0.000	0.000	0.000	0.727	my5651_rel_o2nofp.cz12a_c32r128
0.000	1.163	97.759	1.069	0.009	0.000	0.000	0.000	0.000	0.000	0.051	my5744_rel_o2nofp.cz12a_c32r128
0.000	0.001	99.895	0.097	0.007	nonzero	0.000	0.000	0.000	0.000	0.067	my8043_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.773	0.218	0.008	0.000	0.000	0.000	0.000	0.000	0.036	my8044_rel_o2nofp.cz12a_c32r128
0.000	0.001	99.792	0.196	0.011	0.000	0.000	0.000	0.000	0.000	0.059	my8406_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.814	0.175	0.010	0.000	0.000	0.000	0.000	0.000	0.058	my8407_rel_o2nofp.cz12a_c32r128
0.000	0.001	99.631	0.360	0.007	nonzero	0.000	0.000	0.000	0.000	0.064	my8407_rel_o2nofp.cz12a_nocb_c32r128
0.000	0.000	99.876	0.113	0.010	0.000	0.000	0.000	0.000	0.000	0.057	my9400_rel_o2nofp.cz12a_c32r128
0.000	nonzero	99.809	0.179	0.011	0.000	0.000	0.000	0.000	0.000	0.035	my9500_rel_o2nofp.cz12a_c32r128
0.000	0.000	99.837	0.150	0.012	nonzero	0.000	0.000	0.000	0.000	0.073	my9500_rel_o2nofp.cz13a_c32r128