This is a report for the insert benchmark with 1280M docs and 20 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.
The test server is an ax162-s from Hetzner (see here) with 48 cores, AMD SMT disabled, 128G RAM and ext4 using 2 NVMe devices with SW RAID 1. The benchmark was run with 20 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables with a table per client. It loads 64M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 4m+1m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is larger than memory. Clients and the DBMS share one server.
The tested DBMS are:
The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.
dbms | l.i0 | l.x | l.i1 | l.i2 | qr100 | qp100 | qr500 | qp500 | qr1000 | qp1000 |
---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 1936460 | 2942529 | 73937 | 8532 | 376934 | 22038 | 341294 | 18255 | 274450 | 12827 |
pg164_o2nofp.cx9a2a_c32r128 | 1951220 | 2976744 | 73801 | 7015 | 376412 | 24387 | 340022 | 18439 | 275278 | 12643 |
pg17beta3_o2nofp.cx9a2a_c32r128 | 1972265 | 3368421 | 67969 | 7323 | 378857 | 22963 | 343246 | 18539 | 278876 | 12324 |
pg17rc1_o2nofp.cx9a2a_c32r128 | 2006270 | 3316062 | 73529 | 6500 | 380459 | 24369 | 342689 | 18177 | 270542 | 12472 |
This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.
dbms | l.i0 | l.x | l.i1 | l.i2 | qr100 | qp100 | qr500 | qp500 | qr1000 | qp1000 |
---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
pg164_o2nofp.cx9a2a_c32r128 | 1.01 | 1.01 | 1.00 | 0.82 | 1.00 | 1.11 | 1.00 | 1.01 | 1.00 | 0.99 |
pg17beta3_o2nofp.cx9a2a_c32r128 | 1.02 | 1.14 | 0.92 | 0.86 | 1.01 | 1.04 | 1.01 | 1.02 | 1.02 | 0.96 |
pg17rc1_o2nofp.cx9a2a_c32r128 | 1.04 | 1.13 | 0.99 | 0.76 | 1.01 | 1.11 | 1.00 | 1.00 | 0.99 | 0.97 |
This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.
dbms | qr100.L1 | qp100.L2 | qr500.L3 | qp500.L4 | qr1000.L5 | qp1000.L6 |
---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 1977 | 1977 | 9868 | 9879 | 19672 | 19694 |
pg164_o2nofp.cx9a2a_c32r128 | 1977 | 1977 | 9847 | 9868 | 19715 | 19651 |
pg17beta3_o2nofp.cx9a2a_c32r128 | 1977 | 1976 | 9863 | 9879 | 19704 | 19715 |
pg17rc1_o2nofp.cx9a2a_c32r128 | 1977 | 1977 | 9852 | 9879 | 19640 | 19661 |
target | 2000 | 2000 | 10000 | 10000 | 20000 | 20000 |
l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.
Average throughput:
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 89.099 | 10.747 | 0.084 | 0.055 | 0.008 | 0.006 | 0.001 | 2.275 | |||
pg164_o2nofp.cx9a2a_c32r128 | 87.870 | 11.971 | 0.086 | 0.059 | 0.008 | 0.006 | nonzero | 1.449 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 89.346 | 10.463 | 0.125 | 0.049 | 0.010 | 0.006 | nonzero | 1.245 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 90.440 | 9.379 | 0.115 | 0.049 | 0.010 | 0.007 | nonzero | 1.286 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1936460 0 265 2.8 8870.5 832.3 0.000 0.002 0.005 0.440 307077 56.1 0.159 14 122.5 218.5 17.5 2.275 107415 4795 pg158_o2nofp.cx9a2a_c32r128 1951220 0 229 1.8 8916.3 838.4 0.000 0.001 0.005 0.440 361847 55.7 0.185 14 122.5 218.5 10.1 1.449 108683 9140 pg164_o2nofp.cx9a2a_c32r128 1972265 0 241 2.0 9001.4 848.2 0.000 0.001 0.005 0.440 351303 55.2 0.178 13 122.5 218.5 25.2 1.245 110282 9290 pg17beta3_o2nofp.cx9a2a_c32r128 2006270 0 217 1.8 9140.8 859.6 0.000 0.001 0.005 0.439 349082 55.8 0.174 13 122.5 218.5 95.9 1.286 110856 17681 pg17rc1_o2nofp.cx9a2a_c32r128
l.x: create secondary indexes.
Average throughput:
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 2942529 0 9077 556.6 8407.6 871.6 0.003 0.194 0.003 0.303 141800 22.8 0.048 4 245.9 342.0 18.0 0.002 NA NA pg158_o2nofp.cx9a2a_c32r128 2976744 0 9310 553.9 8567.3 882.1 0.003 0.191 0.003 0.303 152447 22.1 0.051 4 245.9 342.0 19.5 0.074 NA NA pg164_o2nofp.cx9a2a_c32r128 3368421 0 10370 637.2 9383.1 991.5 0.003 0.194 0.003 0.301 84592 23.8 0.025 3 245.9 341.9 17.1 0.002 NA NA pg17beta3_o2nofp.cx9a2a_c32r128 3316062 0 10364 647.9 9302.1 980.2 0.003 0.200 0.003 0.303 82090 24.0 0.025 3 245.9 341.9 18.0 0.002 NA NA pg17rc1_o2nofp.cx9a2a_c32r128
l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.
Average throughput:
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.582 | 75.621 | 11.599 | 12.059 | 0.118 | 0.021 | 0.001 | 1.507 | |||
pg164_o2nofp.cx9a2a_c32r128 | 0.356 | 75.606 | 12.336 | 11.605 | 0.074 | 0.021 | 0.003 | 1.802 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.743 | 75.187 | 11.551 | 12.379 | 0.122 | 0.016 | 0.002 | 1.659 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 1.220 | 74.438 | 11.768 | 12.454 | 0.101 | 0.017 | 0.002 | 1.452 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 7.662 | 29.932 | 45.957 | 16.358 | 0.086 | 0.004 | nonzero | 1.010 | |||
pg164_o2nofp.cx9a2a_c32r128 | 7.330 | 27.116 | 48.767 | 16.731 | 0.054 | 0.001 | 0.001 | 1.702 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 8.228 | 26.491 | 43.985 | 21.198 | 0.094 | 0.003 | nonzero | 1.282 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 8.343 | 29.902 | 44.096 | 17.566 | 0.089 | 0.004 | nonzero | 1.225 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 73937 0 11447 162.0 18132.8 868.8 0.155 2.243 0.245 12.032 67266 32.9 0.910 214 257.5 353.5 37.2 1.507 3996 849 pg158_o2nofp.cx9a2a_c32r128 73801 0 11680 163.3 17855.1 871.0 0.158 2.266 0.242 12.086 67237 33.9 0.911 220 257.6 353.6 52.7 1.802 3098 999 pg164_o2nofp.cx9a2a_c32r128 67969 0 10594 149.1 17486.3 826.0 0.156 2.247 0.257 12.444 60819 32.7 0.895 231 257.6 353.6 0.8 1.659 3697 1099 pg17beta3_o2nofp.cx9a2a_c32r128 73529 0 11488 163.3 17636.0 837.5 0.156 2.274 0.240 11.663 65344 32.2 0.889 210 256.7 373.6 94.0 1.452 3248 1099 pg17rc1_o2nofp.cx9a2a_c32r128
l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.
Average throughput:
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 9.100 | 90.877 | 0.019 | 0.002 | nonzero | 0.001 | nonzero | 0.766 | |||
pg164_o2nofp.cx9a2a_c32r128 | 7.251 | 92.708 | 0.037 | 0.001 | 0.001 | 0.001 | 0.001 | 0.720 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 15.558 | 84.379 | 0.053 | 0.008 | 0.001 | 0.001 | nonzero | 0.535 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 10.046 | 89.913 | 0.036 | 0.003 | 0.001 | 0.001 | 0.001 | 0.563 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.260 | 2.547 | 20.683 | 75.152 | 1.357 | nonzero | 0.112 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 23.701 | 72.703 | 3.596 | nonzero | 0.087 | ||||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.440 | 4.699 | 38.177 | 51.243 | 5.441 | nonzero | nonzero | 0.279 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.515 | 2.439 | 18.707 | 71.610 | 6.728 | 0.001 | 0.112 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 8532 0 119 4.8 3757.9 127.4 0.014 0.572 0.440 15.285 42559 26.2 4.988 1474 258.1 354.2 36.5 0.766 400 260 pg158_o2nofp.cx9a2a_c32r128 7015 0 135 2.8 3132.7 111.2 0.019 0.405 0.447 16.239 35069 21.4 4.999 1464 258.0 354.1 36.5 0.720 585 340 pg164_o2nofp.cx9a2a_c32r128 7323 0 178 7.0 3193.2 108.8 0.024 0.978 0.436 15.213 32591 20.1 4.450 1317 258.3 354.3 5.2 0.535 795 509 pg17beta3_o2nofp.cx9a2a_c32r128 6500 0 128 5.4 2705.5 96.7 0.020 0.844 0.416 15.239 28973 23.1 4.457 1706 257.8 353.9 94.0 0.563 1364 685 pg17rc1_o2nofp.cx9a2a_c32r128
qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 99.995 | 0.003 | 0.002 | nonzero | nonzero | 0.016 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 99.994 | 0.004 | 0.002 | nonzero | nonzero | 0.016 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 99.995 | 0.003 | 0.002 | nonzero | nonzero | 0.017 | |||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 99.995 | 0.003 | 0.002 | nonzero | nonzero | 0.016 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 98.368 | 1.632 | 0.015 | ||||||||
pg164_o2nofp.cx9a2a_c32r128 | 98.653 | 1.331 | 0.017 | 0.036 | |||||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 98.254 | 1.731 | 0.015 | 0.018 | |||||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 98.343 | 1.639 | 0.018 | 0.019 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 44.742 | 55.056 | 0.203 | 0.012 | |||||||
pg164_o2nofp.cx9a2a_c32r128 | 46.999 | 52.792 | 0.182 | 0.028 | 0.034 | ||||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 49.183 | 50.600 | 0.217 | 0.014 | |||||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 47.503 | 52.293 | 0.204 | 0.015 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 376934 21 0.8 958.7 32.3 0.000 0.002 0.485 16.720 1431543 42.7 3.798 54 258.1 354.2 96.4 0.016 19275 17837 pg158_o2nofp.cx9a2a_c32r128 1977 376412 32 1.0 906.4 32.3 0.000 0.003 0.458 16.730 1429376 42.7 3.797 54 258.0 354.1 96.2 0.016 18924 17405 pg164_o2nofp.cx9a2a_c32r128 1977 378857 28 0.9 920.8 32.3 0.000 0.002 0.466 16.752 1438152 42.7 3.796 54 258.3 354.3 0.7 0.017 19314 17539 pg17beta3_o2nofp.cx9a2a_c32r128 1977 380459 27 0.8 950.1 32.2 0.000 0.002 0.481 16.675 1444480 42.7 3.797 54 257.9 353.9 95.8 0.016 19387 17821 pg17rc1_o2nofp.cx9a2a_c32r128
qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 13.026 | 83.449 | 2.805 | 0.144 | 0.575 | nonzero | nonzero | nonzero | 1.986 | ||
pg164_o2nofp.cx9a2a_c32r128 | 13.197 | 83.283 | 2.760 | 0.114 | 0.645 | nonzero | nonzero | 0.950 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 12.298 | 84.094 | 2.911 | 0.105 | 0.591 | nonzero | nonzero | nonzero | 3.020 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 12.051 | 84.550 | 2.650 | 0.098 | 0.650 | nonzero | nonzero | nonzero | 2.336 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.183 | 67.256 | 32.146 | 0.279 | 0.081 | 0.056 | 1.131 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 0.415 | 64.981 | 34.485 | 0.061 | 0.058 | 0.819 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.365 | 66.408 | 32.867 | 0.172 | 0.129 | 0.058 | 2.658 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.331 | 69.633 | 29.837 | 0.171 | 0.001 | 0.026 | 2.132 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 91.024 | 4.197 | 4.775 | 0.001 | 0.001 | 0.001 | 1.035 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 97.057 | 0.378 | 2.558 | 0.007 | 0.798 | ||||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 94.640 | 2.769 | 2.540 | 0.003 | 0.044 | 0.003 | 2.459 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 93.318 | 3.949 | 2.718 | 0.015 | 0.121 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 22038 74676 611.7 6343.5 69.7 3.389 28.423 3.209 36.122 240928 26.0 10.932 566 258.1 354.2 96.0 1.986 1231 511 pg158_o2nofp.cx9a2a_c32r128 1977 24387 81267 665.7 6299.9 69.6 3.332 27.953 3.187 36.072 264365 29.1 10.840 573 258.0 354.1 96.1 0.950 1518 528 pg164_o2nofp.cx9a2a_c32r128 1976 22963 77666 636.1 6307.8 69.6 3.382 28.367 3.193 36.058 252175 27.3 10.982 571 258.3 354.3 0.9 3.020 1359 495 pg17beta3_o2nofp.cx9a2a_c32r128 1977 24369 81806 670.1 6336.1 69.7 3.357 28.159 3.205 36.105 265279 29.3 10.886 577 257.9 353.9 95.2 2.336 1295 543 pg17rc1_o2nofp.cx9a2a_c32r128
qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 99.971 | 0.025 | 0.004 | nonzero | nonzero | nonzero | nonzero | nonzero | 2.245 | ||
pg164_o2nofp.cx9a2a_c32r128 | 99.966 | 0.029 | 0.004 | 0.001 | nonzero | nonzero | nonzero | nonzero | 2.780 | ||
pg17beta3_o2nofp.cx9a2a_c32r128 | 99.972 | 0.023 | 0.005 | nonzero | nonzero | nonzero | nonzero | nonzero | 2.856 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 99.972 | 0.023 | 0.005 | 0.001 | nonzero | nonzero | nonzero | nonzero | 1.805 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 49.161 | 47.788 | 2.636 | 0.146 | 0.197 | 0.072 | 3.318 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 46.541 | 51.200 | 1.964 | 0.089 | 0.135 | 0.072 | 3.308 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 52.125 | 45.525 | 2.053 | 0.097 | 0.140 | 0.060 | 3.487 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 51.771 | 45.785 | 2.152 | 0.085 | 0.140 | 0.066 | 0.001 | 4.779 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 81.164 | 18.612 | 0.207 | 0.003 | 0.009 | 0.004 | 2.262 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 76.658 | 23.199 | 0.138 | 0.001 | 0.001 | 0.002 | 2.002 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 82.697 | 17.156 | 0.141 | 0.001 | 0.003 | 0.001 | 2.238 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 74.422 | 25.429 | 0.141 | 0.003 | 0.004 | 0.001 | 3.538 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9868 341294 6173 53.6 7235.0 163.4 0.018 0.161 0.733 16.960 1292858 46.3 3.788 65 258.4 354.4 86.6 2.245 17389 14800 pg158_o2nofp.cx9a2a_c32r128 9847 340022 6209 53.7 7229.2 163.8 0.018 0.162 0.734 17.030 1287051 45.7 3.785 65 258.2 354.3 88.7 2.780 17405 14998 pg164_o2nofp.cx9a2a_c32r128 9863 343246 6185 53.7 7231.3 163.7 0.018 0.160 0.733 16.992 1298423 46.2 3.783 65 258.4 354.5 84.0 2.856 17565 15503 pg17beta3_o2nofp.cx9a2a_c32r128 9852 342689 6171 53.7 7240.0 163.7 0.018 0.160 0.735 17.012 1297163 46.2 3.785 65 258.2 354.3 84.7 1.805 17453 15296 pg17rc1_o2nofp.cx9a2a_c32r128
qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 3.198 | 86.614 | 8.888 | 0.114 | 1.180 | 0.003 | 0.003 | nonzero | 1.015 | ||
pg164_o2nofp.cx9a2a_c32r128 | 3.184 | 86.722 | 8.835 | 0.036 | 1.220 | 0.001 | 0.002 | nonzero | 2.913 | ||
pg17beta3_o2nofp.cx9a2a_c32r128 | 3.142 | 86.366 | 9.216 | 0.044 | 1.229 | 0.001 | 0.001 | 0.964 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 3.138 | 86.333 | 9.290 | 0.046 | 1.189 | 0.002 | 0.002 | nonzero | 1.599 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.089 | 63.384 | 35.992 | 0.289 | 0.234 | 0.013 | 1.654 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 0.103 | 69.971 | 29.637 | 0.115 | 0.157 | 0.016 | 2.515 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.113 | 65.192 | 34.458 | 0.120 | 0.114 | 0.003 | 1.276 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.105 | 66.761 | 32.803 | 0.150 | 0.175 | 0.007 | 1.526 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 1.232 | 93.355 | 5.222 | 0.107 | 0.084 | 0.001 | 1.023 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 2.301 | 94.334 | 3.240 | 0.058 | 0.066 | 0.001 | 2.395 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 2.474 | 93.966 | 3.454 | 0.051 | 0.055 | 0.676 | |||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 2.123 | 94.390 | 3.346 | 0.071 | 0.070 | 0.976 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9879 18255 90692 723.7 22073.7 266.3 4.968 40.597 2.234 27.603 258913 36.8 14.183 968 259.7 355.7 82.8 1.015 1007 368 pg158_o2nofp.cx9a2a_c32r128 9868 18439 91127 726.3 22077.6 265.4 4.942 40.334 2.237 27.538 261871 37.6 14.202 979 259.7 355.7 86.5 2.913 991 384 pg164_o2nofp.cx9a2a_c32r128 9879 18539 91634 730.4 21986.3 264.9 4.943 40.343 2.226 27.456 261012 38.3 14.079 992 259.7 355.7 84.0 0.964 991 431 pg17beta3_o2nofp.cx9a2a_c32r128 9879 18177 90430 720.9 22048.6 266.2 4.975 40.609 2.232 27.590 257422 37.5 14.162 990 259.5 355.6 84.7 1.599 975 415 pg17rc1_o2nofp.cx9a2a_c32r128
qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 99.811 | 0.154 | 0.019 | 0.010 | 0.007 | nonzero | nonzero | nonzero | 3.735 | ||
pg164_o2nofp.cx9a2a_c32r128 | 99.828 | 0.141 | 0.017 | 0.009 | 0.005 | nonzero | nonzero | nonzero | 1.990 | ||
pg17beta3_o2nofp.cx9a2a_c32r128 | 99.837 | 0.133 | 0.017 | 0.008 | 0.005 | nonzero | nonzero | nonzero | 3.412 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 99.813 | 0.149 | 0.019 | 0.011 | 0.007 | nonzero | nonzero | nonzero | 3.889 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 51.576 | 34.815 | 12.723 | 0.772 | 0.087 | 0.028 | nonzero | 4.251 | |||
pg164_o2nofp.cx9a2a_c32r128 | 54.289 | 33.640 | 11.507 | 0.483 | 0.063 | 0.018 | nonzero | 4.675 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 54.197 | 34.015 | 11.336 | 0.389 | 0.052 | 0.011 | 0.001 | 5.129 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 51.511 | 33.755 | 13.585 | 1.075 | 0.057 | 0.015 | 0.002 | 4.875 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 4.603 | 24.946 | 51.781 | 18.320 | 0.336 | 0.012 | 0.002 | 3.759 | |||
pg164_o2nofp.cx9a2a_c32r128 | 4.723 | 24.120 | 54.570 | 16.377 | 0.205 | 0.005 | 0.001 | 2.352 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 5.162 | 26.366 | 49.319 | 18.986 | 0.161 | 0.005 | nonzero | 3.957 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 4.185 | 23.800 | 50.293 | 21.297 | 0.418 | 0.006 | 0.001 | nonzero | 4.276 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19672 274450 8289 114.0 14837.7 417.3 0.030 0.425 0.754 21.721 977416 55.8 3.561 98 263.5 359.6 52.9 3.735 13873 9478 pg158_o2nofp.cx9a2a_c32r128 19715 275278 8355 115.0 15320.5 423.0 0.030 0.428 0.777 21.972 980254 56.4 3.561 98 263.5 359.6 56.8 1.990 13878 9247 pg164_o2nofp.cx9a2a_c32r128 19704 278876 8363 114.9 15193.3 421.4 0.030 0.422 0.771 21.902 992902 56.6 3.560 97 263.3 359.4 92.2 3.412 14001 9989 pg17beta3_o2nofp.cx9a2a_c32r128 19640 270542 8314 114.5 15215.7 420.8 0.031 0.433 0.775 21.940 962296 56.0 3.557 99 263.5 359.5 91.9 3.889 13658 8423 pg17rc1_o2nofp.cx9a2a_c32r128
qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.427 | 65.808 | 31.491 | 0.396 | 1.868 | 0.005 | 0.005 | nonzero | 1.539 | ||
pg164_o2nofp.cx9a2a_c32r128 | 0.437 | 64.744 | 32.703 | 0.290 | 1.817 | 0.003 | 0.005 | nonzero | nonzero | 5.200 | |
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.353 | 62.481 | 34.883 | 0.298 | 1.976 | 0.004 | 0.004 | nonzero | 1.443 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.387 | 63.429 | 34.014 | 0.282 | 1.881 | 0.003 | 0.004 | nonzero | nonzero | 4.045 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.388 | 58.457 | 40.701 | 0.281 | 0.155 | 0.018 | 1.548 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 0.392 | 57.575 | 41.677 | 0.188 | 0.159 | 0.006 | 0.002 | 5.135 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.370 | 57.125 | 42.122 | 0.236 | 0.138 | 0.009 | 1.578 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.403 | 58.136 | 41.035 | 0.292 | 0.117 | 0.017 | 0.001 | 4.015 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 15.328 | 78.871 | 5.638 | 0.074 | 0.082 | 0.008 | 1.541 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 9.462 | 86.353 | 4.063 | 0.046 | 0.072 | 0.004 | 1.425 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 13.438 | 82.121 | 4.328 | 0.044 | 0.066 | 0.003 | 1.390 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 11.808 | 83.662 | 4.427 | 0.037 | 0.059 | 0.007 | 3.293 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19694 12827 95103 755.4 35291.8 468.9 7.414 60.303 1.792 24.380 249349 43.6 19.439 1632 264.5 360.5 89.3 1.539 671 192 pg158_o2nofp.cx9a2a_c32r128 19651 12643 94256 748.7 34953.8 464.7 7.455 60.639 1.779 24.217 246802 44.4 19.521 1686 264.5 360.5 56.5 5.200 671 223 pg164_o2nofp.cx9a2a_c32r128 19715 12324 93129 739.8 34984.8 465.0 7.557 61.470 1.775 24.150 243843 45.1 19.787 1757 264.4 360.4 86.4 1.443 655 224 pg17beta3_o2nofp.cx9a2a_c32r128 19661 12472 93538 742.9 34892.1 465.4 7.500 61.001 1.775 24.237 244953 44.3 19.641 1705 264.4 360.4 78.1 4.045 655 192 pg17rc1_o2nofp.cx9a2a_c32r128
l.i0: load without secondary indexes
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1936460 0 265 2.8 8870.5 832.3 0.000 0.002 0.005 0.440 307077 56.1 0.159 14 122.5 218.5 17.5 2.275 107415 4795 pg158_o2nofp.cx9a2a_c32r128 1951220 0 229 1.8 8916.3 838.4 0.000 0.001 0.005 0.440 361847 55.7 0.185 14 122.5 218.5 10.1 1.449 108683 9140 pg164_o2nofp.cx9a2a_c32r128 1972265 0 241 2.0 9001.4 848.2 0.000 0.001 0.005 0.440 351303 55.2 0.178 13 122.5 218.5 25.2 1.245 110282 9290 pg17beta3_o2nofp.cx9a2a_c32r128 2006270 0 217 1.8 9140.8 859.6 0.000 0.001 0.005 0.439 349082 55.8 0.174 13 122.5 218.5 95.9 1.286 110856 17681 pg17rc1_o2nofp.cx9a2a_c32r128
l.x: create secondary indexes
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 2942529 0 9077 556.6 8407.6 871.6 0.003 0.194 0.003 0.303 141800 22.8 0.048 4 245.9 342.0 18.0 0.002 NA NA pg158_o2nofp.cx9a2a_c32r128 2976744 0 9310 553.9 8567.3 882.1 0.003 0.191 0.003 0.303 152447 22.1 0.051 4 245.9 342.0 19.5 0.074 NA NA pg164_o2nofp.cx9a2a_c32r128 3368421 0 10370 637.2 9383.1 991.5 0.003 0.194 0.003 0.301 84592 23.8 0.025 3 245.9 341.9 17.1 0.002 NA NA pg17beta3_o2nofp.cx9a2a_c32r128 3316062 0 10364 647.9 9302.1 980.2 0.003 0.200 0.003 0.303 82090 24.0 0.025 3 245.9 341.9 18.0 0.002 NA NA pg17rc1_o2nofp.cx9a2a_c32r128
l.i1: continue load after secondary indexes created with 50 inserts per transaction
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 73937 0 11447 162.0 18132.8 868.8 0.155 2.243 0.245 12.032 67266 32.9 0.910 214 257.5 353.5 37.2 1.507 3996 849 pg158_o2nofp.cx9a2a_c32r128 73801 0 11680 163.3 17855.1 871.0 0.158 2.266 0.242 12.086 67237 33.9 0.911 220 257.6 353.6 52.7 1.802 3098 999 pg164_o2nofp.cx9a2a_c32r128 67969 0 10594 149.1 17486.3 826.0 0.156 2.247 0.257 12.444 60819 32.7 0.895 231 257.6 353.6 0.8 1.659 3697 1099 pg17beta3_o2nofp.cx9a2a_c32r128 73529 0 11488 163.3 17636.0 837.5 0.156 2.274 0.240 11.663 65344 32.2 0.889 210 256.7 373.6 94.0 1.452 3248 1099 pg17rc1_o2nofp.cx9a2a_c32r128
l.i2: continue load after secondary indexes created with 5 inserts per transaction
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 8532 0 119 4.8 3757.9 127.4 0.014 0.572 0.440 15.285 42559 26.2 4.988 1474 258.1 354.2 36.5 0.766 400 260 pg158_o2nofp.cx9a2a_c32r128 7015 0 135 2.8 3132.7 111.2 0.019 0.405 0.447 16.239 35069 21.4 4.999 1464 258.0 354.1 36.5 0.720 585 340 pg164_o2nofp.cx9a2a_c32r128 7323 0 178 7.0 3193.2 108.8 0.024 0.978 0.436 15.213 32591 20.1 4.450 1317 258.3 354.3 5.2 0.535 795 509 pg17beta3_o2nofp.cx9a2a_c32r128 6500 0 128 5.4 2705.5 96.7 0.020 0.844 0.416 15.239 28973 23.1 4.457 1706 257.8 353.9 94.0 0.563 1364 685 pg17rc1_o2nofp.cx9a2a_c32r128
qr100.L1: range queries with 100 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 376934 21 0.8 958.7 32.3 0.000 0.002 0.485 16.720 1431543 42.7 3.798 54 258.1 354.2 96.4 0.016 19275 17837 pg158_o2nofp.cx9a2a_c32r128 1977 376412 32 1.0 906.4 32.3 0.000 0.003 0.458 16.730 1429376 42.7 3.797 54 258.0 354.1 96.2 0.016 18924 17405 pg164_o2nofp.cx9a2a_c32r128 1977 378857 28 0.9 920.8 32.3 0.000 0.002 0.466 16.752 1438152 42.7 3.796 54 258.3 354.3 0.7 0.017 19314 17539 pg17beta3_o2nofp.cx9a2a_c32r128 1977 380459 27 0.8 950.1 32.2 0.000 0.002 0.481 16.675 1444480 42.7 3.797 54 257.9 353.9 95.8 0.016 19387 17821 pg17rc1_o2nofp.cx9a2a_c32r128
qp100.L2: point queries with 100 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 22038 74676 611.7 6343.5 69.7 3.389 28.423 3.209 36.122 240928 26.0 10.932 566 258.1 354.2 96.0 1.986 1231 511 pg158_o2nofp.cx9a2a_c32r128 1977 24387 81267 665.7 6299.9 69.6 3.332 27.953 3.187 36.072 264365 29.1 10.840 573 258.0 354.1 96.1 0.950 1518 528 pg164_o2nofp.cx9a2a_c32r128 1976 22963 77666 636.1 6307.8 69.6 3.382 28.367 3.193 36.058 252175 27.3 10.982 571 258.3 354.3 0.9 3.020 1359 495 pg17beta3_o2nofp.cx9a2a_c32r128 1977 24369 81806 670.1 6336.1 69.7 3.357 28.159 3.205 36.105 265279 29.3 10.886 577 257.9 353.9 95.2 2.336 1295 543 pg17rc1_o2nofp.cx9a2a_c32r128
qr500.L3: range queries with 500 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9868 341294 6173 53.6 7235.0 163.4 0.018 0.161 0.733 16.960 1292858 46.3 3.788 65 258.4 354.4 86.6 2.245 17389 14800 pg158_o2nofp.cx9a2a_c32r128 9847 340022 6209 53.7 7229.2 163.8 0.018 0.162 0.734 17.030 1287051 45.7 3.785 65 258.2 354.3 88.7 2.780 17405 14998 pg164_o2nofp.cx9a2a_c32r128 9863 343246 6185 53.7 7231.3 163.7 0.018 0.160 0.733 16.992 1298423 46.2 3.783 65 258.4 354.5 84.0 2.856 17565 15503 pg17beta3_o2nofp.cx9a2a_c32r128 9852 342689 6171 53.7 7240.0 163.7 0.018 0.160 0.735 17.012 1297163 46.2 3.785 65 258.2 354.3 84.7 1.805 17453 15296 pg17rc1_o2nofp.cx9a2a_c32r128
qp500.L4: point queries with 500 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9879 18255 90692 723.7 22073.7 266.3 4.968 40.597 2.234 27.603 258913 36.8 14.183 968 259.7 355.7 82.8 1.015 1007 368 pg158_o2nofp.cx9a2a_c32r128 9868 18439 91127 726.3 22077.6 265.4 4.942 40.334 2.237 27.538 261871 37.6 14.202 979 259.7 355.7 86.5 2.913 991 384 pg164_o2nofp.cx9a2a_c32r128 9879 18539 91634 730.4 21986.3 264.9 4.943 40.343 2.226 27.456 261012 38.3 14.079 992 259.7 355.7 84.0 0.964 991 431 pg17beta3_o2nofp.cx9a2a_c32r128 9879 18177 90430 720.9 22048.6 266.2 4.975 40.609 2.232 27.590 257422 37.5 14.162 990 259.5 355.6 84.7 1.599 975 415 pg17rc1_o2nofp.cx9a2a_c32r128
qr1000.L5: range queries with 1000 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19672 274450 8289 114.0 14837.7 417.3 0.030 0.425 0.754 21.721 977416 55.8 3.561 98 263.5 359.6 52.9 3.735 13873 9478 pg158_o2nofp.cx9a2a_c32r128 19715 275278 8355 115.0 15320.5 423.0 0.030 0.428 0.777 21.972 980254 56.4 3.561 98 263.5 359.6 56.8 1.990 13878 9247 pg164_o2nofp.cx9a2a_c32r128 19704 278876 8363 114.9 15193.3 421.4 0.030 0.422 0.771 21.902 992902 56.6 3.560 97 263.3 359.4 92.2 3.412 14001 9989 pg17beta3_o2nofp.cx9a2a_c32r128 19640 270542 8314 114.5 15215.7 420.8 0.031 0.433 0.775 21.940 962296 56.0 3.557 99 263.5 359.5 91.9 3.889 13658 8423 pg17rc1_o2nofp.cx9a2a_c32r128
qp1000.L6: point queries with 1000 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19694 12827 95103 755.4 35291.8 468.9 7.414 60.303 1.792 24.380 249349 43.6 19.439 1632 264.5 360.5 89.3 1.539 671 192 pg158_o2nofp.cx9a2a_c32r128 19651 12643 94256 748.7 34953.8 464.7 7.455 60.639 1.779 24.217 246802 44.4 19.521 1686 264.5 360.5 56.5 5.200 671 223 pg164_o2nofp.cx9a2a_c32r128 19715 12324 93129 739.8 34984.8 465.0 7.557 61.470 1.775 24.150 243843 45.1 19.787 1757 264.4 360.4 86.4 1.443 655 224 pg17beta3_o2nofp.cx9a2a_c32r128 19661 12472 93538 742.9 34892.1 465.4 7.500 61.001 1.775 24.237 244953 44.3 19.641 1705 264.4 360.4 78.1 4.045 655 192 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 89.099 10.747 0.084 0.055 0.008 0.006 0.001 0.000 0.000 2.275 pg158_o2nofp.cx9a2a_c32r128 0.000 87.870 11.971 0.086 0.059 0.008 0.006 nonzero 0.000 0.000 1.449 pg164_o2nofp.cx9a2a_c32r128 0.000 89.346 10.463 0.125 0.049 0.010 0.006 nonzero 0.000 0.000 1.245 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 90.440 9.379 0.115 0.049 0.010 0.007 nonzero 0.000 0.000 1.286 pg17rc1_o2nofp.cx9a2a_c32r128
TODO - determine whether there is data for create index response time
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.582 75.621 11.599 12.059 0.118 0.021 0.001 0.000 0.000 1.507 pg158_o2nofp.cx9a2a_c32r128 0.000 0.356 75.606 12.336 11.605 0.074 0.021 0.003 0.000 0.000 1.802 pg164_o2nofp.cx9a2a_c32r128 0.000 0.743 75.187 11.551 12.379 0.122 0.016 0.002 0.000 0.000 1.659 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 1.220 74.438 11.768 12.454 0.101 0.017 0.002 0.000 0.000 1.452 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 7.662 29.932 45.957 16.358 0.086 0.004 nonzero 0.000 0.000 1.010 pg158_o2nofp.cx9a2a_c32r128 0.000 7.330 27.116 48.767 16.731 0.054 0.001 0.001 0.000 0.000 1.702 pg164_o2nofp.cx9a2a_c32r128 0.000 8.228 26.491 43.985 21.198 0.094 0.003 nonzero 0.000 0.000 1.282 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 8.343 29.902 44.096 17.566 0.089 0.004 nonzero 0.000 0.000 1.225 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 9.100 90.877 0.019 0.002 nonzero 0.001 nonzero 0.000 0.000 0.000 0.766 pg158_o2nofp.cx9a2a_c32r128 7.251 92.708 0.037 0.001 0.001 0.001 0.001 0.000 0.000 0.000 0.720 pg164_o2nofp.cx9a2a_c32r128 15.558 84.379 0.053 0.008 0.001 0.001 nonzero 0.000 0.000 0.000 0.535 pg17beta3_o2nofp.cx9a2a_c32r128 10.046 89.913 0.036 0.003 0.001 0.001 0.001 0.000 0.000 0.000 0.563 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.260 2.547 20.683 75.152 1.357 nonzero 0.000 0.000 0.000 0.000 0.112 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 23.701 72.703 3.596 nonzero 0.000 0.000 0.000 0.000 0.087 pg164_o2nofp.cx9a2a_c32r128 0.440 4.699 38.177 51.243 5.441 nonzero nonzero 0.000 0.000 0.000 0.279 pg17beta3_o2nofp.cx9a2a_c32r128 0.515 2.439 18.707 71.610 6.728 0.001 0.000 0.000 0.000 0.000 0.112 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 99.995 0.003 0.002 nonzero nonzero 0.000 0.000 0.000 0.000 0.000 0.016 pg158_o2nofp.cx9a2a_c32r128 99.994 0.004 0.002 nonzero nonzero 0.000 0.000 0.000 0.000 0.000 0.016 pg164_o2nofp.cx9a2a_c32r128 99.995 0.003 0.002 nonzero nonzero 0.000 0.000 0.000 0.000 0.000 0.017 pg17beta3_o2nofp.cx9a2a_c32r128 99.995 0.003 0.002 nonzero nonzero 0.000 0.000 0.000 0.000 0.000 0.016 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 98.368 1.632 0.000 0.000 0.000 0.000 0.000 0.000 0.015 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 98.653 1.331 0.017 0.000 0.000 0.000 0.000 0.000 0.036 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 98.254 1.731 0.015 0.000 0.000 0.000 0.000 0.000 0.018 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 98.343 1.639 0.018 0.000 0.000 0.000 0.000 0.000 0.019 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 44.742 55.056 0.203 0.000 0.000 0.000 0.000 0.000 0.000 0.012 pg158_o2nofp.cx9a2a_c32r128 0.000 46.999 52.792 0.182 0.028 0.000 0.000 0.000 0.000 0.000 0.034 pg164_o2nofp.cx9a2a_c32r128 0.000 49.183 50.600 0.217 0.000 0.000 0.000 0.000 0.000 0.000 0.014 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 47.503 52.293 0.204 0.000 0.000 0.000 0.000 0.000 0.000 0.015 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 13.026 83.449 2.805 0.144 0.575 nonzero nonzero nonzero 0.000 0.000 1.986 pg158_o2nofp.cx9a2a_c32r128 13.197 83.283 2.760 0.114 0.645 nonzero nonzero 0.000 0.000 0.000 0.950 pg164_o2nofp.cx9a2a_c32r128 12.298 84.094 2.911 0.105 0.591 nonzero nonzero nonzero 0.000 0.000 3.020 pg17beta3_o2nofp.cx9a2a_c32r128 12.051 84.550 2.650 0.098 0.650 nonzero nonzero nonzero 0.000 0.000 2.336 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.183 67.256 32.146 0.279 0.081 0.056 0.000 0.000 1.131 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.415 64.981 34.485 0.061 0.058 0.000 0.000 0.000 0.819 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.365 66.408 32.867 0.172 0.129 0.058 0.000 0.000 2.658 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.331 69.633 29.837 0.171 0.001 0.026 0.000 0.000 2.132 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 91.024 4.197 4.775 0.001 0.001 0.001 0.000 0.000 1.035 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 97.057 0.378 2.558 0.000 0.007 0.000 0.000 0.000 0.798 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 94.640 2.769 2.540 0.003 0.044 0.003 0.000 0.000 2.459 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 93.318 3.949 2.718 0.015 0.000 0.000 0.000 0.000 0.121 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 99.971 0.025 0.004 nonzero nonzero nonzero nonzero nonzero 0.000 0.000 2.245 pg158_o2nofp.cx9a2a_c32r128 99.966 0.029 0.004 0.001 nonzero nonzero nonzero nonzero 0.000 0.000 2.780 pg164_o2nofp.cx9a2a_c32r128 99.972 0.023 0.005 nonzero nonzero nonzero nonzero nonzero 0.000 0.000 2.856 pg17beta3_o2nofp.cx9a2a_c32r128 99.972 0.023 0.005 0.001 nonzero nonzero nonzero nonzero 0.000 0.000 1.805 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 49.161 47.788 2.636 0.146 0.197 0.072 0.000 0.000 3.318 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 46.541 51.200 1.964 0.089 0.135 0.072 0.000 0.000 3.308 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 52.125 45.525 2.053 0.097 0.140 0.060 0.000 0.000 3.487 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 51.771 45.785 2.152 0.085 0.140 0.066 0.001 0.000 4.779 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 81.164 18.612 0.207 0.003 0.009 0.004 0.000 0.000 2.262 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 76.658 23.199 0.138 0.001 0.001 0.002 0.000 0.000 2.002 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 82.697 17.156 0.141 0.001 0.003 0.001 0.000 0.000 2.238 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 74.422 25.429 0.141 0.003 0.004 0.001 0.000 0.000 3.538 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 3.198 86.614 8.888 0.114 1.180 0.003 0.003 nonzero 0.000 0.000 1.015 pg158_o2nofp.cx9a2a_c32r128 3.184 86.722 8.835 0.036 1.220 0.001 0.002 nonzero 0.000 0.000 2.913 pg164_o2nofp.cx9a2a_c32r128 3.142 86.366 9.216 0.044 1.229 0.001 0.001 0.000 0.000 0.000 0.964 pg17beta3_o2nofp.cx9a2a_c32r128 3.138 86.333 9.290 0.046 1.189 0.002 0.002 nonzero 0.000 0.000 1.599 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.089 63.384 35.992 0.289 0.234 0.013 0.000 0.000 1.654 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.103 69.971 29.637 0.115 0.157 0.016 0.000 0.000 2.515 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.113 65.192 34.458 0.120 0.114 0.003 0.000 0.000 1.276 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.105 66.761 32.803 0.150 0.175 0.007 0.000 0.000 1.526 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 1.232 93.355 5.222 0.107 0.084 0.001 0.000 0.000 1.023 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 2.301 94.334 3.240 0.058 0.066 0.001 0.000 0.000 2.395 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 2.474 93.966 3.454 0.051 0.055 0.000 0.000 0.000 0.676 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 2.123 94.390 3.346 0.071 0.070 0.000 0.000 0.000 0.976 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 99.811 0.154 0.019 0.010 0.007 nonzero nonzero nonzero 0.000 0.000 3.735 pg158_o2nofp.cx9a2a_c32r128 99.828 0.141 0.017 0.009 0.005 nonzero nonzero nonzero 0.000 0.000 1.990 pg164_o2nofp.cx9a2a_c32r128 99.837 0.133 0.017 0.008 0.005 nonzero nonzero nonzero 0.000 0.000 3.412 pg17beta3_o2nofp.cx9a2a_c32r128 99.813 0.149 0.019 0.011 0.007 nonzero nonzero nonzero 0.000 0.000 3.889 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 51.576 34.815 12.723 0.772 0.087 0.028 nonzero 0.000 4.251 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 54.289 33.640 11.507 0.483 0.063 0.018 nonzero 0.000 4.675 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 54.197 34.015 11.336 0.389 0.052 0.011 0.001 0.000 5.129 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 51.511 33.755 13.585 1.075 0.057 0.015 0.002 0.000 4.875 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 4.603 24.946 51.781 18.320 0.336 0.012 0.002 0.000 0.000 3.759 pg158_o2nofp.cx9a2a_c32r128 0.000 4.723 24.120 54.570 16.377 0.205 0.005 0.001 0.000 0.000 2.352 pg164_o2nofp.cx9a2a_c32r128 0.000 5.162 26.366 49.319 18.986 0.161 0.005 nonzero 0.000 0.000 3.957 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 4.185 23.800 50.293 21.297 0.418 0.006 0.001 nonzero 0.000 4.276 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.427 65.808 31.491 0.396 1.868 0.005 0.005 nonzero 0.000 0.000 1.539 pg158_o2nofp.cx9a2a_c32r128 0.437 64.744 32.703 0.290 1.817 0.003 0.005 nonzero nonzero 0.000 5.200 pg164_o2nofp.cx9a2a_c32r128 0.353 62.481 34.883 0.298 1.976 0.004 0.004 nonzero 0.000 0.000 1.443 pg17beta3_o2nofp.cx9a2a_c32r128 0.387 63.429 34.014 0.282 1.881 0.003 0.004 nonzero nonzero 0.000 4.045 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.388 58.457 40.701 0.281 0.155 0.018 0.000 0.000 1.548 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.392 57.575 41.677 0.188 0.159 0.006 0.002 0.000 5.135 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.370 57.125 42.122 0.236 0.138 0.009 0.000 0.000 1.578 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.403 58.136 41.035 0.292 0.117 0.017 0.001 0.000 4.015 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 15.328 78.871 5.638 0.074 0.082 0.008 0.000 0.000 1.541 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 9.462 86.353 4.063 0.046 0.072 0.004 0.000 0.000 1.425 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 13.438 82.121 4.328 0.044 0.066 0.003 0.000 0.000 1.390 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 11.808 83.662 4.427 0.037 0.059 0.007 0.000 0.000 3.293 pg17rc1_o2nofp.cx9a2a_c32r128