This is a report for the insert benchmark with 4000M docs and 20 client(s). It is generated by scripts (bash, awk, sed) and Tufte might not be impressed. An overview of the insert benchmark is here and a short update is here. Below, by DBMS, I mean DBMS+version.config. An example is my8020.c10b40 where my means MySQL, 8020 is version 8.0.20 and c10b40 is the name for the configuration file.
The test server is an ax162-s from Hetzner (see here) with 48 cores, AMD SMT disabled, 128G RAM and ext4 using 2 NVMe devices with SW RAID 1. The benchmark was run with 20 clients and there were 1 or 3 connections per client (1 for queries or inserts without rate limits, 1+1 for rate limited inserts+deletes). It uses 8 tables with a table per client. It loads 200M rows per table without secondary indexes, creates 3 secondary indexes per table, then inserts 4m+1m rows per table with a delete per insert to avoid growing the table. It then does 6 read+write tests for 1800s each that do queries as fast as possible with 100,100,500,500,1000,1000 inserts/s and the same for deletes/s per client concurrent with the queries. The database is larger than memory. Clients and the DBMS share one server.
The tested DBMS are:
The numbers are inserts/s for l.i0, l.i1 and l.i2, indexed docs (or rows) /s for l.x and queries/s for qr100, qp100 thru qr1000, qp1000" The values are the average rate over the entire test for inserts (IPS) and queries (QPS). The range of values for IPS and QPS is split into 3 parts: bottom 25%, middle 50%, top 25%. Values in the bottom 25% have a red background, values in the top 25% have a green background and values in the middle have no color. A gray background is used for values that can be ignored because the DBMS did not sustain the target insert rate. Red backgrounds are not used when the minimum value is within 80% of the max value.
dbms | l.i0 | l.x | l.i1 | l.i2 | qr100 | qp100 | qr500 | qp500 | qr1000 | qp1000 |
---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 1989060 | 2673797 | 24661 | 2599 | 370777 | 9161 | 329629 | 5712 | 213552 | 3273 |
pg164_o2nofp.cx9a2a_c32r128 | 2004008 | 2875629 | 24331 | 2389 | 371220 | 9376 | 331352 | 6119 | 213497 | 3580 |
pg17beta3_o2nofp.cx9a2a_c32r128 | 2026342 | 3392706 | 24525 | 2404 | 372839 | 9191 | 331037 | 6013 | 213136 | 3481 |
pg17rc1_o2nofp.cx9a2a_c32r128 | 2039776 | 3436426 | 24316 | 2453 | 376989 | 9060 | 331207 | 5994 | 212570 | 3463 |
This table has relative throughput, throughput for the DBMS relative to the DBMS in the first line, using the absolute throughput from the previous table. Values less than 0.95 have a yellow background. Values greater than 1.05 have a blue background.
dbms | l.i0 | l.x | l.i1 | l.i2 | qr100 | qp100 | qr500 | qp500 | qr1000 | qp1000 |
---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
pg164_o2nofp.cx9a2a_c32r128 | 1.01 | 1.08 | 0.99 | 0.92 | 1.00 | 1.02 | 1.01 | 1.07 | 1.00 | 1.09 |
pg17beta3_o2nofp.cx9a2a_c32r128 | 1.02 | 1.27 | 0.99 | 0.92 | 1.01 | 1.00 | 1.00 | 1.05 | 1.00 | 1.06 |
pg17rc1_o2nofp.cx9a2a_c32r128 | 1.03 | 1.29 | 0.99 | 0.94 | 1.02 | 0.99 | 1.00 | 1.05 | 1.00 | 1.06 |
This lists the average rate of inserts/s for the tests that do inserts concurrent with queries. For such tests the query rate is listed in the table above. The read+write tests are setup so that the insert rate should match the target rate every second. Cells that are not at least 95% of the target have a red background to indicate a failure to satisfy the target.
dbms | qr100.L1 | qp100.L2 | qr500.L3 | qp500.L4 | qr1000.L5 | qp1000.L6 |
---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 1977 | 1977 | 9804 | 9863 | 19058 | 19180 |
pg164_o2nofp.cx9a2a_c32r128 | 1977 | 1977 | 9868 | 9874 | 18711 | 19544 |
pg17beta3_o2nofp.cx9a2a_c32r128 | 1976 | 1976 | 9847 | 9879 | 18692 | 19231 |
pg17rc1_o2nofp.cx9a2a_c32r128 | 1977 | 1977 | 9836 | 9841 | 18740 | 19210 |
target | 2000 | 2000 | 10000 | 10000 | 20000 | 20000 |
l.i0: load without secondary indexes. Graphs for performance per 1-second interval are here.
Average throughput:
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 87.809 | 11.979 | 0.105 | 0.089 | 0.012 | 0.005 | nonzero | 1.421 | |||
pg164_o2nofp.cx9a2a_c32r128 | 88.492 | 11.270 | 0.127 | 0.094 | 0.012 | 0.005 | nonzero | 2.357 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 89.344 | 10.390 | 0.150 | 0.097 | 0.013 | 0.005 | nonzero | 1.931 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 89.987 | 9.754 | 0.139 | 0.098 | 0.016 | 0.006 | nonzero | 1.330 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1989060 0 1724 13.5 8354.0 796.4 0.001 0.007 0.004 0.410 363377 57.4 0.183 14 382.7 478.8 6.9 1.421 107058 34962 pg158_o2nofp.cx9a2a_c32r128 2004008 0 1712 13.4 8441.4 806.0 0.001 0.007 0.004 0.412 370269 57.4 0.185 14 382.7 478.8 11.7 2.357 108383 35561 pg164_o2nofp.cx9a2a_c32r128 2026342 0 1701 13.7 8542.2 813.8 0.001 0.007 0.004 0.411 369422 57.0 0.182 14 382.7 478.8 95.4 1.931 109848 27470 pg17beta3_o2nofp.cx9a2a_c32r128 2039776 0 1732 13.9 8560.9 819.2 0.001 0.007 0.004 0.411 362999 57.3 0.178 13 382.7 478.8 97.2 1.330 110081 39857 pg17rc1_o2nofp.cx9a2a_c32r128
l.x: create secondary indexes.
Average throughput:
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 2673797 0 14849 943.0 7784.5 858.6 0.006 0.361 0.003 0.329 150424 20.6 0.056 4 768.4 864.5 52.1 0.013 NA NA pg158_o2nofp.cx9a2a_c32r128 2875629 0 14480 915.2 7489.3 821.6 0.005 0.326 0.003 0.293 156963 21.3 0.055 4 768.4 864.5 30.9 0.437 NA NA pg164_o2nofp.cx9a2a_c32r128 3392706 0 11078 1077.5 8622.4 964.1 0.003 0.325 0.003 0.291 89452 23.8 0.026 3 768.4 863.7 31.2 0.071 NA NA pg17beta3_o2nofp.cx9a2a_c32r128 3436426 0 11401 1091.1 8913.6 983.6 0.003 0.325 0.003 0.293 89973 23.7 0.026 3 768.4 863.7 39.3 0.003 NA NA pg17rc1_o2nofp.cx9a2a_c32r128
l.i1: continue load after secondary indexes created with 50 inserts per transaction. Graphs for performance per 1-second interval are here.
Average throughput:
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 21.007 | 70.392 | 8.352 | 0.126 | 0.122 | 3.352 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 21.845 | 70.089 | 7.871 | 0.086 | 0.109 | 2.887 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 19.950 | 70.859 | 8.979 | 0.104 | 0.108 | nonzero | 4.374 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 21.126 | 69.898 | 8.770 | 0.094 | 0.112 | 3.943 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 2.328 | 9.162 | 26.837 | 60.259 | 1.309 | 0.043 | 0.061 | 3.118 | |||
pg164_o2nofp.cx9a2a_c32r128 | 2.384 | 8.225 | 19.987 | 66.830 | 2.478 | 0.034 | 0.062 | 2.801 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 2.530 | 8.786 | 23.509 | 62.699 | 2.360 | 0.054 | 0.061 | 3.033 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 2.565 | 8.861 | 21.650 | 64.039 | 2.778 | 0.049 | 0.059 | 3.310 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 24661 0 31064 247.5 36812.6 807.2 1.260 10.279 1.493 33.516 90983 29.5 3.689 574 781.5 916.0 1.8 3.352 1299 0 pg158_o2nofp.cx9a2a_c32r128 24331 0 30718 244.9 36189.2 799.0 1.263 10.307 1.487 33.626 85551 30.6 3.516 604 781.5 877.6 2.0 2.887 1249 0 pg164_o2nofp.cx9a2a_c32r128 24525 0 31028 247.3 36654.9 801.5 1.265 10.324 1.495 33.465 85903 29.9 3.503 585 781.5 877.6 85.0 4.374 1199 0 pg17beta3_o2nofp.cx9a2a_c32r128 24316 0 30740 245.9 36359.7 797.3 1.264 10.355 1.495 33.577 85245 30.4 3.506 600 781.5 877.6 87.0 3.943 1249 0 pg17rc1_o2nofp.cx9a2a_c32r128
l.i2: continue load after secondary indexes created with 5 inserts per transaction. Graphs for performance per 1-second interval are here.
Average throughput:
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | nonzero | 37.786 | 61.878 | 0.235 | 0.040 | 0.030 | 0.027 | 0.004 | 2.449 | ||
pg164_o2nofp.cx9a2a_c32r128 | 0.100 | 34.705 | 64.849 | 0.151 | 0.152 | 0.018 | 0.020 | 0.006 | nonzero | 4.228 | |
pg17beta3_o2nofp.cx9a2a_c32r128 | nonzero | 42.802 | 57.096 | 0.033 | 0.029 | 0.016 | 0.020 | 0.004 | 3.570 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.040 | 40.582 | 59.136 | 0.082 | 0.110 | 0.022 | 0.022 | 0.006 | 3.845 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For the max column values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.043 | 0.090 | nonzero | 0.080 | 99.785 | 0.001 | 0.001 | nonzero | 1.053 | ||
pg164_o2nofp.cx9a2a_c32r128 | 0.227 | 2.776 | 1.892 | 0.137 | 94.965 | 0.002 | 0.001 | nonzero | 1.605 | ||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.066 | 99.933 | 0.001 | nonzero | 0.673 | ||||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.097 | 1.562 | 0.323 | 0.056 | 97.961 | 0.001 | 0.001 | nonzero | 1.920 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 2599 0 3236 28.4 4787.0 75.4 1.245 11.171 1.842 29.724 21387 30.3 8.229 5596 784.9 880.9 21.1 2.449 225 170 pg158_o2nofp.cx9a2a_c32r128 2389 0 3109 31.9 4693.4 74.9 1.302 13.655 1.965 32.130 19720 24.8 8.256 4984 784.8 880.9 3.6 4.228 215 180 pg164_o2nofp.cx9a2a_c32r128 2404 0 2925 23.3 4476.8 70.5 1.217 9.933 1.862 30.037 17975 30.6 7.477 6110 784.9 880.9 83.6 3.570 215 180 pg17beta3_o2nofp.cx9a2a_c32r128 2453 0 3078 26.8 4751.3 75.3 1.255 11.201 1.937 31.423 18439 26.8 7.516 5244 784.8 880.9 85.1 3.845 120 105 pg17rc1_o2nofp.cx9a2a_c32r128
qr100.L1: range queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 99.992 | 0.007 | 0.001 | nonzero | nonzero | 0.017 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 99.993 | 0.006 | 0.001 | nonzero | nonzero | nonzero | 0.084 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 99.992 | 0.007 | 0.001 | nonzero | nonzero | nonzero | 0.074 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 99.993 | 0.006 | 0.001 | nonzero | nonzero | 0.043 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 96.879 | 3.090 | 0.031 | 0.212 | |||||||
pg164_o2nofp.cx9a2a_c32r128 | 98.188 | 1.744 | 0.067 | 0.001 | 0.299 | ||||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 98.775 | 1.218 | 0.007 | 0.104 | |||||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 98.771 | 1.121 | 0.094 | 0.014 | 0.769 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 42.203 | 57.710 | 0.075 | 0.013 | 0.019 | ||||||
pg164_o2nofp.cx9a2a_c32r128 | 44.325 | 55.428 | 0.082 | 0.164 | 0.001 | 0.080 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 44.775 | 55.129 | 0.054 | 0.042 | 0.030 | ||||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 48.046 | 51.742 | 0.085 | 0.126 | 0.001 | 0.105 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 370777 2634 21.2 1370.6 37.3 0.007 0.059 0.693 19.322 1410562 43.1 3.804 56 785.0 881.0 96.3 0.017 18930 17038 pg158_o2nofp.cx9a2a_c32r128 1977 371220 2714 21.9 1263.6 36.3 0.007 0.060 0.639 18.811 1412498 42.9 3.805 55 784.9 881.0 94.5 0.084 18652 17086 pg164_o2nofp.cx9a2a_c32r128 1976 372839 2723 22.1 1211.3 35.8 0.007 0.061 0.613 18.542 1419178 43.0 3.806 55 785.0 881.0 94.5 0.074 19147 17277 pg17beta3_o2nofp.cx9a2a_c32r128 1977 376989 2718 21.9 1261.4 36.3 0.007 0.059 0.638 18.827 1434874 42.8 3.806 54 785.0 881.0 96.0 0.043 19147 17405 pg17rc1_o2nofp.cx9a2a_c32r128
qp100.L2: point queries with 100 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | nonzero | 3.019 | 93.920 | 0.674 | 2.381 | 0.003 | 0.002 | 0.002 | 3.858 | ||
pg164_o2nofp.cx9a2a_c32r128 | nonzero | 2.951 | 94.294 | 0.373 | 2.379 | 0.001 | 0.001 | 0.001 | 3.464 | ||
pg17beta3_o2nofp.cx9a2a_c32r128 | nonzero | 3.015 | 94.234 | 0.319 | 2.424 | 0.005 | 0.001 | 0.001 | nonzero | 4.227 | |
pg17rc1_o2nofp.cx9a2a_c32r128 | nonzero | 3.008 | 94.232 | 0.353 | 2.396 | 0.005 | 0.002 | 0.003 | nonzero | 4.902 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 63.615 | 35.526 | 0.282 | 0.306 | 0.271 | 3.653 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 61.718 | 37.722 | 0.167 | 0.219 | 0.174 | 2.600 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 64.808 | 34.531 | 0.214 | 0.163 | 0.272 | 0.013 | 4.061 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 65.578 | 33.178 | 0.379 | 0.418 | 0.415 | 0.032 | 4.781 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 92.969 | 3.343 | 3.635 | 0.007 | 0.028 | 0.018 | 2.653 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 94.350 | 2.307 | 3.233 | 0.106 | 0.004 | 1.948 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 93.264 | 3.033 | 3.636 | 0.006 | 0.036 | 0.025 | 1.840 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 93.369 | 3.221 | 3.263 | 0.040 | 0.057 | 0.047 | 0.003 | 4.676 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 9161 127620 1002.0 6634.6 76.4 13.930 112.003 3.356 39.589 288312 22.7 31.471 1189 785.1 881.2 91.7 3.858 480 32 pg158_o2nofp.cx9a2a_c32r128 1977 9376 130459 1024.4 6731.4 77.2 13.914 111.876 3.405 39.987 294200 23.2 31.377 1188 785.0 881.0 43.6 3.464 480 160 pg164_o2nofp.cx9a2a_c32r128 1976 9191 128073 1005.7 6833.4 77.8 13.934 112.045 3.459 40.316 288923 23.5 31.435 1227 785.1 881.1 90.9 4.227 479 i_qps pg17beta3_o2nofp.cx9a2a_c32r128 1977 9060 126266 991.5 6753.3 77.2 13.937 112.063 3.416 40.010 285487 22.8 31.511 1208 785.1 881.1 92.2 4.902 479 0 pg17rc1_o2nofp.cx9a2a_c32r128
qr500.L3: range queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 99.954 | 0.036 | 0.007 | 0.002 | 0.001 | nonzero | nonzero | nonzero | nonzero | 4.152 | |
pg164_o2nofp.cx9a2a_c32r128 | 99.965 | 0.028 | 0.005 | 0.001 | 0.001 | nonzero | nonzero | nonzero | 1.517 | ||
pg17beta3_o2nofp.cx9a2a_c32r128 | 99.963 | 0.029 | 0.006 | 0.002 | 0.001 | nonzero | nonzero | nonzero | 2.765 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 99.964 | 0.028 | 0.006 | 0.001 | 0.001 | nonzero | nonzero | nonzero | 1.642 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 73.568 | 25.291 | 0.520 | 0.450 | 0.166 | 0.005 | 4.628 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 86.592 | 12.662 | 0.344 | 0.331 | 0.072 | 2.536 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 84.968 | 14.101 | 0.427 | 0.383 | 0.118 | 0.004 | 4.394 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 83.947 | 15.207 | 0.352 | 0.363 | 0.131 | 3.832 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 29.986 | 68.006 | 1.929 | 0.026 | 0.031 | 0.021 | 0.001 | 4.199 | |||
pg164_o2nofp.cx9a2a_c32r128 | 34.301 | 64.564 | 1.117 | 0.005 | 0.009 | 0.004 | 1.875 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 34.182 | 64.334 | 1.465 | 0.008 | 0.009 | 0.002 | nonzero | 4.341 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 39.722 | 58.993 | 1.264 | 0.006 | 0.012 | 0.003 | 3.566 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9804 329629 13733 110.7 14315.1 240.4 0.042 0.344 1.460 25.114 1241708 48.8 3.767 71 785.7 881.8 89.4 4.152 16686 14129 pg158_o2nofp.cx9a2a_c32r128 9868 331352 13813 111.5 14416.8 242.1 0.042 0.345 1.461 25.119 1247923 48.8 3.766 71 785.4 881.4 85.8 1.517 16942 14400 pg164_o2nofp.cx9a2a_c32r128 9847 331037 13777 111.3 14431.6 242.1 0.042 0.344 1.466 25.181 1245582 49.0 3.763 71 785.5 881.5 85.6 2.765 16958 14304 pg17beta3_o2nofp.cx9a2a_c32r128 9836 331207 13775 111.1 14361.1 241.4 0.042 0.344 1.460 25.132 1248427 48.7 3.769 71 785.5 881.6 86.4 1.642 16979 14480 pg17rc1_o2nofp.cx9a2a_c32r128
qp500.L4: point queries with 500 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.256 | 93.460 | 1.974 | 4.284 | 0.014 | 0.011 | 0.001 | 2.426 | |||
pg164_o2nofp.cx9a2a_c32r128 | 0.300 | 94.611 | 0.982 | 4.085 | 0.010 | 0.011 | nonzero | 1.429 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.284 | 94.356 | 1.134 | 4.207 | 0.011 | 0.007 | 0.001 | 2.506 | |||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.302 | 94.383 | 1.143 | 4.144 | 0.016 | 0.011 | 0.002 | 3.977 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 49.773 | 49.423 | 0.466 | 0.296 | 0.042 | 2.198 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 48.949 | 50.421 | 0.305 | 0.308 | 0.017 | 1.562 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 47.623 | 51.841 | 0.289 | 0.227 | 0.020 | 2.215 | |||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 44.616 | 54.555 | 0.454 | 0.328 | 0.046 | 0.001 | 4.110 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 77.171 | 22.478 | 0.152 | 0.179 | 0.019 | 2.059 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 71.763 | 27.855 | 0.194 | 0.183 | 0.004 | 1.549 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 72.867 | 26.898 | 0.080 | 0.150 | 0.005 | 1.287 | |||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 75.161 | 24.473 | 0.150 | 0.207 | 0.009 | 3.613 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9863 5712 100880 792.0 22402.2 301.5 17.660 141.982 2.271 31.304 234702 35.5 41.086 2983 786.5 882.6 36.9 2.426 304 80 pg158_o2nofp.cx9a2a_c32r128 9874 6119 106649 837.7 22506.0 302.7 17.429 140.187 2.279 31.394 246124 36.1 40.223 2832 785.9 881.9 23.8 1.429 320 96 pg164_o2nofp.cx9a2a_c32r128 9879 6013 105182 826.2 22426.2 301.7 17.492 140.702 2.270 31.275 242100 36.6 40.262 2922 785.9 882.0 24.8 2.506 304 96 pg17beta3_o2nofp.cx9a2a_c32r128 9841 5994 104656 822.1 22339.4 300.3 17.459 140.437 2.270 31.249 241320 35.7 40.257 2859 786.0 882.1 26.4 3.977 320 47 pg17rc1_o2nofp.cx9a2a_c32r128
qr1000.L5: range queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 99.557 | 0.341 | 0.047 | 0.038 | 0.016 | nonzero | nonzero | nonzero | 2.567 | ||
pg164_o2nofp.cx9a2a_c32r128 | 99.607 | 0.299 | 0.037 | 0.038 | 0.019 | nonzero | nonzero | nonzero | 2.733 | ||
pg17beta3_o2nofp.cx9a2a_c32r128 | 99.601 | 0.305 | 0.038 | 0.038 | 0.018 | nonzero | nonzero | nonzero | 3.785 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 99.592 | 0.312 | 0.038 | 0.039 | 0.019 | nonzero | nonzero | nonzero | nonzero | 4.278 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 42.825 | 47.852 | 9.137 | 0.092 | 0.093 | 2.682 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 42.614 | 45.912 | 11.268 | 0.092 | 0.112 | 0.002 | 4.800 | ||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 41.988 | 47.333 | 10.492 | 0.075 | 0.110 | 0.002 | 4.371 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 41.656 | 47.175 | 11.004 | 0.068 | 0.089 | 0.008 | 5.394 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 42.260 | 56.035 | 1.614 | 0.034 | 0.057 | 2.617 | |||||
pg164_o2nofp.cx9a2a_c32r128 | 39.885 | 57.554 | 2.468 | 0.044 | 0.048 | 3.443 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 37.443 | 60.042 | 2.436 | 0.036 | 0.044 | 3.954 | |||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 36.808 | 60.427 | 2.699 | 0.026 | 0.040 | nonzero | 4.269 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19058 213552 25378 204.4 27097.7 573.0 0.119 0.980 1.422 30.786 721669 63.3 3.379 142 789.4 885.4 81.4 2.567 11428 448 pg158_o2nofp.cx9a2a_c32r128 18711 213497 24913 200.7 26872.2 568.7 0.117 0.963 1.436 31.121 713162 63.4 3.340 143 788.6 935.6 81.1 2.733 11379 1135 pg164_o2nofp.cx9a2a_c32r128 18692 213136 24939 200.8 26846.5 560.6 0.117 0.965 1.436 30.713 709000 63.4 3.327 143 788.8 884.8 79.4 3.785 11257 1550 pg17beta3_o2nofp.cx9a2a_c32r128 18740 212570 24984 201.3 26861.6 563.8 0.118 0.970 1.433 30.807 706415 63.6 3.323 144 788.6 884.7 77.9 4.278 11168 1071 pg17rc1_o2nofp.cx9a2a_c32r128
qp1000.L6: point queries with 1000 insert/s per client. Graphs for performance per 1-second interval are here.
Average throughput:
Query response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.003 | 74.197 | 18.470 | 7.235 | 0.058 | 0.029 | 0.007 | 0.001 | 4.481 | ||
pg164_o2nofp.cx9a2a_c32r128 | 0.003 | 78.152 | 14.908 | 6.868 | 0.040 | 0.025 | 0.004 | 2.820 | |||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.004 | 77.511 | 15.386 | 7.021 | 0.049 | 0.024 | 0.005 | nonzero | 5.414 | ||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.004 | 76.952 | 15.911 | 7.056 | 0.048 | 0.024 | 0.005 | 0.001 | 6.066 |
Insert response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 11.433 | 82.338 | 5.912 | 0.241 | 0.070 | 0.006 | 4.510 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 14.736 | 81.071 | 3.919 | 0.237 | 0.036 | 2.874 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 14.973 | 79.118 | 5.653 | 0.199 | 0.054 | 0.003 | 5.445 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 14.126 | 79.847 | 5.755 | 0.210 | 0.057 | 0.006 | 6.937 |
Delete response time histogram: each cell has the percentage of responses that take <= the time in the header and max is the max response time in seconds. For max values in the top 25% of the range have a red background and in the bottom 25% of the range have a green background. The red background is not used when the min value is within 80% of the max value.
dbms | 256us | 1ms | 4ms | 16ms | 64ms | 256ms | 1s | 4s | 16s | gt | max |
---|---|---|---|---|---|---|---|---|---|---|---|
pg158_o2nofp.cx9a2a_c32r128 | 0.027 | 99.031 | 0.709 | 0.196 | 0.035 | 0.001 | 4.291 | ||||
pg164_o2nofp.cx9a2a_c32r128 | 0.020 | 99.019 | 0.744 | 0.193 | 0.024 | 2.747 | |||||
pg17beta3_o2nofp.cx9a2a_c32r128 | 0.008 | 98.765 | 1.033 | 0.158 | 0.033 | 0.003 | 5.403 | ||||
pg17rc1_o2nofp.cx9a2a_c32r128 | 0.012 | 98.797 | 1.001 | 0.163 | 0.028 | nonzero | 5.230 |
Performance metrics for the DBMS listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19180 3273 84472 663.5 39473.1 582.2 25.809 207.586 2.058 31.085 214641 57.2 65.581 8389 793.7 889.7 62.8 4.481 176 0 pg158_o2nofp.cx9a2a_c32r128 19544 3580 89856 705.6 40087.5 587.5 25.102 201.848 2.051 30.783 217084 59.6 60.645 7992 792.9 889.0 59.2 2.820 192 48 pg164_o2nofp.cx9a2a_c32r128 19231 3481 87773 689.2 40013.1 587.3 25.215 202.754 2.081 31.274 211410 59.5 60.733 8205 793.1 889.2 59.9 5.414 176 16 pg17beta3_o2nofp.cx9a2a_c32r128 19210 3463 87323 685.7 39761.2 584.5 25.217 202.770 2.070 31.158 210401 59.1 60.760 8192 792.9 889.0 59.1 6.066 176 i_qps pg17rc1_o2nofp.cx9a2a_c32r128
l.i0: load without secondary indexes
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1989060 0 1724 13.5 8354.0 796.4 0.001 0.007 0.004 0.410 363377 57.4 0.183 14 382.7 478.8 6.9 1.421 107058 34962 pg158_o2nofp.cx9a2a_c32r128 2004008 0 1712 13.4 8441.4 806.0 0.001 0.007 0.004 0.412 370269 57.4 0.185 14 382.7 478.8 11.7 2.357 108383 35561 pg164_o2nofp.cx9a2a_c32r128 2026342 0 1701 13.7 8542.2 813.8 0.001 0.007 0.004 0.411 369422 57.0 0.182 14 382.7 478.8 95.4 1.931 109848 27470 pg17beta3_o2nofp.cx9a2a_c32r128 2039776 0 1732 13.9 8560.9 819.2 0.001 0.007 0.004 0.411 362999 57.3 0.178 13 382.7 478.8 97.2 1.330 110081 39857 pg17rc1_o2nofp.cx9a2a_c32r128
l.x: create secondary indexes
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 2673797 0 14849 943.0 7784.5 858.6 0.006 0.361 0.003 0.329 150424 20.6 0.056 4 768.4 864.5 52.1 0.013 NA NA pg158_o2nofp.cx9a2a_c32r128 2875629 0 14480 915.2 7489.3 821.6 0.005 0.326 0.003 0.293 156963 21.3 0.055 4 768.4 864.5 30.9 0.437 NA NA pg164_o2nofp.cx9a2a_c32r128 3392706 0 11078 1077.5 8622.4 964.1 0.003 0.325 0.003 0.291 89452 23.8 0.026 3 768.4 863.7 31.2 0.071 NA NA pg17beta3_o2nofp.cx9a2a_c32r128 3436426 0 11401 1091.1 8913.6 983.6 0.003 0.325 0.003 0.293 89973 23.7 0.026 3 768.4 863.7 39.3 0.003 NA NA pg17rc1_o2nofp.cx9a2a_c32r128
l.i1: continue load after secondary indexes created with 50 inserts per transaction
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 24661 0 31064 247.5 36812.6 807.2 1.260 10.279 1.493 33.516 90983 29.5 3.689 574 781.5 916.0 1.8 3.352 1299 0 pg158_o2nofp.cx9a2a_c32r128 24331 0 30718 244.9 36189.2 799.0 1.263 10.307 1.487 33.626 85551 30.6 3.516 604 781.5 877.6 2.0 2.887 1249 0 pg164_o2nofp.cx9a2a_c32r128 24525 0 31028 247.3 36654.9 801.5 1.265 10.324 1.495 33.465 85903 29.9 3.503 585 781.5 877.6 85.0 4.374 1199 0 pg17beta3_o2nofp.cx9a2a_c32r128 24316 0 30740 245.9 36359.7 797.3 1.264 10.355 1.495 33.577 85245 30.4 3.506 600 781.5 877.6 87.0 3.943 1249 0 pg17rc1_o2nofp.cx9a2a_c32r128
l.i2: continue load after secondary indexes created with 5 inserts per transaction
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 2599 0 3236 28.4 4787.0 75.4 1.245 11.171 1.842 29.724 21387 30.3 8.229 5596 784.9 880.9 21.1 2.449 225 170 pg158_o2nofp.cx9a2a_c32r128 2389 0 3109 31.9 4693.4 74.9 1.302 13.655 1.965 32.130 19720 24.8 8.256 4984 784.8 880.9 3.6 4.228 215 180 pg164_o2nofp.cx9a2a_c32r128 2404 0 2925 23.3 4476.8 70.5 1.217 9.933 1.862 30.037 17975 30.6 7.477 6110 784.9 880.9 83.6 3.570 215 180 pg17beta3_o2nofp.cx9a2a_c32r128 2453 0 3078 26.8 4751.3 75.3 1.255 11.201 1.937 31.423 18439 26.8 7.516 5244 784.8 880.9 85.1 3.845 120 105 pg17rc1_o2nofp.cx9a2a_c32r128
qr100.L1: range queries with 100 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 370777 2634 21.2 1370.6 37.3 0.007 0.059 0.693 19.322 1410562 43.1 3.804 56 785.0 881.0 96.3 0.017 18930 17038 pg158_o2nofp.cx9a2a_c32r128 1977 371220 2714 21.9 1263.6 36.3 0.007 0.060 0.639 18.811 1412498 42.9 3.805 55 784.9 881.0 94.5 0.084 18652 17086 pg164_o2nofp.cx9a2a_c32r128 1976 372839 2723 22.1 1211.3 35.8 0.007 0.061 0.613 18.542 1419178 43.0 3.806 55 785.0 881.0 94.5 0.074 19147 17277 pg17beta3_o2nofp.cx9a2a_c32r128 1977 376989 2718 21.9 1261.4 36.3 0.007 0.059 0.638 18.827 1434874 42.8 3.806 54 785.0 881.0 96.0 0.043 19147 17405 pg17rc1_o2nofp.cx9a2a_c32r128
qp100.L2: point queries with 100 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 1977 9161 127620 1002.0 6634.6 76.4 13.930 112.003 3.356 39.589 288312 22.7 31.471 1189 785.1 881.2 91.7 3.858 480 32 pg158_o2nofp.cx9a2a_c32r128 1977 9376 130459 1024.4 6731.4 77.2 13.914 111.876 3.405 39.987 294200 23.2 31.377 1188 785.0 881.0 43.6 3.464 480 160 pg164_o2nofp.cx9a2a_c32r128 1976 9191 128073 1005.7 6833.4 77.8 13.934 112.045 3.459 40.316 288923 23.5 31.435 1227 785.1 881.1 90.9 4.227 479 i_qps pg17beta3_o2nofp.cx9a2a_c32r128 1977 9060 126266 991.5 6753.3 77.2 13.937 112.063 3.416 40.010 285487 22.8 31.511 1208 785.1 881.1 92.2 4.902 479 0 pg17rc1_o2nofp.cx9a2a_c32r128
qr500.L3: range queries with 500 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9804 329629 13733 110.7 14315.1 240.4 0.042 0.344 1.460 25.114 1241708 48.8 3.767 71 785.7 881.8 89.4 4.152 16686 14129 pg158_o2nofp.cx9a2a_c32r128 9868 331352 13813 111.5 14416.8 242.1 0.042 0.345 1.461 25.119 1247923 48.8 3.766 71 785.4 881.4 85.8 1.517 16942 14400 pg164_o2nofp.cx9a2a_c32r128 9847 331037 13777 111.3 14431.6 242.1 0.042 0.344 1.466 25.181 1245582 49.0 3.763 71 785.5 881.5 85.6 2.765 16958 14304 pg17beta3_o2nofp.cx9a2a_c32r128 9836 331207 13775 111.1 14361.1 241.4 0.042 0.344 1.460 25.132 1248427 48.7 3.769 71 785.5 881.6 86.4 1.642 16979 14480 pg17rc1_o2nofp.cx9a2a_c32r128
qp500.L4: point queries with 500 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 9863 5712 100880 792.0 22402.2 301.5 17.660 141.982 2.271 31.304 234702 35.5 41.086 2983 786.5 882.6 36.9 2.426 304 80 pg158_o2nofp.cx9a2a_c32r128 9874 6119 106649 837.7 22506.0 302.7 17.429 140.187 2.279 31.394 246124 36.1 40.223 2832 785.9 881.9 23.8 1.429 320 96 pg164_o2nofp.cx9a2a_c32r128 9879 6013 105182 826.2 22426.2 301.7 17.492 140.702 2.270 31.275 242100 36.6 40.262 2922 785.9 882.0 24.8 2.506 304 96 pg17beta3_o2nofp.cx9a2a_c32r128 9841 5994 104656 822.1 22339.4 300.3 17.459 140.437 2.270 31.249 241320 35.7 40.257 2859 786.0 882.1 26.4 3.977 320 47 pg17rc1_o2nofp.cx9a2a_c32r128
qr1000.L5: range queries with 1000 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19058 213552 25378 204.4 27097.7 573.0 0.119 0.980 1.422 30.786 721669 63.3 3.379 142 789.4 885.4 81.4 2.567 11428 448 pg158_o2nofp.cx9a2a_c32r128 18711 213497 24913 200.7 26872.2 568.7 0.117 0.963 1.436 31.121 713162 63.4 3.340 143 788.6 935.6 81.1 2.733 11379 1135 pg164_o2nofp.cx9a2a_c32r128 18692 213136 24939 200.8 26846.5 560.6 0.117 0.965 1.436 30.713 709000 63.4 3.327 143 788.8 884.8 79.4 3.785 11257 1550 pg17beta3_o2nofp.cx9a2a_c32r128 18740 212570 24984 201.3 26861.6 563.8 0.118 0.970 1.433 30.807 706415 63.6 3.323 144 788.6 884.7 77.9 4.278 11168 1071 pg17rc1_o2nofp.cx9a2a_c32r128
qp1000.L6: point queries with 1000 insert/s per client
Performance metrics for all DBMS, not just the ones listed above. Some are normalized by throughput, others are not. Legend for results is here.
ips qps rps rmbps wps wmbps rpq rkbpq wpi wkbpi csps cpups cspq cpupq dbgb1 dbgb2 rss maxop p50 p99 tag 19180 3273 84472 663.5 39473.1 582.2 25.809 207.586 2.058 31.085 214641 57.2 65.581 8389 793.7 889.7 62.8 4.481 176 0 pg158_o2nofp.cx9a2a_c32r128 19544 3580 89856 705.6 40087.5 587.5 25.102 201.848 2.051 30.783 217084 59.6 60.645 7992 792.9 889.0 59.2 2.820 192 48 pg164_o2nofp.cx9a2a_c32r128 19231 3481 87773 689.2 40013.1 587.3 25.215 202.754 2.081 31.274 211410 59.5 60.733 8205 793.1 889.2 59.9 5.414 176 16 pg17beta3_o2nofp.cx9a2a_c32r128 19210 3463 87323 685.7 39761.2 584.5 25.217 202.770 2.070 31.158 210401 59.1 60.760 8192 792.9 889.0 59.1 6.066 176 i_qps pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 87.809 11.979 0.105 0.089 0.012 0.005 nonzero 0.000 0.000 1.421 pg158_o2nofp.cx9a2a_c32r128 0.000 88.492 11.270 0.127 0.094 0.012 0.005 nonzero 0.000 0.000 2.357 pg164_o2nofp.cx9a2a_c32r128 0.000 89.344 10.390 0.150 0.097 0.013 0.005 nonzero 0.000 0.000 1.931 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 89.987 9.754 0.139 0.098 0.016 0.006 nonzero 0.000 0.000 1.330 pg17rc1_o2nofp.cx9a2a_c32r128
TODO - determine whether there is data for create index response time
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 21.007 70.392 8.352 0.126 0.122 0.000 0.000 3.352 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 21.845 70.089 7.871 0.086 0.109 0.000 0.000 2.887 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 19.950 70.859 8.979 0.104 0.108 nonzero 0.000 4.374 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 21.126 69.898 8.770 0.094 0.112 0.000 0.000 3.943 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 2.328 9.162 26.837 60.259 1.309 0.043 0.061 0.000 0.000 3.118 pg158_o2nofp.cx9a2a_c32r128 0.000 2.384 8.225 19.987 66.830 2.478 0.034 0.062 0.000 0.000 2.801 pg164_o2nofp.cx9a2a_c32r128 0.000 2.530 8.786 23.509 62.699 2.360 0.054 0.061 0.000 0.000 3.033 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 2.565 8.861 21.650 64.039 2.778 0.049 0.059 0.000 0.000 3.310 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag nonzero 37.786 61.878 0.235 0.040 0.030 0.027 0.004 0.000 0.000 2.449 pg158_o2nofp.cx9a2a_c32r128 0.100 34.705 64.849 0.151 0.152 0.018 0.020 0.006 nonzero 0.000 4.228 pg164_o2nofp.cx9a2a_c32r128 nonzero 42.802 57.096 0.033 0.029 0.016 0.020 0.004 0.000 0.000 3.570 pg17beta3_o2nofp.cx9a2a_c32r128 0.040 40.582 59.136 0.082 0.110 0.022 0.022 0.006 0.000 0.000 3.845 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.043 0.090 nonzero 0.080 99.785 0.001 0.001 nonzero 0.000 0.000 1.053 pg158_o2nofp.cx9a2a_c32r128 0.227 2.776 1.892 0.137 94.965 0.002 0.001 nonzero 0.000 0.000 1.605 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 0.066 99.933 0.001 nonzero 0.000 0.000 0.000 0.673 pg17beta3_o2nofp.cx9a2a_c32r128 0.097 1.562 0.323 0.056 97.961 0.001 0.001 nonzero 0.000 0.000 1.920 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 99.992 0.007 0.001 nonzero nonzero 0.000 0.000 0.000 0.000 0.000 0.017 pg158_o2nofp.cx9a2a_c32r128 99.993 0.006 0.001 nonzero nonzero nonzero 0.000 0.000 0.000 0.000 0.084 pg164_o2nofp.cx9a2a_c32r128 99.992 0.007 0.001 nonzero nonzero nonzero 0.000 0.000 0.000 0.000 0.074 pg17beta3_o2nofp.cx9a2a_c32r128 99.993 0.006 0.001 nonzero nonzero 0.000 0.000 0.000 0.000 0.000 0.043 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 96.879 3.090 0.031 0.000 0.000 0.000 0.000 0.212 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 98.188 1.744 0.067 0.001 0.000 0.000 0.000 0.299 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 98.775 1.218 0.007 0.000 0.000 0.000 0.000 0.104 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 98.771 1.121 0.094 0.014 0.000 0.000 0.000 0.769 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 42.203 57.710 0.075 0.013 0.000 0.000 0.000 0.000 0.000 0.019 pg158_o2nofp.cx9a2a_c32r128 0.000 44.325 55.428 0.082 0.164 0.001 0.000 0.000 0.000 0.000 0.080 pg164_o2nofp.cx9a2a_c32r128 0.000 44.775 55.129 0.054 0.042 0.000 0.000 0.000 0.000 0.000 0.030 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 48.046 51.742 0.085 0.126 0.001 0.000 0.000 0.000 0.000 0.105 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag nonzero 3.019 93.920 0.674 2.381 0.003 0.002 0.002 0.000 0.000 3.858 pg158_o2nofp.cx9a2a_c32r128 nonzero 2.951 94.294 0.373 2.379 0.001 0.001 0.001 0.000 0.000 3.464 pg164_o2nofp.cx9a2a_c32r128 nonzero 3.015 94.234 0.319 2.424 0.005 0.001 0.001 nonzero 0.000 4.227 pg17beta3_o2nofp.cx9a2a_c32r128 nonzero 3.008 94.232 0.353 2.396 0.005 0.002 0.003 nonzero 0.000 4.902 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 63.615 35.526 0.282 0.306 0.271 0.000 0.000 3.653 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 61.718 37.722 0.167 0.219 0.174 0.000 0.000 2.600 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 64.808 34.531 0.214 0.163 0.272 0.013 0.000 4.061 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 65.578 33.178 0.379 0.418 0.415 0.032 0.000 4.781 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 92.969 3.343 3.635 0.007 0.028 0.018 0.000 0.000 2.653 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 94.350 2.307 3.233 0.000 0.106 0.004 0.000 0.000 1.948 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 93.264 3.033 3.636 0.006 0.036 0.025 0.000 0.000 1.840 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 93.369 3.221 3.263 0.040 0.057 0.047 0.003 0.000 4.676 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 99.954 0.036 0.007 0.002 0.001 nonzero nonzero nonzero nonzero 0.000 4.152 pg158_o2nofp.cx9a2a_c32r128 99.965 0.028 0.005 0.001 0.001 nonzero nonzero nonzero 0.000 0.000 1.517 pg164_o2nofp.cx9a2a_c32r128 99.963 0.029 0.006 0.002 0.001 nonzero nonzero nonzero 0.000 0.000 2.765 pg17beta3_o2nofp.cx9a2a_c32r128 99.964 0.028 0.006 0.001 0.001 nonzero nonzero nonzero 0.000 0.000 1.642 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 73.568 25.291 0.520 0.450 0.166 0.005 0.000 4.628 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 86.592 12.662 0.344 0.331 0.072 0.000 0.000 2.536 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 84.968 14.101 0.427 0.383 0.118 0.004 0.000 4.394 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 83.947 15.207 0.352 0.363 0.131 0.000 0.000 3.832 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 29.986 68.006 1.929 0.026 0.031 0.021 0.001 0.000 4.199 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 34.301 64.564 1.117 0.005 0.009 0.004 0.000 0.000 1.875 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 34.182 64.334 1.465 0.008 0.009 0.002 nonzero 0.000 4.341 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 39.722 58.993 1.264 0.006 0.012 0.003 0.000 0.000 3.566 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.256 93.460 1.974 4.284 0.014 0.011 0.001 0.000 0.000 2.426 pg158_o2nofp.cx9a2a_c32r128 0.000 0.300 94.611 0.982 4.085 0.010 0.011 nonzero 0.000 0.000 1.429 pg164_o2nofp.cx9a2a_c32r128 0.000 0.284 94.356 1.134 4.207 0.011 0.007 0.001 0.000 0.000 2.506 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.302 94.383 1.143 4.144 0.016 0.011 0.002 0.000 0.000 3.977 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 49.773 49.423 0.466 0.296 0.042 0.000 0.000 2.198 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 48.949 50.421 0.305 0.308 0.017 0.000 0.000 1.562 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 47.623 51.841 0.289 0.227 0.020 0.000 0.000 2.215 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 44.616 54.555 0.454 0.328 0.046 0.001 0.000 4.110 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 77.171 22.478 0.152 0.179 0.019 0.000 0.000 2.059 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 71.763 27.855 0.194 0.183 0.004 0.000 0.000 1.549 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 72.867 26.898 0.080 0.150 0.005 0.000 0.000 1.287 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 75.161 24.473 0.150 0.207 0.009 0.000 0.000 3.613 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 99.557 0.341 0.047 0.038 0.016 nonzero nonzero nonzero 0.000 0.000 2.567 pg158_o2nofp.cx9a2a_c32r128 99.607 0.299 0.037 0.038 0.019 nonzero nonzero nonzero 0.000 0.000 2.733 pg164_o2nofp.cx9a2a_c32r128 99.601 0.305 0.038 0.038 0.018 nonzero nonzero nonzero 0.000 0.000 3.785 pg17beta3_o2nofp.cx9a2a_c32r128 99.592 0.312 0.038 0.039 0.019 nonzero nonzero nonzero nonzero 0.000 4.278 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 42.825 47.852 9.137 0.092 0.093 0.000 0.000 2.682 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 42.614 45.912 11.268 0.092 0.112 0.002 0.000 4.800 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 41.988 47.333 10.492 0.075 0.110 0.002 0.000 4.371 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 41.656 47.175 11.004 0.068 0.089 0.008 0.000 5.394 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 42.260 56.035 1.614 0.034 0.057 0.000 0.000 2.617 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 39.885 57.554 2.468 0.044 0.048 0.000 0.000 3.443 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 37.443 60.042 2.436 0.036 0.044 0.000 0.000 3.954 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 36.808 60.427 2.699 0.026 0.040 nonzero 0.000 4.269 pg17rc1_o2nofp.cx9a2a_c32r128
Query response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.003 74.197 18.470 7.235 0.058 0.029 0.007 0.001 0.000 4.481 pg158_o2nofp.cx9a2a_c32r128 0.000 0.003 78.152 14.908 6.868 0.040 0.025 0.004 0.000 0.000 2.820 pg164_o2nofp.cx9a2a_c32r128 0.000 0.004 77.511 15.386 7.021 0.049 0.024 0.005 nonzero 0.000 5.414 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.004 76.952 15.911 7.056 0.048 0.024 0.005 0.001 0.000 6.066 pg17rc1_o2nofp.cx9a2a_c32r128
Insert response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 11.433 82.338 5.912 0.241 0.070 0.006 0.000 4.510 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 14.736 81.071 3.919 0.237 0.036 0.000 0.000 2.874 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 14.973 79.118 5.653 0.199 0.054 0.003 0.000 5.445 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 14.126 79.847 5.755 0.210 0.057 0.006 0.000 6.937 pg17rc1_o2nofp.cx9a2a_c32r128
Delete response time histogram
256us 1ms 4ms 16ms 64ms 256ms 1s 4s 16s gt max tag 0.000 0.000 0.000 0.027 99.031 0.709 0.196 0.035 0.001 0.000 4.291 pg158_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 0.020 99.019 0.744 0.193 0.024 0.000 0.000 2.747 pg164_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 0.008 98.765 1.033 0.158 0.033 0.003 0.000 5.403 pg17beta3_o2nofp.cx9a2a_c32r128 0.000 0.000 0.000 0.012 98.797 1.001 0.163 0.028 nonzero 0.000 5.230 pg17rc1_o2nofp.cx9a2a_c32r128