Not logged in : Login

About: In Hoc Signo Vinces (part 17 of n): 100G and 300G Runs on Dual Xeon E5 2650v2     Goto   Sponge   NotDistinct   Permalink

An Entity of Type : atom:Entry, within Data Space : www.openlinksw.com associated with source document(s)
QRcode icon
http://www.openlinksw.com/describe/?url=http%3A%2F%2Fwww.openlinksw.com%2Fdataspace%2Fvdb%2Fweblog%2Fvdb%2527s%2520BLOG%2520%255B136%255D%2F1820

AttributesValues
has container
Date Created
maker
topic
described by
seeAlso
Date Modified
link
id
  • 85db864d072bf3de76c66192f911b21a
content
  • This is an update presenting sample results on a newer platform for a single-server configuration. This is to verify that performance scales with the addition of cores and clock speed. Further, we note that the jump from 100G to 300G changes very little about the score. 3x larger takes approximately 3x longer, as long as things are in memory.

    The platform is one node of the CWI cluster which was also used for the 500Gt RDF experiments reported on this blog. The specification is dual Xeon E5 2650v2 (8 core, 16 thread, 2.6 GHz) with 256 GB RAM. The disk setup is a RAID-0 of three 2 TB rotating disks.

    For the 100G, we go from 240 to 395, which is about 1.64x. The new platform has 16 vs 12 cores and a clock of 2.6 as opposed to 2.3. This makes a multiplier of 1.5. The rest of the acceleration is probably attributable to faster memory clock. Anyway, the point of more speed from larger platform is made.

    The top level scores per run are as follows; the numerical quantities summaries are appended.

    100G

    Run Power Throughput Composite
    Run 1 391,000.1 401,029.4 395,983.0
    Run 2 388,746.2 404,189.3 396,392.6

    300G

    Run Power Throughput Composite
    Run 1 61,988.7 384,883.7 154,461.6
    Run 2 423,431.8 387,248.6 404,936.3
    Run 3 417,672.0 389,719.5 403,453.7

    The interested may reproduce the results using the feature/analytics branch of the v7fasttrack git repository on GitHub as described in Part 13.

    For the 300G runs, we note a much longer load time; see below, as this is seriously IO bound.

    The first power test at 300G is a non-starter, even though this comes right after bulk load. Still, the data is not in working set and getting it from disk is simply an automatic disqualification, unless maybe one had 300 separate disks. This happens in TPC benchmarks, but not very often in the field. Looking at the first power run, the first queries take the longest, but by the time the power run starts, the working set is there. By an artifact of the metric (use of geometric mean for the power test), long queries are penalized less there than in the throughput run.

    So, we run 3 executions instead of the prescribed 2, to have 2 executions from warm state.

    To do 300G well in 256 GB of RAM, one needs either to use several SSDs, or to increase compression and keep all in memory, so no secondary storage at all. In order to keep all in memory, one could have stream-compression on string columns. Stream-compressing strings (e.g., o_comment, l_comment) does not pay if one is already in memory, but if stream-compressing strings eliminates going to secondary storage, then the win is sure.

    As before, all caveats apply; the results are unaudited and for information only. Therefore we do not use the official metric name.

    100G Run 1

    Virt-H Executive Summary

    Report Date September 15, 2014
    Database Scale Factor 100
    Start of Database Load 09/15/2014 07:04:08
    End of Database Load 09/15/2014 07:15:58
    Database Load Time 0:11:50
    Query Streams for
    Throughput Test
    5
    Virt-H Power 391,000.1
    Virt-H Throughput 401,029.4
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@100GB)
    395,983.0
    Measurement Interval in
    Throughput Test (Ts)
    98.846000 seconds

    Duration of stream execution

    Start Date/Time End Date/Time Duration
    Stream 0 09/15/2014 13:13:01 09/15/2014 13:13:28 0:00:27
    Stream 1 09/15/2014 13:13:29 09/15/2014 13:15:06 0:01:37
    Stream 2 09/15/2014 13:13:29 09/15/2014 13:15:07 0:01:38
    Stream 3 09/15/2014 13:13:29 09/15/2014 13:15:07 0:01:38
    Stream 4 09/15/2014 13:13:29 09/15/2014 13:15:04 0:01:35
    Stream 5 09/15/2014 13:13:29 09/15/2014 13:15:08 0:01:39
    Refresh 0 09/15/2014 13:13:01 09/15/2014 13:13:03 0:00:02
    09/15/2014 13:13:28 09/15/2014 13:13:29 0:00:01
    Refresh 1 09/15/2014 13:14:10 09/15/2014 13:14:16 0:00:06
    Refresh 2 09/15/2014 13:13:29 09/15/2014 13:13:42 0:00:13
    Refresh 3 09/15/2014 13:13:42 09/15/2014 13:13:53 0:00:11
    Refresh 4 09/15/2014 13:13:53 09/15/2014 13:14:02 0:00:09
    Refresh 5 09/15/2014 13:14:02 09/15/2014 13:14:10 0:00:08

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 1.442477 0.304513 0.720263 0.351285 0.979414 0.479455 0.865992 0.875236
    Stream 1 3.938133 0.920533 3.738724 2.769707 3.209728 1.339146 2.759384 3.626868
    Stream 2 4.104738 0.952245 4.719658 0.865586 2.139267 0.850909 2.044402 2.600373
    Stream 3 3.692119 1.024876 3.430172 1.579846 4.097845 1.859468 2.312921 6.238070
    Stream 4 5.419537 0.531571 2.116176 1.256836 4.787617 2.117995 3.517466 3.982180
    Stream 5 5.167029 0.746720 3.157557 1.255182 3.004802 2.131963 3.648316 2.835751
    Min Qi 3.692119 0.531571 2.116176 0.865586 2.139267 0.850909 2.044402 2.600373
    Max Qi 5.419537 1.024876 4.719658 2.769707 4.787617 2.131963 3.648316 6.238070
    Avg Qi 4.464311 0.835189 3.432457 1.545431 3.447852 1.659896 2.856498 3.856648
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 2.606044 1.117063 1.847930 0.618534 4.327600 1.110908 0.995289 0.975910
    Stream 1 7.463593 4.686463 4.549733 4.168129 15.759178 5.247666 4.495030 4.075198
    Stream 2 9.398552 5.170904 3.934405 1.880683 19.968787 3.767992 6.965337 3.849845
    Stream 3 7.581069 4.109905 4.301159 2.123634 17.683200 5.383603 4.376887 2.854777
    Stream 4 9.927887 6.913209 3.351489 2.802724 16.985827 3.925148 4.691474 4.080586
    Stream 5 7.035080 3.921425 6.844778 2.899238 14.839509 4.986742 6.629664 4.089547
    Min Qi 7.035080 3.921425 3.351489 1.880683 14.839509 3.767992 4.376887 2.854777
    Max Qi 9.927887 6.913209 6.844778 4.168129 19.968787 5.383603 6.965337 4.089547
    Avg Qi 8.281236 4.960381 4.596313 2.774882 17.047300 4.662230 5.431678 3.789991
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 1.215956 0.745257 0.699801 1.281834 1.291110 0.518425 1.827192 1.014431
    Stream 1 5.779854 2.383264 2.396793 6.130511 5.002700 1.968425 4.172437 2.427047
    Stream 2 7.828176 1.833416 3.175649 4.785709 5.385834 1.403290 6.383005 6.366525
    Stream 3 5.880139 1.797383 3.258024 5.601364 6.373216 1.977848 5.235542 6.385010
    Stream 4 3.989621 1.252891 2.478303 4.678629 3.212176 2.740586 5.037995 3.911379
    Stream 5 5.030440 2.010988 4.188428 6.221990 5.418788 2.187718 3.589915 3.517380
    Min Qi 3.989621 1.252891 2.396793 4.678629 3.212176 1.403290 3.589915 2.427047
    Max Qi 7.828176 2.383264 4.188428 6.221990 6.373216 2.740586 6.383005 6.385010
    Avg Qi 5.701646 1.855588 3.099439 5.483641 5.078543 2.055573 4.883779 4.521468

    100G Run 2

    Virt-H Executive Summary

    Report Date September 15, 2014
    Database Scale Factor 100
    Total Data Storage/Database Size 87,312M
    Start of Database Load 09/15/2014 07:04:08
    End of Database Load 09/15/2014 07:15:58
    Database Load Time 0:11:50
    Query Streams for
    Throughput Test
    5
    Virt-H Power 388,746.2
    Virt-H Throughput 404,189.3
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@100GB)
    396,392.6
    Measurement Interval in
    Throughput Test (Ts)
    98.074000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/15/2014 13:15:11 09/15/2014 13:15:38 0:00:27
    Stream 1 09/15/2014 13:15:39 09/15/2014 13:17:13 0:01:34
    Stream 2 09/15/2014 13:15:39 09/15/2014 13:17:16 0:01:37
    Stream 3 09/15/2014 13:15:39 09/15/2014 13:17:15 0:01:36
    Stream 4 09/15/2014 13:15:39 09/15/2014 13:17:17 0:01:38
    Stream 5 09/15/2014 13:15:39 09/15/2014 13:17:15 0:01:36
    Refresh 0 09/15/2014 13:15:11 09/15/2014 13:15:12 0:00:01
    09/15/2014 13:15:38 09/15/2014 13:15:39 0:00:01
    Refresh 1 09/15/2014 13:16:13 09/15/2014 13:16:20 0:00:07
    Refresh 2 09/15/2014 13:15:39 09/15/2014 13:15:47 0:00:08
    Refresh 3 09/15/2014 13:15:47 09/15/2014 13:15:56 0:00:09
    Refresh 4 09/15/2014 13:15:56 09/15/2014 13:16:03 0:00:07
    Refresh 5 09/15/2014 13:16:03 09/15/2014 13:16:12 0:00:09

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 1.467681 0.277665 0.766102 0.365185 0.941206 0.549381 0.938998 0.803514
    Stream 1 3.883169 1.488521 3.366920 1.627478 3.632321 2.065565 2.911138 2.444544
    Stream 2 3.294589 1.138066 3.260775 1.899615 5.367725 1.820374 3.655119 2.186642
    Stream 3 3.797641 0.995877 3.239690 2.483035 2.737690 1.505998 4.058083 4.268644
    Stream 4 4.099187 0.402685 4.704959 1.469825 5.367910 2.783018 2.706164 2.551061
    Stream 5 3.651273 1.598314 2.051899 1.283754 4.711897 1.519763 2.851300 2.484093
    Min Qi 3.294589 0.402685 2.051899 1.283754 2.737690 1.505998 2.706164 2.186642
    Max Qi 4.099187 1.598314 4.704959 2.483035 5.367910 2.783018 4.058083 4.268644
    Avg Qi 3.745172 1.124693 3.324849 1.752741 4.363509 1.938944 3.236361 2.786997
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 2.734812 1.115539 1.679910 0.633239 4.391739 1.130082 1.137284 0.919646
    Stream 1 9.271071 5.664855 3.377869 2.148228 16.046021 2.935643 4.897009 2.891040
    Stream 2 10.272523 4.578427 4.086788 2.312762 16.295728 2.714776 6.393897 2.414951
    Stream 3 7.095213 4.544636 4.073433 2.710320 18.789088 3.903873 5.471600 2.994184
    Stream 4 7.567924 3.691088 3.951049 2.207944 18.189014 4.985841 6.568935 3.965322
    Stream 5 8.173577 4.959777 4.736593 3.507469 17.106990 5.405699 7.357104 3.125788
    Min Qi 7.095213 3.691088 3.377869 2.148228 16.046021 2.714776 4.897009 2.414951
    Max Qi 10.272523 5.664855 4.736593 3.507469 18.789088 5.405699 7.357104 3.965322
    Avg Qi 8.476062 4.687757 4.045146 2.577345 17.285368 3.989166 6.137709 3.078257
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 1.206347 0.792013 0.699476 1.349182 1.505387 0.543947 1.549135 0.824344
    Stream 1 5.135036 1.873195 4.978155 5.988226 4.705365 1.211049 4.175947 3.579242
    Stream 2 7.656125 2.229819 2.805272 6.629781 4.138014 1.423334 5.165700 3.197300
    Stream 3 6.385983 2.086301 3.450305 3.292353 5.503905 2.302992 4.860041 3.865383
    Stream 4 6.514967 2.876895 3.481100 1.629007 5.715903 2.121692 3.681208 3.347289
    Stream 5 4.100205 2.400816 2.142291 4.710677 5.765320 1.616445 6.095817 3.007436
    Min Qi 4.100205 1.873195 2.142291 1.629007 4.138014 1.211049 3.681208 3.007436
    Max Qi 7.656125 2.876895 4.978155 6.629781 5.765320 2.302992 6.095817 3.865383
    Avg Qi 5.958463 2.293405 3.371425 4.450009 5.165701 1.735102 4.795743 3.399330

    300G Run 1

    Virt-H Executive Summary

    Report Date September 25, 2014
    Database Scale Factor 300
    Start of Database Load 09/25/2014 16:38:20
    End of Database Load 09/25/2014 18:32:06
    Database Load Time 1:53:46
    Query Streams for
    Throughput Test
    6
    Virt-H Power 61,988.7
    Virt-H Throughput 384,883.7
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@300GB)
    154,461.6
    Measurement Interval in
    Throughput Test (Ts)
    370.498000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/25/2014 19:00:29 09/25/2014 19:22:25 0:21:56
    Stream 1 09/25/2014 19:22:27 09/25/2014 19:28:23 0:05:56
    Stream 2 09/25/2014 19:22:27 09/25/2014 19:28:23 0:05:56
    Stream 3 09/25/2014 19:22:27 09/25/2014 19:28:26 0:05:59
    Stream 4 09/25/2014 19:22:27 09/25/2014 19:28:13 0:05:46
    Stream 5 09/25/2014 19:22:27 09/25/2014 19:28:38 0:06:11
    Stream 6 09/25/2014 19:22:27 09/25/2014 19:28:38 0:06:11
    Refresh 0 09/25/2014 19:00:29 09/25/2014 19:03:56 0:03:27
    09/25/2014 19:22:25 09/25/2014 19:22:27 0:00:02
    Refresh 1 09/25/2014 19:25:22 09/25/2014 19:25:58 0:00:36
    Refresh 2 09/25/2014 19:22:27 09/25/2014 19:23:11 0:00:44
    Refresh 3 09/25/2014 19:23:10 09/25/2014 19:23:40 0:00:30
    Refresh 4 09/25/2014 19:23:40 09/25/2014 19:24:21 0:00:41
    Refresh 5 09/25/2014 19:24:21 09/25/2014 19:24:58 0:00:37
    Refresh 6 09/25/2014 19:24:59 09/25/2014 19:25:22 0:00:23

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 183.735463 95.826361 79.826802 87.603164 47.099641 1.301704 2.606488 52.667426
    Stream 1 9.400003 1.983777 15.839250 3.001843 15.593335 6.067716 8.870516 11.679706
    Stream 2 12.634711 3.472203 13.683075 8.057952 16.500741 5.403771 11.181661 12.393932
    Stream 3 10.807287 3.793587 15.844244 3.214977 15.960600 7.099744 10.424530 21.001623
    Stream 4 11.900829 3.741707 14.219904 5.616907 16.487144 14.229782 11.100193 8.769539
    Stream 5 13.933423 2.916529 19.453452 5.258843 16.706269 7.948711 8.982104 17.566729
    Stream 6 17.084445 0.738683 11.503079 8.324812 23.483917 20.101834 9.207737 10.311292
    Min Qi 9.400003 0.738683 11.503079 3.001843 15.593335 5.403771 8.870516 8.769539
    Max Qi 17.084445 3.793587 19.453452 8.324812 23.483917 20.101834 11.181661 21.001623
    Avg Qi 12.626783 2.774414 15.090501 5.579222 17.455334 10.141926 9.961123 13.620470
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 41.997798 2.727870 21.651730 25.704209 293.103984 3.171437 2.886688 5.298823
    Stream 1 29.662265 22.788618 12.979253 7.121358 62.774323 22.132581 22.616793 21.625334
    Stream 2 28.041750 22.481172 19.262140 5.790272 58.105179 16.809177 32.813330 12.692499
    Stream 3 32.534297 15.460256 12.038047 7.012926 59.413740 18.540284 25.968635 16.716208
    Stream 4 28.759993 15.123651 21.734471 6.920480 63.119744 12.848884 21.372432 11.662102
    Stream 5 18.315308 21.781800 26.141212 8.230858 60.985590 22.369824 27.098660 25.283066
    Stream 6 31.455961 27.078707 12.954580 11.081669 72.483462 12.376376 22.129120 11.439147
    Min Qi 18.315308 15.123651 12.038047 5.790272 58.105179 12.376376 21.372432 11.439147
    Max Qi 32.534297 27.078707 26.141212 11.081669 72.483462 22.369824 32.813330 25.283066
    Avg Qi 28.128262 20.785701 17.518284 7.692927 62.813673 17.512854 25.333162 16.569726
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 7.793403 81.545934 41.648484 4.638731 25.003179 0.536267 206.980380 2.501589
    Stream 1 27.058060 3.894254 8.664394 25.315007 11.921265 3.561859 22.936601 13.235777
    Stream 2 25.718500 6.140657 8.856586 14.761290 11.870351 7.728217 13.882613 29.328859
    Stream 3 15.896774 8.631035 15.742406 20.621604 13.370582 5.536313 14.677463 14.772753
    Stream 4 22.458327 5.319241 11.973431 22.344017 11.534642 2.402683 24.214115 16.236299
    Stream 5 13.407745 5.413278 8.800650 18.055743 17.528827 4.173171 15.927165 21.636801
    Stream 6 8.069721 5.531066 13.233927 21.321389 7.622026 12.064182 11.457848 12.342336
    Min Qi 8.069721 3.894254 8.664394 14.761290 7.622026 2.402683 11.457848 12.342336
    Max Qi 27.058060 8.631035 15.742406 25.315007 17.528827 12.064182 24.214115 29.328859
    Avg Qi 18.768188 5.821588 11.211899 20.403175 12.307949 5.911071 17.182634 17.925471

    300G run 2

    Virt-H Executive Summary

    Report Date September 25, 2014
    Database Scale Factor 300
    Start of Database Load 09/25/2014 16:38:20
    End of Database Load 09/25/2014 18:32:06
    Database Load Time 1:53:46
    Query Streams for
    Throughput Test
    6
    Virt-H Power 423,431.8
    Virt-H Throughput 387,248.6
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@300GB)
    404,936.3
    Measurement Interval in
    Throughput Test (Ts)
    368.236000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/25/2014 19:28:42 09/25/2014 19:29:58 0:01:16
    Stream 1 09/25/2014 19:30:00 09/25/2014 19:36:04 0:06:04
    Stream 2 09/25/2014 19:30:00 09/25/2014 19:36:00 0:06:00
    Stream 3 09/25/2014 19:30:00 09/25/2014 19:36:06 0:06:06
    Stream 4 09/25/2014 19:30:00 09/25/2014 19:36:07 0:06:07
    Stream 5 09/25/2014 19:30:00 09/25/2014 19:35:53 0:05:53
    Stream 6 09/25/2014 19:30:00 09/25/2014 19:36:08 0:06:08
    Refresh 0 09/25/2014 19:28:41 09/25/2014 19:28:46 0:00:05
    09/25/2014 19:29:58 09/25/2014 19:30:00 0:00:02
    Refresh 1 09/25/2014 19:32:23 09/25/2014 19:32:55 0:00:32
    Refresh 2 09/25/2014 19:30:00 09/25/2014 19:30:31 0:00:31
    Refresh 3 09/25/2014 19:30:31 09/25/2014 19:31:00 0:00:29
    Refresh 4 09/25/2014 19:31:01 09/25/2014 19:31:23 0:00:22
    Refresh 5 09/25/2014 19:31:23 09/25/2014 19:31:54 0:00:31
    Refresh 6 09/25/2014 19:31:55 09/25/2014 19:32:23 0:00:28

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 4.197427 1.011516 2.535959 0.858781 2.857279 1.293530 2.682266 2.260502
    Stream 1 15.467757 3.517499 13.820864 4.157259 13.141556 10.902710 16.899687 8.986535
    Stream 2 15.639991 6.026485 13.521624 3.918031 17.336458 1.975310 9.718194 15.165247
    Stream 3 14.891929 4.481383 15.322621 5.272911 15.266543 6.771253 13.430646 20.171084
    Stream 4 14.560526 2.464157 11.567112 5.526629 20.531540 5.225971 16.288606 17.209475
    Stream 5 10.390577 3.549165 9.598328 8.783847 17.351211 6.308214 12.606512 13.035716
    Stream 6 16.275922 4.086475 14.109963 4.385887 10.174709 6.703266 8.936217 16.798526
    Min Qi 10.390577 2.464157 9.598328 3.918031 10.174709 1.975310 8.936217 8.986535
    Max Qi 16.275922 6.026485 15.322621 8.783847 20.531540 10.902710 16.899687 20.171084
    Avg Qi 14.537784 4.020861 12.990085 5.340761 15.633670 6.314454 12.979977 15.227764
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 8.300092 2.598145 5.168418 1.619399 11.958836 3.191672 3.097822 2.497410
    Stream 1 26.412829 17.354745 12.942454 8.169447 58.600101 15.227942 32.985324 13.914978
    Stream 2 34.523245 17.635531 15.193748 8.435375 62.442800 16.276300 26.533303 12.414575
    Stream 3 25.334301 18.595422 11.663933 10.029387 63.664992 20.378320 24.760768 15.710589
    Stream 4 36.971957 15.645673 14.672851 13.196301 58.214728 17.375053 26.581101 11.624989
    Stream 5 30.891797 12.993365 14.089049 10.515091 65.232712 20.807026 26.920526 11.362095
    Stream 6 38.143281 21.106772 15.152299 18.845766 66.240343 12.295624 22.510610 18.081103
    Min Qi 25.334301 12.993365 11.663933 8.169447 58.214728 12.295624 22.510610 11.362095
    Max Qi 38.143281 21.106772 15.193748 18.845766 66.240343 20.807026 32.985324 18.081103
    Avg Qi 32.046235 17.221918 13.952389 11.531894 62.399279 17.060044 26.715272 13.851388
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 4.016212 1.603004 1.836489 3.542383 3.901876 0.515102 4.759612 2.358873
    Stream 1 22.162387 10.067834 15.772705 22.091355 12.974776 8.354196 19.342171 12.771250
    Stream 2 25.647926 4.263008 11.590737 19.179326 17.899770 4.137031 15.720245 14.719776
    Stream 3 14.511279 7.484608 20.735250 13.041037 17.139046 6.014141 16.234122 13.454647
    Stream 4 19.297494 10.110707 10.907458 19.649066 15.206251 3.423503 11.268082 11.852223
    Stream 5 17.445165 5.582309 15.266324 19.788382 14.245770 2.810949 16.601461 14.019717
    Stream 6 25.115339 6.896503 11.661563 21.900028 5.520025 3.093050 15.436258 13.353446
    Min Qi 14.511279 4.263008 10.907458 13.041037 5.520025 2.810949 11.268082 11.852223
    Max Qi 25.647926 10.110707 20.735250 22.091355 17.899770 8.354196 19.342171 14.719776
    Avg Qi 20.696598 7.400828 14.322339 19.274866 13.830940 4.638812 15.767057 13.361843

    300G run 3:

    Virt-H Executive Summary

    Report Date September 25, 2014
    Database Scale Factor 300
    Total Data Storage/Database Size 258,888M
    Start of Database Load 09/25/2014 16:38:20
    End of Database Load 09/25/2014 18:32:06
    Database Load Time 1:53:46
    Query Streams for
    Throughput Test
    6
    Virt-H Power 417,672.0
    Virt-H Throughput 389,719.5
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@300GB)
    403,453.7
    Measurement Interval in
    Throughput Test (Ts)
    365.902000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/25/2014 19:36:11 09/25/2014 19:37:29 0:01:18
    Stream 1 09/25/2014 19:37:32 09/25/2014 19:43:13 0:05:41
    Stream 2 09/25/2014 19:37:32 09/25/2014 19:43:31 0:05:59
    Stream 3 09/25/2014 19:37:32 09/25/2014 19:43:37 0:06:05
    Stream 4 09/25/2014 19:37:32 09/25/2014 19:43:33 0:06:01
    Stream 5 09/25/2014 19:37:32 09/25/2014 19:43:32 0:06:00
    Stream 6 09/25/2014 19:37:32 09/25/2014 19:43:37 0:06:05
    Refresh 0 09/25/2014 19:36:12 09/25/2014 19:36:16 0:00:04
    09/25/2014 19:37:29 09/25/2014 19:37:31 0:00:02
    Refresh 1 09/25/2014 19:40:02 09/25/2014 19:40:33 0:00:31
    Refresh 2 09/25/2014 19:37:31 09/25/2014 19:38:01 0:00:30
    Refresh 3 09/25/2014 19:38:01 09/25/2014 19:38:30 0:00:29
    Refresh 4 09/25/2014 19:38:30 09/25/2014 19:38:58 0:00:28
    Refresh 5 09/25/2014 19:38:58 09/25/2014 19:39:27 0:00:29
    Refresh 6 09/25/2014 19:39:27 09/25/2014 19:40:01 0:00:34

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 4.305006 1.083442 2.502758 0.845763 2.840824 1.346166 2.659511 2.233550
    Stream 1 11.513360 3.732513 14.530428 3.819517 14.821291 7.561547 10.435082 8.984230
    Stream 2 13.486433 3.373689 9.620363 3.914320 16.857542 5.837487 10.695443 17.901191
    Stream 3 11.015942 1.780220 4.830412 9.073543 15.587709 9.661989 12.374931 15.262485
    Stream 4 13.600461 0.820899 12.254226 7.799415 19.860761 13.145017 14.404345 11.807583
    Stream 5 13.358000 3.885118 11.099935 4.845043 18.286721 6.424272 9.735255 15.041608
    Stream 6 13.588873 3.789631 13.503399 5.130389 13.104065 3.517076 14.929079 19.831639
    Min Qi 11.015942 0.820899 4.830412 3.819517 13.104065 3.517076 9.735255 8.984230
    Max Qi 13.600461 3.885118 14.530428 9.073543 19.860761 13.145017 14.929079 19.831639
    Avg Qi 12.760511 2.897012 10.973127 5.763705 16.419681 7.691231 12.095689 14.804789
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 8.553183 3.215484 4.652364 1.620089 11.936052 2.916132 3.219969 2.374276
    Stream 1 29.441108 20.348266 9.994556 14.965432 60.537168 13.302875 30.159402 10.277570
    Stream 2 41.799347 18.197400 16.773638 6.510347 67.461446 20.362328 0.109929 9.908769
    Stream 3 24.306937 20.555376 17.140758 16.715188 61.724168 22.469230 27.967206 13.434167
    Stream 4 34.820796 11.795664 18.015120 7.176057 63.134711 11.427374 23.959842 16.759246
    Stream 5 23.139366 12.655317 13.152401 7.258740 64.273225 22.854106 28.803059 12.832364
    Stream 6 27.955059 24.633526 11.046285 5.995041 74.965966 15.636579 22.803890 13.221303
    Min Qi 23.139366 11.795664 9.994556 5.995041 60.537168 11.427374 0.109929 9.908769
    Max Qi 41.799347 24.633526 18.015120 16.715188 74.965966 22.854106 30.159402 16.759246
    Avg Qi 30.243769 18.030925 14.353793 9.770134 65.349447 17.675415 22.300555 12.738903
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 4.298092 1.702071 1.894548 4.118591 3.922889 0.491145 4.519734 2.347913
    Stream 1 16.432222 6.908918 17.749058 18.756674 11.148628 5.464975 18.300673 12.972871
    Stream 2 20.588544 4.387662 14.527229 23.844364 15.500462 15.543458 13.666574 15.240662
    Stream 3 14.008049 6.222633 12.833421 22.811602 16.013232 9.449069 16.486111 12.974515
    Stream 4 16.964699 8.106044 11.207675 22.483826 17.354675 4.641183 14.583941 13.679087
    Stream 5 25.243144 7.359437 16.986615 19.855391 17.183725 5.750937 14.759597 13.052316
    Stream 6 12.986721 10.160993 17.496662 19.267026 17.300224 4.955930 19.267721 15.421241
    Min Qi 12.986721 4.387662 11.207675 18.756674 11.148628 4.641183 13.666574 12.972871
    Max Qi 25.243144 10.160993 17.749058 23.844364 17.354675 15.543458 19.267721 15.421241
    Avg Qi 17.703896 7.190948 15.133443 21.169814 15.750158 7.634259 16.177436 13.890115

    To be continued...

    In Hoc Signo Vinces (TPC-H) Series

  • This is an update presenting sample results on a newer platform for a single-server configuration. This is to verify that performance scales with the addition of cores and clock speed. Further, we note that the jump from 100G to 300G changes very little about the score. 3x larger takes approximately 3x longer, as long as things are in memory.

    The platform is one node of the CWI cluster which was also used for the 500Gt RDF experiments reported on this blog. The specification is dual Xeon E5 2650v2 (8 core, 16 thread, 2.6 GHz) with 256 GB RAM. The disk setup is a RAID-0 of three 2 TB rotating disks.

    For the 100G, we go from 240 to 395, which is about 1.64x. The new platform has 16 vs 12 cores and a clock of 2.6 as opposed to 2.3. This makes a multiplier of 1.5. The rest of the acceleration is probably attributable to faster memory clock. Anyway, the point of more speed from larger platform is made.

    The top level scores per run are as follows; the numerical quantities summaries are appended.

    100G

    Run Power Throughput Composite
    Run 1 391,000.1 401,029.4 395,983.0
    Run 2 388,746.2 404,189.3 396,392.6

    300G

    Run Power Throughput Composite
    Run 1 61,988.7 384,883.7 154,461.6
    Run 2 423,431.8 387,248.6 404,936.3
    Run 3 417,672.0 389,719.5 403,453.7

    The interested may reproduce the results using the feature/analytics branch of the v7fasttrack git repository on GitHub as described in Part 13.

    For the 300G runs, we note a much longer load time; see below, as this is seriously IO bound.

    The first power test at 300G is a non-starter, even though this comes right after bulk load. Still, the data is not in working set and getting it from disk is simply an automatic disqualification, unless maybe one had 300 separate disks. This happens in TPC benchmarks, but not very often in the field. Looking at the first power run, the first queries take the longest, but by the time the power run starts, the working set is there. By an artifact of the metric (use of geometric mean for the power test), long queries are penalized less there than in the throughput run.

    So, we run 3 executions instead of the prescribed 2, to have 2 executions from warm state.

    To do 300G well in 256 GB of RAM, one needs either to use several SSDs, or to increase compression and keep all in memory, so no secondary storage at all. In order to keep all in memory, one could have stream-compression on string columns. Stream-compressing strings (e.g., o_comment, l_comment) does not pay if one is already in memory, but if stream-compressing strings eliminates going to secondary storage, then the win is sure.

    As before, all caveats apply; the results are unaudited and for information only. Therefore we do not use the official metric name.

    100G Run 1

    Virt-H Executive Summary

    Report Date September 15, 2014
    Database Scale Factor 100
    Start of Database Load 09/15/2014 07:04:08
    End of Database Load 09/15/2014 07:15:58
    Database Load Time 0:11:50
    Query Streams for
    Throughput Test
    5
    Virt-H Power 391,000.1
    Virt-H Throughput 401,029.4
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@100GB)
    395,983.0
    Measurement Interval in
    Throughput Test (Ts)
    98.846000 seconds

    Duration of stream execution

    Start Date/Time End Date/Time Duration
    Stream 0 09/15/2014 13:13:01 09/15/2014 13:13:28 0:00:27
    Stream 1 09/15/2014 13:13:29 09/15/2014 13:15:06 0:01:37
    Stream 2 09/15/2014 13:13:29 09/15/2014 13:15:07 0:01:38
    Stream 3 09/15/2014 13:13:29 09/15/2014 13:15:07 0:01:38
    Stream 4 09/15/2014 13:13:29 09/15/2014 13:15:04 0:01:35
    Stream 5 09/15/2014 13:13:29 09/15/2014 13:15:08 0:01:39
    Refresh 0 09/15/2014 13:13:01 09/15/2014 13:13:03 0:00:02
    09/15/2014 13:13:28 09/15/2014 13:13:29 0:00:01
    Refresh 1 09/15/2014 13:14:10 09/15/2014 13:14:16 0:00:06
    Refresh 2 09/15/2014 13:13:29 09/15/2014 13:13:42 0:00:13
    Refresh 3 09/15/2014 13:13:42 09/15/2014 13:13:53 0:00:11
    Refresh 4 09/15/2014 13:13:53 09/15/2014 13:14:02 0:00:09
    Refresh 5 09/15/2014 13:14:02 09/15/2014 13:14:10 0:00:08

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 1.442477 0.304513 0.720263 0.351285 0.979414 0.479455 0.865992 0.875236
    Stream 1 3.938133 0.920533 3.738724 2.769707 3.209728 1.339146 2.759384 3.626868
    Stream 2 4.104738 0.952245 4.719658 0.865586 2.139267 0.850909 2.044402 2.600373
    Stream 3 3.692119 1.024876 3.430172 1.579846 4.097845 1.859468 2.312921 6.238070
    Stream 4 5.419537 0.531571 2.116176 1.256836 4.787617 2.117995 3.517466 3.982180
    Stream 5 5.167029 0.746720 3.157557 1.255182 3.004802 2.131963 3.648316 2.835751
    Min Qi 3.692119 0.531571 2.116176 0.865586 2.139267 0.850909 2.044402 2.600373
    Max Qi 5.419537 1.024876 4.719658 2.769707 4.787617 2.131963 3.648316 6.238070
    Avg Qi 4.464311 0.835189 3.432457 1.545431 3.447852 1.659896 2.856498 3.856648
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 2.606044 1.117063 1.847930 0.618534 4.327600 1.110908 0.995289 0.975910
    Stream 1 7.463593 4.686463 4.549733 4.168129 15.759178 5.247666 4.495030 4.075198
    Stream 2 9.398552 5.170904 3.934405 1.880683 19.968787 3.767992 6.965337 3.849845
    Stream 3 7.581069 4.109905 4.301159 2.123634 17.683200 5.383603 4.376887 2.854777
    Stream 4 9.927887 6.913209 3.351489 2.802724 16.985827 3.925148 4.691474 4.080586
    Stream 5 7.035080 3.921425 6.844778 2.899238 14.839509 4.986742 6.629664 4.089547
    Min Qi 7.035080 3.921425 3.351489 1.880683 14.839509 3.767992 4.376887 2.854777
    Max Qi 9.927887 6.913209 6.844778 4.168129 19.968787 5.383603 6.965337 4.089547
    Avg Qi 8.281236 4.960381 4.596313 2.774882 17.047300 4.662230 5.431678 3.789991
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 1.215956 0.745257 0.699801 1.281834 1.291110 0.518425 1.827192 1.014431
    Stream 1 5.779854 2.383264 2.396793 6.130511 5.002700 1.968425 4.172437 2.427047
    Stream 2 7.828176 1.833416 3.175649 4.785709 5.385834 1.403290 6.383005 6.366525
    Stream 3 5.880139 1.797383 3.258024 5.601364 6.373216 1.977848 5.235542 6.385010
    Stream 4 3.989621 1.252891 2.478303 4.678629 3.212176 2.740586 5.037995 3.911379
    Stream 5 5.030440 2.010988 4.188428 6.221990 5.418788 2.187718 3.589915 3.517380
    Min Qi 3.989621 1.252891 2.396793 4.678629 3.212176 1.403290 3.589915 2.427047
    Max Qi 7.828176 2.383264 4.188428 6.221990 6.373216 2.740586 6.383005 6.385010
    Avg Qi 5.701646 1.855588 3.099439 5.483641 5.078543 2.055573 4.883779 4.521468

    100G Run 2

    Virt-H Executive Summary

    Report Date September 15, 2014
    Database Scale Factor 100
    Total Data Storage/Database Size 87,312M
    Start of Database Load 09/15/2014 07:04:08
    End of Database Load 09/15/2014 07:15:58
    Database Load Time 0:11:50
    Query Streams for
    Throughput Test
    5
    Virt-H Power 388,746.2
    Virt-H Throughput 404,189.3
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@100GB)
    396,392.6
    Measurement Interval in
    Throughput Test (Ts)
    98.074000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/15/2014 13:15:11 09/15/2014 13:15:38 0:00:27
    Stream 1 09/15/2014 13:15:39 09/15/2014 13:17:13 0:01:34
    Stream 2 09/15/2014 13:15:39 09/15/2014 13:17:16 0:01:37
    Stream 3 09/15/2014 13:15:39 09/15/2014 13:17:15 0:01:36
    Stream 4 09/15/2014 13:15:39 09/15/2014 13:17:17 0:01:38
    Stream 5 09/15/2014 13:15:39 09/15/2014 13:17:15 0:01:36
    Refresh 0 09/15/2014 13:15:11 09/15/2014 13:15:12 0:00:01
    09/15/2014 13:15:38 09/15/2014 13:15:39 0:00:01
    Refresh 1 09/15/2014 13:16:13 09/15/2014 13:16:20 0:00:07
    Refresh 2 09/15/2014 13:15:39 09/15/2014 13:15:47 0:00:08
    Refresh 3 09/15/2014 13:15:47 09/15/2014 13:15:56 0:00:09
    Refresh 4 09/15/2014 13:15:56 09/15/2014 13:16:03 0:00:07
    Refresh 5 09/15/2014 13:16:03 09/15/2014 13:16:12 0:00:09

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 1.467681 0.277665 0.766102 0.365185 0.941206 0.549381 0.938998 0.803514
    Stream 1 3.883169 1.488521 3.366920 1.627478 3.632321 2.065565 2.911138 2.444544
    Stream 2 3.294589 1.138066 3.260775 1.899615 5.367725 1.820374 3.655119 2.186642
    Stream 3 3.797641 0.995877 3.239690 2.483035 2.737690 1.505998 4.058083 4.268644
    Stream 4 4.099187 0.402685 4.704959 1.469825 5.367910 2.783018 2.706164 2.551061
    Stream 5 3.651273 1.598314 2.051899 1.283754 4.711897 1.519763 2.851300 2.484093
    Min Qi 3.294589 0.402685 2.051899 1.283754 2.737690 1.505998 2.706164 2.186642
    Max Qi 4.099187 1.598314 4.704959 2.483035 5.367910 2.783018 4.058083 4.268644
    Avg Qi 3.745172 1.124693 3.324849 1.752741 4.363509 1.938944 3.236361 2.786997
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 2.734812 1.115539 1.679910 0.633239 4.391739 1.130082 1.137284 0.919646
    Stream 1 9.271071 5.664855 3.377869 2.148228 16.046021 2.935643 4.897009 2.891040
    Stream 2 10.272523 4.578427 4.086788 2.312762 16.295728 2.714776 6.393897 2.414951
    Stream 3 7.095213 4.544636 4.073433 2.710320 18.789088 3.903873 5.471600 2.994184
    Stream 4 7.567924 3.691088 3.951049 2.207944 18.189014 4.985841 6.568935 3.965322
    Stream 5 8.173577 4.959777 4.736593 3.507469 17.106990 5.405699 7.357104 3.125788
    Min Qi 7.095213 3.691088 3.377869 2.148228 16.046021 2.714776 4.897009 2.414951
    Max Qi 10.272523 5.664855 4.736593 3.507469 18.789088 5.405699 7.357104 3.965322
    Avg Qi 8.476062 4.687757 4.045146 2.577345 17.285368 3.989166 6.137709 3.078257
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 1.206347 0.792013 0.699476 1.349182 1.505387 0.543947 1.549135 0.824344
    Stream 1 5.135036 1.873195 4.978155 5.988226 4.705365 1.211049 4.175947 3.579242
    Stream 2 7.656125 2.229819 2.805272 6.629781 4.138014 1.423334 5.165700 3.197300
    Stream 3 6.385983 2.086301 3.450305 3.292353 5.503905 2.302992 4.860041 3.865383
    Stream 4 6.514967 2.876895 3.481100 1.629007 5.715903 2.121692 3.681208 3.347289
    Stream 5 4.100205 2.400816 2.142291 4.710677 5.765320 1.616445 6.095817 3.007436
    Min Qi 4.100205 1.873195 2.142291 1.629007 4.138014 1.211049 3.681208 3.007436
    Max Qi 7.656125 2.876895 4.978155 6.629781 5.765320 2.302992 6.095817 3.865383
    Avg Qi 5.958463 2.293405 3.371425 4.450009 5.165701 1.735102 4.795743 3.399330

    300G Run 1

    Virt-H Executive Summary

    Report Date September 25, 2014
    Database Scale Factor 300
    Start of Database Load 09/25/2014 16:38:20
    End of Database Load 09/25/2014 18:32:06
    Database Load Time 1:53:46
    Query Streams for
    Throughput Test
    6
    Virt-H Power 61,988.7
    Virt-H Throughput 384,883.7
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@300GB)
    154,461.6
    Measurement Interval in
    Throughput Test (Ts)
    370.498000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/25/2014 19:00:29 09/25/2014 19:22:25 0:21:56
    Stream 1 09/25/2014 19:22:27 09/25/2014 19:28:23 0:05:56
    Stream 2 09/25/2014 19:22:27 09/25/2014 19:28:23 0:05:56
    Stream 3 09/25/2014 19:22:27 09/25/2014 19:28:26 0:05:59
    Stream 4 09/25/2014 19:22:27 09/25/2014 19:28:13 0:05:46
    Stream 5 09/25/2014 19:22:27 09/25/2014 19:28:38 0:06:11
    Stream 6 09/25/2014 19:22:27 09/25/2014 19:28:38 0:06:11
    Refresh 0 09/25/2014 19:00:29 09/25/2014 19:03:56 0:03:27
    09/25/2014 19:22:25 09/25/2014 19:22:27 0:00:02
    Refresh 1 09/25/2014 19:25:22 09/25/2014 19:25:58 0:00:36
    Refresh 2 09/25/2014 19:22:27 09/25/2014 19:23:11 0:00:44
    Refresh 3 09/25/2014 19:23:10 09/25/2014 19:23:40 0:00:30
    Refresh 4 09/25/2014 19:23:40 09/25/2014 19:24:21 0:00:41
    Refresh 5 09/25/2014 19:24:21 09/25/2014 19:24:58 0:00:37
    Refresh 6 09/25/2014 19:24:59 09/25/2014 19:25:22 0:00:23

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 183.735463 95.826361 79.826802 87.603164 47.099641 1.301704 2.606488 52.667426
    Stream 1 9.400003 1.983777 15.839250 3.001843 15.593335 6.067716 8.870516 11.679706
    Stream 2 12.634711 3.472203 13.683075 8.057952 16.500741 5.403771 11.181661 12.393932
    Stream 3 10.807287 3.793587 15.844244 3.214977 15.960600 7.099744 10.424530 21.001623
    Stream 4 11.900829 3.741707 14.219904 5.616907 16.487144 14.229782 11.100193 8.769539
    Stream 5 13.933423 2.916529 19.453452 5.258843 16.706269 7.948711 8.982104 17.566729
    Stream 6 17.084445 0.738683 11.503079 8.324812 23.483917 20.101834 9.207737 10.311292
    Min Qi 9.400003 0.738683 11.503079 3.001843 15.593335 5.403771 8.870516 8.769539
    Max Qi 17.084445 3.793587 19.453452 8.324812 23.483917 20.101834 11.181661 21.001623
    Avg Qi 12.626783 2.774414 15.090501 5.579222 17.455334 10.141926 9.961123 13.620470
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 41.997798 2.727870 21.651730 25.704209 293.103984 3.171437 2.886688 5.298823
    Stream 1 29.662265 22.788618 12.979253 7.121358 62.774323 22.132581 22.616793 21.625334
    Stream 2 28.041750 22.481172 19.262140 5.790272 58.105179 16.809177 32.813330 12.692499
    Stream 3 32.534297 15.460256 12.038047 7.012926 59.413740 18.540284 25.968635 16.716208
    Stream 4 28.759993 15.123651 21.734471 6.920480 63.119744 12.848884 21.372432 11.662102
    Stream 5 18.315308 21.781800 26.141212 8.230858 60.985590 22.369824 27.098660 25.283066
    Stream 6 31.455961 27.078707 12.954580 11.081669 72.483462 12.376376 22.129120 11.439147
    Min Qi 18.315308 15.123651 12.038047 5.790272 58.105179 12.376376 21.372432 11.439147
    Max Qi 32.534297 27.078707 26.141212 11.081669 72.483462 22.369824 32.813330 25.283066
    Avg Qi 28.128262 20.785701 17.518284 7.692927 62.813673 17.512854 25.333162 16.569726
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 7.793403 81.545934 41.648484 4.638731 25.003179 0.536267 206.980380 2.501589
    Stream 1 27.058060 3.894254 8.664394 25.315007 11.921265 3.561859 22.936601 13.235777
    Stream 2 25.718500 6.140657 8.856586 14.761290 11.870351 7.728217 13.882613 29.328859
    Stream 3 15.896774 8.631035 15.742406 20.621604 13.370582 5.536313 14.677463 14.772753
    Stream 4 22.458327 5.319241 11.973431 22.344017 11.534642 2.402683 24.214115 16.236299
    Stream 5 13.407745 5.413278 8.800650 18.055743 17.528827 4.173171 15.927165 21.636801
    Stream 6 8.069721 5.531066 13.233927 21.321389 7.622026 12.064182 11.457848 12.342336
    Min Qi 8.069721 3.894254 8.664394 14.761290 7.622026 2.402683 11.457848 12.342336
    Max Qi 27.058060 8.631035 15.742406 25.315007 17.528827 12.064182 24.214115 29.328859
    Avg Qi 18.768188 5.821588 11.211899 20.403175 12.307949 5.911071 17.182634 17.925471

    300G run 2

    Virt-H Executive Summary

    Report Date September 25, 2014
    Database Scale Factor 300
    Start of Database Load 09/25/2014 16:38:20
    End of Database Load 09/25/2014 18:32:06
    Database Load Time 1:53:46
    Query Streams for
    Throughput Test
    6
    Virt-H Power 423,431.8
    Virt-H Throughput 387,248.6
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@300GB)
    404,936.3
    Measurement Interval in
    Throughput Test (Ts)
    368.236000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/25/2014 19:28:42 09/25/2014 19:29:58 0:01:16
    Stream 1 09/25/2014 19:30:00 09/25/2014 19:36:04 0:06:04
    Stream 2 09/25/2014 19:30:00 09/25/2014 19:36:00 0:06:00
    Stream 3 09/25/2014 19:30:00 09/25/2014 19:36:06 0:06:06
    Stream 4 09/25/2014 19:30:00 09/25/2014 19:36:07 0:06:07
    Stream 5 09/25/2014 19:30:00 09/25/2014 19:35:53 0:05:53
    Stream 6 09/25/2014 19:30:00 09/25/2014 19:36:08 0:06:08
    Refresh 0 09/25/2014 19:28:41 09/25/2014 19:28:46 0:00:05
    09/25/2014 19:29:58 09/25/2014 19:30:00 0:00:02
    Refresh 1 09/25/2014 19:32:23 09/25/2014 19:32:55 0:00:32
    Refresh 2 09/25/2014 19:30:00 09/25/2014 19:30:31 0:00:31
    Refresh 3 09/25/2014 19:30:31 09/25/2014 19:31:00 0:00:29
    Refresh 4 09/25/2014 19:31:01 09/25/2014 19:31:23 0:00:22
    Refresh 5 09/25/2014 19:31:23 09/25/2014 19:31:54 0:00:31
    Refresh 6 09/25/2014 19:31:55 09/25/2014 19:32:23 0:00:28

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 4.197427 1.011516 2.535959 0.858781 2.857279 1.293530 2.682266 2.260502
    Stream 1 15.467757 3.517499 13.820864 4.157259 13.141556 10.902710 16.899687 8.986535
    Stream 2 15.639991 6.026485 13.521624 3.918031 17.336458 1.975310 9.718194 15.165247
    Stream 3 14.891929 4.481383 15.322621 5.272911 15.266543 6.771253 13.430646 20.171084
    Stream 4 14.560526 2.464157 11.567112 5.526629 20.531540 5.225971 16.288606 17.209475
    Stream 5 10.390577 3.549165 9.598328 8.783847 17.351211 6.308214 12.606512 13.035716
    Stream 6 16.275922 4.086475 14.109963 4.385887 10.174709 6.703266 8.936217 16.798526
    Min Qi 10.390577 2.464157 9.598328 3.918031 10.174709 1.975310 8.936217 8.986535
    Max Qi 16.275922 6.026485 15.322621 8.783847 20.531540 10.902710 16.899687 20.171084
    Avg Qi 14.537784 4.020861 12.990085 5.340761 15.633670 6.314454 12.979977 15.227764
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 8.300092 2.598145 5.168418 1.619399 11.958836 3.191672 3.097822 2.497410
    Stream 1 26.412829 17.354745 12.942454 8.169447 58.600101 15.227942 32.985324 13.914978
    Stream 2 34.523245 17.635531 15.193748 8.435375 62.442800 16.276300 26.533303 12.414575
    Stream 3 25.334301 18.595422 11.663933 10.029387 63.664992 20.378320 24.760768 15.710589
    Stream 4 36.971957 15.645673 14.672851 13.196301 58.214728 17.375053 26.581101 11.624989
    Stream 5 30.891797 12.993365 14.089049 10.515091 65.232712 20.807026 26.920526 11.362095
    Stream 6 38.143281 21.106772 15.152299 18.845766 66.240343 12.295624 22.510610 18.081103
    Min Qi 25.334301 12.993365 11.663933 8.169447 58.214728 12.295624 22.510610 11.362095
    Max Qi 38.143281 21.106772 15.193748 18.845766 66.240343 20.807026 32.985324 18.081103
    Avg Qi 32.046235 17.221918 13.952389 11.531894 62.399279 17.060044 26.715272 13.851388
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 4.016212 1.603004 1.836489 3.542383 3.901876 0.515102 4.759612 2.358873
    Stream 1 22.162387 10.067834 15.772705 22.091355 12.974776 8.354196 19.342171 12.771250
    Stream 2 25.647926 4.263008 11.590737 19.179326 17.899770 4.137031 15.720245 14.719776
    Stream 3 14.511279 7.484608 20.735250 13.041037 17.139046 6.014141 16.234122 13.454647
    Stream 4 19.297494 10.110707 10.907458 19.649066 15.206251 3.423503 11.268082 11.852223
    Stream 5 17.445165 5.582309 15.266324 19.788382 14.245770 2.810949 16.601461 14.019717
    Stream 6 25.115339 6.896503 11.661563 21.900028 5.520025 3.093050 15.436258 13.353446
    Min Qi 14.511279 4.263008 10.907458 13.041037 5.520025 2.810949 11.268082 11.852223
    Max Qi 25.647926 10.110707 20.735250 22.091355 17.899770 8.354196 19.342171 14.719776
    Avg Qi 20.696598 7.400828 14.322339 19.274866 13.830940 4.638812 15.767057 13.361843

    300G run 3:

    Virt-H Executive Summary

    Report Date September 25, 2014
    Database Scale Factor 300
    Total Data Storage/Database Size 258,888M
    Start of Database Load 09/25/2014 16:38:20
    End of Database Load 09/25/2014 18:32:06
    Database Load Time 1:53:46
    Query Streams for
    Throughput Test
    6
    Virt-H Power 417,672.0
    Virt-H Throughput 389,719.5
    Virt-H Composite
    Query-per-Hour Metric
    (Qph@300GB)
    403,453.7
    Measurement Interval in
    Throughput Test (Ts)
    365.902000 seconds

    Duration of stream execution:

    Start Date/Time End Date/Time Duration
    Stream 0 09/25/2014 19:36:11 09/25/2014 19:37:29 0:01:18
    Stream 1 09/25/2014 19:37:32 09/25/2014 19:43:13 0:05:41
    Stream 2 09/25/2014 19:37:32 09/25/2014 19:43:31 0:05:59
    Stream 3 09/25/2014 19:37:32 09/25/2014 19:43:37 0:06:05
    Stream 4 09/25/2014 19:37:32 09/25/2014 19:43:33 0:06:01
    Stream 5 09/25/2014 19:37:32 09/25/2014 19:43:32 0:06:00
    Stream 6 09/25/2014 19:37:32 09/25/2014 19:43:37 0:06:05
    Refresh 0 09/25/2014 19:36:12 09/25/2014 19:36:16 0:00:04
    09/25/2014 19:37:29 09/25/2014 19:37:31 0:00:02
    Refresh 1 09/25/2014 19:40:02 09/25/2014 19:40:33 0:00:31
    Refresh 2 09/25/2014 19:37:31 09/25/2014 19:38:01 0:00:30
    Refresh 3 09/25/2014 19:38:01 09/25/2014 19:38:30 0:00:29
    Refresh 4 09/25/2014 19:38:30 09/25/2014 19:38:58 0:00:28
    Refresh 5 09/25/2014 19:38:58 09/25/2014 19:39:27 0:00:29
    Refresh 6 09/25/2014 19:39:27 09/25/2014 19:40:01 0:00:34

    Numerical Quantities Summary Timing Intervals in Seconds:

    Query Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8
    Stream 0 4.305006 1.083442 2.502758 0.845763 2.840824 1.346166 2.659511 2.233550
    Stream 1 11.513360 3.732513 14.530428 3.819517 14.821291 7.561547 10.435082 8.984230
    Stream 2 13.486433 3.373689 9.620363 3.914320 16.857542 5.837487 10.695443 17.901191
    Stream 3 11.015942 1.780220 4.830412 9.073543 15.587709 9.661989 12.374931 15.262485
    Stream 4 13.600461 0.820899 12.254226 7.799415 19.860761 13.145017 14.404345 11.807583
    Stream 5 13.358000 3.885118 11.099935 4.845043 18.286721 6.424272 9.735255 15.041608
    Stream 6 13.588873 3.789631 13.503399 5.130389 13.104065 3.517076 14.929079 19.831639
    Min Qi 11.015942 0.820899 4.830412 3.819517 13.104065 3.517076 9.735255 8.984230
    Max Qi 13.600461 3.885118 14.530428 9.073543 19.860761 13.145017 14.929079 19.831639
    Avg Qi 12.760511 2.897012 10.973127 5.763705 16.419681 7.691231 12.095689 14.804789
    Query Q9 Q10 Q11 Q12 Q13 Q14 Q15 Q16
    Stream 0 8.553183 3.215484 4.652364 1.620089 11.936052 2.916132 3.219969 2.374276
    Stream 1 29.441108 20.348266 9.994556 14.965432 60.537168 13.302875 30.159402 10.277570
    Stream 2 41.799347 18.197400 16.773638 6.510347 67.461446 20.362328 0.109929 9.908769
    Stream 3 24.306937 20.555376 17.140758 16.715188 61.724168 22.469230 27.967206 13.434167
    Stream 4 34.820796 11.795664 18.015120 7.176057 63.134711 11.427374 23.959842 16.759246
    Stream 5 23.139366 12.655317 13.152401 7.258740 64.273225 22.854106 28.803059 12.832364
    Stream 6 27.955059 24.633526 11.046285 5.995041 74.965966 15.636579 22.803890 13.221303
    Min Qi 23.139366 11.795664 9.994556 5.995041 60.537168 11.427374 0.109929 9.908769
    Max Qi 41.799347 24.633526 18.015120 16.715188 74.965966 22.854106 30.159402 16.759246
    Avg Qi 30.243769 18.030925 14.353793 9.770134 65.349447 17.675415 22.300555 12.738903
    Query Q17 Q18 Q19 Q20 Q21 Q22 RF1 RF2
    Stream 0 4.298092 1.702071 1.894548 4.118591 3.922889 0.491145 4.519734 2.347913
    Stream 1 16.432222 6.908918 17.749058 18.756674 11.148628 5.464975 18.300673 12.972871
    Stream 2 20.588544 4.387662 14.527229 23.844364 15.500462 15.543458 13.666574 15.240662
    Stream 3 14.008049 6.222633 12.833421 22.811602 16.013232 9.449069 16.486111 12.974515
    Stream 4 16.964699 8.106044 11.207675 22.483826 17.354675 4.641183 14.583941 13.679087
    Stream 5 25.243144 7.359437 16.986615 19.855391 17.183725 5.750937 14.759597 13.052316
    Stream 6 12.986721 10.160993 17.496662 19.267026 17.300224 4.955930 19.267721 15.421241
    Min Qi 12.986721 4.387662 11.207675 18.756674 11.148628 4.641183 13.666574 12.972871
    Max Qi 25.243144 10.160993 17.749058 23.844364 17.354675 15.543458 19.267721 15.421241
    Avg Qi 17.703896 7.190948 15.133443 21.169814 15.750158 7.634259 16.177436 13.890115

    To be continued...

    In Hoc Signo Vinces (TPC-H) Series

Title
  • In Hoc Signo Vinces (part 17 of n): 100G and 300G Runs on Dual Xeon E5 2650v2
has creator
is described using
atom:source
atom:updated
  • 2014-10-06T17:58:02Z
  • 2015-06-10T16:09:30Z
atom:title
  • In Hoc Signo Vinces (part 17 of n): 100G and 300G Runs on Dual Xeon E5 2650v2
links to
atom:author
label
  • In Hoc Signo Vinces (part 17 of n): 100G and 300G Runs on Dual Xeon E5 2650v2
atom:published
  • 2014-09-26T21:07:14Z
http://rdfs.org/si...ices#has_services
type
is topic of
Faceted Search & Find service v1.17_git63 as of Apr 23 2021


Alternative Linked Data Documents: iSPARQL | ODE     Content Formats:       RDF       ODATA       Microdata      About   
This material is Open Knowledge   W3C Semantic Web Technology [RDF Data] Valid XHTML + RDFa
OpenLink Virtuoso version 08.03.3322 as of Jun 3 2021, on Linux (x86_64-generic-linux-glibc25), Single-Server Edition (30 GB total memory)
Data on this page belongs to its respective rights holders.
Virtuoso Faceted Browser Copyright © 2009-2021 OpenLink Software