We have made an Amazon EC2 deployment of Virtuoso 7 Commercial Edition, configured to use the Elastic Cluster Module with TPC-H preconfigured, similar to the recently published OpenLink Virtuoso Benchmark AMI running the Open Source Edition. The details of the new Elastic Cluster AMI and steps to use it will be published in a forthcoming post. Here we will simply look at results of running TPC-H 100G scale on two machines, and 1000G scale on four machines. This shows how Virtuoso provides great performance on a cloud platform. The extremely fast bulk load \u2014 33 minutes for a terabyte! \u2014 means that you can get straight to work even with on-demand infrastructure.
\n\nIn the following, the Amazon instance type is R3.8xlarge, each with dual Xeon E5-2670 v2, 244G RAM, and 2 x 300G SSD. The image is made from the Amazon Linux with built-in network optimization. We first tried a RedHat image without network optimization and had considerable trouble with the interconnect. Using network-optimized Amazon Linux images inside a virtual private cloud has resolved all these problems.
\n\nThe network optimized 10GE interconnect at Amazon offers throughput close to the QDR InfiniBand running TCP-IP; thus the Amazon platform is suitable for running cluster databases. The execution that we have seen is not seriously network bound.
\n\n\n| Run | \nPower | \nThroughput | \nComposite | \n
|---|---|---|---|
1\n \n | \n 523,554.3\n | \n 590,692.6\n | \n 556,111.2\n | \n
2\n \n | \n 565,353.3\n | \n 642,503.0\n | \n 602,694.9\n | \n
| Run | \nPower | \nThroughput | \nComposite | \n
|---|---|---|---|
1\n \n | \n 592,013.9\n | \n 754,107.6\n | \n 668,163.3\n | \n
2\n \n | \n 896,564.1\n | \n 828,265.4\n | \n 861,738.4\n | \n
3\n \n | \n 883,736.9\n | \n 829,609.0\n | \n 856,245.3\n | \n
For the larger scale we did 3 sets of power + throughput tests to measure consistency of performance. By the TPC-H rules, the worst (first) score should be reported. Even after bulk load, this is markedly less than the next power score due to working set effects. This is seen to a lesser degree with the first throughput score also.
\n\n\n\nThe numerical quantities summaries are available in a report.zip file, or individually --
\nreport-100-1.txt\n report-100-2.txt\n report-1000-1.txt\n report-1000-2.txt\n report-1000-3.txt\n \n Subsequent posts will explain how to deploy Virtuoso Elastic Clusters on AWS.
\n\n\n