Azure Tier Comparison (Benchmark)

Microsoft Azure

So i had some free time and an itch to understand how the different tiers really differed from each other in Azure. It’s important to understand that this is not a comparison against other cloud providers, it’s not designed to show the maximum potential in azure and the results are valid as of 05/08/2016 (most likely will be outdated in 3 months).

To elaborate on the three points above:

  • I wanted to see the differences in terms of performance between the different VM size which Azure offers. I don’t want to compare them with other cloud providers as there are too many variables to considers and will be like comparing apples to oranges.
  • The test i ran where identical for each VM so to show the true differences between them, while i tried to configure the test to get the max performance i can’t grantee that the results i have are the absolute maximum you can achieve nor are they the guaranteed performance you will get when you spin up a VM, especially when it comes to the network results.
  • As with anything the results will probably be outdated in the next 3 months, as Azure replaces old hardware and migrates servers to new more powerful one, prime example would be the network for A series which can now achieve a lot more than the 5 – 400 mbit/s it was initially configured to have.

While the CPU and Ram tests are quite accurate, it was very tricky to get consistent network results due to it’s complexity, i guess that’s why Microsoft do not have official public results of there network and you should in no case take these results as concrete. If you think about it you have different networks over different racks, over different hardware, with Network Security group rules and so on and so on. In my case even creating different machines of the same size showed some slight variation as it most likely was on the other side of the data center. As such i have given the averages by running a lot of tests.

The way i ran the test was to create a G5 machine and install Iperf3 and run it as a server. Then i spun up a VM starting with A0 in the same network, subnet and the same NSG group. I installed Iperf3 and ran it as a client to test against the G5 machines. I ran a few tests (get the average) after which i would change the size instance to the next size up. One thing to stress this is the network speed of the internal network between virtual machines.

I did not post or test extensively the storage io as i found it to be very close to what Microsoft posted (500 iops per normal disk).

Iperf3 Settings:

  • Number of threads: 30
  • Packet size: 2048 KB
  • Test duration: 30 seconds

Software:

  • CPU,RAM Tests: Novabench
  • Disk Tests: Diskspd Utility (superseding SQLIO)
  • Network: Iperf3

Environment:

  • VM OS: Windows Server 2012 R2
  • Location: Azure West Europe
  • Type:  ARM
  • Network: Same Virtual network, Subnet and NSG
 CPU Floating PointCPU IntegerCPU MD5 HashingRam SpeedIperf Internal Network TestLatency 
OPS/SecondOPS/SecondGenerated/SecondMB/sMbit/s
A0 7,342,245 17,403,189 195,629 2,158 4502ms
A1 14,356,746 34,109,137 390,896 4,126 12002ms
A2, A5 28,304,496 72,205,882 413,747 4,451 20002ms
A3, A6 56,267,428 142,505,408 389,636 4,515 20002ms
A4, A7 113,955,256 279,482,496 381,127 4,518 20002ms
A8, A10 204,486,040 702,109,104 1,009,893 11,731 32002ms
A9, A11 409,001,600 1,412,715,328 1,011,888 12,026 32002ms
D1 24,268,074 59,110,993 665,754 7,987 20002ms
D2, D11 49,442,928 125,056,984 704,646 8,695 20002ms
D3, D12 100,603,964 246,954,620 704,402 8,418 20002ms
D4, D13 195,991,600 491,080,272 684,456 8,403 20002ms
D1_V2 25,528,753 89,765,315 941,641 11,068 29002ms
D2_V2, D11_V2 50,998,032 176,682,360 978,454 10,924 29002ms
D3_V2, D12_V2 101,907,360 346,187,376 987,393 10,761 29002ms
D4_V2, D13_V2 203,695,704 682,719,000 955,868 10,410 29002ms
D5_V2, D14_V2 407,601,120 1,405,837,744 939,464 10,247 29002ms
GS1 50,991,708 173,447,442 971,055 10,335 32002ms
GS2 102,068,092 367,824,420 975,045 10,833 32002ms
GS3 204,035,376 696,130,296 977,296 10,070 32002ms
GS4 408,175,696 1,421,048,528 980,252 10,551 32002ms
GS5 816,471,872 Error 1,013,625 9,734 32002ms

 

 

4 thoughts on “Azure Tier Comparison (Benchmark)

  1. Maybe there’s a little error.
    On D and D V2 lines, are aggregated machines with different core numbers (not on A lines).
    Usually one has the double of cores of the other.
    Azure machines haven’t a fixed naming convention.
    Usually Dn and D(n+9), have the same cores, (V2 too)
    but there are exceptions.

    Thank you for you test.

    1. Hello Marco,

      You are absolutely correct, it was a entry mistake (Grammatical) one on my part.
      I have fixed the table to represent the actual names for the D series :).
      Thank you for pointing it out.

      Regards

Leave a Reply

Your email address will not be published. Required fields are marked *