You may be one of the many VMware admins who were unwillingly dropping into the world or storage when you wanted to take advantage of advanced VMware features like high availability (HA) and distributed resources scheduler (DRS). In my case, I was forced to learn more about SAN administration when we wanted to use ESX Server 3 high availability. Many VMware admins still know that they have a lot to learn about storage and, still others, are just getting started.
Today, the world of virtualization and storage have become more and more intertwined and interdependent. VMware (majority owned by EMC) offers their own software-defined storage solution and integrates more and more into the storage layer with features like VAAI and VASA. Software-defined storage solutions and virtualization-aware storage are becoming, more and more, the “norm” in the datacenter. In fact, VMworld looked just as much like a storage show, as much as it did a virtualization show. This all goes to support the fact that, in many IT shops, the “silos are breaking down” and you’re now an “infrastructure administrator”, not just a virtualization admin anymore.
In my time spent learning about and working with storage and virtualization, here are some of the top tips that and resources that I have come up with:
Being successful at storage (as it relates to virtualization) begins with a strong knowledge of the storage fundamentals. For example, what is a HBA, a LUN, RAID striping, SAN vs NAS, storage protocols (iSCSI, NFS, FC), target vs initiator, SMI-S, and who is SNIA?
Here are some of the resources I have used over the years and recommend-
For example, the VMware diagram below shows how the different VMs are made up of virtual disks, those disks are stored in datastores and those datastores could be stored across multiple storage infrastructures, across multiple LUNs.
Graphic Thanks to VMware.com
Once you have a basic understanding of storage infrastructure and how it works, then you can move on to learn VMware’s approach to storage. For example, VMFS vs NFS, virtual disk types, storage vMotion, iSCSI, disk queues, and more. And what about those new things called “VVOLs”?
Some of the VMware storage resources I have used over the years and recommend are:
With fundamental knowledge and then knowledge of vSphere storage, you must ensure that you get some hands on experience. Some admins have access to a high-end SAN at their office. If you don’t have a high-end SAN sitting around and if you don’t have $100K lying around to buy your own storage, no worries.
The best way to gain hands-on storage experience, as it relates to vSphere is to “do it first hand”. Here are some tips:
With your knowledge and hands-on experience about SAN and vSphere administration, it’s time to get down to some tools. What you need is knowledge about-
For example, what model SAN do you have, how is it configured, and how is it connected? How is vSphere configured, what VMs are running on it, where are they on the SAN, and how are they performing?
Usually, part of this information is in the storage and the other part of this information is in the vSphere hypervisor (ESXi) or centralized management platform (vCenter).
VMware admins typically use vCenter storage reports and SAN management tools to gather this info.
For example, vCenter offers some basic analysis of storage-
VMware command line tools like esxcli and esxtop are also very helpful.
Management tools like vCenter Operations Manager also provide storage performance information, as you see below-
While all admins need to be able to view I/O’s in and out and capacity utilization, VMware admins are needing tools that offer more and more insight and numerous companies have stepped up to the plate to help with that problem.
For example, some tools that are offering greater storage performance analysis than ever before are-
Additionally, with the increased focus on storage performance, more and more admins are getting interested in vSphere caching. An example of a vSphere caching solution that requires no hardware to install, requires no downtime to deploy, and offers a free evaluation is the Infinio Accelerator.
Infinio's version 2.0 adds several capabilities to help you better understand your storage performance. For each accelerated datastore, Infinio offers analysis of storage I/O on a per-virtual machine basis, such as which VMs benefit most from caching, and which are generating the most I/O.
For example, here you see a breakdown of the top virtual machines on a datastore, ranked by how much I/O they are generating.
Another valuable resource in the new Accelerator 2.0 product is Cache Advisor. With Cache Advisor, you’ll be able to see what the impact of adding different amounts of cache is to your offload rate, answering questions like "how much more memory should I give Infinio to get a 90% offload rate?"
You can sign up to be notified when Infinio Accelerator 2.0 goes into beta here: http://bit.ly/1p7lCJE
In summary, no longer can you just be a "VMware admin" - welcome to the storage world too. Thankfully, as you can see above, there are a lot more resources available today than ever before and I welcome your feedback on them.
Now, let me direct this article back out to you, the reader ... What’s your favorite vSphere/Storage resource and tool? I welcome your comments, below!