Skip navigation

I often receive questions about programmatic options to manage Hitachi Storage Infrastructure as customers move to higher degrees of automation in their environment. We have many options in this area including CM REST APIs, UCP Advisor, VMware vRealize Orchestrator Connector and Hitachi Snapin adapter for Microsoft PowerShell. One that we probably should highlight more is the Hitachi Infrastructure adapter for PowerShell

 

powershell_rm.png

The Hitachi Snapin for PowerShell software allows administrators to extend the PowerShell/PowerCLI capabilities in VMware, Microsoft and other environments with access to a set of cmdlets for discovering and managing Hitachi storage which can be included in scripts to accomplish a range of daily infrastructure tasks. This covers tasks for Block Storage and NAS Storage such as creating LUNs, CIFS shares, snapshots, clones, datastores, modifying hostgroups etc. It can also manage multi-site operations between arrays such as enabling replication (truecopy, universal replicator or global active device) on specific LUNs using powershell remoting feature which we support.The scripter can filter, sort, and group the storage information by piping the output of one Hitachi infrastructure cmdlets to other cmdlets.

 

We now have over 100+ cmdlets that cover key operations that administrators may want to automate. (I pasted the list below for google search). Simply, add the Snapin, add-storagedevice and ready to execute cmdlets against storage.

 

Go to support.hitachivantara.com and download the free PowerShell adapter ( I had it placed in the VMware adapter section for convenience) and review the admin guide in the package for complete list of cmdlets. We are on version 1.1 so always great to hear feedback on cmdlets that we should be adding going forward.

 

 

 

PS C:\Program Files\Hitachi\SystemCenter\HiPowerShellInfrastructure> Get-Command -Module Hitachi.storage.management.powershell2.admin
CommandType Name Version Source
----------- ---- ------- ------
Cmdlet Add-CIFSShareAccessAuthentication
Cmdlet Add-FileServer
Cmdlet Add-HostGroupToResourceGroup
Cmdlet Add-HostgroupWWN
Cmdlet Add-iSCSIInitiator
Cmdlet Add-iSCSILU
Cmdlet Add-iSCSITargetToResourceGroup
Cmdlet Add-LUToResourceGroup
Cmdlet Add-PortToResourceGroup
Cmdlet Add-QuorumDisk
Cmdlet Add-StorageDevice
Cmdlet Allow-SystemDriveAccess
Cmdlet Clone-FSDirectory
Cmdlet Create-CciConfiguration
Cmdlet Create-CIFSShare
Cmdlet Create-Clone
Cmdlet Create-EnterpriseSnapshot
Cmdlet Create-EVS
Cmdlet Create-FileClone
Cmdlet Create-Filesystem
Cmdlet Create-FSDirectory
Cmdlet Create-FSiSCSILogicalUnit
Cmdlet Create-FSiSCSITarget
Cmdlet Create-FSSnapshot
Cmdlet Create-FSStoragePool
Cmdlet Create-FSVirtualVolume
Cmdlet Create-FSVirtualVolumeQuota
Cmdlet Create-GADPair
Cmdlet Create-Hostgroup
Cmdlet Create-iSCSITarget
Cmdlet Create-Journal
Cmdlet Create-LU
Cmdlet Create-ModularSnapshot
Cmdlet Create-MultiSiteTrueCopy
Cmdlet Create-MultiSiteUniversalReplicatorPair
Cmdlet Create-NFSExport
Cmdlet Create-RemoteClone
Cmdlet Create-SnapOnSnapPair
Cmdlet Create-Snapshot
Cmdlet Create-StoragePool
Cmdlet CreateVirtualBox-ResourceGroup
Cmdlet Create-VVOL
Cmdlet Delete-CIFSShare
Cmdlet Delete-CIFSShareAccessAuthentication
Cmdlet Delete-Clone
Cmdlet Delete-EVS
Cmdlet Delete-Filesystem
Cmdlet Delete-FSDirectory
Cmdlet Delete-FSiSCSILogicalUnit
Cmdlet Delete-FSiSCSITarget
Cmdlet Delete-FSSnapshot
Cmdlet Delete-FSStoragePool
Cmdlet Delete-FSVirtualVolume
Cmdlet Delete-FSVirtualVolumeQuota
Cmdlet Delete-GADPair
Cmdlet Delete-Hostgroup
Cmdlet Delete-iSCSITarget
Cmdlet Delete-Journal
Cmdlet Delete-LU
Cmdlet Delete-NFSExport
Cmdlet Delete-RemoteClone
Cmdlet Delete-ReplicationPairGroup
Cmdlet Delete-ResourceGroup
Cmdlet Delete-Snapshot
Cmdlet Delete-StoragePool
Cmdlet Deny-SystemDriveAccess
Cmdlet Disable-EVS
Cmdlet Edit-HostgroupHostMode
Cmdlet Enable-CommandDevice
Cmdlet Enable-EVS
Cmdlet Expand-Filesystem
Cmdlet Expand-FSStoragePool
Cmdlet Expand-Journal
Cmdlet Expand-LU
Cmdlet Expand-StoragePool
Cmdlet Format-Filesystem
Cmdlet Get-CIFSShare
Cmdlet Get-CIFSShareAccessAuthentication
Cmdlet Get-Clone
Cmdlet Get-Controller
Cmdlet Get-Drive
Cmdlet Get-EVS
Cmdlet Get-FileServer
Cmdlet Get-FileServerNodes
Cmdlet Get-Filesystem
Cmdlet Get-FreeConsistencyGroup
Cmdlet Get-FreeLU
Cmdlet Get-FSiSCSIAggregateGroups
Cmdlet Get-FSiSCSIDomainName
Cmdlet Get-FSiSCSILogicalUnit
Cmdlet Get-FSiSCSITarget
Cmdlet Get-FSSnapshot
Cmdlet Get-FSStoragePool
Cmdlet Get-FSVirtualVolume
Cmdlet Get-FSVirtualVolumeQuota
Cmdlet Get-GADPair
Cmdlet Get-HitachiDisk
Cmdlet Get-Hostgroup
Cmdlet Get-iSCSITarget
Cmdlet Get-Journal
Cmdlet Get-LinkAggregation
Cmdlet Get-LU
Cmdlet Get-LUPerformance
Cmdlet Get-NFSExport
Cmdlet Get-Port
Cmdlet Get-PortLoginWWNs
Cmdlet Get-PortPerformance
Cmdlet Get-QuorumDisk
Cmdlet Get-RemoteClone
Cmdlet Get-ReplicationPairGroup
Cmdlet Get-ResourceGroup
Cmdlet Get-Snapshot
Cmdlet Get-StorageDevice
Cmdlet Get-StoragePool
Cmdlet Get-SystemDrive
Cmdlet Get-Version
Cmdlet Get-VirtualStorageDevice
Cmdlet Lock-ResourceGroup
Cmdlet Map-FloatingVVol
Cmdlet Map-VirtualLU
Cmdlet Modify-CIFSShare
Cmdlet Modify-FSiSCSILogicalUnit
Cmdlet Modify-FSiSCSITarget
Cmdlet Modify-FSVirtualVolume
Cmdlet Modify-FSVirtualVolumeQuota
Cmdlet Modify-NFSExport
Cmdlet Modify-SysLock
Cmdlet Mount-CIFSShare
Cmdlet Mount-Filesystem
Cmdlet Mount-FSiSCSILogicalUnit
Cmdlet Mount-LU
Cmdlet Present-LU
Cmdlet Present-LUAsNASDrive
Cmdlet Remove-FileServer
Cmdlet Remove-HostGroupFromResourceGroup
Cmdlet Remove-HostgroupWWN
Cmdlet Remove-iSCSIInitiator
Cmdlet Remove-iSCSILU
Cmdlet Remove-iSCSITargetFromResourceGroup
Cmdlet Remove-LUFromResourceGroup
Cmdlet Remove-PortFromResourceGroup
Cmdlet Remove-QuorumDisk
Cmdlet Rename-Filesystem
Cmdlet Reserve-LUForGAD
Cmdlet Restore-Filesystem
Cmdlet Restore-ReplicationPairGroup
Cmdlet Resync-Clone
Cmdlet Resync-GADPair
Cmdlet Resync-RemoteClone
Cmdlet Resync-ReplicationPairGroup
Cmdlet Resync-Snapshot
Cmdlet Set-FSiSCSIDomainName
Cmdlet Set-HDPPoolThreshold
Cmdlet Shrink-Journal
Cmdlet Shrink-StoragePool
Cmdlet Split-Clone
Cmdlet Split-GADPair
Cmdlet Split-RemoteClone
Cmdlet Split-ReplicationPairGroup
Cmdlet Split-Snapshot
Cmdlet UnLock-ResourceGroup
Cmdlet Unmap-FloatingVVol
Cmdlet Unmap-VirtualLU
Cmdlet Unmount-CIFSShare
Cmdlet Unmount-Filesystem
Cmdlet Unmount-FSiSCSILogicalUnit
Cmdlet Unmount-LU
Cmdlet Unpresent-LU
Cmdlet Unpresent-LUAsNASDrive

A lengthy title but the following is long overdue for our customers. In the most recent releases of vSphere 6.7 and vSphere 6.5, VMware has now included default multipathing claim rules for Hitachi VSP Storage.

 

As a refresher, most customers had to manually add the following SATP rules when configuring multipathing (specifically path selection (PSP) and path failover (SATP) rules for Hitachi devices) on every ESXi host. Now these rules are included out of the box in vSphere 6.7U1 and vSphere 6.5 P03 (GA today, Nov 30th 2018) builds or later. This further reduces the time to production usage when deploying new vSphere ESXi hosts/clusters connected Hitachi Storage or as part of Hitachi UCP converged offering. The rules will handle devices configured with or without ALUA with ALUA typically being used for active-active (GAD) configurations.

 

The following are the recommended rules and what is now baked into vSphere builds

 

esxcli storage nmp satp rule add -V HITACHI  -P VMW_PSP_RR -s VMW_SATP_ALUA -c tpgs_on -e "Hitachi VSP Storage with ALUA enabled"

esxcli storage nmp satp rule add --satp "VMW_SATP_DEFAULT_AA" -V HITACHI -P "VMW_PSP_RR" -e "Hitachi VSP Storage"

 

We kept the IO Operations Limit to the default of 1000 as every site has some uniqueness. This may differ from other vendors recommendations (some who recommend 1) but that low a value would spoil the sequential detection handling within the VSP array and you might lose some performance from increases in random port behavior. More tests in this area to follow but wouldn't go below value of 20 if you do want to tweak where you have smaller number of LUNs and a high number of paths based on some initial informal testing.

 

Here is the typical output you should see on fresh install.  Note rules are "system" and no longer "user"

-------------------------------------------------------------------------------------------------------------------------------

[root@localhost:~] esxcli storage nmp satp rule list |grep -i Hitachi

VMW_SATP_ALUA                        HITACHI   OPEN-V   system      tpgs_on                  VMW_PSP_RR            Hitachi VSP Storage with ALUA enabled                              

VMW_SATP_DEFAULT_AA          HITACHI                     system      inq_data[128]={0x44 0x46 0x30 0x30}  VMW_PSP_RR                                                                                

VMW_SATP_DEFAULT_AA          HITACHI   OPEN-V    system      tpgs_off                 VMW_PSP_RR             Hitachi VSP Storage                                                      

VMW_SATP_DEFAULT_AA          HITACHI                     system           

 

If you want to check what SATP/PSP is being claimed by a device (datastore LUN),  use the following command

------------------------------------------------------------------------------------------------------------------------------------------------

[root@localhost:~] esxcli storage nmp device list

naa.60060e800727200000302720000002aa

   Device Display Name: HITACHI Fibre Channel Disk (naa.60060e800727200000302720000002aa)

   Storage Array Type: VMW_SATP_ALUA

   Storage Array Type Device Config: {implicit_support=on; explicit_support=off; explicit_allow=on; alua_followover=on; action_OnRetryErrors=off; {TPG_id=7,TPG_state=AO}{TPG_id=4101,TPG_state=AO}}

  Path Selection Policy: VMW_PSP_RR

   Path Selection Policy Device Config: {policy=rr,iops=1000,bytes=10485760,useANO=0; lastPathIndex=1: NumIOsPending=0,numBytesPending=0}

   Path Selection Policy Device Custom Config:

   Working Paths: vmhba3:C0:T0:L0, vmhba2:C0:T0:L0

 

if you want to check the paths, [root@localhost:~] esxcli storage core path list

   Runtime Name: vmhba3:C0:T0:L1

   Device Display Name: HITACHI Fibre Channel Disk (naa.60060e800727200000302720000002ab)

   Adapter: vmhba3

   Channel: 0

   Target: 0

   LUN: 1

<truncated>

   ----------------------------------------------------------------------------------------------------------------------------------------------

So another step to improve time to value and out of box best practice reliability in your VMware ecosystems with Hitachi Infrastructure. As parting thought and for upcoming blog, did you know latest release of UCP Advisor can perform that ESXi deployment from scratch (on supported compute) to take this time to value to the next level..

 

[update] If you want more information on claimrules, I found the following VMware online document useful

https://docs.vmware.com/en/VMware-vSphere/6.7/com.vmware.vsphere.storage.doc/GUID-9B19EF2E-DA5A-43D2-B41F-8E7C112D2E00.html

 

https://docs.vmware.com/en/VMware-vSphere/6.5/rn/esxi650-201811002.html

On we roll to the final part 3 blog on UCP Advisor v1.2. I jest with the part "Tree" as I was reminded that those unaccustomed to listening to the Irish accent don't know we tend to drop the "h" which sends my kids into hysterics when I say "3".

At least UCP Advisor is generating the right sort of hysterics.....tt.png

In part 2 , I covered the essential networking mgmt, some of the day 0-90 administration aspects and integrated data protection management features. I am going to conclude and cover firmware management, some of the bare metal support, integrated operational analysis with Log Insight content pack and close on some of the cloud automation integration aspects using Powershell and vRO.

 

When it comes to software firmware management, it's one of those areas that normally infuses dread into administrators. We all share the same apprehension when deciding to update some frequently used software package on our tablet/streaming TV that we tend to rely on after poor previous experience. The planning and execution to successfully navigate software upgrades in an enterprise environment of inter-dependent infrastructure components running production workloads, with the mandate to keep the business online, takes it to another time consuming level. Part of the issue is the passage of time between each upgrade requiring generalist admins to re-research and figure out the esoteric operations for each of the individual components based on latest best practices/software versions. With UCP Advisor, we tackled the problem of ensuring the software could update administrators when a suitable collection of firmware was available, give administrators a simple menu of to select where and what could be deployed. This includes BMC, BIOS and BMC firmware upgrades on the compute nodes supporting hyper converged UCP HC and converged UCP 2000 and also the network switches providing either FC and Ethernet services. UCP Advisor will apply the software updates carefully across the range of infrastructure components while ensuring non-impact to services that UCP is serving. It ensures, for example, firmware updates are completed on side A of FC fabric/spine-leaf infrastructure before doing side B, it ensures each or a set of compute nodes is back and operational before progressing to next one. In version 1.2, you can optionally add additional capacity before doing upgrades to ensure sufficient capacity to handle workloads during upgrade cycle. Click the visual below to get some some indication of the administration process.

firmware mgmt.gif

 

I mentioned bare-metal. Essentially, UCP Advisor is not restricted to providing infrastructure services to ESXi hosts. With right credentials, UCP Advisor exposes physical infrastructure management so Advisor administrator could automate the creation and hostgroup presentation of iSCSI LUNs to a RedHat physical node. Other areas covered include storage pools and subset of replication pair management

bm.gif

 

When it comes to operational insight, VMware's log insight (vRLI) provides a intuitive real time log analysis toolset to provide real time answers and insights to problems or potential operational problems related to systems and services on UCP platform. UCP Advisor comes with integrated content pack which provides the connection to logs from compute, network and storage. In a previous blog, I covered some examples of how a version of this content pack can be leveraged including automatic alerts based on unknown intrusions into infrastructure management domain from suspect IP addresses based purely on real time log analysis. Huge potential to exploit this for many different use cases. Click visual to get a perspective on this. I'm really interested to hear how you are exploiting the log insight content packs.

loginsight.gif

 

Finally, UCP and UCP Advisor can be integrated into cloud automation management toolset and processes such as vRealize Automation or similar products like Hitachi Enterprise Cloud. UCP Advisor comes with extended PowerCLI cmdlets and vRealize Orchestrator (vRO) workflows for the majority of the tasks that I've mentioned previously. There is a mixture of foundational workflows and high level workflows that are provided, whether for example its to allow service catalog based creation/deployment of ESXi/datastore infrastructure resources or allow self service VM recovery for tenant users.

vro.gif

 

To borrow from my "tree" opening, I highly recommend evaluating the infrastructure automation simplicity that UCP Advisor (download) brings to your virtualization/private cloud infrastructure projects so you can manage the forest and not have to climb each and every tree. Stay tuned as team is busy working on next-gen UCP Advisor with even more automation brilliance.

 

TitleAuthorCreatedViews
Blog PostLet's See the Demo - UCP Advisor in Action

I recently published a short video blog Let's hear it - Introduction to UCP Advisor which introduced a new converged and hyper-converged infrastructure automation and delivery software from HDS...

Paul MorrisseyNovember 28, 2016 7:18 PM438201Actions
Blog PostLet's hear it - Introduction to UCP Advisor

With the announcement that UCP Advisor went GA today, I wanted to expand on the initial blog Boom!- Rolling out UCP Advisor for Converged and Hyper-Converged - Infrastructure Orchestration Software where we introduced..

Paul MorrisseyNovember 22, 2016 1:34 AM1025202Actions
Blog PostBoom!- Rolling out UCP Advisor for Converged and Hyper-Converged - Infrastructure Orchestration Software

This week we rolled out the new Hitachi Management Automation Strategy to deliver modern infrastructure management software to enable customers to simplify and automate the delivery of infrastructure and application s..

Paul MorrisseyOctober 11, 2016 8:09 AM2390304Actions
Blog PostVMUG Virtual Event - Software–Defined & Reliably Delivered High Availability / Disaster Recovery across Tier 1 Applications

in VMware

Paul MorrisseyNovember 5, 2015 1:03 AM1746311Actions
Blog PostLatest V Integration - Hitachi Content Packs for VMware vRealize Log Insight – Compute and Storage

in VMware

Paul MorrisseyOctober 14, 2015 8:09 AM968520Actions
Blog PostAutomating VM Snapshot Backups and Restoring 1TB VMs in seconds with Hitachi Virtual Infrastructure Integrator - Part 2

Simplifying data protection and virtual machine data management is every VM administrator and IT architecture team goal. More and more of my conversations with clients when discussing their plans for extending their E...

Paul MorrisseyJune 30, 2015 8:14 PM1842310Actions
Blog PostHitachi and VMware Virtual Volumes - Part 3

in VMware

Paul MorrisseyMarch 26, 2015 11:43 PM7602110Actions
Blog PostHitachi and VMware Virtual Volumes - Part 2

in VMware

Paul MorrisseyMarch 18, 2015 11:56 PM3953210Actions
Blog PostHitachi and VMware Virtual Volumes - Part 1

in VMware

Paul MorrisseyMarch 16, 2015 11:58 AM5992221Actions
Blog PostShining a light on Hitachi Storage Adapter for VMware vC Ops (hmm vROPS)

VMware vCenter Operations Management Suite (recently rebranded as VMware vRealize Operations) has become an integrated part of today’s data center management stack due its ability to monitor virtual infrastructu...

Paul MorrisseyNovember 7, 2014 4:50 PM3894001Actions
Blog PostKeeping VM and storage admins excited - updates from Hitachi Storage at VMworld Barcelona

This week at VMworld Barcelona, we are covering a number of initiatives that we have delivered on in recent months or just announced at the show. Beside'sall the great work we are doing with Unified Compute Platform ...

Paul MorrisseyOctober 15, 2014 6:15 AM3447121Actions
Blog PostAutomating VM Snapshot Backups and Recovering 1TB VMs in seconds with Hitachi Virtual Infrastructure Integrator

One of the key areas we assist our customer's leveraging HDS Storage for their VMware environments is automated VM-level backups. This is one of the key areas addressed by a solution called Hitachi Virtual Infrastruct...

Paul MorrisseyOctober 12, 2014 7:55 AM4302005Actions
Blog PostFearless: Hitachi , NFS and VMware ; Scaling from 200 to 15,000 VMs with HNAS

Hitachi is traditionally be seen as the leader in FC Block for enterprise storage systems. You want reliable scalable vSphere based environment, you could be fearless with Hitachi. Now, I want to give a callout to th...

Paul MorrisseyAugust 27, 2014 5:41 PM2707100Actions
Blog PostGlobal Active “Datastore” with VSP G1000 GAD is now VMware Metro Storage Cluster certified (block and file)

"Global Active Datastore" ready for active-active datacenters. Just received notification that we're officially vSphere Metro Storage Cluster (VMware vMSC) certified for 5.5 and 5.5U1 with both a new file certificati...

Paul MorrisseyAugust 25, 2014 10:13 PM4673202Actions
Blog PostNo Worry Desktops, Save Money - VMware Mirage with Hitachi Data Systems

No Worry Desktops, Save Money - VMware Mirage with Hitachi Data Systems   The advent of bring-your-own-device (BYOD) has pushed organizations worldwide to seriously consider centralized endpoint management for ...

Paul MorrisseyAugust 20, 2014 2:21 PM2693000Actions
Blog PostVMware Virtual Volumes (VVol) with Hitachi Storage and Converged Infrastructure.

This is the time of year when the tech community eagerly awaits the start of VMworld, where VMware and its partners unveil cutting edge technology products and solutions. In the run up to VMworld, nothing else merits ...

Paul MorrisseyJuly 27, 2014 8:33 PM4064522