Introduction
This blog shows how to migrate 3 Data Centre (3DC) setup pairs from a Hitachi Virtual Storage Platform E590 (VSP E590) storage system using a VSP G600 storage system as a remote storage system to a VSP One Block 28 (VSP One B28) storage system with VSP F900 as the remote storage system non-disruptively.
Environment
The migration environment consists of:
· Source Primary: VSP E590 storage system with microcode 93-07-23-40/01
· Source Secondary: VSP E590 storage system with microcode 93-07-23-40/01
· Source Remote: VSP G600 storage system with microcode 83-05-51-40/00
· Target Primary: VSP One B28 storage system with microcode A3-02-21-40/01
· Target Secondary: VSP One B28 storage system with microcode A3-02-21-40/01
· Target Remote: VSP F900 storage system with microcode 88-08-13-60/01
· Quorum: 1x G600
· One RHEL host
· FC switch for Host and Remote connections.
Figure 1 shows the setup used for migrating 3DC volumes from a VSP E590 storage system with VSP G600 storage system as the remote storage to a VSP One B28 storage system with VSP F900 as the remote storage. Two quorum disks were created from the VSP G600 storage system for the source and target global-active device (GAD) pairs. A temporary GAD pair is created for data migration with a volume-less quorum device. The migration workflow is shown using a single 3DC pair.

Figure 1: 3DC migration environment
Setup
To set up the environment, complete the following steps:
1. Create remote paths, quorums, and prepare volumes for testing.
2. For 3DC pair operations, create six horcm files, one for each storage system, as shown in Figure 2.
Note: In the lab environment, a 3DC device pair is used for data migration.
Prepare horcm files for each storage system as follows:

Figure 2: Horcm Files
· Horcm -Source Primary (horcm672.conf):
HORCM_MON
#ip_address service poll(10ms) timeout(10ms)
localhost 13230 3000 3000
HORCM_CMD
#dev_name dev_name dev_name
\\.\IPCMD-172.a.a.a-31001
HORCM_LDEV
3dc_gad_grp1 3dc_gad_grp1_pair0 611111 1024 0
3dc_gad_grp2 3dc_gad_grp2_pair0 611111 1024 1
3dc_hur_grp 3dc_hur_grp_pair0 611111 1024 h2
HORCM_INSTP
3dc_gad_grp1 localhost 13231 1
3dc_gad_grp2 localhost 13330 2
3dc_hur_grp localhost 13232 5
· Horcm -Source Secondary (horcm692.conf):
HORCM_MON
#ip_address service poll(10ms) timeout(10ms)
localhost 13231 3000 3000
HORCM_CMD
#dev_name dev_name dev_name
\\.\IPCMD-172.b.b.b-31001
HORCM_LDEV
3dc_gad_grp1 3dc_gad_grp1_pair0 622222 1024 0
3dc_delta_grp 3dc_delta_grp_pair0 622222 1024 h3
HORCM_INSTP
3dc_gad_grp1 localhost 13230 1
3dc_delta_grp localhost 13232 4
· Horcm -Source Remote (horcm1912.conf):
HORCM_MON
#ip_address service poll(10ms) timeout(10ms)
localhost 13232 3000 3000
HORCM_CMD
#dev_name dev_name dev_name
\\.\IPCMD-172.c.c.c-31001
HORCM_LDEV
3dc_delta_grp 3dc_delta_grp_pair0 433333 1024 h3
3dc_hur_grp 3dc_hur_grp_pair0 433333 1024 h2
HORCM_INSTP
3dc_delta_grp localhost 13231 4
3dc_hur_grp localhost 13230 5
· Horcm -Target Primary (horcm422.conf):
HORCM_MON
#ip_address service poll(10ms) timeout(10ms)
localhost 13330 3000 3000
HORCM_CMD
#dev_name dev_name dev_name
\\.\IPCMD-172.d.d.d-31001
HORCM_LDEV
3dc_gad_grp2 3dc_gad_grp2_pair0 844444 1024 1
3dc_gad_grp3 3dc_gad_grp3_pair0 844444 1024 2
3dc_hur_grp 3dc_hur_grp_pair0 844444 1024 h0
HORCM_INSTP
3dc_gad_grp3 localhost 13331 3
3dc_gad_grp2 localhost 13230 2
3dc_hur_grp localhost 13332 6
· Horcm -Target Secondary (horcm452.conf):
HORCM_MON
#ip_address service poll(10ms) timeout(10ms)
localhost 13331 3000 3000
HORCM_CMD
#dev_name dev_name dev_name
\\.\IPCMD-172.e.e.e-31001
HORCM_LDEV
3dc_gad_grp3 3dc_gad_grp3_pair0 855555 1024 2
3dc_delta_grp 3dc_delta_grp_pair0 855555 1024 h3
HORCM_INSTP
3dc_gad_grp3 localhost 13330 3
3dc_delta_grp localhost 13332 7
· Horcm -Target Remote (horcm1842.conf):
HORCM_MON
#ip_address service poll(10ms) timeout(10ms)
localhost 13332 3000 3000
HORCM_CMD
#dev_name dev_name dev_name
\\.\IPCMD-172.f.f.f-31001
HORCM_LDEV
3dc_delta_grp 3dc_delta_grp_pair0 466666 1024 h3
3dc_hur_grp 3dc_hur_grp_pair0 466666 1024 h0
HORCM_INSTP
3dc_delta_grp localhost 13332 7
3dc_hur_grp localhost 13330 6
3. Ensure one remote path is created in each direction between each storage system, as shown in Figure 1.
4. Assign a separate path group ID for each remote connection, as shown in Figure 2.
1.
● Remote paths between Source Primary and Secondary for Source GAD pairs:
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
611111 M8 1 - - RCU F 0 CL7-A CL7-A NML_01 -
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
622222 M8 1 - - RCU F 0 CL8-A CL8-A NML_01 -
● Remote paths between Source Primary and Target Primary for temporary GAD pairs:
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
611111 M8 2 - - RCU F 0 CL2-A CL2-A NML_01 -
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
844444 M8 2 - - RCU F 0 CL1-A CL1-A NML_01 -
● Remote paths between Target Primary and Target Secondary for target GAD pairs:
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
855555 M8 3 - - RCU F 0 CL7-A CL7-A NML_01 -
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
844444 M8 3 - - RCU F 0 CL6-A CL6-A NML_01 -
● Remote paths between Source Secondary and Remote for Source UR delta resync pairs:
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
433333 M8 4 - - RCU F 0 CL7-C CL7-F NML_01 -
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
622222 M8 4 - - RCU F 0 CL7-F CL7-C NML_01 -
● Remote paths between Source Primary and Remote for Source universal replication pairs:
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
433333 M8 5 - - RCU F 0 CL7-C CL8-F NML_01 -
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
611111 M8 5 - - RCU F 0 CL8-F CL7-C NML_01 -
● Remote paths between Target Primary and Remote for Target universal replication pairs:
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
466666 M8 6 - - RCU F 0 CL7-D CL7-B NML_01 -
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
844444 M8 6 - - RCU F 0 CL7-B CL7-D NML_01 -
● Remote paths between Target Secondary and Remote for Target UR delta resync pairs:
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
466666 M8 7 - - RCU F 0 CL7-D CL8-B NML_01 -
Serial# ID PID MCU RCU M/R T PNO MPORT RPORT STS_CD SSIDs ...
855555 M8 7 - - RCU F 0 CL8-B CL7-D NML_01 -
5. Use the VSP G600 storage system as an external storage system to provision quorum for source and target GAD pairs. For more details on how to set up a physical quorum device, see the GAD user guide.
In this scenario, quorum ID# 1 (volume-less) is created for the temporary GAD pair using the following commands:
#raidcom add quorum -quorum_id 1 -request_id auto -remote_storage 611111 M800 -I422
#raidcom add quorum -quorum_id 1 -request_id auto -remote_storage 844444 M800 -I672
Prepare Global-active device volumes
A Virtual Storage Machine (VSM) is created with the Source Primary storage system information on Source Secondary, Target Primary and Target Secondary storage systems.
The following steps are performed for each of the three storage systems:
1. Creating the resource group.
2. Adding ports to the resource group.
3. Virtualizing GAD target volumes and adding them to the resource group.
Source Secondary:
#raidcom add resource -resource_name VSM-611111 -virtual_type 611111 M900S -I692
#raidcom add resource -resource_name VSM-611111 -port CL5-A-1 -I692
#raidcom unmap resource -ldev_id 1024 -virtual_ldev_id 1024 -I692
#raidcom map resource -ldev_id 1024 -virtual_ldev_id reserve -I692
#raidcom add resource -resource_name 'VSM-611111' -ldev_id 1024 -I692
Target Primary:
#raidcom add resource -resource_name VSM-611111 -virtual_type 611111 M900S -I422
#raidcom add resource -resource_name VSM-611111 -port CL3-A-1 -I422
#raidcom unmap resource -ldev_id 1024 -virtual_ldev_id 1024 -I422
#raidcom map resource -ldev_id 1024 -virtual_ldev_id reserve -I422
#raidcom add resource -resource_name 'VSM-611111' -ldev_id 1024 -I422
Target Secondary:
#raidcom add resource -resource_name VSM-611111 -virtual_type 611111 M900S -I452
#raidcom add resource -resource_name VSM-611111 -port CL3-A-1 -I452
#raidcom unmap resource -ldev_id 1024 -virtual_ldev_id 1024 -I452
#raidcom map resource -ldev_id 1024 -virtual_ldev_id reserve -I452
#raidcom add resource -resource_name 'VSM-611111' -ldev_id 1024 -I452
Migration Methodology
The high-level workflow for migrating a 3DC pair from one storage system to another using GAD are as follows:
1. Create remote paths, quorums and prepare volumes for testing for the Target Primary, Secondary, and Remote storage systems, as shown in Figure 1.
2. Create the source, temporary, and target GAD pairs, UR delta resync pairs and UR pairs.
3. Suspend the source GAD pair by specifying the P-VOL and then enable the host to recognize the S-VOL of the temporary GAD pair used for data migration in the PAIR status.
4. Suspend the temporary GAD pair created for data migration by specifying the S-VOL and then enable the host to recognize the S-VOL of the target GAD pair in the PAIR status.
5. Delete the source UR delta resync, UR, source GAD pair and the temporary GAD pair created for data migration.
6. Optionally, remove the physical paths for the source storage systems, and then remove the storage systems.
To start the migration workflow, you must first create a 3DC environment by completing the following steps:
1. Create the source GAD pair between two VSP E590 storage systems by running the following command:
# paircreate -g 3dc_gad_grp1 -vl -fg never 0 -jq 0 -I672
# pairdisplay -g 3dc_gad_grp1 -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp1 3dc_gad_grp1_pair0(L) (CL5-A-1, 0, 0)611111 400.P-VOL PAIR NEVER , 100 400 - 0 0 1 - - - L/M AA S N D 3 - - - - - -
3dc_gad_grp1 3dc_gad_grp1_pair0(R) (CL5-A-1, 0, 0)622222 400.S-VOL PAIR NEVER , 100 400 - 0 0 1 - - - L/M AA D N D 3 - - - - - -
2. When the source GAD pair is in the PAIR state, create UR delta resync pairs between the source secondary VSP E590 and source remote VSP G600 storage systems.
# paircreate -g 3dc_delta_grp -fg async -vl -jp 0 -js 0 -nocsus -IH692
# pairdisplay -g 3dc_delta_grp -fxce -I692
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_delta_grp 3dc_delta_grp_pair0(L) (CL5-A-1, 0, 0)622222 400.P-VOL PSUE ASYNC , 0 400 - 1 0 1 - - - -/- - D N - 3 - - - - - -
3dc_delta_grp 3dc_delta_grp_pair0(R) (CL7-G-1, 0, 0)433333 400.S-VOL SSUS ASYNC , 0 400 - 1 0 1 - - - -/- - - - - 3 - - - - - -
3. Create UR pairs between the source primary VSP E590 and source remote VSP G600 storage systems.
# paircreate -g 3dc_hur_grp -vl -f async -jp 0 -js 0 -IH672
# pairdisplay -g 3dc_hur_grp -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_hur_grp 3dc_hur_grp_pair0(L) (CL5-A-1, 0, 0)611111 400.P-VOL PAIR ASYNC , 1 400 - 2 0 1 - - - -/- - S N - 3 - - - - - -
3dc_hur_grp 3dc_hur_grp_pair0(R) (CL7-G-1, 0, 0)433333 400.S-VOL PAIR ASYNC , 0 400 - 2 0 1 - - - -/- - - - - 3 - - - - - -
4. When the source UR pair is in the PAIR state, create a temporary GAD pair between the source primary E590 storage system and the target primary VSP One B28 storage system for data migration. The temporary GAD pair remains in the COPY state until the source GAD pair is split.
# paircreate -g 3dc_gad_grp2 -vl -fg never 1 -jq 1 -I672
# pairdisplay -g 3dc_gad_grp2 -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp2 3dc_gad_grp2_pair0(L) (CL5-A-1, 0, 0)611111 400.P-VOL COPY NEVER , 67 400 - 1 1 1 - - - L/M - S N D 3 - - - - - -
3dc_gad_grp2 3dc_gad_grp2_pair0(R) (CL3-A-1, 0, 0)844444 400.S-VOL COPY NEVER ,----- 400 - 1 1 1 - - - B/B - S N D 3 COPY 01 - 2 -
5. Create a target GAD pair between the target primary and the target secondary storage system. This pair remains in the COPY state until the temporary GAD pair is split.
# paircreate -g 3dc_gad_grp3 -vl -fg never 2 -jq -I422
# pairdisplay -g 3dc_gad_grp3 -fxce -I422
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp3 3dc_gad_grp3_pair0(L) (CL3-A-1, 0, 0)844444 400.P-VOL COPY NEVER , 96 400 - 2 2 1 - - - L/M AA S N D 3 COPY 01 - 3 - 2024-07-06T09:00:36
3dc_gad_grp3 3dc_gad_grp3_pair0(R) (CL3-A-1, 0, 0)855555 400.S-VOL COPY NEVER ,----- 400 - 2 2 1 - - - B/B AA S N D 3 COPY 01 - 3 - 2024-07-06T09:00:42
6. Create UR delta resync pairs between the target secondary VSP One B28 and the target remote VSP F900 storage systems.
# paircreate -g 3dc_delta_grp -fg async -vl -jp 0 -js 0 -nocsus -IH452
# pairdisplay -g 3dc_delta_grp -fxce -I452
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_delta_grp 3dc_delta_grp_pair0(L) (CL3-A-1, 0, 0)855555 400.P-VOL PSUE ASYNC , 0 400 - 0 0 1 - - - -/- - S N - 3 HLDI 06 N 7 - 2024-07-06T09:10:39
3dc_delta_grp 3dc_delta_grp_pair0(R) (CL3-A-2, 0, 0)466666 400.S-VOL SSUS ASYNC , 0 400 - 0 0 1 - - - -/- - S N - 3 - - - - - -
7. Create UR pairs between the target primary VSP One B28 and the target remote VSP F900 storage systems. The UR device pair remains in the COPY state until the target GAD pair is pair state.
# paircreate -g 3dc_hur_grp -vl -f async -jp 0 -js 0 -IH422
# pairdisplay -g 3dc_hur_grp -fxce -I422
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_hur_grp 3dc_hur_grp_pair0(L) (CL3-A-1, 0, 0)844444 400.P-VOL COPY ASYNC , 15 400 - 3 0 1 - - - -/- - S N - 3 COPY 01 N 6 - 2024-07-06T09:18:13
3dc_hur_grp 3dc_hur_grp_pair0(R) (CL3-A-2, 0, 0)466666 400.S-VOL COPY ASYNC ,----- 400 - 3 0 1 - - - -/- - S N - 3 - - - - - -
Migration Workflow
This section describes the workflow to migrate a 3DC setup from the source storage system to the target storage system.
When the 3DC environment is prepared, the copy state of the different pairs is as follows:
· Source GAD and UR pair is in PAIR state.
· Source UR delta resync is in PSUS state.
· Temporary and target GAD pairs are in COPY state.
· Target UR is in COPY state.
· Target UR delta resync is in PSUE state.
Host I/O is used by both source VSP E590 storage systems, as shown in Figure 3.

Figure 3: Status of global-active device, UR delta resync and UR pairs before migration
To migrate from source to target, complete the following steps:
1. Suspend the source GAD pair by specifying the P-VOL. This changes the source GAD pair to PSUS/SSUS, the temporary GAD pair to PAIR/PAIR, and the target GAD pair remains in COPY/COPY state.
# pairsplit -g 3dc_gad_grp1 -I672
# pairdisplay -g 3dc_gad_grp1 -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence,Seq#,P-LDEV# M
3dc_gad_grp1 3dc_gad_grp1_pair0(L) (CL5-A-1, 0, 0)611111 1024.P-VOL PSUS NEVER ,622222 1024 -
3dc_gad_grp1 3dc_gad_grp1_pair0(R) (CL5-A-1, 0, 0)622222 1024.S-VOL SSUS NEVER ,----- 1024 –
# pairdisplay -g 3dc_gad_grp2 -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp2 3dc_gad_grp2_pair0(L) (CL5-A-1, 0, 0)611111 400.P-VOL PAIR NEVER , 100 400 - 1 1 1 - - - L/M - S N D 3 - - - - - -
3dc_gad_grp2 3dc_gad_grp2_pair0(R) (CL3-A-1, 0, 0)844444 400.S-VOL PAIR NEVER , 100 400 - 1 1 1 - - - L/M - S N D 3 PAIR 02 - 2 - 2024-07-06T09:29:50
# pairdisplay -g 3dc_gad_grp3 -fxce -I422
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp3 3dc_gad_grp3_pair0(L) (CL3-A-1, 0, 0)844444 400.P-VOL COPY NEVER , 96 400 - 2 2 1 - - - L/M AA S N D 3 COPY 01 - 3 - 2024-07-06T09:00:36
3dc_gad_grp3 3dc_gad_grp3_pair0(R) (CL3-A-1, 0, 0)855555 400.S-VOL COPY NEVER ,----- 400 - 2 2 1 - - - B/B AA S N D 3 COPY 01 - 3 - 2024-07-06T09:00:42
2. When the temporary GAD pair is in PAIR state, re-scan host paths to recognize the S-VOL from the target primary storage system to allow the host to see I/O paths from both the source primary and target primary storage systems, as shown in the following figure:

3. Suspend the temporary GAD pair created for data migration by specifying the S-VOL. This changes the temporary GAD pair to PSUS/SSWS and the target GAD pair to PAIR/PAIR state.
# pairsplit -g 3dc_gad_grp2 -RS -I422
# pairdisplay -g 3dc_gad_grp1 -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp1 3dc_gad_grp1_pair0(L) (CL5-A-1, 0, 0)611111 400.P-VOL PSUS NEVER , 1 400 - 0 0 1 - - - L/L - S N D 3 - - - - - -
3dc_gad_grp1 3dc_gad_grp1_pair0(R) (CL5-A-1, 0, 0)622222 400.S-VOL SSUS NEVER , 100 400 - 0 0 1 - - - B/B - D N D 3 - - - - - -
# pairdisplay -g 3dc_gad_grp2 -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp2 3dc_gad_grp2_pair0(L) (CL5-A-1, 0, 0)611111 400.P-VOL PSUS NEVER , 100 400 - 1 1 1 - - - B/B - S N D 3 - - - - - -
3dc_gad_grp2 3dc_gad_grp2_pair0(R) (CL3-A-1, 0, 0)844444 400.S-VOL SSWS NEVER , 39 400 - 1 1 1 - - - L/L - S N D 3 SSWS 04 - 2 - 2024-07-06T09:54:52
# pairdisplay -g 3dc_gad_grp3 -fxce -I422
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp3 3dc_gad_grp3_pair0(L) (CL3-A-1, 0, 0)844444 400.P-VOL PAIR NEVER , 100 400 - 2 2 1 - - - L/M AA S N D 3 PAIR 02 - 3 3255 2024-07-06T09:54:52
3dc_gad_grp3 3dc_gad_grp3_pair0(R) (CL3-A-1, 0, 0)855555 400.S-VOL PAIR NEVER , 100 400 - 2 2 1 - - - L/M AA S N D 3 PAIR 02 - 3 - 2024-07-06T09:54:49
4. When the target GAD pair is in PAIR state, re-scan host paths to recognize the S-VOL from the target secondary storage system to allow the host to receive I/O from both the target primary and secondary storage systems, as shown in the following figure:

Wait for the status transition of UR delta resync pairs:
# pairdisplay -g 3dc_delta_grp -fxce -I452
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_delta_grp 3dc_delta_grp_pair0(L) (CL3-A-1, 0, 0)855555 400.P-VOL PSUS ASYNC , 1 400 - 0 0 1 - - - -/- - S N - 3 HOLD 03 N 7 - 2024-07-06T09:10:39
3dc_delta_grp 3dc_delta_grp_pair0(R) (CL3-A-2, 0, 0)466666 400.S-VOL SSUS ASYNC , 0 400 - 0 0 1 - - - -/- - S N - 3 - - - - - -
Wait for the status transition of UR pairs:
# pairdisplay -g 3dc_hur_grp -fxce -I422
[root@SISHA820G2-34 script]# pairdisplay -g 3dc_hur_grp -fxce -I422
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_hur_grp 3dc_hur_grp_pair0(L) (CL3-A-1, 0, 0)844444 400.P-VOL PAIR ASYNC , 1 400 - 3 0 1 - - - -/- - S N - 3 PAIR 02 N 6 2602 2024-07-06T10:01:35
3dc_hur_grp 3dc_hur_grp_pair0(R) (CL3-A-2, 0, 0)466666 400.S-VOL PAIR ASYNC , 1 400 - 3 0 1 -
5. After the 3DC setup is migrated to the target (primary, secondary, and remote) storage systems, delete the source UR delta resync, UR, GAD pair and the temporary GAD pair created for data migration. Optionally, you can remove the physical paths for the source storage systems and then remove the storage systems.
# pairsplit -g 3dc_delta_grp -S -I692
# pairsplit -g 3dc_hur_grp -S -I672
# pairsplit -g 3dc_gad_grp1 -S -I672
# pairsplit -g 3dc_gad_grp2 -R -I422
# pairdisplay -g 3dc_delta_grp -fxce -I692
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_delta_grp 3dc_delta_grp_pair0(L) (CL5-A-1, 0, 0)622222 400.SMPL ---- ------,----- ----- - - - - - - - -/- - - - - - - - - - - -
3dc_delta_grp 3dc_delta_grp_pair0(R) (CL7-G-1, 0, 0)433333 400.SMPL ---- ------,----- ----- - - - - - - - -/- - - - - - - - - - - -
# pairdisplay -g 3dc_hur_grp -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_hur_grp 3dc_hur_grp_pair0(L) (CL5-A-1, 0, 0)611111 400.SMPL ---- ------,----- ----- - - - - - - - -/- - - - - - - - - - - -
3dc_hur_grp 3dc_hur_grp_pair0(R) (CL7-G-1, 0, 0)433333 400.SMPL ---- ------,----- ----- - - - - - - - -/- - - - - - - - - - - -
# pairdisplay -g 3dc_gad_grp1 -fxce -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp1 3dc_gad_grp1_pair0(L) (CL5-A-1, 0, 0)611111 400.SMPL ---- ------,----- ----- - - - - - - - -/- - - - - - - - - - - -
3dc_gad_grp1 3dc_gad_grp1_pair0(R) (CL5-A-1, 0, 0)622222 400.SMPL ---- ------,----- ----- - - - - - - - -/- - - - - - - - - - - -
# pairdisplay -g 3dc_gad_grp2 -I672
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence,Seq#,P-LDEV# M
3dc_gad_grp2 3dc_gad_grp2_pair0(L) (CL5-A-1, 0, 0)611111 1024.SMPL ---- ------,----- ----- -
3dc_gad_grp2 3dc_gad_grp2_pair0(R) (CL3-A-1, 0, 0)844444 1024.SMPL ---- ------,----- ----- -
# pairdisplay -g 3dc_gad_grp3 -fxce -I422
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_gad_grp3 3dc_gad_grp3_pair0(L) (CL3-A-1, 0, 0)844444 400.P-VOL PAIR NEVER , 100 400 - 2 2 1 - - - L/M AA S N D 3 PAIR 02 - 3 3255 2024-07-06T09:54:52
3dc_gad_grp3 3dc_gad_grp3_pair0(R) (CL3-A-1, 0, 0)855555 400.S-VOL PAIR NEVER , 100 400 - 2 2 1 - - - L/M AA S N D 3 PAIR 02 - 3 - 2024-
07-06T09:54:49
# pairdisplay -g 3dc_delta_grp -fxce -I452
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_delta_grp 3dc_delta_grp_pair0(L) (CL3-A-1, 0, 0)855555 400.P-VOL PSUS ASYNC , 1 400 - 0 0 1 - - - -/- - S N - 3 HOLD 03 N 7 - 2024-07-06T09:10:39
3dc_delta_grp 3dc_delta_grp_pair0(R) (CL3-A-2, 0, 0)466666 400.S-VOL SSUS ASYNC , 0 400 - 0 0 1 - - - -/- - S N - 3 - - - - - -
# pairdisplay -g 3dc_hur_grp -fxce -I422
Group PairVol(L/R) (Port#,TID, LU),Seq#,LDEV#.P/S,Status,Fence, %,P-LDEV# M CTG JID AP EM E-Seq# E-LDEV# R/W QM DM P PR CS D_Status ST ELV PGID CT(s) LUT
3dc_hur_grp 3dc_hur_grp_pair0(L) (CL3-A-1, 0, 0)844444 400.P-VOL PAIR ASYNC , 1 400 - 3 0 1 - - - -/- - S N - 3 PAIR 02 N 6 2602 2024-07-06T10:01:35
3dc_hur_grp 3dc_hur_grp_pair0(R) (CL3-A-2, 0, 0)466666 400.S-VOL PAIR ASYNC , 1 400 - 3 0 1 - - - -/- - S N - 3 - - - - - -
The migration workflow is complete and the source storage systems are disconnected.
