AnsweredAssumed Answered

Delete lun from HDLM and Solaris 11:

Question asked by Javier Arjona on Nov 21, 2014

We are replacing an AMS1000 with a HUS130. So we are in the process to migrate all AMS luns to HUS130. As soon as a lun is available for the applications on the HUS, we delete the old AMS lun. The problem is that all luns that we delete from AMS are show as "failing" status when we use cfgadm command. We have read that a reboot solve the problem, but the server from which we unmap the AMS luns, is a server with two LDOMs, many zones, and with many Oracle RDBMS. A reboot is not an option for us. 

 

We create a sandbox lun to show you the procedure we use to delete luns.


        This is the procedure to create a new lun:

1.  We create a lun on a VSP (a different storage)

2.  We map the VSP lun to the server as lun 99

3.  On the server:

    # cfgadm -al -o show_FCP_dev   (Only the new lun is shown)

    c7::50060e8006d31821,99        disk         connected    configured   unknown

    c9::50060e8006d31831,99        disk         connected    configured   unknown

4.  # find /dev | grep d99

    /dev/dsk/c7t50060E8006D31821d99s0

    /dev/dsk/c7t50060E8006D31821d99s1

    /dev/dsk/c7t50060E8006D31821d99s2

    /dev/dsk/c7t50060E8006D31821d99s3

    /dev/dsk/c7t50060E8006D31821d99s4

    /dev/dsk/c7t50060E8006D31821d99s5

    /dev/dsk/c7t50060E8006D31821d99s6

    /dev/dsk/c7t50060E8006D31821d99s7

    /dev/dsk/c9t50060E8006D31831d99s0

    /dev/dsk/c9t50060E8006D31831d99s1

    /dev/dsk/c9t50060E8006D31831d99s2

    /dev/dsk/c9t50060E8006D31831d99s3

    /dev/dsk/c9t50060E8006D31831d99s4

    /dev/dsk/c9t50060E8006D31831d99s5

    /dev/dsk/c9t50060E8006D31831d99s6

    /dev/dsk/c9t50060E8006D31831d99s7

    /dev/rdsk/c7t50060E8006D31821d99s0

    /dev/rdsk/c7t50060E8006D31821d99s1

    /dev/rdsk/c7t50060E8006D31821d99s2

    /dev/rdsk/c7t50060E8006D31821d99s3

    /dev/rdsk/c7t50060E8006D31821d99s4

    /dev/rdsk/c7t50060E8006D31821d99s5

    /dev/rdsk/c7t50060E8006D31821d99s6

    /dev/rdsk/c7t50060E8006D31821d99s7

    /dev/rdsk/c9t50060E8006D31831d99s0

    /dev/rdsk/c9t50060E8006D31831d99s1

    /dev/rdsk/c9t50060E8006D31831d99s2

    /dev/rdsk/c9t50060E8006D31831d99s3

    /dev/rdsk/c9t50060E8006D31831d99s4

    /dev/rdsk/c9t50060E8006D31831d99s5

    /dev/rdsk/c9t50060E8006D31831d99s6

    /dev/rdsk/c9t50060E8006D31831d99s7

5.  # dlmsetconf

6.  # dlmcfgmgr -a

    KAPL10378-I The LU (LDEV = VSP.0054040.00FD02) was successfully added.

7.  # dlnkmgr view -lu

    Product       : VSP

    SerialNumber  : 0054040       

    LUs           : 4

    iLU    HDevName                Device PathID Status   

    000460 c13t50060E8006D31821d0  ssd214 000085 Online   

                                   ssd215 000201 Online   

    001009 c13t50060E8006D31821d1  ssd315 000276 Online   

                                   ssd317 000277 Online   

    00100A c13t50060E8006D31821d2  ssd314 000278 Online   

                                   ssd316 000279 Online   

    00FD02 c13t50060E8006D31821d99 ssd328 000000 Online   

                                   ssd329 000002 Online   

8.  # find /dev | grep d99

    /dev/dsk/c13t50060E8006D31821d99s0

    /dev/dsk/c13t50060E8006D31821d99s1

    /dev/dsk/c13t50060E8006D31821d99s2

    /dev/dsk/c13t50060E8006D31821d99s3

    /dev/dsk/c13t50060E8006D31821d99s4

    /dev/dsk/c13t50060E8006D31821d99s5

    /dev/dsk/c13t50060E8006D31821d99s6

    /dev/dsk/c13t50060E8006D31821d99s7

    /dev/rdsk/c13t50060E8006D31821d99s0

    /dev/rdsk/c13t50060E8006D31821d99s1

    /dev/rdsk/c13t50060E8006D31821d99s2

    /dev/rdsk/c13t50060E8006D31821d99s3

    /dev/rdsk/c13t50060E8006D31821d99s4

    /dev/rdsk/c13t50060E8006D31821d99s5

    /dev/rdsk/c13t50060E8006D31821d99s6

    /dev/rdsk/c13t50060E8006D31821d99s7

 

        Now this is the procedure to delete the lun:

1.  Modify dlmfdrv.unconf to uncoment lun 99

    ################## T2955008 D99(VSP.0054040.00FD02) ##################

    ### Device=ssd328 target=2955008 lun=99

    ### Path=/pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8006d31821,63

    ### Device=ssd329 target=3020544 lun=99

    ### Path=/pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8006d31831,63

    LDEV=VSP.0054040.00FD02;

2.  Clean /dev directory

    # rm /dev/dsk/c13*d99s*

    # rm /dev/rdsk/c13*d99s*

    # find /dev | grep d99

3.  Unmap lun 99

4.  dlmsetconf

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8006d31821,63

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8006d31831,63

5.  dlmcfgmgr -a

    KAPL10951-I The LU (LDEV = VSP.0054040.00FD02) was successfully deleted.

6.  # dlnkmgr view -lu

    Product       : VSP

    SerialNumber  : 0054040        

    LUs           : 3

    iLU    HDevName               Device PathID Status    

    000460 c13t50060E8006D31821d0 ssd214 000085 Online    

                                  ssd215 000201 Online    

    001009 c13t50060E8006D31821d1 ssd315 000276 Online    

                                  ssd317 000277 Online    

    00100A c13t50060E8006D31821d2 ssd314 000278 Online    

                                  ssd316 000279 Online    

7.  # cfgadm -al -o show_FCP_dev   (Only the deleted lun is shown)

    c7::50060e8006d31821,99        disk         connected    configured   failing

    c9::50060e8006d31831,99        disk         connected    configured   failing

 

From here we don't know how to clean this status. Also each time that we use dlmsetconf it

shows KAPL10258-W error for all luns with failing status

    # dlmsetconf

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,10

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,f

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,e

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,d

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,c

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,b

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,a

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,3

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error), 

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,2

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,1

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8010029644,1c

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8010029644,1a

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8010029641,1c

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8010029641,1a

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,10

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,f

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,e

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,d

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,c

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,b

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,a

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,6

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,5

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,4

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,3

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,2

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,1

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,17

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,16

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,15

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,17

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,16

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,15

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8006fed623,38

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8006fed633,38

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,1a

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,19

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f4,18

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,1a

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,19

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e80100276f1,18

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8006d31821,63  (lun 99)

    KAPL10258-W The ioctl(0x4c9) operation has failed. Errno = 5 (I/O error),

                Device = /pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8006d31831,63  (lun 99)

 

 

The dlmcfgmgr utility also show others errors that we don't know what they are:
    KAPL10388-E The path (/pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8006fed623,20)

    could not be added. (Function: devctl_bus_dev_create, ErrorCode = 6 (No such device or address)).
    Execute the DLMgetras utility to collect error information, and then contact your vendor or

    maintenance company.
    KAPL10388-E The path (/pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8006fed633,20)

    could not be added. (Function: devctl_bus_dev_create, ErrorCode = 6 (No such device or address)).
    Execute the DLMgetras utility to collect error information, and then contact your vendor or

    maintenance company.
    KAPL10388-E The path (/pci@380/pci@1/pci@0/pci@5/SUNW,qlc@0/fp@0,0/ssd@w50060e8006fed623,1b)

    could not be added. (Function: devctl_bus_dev_create, ErrorCode = 6 (No such device or address)).
    Execute the DLMgetras utility to collect error information, and then contact your vendor or

    maintenance company.
    KAPL10388-E The path (/pci@380/pci@1/pci@0/pci@6/SUNW,qlc@0/fp@0,0/ssd@w50060e8006fed633,1b)

    could not be added. (Function: devctl_bus_dev_create, ErrorCode = 6 (No such device or address)).
    Execute the DLMgetras utility to collect error information, and then contact your vendor or

    maintenance company.

 

The error list from dlmsetconf should increase as soon as we delete more luns. We have saw two things:
   1. dlmsetconf and dlmcfgmgr change the lun controller of the lun from C7 and C9 to C13 when we
       added a new lun to HDLM
   2. dlmsetconf and dlmcfgmgr does not recreate C7 and C9 paths when we deleted the lun and
       maybe this is the reason of "failing" status.

 

Regards, Javier.

Outcomes