Thursday, November 22, 2007

HDLM installation on VIO server

Procedure: Install/Update HDLM drivers

# login to vio server as "padmin".
# Switch to "oem" prompt.
oem_setup_env
umount /mnt
mount bosapnim01:/export/lpp_source/hitachi /mnt

# Install and update all filesets from the directories below.
# "smitty install_all"
cd /mnt/hdlm_5601/aix_odm/V5.0.0.1
cd /mnt/hdlm_5601/aix_odm/V5.0.0.4u
cd /mnt/hdlm_5601/aix_odm/V5.0.1.4U
cd /mnt/hdlm_5601/aix_odm/V5.0.52.1U

# Copy license file.
cd /mnt/hdlm_5601/license/enterprise
cp *.plk /var/tmp/hdlm_license

# install and update all filesets from the above directory
# "smitty install_all"
# Fileset DLManager 5.60.1.100 Hitachi Dynamic Link Manager
cd /mnt/hdlm_5601

# Leave the current Directory and unmount Driver Source Directory.
cd /
umount /mnt


Procedure: Install/Update VIO fixpack

# Login to VIO server as "padmin"
# Obtain current IOS level
ioslevel

# Update VIO to latest IOS level
mount bosapnim01:/export/lpp_source/aix/vio_1200 /mnt
updateios -dev /mnt
** Enter "y" to continue install

# Return to "root" shell prompt and HALT system.
oem_setup_env
shutdown -Fh

# Activate LPAR from HMC WebSM


Procedure: Configure VIO Server to utilize Boot Disks
# Login as "padmin"
# Switch to "oem" prompt
oem_setup_env

# Run in korn shell 93
ksh93

# Remove any vhost adapter configuration settings
for (( i=0; i<=48; ++i ))
do
/usr/ios/cli/ioscli rmdev -pdev vhost${i}
done

# Remove all HDLM disks
for i in $( lsdev -Cc disk -F name | grep dlmfdrv )
do
rmdev -Rdl ${i}
done

# Remove all hdisks except for hdisk0 and hdisk1 - assumed to be rootvg
for i in $( lsdev -Cc disk -F name | grep hdisk | egrep -v 'hdisk0$ | hdisk1$' )
do
rmdev -Rdl ${i}
done

# If an HDLM unconfig file exists, rename it
[[ -f /usr/DynamicLinkManager/drv/dlmfdrv.unconf ]] &&
mv /usr/DynamicLinkManager/drv/dlmfdrv.unconf \
/usr/DynamicLinkManager/drv/$( date +"%Y%m%d").dlmfdrv.unconf

# Verify "dlmfdrv.unconf" was renamed.
ls /usr/DynamicLinkManager/drv

# Set fast fail Parameter for SCSI Adapters and Reconfigure FC Adapters
chdev -l fscsi0 -a fc_err_recov=fast_fail
chdev -l fscsi1 -a fc_err_recov=fast_fail
chdev -l fscsi2 -a fc_err_recov=fast_fail
cfgmgr -vl fcs0
cfgmgr -vl fcs1
cfgmgr -vl fcs2

# Change HDLM settings
cd /usr/DynamicLinkManager/bin
print y | ./dlmodmset -e on
print y | ./dlmodmset -b 68608

# Reconfigure HDLM disks
./dlmcfgmgr

# Turn off reserve settings on HDLM Driver
./dlnkmgr set -rsv on 0 -s

# Remove HDLM disks
for i in $( lsdev -Cc disk -F name | grep dlmfdrv )
do
rmdev -Rdl ${i}
done

# Change reserve policy on hdisks to "no_reserve"
for i in $( lsdev -Cc disk -F name |
grep hdisk |
egrep -v 'hdisk0$|hdisk1$' )
do
chdev -l ${i} -a reserve_policy=no_reserve
done

# Reconfigure HDLM disks
./dlmcfgmgr

# Verify all HDLM disks have an assigned PVID
for i in $( lsdev -Cc disk -F name | grep dlmfdrv )
do
chdev -l ${i} -a pv=yes
done
lspv

# Remove any vhost adapter configuration settings
/usr/ios/cli/ioscli lsmap -all

# Verify all vhosts adapters exist wihout Devices.
SVSA Physloc Client Partition ID
--------------- -------------------------------------------- ------------------
vhost0 U9119.590.51A432C-V3-C10 0x00000000

VTD NO VIRTUAL TARGET DEVICE FOUND

# Reboot VIO Server.
shutdown -Fr


# End of Final Procedure




# Do not perform this step as part of this procedure
for (( i=0; i<=48; ++i ))
do
/usr/ios/cli/ioscli rmdev -pdev vhost${i}
done
-----------------------------------------------------------

VIO HDLM Boot Disks

--------------------------------------------------------------------------------
VIO HDLM Boot Disks in HDLM ENVIRONMENT

Power 5: VIO configuration to support HDLM boot disks

This document describes the procedure to configure the HDLM driver and SAN disks on multiple VIO servers for the purpose of serving virtual "rootvg" boot disks to client LPARs. This procedure requires multiple parameter settings that must be performed in a specific sequence in order for the values to take effect.

NOTE: This procedure assumes an entire HDLM disk is used as the backend device, not a logical volume on an HDLM disk.

--------------------------------------------------------------------------------

Login to the VIO server as "padmin" and change to the "root" prompt. From the VIO "root" prompt, switch to korn shell 93:

oem_setup_env
--------------------------------------------------------------------------------

Install the following HDLM software on each VIO Server:

DLManager.rte 5.60.1.100
Hitachi.aix.support.rte 5.0.52.1

If the Hitachi MPIO driver is installed, remove it.

--------------------------------------------------------------------------------

Remove any vhost adapter configuration setttings:

for (( i=0; i<=48; ++i ))
do
/usr/ios/cli/ioscli rmdev -pdev vhost${i}
done

--------------------------------------------------------------------------------

Remove all HDLM disks:

for i in $( lsdev -Cc disk -F name | grep dlmfdrv )
do
rmdev -Rdl ${i}
done

--------------------------------------------------------------------------------

Remove all hdisks except for hdisk0 and hdisk1 - assumed to be rootvg:

for i in $( lsdev -Cc disk -F name | grep hdisk | egrep -v 'hdisk0$|hdisk1$' )
do
rmdev -Rdl ${i}
done

--------------------------------------------------------------------------------

If an HDLM unconfig file exists, rename it :

[[ -f /usr/DynamicLinkManager/drv/dlmfdrv.unconf ]] &&
mv /usr/DynamicLinkManager/drv/dlmfdrv.unconf /usr/DynamicLinkManager/drv/$( date +"%Y%m%d").dlmfdrv.unconf
ls /usr/DynamicLinkManager/drv

--------------------------------------------------------------------------------

Set fast fail parameter for SCSI adapters and reconfigure FC adapters:

chdev -l fscsi0 -a fc_err_recov=fast_fail
chdev -l fscsi1 -a fc_err_recov=fast_fail
cfgmgr -vl fcs0
cfgmgr -vl fcs1

--------------------------------------------------------------------------------

Change HDLM settings:

cd /usr/DynamicLinkManager/bin
print y | ./dlmodmset -e on
print y | ./dlmodmset -b 68608

--------------------------------------------------------------------------------
Rediscover HDLM disks:

./dlmcfgmgr

--------------------------------------------------------------------------------
Turn off reserve settings:

./dlnkmgr set -rsv on 0 -s

--------------------------------------------------------------------------------
Remove HDLM disks:

for i in $( lsdev -Cc disk -F name | grep dlmfdrv )
do
rmdev -Rdl ${i}
done

--------------------------------------------------------------------------------
Change reserve policy on hdisks to "no_reserve":

for i in $( lsdev -Cc disk -F name | grep hdisk | egrep -v 'hdisk0$|hdisk1$' )
do
chdev -l ${i} -a reserve_policy=no_reserve
done

--------------------------------------------------------------------------------
Rediscover HDLM disks:

./dlmcfgmgr

--------------------------------------------------------------------------------
Make sure all HDLM disks have a PVID:

for i in $( lsdev -Cc disk -F name | grep dlmfdrv )
do
chdev -l ${i} -a pv=yes
done

--------------------------------------------------------------------------------
Configure bootable vhost adapters, the following command are only an example. The actual commands will be dependent upon the SAN disks allocated to the the VIO server, and the LPAR's being configured:

/usr/ios/cli/ioscli rmdev -pdev vhost0
/usr/ios/cli/ioscli rmdev -pdev vhost1
/usr/ios/cli/ioscli rmdev -pdev vhost2
/usr/ios/cli/ioscli rmdev -pdev vhost3
/usr/ios/cli/ioscli rmdev -pdev vhost4
/usr/ios/cli/ioscli rmdev -pdev vhost5
/usr/ios/cli/ioscli rmdev -pdev vhost6
/usr/ios/cli/ioscli rmdev -pdev vhost7
/usr/ios/cli/ioscli rmdev -pdev vhost8
/usr/ios/cli/ioscli rmdev -pdev vhost9
/usr/ios/cli/ioscli rmdev -pdev vhost10
/usr/ios/cli/ioscli rmdev -pdev vhost11

/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv0 -vadapter vhost0 -dev vdlmfdrv0
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv1 -vadapter vhost1 -dev vdlmfdrv1
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv2 -vadapter vhost2 -dev vdlmfdrv2
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv3 -vadapter vhost3 -dev vdlmfdrv3
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv4 -vadapter vhost4 -dev vdlmfdrv4
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv5 -vadapter vhost5 -dev vdlmfdrv5
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv6 -vadapter vhost6 -dev vdlmfdrv6
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv7 -vadapter vhost7 -dev vdlmfdrv7
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv8 -vadapter vhost8 -dev vdlmfdrv8
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv9 -vadapter vhost9 -dev vdlmfdrv9
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv10 -vadapter vhost10 -dev vdlmfdrv10
/usr/ios/cli/ioscli mkvdev -vdev dlmfdrv11 -vadapter vhost11 -dev vdlmfdrv11

/usr/ios/cli/ioscli lsmap -vadapter vhost0
/usr/ios/cli/ioscli lsmap -vadapter vhost1
/usr/ios/cli/ioscli lsmap -vadapter vhost2
/usr/ios/cli/ioscli lsmap -vadapter vhost3
/usr/ios/cli/ioscli lsmap -vadapter vhost4
/usr/ios/cli/ioscli lsmap -vadapter vhost5
/usr/ios/cli/ioscli lsmap -vadapter vhost6
/usr/ios/cli/ioscli lsmap -vadapter vhost7
/usr/ios/cli/ioscli lsmap -vadapter vhost8
/usr/ios/cli/ioscli lsmap -vadapter vhost9
/usr/ios/cli/ioscli lsmap -vadapter vhost10
/usr/ios/cli/ioscli lsmap -vadapter vhost11

--------------------------------------------------------------------------------

On each LPAR enable the hcheck_interval parameter to perform automated health checks for all disks on all LPAR's:

for i in $( lsdev -Cc disk -F name )
do
chdev -l ${i} -a hcheck_interval=20 -P
done
shutdown -Fr

1 comment:

Unknown said...

Hi,

Your response would be much appreciated.

I have a problem where i perform mksysb from LPAR1 and restore it on LPAR2. Then, i perform install HDLM on LPAR2 but get this error:

0503-464 installp: The installation has FAILED for the "usr" part
of the following filesets:
DLManager.mpio.rte 6.6.0.0

installp: Cleaning up software for:
DLManager.mpio.rte 6.6.0.0

Finished processing all filesets. (Total time: 11 secs).


I follow exactly your steps.
I get no error if i start with fresh OS but will definitely get this error if I perform restore from mksysb.

Thank you.