Problem

At cluster package stop, a file system is not unmounting correctly because the underlying NFS share is not being unshared first correcty:

HANFS -- Sep 20 16:18:53 - Node "serv1": Killing rpc.statd
HANFS -- Sep 20 16:18:53 - Node "serv1": Killing rpc.lockd
HANFS -- Sep 20 16:18:53 - Node "serv1": Killing nfsd
HANFS -- Sep 20 16:18:53 - Node "serv1": Restarting rpc.statd
HANFS -- Sep 20 16:18:54 - Node "serv1": Restarting rpc.lockd
HANFS -- Sep 20 16:18:55 - Node "serv1": Restarting nfsd
HANFS EXPORT-- Sep 20 16:18:55
Usage: unshare { pathname | resource }
        ERROR:  Function nfs_un_export_fs
        ERROR:  Failed to unexport root=serv1:serv1.acme.com:dbORA      /export/sapmnt/ORA
HANFS EXPORT -- Sep 20 16:18:55 - Node "serv1": Unexporting filesystem on   /export/usr/sap/trans_ORA
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: Number of components: 4 5 5 5 5 5 5 5 5 5 6
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: sorted indexes: 0 1 2 3 4 5 6 7 8 9 10
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 10 /export/usr/sap/trans_ORA 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 9 /export/sapmnt/ORA 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 8 /oracle/ORA/sapdata1 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 7 /oracle/ORA/oraarch 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 6 /oracle/ORA/mirrlogB 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 5 /oracle/ORA/mirrlogA 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 4 /oracle/ORA/origlogB 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 3 /oracle/ORA/origlogA 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 2 /oracle/ORA/sapreorg 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 1 /oracle/ORA/11204 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: processing 0 /oracle/ORA 1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: max mnt order: 2
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvsapdata1
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvoraarch
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvmirrlogB
Sep 20 16:18:55 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvmirrlogA
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvoriglogB
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvoriglogA
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvsapreorg
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lv11204
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvusrsaptrans
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvsapmnt
umount: cannot unmount /dev/vgdbORA/lvsapmnt : Device busy
umount: return error 1.
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]:
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: WARNING: Running fuser to remove anyone using the file system directly.
/dev/vgdbORA/lvsapmnt:
umount: cannot unmount /dev/vgdbORA/lvsapmnt : Device busy
umount: return error 1.
Sep 20 16:18:56 root@serv1 filesystem.sh[11580]: ERROR: Unmount /dev/vgdbORA/lvsapmnt failed, trying again.
/dev/vgdbORA/lvsapmnt:
umount: cannot unmount /dev/vgdbORA/lvsapmnt : Device busy
umount: return error 1.
Sep 20 16:18:57 root@serv1 filesystem.sh[11580]: ERROR: Unmount /dev/vgdbORA/lvsapmnt failed, trying again.
/dev/vgdbORA/lvsapmnt:
umount: cannot unmount /dev/vgdbORA/lvsapmnt : Device busy
umount: return error 1.
Sep 20 16:18:58 root@serv1 filesystem.sh[11580]: Unmounting filesystem /dev/vgdbORA/lvsapmnt using the -o force option
Sep 20 16:18:59 root@serv1 filesystem.sh[11580]: Unmounting filesystem on /dev/vgdbORA/lvoraclehome
Sep 20 16:18:59 root@serv1 volume_group.sh[11704]: Deactivating volume group /dev/vgdbORA
Volume Group configuration for /dev/vgdbORA has been saved.
Deactivated volume group in Exclusive Mode.
Volume group "/dev/vgdbORA" has been successfully changed.

Solution

After removing the TABS and putting spaces I was able to unshare the filesystem without any issue during package halt.

So the config should not be:

# ************ HANFS TOOLKIT PARAMETERS ************
#
#   NFS EXPORTS
#
#   Specifies all exported NFS directories with share options. The directories
#   must be defined in the mounted file system FS list specified in the control
#   script. These variables are used by the command "share" to share the
#   file systems and the command "unshare" to unshare the file systems.
#   The configuration value for XFS should be with in double quotes.
#   Example: XFS        "-o ro /pkg1"
#   Example: XFS        "/pkg2"
#
# Legal values for nfs/hanfs_export/XFS: /^\"[^"]+[^\]\"$/.

nfs/hanfs_export/XFS            "-o root=serv1:serv1.acme.com:dbORA <TABS> /export/sapmnt/ORA"
nfs/hanfs_export/XFS            "-o root=serv1:serv1.acme.com:dbORA <TABS> /export/usr/sap/trans_ORA"

But rather:

# ********** HANFS TOOLKIT PARAMETERS **********
#
#   NFS EXPORTS
#
#   Specifies all exported NFS directories with share options. The directories
#   must be defined in the mounted file system FS list specified in the control
#   script. These variables are used by the command "share" to share the
#   file systems and the command "unshare" to unshare the file systems.
#   The configuration value for XFS should be with in double quotes.
#   Example: XFS        "-o ro /pkg1"
#   Example: XFS        "/pkg2"
#
# Legal values for nfs/hanfs_export/XFS: /^\"[^"]+[^\]\"$/.

nfs/hanfs_export/XFS            "-o root=serv1:serv1.acme.com:dbORA <SPACES> /export/sapmnt/ORA"
nfs/hanfs_export/XFS            "-o root=serv1:serv1.acme.com:dbORA <SPACES> /export/usr/sap/trans_ORA"

See: http://h20564.www2.hpe.com/hpsc/doc/public/display?docId=emr_na-c02653531&sp4ts.oid=4162088

Comments