fix ssh failures to login node VM
SSH to login node VM is failing via ssh proxy. A user is only supposed to access the login node via the proxy, but since we observed this issue in the staging environment, we could log in directly to the node as root and inspect the sshd logs. We found some errors related to pam_slurm shown below,
Dec 23 10:06:45 login-gpfs4-01.openstack.internal sshd[25122]: pam_access(sshd:account): access denied for user `louistw' from `164.111.161.62'
Dec 23 10:06:45 login-gpfs4-01.openstack.internal sshd[25122]: fatal: Access denied for user louistw by PAM account configuration [preauth]
Dec 23 10:07:02 login-gpfs4-01.openstack.internal sshd[25506]: Accepted publickey for root from 164.111.161.62 port 36717 ssh2: RSA SHA256:0+g34EjgV
Dec 23 10:11:25 login-gpfs4-01.openstack.internal sshd[30593]: pam_access(sshd:account): access denied for user `louistw' from `164.111.161.62'
Dec 23 10:11:25 login-gpfs4-01.openstack.internal sshd[30593]: fatal: Access denied for user louistw by PAM account configuration [preauth]
These errors occur due to pam_slurm denying ssh into the login node. So we need to remove the role that configures pam_slurm on the login node in login.yml playbook.