The mass storage crashed, it needs a software restart.
After reboot, the mass storage went back online. All worker nodes and user interfaces recovered /pnfs.