The batch system is refusing new job submissions. Investigating.
The batch system should be back only but the submission process might still be slow for a while due to the generated backlog.
Sunday 30th June 2019
No incidents reported
Saturday 29th June 2019
No incidents reported
Friday 28th June 2019
Mass storage /pnfs issue
We are facing an 'Xrootd storm". This is due to a lot of remote transfers initiated probably by "ignore locality jobs". We had to restart the mass storage services. Some of your jobs might have crashed.
Wednesday 26th June 2019
Batch SystemBatch system did not accept jobs anymore
It seems the batch system did not accept jobs anymore. The service was rebooted and is now working properly again.
User Interfaces - mX machines/cvmfs is not working properly on m9
/cvmfs seems to be outdated on m9, compared to other machines.
m9 needed a complete re-install to fix the problem. /cvmfs should be up-to-date and same as other machines now.
To fix the issue with /cvmfs on m9, we need to empty the cache and reboot the machine. This will be done at 11PM today, Thursday 27/06, so please save your work and exit m9.