For the last few days, /pnfs is having performance issues, while some storage nodes can't serve files.
We have not identified the cause yet.
Mainly cd/ls becomes slow, and only a restart of the service makes it work fast again.
Also, a couple of storage nodes have a hard time serving files (hence why some of your files have issues), this usually solves itself after a while.
Cheers,
The T2B IT Team
Past Incidents
Tuesday 31st October 2023
No incidents reported
Monday 30th October 2023
No incidents reported
Sunday 29th October 2023
No incidents reported
Saturday 28th October 2023
No incidents reported
Friday 27th October 2023
No incidents reported
Thursday 26th October 2023
No incidents reported
Wednesday 25th October 2023
Mass Storage (/pnfs)Ongoing slowness on /pnfs
Dear users,
As you have probably noticed, /pnfs is working very slowly these last days/weeks.
The slowness is connected to the nfs file system that is used within the dCache software (dCache is the software we use to build our mass storage system. We have used it for almost 20 years).
We are actively working together with the developers of dCache to solve this problem. However, none of the many avenues we have explored has yielded any success.
We will keep you informed whenever we have a stable solution.
Kind regards,
Olivier
For the T2B admin team.
We have modified the parameters affecting this issue, and for almost a week, access to /pnfs has been stable.