network severance - for testing internal dependencies and resilience, computing center network connections are cut for ~15m. External clients with smaller timeouts might be affected
ROC_Canada
CA-WATERLOO-T2
TIERNA
2024-12-08 17:00
2025-01-08 04:00
OUTAGE
SCHEDULED
Major cooling infrastructure work in datacentre so all compute nodes offline for 4 weeks
AsiaPacific
INDIACMS-TIFR
TIER2
2024-11-30 18:26
2025-01-31 23:55
OUTAGE
SCHEDULED
Extension of downtime 36117 - Resolving breaches at site and applying more security measures
NGI_FRANCE
IN2P3-LAPP
TIER2
2025-01-14 06:00
2025-01-15 18:43
OUTAGE
SCHEDULED
Operation on electric equipments @LAPP
ROC_Canada
CA-WATERLOO-T2
TIERNA
2024-12-09 14:35
2025-01-09 04:59
OUTAGE
UNSCHEDULED
Cooling capacity currently insufficient to maintain storage. Declaring outage.
ROC_Canada
CA-SFU-T2
TIERNA
2025-01-13 15:00
2025-01-15 06:50
OUTAGE
SCHEDULED
1-2 day outage for power equipment upgrade before new cluster installation. Storage elements will stay up
AsiaPacific
JP-KEK-CRC-02
TIERNA
2025-01-10 06:00
2025-01-13 05:00
OUTAGE
SCHEDULED
Scheduled power outage for the substation equipment renewal work as expected on January 11 and February 8, 2025 (only in Tsukuba, not in Tokai, J-PARC): We will take software maintenance across the system (KEKCC) before and after the power outage. The system will be back online on Monday, January 13 (Note: it is a Japanese national holiday)
AsiaPacific
JP-KEK-CRC-02
TIERNA
2025-02-08 01:00
2025-02-08 12:00
OUTAGE
SCHEDULED
Scheduled power outage for the substation equipment renewal work as expected on January 11 and February 8, 2025 (only in Tsukuba, not in Tokai, J-PARC)
AsiaPacific
JP-KEK-CRC-02
TIERNA
2025-01-13 05:00
2025-01-13 06:00
WARNING
SCHEDULED
Decommissioning GridFTP protocol running on data transfer nodes, some tiny works may run background earlier than the downtime start time
NGI_NDGF
T2_Estonia
TIER2
2025-01-20 00:00
2025-03-31 00:00
OUTAGE
SCHEDULED
Full server room renovation
NGI_UK
UKI-NORTHGRID-SHEF-HEP
TIER2
2025-01-07 12:00
2025-01-08 10:05
OUTAGE
SCHEDULED
Building Power being turned off.
NGI_CH
UNIBE-LHEP
TIERNA
2024-12-18 20:00
2025-06-30 20:00
OUTAGE
SCHEDULED
CEs undergoing upgrades
ROC_LA
CBPF
TIERNA
2024-12-26 03:00
2025-01-10 23:00
OUTAGE
SCHEDULED
electrical maintenance
ROC_Canada
CA-SFU-T2
TIERNA
2025-01-15 05:00
2025-01-18 06:00
OUTAGE
SCHEDULED
outage for power equipment upgrade before new cluster installation. Storage elements will stay up
NGI_BG
BG05-SUGrid
TIERNA
2024-12-23 07:00
2025-02-23 07:00
OUTAGE
SCHEDULED
Updating the operating system and services of the site
ROC_LA
EELA-UTFSM
TIERNA
2024-12-23 18:00
2025-01-07 18:00
OUTAGE
SCHEDULED
WebDAV error,(All pools are full)
NGI_GRNET
GRNET-ARIS
TIERNA
2025-01-01 00:00
2025-01-31 23:59
OUTAGE
SCHEDULED
ARIS is down due to a very serious water leak in the data center
NGI_RO
GRIDIFIN
TIERNA
2024-12-31 10:00
2025-01-08 00:00
OUTAGE
SCHEDULED
Solving problems after the OS upgrade
NGI_PL
WUT
TIERNA
2024-12-30 23:50
2025-01-07 23:50
OUTAGE
SCHEDULED
CE outage of HTCondor
NGI_IT
INFN-COSENZA
TIERNA
2024-12-31 22:30
2025-01-08 12:35
OUTAGE
SCHEDULED
Faulty Chillers
NGI_CHINA
HK-LCG2
TIERNA
2025-01-06 00:00
2025-01-31 23:59
OUTAGE
UNSCHEDULED
Waiting for SSL Cert Renewal
EGI.eu
GRIDOPS-PERUN
TIERNA
2025-01-28 07:00
2025-01-28 09:00
OUTAGE
SCHEDULED
Upgrade EGI Perun OS to Debian 12
NGI_NL
BelGrid-UCL
TIER2
2025-01-24 08:00
2025-01-29 13:03
OUTAGE
SCHEDULED
cluster maintenance, SLURM update, OS reinstallation on storage servers
AsiaPacific
JP-KEK-CRC-02
TIERNA
2025-01-13 01:00
2025-01-13 04:00
WARNING
SCHEDULED
Software maintenance for VOMS servers.
NGI_IT
INFN-ROMA3
TIERNA
2025-01-09 07:15
2025-01-09 10:45
OUTAGE
SCHEDULED
Maintanance of electrical substation of building
NGI_DE
DESY-HH
TIER2
2025-01-20 08:00
2025-01-20 18:00
OUTAGE
SCHEDULED
annual maintenance and update of the CMS dCache storage instance
ROC_LA
EELA-UTFSM
TIERNA
2025-01-08 14:00
2025-01-28 23:00
OUTAGE
SCHEDULED
WebDAV error,(All pools are full)
ROC_LA
EELA-UTFSM
TIERNA
2025-01-07 18:00
2025-01-08 14:00
OUTAGE
UNSCHEDULED
WebDAV error,(All pools are full)
NGI_IT
Hephy-Vienna
TIER2
2025-01-08 08:00
2025-01-09 07:00
WARNING
UNSCHEDULED
We are performing firmware updates on compute nodes
CERN
CERN-PROD
TIER0
2025-01-14 09:00
2025-01-14 13:00
OUTAGE
SCHEDULED
CERN upgrade of FTS ATLAS, DAQ and LHCb
ROC_Canada
CA-WATERLOO-T2
TIERNA
2025-01-10 04:58
2025-01-17 04:59
OUTAGE
SCHEDULED
Work on cooling and power in datacentre continues, so systems are offline for another week
NGI_IT
INFN-T1
TIER1
2025-01-13 08:00
2025-01-20 16:00
OUTAGE
SCHEDULED
Moving tape library to new site
NGI_CH
T3_CH_PSI
TIERNA
2025-01-10 14:00
2025-01-13 16:00
OUTAGE
SCHEDULED
Yearly Compute Center Maintenance
NGI_DE
DESY-HH
TIER2
2025-01-09 07:00
2025-01-10 17:00
WARNING
UNSCHEDULED
a subset of ATLAS files are not available - a ATLAS storage pool is offline with hardware issues
ROC_LA
CBPF
TIERNA
2025-01-10 23:00
2025-01-14 18:30
OUTAGE
SCHEDULED
electrical maintenance
ROC_Canada
CA-WATERLOO-T2
TIERNA
2025-01-09 05:01
2025-01-11 14:00
OUTAGE
UNSCHEDULED
Missed a day of downtime due to major work in the datacentre (power and cooling)
ROC_Canada
CA-WATERLOO-T2
TIERNA
2025-01-09 05:01
2025-01-11 14:00
OUTAGE
UNSCHEDULED
Missed a day of downtime due to major work in the datacentre (power and cooling)
NGI_SK
IEPSAS-Kosice
TIERNA
2025-01-13 08:00
2025-01-14 15:32
OUTAGE
SCHEDULED
Recabling the central switch and reorgaize racks
NGI_CZ
CESNET-MCCG2
TIERNA
2025-01-11 13:00
2025-01-17 18:00
WARNING
SCHEDULED
Maintenance (certification process)
NGI_PL
WUT
TIERNA
2025-01-13 23:50
2025-01-16 23:50
OUTAGE
SCHEDULED
CE outage of HTCondor
AsiaPacific
JP-KEK-CRC-02
TIERNA
2025-01-13 08:10
2025-01-13 08:12
WARNING
UNSCHEDULED
An extra emergency downtime because the system unexpectedly did not come back online, ref: 36231
EGI.eu
GRIDOPS-CTOOLS
TIERNA
2025-01-12 19:30
2025-01-12 21:30
OUTAGE
UNSCHEDULED
Maintenance - Confluence Update
NGI_NL
NIKHEF-ELPROD
TIER1
2025-01-16 08:00
2025-01-16 17:00
OUTAGE
SCHEDULED
Upgrade of Nikhef CVMFS Stratum-1 service
EGI.eu
GRIDOPS-GGUS
TIERNA
2025-01-29 07:00
2025-01-29 19:00
OUTAGE
SCHEDULED
GGUS migration to new platform
NGI_CZ
prague_cesnet_lcg2
TIER2
2025-01-24 07:00
2025-01-24 19:00
OUTAGE
SCHEDULED
Network upgrade
ROC_Canada
TRIUMF-LCG2
TIER1
2025-01-16 17:00
2025-01-16 21:00
OUTAGE
SCHEDULED
Update frontier-squid to frontier-squid-5.9-3.2
NGI_CH
UNIBE-LHEP
TIERNA
2025-01-15 09:35
2025-01-15 22:08
OUTAGE
UNSCHEDULED
Lustre outage
EGI.eu
GRIDOPS-APEL
TIERNA
2025-01-21 07:00
2025-01-21 08:00
WARNING
SCHEDULED
At risk for the macro seg firewall change, with a 10 minute network outage window between 07:15-07:25
EGI.eu
GRIDOPS-GOCDB
TIERNA
2025-01-21 07:00
2025-01-21 08:00
WARNING
SCHEDULED
At risk for the macro seg firewall change, with a 10 minute network outage window between 07:15-07:25
iris.ac.uk
IRISOPS-IAM
TIERNA
2025-01-21 07:00
2025-01-21 08:00
WARNING
SCHEDULED
At risk for the macro seg firewall change, with a 10 minute network outage window between 07:15-07:25
ROC_Canada
TRIUMF-LCG2
TIER1
2025-01-15 20:00
2025-01-16 22:27
OUTAGE
UNSCHEDULED
Have to move different rack for space
ROC_Canada
CA-SFU-T2
TIERNA
2025-01-18 05:00
2025-01-22 21:47
OUTAGE
SCHEDULED
Extending cluster downtime for another week
NGI_PL
WUT
TIERNA
2025-01-16 14:00
2025-01-16 14:30
OUTAGE
UNSCHEDULED
SE outage
NGI_IT
INFN-T1
TIER1
2025-01-20 16:00
2025-01-22 17:00
OUTAGE
SCHEDULED
Moving tape library to new site (extending downtime 36310)
NGI_PL
WUT
TIERNA
2025-01-17 01:00
2025-01-20 23:50
OUTAGE
UNSCHEDULED
CE outage of HTCondor
ROC_Canada
CA-WATERLOO-T2
TIERNA
2025-01-17 04:00
2025-01-25 04:59
OUTAGE
UNSCHEDULED
Recovery of systems starting after electical/cooling renovation work, but unlikely stable enough for production service so extending downtime another week for now
ROC_Canada
TRIUMF-LCG2
TIER1
2025-01-21 17:00
2025-01-21 23:59
OUTAGE
SCHEDULED
Update frontier-squid to frontier-squid-5.9-3.2
NGI_RO
CLOUDIFIN
TIERNA
2025-01-18 07:00
2025-01-24 07:00
WARNING
SCHEDULED
Solving problems that appeared on cloud-bdii.nipne.ro
NGI_NDGF
NDGF-T1
TIER1
2025-01-20 17:00
2025-01-20 21:00
WARNING
SCHEDULED
Network provider will do a router upgrade. Access to NDGF services may be disrupted during router restarts. -NORDUnet core router in Orestad (dk-ore) will be upgraded to a new software release.
ROC_LA
CBPF
TIERNA
2025-01-19 03:00
2025-01-20 03:00
OUTAGE
SCHEDULED
Upgrade to al9
ROC_LA
CBPF
TIERNA
2025-01-20 00:00
2025-01-31 22:59
OUTAGE
SCHEDULED
Upgrade to al9
ROC_LA
SAMPA
TIERNA
2025-01-17 17:30
2025-02-07 20:00
OUTAGE
UNSCHEDULED
Old SE is showing instabilities and will be replaced
NGI_PL
WUT
TIERNA
2025-01-18 00:10
2025-01-19 23:00
OUTAGE
UNSCHEDULED
WUT site outage - change of site BDII host name
NGI_IT
INFN-NAPOLI-ATLAS
TIER2
2025-01-19 01:00
2025-01-20 15:00
OUTAGE
UNSCHEDULED
Cooling outage
NGI_PL
WUT
TIERNA
2025-01-20 02:00
2025-01-24 23:00
OUTAGE
UNSCHEDULED
CE outage of HTCondor
NGI_IBERGRID
pic
TIER1
2025-01-21 08:00
2025-01-21 10:00
WARNING
UNSCHEDULED
New HW for dcache doors and switch some services to new door
NGI_IBERGRID
UAM-LCG2
TIER2
2025-01-23 08:30
2025-01-23 10:31
OUTAGE
SCHEDULED
Netwoking update from 10 Gb/s to 100 Gb/s
NGI_DE
DESY-HH
TIER2
2025-02-18 07:00
2025-02-18 19:00
OUTAGE
SCHEDULED
maintenance of the storage instances for ATLAS as well as Belle, ILC, ALPS, MADMAX,...
ROC_Canada
TRIUMF-LCG2
TIER1
2025-01-21 22:47
2025-01-24 03:00
OUTAGE
UNSCHEDULED
Tape Storage Maintenance
NGI_NDGF
NDGF-T1
TIER1
2025-01-22 06:00
2025-01-22 14:24
WARNING
UNSCHEDULED
Maintenance. Services are mostly available.
NGI_DE
wuppertalprod
TIER2
2025-02-21 06:00
2025-02-21 17:00
OUTAGE
SCHEDULED
dCache update
NGI_CHINA
HK-LCG2
TIERNA
2025-02-01 00:00
2025-02-28 22:59
OUTAGE
SCHEDULED
Waiting for SSL Cert Renewal
NGI_IT
INFN-NAPOLI-ATLAS
TIER2
2025-01-22 23:00
2025-01-23 08:35
OUTAGE
UNSCHEDULED
Storage problem
EGI.eu
GRIDOPS-GGUS
TIERNA
2025-01-29 19:00
2025-01-30 09:00
OUTAGE
SCHEDULED
Migration to a new helpdesk
NGI_FRANCE
IN2P3-CPPM
TIER2
2025-01-23 00:00
2025-01-24 12:26
OUTAGE
UNSCHEDULED
decomissioning of centos7 squid marsq03
ROC_Canada
CA-WATERLOO-T2
TIERNA
2025-01-25 04:00
2025-02-01 04:59
OUTAGE
SCHEDULED
File system migration and ongoing work in datacentre so operational services delayed another week
NGI_PL
CYFRONET-LCG2
TIER2
2025-01-23 19:00
2025-01-24 09:56
OUTAGE
UNSCHEDULED
EOS down after OS update
NGI_UK
UKI-SOUTHGRID-SUSX
TIERNA
2025-01-24 08:40
2025-01-24 23:59
OUTAGE
UNSCHEDULED
Memory leak
NGI_FRANCE
GRIF
TIER2
2025-02-12 08:00
2025-02-12 20:00
OUTAGE
SCHEDULED
maintenance the cooling room
EGI.eu
GRIDOPS-CheckIn
TIERNA
2025-01-27 07:00
2025-01-27 07:15
OUTAGE
SCHEDULED
EGI Check-in Keycloak Update to version 22.0.13-1.13
ROC_LA
EELA-UTFSM
TIERNA
2025-01-28 23:00
2025-02-28 00:00
OUTAGE
SCHEDULED
WebDAV error,(All pools are full)
NGI_IBERGRID
pic
TIER1
2025-02-04 08:00
2025-02-04 10:00
OUTAGE
SCHEDULED
dCache door new HW
NGI_FRANCE
IN2P3-IRES
TIER2
2025-02-14 09:00
2025-03-06 00:00
OUTAGE
SCHEDULED
Decommissionning of sbgce2 ARC-CE
NGI_SI
SiGNET
TIER2
2025-02-08 06:00
2025-02-08 19:00
OUTAGE
SCHEDULED
Electrical maintenance
EGI.eu
GRIDOPS-GOCDB
TIERNA
2025-01-28 18:00
2025-01-29 10:17
OUTAGE
UNSCHEDULED
Due to operational issues with the database system that underpins GOCDB, these services were down during this window.
NGI_IT
INFN-NAPOLI-ATLAS
TIER2
2025-01-30 14:00
2025-01-30 17:44
OUTAGE
SCHEDULED
Storage OS upgarde
NGI_IBERGRID
IFCA-LCG2
TIER2
2025-02-03 09:00
2025-02-03 14:00
OUTAGE
SCHEDULED
Update Operating System
ROC_LA
CBPF
TIERNA
2025-01-31 21:59
2025-02-01 21:59
OUTAGE
UNSCHEDULED
Upgrade to al9
ROC_LA
CBPF
TIERNA
2025-02-01 21:59
2025-02-21 23:00
OUTAGE
SCHEDULED
Upgrade to al9
NGI_UK
UKI-SCOTGRID-GLASGOW
TIER2
2025-02-03 08:00
2025-02-07 16:00
OUTAGE
SCHEDULED
Rebuild of ce-test
NGI_GRNET
GRNET-ARIS
TIERNA
2025-01-31 22:00
2025-02-03 11:03
OUTAGE
UNSCHEDULED
ARIS is down due to a very serious water leak in the data center
NGI_CH
T3_CH_PSI
TIERNA
2025-01-31 15:30
2025-02-03 16:14
OUTAGE
UNSCHEDULED
One SE file server failed - HW intervention needed
ROC_Canada
CA-WATERLOO-T2
TIERNA
2025-02-01 05:00
2025-02-13 04:59
OUTAGE
UNSCHEDULED
Data and service migration still ongoing so downtime extended another 10 days
NGI_UK
UKI-SCOTGRID-ECDF
TIER2
2025-02-14 17:00
2025-03-03 12:00
OUTAGE
SCHEDULED
Initial relocation of equipment from ACF to MSCD
NGI_NDGF
NDGF-T1
TIER1
2025-02-06 18:30
2025-02-06 22:00
WARNING
SCHEDULED
Main router migration at ØRE. Only a short interruption is expected.
NGI_IBERGRID
IFCA-LCG2
TIER2
2025-02-05 08:30
2025-02-05 17:00
OUTAGE
UNSCHEDULED
Update Operating System
EGI.eu
GRIDOPS-GOCDB
TIERNA
2025-02-05 10:05
2025-02-05 10:30
WARNING
SCHEDULED
These systems will be routinely patched and rebooted during this time. As such, they will be unavailable for approximately 15 minutes during this window.
AsiaPacific
JP-KEK-CRC-02
TIERNA
2025-02-08 04:30
2025-02-08 05:30
WARNING
SCHEDULED
Hardware maintenance related with VOMS/IAM/FTS servers.
ROC_Canada
CA-VICTORIA-WESTGRID-T2
TIER2
2025-02-05 18:00
2025-02-05 23:17
OUTAGE
SCHEDULED
cluster upgrade
ROC_LA
SAMPA
TIERNA
2025-02-07 20:00
2025-02-17 20:00
OUTAGE
SCHEDULED
Old SE is showing instabilities and will be replaced