MGHPCC SHARED SERVICES (MGHPCC-SS) ACCOUNT PORTAL - Operational
MGHPCC SHARED SERVICES (MGHPCC-SS) ACCOUNT PORTAL
NERC COLDFRONT - Operational
NERC COLDFRONT
NERC ACADEMIC (EDU) OPENSHIFT CLUSTER - Operational
NERC ACADEMIC (EDU) OPENSHIFT CLUSTER
NETWORKING - Operational
NETWORKING
STORAGE - Operational
NERC WEBSITE - Operational
NERC WEBSITE
NERC DOCUMENTATION WEBSITE - Operational
NERC TICKETING SYSTEM - Operational
NERC TICKETING SYSTEM
Notice history
View current statusFeb 2024
- Resolved · UTCThis incident has been resolved.
- Investigating · UTC
NOTICES
We regret to inform you that we are experiencing a service degradation event affecting our NERC OpenShift (OCP) cluster and consequently impacting access to our OCP and RedHat OpenShift AI (RHOAI) services.
Our Systems team is actively investigating the root cause of this issue and working diligently to restore normal service operations as quickly as possible. We understand the critical nature of our services to your operations and apologize for any inconvenience this may cause.
We will provide regular updates regarding the progress of our investigation and resolution efforts. To receive future updates on the status of NERC's services, please subscribe using the following link: https://nerc.instatus.com/subscribe/email
More information about NERC is available on NERC’s website (https://nerc.mghpcc.org/). If you have any questions, please don't hesitate to contact us via email (help@nese.mghpcc.org) or submit a new ticket to the NERC's Support Ticketing System.
- Completed · February 22, 2024 at 10:00 PMUTCMaintenance has completed successfully
- In progress · February 22, 2024 at 7:00 PMUTCMaintenance is now in progress
- Planned · February 22, 2024 at 7:00 PMUTC
Upcoming NERC OpenShift Container Platform (OCP) maintenance and upgrade will occur on Thursday February 22, 2024 from 2 PM - 5 PM.
GENERAL MAINTENANCE
– We are writing to inform you that we are planning to perform maintenance on the NERC OpenShift deployment.
NOTICES
- We will be expanding the NERC OpenShift cluster with new compute hosts that will provide 40 NVIDIA A100 SXM4 GPUs. This will involve a rolling reboot of all hosts in the OpenShift cluster. Please be aware this may cause issues for any workloads on the cluster that are not configured to automatically failover to other nodes.
- NERC OpenShift web console and other OpenShift CLI may be inaccessible at times during this process.
- Please ensure that all your Jupyter notebooks and RHODS workloads have been saved and exited before 2 PM.
- Please be aware that during this maintenance, project and project change requests for OpenShift Resource Type will not be accepted and approved.- We are reserving three hours, from 2pm to 5pm. It can take more or less time, so we urge you to keep an eye on https://nerc.instatus.com/ to get the progress during this time.
- Please do subscribe to https://nerc.instatus.com/subscribe/email in order to get the progress updates during this time.
Our priority is to help make science happen, so If you or your research team have any questions or need to escalate an issue, please contact us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC’s Support Ticketing System.
Thanks,New England Research Cloud (NERC)
- Completed · February 21, 2024 at 7:00 AMUTCMaintenance has completed successfully
- Update · February 21, 2024 at 3:56 AMUTC
We are still working on it! We will extend the maintenance time by another 1 more hours till 12AM.
- Update · February 21, 2024 at 2:54 AMUTC
We are still working on it! We will extend the maintenance time by another 1 more hours till 11PM.
- Update · February 21, 2024 at 1:52 AMUTC
We are still working on it! We will extend the maintenance time by another 1 more hours till 10PM.
- Update · February 20, 2024 at 11:23 PMUTC
We are still working on it! We will extend the maintenance time by another 2 more hours till 9PM.
- Update · February 20, 2024 at 9:09 PMUTC
We are still working on it! We will extend the maintenance time by another 2 hours till 7PM.
- In progress · February 20, 2024 at 2:00 PMUTCMaintenance is now in progress
- Planned · February 20, 2024 at 2:00 PMUTC
Upcoming NERC system maintenance and upgrade will occur on Tuesday February 20, 2024 from 9:00 AM – 5:00 PM.
GENERAL MAINTENANCE
– We are writing to inform you that we are planning to perform maintenance on the NERC OpenStack deployment. This will take the majority of the maintenance period.
– We will also be upgrading our ColdFront deployment.
NOTICES
– We plan to perform maintenance on the NERC OpenStack deployment during this time.
– NERC OpenStack’s Horizon dashboard and other OpenStack API services may be inaccessible at times during this process.
– The OpenStack maintenance should not affect any of your running VMs and used storage including volumes and object storage.
– Please be aware that during the ColdFront maintenance, project and project change requests will not be accepted and approved. We will post updates to the status page when the ColdFront portion of this maintenance has been completed.
– We are reserving the whole day, from 9am to 5pm. It can take more or less time, so we urge you to keep an eye on https://nerc.instatus.com/ to get the progress during this time.
– Please do subscribe to https://nerc.instatus.com/subscribe/email in order to get the progress updates during this time.
Our priority is to help make science happen, so If you or your research team have any questions or need to escalate an issue, please contact us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC’s Support Ticketing System.
Thanks,New England Research Cloud (NERC)
Jan 2024
- Completed · January 29, 2024 at 11:00 PMUTC
Maintenance has completed successfully
- Update · January 29, 2024 at 10:23 PMUTC
Maintenance is now in progress. We are extending this till 6:00PM.
- Update · January 29, 2024 at 8:00 PMUTC
Maintenance is now in progress. We are extending this till 5:30PM.
- In progress · January 29, 2024 at 8:00 PMUTC
Maintenance is now in progress
- Update · January 29, 2024 at 8:00 PMUTC
We are postponing the NERC's OpenStack upgrade due to a licensing issue for now. However, we will still be expanding the available Floating IPs from 3 PM to 5 PM today.
- Planned · January 29, 2024 at 8:00 PMUTC
Upcoming NERC OpenStack Platform upgrade to version 16.2.6 and floating IP network expansion will occur on Monday January 29, 2024 from 9:00 AM – 5:00 PM.
GENERAL MAINTENANCE
We are writing to inform you that we are planning to upgrade our NERC OpenStack Platform to version 16.2.6. This will take the majority of the maintenance period.
We will also be expanding the currently available floating IP space to support a large number of users and projects. This work should take ~1hr and will be done after the upgrade work has completed successfully (most likely in the afternoon).
NOTICES
We have rescheduled the planned NERC OpenStack Platform version upgrade to a new date to include expansion of NERC OpenStack Floating IPs.
NERC OpenStack’s Horizon dashboard and other OpenStack API services may be inaccessible at times during this process.
The RHOSP upgrade process should not affect any of your running VMs and used storage including volumes and object storage. However, during the expansion of the floating IP space after the upgrade, VMs will be temporarily unable to get out to the internet and will also be temporarily unreachable from the internet. We expect the floating IP expansion to take around an hour to complete. We will update the status page if it takes more or less time.
Please be aware that during this maintenance, project and project change requests will not be accepted and approved.
We are reserving the whole day, from 9am to 5pm. It can take more or less time, so we urge you to keep an eye on https://nerc.instatus.com/ to get the progress during this time.
Please do subscribe to https://nerc.instatus.com/subscribe/email in order to get the progress updates during this time.
Our priority is to help make science happen, so If you or your research team have any questions or need to escalate an issue, please contact us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC's Support Ticketing System.
Thank you,
New England Research Cloud (NERC)
- Completed · January 04, 2024 at 3:40 PMUTC
Maintenance has completed successfully.
- In progress · January 04, 2024 at 3:00 PMUTC
Maintenance is now in progress
- Planned · January 04, 2024 at 3:00 PMUTC
Upcoming renewal and upgrade of NERC OpenStack Platform SSL Certificates will occur on Thursday January 4, 2024 10:00 AM - 11:00 AM.
GENERAL MAINTENANCE
- We will be renewing and upgrading our RedHat OpenStack Platform SSL Certificates.
NOTICES
NERC OpenStack’s Horizon dashboard and other OpenStack API services may be inaccessible during this process.
The estimated time to complete this update is only 1 hour. It can take more or less time, so we urge you to keep an eye on https://nerc.instatus.com/ to get the progress during this time.
Please do subscribe to the NERC’s status for any future updates: https://nerc.instatus.com/subscribe/email
We appreciate your understanding and cooperation as we work to enhance the security measures within our NERC's OpenStack environment. Thank you for being a valued member of our community.
If you or your research team have any questions or need to escalate an issue, please don't hesitate to reach out to us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC's Support Ticketing System.
Thank you,
New England Research Cloud (NERC)
https://nerc.mghpcc.org/
https://nerc-project.github.io/nerc-docs/