GETTING HELP
Email: help@nerc.mghpcc.org or, using the NERC's Support Ticketing System
NERC Documentation: https://nerc-project.github.io/nerc-docs/
Status page for the New England Research Cloud (NERC) and other resources.
Please scroll down to see details on any Incidents or maintenance notices.

MGHPCC SHARED SERVICES (MGHPCC-SS) ACCOUNT PORTAL

99.98% uptime
Dec 2023 · 100.0%Jan 2024 · 100.0%Feb · 99.93%
Dec 2023100.0% uptime
Jan 2024100.0% uptime
Feb 202499.93% uptime

NERC COLDFRONT

99.98% uptime
Dec 2023 · 100.0%Jan 2024 · 100.0%Feb · 99.94%
Dec 2023100.0% uptime
Jan 2024100.0% uptime
Feb 202499.94% uptime

NETWORKING

100.0% uptime
Dec 2023 · 100.0%Jan 2024 · 100.0%Feb · 100.0%
Dec 2023100.0% uptime
Jan 2024100.0% uptime
Feb 2024100.0% uptime
STORAGE
100.0% uptime
Dec 2023 · 100.0%Jan 2024 · 100.0%Feb · 100.0%
Dec 2023100.0% uptime
Jan 2024100.0% uptime
Feb 2024100.0% uptime
OTHER WEBSITES & TOOLS
99.99% uptime

NERC WEBSITE

100.0% uptime
Dec 2023 · 100.0%Jan 2024 · 100.0%Feb · 99.99%
Dec 2023100.0% uptime
Jan 2024100.0% uptime
Feb 202499.99% uptime
NERC DOCUMENTATION WEBSITE
100.0% uptime
Dec 2023 · 100.0%Jan 2024 · 100.0%Feb · 100.0%
Dec 2023100.0% uptime
Jan 2024100.0% uptime
Feb 2024100.0% uptime

NERC TICKETING SYSTEM

99.98% uptime
Dec 2023 · 99.95%Jan 2024 · 100.0%Feb · 99.98%
Dec 202399.95% uptime
Jan 2024100.0% uptime
Feb 202499.98% uptime

Notice history

Feb 2024

Urgent: Service Degradation Notification OpenShift Container Platform (OCP) and RH OpenShift AI (RHOAI) platform
  • Resolved
    Resolved
    This incident has been resolved.
  • Investigating
    Investigating

    NOTICES

    We regret to inform you that we are experiencing a service degradation event affecting our NERC OpenShift (OCP) cluster and consequently impacting access to our OCP and RedHat OpenShift AI (RHOAI) services.

    Our Systems team is actively investigating the root cause of this issue and working diligently to restore normal service operations as quickly as possible. We understand the critical nature of our services to your operations and apologize for any inconvenience this may cause.

    We will provide regular updates regarding the progress of our investigation and resolution efforts. To receive future updates on the status of NERC's services, please subscribe using the following link: https://nerc.instatus.com/subscribe/email


    More information about NERC is available on NERC’s website (https://nerc.mghpcc.org/). If you have any questions, please don't hesitate to contact us via email (help@nese.mghpcc.org) or submit a new ticket to the NERC's Support Ticketing System.

Upcoming NERC OpenShift Container Platform (OCP) maintenance and upgrade – [Thursday February 22, 2024 from 2:00 PM – 5:00 PM]
  • Completed
    February 22, 2024 at 10:00 PM
    Completed
    February 22, 2024 at 10:00 PM
    Maintenance has completed successfully
  • In progress
    February 22, 2024 at 7:00 PM
    In progress
    February 22, 2024 at 7:00 PM
    Maintenance is now in progress
  • Planned
    February 22, 2024 at 7:00 PM
    Planned
    February 22, 2024 at 7:00 PM

    Upcoming NERC OpenShift Container Platform (OCP) maintenance and upgrade will occur on Thursday February 22, 2024 from 2 PM - 5 PM.

    GENERAL MAINTENANCE

    – We are writing to inform you that we are planning to perform maintenance on the NERC OpenShift deployment.

    NOTICES

    - We will be expanding the NERC OpenShift cluster with new compute hosts that will provide 40 NVIDIA A100 SXM4 GPUs. This will involve a rolling reboot of all hosts in the OpenShift cluster. Please be aware this may cause issues for any workloads on the cluster that are not configured to automatically failover to other nodes.

    - NERC OpenShift web console and other OpenShift CLI may be inaccessible at times during this process.

    - Please ensure that all your Jupyter notebooks and RHODS workloads have been saved and exited before 2 PM.

    - Please be aware that during this maintenance, project and project change requests for OpenShift Resource Type will not be accepted and approved.

    - We are reserving three hours, from 2pm to 5pm. It can take more or less time, so we urge you to keep an eye on https://nerc.instatus.com/ to get the progress during this time.

    - Please do subscribe to https://nerc.instatus.com/subscribe/email in order to get the progress updates during this time.

    Our priority is to help make science happen, so If you or your research team have any questions or need to escalate an issue, please contact us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC’s Support Ticketing System.

    Thanks,

    New England Research Cloud (NERC)

    https://nerc.mghpcc.org/

    https://nerc-project.github.io/nerc-docs/

Upcoming NERC system maintenance and upgrade – OpenStack and ColdFront – [Tuesday February 20, 2024 from 9:00 AM – 5:00 PM]
  • Completed
    February 21, 2024 at 7:00 AM
    Completed
    February 21, 2024 at 7:00 AM
    Maintenance has completed successfully
  • Update
    February 21, 2024 at 3:56 AM
    In progress
    February 21, 2024 at 3:56 AM

    We are still working on it! We will extend the maintenance time by another 1 more hours till 12AM.

  • Update
    February 21, 2024 at 2:54 AM
    In progress
    February 21, 2024 at 2:54 AM

    We are still working on it! We will extend the maintenance time by another 1 more hours till 11PM.

  • Update
    February 21, 2024 at 1:52 AM
    In progress
    February 21, 2024 at 1:52 AM

    We are still working on it! We will extend the maintenance time by another 1 more hours till 10PM.

  • Update
    February 20, 2024 at 11:23 PM
    In progress
    February 20, 2024 at 11:23 PM

    We are still working on it! We will extend the maintenance time by another 2 more hours till 9PM.

  • Update
    February 20, 2024 at 9:09 PM
    In progress
    February 20, 2024 at 9:09 PM

    We are still working on it! We will extend the maintenance time by another 2 hours till 7PM.

  • In progress
    February 20, 2024 at 2:00 PM
    In progress
    February 20, 2024 at 2:00 PM
    Maintenance is now in progress
  • Planned
    February 20, 2024 at 2:00 PM
    Planned
    February 20, 2024 at 2:00 PM

    Upcoming NERC system maintenance and upgrade will occur on Tuesday February 20, 2024 from 9:00 AM – 5:00 PM.

    GENERAL MAINTENANCE

    – We are writing to inform you that we are planning to perform maintenance on the NERC OpenStack deployment. This will take the majority of the maintenance period.

    – We will also be upgrading our ColdFront deployment.

    NOTICES

    – We plan to perform maintenance on the NERC OpenStack deployment during this time.

    – NERC OpenStack’s Horizon dashboard and other OpenStack API services may be inaccessible at times during this process.

    – The OpenStack maintenance should not affect any of your running VMs and used storage including volumes and object storage.

    – Please be aware that during the ColdFront maintenance, project and project change requests will not be accepted and approved. We will post updates to the status page when the ColdFront portion of this maintenance has been completed.

    – We are reserving the whole day, from 9am to 5pm. It can take more or less time, so we urge you to keep an eye on https://nerc.instatus.com/ to get the progress during this time.

    – Please do subscribe to https://nerc.instatus.com/subscribe/email in order to get the progress updates during this time.

    Our priority is to help make science happen, so If you or your research team have any questions or need to escalate an issue, please contact us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC’s Support Ticketing System.
    Thanks,

    New England Research Cloud (NERC)

    https://nerc.mghpcc.org/

    https://nerc-project.github.io/nerc-docs/

Jan 2024

Upcoming NERC expansion of available Floating IPs [January 29, 2024 3PM – 5PM]
  • Completed
    January 29, 2024 at 11:00 PM
    Completed
    January 29, 2024 at 11:00 PM

    Maintenance has completed successfully

  • Update
    January 29, 2024 at 10:23 PM
    In progress
    January 29, 2024 at 10:23 PM

    Maintenance is now in progress. We are extending this till 6:00PM.

  • Update
    January 29, 2024 at 8:00 PM
    In progress
    January 29, 2024 at 8:00 PM

    Maintenance is now in progress. We are extending this till 5:30PM.

  • In progress
    January 29, 2024 at 8:00 PM
    In progress
    January 29, 2024 at 8:00 PM

    Maintenance is now in progress

  • Update
    January 29, 2024 at 8:00 PM
    Planned
    January 29, 2024 at 8:00 PM

    We are postponing the NERC's OpenStack upgrade due to a licensing issue for now. However, we will still be expanding the available Floating IPs from 3 PM to 5 PM today.

  • Planned
    January 29, 2024 at 8:00 PM
    Planned
    January 29, 2024 at 8:00 PM

    Upcoming NERC OpenStack Platform upgrade to version 16.2.6 and floating IP network expansion will occur on Monday January 29, 2024 from 9:00 AM – 5:00 PM.

    GENERAL MAINTENANCE

    • We are writing to inform you that we are planning to upgrade our NERC OpenStack Platform to version 16.2.6. This will take the majority of the maintenance period.

    • We will also be expanding the currently available floating IP space to support a large number of users and projects. This work should take ~1hr and will be done after the upgrade work has completed successfully (most likely in the afternoon).

    NOTICES

    • We have rescheduled the planned NERC OpenStack Platform version upgrade to a new date to include expansion of NERC OpenStack Floating IPs.

    • NERC OpenStack’s Horizon dashboard and other OpenStack API services may be inaccessible at times during this process.

    • The RHOSP upgrade process should not affect any of your running VMs and used storage including volumes and object storage. However, during the expansion of the floating IP space after the upgrade, VMs will be temporarily unable to get out to the internet and will also be temporarily unreachable from the internet. We expect the floating IP expansion to take around an hour to complete. We will update the status page if it takes more or less time.

    • Please be aware that during this maintenance, project and project change requests will not be accepted and approved.

    • We are reserving the whole day, from 9am to 5pm. It can take more or less time, so we urge you to keep an eye on https://nerc.instatus.com/ to get the progress during this time.

    • Please do subscribe to https://nerc.instatus.com/subscribe/email in order to get the progress updates during this time.

    Our priority is to help make science happen, so If you or your research team have any questions or need to escalate an issue, please contact us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC's Support Ticketing System.

    Thank you,

    New England Research Cloud (NERC)

    https://nerc.mghpcc.org/

    https://nerc-project.github.io/nerc-docs/

Upcoming renewal and upgrade of NERC OpenStack Platform SSL Certificates January 4, 2024 from 10:00 AM to 11:00 AM
  • Completed
    January 04, 2024 at 3:40 PM
    Completed
    January 04, 2024 at 3:40 PM

    Maintenance has completed successfully.

  • In progress
    January 04, 2024 at 3:00 PM
    In progress
    January 04, 2024 at 3:00 PM

    Maintenance is now in progress

  • Planned
    January 04, 2024 at 3:00 PM
    Planned
    January 04, 2024 at 3:00 PM

    Upcoming renewal and upgrade of NERC OpenStack Platform SSL Certificates will occur on Thursday January 4, 2024 10:00 AM - 11:00 AM.

    GENERAL MAINTENANCE

    • We will be renewing and upgrading our RedHat OpenStack Platform SSL Certificates.

    NOTICES

    We appreciate your understanding and cooperation as we work to enhance the security measures within our NERC's OpenStack environment. Thank you for being a valued member of our community.

    If you or your research team have any questions or need to escalate an issue, please don't hesitate to reach out to us via email (help@nerc.mghpcc.org) or, by submitting a new ticket at the NERC's Support Ticketing System.

    Thank you,

    New England Research Cloud (NERC)
    https://nerc.mghpcc.org/
    https://nerc-project.github.io/nerc-docs/

Dec 2023

Dec 2023 to Feb 2024