Service Notes

Update: Did not occur due to a full boot partition. Maintenance must be completed on system first.

Jenkins will be down momentarily during Thursday's maintenance window for a software update.

GitLab will be down for approximately 15 minutes during Thursday's maintenance window for it's monthly software update.

OTRS will be updated from 4.0.9 to 4.0.11 during next Sunday's maintenance window, 9/20/2015, at 8:00 AM. The outage is scheduled for 1 hour. 

Update:

The web server process on OTRS's application server has been restarted and services restored.

The OTRS has been reported as down. We are working to resolve the issue.

Blackboard services failed at approximately 5:00am this morning. Services were restarted and available by 7:50am. We are reseaching the failure and believe we have tracked down the issue to a configure problem. We in the process of taking corrective actions so we have no future failures of this kind. 

Tonight at 9:00PM a new Active Directory certificate authority will be installed. and logon page for Outlook Web Access at exchange.truman.edu will be updated. No outage is expected for either event. 

As of noon, the University internet connection is available. Outages with the University internet service provider, Bluebird, caused the outage in the greater Kirksville area. Bluebird is looking into the cause of the outage. 

The Banner application and database server was restarted at 10:00pm to complete system maintenance on the server. All services were available by approximately 10:15pm.

Blackboard services will be restarted at 5pm today so we can complete a few post-upgrade configuration changes. We expect this upgrade to be short and services to be restored by approximately 5:30pm.

The Banner forms server was restarted following OS updates. All services are again available.

Blackboard services are up and available.

We are still working with Blackboard support on a few issues. At this time, we don't know of any additional outage needs will this may change as Blackboard finds resolution to the remaining issues related to migrating to new servers. 

-----

UPDATE: The Blackboard upgrade is still in progress. We are working with Blackboard support on the migration needs for the cloud services that are part of Blackboard. This piece of the upgrade is complicated, involving multiple groups at Blackboard.

We appreciate your patience as we continue to work on this upgrade. We will get the system back up as soon as possible.

-----

Blackboard Upgrade Plan
Due to the size of Blackboard, this upgrade will take a lot of time to complete. To try to help minimize the actual downtime of the whole system, we are breaking this upgrade into pieces. We are finishing up the upgrade and migration of all prior semesters by this weekend. Since the fall semester is so much larger than the summer semester, we are working on it next. This allows the current, active summer semester to remain up the longest and have the least amount of impacted downtime.  Therefore beginning on Sunday, August 2, at noon, we ask all updates to Fall 2015 courses and local courses (non-Banner courses) be stopped until we complete the upgrade on Monday, August 3. We will migrate these two groups of courses on Sunday.

The final piece of the upgrade requires the system to be down to move the active semester and complete the final services migrations to the new servers. Beginning at 4am on Monday, August 3, all Blackboard services will be taken down for the final upgrade. Blackboard services will remain down until the upgrade is complete. We will send out a campus wide notification when the upgrade is complete and Blackboard is available. We are not sure how long this remaining piece will take but we are giving a very rough estimate of 8 hours. We will try to complete it as quickly as we can and still ensure we have completed all required tasks and checked everything for accuracy.   

Tonight, starting at 8:00PM, maintenance will be performed on the wireless network and internet connection. For the wireless network there will be a campus wide five to fifteen minute outage at 8:00PM. For the internet connection, there will be a short one to three minute outage.

There will also be short localized network outages in Pickler 1st Floor on the east side of the building, in General Services and in the West Campus Suites 1st floor. 

Finally, logon script software will be upgrade during this maintenance window as well.

Banner services were unavailable for approximately 15 minutes due to an issue with the Banner database. All services should now be avaiable.

AmerenUE is reporting issues with the electrical grid serving Campbell Apartments and Delaney Baldwin. 

Without stable power, networking services may be unavailable to Campbell Apartments, Delaney Baldwin, Stokes Stadium and the Trades Building. 

We worked with our vendors and identified and resolved the issues with the DegreeWorks system. DegreeWorks is available for use.

-----

Prior to the scheduled restart, DegreeWorks services begin experiencing a serious error that is rendering the system effectively down with no abilitiy for accessing student audits. We have a call into Ellucian support and will work to resolve this as quickly as possible.

On Tuesday, July 28th, at 12:30pm, we are completing an update to the server running DegreeWorks that requires a system restart. This should take approximate 20 minutes.

On Sunday, July 26^th at 7:30am, we will be taking down Banner and all Banner services in TruView to perform maintenance on the server that runs these systems. Banner Forms/Administrative interface (Banner ADMIN) and all Banner links in TruView will be unavailable. In addition, systems that are integrated and dependent on Banner will be impacted and have at least degraded services. These include but are not limited to DegreeWorks and online Student Bill+Payment.

The outage is expected to take approximately one hour. We apologize for the inconvenience of this service work and appreciate your patience and support as we work to ensure the systems are properly maintained.  

Blackboard will not be impacted by this update.

UPDATE:

TruView service has been restored.

The TruView service is not serving requests at the moment. Users have reported a 504 gateway timeout when trying to access the service. We are in the process of troubleshooting the issue and will send an update once resolution is met.

OTRS will be unavailable from 9-10 p.m. on 7/23/2015 for an upgrade and relocation to a new server. 

An update to the DegreeWorks server has been scheduled to begin at 7:45am, on Thursday, July 23, 2015. It is expected that service will be available again by approximately 8:30am.

We appreciate your patience as we work on keeping the many services and servers up to date on maintenance requirements.

Tonight, starting at 9:00PM, the University primary file server and authentication servers will be briefly unavailable for maintenance. This maintenance is expected to last an hour during which there will be brief service disruptions.