NEAAR Network Operations Report
03/01/2017 - 05/31/2017

NEAAR Network Operations Center
at Indiana University

New Connections

ConnectorTypeDateSponsor
NEAAR-NEWY32AOA-LOND-100GE-01500100GE03/02/2017
NEAAR-NEWY32AOA-NEWY32AOA-100GE-01501 100GE03/02/2017


Upgrades
rtr.newy32aoa.neaar.net 03/01/2017

New Services

None



Unscheduled Outages Summary







Ticket Number
Customer Impact
Network Impact
Title
Outage Type
Source Of Impact
Start Time (UTC)

End Time (UTC)





132-High
2-High

Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
Circuit - Damaged FiberVendor
03/01/2017 10:29 AM
03/01/2017 9:20 PM


152-High
2-High

Instability Resolved - NEAAR Backbone NEWY32AOA-LOND
HardwareVendor
03/02/2017 12:03 AM
03/06/2017 5:18 PM


03/06/2017 6:27 PM
03/09/2017 7:22 PM


182-High
2-High

Outage Resolved - NEAAR Backbone NEWY32AOA-NEW32AOA to MANLAN
HardwareInternal
03/07/2017 3:41 PM
03/17/2017 10:33 PM


262-High
2-High

Outage Resolved - NEAAR Backbone NEWY32AOA-NEW32AOA to MANLAN
Unannounced MaintenanceVendor
03/22/2017 4:13 AM
03/22/2017 6:23 AM


362-High
2-High

Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
HardwareVendor
04/06/2017 11:06 PM
04/06/2017 11:21 PM


422-High
2-High

Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
HardwareVendor
04/07/2017 5:56 AM
04/11/2017 7:58 PM


402-High
2-High

Outage Resolved - NEAAR Interconnect to MANLAN
Unannounced MaintenanceInternal
04/10/2017 4:17 PM
04/10/2017 6:16 PM


04/10/2017 8:55 PM
04/10/2017 9:01 PM


494-Normal
2-High

Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
Unannounced MaintenanceVendor
04/13/2017 3:50 PM
04/13/2017 3:51 PM


544-Normal
2-High

Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
Unannounced MaintenanceVendor
04/24/2017 10:59 PM
04/24/2017 11:01 PM


554-Normal
2-High

Brief Outage - NEAAR Backbone NEWY32AOA-LOND
UndeterminedUndetermined
04/26/2017 2:46 AM
04/26/2017 2:47 AM


652-High
2-High

Availability - NEAAR Backbone NEWY32AOA-LOND
UndeterminedUndetermined
05/09/2017 5:05 AM
05/09/2017 5:16 AM


05/10/2017 3:01 PM
05/10/2017 3:22 PM


664-Normal
2-High

Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
Unannounced MaintenanceVendor
05/11/2017 9:27 PM
05/11/2017 9:40 PM


674-Normal
2-High

Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
Circuit - Bumped FiberVendor
05/13/2017 2:58 AM
05/13/2017 3:04 AM


724-Normal
2-High

Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
Circuit - Damaged FiberVendor
05/16/2017 11:07 AM
05/16/2017 11:26 AM


734-Normal
2-High

Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND
Circuit - Bumped FiberVendor
05/18/2017 4:45 PM
05/18/2017 4:50 PM


754-Normal
2-High

Brief Outage - NEAAR Backbone NEWY32AOA-LOND
Unannounced MaintenanceVendor
05/20/2017 1:49 AM
05/20/2017 1:57 AM






Unscheduled Outages Detail






Ticket No.:13:166



Subject:Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Wednesday, March 1, 2017, 10:29 AM (1029) UTC



End Time:Wednesday, March 1, 2017, 9:20 PM (2120) UTC


Description:The above NEAAR backbone circuit is available.  Circuit vendor
Aquacomms has been contacted. The outage has been determined to be due to
a fiber cut in North Wales due to power. Services have restored and no
further outages are expected.







Ticket No.:15:166



Subject:Instability Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Thursday, March 2, 2017, 12:03 AM (0003) UTC



End Time:Monday, March 6, 2017, 5:18 PM (1718) UTC


Start Time:Monday, March 6, 2017, 6:27 PM (1827) UTC



End Time:Thursday, March 9, 2017, 7:22 PM (1922) UTC


Description:The above NEAAR backbone circuit is now stable. NEAAR Engineers have 
swapped a card, and all services have stabilized. No further outages are 
expected.







Ticket No.:18:166



Subject:Outage Resolved - NEAAR Backbone NEWY32AOA-NEW32AOA to MANLAN



Source Of Impact:Internal



Affected:Backbone NEW32AOA-NEWY32AOA



Start Time:Tuesday, March 7, 2017, 3:41 PM (1541) UTC



End Time:Friday, March 17, 2017, 10:33 PM (2233) UTC


Description:The above listed backbone is now available. NEAAR engineers
have reported the reason for outage was administrative work being
performed on the backbone by NEAAR engineers. A card swap has been 
completed and services restored. No further outages expected.







Ticket No.:26:166



Subject:Outage Resolved - NEAAR Backbone NEWY32AOA-NEW32AOA to MANLAN



Source Of Impact:Vendor



Affected:Backbone NEW32AOA-NEWY32AOA



Start Time:Wednesday, March 22, 2017, 4:13 AM (0413) UTC



End Time:Wednesday, March 22, 2017, 6:23 AM (0623) UTC


Description:The above listed backbone is now available. NEAAR engineers
have investigated. The reason for the outage is due to maintenance.
Maintenance has been completed. No further outages are expected.







Ticket No.:36:166



Subject:Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Thursday, April 6, 2017, 11:06 PM (2306) UTC



End Time:Thursday, April 6, 2017, 11:21 PM (2321) UTC


Description:The above NEAAR backbone circuit remains unavailable. Vendor Aquacom has 
reported they have repaired a fiber issue. Services remain unavailable due to an 
ongoing hardware issue being tracked under ticket 42:166. Updates for future status will 
be received under ticket 42:166.







Ticket No.:42:166



Subject:Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Friday, April 7, 2017, 5:56 AM (0556) UTC



End Time:Tuesday, April 11, 2017, 7:58 PM (1958) UTC


Description:The above NEAAR backbone circuit is now available. NEAAR Engineers have 
reported the outage was due to a hardware failure and worked with hardware 
vendor to replace a faulty card. No further outages are expected.







Ticket No.:40:166



Subject:Outage Resolved - NEAAR Interconnect to MANLAN



Source Of Impact:Internal



Affected:NEAAR-NEW32AOA-NEWY32AOA-100GE-01501



Start Time:Monday, April 10, 2017, 4:17 PM (1617) UTC



End Time:Monday, April 10, 2017, 6:16 PM (1816) UTC


Start Time:Monday, April 10, 2017, 8:55 PM (2055) UTC



End Time:Monday, April 10, 2017, 9:01 PM (2101) UTC


Description:The above listed asset is now available. NEAAR engineers have reported the reason for 
the outage was due to planned maintenance. Maintenance has completed.







Ticket No.:49:166



Subject:Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Thursday, April 13, 2017, 3:50 PM (1550) UTC



End Time:Thursday, April 13, 2017, 3:51 PM (1551) UTC


Description:The above NEAAR backbone circuit is now available.  The reason for
outage is an unannounced maintenance by NEAAR Engineering.







Ticket No.:54:166



Subject:Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:NEAAR 100G to GEANT London



Start Time:Monday, April 24, 2017, 10:59 PM (2259) UTC



End Time:Monday, April 24, 2017, 11:01 PM (2301) UTC


Description:The above listed was briefly unavailable. Aquacomm Engineers have reported the 
outage was caused by a planned maintenance which has since been completed. No 
further impact is expected.







Ticket No.:55:166



Subject:Brief Outage - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Undetermined



Affected:Backbone NEWY32AOA-LOND



Start Time:Wednesday, April 26, 2017, 2:46 AM (0246) UTC



End Time:Wednesday, April 26, 2017, 2:47 AM (0247) UTC


Description:The above NEAAR backbone circuit is now available.  Circuit vendor
Aquacomms has been contacted; however the reason for the brief outage is 
pending.







Ticket No.:65:166



Subject:Availability - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Undetermined



Affected:Backbone NEWY32AOA-LOND



Start Time:Tuesday, May 9, 2017, 5:05 AM (0505) UTC



End Time:Tuesday, May 9, 2017, 5:16 AM (0516) UTC


Start Time:Wednesday, May 10, 2017, 3:01 PM (1501) UTC



End Time:Wednesday, May 10, 2017, 3:22 PM (1522) UTC


Description:The above NEAAR backbone circuit is available. Circuit vendor
Aquacomms has been contacted and has investigating. The reason for the 
outage
is undetermined.







Ticket No.:66:166



Subject:Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Thursday, May 11, 2017, 9:27 PM (2127) UTC



End Time:Thursday, May 11, 2017, 9:40 PM (2140) UTC


Description:The above NEAAR backbone circuit is now stable. Circuit vendor Aquacomms 
reported that it was due to an unannounced maintenance performed by a third 
party provider.







Ticket No.:67:166



Subject:Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Saturday, May 13, 2017, 2:58 AM (0258) UTC



End Time:Saturday, May 13, 2017, 3:04 AM (0304) UTC


Description:The above NEAAR backbone circuit is now available after a brief outage. Circuit
vendor Aquacomms reported that it was caused by a fiber bump. No further 
outages are expected.







Ticket No.:72:166



Subject:Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Tuesday, May 16, 2017, 11:07 AM (1107) UTC



End Time:Tuesday, May 16, 2017, 11:26 AM (1126) UTC


Description:The above NEAAR backbone circuit was unavailable. Circuit vendor
Aquacomms have reported that the outage was due to a fiber cut. The fiber has 
been repaired. No further outages are expected.







Ticket No.:73:166



Subject:Brief Outage Resolved - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Thursday, May 18, 2017, 4:45 PM (1645) UTC



End Time:Thursday, May 18, 2017, 4:50 PM (1650) UTC


Description:The above NEAAR backbone circuit is now available after a brief outage.  Circuit
vendor Aquacomms has been contacted. The reason for the outage was caused by a fiber
bump. Maintenance in this area has completed. No further outages are expected.







Ticket No.:75:166



Subject:Brief Outage - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Saturday, May 20, 2017, 1:49 AM (0149) UTC



End Time:Saturday, May 20, 2017, 1:57 AM (0157) UTC


Description:The above NEAAR backbone circuit is now available after a brief outage.  Circuit
vendor Aquacomms reported that was due to a scheduled maintenance to move 
our circuit back to its lowest latency route.







Scheduled Maintenances Summary





Ticket Number
Customer Impact
Network Impact
Title

Maintenance Type
Source Of Impact
Start Time (UTC)
End Time (UTC)





53
3-Elevated
2-High

Maintenance Completed - NEAAR Backbone NEWY32AOA-LOND
Circuit
Vendor04/21/2017 2:20 PM
04/21/2017 2:35 PM


71
3-Elevated
2-High

Emergency Maintenance Completed 2 of 2 - NEAAR Backbone NEWY32AOA-LOND
CircuitVendor
05/18/2017 1:47 AM
05/18/2017 1:59 AM




Scheduled Maintenances Detail





Ticket No.:53:166



Subject:Maintenance Completed - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Friday, April 21, 2017, 2:20 PM (1420) UTC



End Time:Friday, April 21, 2017, 2:35 PM (1435) UTC


Description:   The above Backbone was unavailable while NEAAR Engineering performed
maintenance. This maintenance has been completed.



  







Ticket No.:71:166



Subject:Emergency Maintenance Completed 2 of 2 - NEAAR Backbone NEWY32AOA-LOND



Source Of Impact:Vendor



Affected:Backbone NEWY32AOA-LOND



Start Time:Thursday, May 18, 2017, 1:47 AM (0147) UTC



End Time:Thursday, May 18, 2017, 1:59 AM (0159) UTC


Description:   The above Backbone was unavailable while AquaComms performed fiber 
maintenance. This maintenance has been completed.



  










Downtime and Availability







NEAAR Core NodesDown TimeReporting Period Availability52 Week Availability


rtr.newy32aoa.neaar.net0 hr 0 min100.00000%100.00000%
      
Aggregate NEAAR Core Nodes0 hr 0 min100.00000%100.00000%

	    

	    
NEAAR Backbone CircuitsDown TimeReporting Period Availability52 Week Availability


NEAAR-NEWY32AOA-LOND-100GE-01500309 hr 12 min85.99638%96.47996%
NEAAR-NEWY32AOA-NEWY32AOA-100GE-01501251 hr 7 min88.62696%97.14120%
      
Aggregate All NEAAR Backbone Circuits560 hr 19 min87.31167%96.81058%



Upcoming Scheduled Maintenances





Ticket No.:74:166



Subject:Maintenance - NEAAR Backbone NEWY32AOA-LOND



Affected:Backbone NEWY32AOA-LOND



Start Time:Sunday, June 18, 2017, 10:00 PM (2200) UTC



End Time:Monday, June 19, 2017, 5:00 AM (0500) UTC



Description:   The above Backbone will be unavailable while AquaComms performs
maintenance. An outage is expected and the entire window is reserved.