OVHcloud Network Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
FS#4871 — Roubaix2 room 26
Incident Report for Network & Infrastructure
Resolved
We had an electric problem in this room. Much info are to come.

Update(s):

Date: 2010-11-24 15:02:15 UTC
The manufacturer indicates that the circuit breaker was broken again
and that it must be replaced. It is ongoing his morning. The same type of
circuit breaker is installed on every other UPS.

We think of a means to find out the origin of the problem.

Date: 2010-11-23 15:25:01 UTC
15h00

It's the end
6 ns
9 ks
4 rps

15h45
completed

Date: 2010-11-23 15:24:33 UTC
46 ns
26 ks
28 rps

Date: 2010-11-23 13:14:54 UTC
68 ns
35 ks
40 rps


Date: 2010-11-23 13:14:45 UTC
Still
95 ns
42 ks
40 rps

Date: 2010-11-23 13:14:28 UTC
We have already had 2 cuts on this room.
At first, it was due to a a problem on the circuit breaker of a battery,
which came off during the tests of the generators. We
have changed it and we decided to carry out maintenance tasks
in order to put 2 sets of batteries on each UPS with 2 circuit breakers.
The maintenance tasks were almost finalised, there is still
only ... the UPS which has just came off.
Bad management of maintenance tasks. We should have started with this
UPS and not end up with it.

The second cut was due to the tests of the generators with
multiple switches because of a need to an ecological tests for the
DREAL. The UPS retuned bad information on the status of
the battery, indicating that it remains only 80% although the batteries were
apparently empty. The UPS broke down therefore during the switch
of energy source

http://status.ovh.net/?do=details&id=609
http://travaux.ovh.net/?do=details&id=3819

Today, we have scheduled the maintenance tasks with EDF in order to introduce
the double power supply of RBX-2/RBX-4 starting from a new source. A
cut of seconds was expected. This cut at the level of 20000V is
taken by the UPS which has a stock of energy on the batteries and
can generate the current during 15 minutes. We have still a 3rd
cut on the room 26 due also to a circuit breaker of battery which has again
came off. 2 things: the maintenance tasks which are still ongoing to put the
2 circuit breakers in parallel with 2 sets of of batteries. Yet, this problem
is abnormal. The first time the manufacturer, Eaton, has diagnosed
circuit breaker crash and therefore we replaced it. So, why does the circuit
breaker came off if it is new? We have to find out the origin of the
problem.

We are reputting the servers back working.
Posted Nov 23, 2010 - 12:29 UTC