[atlas] Atlas infrastructure issues on Friday, 2012-06-29

Dear Atlas users,

As part of regular maintenance, last Thursday (2012-06-28) afternoon we
upgraded the OS on a subset of our controlling infrastructure. During this
work, some Atlas probes were told to hold back result reporting. A
consequence of this was that when reconnecting, these probes sent in way
more (and bigger) results than usual. Unfortunately, not all of the upgraded
components ("controllers") had enough disk space to deal with the sudden
increased data inflow.

The combination of these events means that part of our infrastructure could
not buffer results submitted from the probes, and as a result these results
have been discarded. The event lasted approximately between 22h Thursday and
05h Friday (UTC), and affected about 30% of the probes. These probes will
have a gap in their downloadable data sets and on their graphs.

Since the event we increased the capacity of the involved infrastructure
components. This will help us avoiding the same event occurring again.

We apologise for the inconvenience this may cause.

Regards,
Robert Kisteleki
RIPE NCC R&D