[atlas] Feature request: Regularly Publish Names

Title: Regularly Publish Names

Description:

Regularly collect all IP addresses referenced in measurement definitions and all results.
Reverse resolve the addresses in the DNS.
Collect netnames for the addresses from the RIR registration data.
Possibly collect other data such as geo-location and ASes announcing.
Publish this collected data both in bulk and thru the API indexed by IP.

A frequency of once every 24 hours would be sufficient to stat with.


Use:

When analysing measurements from the past it is important to have meta information that was current at the time of the measurement. Having this data collected in advance often also allows for more efficient analysis and more responsive tools.

Perceived complexity:

Low. Use hadoop to collect the list of IPs. Then run a low priority job to collect the meta data. The job also has high potential for parallelism.

Perceived cost:

Low. Just some cycles and storage on the back end.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 163 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: </ripe/mail/archives/ripe-atlas/attachments/20131112/7e788995/attachment.sig>