<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style></style></head><body lang=ES link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span lang=EN-US style='font-size:12.0pt;mso-fareast-language:EN-US'>Hi Thiago,<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:12.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:12.0pt;mso-fareast-language:EN-US'>The question here, I think, is to understand how much in euros is “a lot”?<o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:12.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><div><p class=MsoNormal><span lang=EN-US style='font-size:12.0pt;color:black'>Regards,<o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:12.0pt'><span lang=EN-US style='font-size:12.0pt;color:black;mso-fareast-language:EN-US'>Jordi<o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:12.0pt'><span lang=EN-US style='font-size:12.0pt;color:black;mso-fareast-language:EN-US'>@jordipalet<o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:12.0pt'><span lang=EN-US style='font-size:12.0pt;color:black;mso-fareast-language:EN-US'><o:p> </o:p></span></p></div><p class=MsoNormal><span lang=EN-US style='font-size:12.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-size:12.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><div><div><p class=MsoNormal style='margin-left:35.4pt'>El 2/3/20 11:11, "routing-wg en nombre de Thiago da Cruz" <<a href="mailto:routing-wg-bounces@ripe.net">routing-wg-bounces@ripe.net</a> en nombre de <a href="mailto:tdacruz@ripe.net">tdacruz@ripe.net</a>> escribió:<o:p></o:p></p></div></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>Hi all,</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>Many of you might not know me, but I’m part of RIPE’s software engineering team that takes care of RPKI.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>I’ve been following this discussion closely and I've noticed some lack of clarity about our decision to duplicate our RPKI infrastructure.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>So I think it’s important for us to tell a few things about our approach. </span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>First what we have today in production:</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>- TA software (offline box)</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>- HSM for the TA (plus backups and spare parts)</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>- A few application servers running our RPKI software - I’ll call it RPKI-Core</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>- Redundant HSMs used by RPKI-Core</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>- RRDP publication service (cloud)</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>- Some rsync nodes (internal infra)</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>Something like the diagram below.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>For testing environment we have practically the same infra. </span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>And for public test (localcert) we use ‘soft' keys and no HSMs.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>About the new AS0 TA, yes, we could simplify our infra.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>One option would be to use ‘soft’ keys all around or use a HSM for TA only.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>We could also use third-party software for TA, Core and publication service.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>It crossed my mind, for a fraction of a second, to skip AS0 TA instances for our internal and/or public test environments.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>But I don’t think we should treat it as a "second class citizen". </span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>If we provide another TA, it’s worthy of receiving as much TLC as our production TA; meaning that it would also require the same (or similar) process around it as our production TA does. That includes keeping track of HSM card holders, defining a proper admin and operator quorum, scheduling periodical resigning sessions, etc…</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>I’m not here to advocate against nor in favour of AS0 TA. </span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>But when discussing our implementation, this was our rationale to duplicate the infrastructure. </span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>And that’s why it would cost us a lot to implement it. </span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>Let me know you need more info about this subject.</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>Kind regards, <o:p></o:p></span></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>Thiago da Cruz <o:p></o:p></span></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>Sr. software engineer - RPKI Team<o:p></o:p></span></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>RIPE NCC<o:p></o:p></span></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'><o:p> </o:p></span></p></div></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> +---------------------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | +-------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | TA (offline) +------------+ HSM |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | +-------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> +---------------------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> +------------------------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> +-----------> | RRDP publication |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | (cloud) |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> +-------------------+ +-------------------+ | +------------------------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | | | Publication |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | RPKI-Core 1 | (...) | RPKI-Core n | ----------------------> * +></span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | | | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> +--+-----+----+-----+ +--+------+-------+-+ | +----------------------------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | | | | | | | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | +---------------+ | | | | | Rsync publication |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | | | | +----+ +-----------> | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> +-----+ +-----------+ +---------+ | | | (internal infra - x nodes) |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | | | | | | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | | +-------------------+ | | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | +-----------------------------------------+ | | +----------------------------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'> | | | | | |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>+-+----+--+ + + +-+------++</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>| HSM 1 | (......................) | HSM m |</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><span style='font-family:Monaco'>+---------+ +---------+</span><o:p></o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div><div><p class=MsoNormal style='margin-left:35.4pt'><br><br><o:p></o:p></p><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><div><p class=MsoNormal style='margin-left:35.4pt'>On 27 Feb 2020, at 23:51, George Michaelson <<a href="mailto:ggm@algebras.org">ggm@algebras.org</a>> wrote:<o:p></o:p></p></div><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p><div><div><p class=MsoNormal style='margin-left:35.4pt'>Anton pointed out I may have both misunderstood and not answered your question.<br><br>The testbed is a soft TA. In deployment, people will have to move to a<br>new (as yet not created) TAL for AS0, as long as it runs independently<br>of the mainline TAL.<br><br>We intend running a distinct TA for AS0 until we get a clear signal<br>our community wants it integrated. We have stated concerns about the<br>automatic adoption of ASO products worldwide without visible agreement<br>of this activity, a separate TAL turns the activity from opt-out to<br>opt-in.<br><br>We are duplicating the software signing infrastructure, but with lower<br>costs overall given commonalities.<br><br>We are still discussing if we can run the offline-TA HSM and the<br>online production key HSM for both activities, or if we need a<br>distinct infrastructure for AS0 and mainline. Duplication overall is<br>not in APNIC's model, we rely on spares and alternate use of the HSM,<br>but production signing systems are single instances. I believe they<br>are capable of some virtualisation or segmentation but that skirts the<br>underlying physical risk/dependency.<br><br>Sorry for not being clearer before<br><br>-George<br><br>On Wed, Feb 26, 2020 at 6:18 PM Carlos Friaças via routing-wg<br><<a href="mailto:routing-wg@ripe.net">routing-wg@ripe.net</a>> wrote:<br><br><o:p></o:p></p><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><p class=MsoNormal style='margin-left:35.4pt'><br><br>Hi,<br><br>Any clue if APNIC has duplicated the infrastructure (and cost) as it is<br>foreseen in the NCC's impact analysis...?<br><br>Carlos<br><br><br><br>On Wed, 26 Feb 2020, JORDI PALET MARTINEZ via routing-wg wrote:<br><br><br><o:p></o:p></p><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><p class=MsoNormal style='margin-left:35.4pt'>Hi Max,<br><br>I think is too early to take a decision, and in fact I don't think we are yet in case A.<br><br>Consensus is about justified objections. I can see also people in favor and I understand, as we usually do in any proposal discussion, that non-objection is consent.<br><br>The only justification that I can see is from Job about possible cost. However, I don't see figures about how much it cost to develop this AS0 + how much it cost the operators to use it (if they want) vs developing the SLURM + making sure it is secure as RPKI + how much ti cost the operators to use it.<br><br>And by the way, the AS0 is compatible with the SLURM, so opeartors can choose.<br><br>Regards,<br>Jordi<br>@jordipalet<br><br><br><br>El 25/2/20 20:30, "routing-wg en nombre de Massimiliano Stucchi" <<a href="mailto:routing-wg-bounces@ripe.net">routing-wg-bounces@ripe.net</a> en nombre de <a href="mailto:max@stucchi.ch">max@stucchi.ch</a>> escribió:<br><br><br> Hi everyone,<br><br> On 20/02/2020 15:39, Petrit Hasani wrote:<br><br><br><o:p></o:p></p><blockquote style='margin-top:5.0pt;margin-bottom:5.0pt'><p class=MsoNormal style='margin-left:35.4pt'>As per the RIPE Policy Development Process (PDP), the purpose of this four week Review Phase is to continue discussion of the proposal, taking the impact analysis into consideration, and to review the full draft RIPE Policy Document.<br><br>At the end of the Review Phase, the Working Group (WG) Chairs will determine whether the WG has reached rough consensus. It is therefore important to provide your opinion, even if it is simply a restatement of your input from the previous phase.<o:p></o:p></p></blockquote><p class=MsoNormal style='mso-margin-top-alt:0cm;margin-right:0cm;margin-bottom:12.0pt;margin-left:35.4pt'><br> Today, me and the other proposers of this policy change had a meeting to<br> discuss the feedback we have been receiving on the list.<br><br> We understand that many people find this proposal controversial, and<br> many have expressed themselves against it in the past days.<br><br> We would like to encourage discussion and provide us with a bit of<br> guidance on how the community would like to proceed. At present we have<br> identified three ways of progressing:<br><br> A) We can try to go ahead with this proposal, although it will be hard<br> to get consensus;<br><br> B) We can drop the proposal, and leave everything as is;<br><br> C) We can change the proposal to a different ask for RIPE NCC. The idea<br> could be to ask RIPE NCC to provide a SLURM file (similar to what APNIC<br> does), so that single users can decide if they want to feed it to their<br> validators.<br><br> From what we gathered in the discussions, I think B) could be the most<br> sought-after decision, but we would like to propose C) as the way<br> forward. It would give the possibility to those who want to implement<br> this solution to do it in a lightweight fashion. It would for sure be<br> much much cheaper to implement.<br><br> In any case, as Job already pointed out, I prepared a simple tool to<br> generate a SLURM file using either the Team Cymru bogons list, or<br> considering any unassigned space from the NRO delegated stats file.<br> RIPE NCC has kindly provided help and patches to improve it. If you<br> want to give it a go, you can find it here:<br><br> <a href="https://github.com/stucchimax/rpki-as0-bogons">https://github.com/stucchimax/rpki-as0-bogons</a><br><br> Thank you for any suggestion or any discussion around this.<br><br> Ciao!<br> --<br> Massimiliano Stucchi<br> MS16801-RIPE<br> Twitter/Telegram: @stucchimax<br><br><br><br><br><br>**********************************************<br>IPv4 is over<br>Are you ready for the new Internet ?<br><a href="http://www.theipv6company.com">http://www.theipv6company.com</a><br>The IPv6 Company<br><br>This electronic message contains information which may be privileged or confidential. The information is intended to be for the exclusive use of the individual(s) named above and further non-explicilty authorized disclosure, copying, distribution or use of the contents of this information, even if partially, including attached files, is strictly prohibited and will be considered a criminal offense. If you are not the intended recipient be aware that any disclosure, copying, distribution or use of the contents of this information, even if partially, including attached files, is strictly prohibited, will be considered a criminal offense, so you must reply to the original sender to inform about this communication and delete it.<br><br><br><br><br><o:p></o:p></p></blockquote></blockquote><p class=MsoNormal style='margin-left:35.4pt'><o:p> </o:p></p></div></div></blockquote></div><p class=MsoNormal style='margin-left:35.4pt'><br><br><o:p></o:p></p></div><br>**********************************************<br> IPv4 is over<br> Are you ready for the new Internet ?<br> http://www.theipv6company.com<br> The IPv6 Company<br> <br> This electronic message contains information which may be privileged or confidential. The information is intended to be for the exclusive use of the individual(s) named above and further non-explicilty authorized disclosure, copying, distribution or use of the contents of this information, even if partially, including attached files, is strictly prohibited and will be considered a criminal offense. If you are not the intended recipient be aware that any disclosure, copying, distribution or use of the contents of this information, even if partially, including attached files, is strictly prohibited, will be considered a criminal offense, so you must reply to the original sender to inform about this communication and delete it.<br> <br> </body></html>