Blair Bethwaite.pdf (9.58 MB)
Download file

NeSI's Flexible HPC - A programmable infrastructure for science data collaboration

Download (9.58 MB)
presentation
posted on 03.03.2022, 03:50 authored by eRNZ AdmineRNZ Admin, Blair BethwaiteBlair Bethwaite, Sean MathenySean Matheny, Richard Tumaliuan

Through 2021, NeSI has procured and integrated a new high-performance private cloud platform we are calling FlexiHPC. This presentation will cover some of the motivations and early use-cases for the new infrastructure, alongside a helicopter view of the core technology components, key partnerships and integrations (such as direct REANNZ connectivity). This platform will deliver base Infrastructure-as-a-Service (compute, storage, and network, among others) in a multi-tenanted design leveraging the OpenStack private cloud framework. Some elements of the FlexiHPC platform have been designed specifically to accommodate high-performance workloads whilst maximising opportunities for shared investment and benefit at scale.

The FlexiHPC platform is being designed to support multiple models of consumption and integration, including contemporary on-demand access to shared services alongside dedicated hardware tenancies with deep local integration. A significant example of this is AgResearch’s new eResearch Infrastructure, which is being integrated within the FlexiHPC architecture (we plan to talk specifically about the AgResearch Infrastructure in another session).

It is envisaged that NeSI’s FlexiHPC will provide the sector with a programmable platform for collaboration around science data and support a scalable approach to mid-tier HPC with national expertise complementing localised integration.

ABOUT THE AUTHORS

Blair Bethwaite
Blair is Solutions Manager at New Zealand eScience Infrastructure (NeSI). He has worked in distributed computing for over a decade; both in research and for research; for institutional and national projects; from applications, through grid & cloud middleware, to full HPC & cloud systems design, implementation, and operations. Previously over the ditch at Monash University, Blair most recently led Monash’s use of OpenStack to underpin research computing. Originally from Christchurch, in mid-2018 Blair returned to take up the opportunity of becoming NeSI's Solutions Manager, focusing back up the technology stack closer to the user. Blair's role within NeSI covers Application Support and Collaboration & Integration.

Sean Matheny

Sean is a Systems Engineer at New Zealand eScience Infrastructure (NeSI). Prior to joining NeSI, he worked with the Centre for eResearch at the University of Auckland. Sean helped researchers with various computational needs, and helped to set up the Auckland Node of the OpenStack-based NeCTAR Research Cloud. Sean is an advocate for open source and open infrastructure solutions, and he loves staying on the cutting-edge of new developments.

Richard Tumaliuan
Richard joined REANNZ from Singapore where he operated networks for over a decade. Most recently he worked for Rio Tinto where he was a part of the team responsible for managing the organisation's global network infrastructure. Previously Richard worked in HP Enterprise services supporting government projects; at Singapore Technologies delivering IP transit; and at Fujitsu operating their regional WAN.


History