Agile Systems Engineering & Agile at SKA Scale

Download Agile Systems Engineering & Agile at SKA Scale

Post on 21-Jan-2018

30 views

Category:

Engineering

4 download

TRANSCRIPT

<ol><li> 1. Agile Software Engineering &amp; System Engineering at SKA scale Juande Santander-Vela SKA SW Systems Engineer SQUARE KILOMETRE ARRAY Exploring the Universewith the worlds largest radio telescope Astronomical Data Analysis Software &amp; Systems (on behalf of the SE team) </li><li> 2. SKA Key Science Drivers: The history of the Universe Cosmic Dawn(First Stars and Galaxies) Galaxy Evolution(Normal Galaxies z~2-3) Cosmology(Dark Energy, Large Scale Structure) Cosmic Magnetism(Origin, Evolution) Cradle of Life(Planets, Molecules, SETI) Testing General Relativity(Strong Regime, Gravitational Waves) Exploration of the Unknown Broadest range of science of any facility, worldwide </li><li> 3. SKA Observatory Vision Exploring the Universewith the worlds largest radio telescope 3 sites 2 telescopes 1 observatoryDesign Phase: ~ 200M; 600 scientists+engineers, 80% complete SKA Phase 1 (SKA1) Construction: 2019 2025Construction cost cap: 674.1M (2016inflation-adjusted)Operations cost: (estimate) 89M/yrMeerKAT integrated Observatory Development Programme (20M/year planned)SKA Regional centres out of scope of centrally-funded SKAO. SKA Phase 2: start mid-2020s ~2000 dishes across 3500km of Southern AfricaMajor expansion of SKA1-Low across Western Australia &gt;50 years lifetime! Drives need for reliability, and adaptability </li><li> 4. SKA Observatory Vision Exploring the Universewith the worlds largest radio telescope 3 sites 2 telescopes 1 observatoryDesign Phase: ~ 200M; 600 scientists+engineers, 80% complete SKA Phase 1 (SKA1) Construction: 2019 2025Construction cost cap: 674.1M (2016inflation-adjusted)Operations cost: (estimate) 89M/yrMeerKAT integrated Observatory Development Programme (20M/year planned)SKA Regional centres out of scope of centrally-funded SKAO. SKA Phase 2: start mid-2020s ~2000 dishes across 3500km of Southern AfricaMajor expansion of SKA1-Low across Western Australia &gt;50 years lifetime! Drives need for reliability, and adaptability </li><li> 5. SKA Organisation Exploring the Universewith the worlds largest radio telescope !Australia (DoI&amp;S)"Canada (NRC-HIA)#China (MOST)$India (DAE)%Italy (INAF)&amp; Netherlands (NWO)' New Zealand (MED)(South Africa (DST))Sweden (Chalmers)*UK (BEIS/STFC) In discussion with:+Germany,France-Portugal.Spain/Switzerland0Japan1South KoreaIn the process of becoming an Inter- Governmental Organisation </li><li> 6. SKA1 Design Consortia Exploring the Universewith the worlds largest radio telescope </li><li> 7. SKA1 Design Consortia Exploring the Universewith the worlds largest radio telescope Software Heavy Elements </li><li> 8. Have ~6-10FTE wrt SKAO SKA1 Design Consortia Exploring the Universewith the worlds largest radio telescope </li><li> 9. 1000 kmMap data 2017 Terms of Use Filter Consortia Assembly, Integration &amp; Verication Central Signal Processor Dish Infrastructure Australia Infrastructure South Africa Low-Frequency Aperture Array Mid-Frequency Aperture Array Science Data Processor Signal and Data Transport Telescope Manager Wideband Single Pixel Feeds Check/uncheck all GMT-7 GMT+12 Exploring the Universewith the worlds largest radio telescope 19 hour timezone span </li><li> 10. SKA1-Lowlocations 1600km N NDataSIO,NOAA,U.S.Navy,NGA,GEBCODataSIO,NOAA,U.S.Navy,NGA,GEBCO ImageLandsat/CopernicusImageLandsat/Copernicus SKA1-Midlocations 500km N NImageLandsat/CopernicusImageLandsat/Copernicus DataSIO,NOAA,U.S.Navy,NGA,GEBCODataSIO,NOAA,U.S.Navy,NGA,GEBCO SKA1 Sites Exploring the Universewith the worlds largest radio telescope SKA1-LOW: 50 350 MHz Phase 1: ~130,000 antennas across 65km SKA1-Mid: 350 MHz 24 GHz Phase 1: 200 15-m dishesacross150 km </li><li> 11. SKA1 Telescopes Exploring the Universewith the worlds largest radio telescope SKA1-LOW: 50 350 MHz Phase 1: ~130,000 antennas across 65km SKA1-Mid: 350 MHz 24 GHz Phase 1: 200 15-m dishesacross150 km </li><li> 12. SKA1 Notional Data Flow Exploring the Universewith the worlds largest radio telescope 2 Pb/s 7.2 Tb/s 7.2 Tb/s 8.8 Tb/s8.8 Tb/s ~50 PFLOPS ~5 Tb/s ~250 PFLOPS Long Term Storage 300 PB/year LFAA Data Network Digital Data Backhaul Digital Data Backhaul CSP-SDP Network </li><li> 13. SKA1 Notional Data Flow Exploring the Universewith the worlds largest radio telescope 2 Pb/s 7.2 Tb/s 7.2 Tb/s 8.8 Tb/s8.8 Tb/s ~50 PFLOPS ~5 Tb/s ~250 PFLOPS Long Term Storage 300 PB/year LFAA Data Network Digital Data Backhaul Digital Data Backhaul CSP-SDP Network </li><li> 14. SKA1 Notional Data Flow Exploring the Universewith the worlds largest radio telescope 2 Pb/s 7.2 Tb/s 7.2 Tb/s 8.8 Tb/s8.8 Tb/s ~50 PFLOPS ~5 Tb/s ~250 PFLOPS Long Term Storage 300 PB/year LFAA Data Network Digital Data Backhaul Digital Data Backhaul CSP-SDP Network </li><li> 15. SKA1 Notional Data Flow Exploring the Universewith the worlds largest radio telescope 2 Pb/s 7.2 Tb/s 7.2 Tb/s 8.8 Tb/s8.8 Tb/s ~50 PFLOPS ~5 Tb/s ~250 PFLOPS Long Term Storage 300 PB/year LFAA Data Network Digital Data Backhaul Digital Data Backhaul CSP-SDP Network Similar to LOFAR in exibility. See O4.2 by Adriaan Renting </li><li> 16. How to develop so muchsoftware? Exploring the Universewith the worlds largest radio telescope </li><li> 17. Agile Exploring the Universewith the worlds largest radio telescope </li><li> 18. Agile, ScaledAgile Exploring the Universewith the worlds largest radio telescope (Framework) </li><li> 19. SAFe for Lean Enterprises Large Solution SAFe Exploring the Universewith the worlds largest radio telescope Agile Teams, 5-7 people (including Scrum Master), 2 peopleAgile Release Trains (ARTs) inDenition https://scaledagileframework.com/ </li><li> 20. Agile Manifesto Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan Exploring the Universewith the worlds largest radio telescope http://agilemanifesto.org </li><li> 21. The emphasis is on Quality Exploring the Universewith the worlds largest radio telescope Nick Rees talk I10.1 (Thursday26th, 9:00 AM) </li><li> 22. What about SystemsEngineering? Exploring the Universewith the worlds largest radio telescope </li><li> 23. INCOSE, 2004 Systems engineering [SE] is an interdisciplinary approach and means to enable the realisation of successful systems [] [SE] integrates all the disciplines and specialty groups into a team effort forming a structured development process [] from concept to production to operation. [SE] considers both the business and the technical needs of all customers with the goal of providing a quality product that meets the user needs. Exploring the Universewith the worlds largest radio telescope </li><li> 24. INCOSE, 2004 Systems engineering [SE] is an interdisciplinary approach and means to enable the realisation of successful systems [] [SE] integrates all the disciplines and specialty groups into a team effort forming a structured development process [] from concept to production to operation. [SE] considers both the business and the technical needs of all customers with the goal of providing a quality product that meets the user needs. Exploring the Universewith the worlds largest radio telescope </li><li> 25. INCOSE, 2004 Systems engineering [SE] is an interdisciplinary approach and means to enable the realisation of successful systems [] [SE] integrates all the disciplines and specialty groups into a team effort forming a structured development process [] from concept to production to operation. [SE] considers both the business and the technical needs of all customers with the goal of providing a quality product that meets the user needs. Exploring the Universewith the worlds largest radio telescope </li><li> 26. INCOSE, 2004 Systems engineering [SE] is an interdisciplinary approach and means to enable the realisation of successful systems [] [SE] integrates all the disciplines and specialty groups into a team effort forming a structured development process [] from concept to production to operation. [SE] considers both the business and the technical needs of all customers with the goal of providing a quality product that meets the user needs. Exploring the Universewith the worlds largest radio telescope </li><li> 27. INCOSE, 2004 Systems engineering [SE] is an interdisciplinary approach and means to enable the realisation of successful systems [] [SE] integrates all the disciplines and specialty groups into a team effort forming a structured development process [] from concept to production to operation. [SE] considers both the business and the technical needs of all customers with the goal of providing a quality product that meets the user needs. Exploring the Universewith the worlds largest radio telescope </li><li> 28. David Long, CEO Vitech Corp The role of Systems Engineers is to encode and translate engineering to all stakeholders. Exploring the Universewith the worlds largest radio telescope </li><li> 29. Nick Rees, SKAO Head of Computing Systems Engineers capture and remind us ofall the bullshit stakeholders say about thesystem. Exploring the Universewith the worlds largest radio telescope </li><li> 30. Exploring the Universewith the worlds largest radio telescope </li><li> 31. Exploring the Universewith the worlds largest radio telescope </li><li> 32. Exploring the Universewith the worlds largest radio telescope </li><li> 33. Juande Santander-Vela, SKAO Software SE Systems Engineers have to provide useful engineering artefacts to stakeholders, notice still missing denition, and supply it ASAP Exploring the Universewith the worlds largest radio telescope Freshly coined for #ADASS2017CL! </li><li> 34. Juande Santander-Vela, SKAO Software SE Systems Engineers have to provide useful engineering artefacts to stakeholders, notice still missing denition, and supply it ASAP Exploring the Universewith the worlds largest radio telescope Or assess and record the risk of not doing it Freshly coined for #ADASS2017CL! </li><li> 35. INCOSE, 2004 Systems engineering [SE] is an interdisciplinary approach and means to enable the realisation of successful systems [] [SE] integrates all the disciplines and specialty groups into a team effort forming a structured development process [] from concept to production to operation. [SE] considers both the business and the technical needs of all customers with the goal of providing a quality product that meets the user needs. Exploring the Universewith the worlds largest radio telescope With an assessment of what are the risks against quality and user needs </li><li> 36. SE must be Agile, or it provides diminished value Exploring the Universewith the worlds largest radio telescope </li><li> 37. Agile Manifesto Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan Exploring the Universewith the worlds largest radio telescope http://agilemanifesto.org </li><li> 38. Agile SE Keep communication with all stakeholders involved in the project, with speedy and clear dissemination of agreements Continuous integration of the engineering artefacts and code, preferably self-documented Get devs (and SEs) that are invested, not just contractedGainshareframeworks Have systems &amp; processes that accommodate system (and code) change and prove requirements are satised dont do document- centric requirements management Exploring the Universewith the worlds largest radio telescope </li><li> 39. Agile SE Keep communication with all stakeholders involved in the project, with speedy and clear dissemination of agreements Continuous integration of the engineering artefacts and code, preferably self-documented Get devs (and SEs) that are invested, not just contractedGainshareframeworks Have systems &amp; processes that accommodate system (and code) change and prove requirements are satised dont do document- centric requirements management Exploring the Universewith the worlds largest radio telescope At all phases! Including design, construction, commissioning, and operations Dont disband SE! </li><li> 40. Agile SE Keep communication with all stakeholders involved in the project, with speedy and clear dissemination of agreements Continuous integration of the engineering artefacts and code, preferably self-documented Get devs (and SEs) that are invested, not just contractedGainshareframeworks Have systems &amp; processes that accommodate system (and code) change and prove requirements are satised dont do document- centric requirements management Exploring the Universewith the worlds largest radio telescope At all phases! Including design, construction, commissioning, and operations Dont disband SE! </li><li> 41. Agile SE Keep communication with all stakeholders involved in the project, with speedy and clear dissemination of agreements Continuous integration of the engineering artefacts and code, preferably self-documented Get devs (and SEs) that are invested, not just contractedGainshareframeworks Have systems &amp; processes that accommodate system (and code) change and prove requirements are satised dont do document- centric requirements management Exploring the Universewith the worlds largest radio telescope At all phases! Including design, construction, commissioning, and operations Dont disband SE! </li><li> 42. Agile SE Keep communication with all stakeholders involved in the project, with speedy and clear dissemination of agreements Continuous integration of the engineering artefacts and code, preferably self-documented Get devs (and SEs) that are invested, not just contractedGainshareframeworks Have systems &amp; processes that accommodate system (and code) change and prove requirements are satised dont do document- centric requirements management Exploring the Universewith the worlds largest radio telescope Partners, not contractors/suppliers mentioned by JCGuzmanonI2.1 At all phases! Including design, construction, commissioning, and operations Dont disband SE! </li><li> 43. Agile SE Keep communication with all stakeholders involved in the project, with speedy and clear dissemination of agreements Continuous integration of the engineering artefacts and code, preferably self-documented Get devs (and SEs) that are invested, not just contractedGainshareframeworks Have systems &amp; processes that accommodate system (and code) change and prove requirements are satised dont do document- centric requirements management Exploring the Universewith the worlds largest radio telescope Partners, not contractors/suppliers mentioned by JCGuzmanonI2.1 At all phases! Including design, construction, commissioning, and operations Dont disband SE! </li><li> 44. Agile-ish Practices at SKAO SE planning We have a full plan, from which the backlog is constructed Progress reviewed every 2 weeks, with forward look to another 2 weeks Systems Modelling Integrated System Model for SKA1_Common and SKA1_Low in Cameo SysML Second model for SKA1_Mid in Vitech CORE Used for ICDs, discussions SKA1_Mid and SKA1_Low Block Diagrams Used for reference, updated in agile way, but low priority Exploring the Universewith the worlds largest radio tele...</li></ol>