The Pacific Research Platform Two Years In

Download The Pacific Research Platform Two Years In

Post on 12-Apr-2017



Data & Analytics

1 download


Exchange Points (101?)The Pacific Research PlatformTwo Years In Welcome and Overview Talk to the Pacific Research Platform PRPv2 Workshop 2017University of California, San DiegoFebruary 21, 2017Dr. Larry SmarrDirector, California Institute for Telecommunications and Information TechnologyHarry E. Gruber Professor, Dept. of Computer Science and EngineeringJacobs School of Engineering, UCSDhttp://lsmarr.calit2.net11DOE ESnets Science DMZ: A Scalable Network Design Model for Optimizing Science Data TransfersA Science DMZ integrates 4 key concepts into a unified whole:A network architecture designed for high-performance applications, with the science network distinct from the general-purpose networkThe use of dedicated systems as data transfer nodes (DTNs)Performance measurement and network testing systems that are regularly used to characterize and troubleshoot the networkSecurity policies and enforcement mechanisms that are tailored for high performance science environments DMZCoined 2010The DOE ESnet Science DMZ and the NSF Campus Bridging Taskforce Report Formed the Basis for the NSF Campus Cyberinfrastructure Network Infrastructure and Engineering (CC-NIE) Program2FIONAs and FIONettes Flash I/O Network Appliances Are DTNs:Linux PCs Optimized for DMZs over DistanceFIONAs Are Science DMZ Data Transfer Nodes (DTNs) &Also Compute/Visualization/ML NodesPhil Papadopoulos & Tom DeFantiJoe Keefe & John GrahamFIONAS40G, $8,000FIONette1G, $1,0003The Pacific Research Platforms Second Year:a Working End-to-End Science-Driven DMZ-ConnectorFIONAs as Uniform DTN End PointsNSF CC*DNI Grant$5M 10/2015-10/2020PI: Larry Smarr, UC San Diego Calit2Co-Pis: Camille Crittenden, UC Berkeley CITRIS, Tom DeFanti, UC San Diego Calit2, Philip Papadopoulos, UCSD SDSC, Frank Wuerthwein, UCSD Physics and SDSCPRP Continues to Expand Rapidly While Increasing Connectivity:One Year of Progress 12 Sites to 20 SitesJanuary 29, 2016 December 15, 2016 Connected 20 DMZs at 10G and 40G, demonstrating disk-to-disk GridFTP at ~7.5G and 12.5G respectively, and 900Mb at 1G Many PRP Science Engagement Workshops Were Held in 2016PRP Workshop Held in Collaboration with UC-Wide Research IT May 1, 201645 AttendeesTen UC CampusesSee Talk by Camille Crittenden and Tom DeFantiPRPs First 1.5 Years: Connecting Campus Application Teams and Devices100 Gbps FIONA at UCSC Connects the UCSC Hyades Cluster to the NERSC Supercomputer at LBNL Supporting UCSC Remote Access to Large Data Subsets of the Dark Energy Spectroscopic Instrument (DESI) and AGORA Galaxy Simulation DataProduced at NERSC.250 images per night 800GB per nightSee Talk by Shawfeng DongUCSC Feb 7, 201740G FIONAs20x40G PRP-connectedWAVE@UC San DiegoPRP Will Enable Distributed Virtual RealityPRPMerWAVE @UC MercedSee Talk by Jeff WeekleyPRP Will Link the Laboratories of the Pacific Earthquake Engineering Research Center Second FIONette was Deployed at the PEER Facility at UC Berkeley, and its Performance is Being MonitoredJohn Graham Installing FIONette at PEER Feb 10, 2017SIO Researchers Beginning to UseBig Data Networks (Prism, IDI, PRP)Jules Jaffe - Microscope Off Scripps PierFrank Vernon - Expansion of HPWRENDan Cayan, Mike Dettinger Regional Downscaling of Climate ModelsScott Sellars, Marty RalphCenter for Western Weather and Water ExtremesPRP Backbone Sets Stage for 2017 Expansion of HPWREN, Connected to CENIC, into Orange and Riverside CountiesPRP CENIC 100G Link UCSD to SDSUDTN FIONAs EndpointsData Redundancy Disaster Recovery High Availability Network RedundancyAnchor to CENIC at UCIPRP FIONA Connects toCalREN-HPR NetworkData Replication SitePotential Future UCR CENIC AnchorUCRUCIUCSDSDSUSource: Frank Vernon, Greg Hidley, UCSDPacificCityNeptune Canada45N4730N130W12730WNSeattleGigaPOPPortlandPossible PRP 2017 Expansion to Include NSFs Ocean Observatory Initiative Fiber Optic SensorNets on Seafloor Off WashingtonTo PRP viaPacific WaveSea BottomElectro-optical Cable:8,000 Volts10 Gbps OpticsSlide Courtesy, John Delaney, UWashJohn Delaney Visiting UCSDs SIO For Three Months in 2017Axial Volcano140 Scientific InstrumentsBeing There - Remote Live High Definition Videoof Deep Sea Hydrothermal Vents Hydrothermal Vent on Axial Seamount1 Mile Below Sea LevelPicture Created From 40 HD Frames14 Minutes Live HD VideoOn-Line Every 3 Hours15 feetSlide Courtesy, John Delaney, UWashThe Future of Supercomputing Will Blend Traditional HPC and Data Analytics Integrating Non-von Neumann ArchitecturesHigh Performance Computing Will Evolve Towards a Hybrid Model, Integrating Emerging Non-von Neumann Architectures, with Huge Potential in Pattern Recognition, Streaming Data Analysis, and Unpredictable New Applications.Horst Simon, Deputy Director, U.S. Department of EnergysLawrence Berkeley National LaboratoryCalit2s Qualcomm Institute Has Established a Pattern Recognition Lab For Machine Learning on non-von Neumann Processors Source: Dr. Dharmendra ModhaFounding Director, IBM Cognitive Computing GroupAugust 8, 2014UCSD ECE Professor Ken Kreutz-Delgado Brings the IBM TrueNorth Chip to Start Calit2s Qualcomm Institute Pattern Recognition LaboratorySeptember 16, 2015New Brain-Inspired Non-von Neumann Processors Are Emerging:KnuEdge Has Provided Processor to Calit2s, and Calit2 have worked together since the early days of the KnuEdge LambdaFabric processor, when key personnel and technology from UC San Diego provided the genesis for the first processor 6, 2016Proposed Cognitive Hardware and Software EcosystemOn the Pacific Research PlatformWorking With 30 CSE Machine Learning ResearchersGoal is 320 Game GPUs in 32-40 FIONAs at 10 PRP CampusesPRP Couples FIONAs with GPUs into a Condor-Managed CloudPRP Access to Emerging ProcessorsIBM TrueNorth, KnuEdge, FPGA, and Qualcomm SnapdragonSoftware Including a Wide Range of Open ML Algorithms Metrics for Performance of Processors and AlgorithmsSource: Tom DeFanti, Calit2Multiple Proposals Under ReviewFIONA with 8-Game GPUsExpanding to National Research Platform and Global Research PlatformVia CENIC/Pacific Wave, Internet2, and International LinksPRPs Current InternationalPartnersPRP TimelinePRPv1A Routed Layer 3 Architecture Tested, Measured, Optimized, With Multi-Domain Science DataBring Many Of Our Science Teams Up Each Community Thus Will Have Its Own Certificate-Based Access To its Specific Federated Data InfrastructurePRPv2Incorporating SDN/SDX, AutoGOLE / NSIAdvanced IPv6-Only Version with Robust Security Features e.g. Trusted Platform Module Hardware and SDN/SDX SoftwareSupport Rates up to 100Gb/s in Bursts and StreamsDevelop Means to Operate a Shared Federation of CachesCooperating Research GroupsOur Support: US National Science Foundation (NSF) awards CNS 0821155 and CNS-1338192, CNS-1456638, ACI-1540112, and ACI-1541349University of California Office of the President CIOUCSD Chancellors Integrated Digital Infrastructure Program UCSD Next Generation Networking initiativeCalit2 and Calit2 Qualcomm InstituteCENIC, PacificWave and StarLightDOE ESnet22


View more >