1 grid computing barry wilkinson department of computer science university of north carolina at...

1

Grid Computing

Barry WilkinsonDepartment of Computer Science

University of North Carolina at Charlotte

2

Grid Computing

• Using geographically distributed and interconnected computers together for computing and for resource sharing.

3

“The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks

4

Need to harness computers

Original driving force behind grid computing the same as behind the early development of networks that became the Internet:

– Connecting computers at distributed sites for high performance computing.

5

Virtual Organization

Usually, grid computing involves teams working together on a common goal, sharing computing resources and possibly experimental equipment.

Geographically distributed grid computing team called a virtual organization.

The resources shared include software and experimental data. Crosses multiple administrative domains.

6

Resource sharing and collaborative computing

• Grid computing is about collaborating and resource sharing as much as it is about high performance computing.

• Can share much more than just computers:– Storage– Sensors for experiments at particular sites– Application Software– Databases– Network capacity, …

7

Applications

• Originally e-Science applications– Computational intensive

• Not necessarily one big problem but a problem that has to be solved repeatedly with different parameters.

– Data intensive.– Experimental collaborative projects

• Now also e-Business applications to improve business models and practices.

8

Interconnections and ProtocolsUsually grid computing employs the Internet to interconnect the computers.Standard Internet protocols are used.

Focus now on using standard Internet protocols and technology, i.e. HTTP, SOAP, web services, etc.

9

Web Services-Based Grid Computing

• Grid Computing now strongly based upon web services.

• Large number of newly proposed grid computing standards:– WS-Resource Framework (WSRF)– WS-Addressing– etc., etc. …. .

10

History

• Began in mid 1990’s with experiments using computers at geographically dispersed sites.

• Seminal experiment – “I-way” experiment at 1995 Supercomputing conference (SC’95), using 17 sites across the US running:– 60+ applications.– Existing networks (10 networks).

11

1995 2000 200519901985

Distributed computing

Remote Procedure calls (RPC)Concept of service registry

Beginnings of service oriented architecture

Object oriented approachesJava Remote Method Invocation (RMI)

CORBA (Common Request Broker Architecture)

Cluster computing

Software Techniques:

Computing platforms:

Parallel computers

Geographically distributed computers (Grid computing in the broadest sense)

Web services

SC’95 experiment

12

Computational Grid Applications

• Biomedical research

• Industrial research

• Engineering research

• Studies in Physics and Chemistry

NSF Network for Earthquake Engineering Simulation (NEES)

Transform our ability to carry out research vital to reducing vulnerability to catastrophic earthquakes

I. Foster

14

Earth System Grid I. Foster

15

Grid networks for collaborative grid computing projects

Grids have been set up at the local level, national level, and international level throughout the world, to promote grid computing

16

CiscoEPA

North Carolina’s Foundation for Grid: NCREN

4-7 MCNC-owned Clusters distributed throughout the stateLocations still under evaluation

Internet Internet 2

NLR

Internet Internet 2

NLR

InternetInternet

Existing: Blend of owned and leased fiber and circuits moving toward resilient rings powered by Cisco routers

Planned: Strong focus on owned and leased fiber, Lambda, and few circuits, in resilient rings powered by Cisco routers and Wave Division Multiplexers

Close to home:

From “Grid Computing in the Industry” by Wolfgang Gentzsch, presentation to Fall 2004 grid computing course. Full set of slides on course home page.

17

TeraGridFunded by NSF in 2002 to link 5 supercomputer sites

with 40 Gb/s links

18

National GridsMany countries have embraced grid computing and set-up grid computing infrastructure:

• UK e-Science grid• Grid-Ireland• NorduGrid• DutchGrid• POINIER grid (Poland)• ACI grid (France)• Japanese grid• etc, etc., …

19

UK e-Science Grid

20

Globus Project

• Open source software toolkit developed for grid computing.

• Roots in I-way experiment.• Work started in 1996. • Four versions developed to present time.• Reference implementations of grid computing

standards.• Defacto standard for grid computing.

21

• GSI (Grid Security Infrastructure)– Grid security.

• MDS (Monitoring and discovery Service)– Interface to system and service information.

• GRAM (Grid Resource Allocation Manager) – Remote job submission and control.

• GridFTP– Secure data transfer.

GlobusKey Components

22

Globus Toolkit: Recent History

• GT2 (2.4 released in 2002)– GRAM, MDS, GridFTP, GSI.

• GT3 (3.2 released mid-2004): redesign– OGSA (Open Grid Service Architecture)/OGSI (Open

Grid Services Infrastructure) based.– Introduced “Grid services” as an extension of web

services.– OGSI now abandoned.

• GT4 (released April 2005): major redesign– WSRF (Web service Resource Framework) based.– Grid standards merged with Web services.

23

Grid Computing Course• Instructors: Barry Wilkinson and Clayton Ferner• Several faculty and students significantly helped at

various sites – “virtual organization”• In Fall 2004, 43 students took course at 8 institutions

Fall 2004 Participating Sites

(Fall 2005)

24

Fall 2004 Guest Speakers• Professor Daniel A. Reed, Chancellor's Eminent Professor,

Vice Chancellor for IT and CIO, UNC-Chapel Hill:

– “Grid computing: 21st Century Challenges.” • Dr. Wolfgang Gentzsch, Managing Director, MCNC Grid

Computing and Networking Services:

– “Grid Computing in the Industry”• Chuck Kesler, Director, Grid Deployment and Data Center

Services, MCNC:

– “Security Policy, Legal, and Regulatory Challenges in Grid Computing Environments”

• Professor Ian Foster: Ian Foster, Argonne National Laboratory and University of Chicago:

– “The Grid: Beyond the Hype”Taped presentation (originally given at Duke University, Sept. 14, 2004).

25

Fall 2005 Grid Computing Course

Currently being taught with 12 institutions participating.

About 40 students.

26

Course virtual organizationCurrent list of sites receiving course:

• Appalachian State University• Elon University• Lenoir Rhyne College • NC State University• University of North Carolina at Asheville• University of North Carolina at Charlotte• University of North Carolina, Chapel Hill (grad student, not for credit)

• University of North Carolina at Pembroke• University of North Carolina at Wilmington• Wake Technical Community College (Faculty in attendance)

• Western Carolina University• Winston-Salem State University

27

Fall 2005 Guest speakers

• Lavanya Ramakrishnan, The Renaissance Computing Institute (RENCI), University of North Carolina at Chapel Hill, North Carolina State University, and Duke University.

• Team from SURAGrid, a working grid with more than 19 institutions across the country. Details of presentation being worked out.

28

Fall 2005 Course grid structurewith Certificate Authorities

WCU

UNC-C

UNC-A

NCSU

ASU

MCNC

CA

CA

CA

CACA

CA

29

Users certified by a local CA

UNC-C

CA

30

CA’s with Mutual Trust

UNC-C

CA

NCSU

CA

31

More information on course

Course home page

http://www.cs.uncc.edu/~abw/ITCS4010F05

32

Acknowledgements

Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grants 0410667 and 0533334 (with supplementary funding)

and

by two grants from University of North Carolina, Office of the President. One of these grants provided computing equipment at 9 sites, including UNC-C