outline.1

Grid Computing

Fall 2005Tuesday/Thursday 11:00 am - 12:20 pm

Instructors

Dr. Barry WilkinsonUniversity of North Carolina at Charlotte

andDr. Clayton Ferner

University of North Carolina at Wilmington

Grid Computing, B. Wilkinson, 2005

outline.2

Grid Computing

• Using geographically distributed and interconnected computers together for computing and for resource sharing.

outline.3

“The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks

outline.4

Interconnections

Usually grid computing employs the Internet to interconnect the computers.

As we see, standard Internet protocols are used.

outline.5

Virtual Organization

Usually, grid computing involves teams working together on a common goal, sharing computing resources and possibly experimental equipment.

The geographically distributed grid computing team is called a virtual organization.

The resources shared include software and experimental data.

outline.6

Course credit

This course can be taken by students at any university connected to the NCREN, for credit at their institution.

Course number assigned by the institution.

Listed as an undergraduate course but can be taken for graduate credit with my approval and your institution.

Graduate students can expect more demanding work.

outline.7

Course virtual organization

Current list of sites scheduled to receive course with students:

• NC State University• University of North Carolina at Asheville• University of North Carolina at Charlotte• University of North Carolina at Pembroke• University of North Carolina at Wilmington• Western Carolina University

outline.8

Course grid structure

MCNC

UNC-W UNC-A

NCSUWCU

UNC-CASU

outline.9

Class scheduleEach university has its own class schedule.

Start date: Tuesday August 23rd, 2005 (UNC-C's start date).

Last class: Thursday December 1st, 2005.

No class on:• Tuesday October 11th, 2004 (UNC-C Fall break) and• Thursday November 24th, 2005 (Thanksgiving ).

It will be necessary for students at sites with breaks that do not coincide with UNC-C's breaks to watch recordings of classes later.

outline.10

Prerequisites

• Preferably programming skills in Java on a Linux system.

outline.11

Topics

• Introduction to grid computing

• Web services

• Grid computing software (Globus 4.0)

• Security, Public Key Infrastructure

• Schedulers

• UNC-W workflow editor (GridNexus)

• Grid computing applications

outline.12

Assignments and Grading• Several “simple” pre-written

programming assignments (tasks)– web services– GT 4 services– Globus job– SGE job– Using UNC-W GUI

• Additional programming assignment/project

• Class tests (2)• Final test• Small print: Subject to change. The instructor reserves the right to change the assignments and the grading to make it easier or harder.

45%

15%25%15%

outline.13

“Simple” Prewritten Programming Assignments

• Detailed instructions provided on achieving a task (creating a web service, GT 4 web service, etc.)

• Simply follow instructions.

• At end, asked to extend the work - e.g. add functionality to a service.

outline.14

SoftwareCourse assignments require specific distributed computing software from the NSF NMI package.

The software is installed on systems at certain sites, including:

• Appalachian State University• Elon University• NC State University• University of North Carolina at Charlotte• University of North Carolina at Wilmington• Western Carolina University• MCNC (Microelectronics Center of North Carolina)

If not available locally, student will access software through remote access to one of the participating sites or MCNC.

outline.15

Software continued

Certain software can easily be downloaded and installed on your own PC, so that you can do some work at home.

All software can be downloaded and installed on a Linux system.

Instructions are provided on the course home page but it can be quite difficult to make the software work.

outline.16

Class tests and assignment submission

WebCT at UNC-C will be used for multiple-choice class tests and for submitting assignments.

http://www.webct.uncc.edu/WCT_FACULTY/index.html

Everyone will be given an account on this system.

outline.17

Weeks 1 - 3 (tentative)Grid computing Virtual organizations, computational grid

projects, grid computing networks, TeraGrid, grid projects in the US and around the world, grid challenges

 Internet Technologies IP addresses, HTTP, URL, HTTP, XML, Telnet,

FTP, SSL Web Services I. Service-Oriented Architecture (SOA), service

registry, XML documents, XML schema, namespaces, SOAP, XML/SOAP examples, Axis

 Web Services II. WSDL, portType, message definition, WSDL

to/from code Assignment 1 "Simple" Web service Java programming

assignment. Tomcat environment, axis, JWS facility

outline.18

Weeks 3 - 4 (tentative)

Grid Computing Standards, Open Grid Services Architecture (OGSA), Web Services Resource Framework (WSRF), Globus 4.0, components, creating a GT 4 service and clients.

 

Assignment 2 "Simple" GT4 service programming assignment. Globus 4.0 environment.

 

outline.19

Weeks 4 - 5 (tentative)

Security Secure connection, authorization requirements, symmetric and asymmetric (public/private) key cryptography, non-repudiation, digital signatures, certificates, certificate authorities, X509 certificate

Information Directory Services, LDAP, resource discovery

Assignment 2a “Sticky Note” tutorial.

outline.20

Weeks 5 - 6 (tentative)

GT 4 Job submission Basic structure (version 4.0), service container, service browser, Globus Resource Allocation Manager (GRAM), job submission with globusrun-ws, Grid Security Infrastructure (GSI), Globus certificates, simpleCA, proxies, creating a proxy, Resource management, resource Specification Language, syntax and examples in RSL and RSl-2 

Assignment 3 Submitting a Job to the Grid, GT4 globusrun-ws, job specified in RSL-2 (XML file)

outline.21

Weeks 6 - 7 (tentative)

 Schedulers and Condor, submit description file, resource brokers DAGMan, Checkpointing, ClassAd, Condor-

G, Sun Grid Engine

Assignment 4 Submitting an SGE Job

outline.22

Weeks 7 - 8 (tentative)

High Performance Techniques for high performance computing (HPC) computing, brief introduction to MPI,

techniques suitable for grid computing.

outline.23

Weeks 8 - 9 (tentative)

 

Workflow editors GridNexus, JXPL

Grid portals Examples and design using JSP 168

Assignment 5 Using GridNexus

outline.24

Weeks 10 to 15

 

UNC-W applications Scientific, business

Guest Speakers

Course projects

outline.25

Instructor details

Barry Wilkinson

Department of Computer ScienceUniversity of North Carolina at Charlotte

Home page: http://www.cs.uncc.edu/~abwEmail: abw@uncc.edu

Office HoursTuesday/Thursday

9:30 am to 10:30 am and 2:00 pm to 3:00 pm 

outline.26

Course Home Page

http://www.cs.uncc.edu/~abw/ITCS4010F05

for announcements, slides, assignments, reading materials, tests dates, etc.

Visit regularly.

outline.27

Course Text

• There is no assigned course textbook

• Materials and links are provided on the home page.

outline.28

Expectations

• Print out slides before class, read them, and annotate them during class.

• Read key papers and other materials provided.

• Ask questions during class and participate in class discussion.

outline.29

Acknowledgements

Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grant 0410667and byUniversity of North Carolina, Office of the President.

Their support is gratefully acknowledged.

outline.30

NCREN facility(North Carolina Research and Education Network)

Site interaction

Each site will be using their NCREN facility, which provides microphones for individuals to speak.

Please feel fee to speak at suitable times but remember that the NCREN needs to be able to recognize the site and speaker, so first announce your institution.

outline.31

NCREN facility(continued)

• Since most microphones are turned one all the time, any sound will be heard across all sites unless a site turns their microphones off, so try to avoid unnecessary sounds.

• Fans from laptop can be especially disturbing, so move laptop away from a microphone.