www.see-grid-sci.eu see-grid-sci user interface (ui) installation and configuration branimir ackovic...

www.see-grid-sci.eu

SEE-GRID-SCI

User Interface (UI) Installation and Configuration

Branimir AckovicInstitute of Physics

[email protected]

The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no. 211338

Regional SEE-GRID-SCI Training for Site Administrators

Institute of Physics BelgradeMarch 5-6, 2009

<Title>

Regional SEE-GRID-SCI Training for Site Administrators, Institute of Physics Belgrade, March 5-6, 2009 2

Presentation Overview

• User Interface• User Certificates• Host Certificates• UI Installation• UI Configuration• Tweaking UI• Job types

• Job

• Collection

• Parametric

• DAG

• MPI


User Interface

• List all the resources suitable to execute a given job• Submit jobs for execution• Cancel jobs• Retrieve the output of finished jobs• Show the status of submitted jobs• Retrieve the logging and bookkeeping information of jobs• Copy, replicate and delete files from the Grid• Retrieve the status of different resources from the Information System


Grid Security

• X.509, SSL• Certification Authority (CA)• Host Certificate• User Certificate• Proxy• MyProxy Service

Grid Security Infrastructure GSI


Grid Security

•Private key•Public Key

SSL, X.509


SEE Certification Authorities

• SEEGRID - HellasGrid

• Greece - HellasGrid• Turkey - TRGrid• Hungary - NIIF• Croatia - SRCE• Serbia - RCUB• Macedonia - UKIM


Host Certificate

/etc/grid-security/globus-host-ssl.conf

grid-cert-request -host <fqdn> -d <dirname>


User Certificate

/etc/grid-security/globus-user-ssl.conf

grid-cert-request -int


Proxy, MyProxy

Grid proxy

MyProxy delegation


UI Installation

http://glite.web.cern.ch/glite/packages/R3.0/R20060502/doc/installation_guide_3.0-2.html

http://rpm.scl.rs/yum.conf/scl-glite-UI.repo

yum install glite-UI


UI Configuration

https://twiki.cern.ch/twiki/bin/view/EGEE/YAIM

yaim -c -s <location of site-info.def> -n UI


UI Tweaking

WMS and MyProxy config files:

/opt/glite/etc/<voname>

LFC config:

$LFC_HOST


Creating Proxy, Proxy delegation

grid-proxy-init

voms-proxy-init -voms <voname>

voms-proxy-info

voms-proxy-destroy

myproxy-init -d -n -c <hrs>


lcg-info

lcg-info --vo <voname> --list-ce

lcg-info –vo <voname> --list-se

lcg-info –list-attrs

--attrs


JDL

Type = "Job";

Executable = "test.sh";

#Arguments = "";

StdOutput = "output";

StdError = "stderror";

InputSandbox = {"test.sh"};

OutputSandbox = {"output","stderror"};

Requirements = other.GlueCEUniqueID == "<GCEUID>";

.....


Job Operations

glite-wms-job-submit -a (-d <delegation>) -c <wmscfg>

glite-wms-delegate-proxy -d <delegation>

glite-wms-job-status <jobid>

glite-wms-job-output <jobid>


Job Types

• Simple JOB• Collection• Parametric• DAG• MPI


Collection 1/2

Type = "Collection";

nodes = {

[

JobType = "normal";

Executable = "/bin/hostname";

Arguments = "-i";

StdOutput = "out";

StdError = "err";

OutputSandbox ={"out","err"};

],

[

JobType = "Normal";

Executable = "/bin/date";

StdOutput = "date";

StdError = "err";

OutputSandbox= {"date"};

]

};


Collection 1/2

[

JobType = "Normal";

Executable = "/bin/date";

StdOutput = "date";

StdError = "err";

OutputSandbox= {"date"};

]

};


Parametric type 1 Parametric type 1

Type = "Job";

JobType = "Parametric";

Executable = "/bin/echo";

Arguments = "_PARAM_";

Parameters = {red, green, blue};

StdOutput = "colour_PARAM_.txt";

StdError = "error_PARAM_.txt";

OutputSandbox = {"colour_PARAM_.txt","error_PARAM_.txt"};


Parametric type 2

Type = "Job";

JobType = "parametric";

Executable = "exec";

StdInput = "input_PARAM_.txt";

StdOutput = "output_PARAM_.txt";

Parameters = 10;

ParameterStart = 1;

ParameterStep = 1;

InputSandbox = {"<exec>", "<param_file>"};

OutputSandbox = {"output_PARAM_.txt"};


DAG 1/5

Type = "dag";

InputSandbox = {"job.sh"};

Nodes = [

nodeA = [

Description = [

JobType = "Normal";

Executable = "job.sh";

Arguments = "A";

StdOutput = "std.out";

StdError = "std.err";

InputSandbox = {root.InputSandbox[0]};

OutputSandbox = {"std.out","std.err"};

];

];


DAG 2/5

nodeB = [

Description = [

JobType = "Normal";


Arguments = "B";





];

];


DAG 3/5

nodeC = [

Description = [

JobType = "Normal";


Arguments = "C";





];

];


DAG 4/5

nodeD = [

Description = [

JobType = "Normal";


Arguments = "D";





];

];

Dependencies = {

{nodeA,nodeB},{nodeA,nodeC},{{nodeB,nodeC},nodeD}

};

]


DAG 5/5

job.sh

#!/bin/bash

echo "Job $1 - `date` - BEGIN"

hostname

sleep 100

echo "Job $1 - `date` - END"


MPI 1/2

Type = "Job";

JobType = "MPICH";

NodeNumber = 2;

Executable = "test-mpi.sh";

Arguments = "test-mpi";

StdOutput = "test-mpi.out";

StdError = "test-mpi.err";

InputSandbox = {"test-mpi.sh","test-mpi.c"};

OutputSandbox = {"test-mpi.err","test-mpi.out","mpiexec.out"};


MPI 2/2

int main(int argc, char *argv[])

{

int numprocs; /* Number of processors */

int procnum; /* Processor number */

/* Initialize MPI */

MPI_Init(&argc, &argv);

/* Find this processor number */

MPI_Comm_rank(MPI_COMM_WORLD, &procnum);

/* Find the number of processors */

MPI_Comm_size(MPI_COMM_WORLD, &numprocs);

printf ("Hello world! from processor %d out of %d\n", procnum, numprocs);

/* Shut down MPI */

MPI_Finalize();

return 0;

}


Links

Glite User guide:

https://edms.cern.ch/file/722398/1.2/gLite-3-UserGuide.html

Glite Installation guide:

http://glite.web.cern.ch/glite/packages/R3.0/R20060502/doc/installation_guide_3.0-2.html

https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide310

Yaim guide:

https://twiki.cern.ch/twiki/bin/view/LCG/YaimGuide400

www.see-grid-sci.eu see-grid-sci user interface (ui) installation and configuration branimir ackovic...

Documents