lcg installation – lcfgng · 2005. 10. 31. · joining lcg • join a vo, probably dteam dteam:...
Post on 16-Oct-2020
3 Views
Preview:
TRANSCRIPT
EGEE is a project funded by the European Union under contract IST-2003-508833
LCG Installation –LCFGng
Peer HasselmeyerGridKa, FZK
GridKa School, 20-23 September 2004
www.eu-egee.org
GridKa School, 21 September 2004 - 2
Outline
• What is LCFGng?• LCFGng Objects• Configurations• RPM Configuration• Node Installation Process• LCFGng Server Installation• EGEE/LCG Administrative
Procedures
GridKa School, 21 September 2004 - 3
Installation Methods
• Manualuseful for small sites (~ 5-10 nodes)
• AutomatedQuattor,Rocks,LCFGng, ...
requires dedicated hardware for installation serverfast installation of nodes, work required to install/maintain installation server
GridKa School, 21 September 2004 - 4
LCFGng
• Local Configuration system next generation• Developed by University of Edinburgh• later on by the EDG (European Data Grid)
project• does two things:
installation (RPMs)configuration
• Client/server architecture: LCFGng server configures an arbitrary number of clients
each client node can have different set up
GridKa School, 21 September 2004 - 5
LCFGng Objects
• Configuration is split into so-called “objects”not like objects in object-oriented programming languagesrather: componentse.g. network object: configures IP addresses etc.
• Objects are distributed among LCFGng server and clients
• Objects consist of three partsdefinitionsvaluesscript
GridKa School, 21 September 2004 - 6
LCFGng Objects
• Object definitionsdefine possible configuration parameter namese.g. servers (object: ntp)
• Parameter valuesassign concrete values to parameterse.g. timehost.fzk.de
• Object scriptenacts actual configuration, e.g.
• creates files from parameters (/var/obj/conf/ntp.conf)• starts external components (/usr/sbin/ntpd)
located in /etc/obj/
GridKa School, 21 September 2004 - 7
LCFGng Objects
LCFGng Server Client
Definition
Values validate XML XML
Script
OS configurationfiles
http
Actions
DB
mkxprof
Usually, youchange only
these
GridKa School, 21 September 2004 - 8
Configurations
• Based on C preprocessoruses #include, #ifdef directives etc.“componentize” configurations with includes
machine A
CEHW X
Globus Monitoring
machine B
BatchSystem M
GridKa School, 21 September 2004 - 9
Configurations
• Basic building block: assignment
notation: object.parameter valuee.g. ntp.servers timehost.fzk.de
• Usually assignment once, reconfiguration:+ntp.servers lcfg.fzk.de
Obj
ect parameter a
parameter b
parameter c
value x
value y
value z
GridKa School, 21 September 2004 - 10
Configurations
• Lists possiblenetwork.interfaces eth0 eth1network.ipaddress_eth0 192.108.45.38network.ipaddress_eth1 10.33.1.138
• List operatorsEXTRA(network.interfaces) eth2PREPEND(network.interfaces,eth2)DELETE(network.interfaces,eth2)
GridKa School, 21 September 2004 - 11
Configurations
• “Human readable” configurations are validated and translated to XML by mkxprof
• XML is transferred from LCFGng server to client via HTTP
• Default configurations for all LCG node types can be downloaded from CERN deployment repository
“just” customize the example configurations
GridKa School, 21 September 2004 - 12
RPM Configuration
• Software packages to be installed defined by list of RPMs
RPM lists handled by C preprocessor#include allows componentization
Globus MonitoringSystem
CE
GridIce Ganglia
GridKa School, 21 September 2004 - 13
RPM Configuration
• Basic building block: RPM namee.g. kernel-smp-2.4.20-30.7.legacy/i686
• Modeled as LCFGng object (updaterpms)points to “master” list, e.g. CEactual RPM lists outside the scope of regular LCFGngmethods!
• RPMs and RPM lists distributed via NFS from LCFGng server
• Lists also downloadable from CERN deployment repository
GridKa School, 21 September 2004 - 14
Node Configuration
• Get default configuration files• Customize them• Call mkxprof
• Installation: boot client node• Reconfiguration: wait
client node notified about configuration changes (rdxprof daemon on client node, log file /var/obj/log/client)changes are automatically enacted by LCFGng objects
GridKa School, 21 September 2004 - 15
Node Installation ProcessBoot a kernel (PXE, DHCP, TFTP)Mount root file system (“LiveOS”, NFS: /opt/local/linux/nginstallroot/7.3)
• Start /etc/rc_installGet network configuration (DHCP)Call /etc/obj/client install
Get LCFGng configuration (XML via HTTP)Synchronize clock (NTP)Mount RPMs and RPM lists (NFS: /opt/local/linux/7.3)
Call /etc/obj/install install• Format harddisk
Install base RPMs• Write configuration (LCFG objects)
GridKa School, 21 September 2004 - 16
Node Installation Process• Reboot (from harddisk)• Call /etc/obj/boot start
/etc/obj/nfsmount: mount RPMs and RPM lists (NFS)/etc/obj/updaterpms: install node specific RPMsWrite configuration (LCFG objects)
• Reboot (from harddisk)
Don’t forget the manual configuration steps (from the installation guide)!
GridKa School, 21 September 2004 - 17
LCFGng Server Services
• DHCP server (PXE, profile URL)• TFTP server (PXE)• NFS server (RPMs and RPM lists)• HTTP server (XML profiles)• NTP server (clock synchronization)
GridKa School, 21 September 2004 - 18
LCFGng Server Requirements
• LiveOS: root file system for first boot• LCFGng object definitions• LCFGng configurations
configurations in XML format
How is all this set up?
GridKa School, 21 September 2004 - 19
“Traditional”LCFGng Server Installation
• Take a machine with installed OS (RH7.3)• Install LCFGng setup packages• Check out an LCG tag, e.g. LCG2_2_0
contains default configuration files and RPM lists
• Download RPMs (updaterep)• Install LCFGng server packages
(lcfgng_server_update.pl)• Build LiveOS (lcfgng_installroot.pl)• Configure network services
GridKa School, 21 September 2004 - 20
Joining LCG
• Nice cluster installed what now?• Subscribe to the LCG rollout mailing list
hopefully done before
• Contact your local ROC (EGEE)maybe your P-site / tier (x-1) center works as well (LCG)send them your registration form (see install notes, appendix G), copy to support-lcg-deployment@cern.ch
• Get access to the GOC-DBto enter your resources for monitoring
GridKa School, 21 September 2004 - 21
GOC Monitoring
GridKa School, 21 September 2004 - 22
GOC Database
GridKa School, 21 September 2004 - 23
Joining LCG
• Join a VO, probably dteamdteam: system administrators, supported by all LCG sites
• Have ROC test your systemno agreed certification procedure yet
• Announce availability of resources to rollout list and to CERN deployment support
will put you into “test zone”run additional certification tests on your site
GridKa School, 21 September 2004 - 24
LCFGng Server Installation
• Take a machine with installed OS (RH7.3)• Check out an LCG tag, e.g. LCG2_2_0
contains default configuration files and RPM lists
• Install cg-lcfg-go RPM• Download RPMs (updateRPMCache.pl)
called from cg-lcfg-go -d
• Install LCFGng server packages (cg-lcfg-go -l)
• Build LiveOS (create-nginstallroot-rh73)• Configure network services
GridKa School, 21 September 2004 - 25
Links• LCFGng server installation guide:
http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/lcg2/docs/LCFGng_server_install.txt
• LCG Releases: http://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/index.cgi?var=releases
• LCG configuration repository: http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/
• LCG User Guide: http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/lcg-docs/LCG2UserGuide/LCG-2-Userguide.pdf
All these and more can be found at http://lcg.fzk.de/
GridKa School, 21 September 2004 - 26
Links• Rollout list:
http://www.listserv.rl.ac.uk/archives/lcg-rollout.html• GOC Monitoring:
http://goc.grid-support.ac.uk/gridsite/gocmain/monitoring/• GOC trouble shooting wiki:
http://goc.grid.sinica.edu.tw/gocwiki/TroubleShootingHistory• GridPP support FAQ:
http://www.gridpp.ac.uk/tb-support/faq/
All these and more can be found at http://lcg.fzk.de/
top related