construction methods and monitoring in meta-cluster systems lit, jinr korenkov v.v, mitsyn v.v,...
DESCRIPTION
Main problems presence of heterogeneous platforms in the rectangular components Addition of cluster-node facilities on the PCs should not prevent their main usage Resources are distributed in different places over the city some functions and software on the host operating system impends the work of system under virtual pcTRANSCRIPT
![Page 1: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/1.jpg)
Construction methods and monitoring in meta-cluster systems
LIT, JINR
Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V
![Page 2: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/2.jpg)
Main goals
To unite in city the distributed resources in one computing system (meta-cluster)
Installation of detailed monitoring of the system,
Develop and debug convenient, fast mechanisms for expansion of the cluster
To make management and administration of the system centralized and to develop ways of automation for some procedures
![Page 3: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/3.jpg)
Main problems
presence of heterogeneous platforms in the rectangular components
Addition of cluster-node facilities on the PCs should not prevent their main usage
Resources are distributed in different places over the city
some functions and software on the host operating system impends the work of system under virtual pc
![Page 4: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/4.jpg)
Loading process
PC emulated by VMware.
Real windows
SERVER
dhcptftpnfsntpopenbpswarewulfGagnlia srv
Get IP address
Load Kernel and file system
Mount some repositories
Synchronize time
Get Jobs
![Page 5: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/5.jpg)
Logical structure
Bridge
Cisco
Primary Out, Internet
Virtual
Real, Windows
Out, With Nat
Schoolseth0
eth1
eth2
SERVER University
![Page 6: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/6.jpg)
Cluster map
Server
![Page 7: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/7.jpg)
Used Software
CERN Scientific Linux 3.0.5 VMware – virtual PC simulator VLan – Virtual Network Simulator Warewulf – technology for creating and
booting cluster nodes from network without Hard Disks.
OpenPBS – Portable Batch System Ganglia Monitoring System
![Page 8: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/8.jpg)
Problem Solving
By means of VMWARE, for creations of system we receive a homogeneous environment from heterogeneous platforms
VMWARE in WINDOWS starts as background process with a priority one less than usual (Bellownormal)
Expansion of resources occurs using of cloning of a hard disk from an exemplary computer
![Page 9: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/9.jpg)
Monitoring
Was used Ganglia cluster monitoring system Work nodes are incorporated in different
groups on classes. One class – one group On a site it is added an opportunity for
detection of mistakes from the point of view of windows
![Page 10: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/10.jpg)
Screenshot from server
![Page 11: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/11.jpg)
Screenshot from Check errors
![Page 12: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/12.jpg)
How “check errors” works
PING
PING
SERVER
eth1
eth2
Virtual, VMware
Real, Windows
![Page 13: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/13.jpg)
Results
For creation metacluster it was used only existing technologies
Computing resources have not been bought, the system is created from already being computers
Use of computers as computing units of the system did not hinder their main functions
![Page 14: Construction methods and monitoring in meta-cluster systems LIT, JINR Korenkov V.V, Mitsyn V.V, Chkhaberidze D.V, Belyakov D.V](https://reader035.vdocuments.site/reader035/viewer/2022070605/5a4d1ad07f8b9ab05997119a/html5/thumbnails/14.jpg)
Results
Heterogeneity of platforms is endowed by means of VMWARE
Monitoring does administration of the cluster more convenient and helps to support reliability of the system.