cluster scheduling
DESCRIPTION
Cluster scheduling. Presented by: Priti Lohani. What is cluster?. It is a group of loosely coupled computers. They are arranged in a way to improvise in a speed and reliability provided by a single computer. It allows the organizations to boost their processing power. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/1.jpg)
Presented by: Priti Lohani
![Page 2: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/2.jpg)
What is cluster?It is a group of loosely coupled computers.They are arranged in a way to improvise in a
speed and reliability provided by a single computer.
It allows the organizations to boost their processing power.
It provides expandability.
![Page 3: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/3.jpg)
Classification of clusters:High -availability clustersLoad-balancing clustersHigh-Performance clustersGrid clusters
![Page 4: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/4.jpg)
Clustering algorithm requirements:scalabilityBroad scopeSensitivity to compute node and interconnect
architecture Fair share capabilityCapability to integrate with standard
resource managers Fault tolerance
![Page 5: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/5.jpg)
Resource management systemIt manages the processing of load by
preventing jobs from competing with each other for limited compute resources
Resource managers do basic node state monitoring, receive job submission requests and executes the requests on the computer node.
The scheduler communicates with the resource manager to obtain information about queues, loads on compute nodes, and resource availability to make scheduling decisions.
![Page 6: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/6.jpg)
Cluster scheduling algorithms:There are two types of schedulers:Time sharingSpace sharingTime sharing:Local schedulingGang schedulingCommunication driven co-schedulingSpace sharing:Batch scheduling
![Page 7: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/7.jpg)
Batch scheduling:FCFS (First come first serve)SJF (Shortest job first)LJF (Longest job first)Advance reservationBackfillingPreemptive backfilling
![Page 8: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/8.jpg)
Classifications of clustering algorithms:Exclusive ClusteringOverlapping ClusteringHierarchical ClusteringProbabilistic Clustering
![Page 9: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/9.jpg)
Maui cluster scheduler:It is an open source advanced job scheduler.It focuses on large turn around of large
parallel jobsIt is a best open source scheduler.It is capable of optimizing scheduling and
node allocation decisions.It has a 2 phase scheduling algorithm.
![Page 10: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/10.jpg)
Resource managers for Maui:
PBSVersion of PBS:Open PBSProfessional PBSTorque
![Page 11: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/11.jpg)
Open PBS VS TorqueTorque is better than PBS in following areas:Fault toleranceScheduling interfaceScalabilityUsability
![Page 12: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/12.jpg)
Scheduling policies for MauiAdvance reservationBackfillJob prioritization
![Page 13: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/13.jpg)
Backfill algorithm:
![Page 14: Cluster scheduling](https://reader034.vdocuments.site/reader034/viewer/2022051401/56812d64550346895d9273e5/html5/thumbnails/14.jpg)
Thank you for listening!