copyright © 2012, sas institute inc. all rights reserved. sas ® grid at phac sas ottawa platform...

36
Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Upload: austen-knight

Post on 17-Jan-2018

221 views

Category:

Documents


0 download

DESCRIPTION

Copyright © 2012, SAS Institute Inc. All rights reserved. SAS GRID AT PHAC AGENDA 1. SAS Grid Manager SAS Grid Manager Features and benefits 2. Grid at PHAC Objectives Architecture Design details 3. Implementation

TRANSCRIPT

Page 1: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS® GRID AT PHACSAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Page 2: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 3: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 4: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC SAS GRID MANAGER

• A SAS grid computing environment is one in which SAS computing tasks are distributed among multiple computers on a network, all under the control of SAS Grid Manager.

Page 5: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 6: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC FEATURES AND BENEFITS

• Performance• Workload Balancing (multi-user and parallelized)• High Availability• Scalability• Distributed Enterprise Scheduling

Page 7: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 8: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 9: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 10: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC ARCHITECTURE

Page 11: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC ARCHITECTURE

• 64bit SUSE Linux Enterprise Server 11• Virtual Red Hat Server for RTM• OCFS2• LDAP / PAM (Novell eDirectory)

Page 12: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 13: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC DESIGN DETAILS

• Shared executables and configurations

• /sas/software/ {meta} {app} {midtier}• /sas/config/ {meta} {app} {midtier}• /sas/pss/lsf

Page 14: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC DESIGN DETAILS

• Workspace Server clustering (hybrid Grid solution)

• Application Server context association with specific queue:• SASApp – normal queue• SASPriority – priority queue

Page 15: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC DESIGN DETAILS

Normal queue:

QUEUE_NAME = normalPRIORITY = 30NICE = 20PREEMPTION = PREEMPTABLE

Priority queue:

QUEUE_NAME = priorityPRIORITY = 40NICE = 10PREEMPTION = PREEMPTIVE

Page 16: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC DESIGN DETAILS

• Reduced sleep times:

• MBD_SLEEP_TIME = 3• SBD_SLEEP_TIME = 5

• Increased MXJ value (128)

Page 17: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC DESIGN DETAILS

Page 18: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC AGENDA

• 1. SAS Grid Manager• SAS Grid Manager• Features and benefits

• 2. Grid at PHAC• Objectives• Architecture• Design details

• 3. Implementation

Page 19: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

• Prerequisites• Shared storage• Networking• Users• License, SAS Depot, plan file• Third Party Software

Page 20: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

• Platform Suite for SAS 6.1 (PSS)• Install PM, LSF and GMS• Run hostsetup on every node• Install MPI• Test• Install RTM

Page 21: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

• Install SAS Software• Install Metadata Server, Application Server and Mid-tier• Configure

Page 22: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

• Grid specific options during configuration

Page 23: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 24: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 25: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 26: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 27: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 28: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

• Edit configuration files to configure grid• lsb.params• lsb.hosts• lsf.cluster.[cluster_name]• lsb.queues

Page 29: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

• Create new application server context• Associate workspace with grid queue

Page 30: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

• Play

Page 31: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 32: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 33: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC IMPLEMENTATION

Page 34: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

SAS GRID AT PHAC FUTURE

• Metadata HA• More customized queues• Additional queues and application server contexts• DI server• Web Application clustering (horizontal / vertical)

Page 35: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved.

RESOURCES

• SAS Grid Computing Documents• http://support.sas.com/rnd/scalability/grid/griddocs.html

• Standard deployment plan - Grid Manager, four machines• http://

support.sas.com/demosdownloads/sysdep_t6.jsp?packageID=000803&searchvar=productCat&searchval=sas%20grid%20manager

Page 36: Copyright © 2012, SAS Institute Inc. All rights reserved. SAS ® GRID AT PHAC SAS OTTAWA PLATFORM USERS SOCIETY, NOVEMBER 2012

Copyr igh t © 2012, SAS Ins t i tute Inc . A l l r i gh ts r es erved. www.SAS.com

THANK YOU