pre-con ed: ca workload automation esp edition: hints, tips and tricks

World®’16

CAWorkloadAutomationESPEditionHints,TipsandTricksSteveWotton,CATechnologies,Sr.PrincipalConsultant

MFX25E

MAINFRAMEANDWORKLOADAUTOMATION

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.

Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.

ForInformationalPurposesOnlyTermsofthisPresentation


Abstract

Inthissessionyouwilllearnaboutwaystoreducemanualinterventionandstreamlineyourbatchworkflows.

Byleveragingavarietyoffeatures,functionsandtechniques,youcanoptimizeyourCAWorkloadAutomationESPEdition(CAWAESP)ProceduresandCAWAESPApplicationstosimplifyandautomateyourcomplexschedulingrequirements.

SteveWotton

CATechnologiesSr.PrincipalConsultant


Agenda

SCHEDULECRITERIA

DUEOUTPROCESSING

TEMPLATES

CONFIGURATIONOPTIONS

1

2

3

4

ScheduleCriteria


ScheduleCriteria

§ CAWAESPEditionenablesyoutousefreeformat,everydayEnglish,tospecifyschedulecriteriawhenschedulingEvents,jobsandothertasks

§ CAWAESPEditionhasabuilt-inunderstandingofgeneralschedulingtermsandyoucanaddyourownuniqueschedulingtermstoacalendartoincludeholidaysandspecialprocessingdays/periods

Overview


ScheduleCriteriaOverview

§ Youcanspecifyschedulecriteriauptotheyear2042whichisalimitationintherepresentationoftimeonIBMz/OSsystems– Timeinz/OSisrepresentedbya64-bitintegerwiththenumberof

microsecondssinceJan1,1900,whichwillrolloveronSept17,2042– IBMhasdefineda128-bittimeformatavailableonnewerhardware,

butmanyapplicationsandsoftwarecontinuetorelyonthe64-bitformat


ScheduleCriteriaOverview


ScheduleCriteriaExample

§ Run9thdayofmonth,onlyifthe9th isaSunday,elserunonthefirstSundayafterthe9th day



§ RuneveryFridayexceptthefirstandlastFridayofthemonth



§ Run31st dayofmonthbutonlyinmonthsthatactuallyhave31days

Hmmm……

Hmmm……

JOBPAY001IFESPSDD=“31”THENRUNTODAY

ENDJOB

Check“ScheduledDate”variabletodetermineifthescheduleddayisthe31st beforeselectingjob



§ Run1stMondayofmonth…butifthemonthstartsonaSaturdayorSunday,runon2nd Mondayofthemonthinstead

JOBSOMEJOBGENTIMEFST1STDAYOFMONTHSTARTINGTODAYIFFSTDAY=‘SATURDAY’ORFSTDAY=‘SUNDAY’THEN-RUN2NDMONDAYOFMONTHELSERUN1STMONDAYOFMONTH

ENDJOB

UseGENTIMEtodeterminethedayoftheweekonwhichthecurrentmonthstarts,anddependingontheresult,schedulethejobtoruneitherthe1st or2nd Mondayofthemonth

Runs1st Monday

Runs2nd Monday


CalendarRetainCount

§ CalendarRetainCountindicateshowlongaHolidayorSpecialDayisstoredonacalendar- defaultis2daysafterthedateoccurs

§ YoumusttakeintoaccounthowlongaHolidayorSpecialdaymayneedtobereferenced,todeterminetheRetainCount

§ HolidayandSpecialDayInstancesareonlydeletedaftertheRetainCountisreachedandonceacalendarupdateismade

Overview


CalendarRetainCountExample

§ BLACK_FRIDAYPLUS1WEEKwillonlyresolveifBLACK_FRIDAYisretainedforatleast1weekafterthedatespecified

JOBPAY001RUNBLACK_FRIDAYPLUS1WEEK

ENDJOB


DUEOUTProcessing


NOWvsREALNOW

§ Theterm“NOW”inCAWAESPreferstothescheduled timeanEventwastriggered

§ Theterm“REALNOW”inCAWAESPreferstotheactual timeanEventwastriggered

Overview


NOWvsREALNOW

§ Acyclicjobrunsevery1minuteuntil4pm.Ifanystepreturnsanon-zeroreturncodethejobwillstopprocessing,andoncetheerrorhasbeenresolvedthejobisrestartedandthe1-minutecyclicprocessingwillcontinue

§ ThisexampleusesNOW,REALNOWandRERUNMcommands– NOWreferstothescheduledtimeoftheEventwhileREALNOWreferstotheactual

timetheEventwastriggered– RERUNM(RerunMultiple)commandcanbeusedtorerunoneormorejobsinan

Applicationwithexecutiondependenciesresettothestatetheywereinbeforethejobsran,andthenthenrescheduledastheirdependenciesaresatisfied

Example


JOBCYCLICRUNDAILYCCCHKRC(1:4095)FAILSTOPRELEASE(REPEAT.CYCLE)

ENDJOB

JOBREPEAT.CYCLETASKSELFCOMPLETINGRELDELAY1ESPRERUNM APPLICATION(CYCLIC.0)ROOTJOBS(CYCLIC+)ESPAJREPEAT.CYCLEAPPLICATION(CYCLIC.0)RESETEARLYSUB('REALNOW PLUS1MINUTE')RUNDAILY

ENDJOB

JOBEND.CYCLELINKPROCESSEARLYSUB4PMESPAJALLCOMPLETEAPPL(CYCLIC.0)RUNDAILY

ENDJOB

NOWvsREALNOWExample

RerunalljobsinthisApplicationbeginning

withjobCYCLIC

ResetRELDELAYtimeto1minfromwhencommandissued


LatePrediction

§ LatePredictionisanextensionoftheDUEOUTorLATESUBprocessingandprovidesadvancedwarningprovidedwhenaJobispredictedtobelate

§ Providesnotificationwhenajobthatwasoriginallypredictedtobelateisonceagainontime

§ SupportscrossApplicationdependenciesbypropagatinganticipatedtimesthroughExternaljobstoprovidenotification

Overview


LatePrediction

§ LatePredictionisactivatedbyspecifyingLATEPREDInitializationParameter

– Providenotificationifajob’sDue-outtimeiswithinthenext5hoursandthejobispredicatedtogooverduebymorethan3minutes

– Notificationdoesnotoccurifoverduestatefallsoutsideoftheboundaries

LATEPREDON(5,3)

Overview


LatePrediction

§ Providenotificationsbasedonlatepredictions

Example

JOBAHOLDRUNDAILYDURATION40RELEASEB

ENDJOB

JOBBRUNDAILYDURATION40DUEOUTEXECNOWPLUS2HOURSNOTIFYLATEPRED(1,5) USER(SWOTTON)

ENDJOB

ProvidenotificationifJobispredictedtobelateby5minsormoreandDueouttimeis

within1hour

At10:00,AETis11:20andDUEOUTis12:00STATUS:NotLate

At10:50,AETis12:10andDUEOUTis12:00STATUS:10minslatebutDon’tNotifysincemorethan1houruntilDueouttime

At11:00,AETis12:20andDUEOUTis12:00STATUS:20minslate- SendNotifysincethereis1hourorlessuntilDueouttimearrivesandjobismorethan5minslate

StartTime:10:00

Due-outTime:12:00


Templates


Templates

§ ATemplateisanelementofCLANGyoucanusetospecifyrepetitivecommandsorstatementsonce

§ Parameters,positionalorkeyword,arepassedtotheTemplateandthroughaniterativeprocess,theTemplateisexpanded

TEMPLATEBILLING(1,JOBNAME)JOB%JOBNAMERUNDAILYENDJOBENDTEMPLBILLINGBILLJOB1BILLINGBILLJOB2

JOBBILLJOB1RUNDAILYENDJOBJOBBILLJOB2RUNDAILYENDJOB

Overview


Templates

§ CreateaTemplatethatpassesparametersfortheJobnameandanysuccessor

§ AlljobshavethesameRunFrequencyandTagfield

APPLBILLINGJCLLIB'WOTST01.DEMO.CNTL'TEMPLATEBILLING(1,JOBNAME,NEXTJOB())JOB%JOBNAMERUNDAILYTAG'BILLINGJOB'IFNEXTJOBNE''THENRELEASE(%NEXTJOB)ENDJOBENDTEMPLBILLINGBILLJOB1NEXTJOB(BILLJOB2,BILLJOB3)BILLINGBILLJOB2NEXTJOB(BILLJOB4)BILLINGBILLJOB3NEXTJOB(BILLJOB4)BILLINGBILLJOB4NEXTJOB(BILLJOB5)BILLINGBILLJOB5NEXTJOB(BILLJOB6,BILLJOB7)BILLINGBILLJOB6NEXTJOB(BILLJOB8)BILLINGBILLJOB7NEXTJOB(BILLJOB8)BILLINGBILLJOB8

Example


Templates

§ WhendownloadedviaWorkstation,aTemplatedoesnotexpandorresolvegraphicallyuntiltheCAWAESPProcedureisSimulated

Example


ConfigurationOptions


GeneratingandProcessinganApplication

EventTriggers

ApplicationGenerationPhase

ApplicationProcessPhase

ApplicationGenerationPhase• ReadstheCAWAESPProcedure• Determineswhichjobsarescheduledtoday

alongwiththeirrequirements• Createsthejob-flow

ApplicationProcessPhase• Assesseswhetherpredecessorand

timedependencieshavebeenmet• DetermineswhetherResource

requirementshavebeenmet• Re-triggersEventtosubmitjoband

performfurtherprocessing

Overview


ConcurrentEventProcessing

§ EventInitiatorsenablesyoutoprovidededicatedclassesofinitiatorstospecificEventsandareoftenusedtoprioritizeandstreamcriticalEventprocessing

§ WerecommendthatyoucreatesixEventInitiators,whichenablesCAWAESPEditiontoprocesssixconcurrentrequests– Youcanaddmoreeventinitiatorstomeetyourperformance

requirementsandworkloadvolume

Overview


§ UsetheEICLASSInitializationParametertocreateanEventInitiatorClassspecifyinganidentifyingclassnumberandnumberofinitiators

ConcurrentEventProcessing

• EICLASSdisplaycommandprovides:– NumberofInitiatorsforeachclass– NumberofInitiatorsactive– MaxnumberofallowedInitiators– NumberofEventsandjobseachinitiatorhasprocessedtodate

Overview


§ UsetheEICLASSparameterinanEventtospecifyinwhichInitiatorClassandEventshouldprocess

ConcurrentEventProcessingExample


ProcedureCaching

§ ProcedureCachingcanimproveCPUusageandprocessingspeedforCAWAESPproceduresthathaveover400jobs

§ ProcedurecachingallowsyoutokeepanoriginalcachedcopyofaCAWAESPproceduretoreduceI/Oduringprocessing

§ AcachedcopyoftheCAWAESPprocedureisstoredintheAPPLFILE

Overview


§ ToturnonprocedurecachingforallProcedures,addthefollowingInitializationParameter:– PCACHEON

§ ToturnonprocedurecachingforcertainProcedures,suchasthosecontaininglargeApplications,addthefollowingInitializationParameter:– PCACHEENABLE

§ Then,addtheCACHEoperandtotheINVOKEstatementineithertheEventorApplication

ProcedureCachingOverview


ProcedureCaching

§ EachtimethePAYROLLApplicationisinvoked,theDATESprocedureisalsoinvokedcontainingsymbolicvariablesrequiredbythejobsintheApplication

§ TheDATESprocedurewillbecachedinmemorytospeedaccess

APPLPAYROLLJCLLIB'CYBER.JCL.CNTL'INVOKE'CYBER.SYMBOLS.CNTL(DATES)'CACHE

JOBPAYJOB1RUNWORKDAYS

ENDJOB

Example


ResultsInthissessionwediscussedwaystoreducemanualinterventionandstreamlineyourbatchworkflowsbymakinguseofavarietyoffeatures,functionsandtechniquesrelatedto:

• Maximizingschedulecriteria

• Streamliningjobdependencies

• ProvidingproactiveDueoutnotifications

• ReducingcodethroughiterativeTemplates

• EnablingconfigurationoptionstoimproveCPUusageandminimizefilei/o

SummaryAFewWordstoReview


Questions?


RecommendedSessionsSESSION# TITLE DATE/TIME

MFX26ECAWorkloadAutomationESPEdition:SLAManagementandBusinessContinuity

11/14/2016at1:00pm

JasmineB

MFX31EBetterBigDataAnalyticswithCAWorkloadAutomationforHadoop

11/14/2016at3:00pm

JasmineB

MFX24EWobtrigs andFileTriggerswithCAWorkloadAutomationESPEdition

11/15/2016at11:00am

JasmineB

MFX33EBestPracticesforsettingupCAWorkloadAutomationESPApplicationProcedures

11/15/2016at1:00pm

JasmineB


You Are Cordially Invited……..CA Workload Automation & CA Process Automation

Where? South Seas E When? Tuesday, November 15th

Time? 4:30pm – 6:00pm

Customer & Partner Reception


MustSeeDemos

ModernWorkloadAutomation

CAWLADEMFandWorkloadAutomation

SeamlessApplicationAutomationAgents&AdvancedIntegrationsMFandWorkloadAutomation

CAConversionasaService

CAWorkloadAutomationMFandWorkloadAutomation

Innovations:MainframeWorkloadAutomationCAWLACA7&ESPMFandWorkloadAutomation


Thankyou

Stayconnectedatcommunities.ca.com

pre-con ed: ca workload automation esp edition: hints, tips and tricks

Technology