What is it and how is it used

Jeff Van Minde, IBM Support and Solutions z/TPF vanminde@us.ibm.com February 25th, 2015

Understanding z/TPF Transaction Processing Facility

2 Source: Cartoon from http://www.brotherjones.com/doug/portfolio/people/juggler

z/TPF Basics

z/TPF is an Operating System

4

User

Application

z/TPF Operating system

System z Hardware

z/TPF Specifically Built for

5

Speed

Availability

Efficiency

Reliability

z/TPF

z/TPF Highlights Memory, Storage, Communications Efficient

Messages and Transactions Short Existence Time

Tens of Thousands of Transactions a Second High throughput

Minimum Latency, Millisecond Existence Quick response times

Storage and Communication (I/O) Short instruction path lengths

Allowing 365x24x7 Operation High availability

To Create and Teardown Processes Quickly and Often Lightweight process model

30 seconds to 2 minutes Fast Restart and Recovery

Each Process (ECB) is Only Aware of its Own Resources Process Protection

Vertical scaling with up to 84 engines that z/TPF can address Horizontal clustering as many as 32 multiprocessor systems accessing same database Open-ended growth capacity

Software, Memory Allocations, Database Organization, Database Resources Ability to make updates while taking traffic 6

z/TPF History

8

Created by IBM and SABRE @ 1965 A need for a global electronic ticketing solution Created Airline Control Program (ACP) Created Programmed Airline Reservation System (PARS) application

Keeps Evolving Currently PUT11 with weekly updates

ACP becomes

TPF TPF 2.1

(LC support)

TPF 3.1 (TC support and C Lang.)

TPF 4.1 (31-bit and

virtual addressing)

z/TPF (64-bit, SOA,

security, open run-time/dev.)

1968 1979 2005 1994 1989 1982 PARS

IBM

Customers

Most reservation applications derived from this application

base 1960s

Application

Other industries develop applications for TPF

Airline Control

Program (ACP)

Invented for Real Time Transaction Processing

2014

z/TPF (PUT11.)

What is z/TPF used for Today?

9

z/TPF Differences

Typical Workload Types

11

http://www-01.ibm.com/support/knowledgecenter/zosbasics/com.ibm.zos.zmainframe/zconc_mfworklds.htm

A Background on Operating Systems

Windows

MS DOS @1979 SCP

Android

Linux

iOS

Darwin

UNIX variant @1969

OS X

FreeBSD

UNIX variant @1969

Linux

Minux

UNIX variant @1969

z/OS

OS/360 @1964 IBM

z/TPF

ACP @1965 IBM

12

Most Operating Systems (OS) were developed in the 1960s or 1970s Todays modern OSs are based on older traditional models (red)

http://en.wikipedia.org/wiki/Operating_system

Operating Systems - Compare and Contrast Category Unix/Linux z/OS z/TPF z/VM Hardware Multiple z Systems z Systems z Systems

Created 1969 (Unics) 1964 (OS 360) 1965 (ACP) 1970 (CP-67)

Current Linux on IBM z Systems Suse 12, Redhat 6

z/OS 2.1 z/TPF PUT11 z/VM 6.3

Type General Purpose Batch/Transactional Transactional Virtualization

Applications Desktop to Enterprise WAS, CICS, IMS, Vendor, Custom

Customized, Open Source

Virtualized OSs, CMS

Industry Academic, Consumer, Midsize, Business, Fortune 500

Business, Fortune 500

CRS, GDS, Airlines, Financial, Rail,

Topology Centralized, Distributed Centralized Centralized Centralized, Virtualized

Languages C, C++, Java, Scripted, etc.

Assembler, C, C++, COBOL, PL/1, Java, REXX

Assembler, C, C++ REXX, Scripting

13

Comparing z/TPF to other Transaction OSs

Memory Based solutions Transactional speed achieved by in-memory tables Capturing significant changes from a memory database is problematic

Distributed Based solutions Transactional speed achieved by multiple servers Syncing the database on distributed servers is inefficient

14

Most other Transaction Processing models run on top of another operating system and are not as efficient as a native operating system like z/TPF

Less Layers in z/TPF

15

User

Application

Transaction APIs

Other Operating Systems

Hardware

User

Application

z/TPF Operating System

System z Hardware

z/TPF

Other Operating Systems

Fit for Purpose

16

What is the best platform for the workload? How important is Reliability, Availability, Serviceability and Speed?

z/TPF and z Systems

z/TPF exclusively runs on z System hardware

Specifically written and optimized for the z System hardware features and functions

17

Infographic is a z13 Model Server http://www-03.ibm.com/systems/z/hardware/z13.html

Centralized Footprint + Distributed Benefits

18

https://www.ibm.com/developerworks/community/wikis/home?lang=ru#!/wiki/Tivoli%20System%20z%20Monitoring%20and%20Application%20Management/page/IBM%20Tivoli%20zEnterprise%20Monitoring%20--%20An%20Overviewk

z/TPF Details

z/TPF is Delivered Electronically

Software

Source code provided to customers

Pre-built objects also available

Customers can make modifications

Deliverables

Control Program

System Services

Continual APAR updates

Yearly PUT releases

Drivers, Automation, etc.

20

/ztpf

/base

/hpo

/tpfdf

/bss

/linux

/os390/tpftools

/local_mod

/base

/hpo

/tpfdf

Shipped

Configuration Dependent

Customer Modified Shipped Source

Open Source

/opensource

z/TPF - Control Program

Also Known As: Control Program, CP, Kernal, CPS0

About 3.5 Meg in size

Memory Resident

Written in Assembler

Dispatch Control (CPU LOOP)

Channel Programs/Drivers Efficient Hardware Specific

Memory/Storage Management

Linkage CSECTS linked together to make up CPS0 Built as part of System Initialization (SIP)

User Exits

21

Control Program

Memory

z/TPF - Shared Objects / Programs

Any software that is not part of the CP is a Shared Object (SO) that can be pre-loaded in memory or loaded when initially called for use.

SOs are written in: Assembler C/C++

SOs can be z/TPF System Software or Application Software

22

Control Program

Core Resident Program Area

Storage/Disk/DASD Memory

Each Process has an Entry Control Block (ECB)

23

Control Program

Input Message Start a Process

Entry Control Block (ECB)

Shared Object(s)

Shared Object(s)

End a Process

CPU(s)

Interacts with..

Interacts with..

Output Message

Memory/Disk

Each ECB is protected / fenced

100s ECBs active at one time

Shared Objects are reentrant

CPUs evenly distribute workload

CP is interrupt driven

24

Database Design Built for Performance Fixed and pool records are spread evenly across all modules Ensures I/O spread evenly across all volumes z/TPF reads from either module and writes to both modules

0 3 6 9 1 4 7 10 2 5 8 11 12 15 18 21 13 16 19 22 14 17 20 23

0 3 6 9 1 4 7 10 2 5 8 11 12 15 18 13 16 19 14 17

Prime Modules

Duplicate Modules

PK0001 PK0003 PK0005

0 3 6 9 1 4 7 10 2 5 8 11 12 15 18 21 13 16 19 22 14 17 20 23

PK0002 PK0004 PK0006 0 3 6 9 1 4 7 10 2 5 8 11

12 15 18 13 16 19 14 17

Fixed Record with 20 records

Pool type with 24 records

Example of z/TPF with 6 modules defined

z/TPF Databases Types

Traditional Fixed File Flat File Very Fast Application must manage

database

Globals Format 1 and Format 2 Very Fast Memory and keypointed to file

on a time initiated basis

TPF Database Facility (TPFDF) Database Manager Very Fast Application abstracted from

database

TPF File Systems POSIX Interface Slow, Medium, Fast based on

model used

TPF Collection Support (TPFCS) Database Manager Smalltalk model Medium

Virtual File Area (VFA) Memory cached records Usually have a high read count Bubble out and are written to

file when filed.

25

z/TPF Communications

3215 / 3270 Console

Connects visa OSA Integrated Console Controller (OSA-ICC)

Used for console support for TPF Operations Server (TOS)

Also can be attached via ESCON and Controller Unit (Vendor)

System Network Architecture (SNA)

3745 Network Control Program

Channel to Channel (CTC)

TCP/IP

Connectivity via OSA Express Card

Internet Daemon Model

TCP/IP Native Stack

26

27

z/TPF Security

Hardware Support

Cryptographic Cards on Server Accelerator

Mode Central Processor

Assist for Cryptographic Functions (CPACF)

TPF Operations Server

Software Support

OpenSSL Non Displayable

Memory Internet Security

Memory Security

Key Protected Fetch protection Write protection Low memory

Protection

Processes (ECBs) protected

Virtual Addressing with Enhanced Dynamic Address Translation (DAT)

ECB view address (EVA)

System view address (SVA)

Development Environment

Development Environment

TPF Toolkit IDE

Debugger

Editor

Linux on z Systems

MakeTPF

BuildTPF

z/VM

VPARS

VTAPE

29

z/TPF Relies on Supporting Systems

z/OS

Format DASD Environment

Create System Initialization Environment

Run Batch oriented tasks

Access to General Data Sets

Linux on z System

Used to build z/TPF object code

HLASM GCC Compiler Create Loader

components Other Utilities

z/VM

Can virtualize z/TPF as a guest

Used for testing and production

z/TPF depends on other systems to build the z/TPF configuration, build z/TPF software, run off-line batch jobs, connect via a primary console, and provide tools for testing, performance and debugging

z/TPF Configuration Options

System Configuration Uni (Single Engine) Environment

31

Control Program

DASD

z System LPAR (s)

Up to 140 I-Streams

Network

Online Programs

z/TPF

Only one I-stream used in Uni system

System Configuration Tightly Coupled (Multi Engine)

32

Control Program

DASD

z System LPAR (s)

Up to 140 I-Streams

Network

Online Programs

z/TPF

System Configuration Loosely Coupled Environment (Multi Server)

33

Network

DASD

Control Program

System Z LPAR

Up to 99 I-Streams

Online Programs

z/TPF

Control Program

z System LPAR (s)

Up to 140 I-Streams

Online Programs

z/TPF

Control Program

z System LPAR (s)

Up to 140 I-Streams

Online Programs

z/TPF

z/TPF Functionality

35

z/TPF Functionality is Customer Driven

Customer Needs

Requirement Details

Functionality Created

Enhancements Added

36

z/TPF Middleware and System Services Layer

MQ

Server (Turbo) Memory Based

Client

Web Services

XML SOAP WS-Security JSON Mail Server HTTP Server HTTP Client WebSphere

Operational Decision Management (WDOM)

Business Events FTP

Transaction Services

Commit/Rollback

Recovery Log

Database

TPFDF TPFCS TPFAR File System

Ported Open Source

Apache OpenLDAP MySQL OpenSSL zlib

37

Customers Create and Support Their Applications

Banking Credit Card Authorization Airline

Booking Hotel

Booking ATM

Authorization

Specific Customer Applications

38

Every Solution has Pros and Cons

z/TPF Pros Code Software to Exact Business

Needs

Can Differentiate from the Competition

Streamlined, Efficient Functionality

Reliability, Availability, Serviceability, and Speed

z/TPF Cons Self Supporting Application Software

Customization Needed

Does Not Support All Function Types

Restricted Environment

39

Follow z/TPF

TPFs Home Page ibm.com/tpf

z/TPF Blog ibm.biz/zTPF_dW

z/TPF YouTube Channel ibm.biz/IBM_TPF_recordings

Twitter IBM_TPF twitter.com/ibm_tpf

40

Provide feedback

Take a second and comment on the blog about the webinar. Tell me if you liked it, disliked it, or have additional questions. www.ibm.biz/understanding_ztpf Scroll down, click Add a Comment, and add your feedback. Thanks!

41

Questions?