ibm db2 update, z/os architecture (ziip, zaap, ifl)
DESCRIPTION
TRANSCRIPT
IBM Software Group
IBM Technical ExchangeColorado DB2 User Group
Kevin HarrisonConsulting IT ArchitectDB2 for z/OS Technical SupportData Management West [email protected]
IBM Software Group | DB2 Information Management Software
Software Announcements
• IBM Information on Demand– http://www-306.ibm.com/software/data/ondemandbusiness/index_products.html
– get the right information to the right people at the right time
– address the need to horizontally integrate information
– integrate, analyze, and optimize heterogeneous types and sources of business information throughout its lifecycle to manage risk and create new business insight.
• SOA– Information as a service
– z/OS new software offerings
– Architectural Premise• http://www-306.ibm.com/software/solutions/soa/
IBM Software Group | DB2 Information Management Software
IBM Information on Demand New Software Portfolio
– Business Process Innovation - Built on IBM's deep industry expertise and industry specific Information Framework Process and Data models these solutions focus on the integration of on demand information services such as search, analytics, data placement and synchronization to assure the right time delivery of information in-line and in-context for analysis.
– Business Analysis and Discovery - IBM's Business Analysis and Discovery solutions go beyond static reporting and information access to provide the industry's most advanced engine for analysis and discovery by enabling information to flow across the enterprise.
– Master Data Management - IBM's Master Data Management solution provides a complete set of services, technologies and solutions to create and maintain a "single version of truth" for enterprise data domains such as customer, product, supplier and constituent for all stakeholders across and beyond the enterprise.
– Risk & Compliance - IBM's Risk and Compliance Management Solutions enable clients to make the collection of compliance data a key business process, to increase the speed and cost effectiveness of meeting compliance requirements.
– Work Force Productivity - These solutions are focused on attacking information overload in today's work environments to help workers spend time using enhanced information to make better business decisions, not be overwhelmed by it. Our productivity solutions define opportunities to create employee work environments that are focused, relevant and actionable for all stakeholders to enable information to be used in smart and intelligent ways
– Business Performance & Process Management - These IBM solutions are built upon sense and respond frameworks to realize the adaptive, rather than reactive, enterprise. They provide line of business executives with critical information drawn and analyzed from across the enterprise to respond quickly to problems and exploit opportunities - offering insight never previously availed to power innovation for competitive advantage.
IBM Software Group | DB2 Information Management Software
Java Usage
• zAAP– Whitepaper references
• http://www-03.ibm.com/servers/eserver/zseries/zaap/faq/#faq19
• SQLJ vs JDBC– More and More questions on this topic
– It is a somewhat controversial argument
– SQLJ has definite advantages and is growing in popularity
– JDBC has “easier” prep process
IBM Software Group | DB2 Information Management Software
WLM Application Environments
IBM Software Group | DB2 Information Management Software
Maintenance
• Maintenance level– If You are on V8 you should be at 0511
• Most major performance PTFs
• Storage and CPU reductions
• UK09097 >> PK14393• LC32 for sequential Prefetch
• UK11702 >> PK14254• The infamous SQL -189
• Toleration of CCSID 0
• Only if DB2 coprocessor is utilized
IBM Software Group | DB2 Information Management Software
Maintenance
31
IBM Software Group
31
Most Important V8 Regression Apars in 20051. PK01911 6/05 Increased cpu time in Index and Storage processing,
sometimes accompanied by high LC32 contention 2. Insert
V7/V8 PQ87381 8/05 More robust free space search for Member Cluster tablespace
PK05644 11/05 Preformatting performance enhancement when small Priqtyand large Secqty
PQ99608 2/05 Excessive log write i/o’s
3. Incorrect Runstats values PK01510 5/05 NPI cluster ratio PK03469 5/05 Non-uniform distribution stats
4. PK04107 8/05 Bidirectional indexability between unicode and ebcdic table
5. PK10021 10/05 Restore parallelism in multi-row Fetch with host variable, parameter marker, special register
6. Utility PK04076 5/05 Load default of No Sortkeys if only one index and sorted
input PQ92757 4/05 Reduce below 16MB storage use by DFSORT
IBM Software Group | DB2 Information Management Software
Migration Notes
• Reduction in IRLM– You will note a reduction in locks and overall IRLM CPU
• Bind Performance– BIND performance can be up to 10x faster– Given the fact that in order to pick up fast column processing you must BIND– Have to BIND to pick up CM functionality
• CPU usage– If you don’t REBIND regression could be higher– Fetch intensive workloads can be higher– Maintenance relieves stress
• Puffing of DBRMs– Without rebind the skeletons in the EDM Pool will be puffed up to look like V8 structures when
they are loaded. – This applies to all modes of V8. – The puffing effect in terms of extra CPU is very minor
IBM Software Group | DB2 Information Management Software
DB2 Universal Database for z/OS
DB2 for z/OS and OS/390 - Product Lifecycle – Last Updated January 23, 2006
– The DB2 UDB for z/OS Product Lifecycle matrix displays the marketing and support services available to you over the life of your product. Hyperlinks are enabled to take you directly to the product announcement letter by simply selecting any of the dates listed. If your product or version is not listed on the Product Lifecycle chart below, it has probably reached End of Service. While every effort has been made to provide accurate information, the authoritative source for product information is the IBM announcement letters.
– All statements regarding the future direction and intent of IBM are subject to change or withdrawal without notice and represent goals and objectives only.
IBM Software Group | DB2 Information Management Software
Ver/Rel OS/Platform PID EOM EOS
8 z/OS 5625-DB2 TBD TBD
7 OS/390, z/OS 5675-DB2 2Q2006* September, 2007*
6 OS/390 5645-DB2 30-Jun-02 30-Jun-05
5 OS/390 5655-DB2 31-Dec-01 31-Dec-02
4 MVS/ESA 5695-DB2 01-Dec-00 31-Dec-01
3 MVS 5685-DB2 29-Feb-00 31-Jan-01
DB2 Universal Database for z/OSDB2 for z/OS and OS/390 - Product Lifecycle (cont….)
* Indicates projected date. Actual end of marketing or end of service date has not been announced yet.
IBM Software Group | DB2 Information Management Software
Available: May 18, 2006 11:00 a.m. Eastern Daylight TimeTarget Audience: Operations Management, Application Development ManagementTechnical Level: IntermediateDB2 as the central hub for information as a service, provides an unmatched IT infrastructure to solve your information-intensive business problems. Learn how the unique capabilities of DB2 for z/OS V9.1 and DB2 Tools, along with the rest of the IM portfolio, delivers unmatched capabilities that manage risk and streamline compliance, manage your information infrastructure, and delivers lower cost thru an optimized IT infrastructure. These new capabilities are critical to support key information-intensive applications that provide business advantage.
New features in DB2 for z/OS V9 & DB2 Tools continue to help solve your information-intensive business problems
IBM Software Group | DB2 Information Management Software
March 23, 2006, 11:00 am Eastern Standard Time Audience: CICS System Programmers, Operations Managers Technical level: Basic to Intermediate Description: Access to your VSAM data is critical for successful business operations. Any systems outage due to loss or corruption of that data can mean a significant business impact. Plus, during normal business operations, that data can be locked by batch jobs running against it, preventing online CICS® transactions from accessing and updating that data. What’s needed are tools to protect your VSAM data from loss and corruption, and to efficiently manage the allocation of data between batch and online systems.
In this teleconference, you’ll be introduced to CICS tools that can:
Automatically forward recovery of batch backout
Protect you from loss or damaged VSAM data caused by updates made by CICS transactions of batch jobs
Reduce the cost and effort required to manage access to VSAM data by online and batch systems
Achieve potential savings in licensing cost over your existing vendors’ recovery management and resource management tools
Your business could be at risk of losing or damaging critical data held in VSAM datasets. This teleconference can show you ways to cleanly manage the allocation of VSAM datasets between batch and online systems—while reducing the costs of VSAM recovery management and resource management.
Managing and Protecting Your VSAM Data
IBM Software Group | DB2 Information Management Software
Available in replay for your convenience, register now. Audience: Database Administrators, Systems Programmers, IT Architects, IT Management Technical Level: Intermediate Description:Today’s global economy drives high demands for IT. You’re expected to manage new and growing workloads while maintaining operational costs—and without sacrificing service levels to users. What’s required is an efficient and flexible database server to manage multiple complex workloads, including OLTP, Web-based applications, Business Intelligence and SAP.
You can learn how IBM DB2® for z/OS® Version 8, DB2 tools and z9™ or zSeries® provides an optimized infrastructure to manage information for diverse workloads securely and efficiently.The Webcast will discuss:
How to take advantage of DB2 for z/OS Version 8 in a System z9 or zSeries environment with new and growing workloads
How DB2 for z/OS Version 8, DB2 tools and System z9 or zSeries can help you manage the cost of managing information
How DB2 tools can help you optimize your existing investments and resources by reducing the complexity of managing data systems
Which DB2 tools can make database administrators more effective
When DB2 for z/OS Version 8 is optimized as a data server for new and existing workloads, it can provide performance for new and existing workloads in a cost effective way. By leveraging its capabilities and complementary DB2 tools, you can further improve productivity, while leveraging the function of DB2 for Information on Demand. Speakers: Roger Miller, DB2 for z/OS Version 8 Product Development, Thomas Ramey, Business Executive, Information Management – DB2 Tools More information
DB2 for z/OS and DB2 Tools: A Common ‘Cents’ Solution to Reduce Cost and Complexity
IBM Software Group | DB2 Information Management Software
Software Announcements Links– SW Webcasts
• http://www-306.ibm.com/software/os/zseries/events/
– HW Announcements z9• http://www-03.ibm.com/systems/z/feature112905/
• http://www-03.ibm.com/systems/systemz9/z9109/
– DB2 V8 Library refresh 2/2006• http://www-306.ibm.com/software/data/db2/zos/v8books.html
IBM Software Group | DB2 Information Management Software
Problem: The COPY utility with the SHRLEVEL(CHANGE) option keeps all of the objects in my list serialized (in UTRW status) for the entire duration of the utility. These objects cannot be used by other utility operations, such as LOAD or REORG, which are not compatible with COPY. How can I prevent COPY from keeping objects serialized for the entire duration of the COPY utility?
Solution: Specify the statement OPTIONS EVENT(ITEMERROR,SKIP) before the COPY statement with the SHRLEVEL(CHANGE) option.
If you specify OPTIONS EVENT(ITEMERROR,SKIP), each object in the list is placed in UTRW status and the read claim class is held only while the object is being copied. If you do not specify OPTIONS EVENT(ITEMERROR,SKIP), all of the objects in the list are placed in UTRW status and the read claim class is held on all objects for the entire duration of the COPY utility.
For more details, see APAR PQ74111
Preventing COPY SHRLEVEL(CHANGE) from keeping objects serialized for the entire duration of the COPY
IBM Software Group | DB2 Information Management Software
FAQ and more !!!
• Technical support page has a lot of usage information– It is DB2 z/OS Central
– http://www-306.ibm.com/software/data/db2/zos/support.html
• Highlights– How the EDMPOOL actually works in DB2 presentation
– Discussion of CURRENTDATA
– CCSID Casting
– Thread States
– And all sorts of stuff > Presentations, FAQs, User examples…
IBM Software Group | DB2 Information Management Software
IBM System z9 Integrated Information Processor (zIIP)
Enhanced Cryptography
Enhanced channels
Faster Processors, up to 54
More memory, better value, 64-bit virtual storage
New backup and restore
Multilevel Security
Unicode conversion
Compression
zSeries Application Assist Processor
z/Architecture™ new instructions
WLM enhanced …
IBM System z9, z/OS & DB2 for z/OS
IBM Software Group | DB2 Information Management Software
• IBM System z9 Integrated Information Processor (IBM zIIP) (planned for 2006)– Designed to improve resource optimization– Can help lower cost of computing for eligible workloads– Requires z/OS 1.6
• First IBM exploiter will be DB2 for z/OS V8
• System z9 Application Assist Processor (zAAP)– zAAPs support Java code execution
• z/OS Java Virtual Machines (JVMs) assist with the execution of code from standard processors to zAAPs• JVM executes the Java code on the zAAP
– Designed to provide a Single Tier integrated application and database serving environment– Requires z/OS 1.6
• Integrated Facility for Linux (IFL)– Provides additional processing capacity exclusively for Linux workloads– Runs Linux native or as a guest of z/VM® V4 and V5
• Internal Coupling Facility (ICF)– Provides additional processing capacity used for coupling to other processors
Specialty engines
IBM Software Group | DB2 Information Management Software
IBM Software Group | DB2 Information Management Software
IBM Software Group | DB2 Information Management Software
Specialty engines
z/OS LPAR
Application
Applicationnot on
System zTCP/IP
The IBM System z9 specialty engines can
operate on the same machine
together
(shown at left, instances where zIIP
can be employed)
Linux on System z LPARApplication
IFL
TCP/IPHiperSockets
DRDA
DB2
CP
z/OS LPARWAS Application
zAAP
TCP/IPHiperSockets
WASApplication
zAAP
zIIP
DRDA
DRDA
StarSchema
IBM Software Group | DB2 Information Management Software
• New specialty engine for the System z9 mainframe (planned for 2006) designed to help:
– Customers integrate data across the enterprise
– Improve resource optimization and lower the cost of ownership for eligible data serving workloads
• z/OS manages and directs work between the general purpose processor and the zIIP
– Number of zIIPs per z9-109 not to exceed number of standard processors
– No changes anticipated to DB2 for z/OS V8 applications
• DB2 for z/OS V8 will be first IBM exploiter of the zIIP with
– System z9 109
– z/OS 1.6 or later
– DB2 for z/OS V8
New IBM System z9 Integrated Information
Processor (IBM zIIP)
IBM Software Group | DB2 Information Management Software
2. Data warehousing applications*•Requests that utilize DB2 for z/OS V8 complex star schema parallel queries may have portions of these SQL requests directed to the zIIP when DB2 gives z/OS the necessary information
3. Some DB2 for z/OS V8 utilities*•A portion of DB2 utility functions used to maintain index maintenance structures (LOAD, REORG, and REBUILD INDEX) typically run during batch, can be redirected to zIIP.
1. ERP or CRM application serving*
•For applications, running on z/OS, UNIX®, Linux, Intel®, or Linux on System z that access DB2 for z/OS V8 on a System z9 109, via DRDA over a TCP/IP connection. DB2 gives z/OS the necessary information to have portions of these SQL requests directed to the zIIP
* The zIIP is designed so that a program can work with z/OS to have all or a portion of it’s Service Request Block (SRB) enclave work directed to the zIIP. The above types of DB2 V8 work are those executing in SRB enclaves, portions of which can be sent to the zIIP.
TCP/IP TCP/IPCP CP
New Engine
Types of DB2 for z/OS workloads that may benefit from zIIP
IBM Software Group | DB2 Information Management Software
The zIIP is designed so that a program can work with z/OS to have all or a portion of its enclave Service Request Block (SRB) work directed to the zIIP. The types of DB2 V8 work listed below are those executing in enclave SRBs, portions of which can be sent to the zIIP.
Example 1 = Distributed SQL requests (DRDA)
Queries that access DB2 for z/OS V8 via DRDA over a TCP/IP connection are dispatched within z/OS in enclave SRBs. z/OS directs a portion of this work to the zIIP.
Example 2 = Complex parallel query (BI)
Complex star schema parallel queries will now use enclave SRBs. z/OS directs a portion of this work to the zIIP.
Example 3 = DB2 utilities for index maintenance
DB2 utilities LOAD, REORG, and REBUILD will now use enclave SRBs for the portion of the processing that is related to index maintenance. z/OS directs a portion of this work to the zIIP.
How does the zIIP work .....
IBM Software Group | DB2 Information Management Software
• Utilization of the zIIP is expected to be transparent to the application.– No anticipated changes to applications that use DB2 for z/OS V8
• The enclave SRB interface is available upon request to non-IBM vendors as well.
– ISVs are interested
Important technical notes
IBM Software Group | DB2 Information Management Software
Some instances where zIIP would not be exploited
z/OS LPAR
Batch
WAS applications may access with a local Type2 JDBC access. For performance reasons, this is the recommended scenario as the WAS code was optimized for this configuration. No zIIP would be needed here.
DB2
CP
WASApplication zAAP
IMS™CICS®
QMF™ (TSO)
CPCP
CP
IBM Software Group | DB2 Information Management Software
1. Contact your regional DB2 Engine Specialist to assist with Data Gathering and Analysis
2. Engine Specialist contacts SVL coordinator for analysis or performs analysis locally
3. Provide info on LPAR config, DB2 related WLM service class and reporting class to cross check with DB2 data analysis
May have to modify WLM to add reporting classes
4. For estimation of Utilities and Star Schema work with local DB2 Engine Specialist for estimation
5. Make no assumptions about your eligible workload without involving DB2 Engine Specialist who will work with SVL
IBM Software Group | DB2 Information Management Software
SQL Replication
Nicknames
Staging Table
Log based
Trigger based
IMSDB2
Sybase
Oracle SQL Server
Informix
Admin
Control
FederationEngine
DB2
Sybase
Oracle SQL Server
Informix
Teradata
Nicknames
Apply
CD1CD
CD1CD
CD1CD
Control
Capture
Trigger
Log
IBM Software Group | DB2 Information Management Software
What is Q Replication ?
• New replication architecture– High throughput and low latency
– Multi-directional replication
– Event Publishing
• 1 transaction per message
• Highly parallel apply process
• Differentiated conflict detection and resolution
Control TablesControl Tables
Log based
Source
Admin
WebSphere MQ
Q Capture Q ApplyLog
Target
Informix Oracle
Nicknames
Stored Procedure
agentagentagent
SQL Server Sybase
IBM Software Group | DB2 Information Management Software
DB2 LUW “ VIPER”
IBM Software Group | DB2 Information Management Software
XML in DB2• "Feels" relational and/or XML
• Both SQL flavor and fully XML flavor
• XML *is* DB2 internals - XML Extender becomes one with the data engine
SERVERCLIENT
Data management client
Customer client application
SQL(X)
XQuery
DB2 Server
XMLInterface
RelationalInterface
XMLStorage
RelationalStorage
IBM Software Group | DB2 Information Management Software
Table Partitioning• What is Table (Range) Partitioning ?
– Storing a table in more than one physical object, across one or more table spaces
– Each table space contains a range of the data that can be found very efficiently
– Why?• Increase table capacity limit
• Increase large table manageability
• Improve SQL performance through partition elimination
• Provide fast & online data roll-in and roll-out
• Converge towards Informix functionality
• Family compatibility with DB2 on zOS and IDS
IBM Software Group | DB2 Information Management Software
Large Row Identifiers
• Increase In table size limits and rows per page– Tablespace level definition
– DMS Tablespace only
• ALTER TABLESPACE <name> CONVERT TO LARGE– Tablespace is locked, definition is modified and catalogues are updated
– Indexes will need to be reorganized• Every index for every table in the converted tablespace needs to be reorganized or rebuilt to
convert the RID entries from regular to large
IBM Software Group | DB2 Information Management Software
Previous Table Space Design
8KB
16KB
32KB
Page size
64GB
128GB
256GB
512GB
4KB
Table space size
Row ID (RID) 4 Bytes
4x109 Rows25516M
For tables in all table spaces (regular, temporary, DMS, SMS)
IBM Software Group | DB2 Information Management Software
New Large and Temporary Table Space Design
8KB
16KB
32KB
Page size
2TB
4TB
8TB
16TB
4KB
Table space size
Row ID (RID) 6 Bytes
1.1x1012 Rows512M ~2K
For tables in LARGE table spaces (DMS only)Also all SYSTEM and USER temporary table spaces
IBM Software Group | DB2 Information Management Software
Row Compression• Dictionary based - symbol table for compressing/decompressing data records
• Lempel-Ziv (LZ) based algorithm (static dictionary)
• Dictionary per table stored within the permanent table object (~74KB in size)
• Data resides compressed on pages (both on-disk and in bufferpool)– Significant I/O bandwidth savings
– Significant memory savings
– CPU costs: Rows must be decompressed before being processed for evaluation
• Log data from compressed records in compressed format
• Does not compress rows where no storage saving is realized for that row
• Repeating patterns within the data (and just within each row) is the key to good compression. Text data tends to compress well because of reoccurring strings as well as data with lots of repeating characters, leading or trailing blanks
IBM Software Group | DB2 Information Management Software
Education
• DB2 Version 8 Migration Workshops– Let us know if you need one
• DB2 Version 8 Transition class– CG381
• IBM DB2 Information Management Technical Conference– October 15-20, 2006
– Anaheim, CA
– http://www-304.ibm.com/jct03001c/services/learning/
• IDUG– May 7-11, 2006
– Tampa, FL
– w3.idug.org/na
IBM Software Group | DB2 Information Management Software
Best Practices Workshop for DB2 z/OS• zSeries skills aging/retiring/brand new and some of the basics are overlooked• Not a Health Check• 2-3 days onsite• Review of your DB2 Usage
– Zparms– Subsystem
• Tooling• Hardware/Software feature usage
– z/OS– DASD features, zSeries exploitation
• Monitoring strategy• How you can Exploit and Improve• Part of IBM zIAW• IBM may propose software/hardware solutions
IBM Software Group | DB2 Information Management Software
DB2 Redbooks - 2Q 2004 http://www.ibm.com/redbooks
• Coupling Facility Performance: A Real World Perspective (REDP-4414)– This Redpaper can help you understand the Coupling Facility technology and how different configuration options can
affect your workload. It describes how to configure your Coupling Facility to enhance performance and high availability in a zSeries Parallel Sysplex environment.
• DB2 UDB for z/OS: Design Guidelines for High Performance and Availability (SG24-7134)– Discussion of the techniques and guidelines for database and application design. We expect the best practices described
in this IBM Redbook will help DB2 professionals design high-performance and high-availability applications. • DB2 UDB for z/OS Version 8 Performance Topics (SG24-6465)
– February Update • DB2 UDB for z/OS Stored Procedures: Through the Call and Beyond (SG24-7083)
– February Update • DB2 Recovery with DB2 for z/OS (SG24-6370)
– The main concepts, and the primary components for possible solutions. We then describe the most common solutions, and implement several recovery scenarios. All tests were implemented with DB2 UDB for z/OS Version 8. Includes criteria for choosing a solution, and recommendations based on recovery best practices.
• DB2 for z/OS and WebSphere: The Perfect Couple (SG24-6319)– Provides a broad understanding of the installation, configuration, and use of the IBM DB2 Universal Driver for SQLJ and
JDBC in a DB2 for z/OS and OS/390 Version 7, and DB2 for z/OS Version 8 environment, with IBM WebSphere Application Server for z/OS for z/OS Version 5.02. It describes both type 2 and type 4 connectivity (including the XA transaction support) from a WebSphere Application Server on z/OS to a DB2 for z/OS and OS/390 database server. Demonstrates the advantages of SQLJ in a DB2 environment, the SQLJ support in the IBM application development tool WebSphere Studio Application Developer, as well as the SQLJ support for Enterprise JavaBeans using container-managed persistence.
IBM Software Group | DB2 Information Management Software
Reference URLs
http://www.ibm.com/software/data/db2/zos/index.htmlibm.com/software/db2zos DB2 for z/OSibm.com/software/db2zos/db2zosv8.html V8ibm.com/software/db2zos/support.html Supportibm.com/software/data/db2imstools/ Toolsibm.com/developerworks/db2 Applications
ftp site for papers, presentations:
Unicode: http://www-06.ibm.com/developerworks/library/whyunicode.html