4.technical infrastructure requirements-2.1

124
Thai Airways International Public Company Limited DATA WAREHOUSE System Functional 4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Since the workload and type of work done in a data warehousing environment is very different from traditional Online Transaction Processing (OLTP), this section pays attention to some of the items considered to be of high importance to data warehousing. This section should be the basis for vendor’s proposed technical strategy. 4.1. General Requirements 4.1.1 Vendor shall be able to perform the installation, configuration, implementation, and problem solving etc. during non-office hours. SF will responsible for system installation, configuration, implementation and problem solving during THAI office hours and non-office hours 4.1.2 Vendor shall provide all hardware, software and implementation services for successful implementation of the business services requirements in this RFP. SF will provide all hardware, software and implementation service for successful implementation 4.1.3 Vendor shall provide administration, operation, support and problem solving services after project go-live. SF will provide system administrator, operation process by provide dedicate technical support on site at THAI office 4.1.4 Vendor shall propose overall system architecture/infrastructure, components and configuration diagram with detail description including hardware and software specification. SF will provide overall system architecture/infrastructure, component and configuration diagram with detail description for all hardware and software for THAI 4.1.5 The proposed hardware and software should conform to existing THAI’s infrastructure as much as possible and the interface systems/equipments shall be provided. In case, proposed hardware or software does not conform to THAI’s infrastructure, its’ benefit/reasons shall be clearly defined. SF will provide hardware and software compile with THAI’s infrastructure. We will provide Oracle Exadata appliance data warehouse M9000 for application server, IBM 3584 for tape backup, EMC storage Cisco Giga Ethernet switch, EMC SAN switch 4.1.6 Vendor shall provide appropriate and sufficient hardware, software, equipments and all necessary items required for the successful implementation. If any of pre-requisite infrastructures at THAI is missing or insufficient, according to either DW solution or standard of THAI infrastructure requirements, it is vendor responsibility to provide them. 4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 11

Upload: arif-mohammed

Post on 02-May-2017

221 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTSSince the workload and type of work done in a data warehousing environment is very different from traditional Online Transaction Processing (OLTP), this section pays attention to some of the items considered to be of high importance to data warehousing. This section should be the basis for vendor’s proposed technical strategy.

4.1. General Requirements 4.1.1 Vendor shall be able to perform the installation, configuration, implementation, and

problem solving etc. during non-office hours.SF will responsible for system installation, configuration, implementation and problem solving during THAI office hours and non-office hours

4.1.2 Vendor shall provide all hardware, software and implementation services forsuccessful implementation of the business services requirements in this RFP.SF will provide all hardware, software and implementation service for successful

implementation4.1.3 Vendor shall provide administration, operation, support and problem solving services

after project go-live.SF will provide system administrator, operation process by provide dedicate technical support on site at THAI office

4.1.4 Vendor shall propose overall system architecture/infrastructure, components andconfiguration diagram with detail description including hardware and softwarespecification.SF will provide overall system architecture/infrastructure, component and configuration diagram with detail description for all hardware and software for THAI

4.1.5 The proposed hardware and software should conform to existing THAI’sinfrastructure as much as possible and the interface systems/equipments shall beprovided.

In case, proposed hardware or software does not conform to THAI’s infrastructure, its’ benefit/reasons shall be clearly defined.

SF will provide hardware and software compile with THAI’s infrastructure. We will provide

– Oracle Exadata appliance data warehouse – M9000 for application server, – IBM 3584 for tape backup,– EMC storage

Cisco Giga Ethernet switch, EMC SAN switch4.1.6 Vendor shall provide appropriate and sufficient hardware, software, equipments and

all necessary items required for the successful implementation. If any of pre-requisite

infrastructures at THAI is missing or insufficient, according to either DW solution or

standard of THAI infrastructure requirements, it is vendor responsibility to

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 11

Page 2: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

provide them.

For example, vendor shall provide sufficient hardware accessories such as UTP cable, fiber cable, fiber channel adapter, network adapter, mountable rack, etc. needed for successful connecting the proposed hardware to THAI’s corporate network, tape library and storage devices.

SF will provide appropriate and sufficient hardware, software, and equipment and all necessary items to ensure successful EDW implementation. SF will co-ordinate with THAI for

Design hardware, network diagram follow with THAI ‘s IT standard.

Prepare software pre-requisite installation Administrative and IT operation on proposed

systemOracle Exadata is appliance data warehouse hardware complete hardware and software configuration

Pre-configuration operation system , network

Pre-configure Infiniband network cabling

For networking of application server, console and backup system. SF will provide Cisco switch and SAN port adequate number of port. All of server, storage, backup system and network equipment will be install in rack. If propose EDW system need to be connected THAI’s infrastructure. For example we require to connect from propose SNA storage to existing THAI’s tape library. SF will response to do

4.2. Hardware Requirements 4.2.1 All proposed equipments shall be able to operate on 220V., 50Hz. and also delivered

together with the operation manuals & software drivers (if applicable).

Yes: Oracle Exadata for database engine can operate on 220V, 50Hz

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 12

Page 3: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4.2.2 Vendor shall install all proposed equipments at the location notified by THAI.

Yes: Oracle Exadata related server such as ELT, Mining, Business intelligent server, System monitoring will be installed at THAI data center. All production environment will be located at building 5 and mirror all data and configuration to standby environment at building 8. SF will provide document about site preparation for hardware installation for THAI to fill in before hardware delivery

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 13

Example of Oracle Exadata site preparation

Page 4: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4.2.3 Vendor shall propose hardware for development and production system with the same

platform.

Yes. Development server of database warehouse use same platform with production data warehouse.

List of development server Data warehouse database will use Oracle Exadata BI-EE and Essbase will use M9000

4.2.4 Proposed solution shall be able to manage, use, and administer as single

environment/console. Solution of system administrative, management and monitoring uses Oracle Enterprise Manager Grid Control. It is web base GUI. Enterprise Manager enables users to manage their applications from top to bottom - from monitoring service levels to proactively isolating business exceptions before they escalate to addressing issues at any level in the IT stack. Users can manage the entire application lifecycle with comprehensive application quality management and compliance solutions. Key features of Enterprise Manager:■ System Monitoring■ Managing Groups■ Job System

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 14

Page 5: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Oracle Enterprise Manager Grid Control Component

4.2.5 Vendor shall provide but not limited to the following hardware:

4.2.5.1 Sets of server nodes and completed components with adequate capacity and

good performance to operate the following items and all other required

servers to serve THAI’s business requirements.

Database Engine

ETL/ELT, Data Cleansing, and Data Quality

Business Intelligence Data Mining Metadata

Backup, Archive and Recovery

Management

Etc.

SF will provide adequate capacity and good performance of proposed hardware - 2 servers of Exadata database server (Production and Redundancy)

o Building 5 (Production) 1 Oracle Exadata server

Building 8 (Standby and Development) 1 Oracle Exadata server

- 4 set of work stations for console of ODI console BI-EE console Essbase console Mining console Oracle Grid console for system monitoring

- 2 set of M9000 server for BI-EE server Essbase server

SF will propose other equipment compile with THAI IT

2 Cisco Ethernet switch 2 EMC SAN switch

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 15

Page 6: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

2 EMC storage 1 Backup server 1 IBM 3584 Tape drive 52 LTO4 tape cartridge

-

4.2.5.2 All proposed hardware shall be able to operate for 24 hours x 7 days,

therefore, redundant, hot swappable, hot standby and fault tolerant hardware

is required. For example, the hardware provides the following high

availability features and require no additional effort to setup, configure and

administer:

Mirrored operating system disks

All proposed servers and workstation would set mirroring for internal disk configuration to OS and software installation. Each server will have 2 disks as minimum

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 16

Page 7: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Database in Oracle Exadata is mirrored across cells to ensure that the failure of a cell does not cause loss of data or availability. The scale-out architecture achieves near infinite scalability, while lowering costs by allowing storage to be purchased incrementally on demand.

ASM mirroring, and the hot swap capability of the Exadata cell, provides transparent data protection and access across disk failures.

ASM provides for double or triple mirroring to tailor the protection to the criticality of the data.

ASM failure groups are automatically created with Exadata to provide transparent data protection and access across cell failures.

‘exadata_technical_whitepaper page 24,25’

Dual redundant power cables to enable connection to redundant power circuits.

Oracle Exadata provide redundancy of power supply and PDU (power distribution unit) and also fan for database server and storage server. For other proposed hardware and equipment also have redundancy power supply

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 17

Page 8: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Redundancy of power supply for database server in Oracle Exadata

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 18

Page 9: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Redundancy of power supply of storage server in Oracle Exadata

Dual redundant hardware components including but not limited to host bus adapters, network connections, fiber channel connections to the disk arrays, disk array controllers and RAID 1 disk mirroring. Yes. All proposed application servers BI-EE and Essbase will have

Minimum 2 of Quad gigabit Ethernet card and also redundant network cabling to Cisco switch

BI-EE and Essbase server will have 2 fibers channel cable to SAN switch

Oracle Exadata Exadata is designed to be connected to two separate InfiniBand switches forhigh availability. The dual port card is only for availability. Each port of the InfiniBand card is capable of transferring the full data bandwidth generated by the storage cell. The loss of one network will not impact the performance of the storage cell. Exadata cell will providesFor Database server in Oracle Exadata will have following redundancy

equipment Dual-port QDR (40Gb/s) InfiniBand Host Channel Adapter (HCA) and

redundant infinband cable connect to redundant infiniband switch 4 embedded Gigabit network ports to redundancy of data and

network path.

‘owner_guide page 1-3,1-4’

For storage server in Oracle will provide Disk controller HBA with 512 MB battery-backed write cache

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 19

Page 10: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Dual-port QDR (40Gb/s) InfiniBand Host Channel Adapter (HCA) and redundant infiniband cable connect to redundant infiniband switch

Ex_ug page 2-7

Hot standby Node

Hot standby of Database engine Oracle database run in Oracle Exadata will have Oracle Data Guard is the software feature of Oracle Database that creates, maintains, and monitors one or more standby databases to protect your database from failures, disasters, errors, and corruptions. Data Guard works unmodified with Exadata and can be used for both production and standby databases. By using Active Data Guard with Exadata storage, queries and reports can be offloaded from the production database to an extremely fast standby database and ensure that critical work on the production database is not impacted while still providing disaster protection We can setup oracle data guard between building 5 (production database) and building 8 (standby database)Refer ‘exadata_technical_whitepaper page 26 Hot standby of other proposed servers All of other proposed servers. SF will provide same hardware model and configuration of BI-EE and Essbase server. They will be connected all the EMC SAN storage installed at building 8 and building 5 and using feature of storage replicate to symphonize all data and configuration. In case of site failure. THAI can switch on BI-EE and Essbase at standby site

Etc.

<Please compile this paragraph here : is it support all the feature THAI requires?>

4.2.5.3 Proposed hardware for database engine shall be able to operate in MPP

(Massive Parallel Processing) shared-nothing environment and shall provide

the following features;

Sun Oracle Database Machine, a building-block methodology is used that allows the largest Sun Oracle Database Machine Full Rack to quickly and easily scale to any size. Sun Oracle Database Machine Full Racks can be coupled using the integrated InfiniBand fabric. As new racks of Sun Oracle Database Machines are incrementally added to a system, the storage capacity and performance of the system grows; a two-rack system is simply twice as powerful as a single rack system, providing double the through put and double the storage capacity. Scaling out is easy: Oracle Real Application Clusters (RAC) can dynamically add more processing power and Automatic Storage Management (ASM) can dynamically rebalance the data across Exadata Storage servers to fully utilize all the hardware in each configuration.

Linear scalability

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 20

Page 11: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Database Scalability

By default, in an Oracle RAC environment, a SQL statement executed in parallel can run across all of the nodes in the cluster. For this cross-node or inter-node parallel execution to perform the. A run-time failover for high-availability environments, such as Oracle Real Application Clusters that refers to the failover and re-establishment of application-to-service connections. It enables client applications to automatically reconnect to the database if the connection fails, and, optionally, resume a SELECT statement that was in progress.

Storage Scalability: Oracle Exadata use Oracle ASM instance handles placement of data files on disks, operating as a metadata manager. The Oracle ASM instance is primarily active during file creation and extension, or during disk rebalancing following a configuration change. Run-time I/O operations are sent directly from the database to storage cells without passing through an Oracle ASM instance.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 21

Production Database (Building 5)

Standby Database (Building 8)

Page 12: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Balance workload automatically, such that workload is distributed most efficiently.

Oracle Real Application Cluster(RAC) can manage workload automatically by use Runtime Connection Load Balancing feature.App. work requests to RAC instances are assigned on a random basis, which is suitable when each instance is performing equally well. However, if one of the instances becomes more burdened than the others because of the amount of work resulting from each connection assignment, the random model does not perform optimally.The Runtime Connection Load Balancing feature provides assignment of connections based on feedback from the instances in the RAC cluster. The Connection Cache assigns connections to clients on the basis of a relative number indicating what percentage of work requests each instance should handle.In the diagram in the slide, the feedback indicates that the EDW service on Inst1 is so busy that it should service only 10% of the EDW work requests; Inst2 is so lightly loaded that it should service 60%; and Inst3 is somewhere in the middle, servicing 30% of requests. Note that these percentages apply to, and the decision is made on, a per service basis. In this example, EDW is the service in question.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 22

Page 13: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Real Application Clusters Administration and Deployment Guide page 4-2

Refer to ds-rac_11gr2 page1,2

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 23

Page 14: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Automatically and evenly distribute data to all units of parallelism. Oracle Exadata use Oracle Automatic Storage Management (Oracle ASM) to

distributedata evenly across the cells. Because Exadata Cell supports dynamic disk insertion and removal, the online dynamic data redistribution feature of Oracle ASM ensures that data is appropriately balanced across the newly added, or remaining, disks without interrupting database processing ‘exadata_storage_ug page 1-2’

Support data high availability when node(s) in the MPP environment failed, the other/stand by node(s) shall be able to automatically take the failed node’s resources and make the data available to users.

Oracle Exadata production is installed at building 8 will provides high availability environment as following High Availability Features • Redundant power supplies for all servers • Redundant InfiniBand switches • Oracle Automatic Storage Management: All database files mirrored; disk failures do not interrupt query processing

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 24

Disk GroupDisk B Disk C Disk DDisk A

ASM File26

37

48

15

Allocation Units(One per File Extent initially)

Page 15: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

• Oracle Real Application Clusters: database server failures are tolerated • Oracle Exadata Storage Server Software: storage server failures are tolerated • Backup is performed using Oracle Recovery Manager • Point in time restores are performed using Oracle Flashback Technologies ‘refer to ds_db_machine page 6’

We also propose high availability of database engine between production environment (building 5) and standby (building 8) environment using Oracle Data Guard. Oracle Exadata at building 8 site hosts the disaster recovery database instance; it receives transaction logs from production and applies them to the secondary instance. Under a site-wide failure scenario the secondary site activates as the primary instance – whilst Oracle Dataguard can detect when the primary instance has failed and activate the standby, typically this is a manual procedure as a site wide failure is typically a serious scenario and the decision declare a disaster is typically a business oneOracle data guard provide data high availability between build 5 (production) and building 8 (standby)

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 25

DB Server DB Server DB Server

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

Exadata Cell

DB Server

Redundancy infiniband switch

Oracle Real Application Cluster (RAC) for database redundancy

Oracle Automatic Storage Management (ASM)

Storage redundancy

Page 16: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Proposed hardware shall support co-existence of multiple generations of hardware (without hardware performance downgrade) in a single platform reducing the need to dispose of existing hardware when more capacity is required. Exadata is a joint offering from Oracle and Sun Microsystems. Sun is providing the hardware technology used in the Database Machine and Exadata Storage Server. Oracle is providing the software to impart database intelligence to the storage and Database Machine and is tightly integrated with the Oracle Database and all its features. The Sun servers combine the power of the latest generation of Intel® Xeon® processors with Sun's system engineering expertise. These servers offer the needed density and expandability to satisfy the most demanding datacenter applications. The Oracle and Sun partnership makes possible the delivery of the Sun Oracle Database Machine and Exadata Storage Server and the revolutionary capabilities it provides.

‘oracle_technical_whitepaper page 2’

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 26

O r a c l e A r c h i v e d l o g

T H A I E D W P r o d u c t i o nB u i l d i n g 5

T H A I E D W S t a n d b yB u i l d i n g 8

E t h e r n e t N e t w o r k

Page 17: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4.2.5.4 Proposed hardware for backup, archive and recovery managements shouldbe conform to the following requirements: -

Able to operate on UNIX-based SUN Solaris 10 or

up. Able to operate on SUN E25K or M9000 model Comment for Gartner base on Oracle Exadata V1 publication Date: 29 September 2008. Please noted now Oracle has changed to Oracle Exadata V2 use SUN platform

Oracle Exadata is appliance enterprise data warehouse solution which oracle has best practice of enterprise data warehouse solution. Oracle database and Oracle Exadata storage server has backup solution to getting extreme backup performance by using Oracle technology and performance. Main feature for the solution

Using Recovery Manager (RMAN) automatically parallelizes backup operations across all database nodes and Exadata storage cells. This allows all the disks, all the network connections, and all the CPUs in the system to contribute to performing backup operations.

The InfiniBand network provides an extremely high performance network for transferring backup data from storage servers to database servers and then to tape media servers. Not only are the transfer rates high, the CPU utilization of InfiniBand network transfers is very low.

he block change tracking feature of the Oracle Database allows incremental backups to run very quickly and efficiently. With block change tracking, only the areas of the database that have been modified need to be read from disk.

Exadata storage has very highly optimized disk I/O capabilities. Each Exadata Storage Server can achieve a disk transfer rate of over 1000 MB/sec with just 12 disk drives.

Exadata has offload capabilities that further speed up incremental backups. When changed blocks and unchanged blocks are near each other on disk, The Exadata offload capability combines with block change tracking to perform very efficient large I/Os at the storage level, while returning only individual changed blocks to the database level.

SF will follow Oracle Exadata backup solution benchmark using as testing paper HPDL360 and IBM3584 LTO4 tape drive

Refer to

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 27

Page 18: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

MAA_WP_TapeBackup_on_Exadata_2009_final.pdf page 1,2

Provide adequate equipments and software license to support LAN-Free backup for all proposed servers.SF will provide adequate equipments to complete Oracle Exadata backup

solution Propose backup model SUN x4170 and IBM 3584 tape drive and EMC

SAN storage for backup staging disk Veritas Netbackup Enterprise Client v7

Oracle Exadata has LAN free backup solution by connecting backup server to infiband in side Oracle Exadata RACK and connect from backup server to b IBM Tape 3584 The InfiniBand network provides an extremely high performance network for transferring backup data from storage servers to database servers and then to tape media servers. Not only are the transfer rates high, the CPU utilization of InfiniBand network transfers is very low The diagram in Figure 1 represents a single media server configuration for customers that require a data transfer rate of up to 5.6 TB/hour (1.6 GB/sec). The effective backup rate depends on the type of RMAN backup. For a full backup, the backup rate is 5.6 TB/hour (1.6 GB/sec). For a differential or cumulative incremental backup where only 10% of the database has changed, the effective incremental backup rate was measured to be 47 TB/hour (13 GB/sec) and where 20% of the database has changed the effective incremental backup rate was 24 TB/hour (6.8 GB/sec). Refer to MAA_WP_TapeBackup_on_Exadata_2009_final.pdf page 8

4.2.5.5 Vendors will be at an advantage if they are able to proposed hardware

for other servers outside database engine and backup, archive and recovery

management and able to operate on one of current THAI’s consolidate

server infrastructure as defined in the hardware and software specification

for THAI’s consolidate server items in Appendix-B and as details in the

following items.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 28

LAN Free: Backup server is connected directly to Innifiband switch

Page 19: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

For Intel-Based Server, brand name to include DELL, HP, IBM, HP,

NEC or Fujitzu, operating system which should support: -

• Microsoft Window 2003 up that could operate on consolidate

server VMWare ESX 3.5 or up

For UNIX-Based, operating system which should support: -

• AIX 5.3 up that could operate on consolidate server IBM Unix

platform, or

• Solaris 10 up that could operate on consolidate server SUN

E25K/M9000 up.

Since THAI now has inadequate server resource, vendor should propose new box for all server types mentioned above.

SF will propose new hardware outside database engine conform with THAI IT standard

Intel base SF will propose SUN x4170 and running Window 2003 for Backup server installed within Oracle Exadata production RACK at building 5

4.2.5.6 Vendors will be at an advantage if they are able to proposed storage and

tape media that conform to current THAI’s infrastructure as defined in

Appendix-B for example:-

Fiber Channel Storage EMC: CX3-80 and CX4-960 (hot swappable fiber disk with 4Gbs and 15 Krpm) SF will propose fiber channel disk , speed 15Krpm . The FC disks will be installed into existing EMC CX4-960 for production and standby datacenter and also provide SATA disks installed into EMC CX-700 for each datacenter

SAN Switch Connectrix ED-24000B, ED-48000 SF will provide SAN Switch Connectrix ED-48000 installed into existing THAI’s EMC SAN Switch, we will provide 2 sets for production datacenter and 2 sets for standby datacenter

Tape Drives with certified to install with THAI existing Tape Library system: IBM3584. Below are the minimum technical requirements for Tape Drive Unit and frame of Tape Library vendor should provide Tape library frame to complete the installation for THAI.. SF will propose IBM 3584 LTO4 tape drive support to install into existing THAI’s IBM tape library. The propose tape library will conform with THAI’s tape

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 29

Page 20: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

• Drive Type : Minimum LTO-4 (minimum transfer rate of 120

MB/s) • Drive interface : 4 Gb Fiber channel interface per connection • Mixed media supported : Support media type of LTO3 and

LTO-4 • Able to operate with EMC storage CLARion CX700 and SAN

Switch Connectrix ED-24000B and ED-48000B

Data Cartridge • Data Cartridge Media Capacity: Minimum LTO-4 (800 GB/1.6

TB per cartridge) • Equip with barcode scan engine to be able to scan and read

barcode from cartridge tape • Number of Barcode Label provided

<Please compile this paragraph here : HW Specification should be here. Or we can refer to the catalogue.>4.2.5.7 Hardware Sizing Requirements

All propose hardware shall cover initial data, history data with data and workload growth of 5% per year for at least 3 years.

Capacity of the provided hardware and sizing calculation shall be:-

• Able to accommodate growth of concurrent users from 50 to 100

users.

SF will propose system will support growth of concurrent user from 50 to 100 users. M9000 server a

• Able to serve Recovery Point Objective (RPO) within 24 hours

and Recovery Time Objective (RTO) within 12 hours.

The propose infrastructure will support RPO within 24 hours and RTO with on 12 hours. For application server (BI-EE and Essbase). Production of BI-EE and Essbase server at building 5 will be connected to EMC SAN storage and we have same configuration at standby building 8. We will use SAN real time synchronization technology to synchronize data in EMC SAN between building 5 and building 8. In case of system or site failure at production site. THAI can switch over to utilize infrastructure of standby

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 30

Page 21: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

For database engine layer. There are 2 kind of outage can be protected by our solution The production of oracle database building 5 has RAC to

protect database engine. In case of system failure occurred it will automatically connect to available database instance.

Oracle Data Guard configuration between production Oracle database at building 5 and standby database building 8 will protect data failure of production database. The production database will ship Oracle archive log to standby database and standby database retrieve and recover. Refer MAA_WP_10gR2_Roadmap.pdf page 4

• Able to support DW connection from clients in Thailand and

station abroad.

Yes. All clients in Thailand and station aboard will able to connect reporting server (OBI-EE). OBI-EE provides web-base interface

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 31

RAC: protect database engine failure

Data Guard: protect data and site failure

Page 22: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 32

Page 23: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Provide adequate servers, processors, memory, storage, network interface card, host bus adapter and all requiredequipments/accessories to serve workload and growth required byDW and business requirements with user acceptable reliable, performance and response time. SF will provide adequateVendor shall provide detail hardware specification for each set of the following servers with detail calculation method: -

• Database Engine

• ETL/ELT, Data Cleansing, and Data Quality

• Business Intelligence

• Data Mining

• Metadata

• Backup, Archive and Recovery Management

SF will provide list of server refer to document THAI_EDW_HW.xlsProvide adequate high speed disk storage and all required components to support raw data size as estimated in Appendix-A and shall serve the following requirements: -

• Adequate to keep all designed layers for DW including semantic

and OLAP layers which shall be directly accessed by business

intelligence and data mining tools. The Sun Oracle Exadata Storage Server comes with either twelve 600 GB Serial Attached SCSI (SAS) disks or twelve 2 TB Serial Advanced Technology Attachment (SATA) disks. SAS based Exadata Storage Servers provide up to 2 TB of uncompressed user data capacity, and up to 1.5 GB/second of raw data bandwidth. SATA based Exadata Storage Servers provide up to 7 TB of uncompressed user data capacity, and up to 0.85 GB/second of raw data bandwidth. The performance that each cell delivers is extremely high due to

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 33

Page 24: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

the Exadata Smart Flash Cache. The automated caching of the Flash cache enables each Exadata cell to deliver up to 3.6 GB/second bandwidth and 75,000 IOPS when accessing uncompressed data. Refer exadata-technical-whitepaper.pdf page 5,6 and 10

Exadata Storage performance on single server SF will provide Oracle Exadata Haft Rack SAS disk configuration for production database and Oracle Exadata Quarter Rack SATA disk configuration for standby database

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 34

F20 Sun Flash Card

Oracle Exadata Storage Cell

Page 25: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

THAI transactional information will be keep in SAS storage. For example THAI is keep as PNR or Flown data on SAS storage, they will get 10.5 GB/s for data throughput but if THAI is able to cache these table flash cache storage. So THAI will get 25GB/s data throughput

Example command to cache table from SAS to flash cache

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 35

Storage performance for Standby database engine at building 8 using SATA disk configuration

Storage performance for Standby database engine at building 8 using SAS disk configuration

Flash Cache data bandwidth

Flash Cache data throughput

Page 26: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Exadata_Storage_UG_e13861.pdf page 17.18Oracle Exadata for production will provide SUN Flash Card total size 2.6 TB and 1.1 TB for standby database. THAI can keep summary, aggregate tables or OLTP table on it. SUN Flash card will provide high performance access as following

• Adequate to keep database and data repository required for all

proposed software such as ETL/ELT, Metadata, Business

Intelligence, Data Mining, etc.

Oracle database 11gR2 is installed Oracle Exadata will be repository of ODI repository and Business Intelligence repository. For Data mining, Oracle use in database mining. So Mining tool call Oracle DataMinnner will direct connect to oracle database

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 36

ODI Repositoy

BI-EERepository

BI-EEODI

Oracle 11gR2 Enterprise Edition

THAI Transactiondata

SAS14TB

Mining

Ethernet

Mining data

Flash 2.6TB

Repository are created with in Oracle Database on Oracle Exadata

Page 27: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

• Adequate to keep interim data required by ETL/ELT/Cleansing/

data quality process that extract, transform, cleansing data from

both THAI’s internal or external data sources into target DW and

also interim data out of DW to other required systems.

We are estimate size of THAI data warehouse is 3TB. For cleansing data and data quality will keep with Oracle database by ODI engine. Production database will have available capacity 14TB. It is enough to keep all cleansing and data quality data inside database. Oracle Exadata is able spilt multiple disk volume size. For example, we can create 2 kind of disk group, 4 TB disk group will crated for THAI data warehouse database and 6 TB disk group will created for staging area database. So THAI can manipulate staging area to keep all ODI processing data separate to transactional data

Example separate disk group for EDW data and staging data

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 37

Allocated for THAI EDW transactional data at

ASM cluster 1 Data Disk Group

Allocated for THAI staging area at

ASM cluster 2 Data Disk Group

Page 28: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

• Adequate storage to keep staging of backup, archive log and

interim data for at least 2 weeks retention before transfer to tape.

Sizing of Oracle Exadata at production building 5 will have capacity 14 TB and we also propose Oracle Exadata at standby building 8, which has capacity 21TB. Database at standby site will keep synchronize with production. So Standby database has enough space for THAI can duplicate database as archive database by using RMAN duplicate database command and we also provide external EMC SAN storage 4 TB to keep backup staging disk

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 38

Page 29: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Provide adequate SAN Switch port for both unit (ED24000B and ED 48000B) if required and one server shall be connected to two SAN switch for high availability reason.

SF will propose SAN switch port installed exiting ED4800B Yes SF will propose EMC ED4800B SAN switch 4 items .2 set will be installed building 5 and the rest install at building 8

Vendor can propose new SAN switch with the same or higher class (enterprise) and newer model.

Yes SF will propose SAN switch model..Provide the estimate number of IP, LAN port, Heart Beat port, SAN switch port, NTP, etc. those required from THAI’s infrastructure. In Oracle Exadata each database server and Exadata Storage Server has two interfaces for management. One provides management access to the operating system, and theother provides access to the Integrated Lights Out Manager. Both interfaces

areconnected to the Ethernet switch on the rack. Cabling or configuration

changes tothese interfaces on Exadata Storage Servers is not permitted.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 39

Page 30: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 40

Assigned IP from THAI Request network port

Database Engine building 5 26 9

ODI and Mining console 1 2BI-EE 1 2

Ess Base 1 2

Backup server 1 2

Total

Page 31: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 41

THAI IP address THAI network port

Database Engine building 8 14 7

ODI and Mining console Standby

1 2

BI-EE standby 1 2

Ess Base standby 1 2

BI-EE and Essbase for development

1 2

Total

Page 32: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 42

Exadata provide Cisco switch for remote management in side Oracle Exadata RACK

Page 33: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

The network bandwidth shall be estimated to accommodate the connection from clients in Thailand and station abroad to DW for all kinds of services.

Yes, Oracle BI-EE is web base interface, so all of THAI employee in Thailand and abroad can access to the system

Sizing calculation method shall be clearly defined for infrastructure requirements and all proposed hardware sizing.

Get from FT

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 43

Page 34: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Provide adequate backup equipments for the proposed backup and recovery solution with following requirements.

(The proposed hardware should conform to existing THAI’s infrastructure as defined in item 4.2.5.5.)

• Backup Server, which is able to accommodate back up window

time - maximum 6 hours per day. SF will provide backup solution to support maximum backup windows 6 hour. Oracle Exadata backup solution use infiniband switch and staging backup data to external disk storage. Oracle recommends the following best practices for performing backups to tape in a data warehouse environment:

• Perform level 0 and differential backups Create a level 0 (full) backup once a week Create a differential incremental backup daily Oracle further optimizes incremental backups by:

• Using incremental backups, which: • Reduced system utilization in all cases

• Reduced backup times in cases where the percent of database blocks changed between incremental backups was less than 40%

• Using a block change tracking file to identify changed blocks for incremental backups. By reading the small bitmap file to determine which blocks changed, RMAN avoids having to scan every block in the data file that it is backing up. With Exadata, more data block inspection is offloaded from the database server.refer ‘maa_wb_backup page 11’

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 44

Backup windows time 5.6TB/HourLAN-Free backup architecture for Oracle Exadata

Page 35: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

• Adequate tape drive units and frames of tape library, which are

able to serve the above backup windows requirements. Adequate data cartridges to keep monthly, weekly and daily backup of the DW built from the estimate of raw data size defined in Appendix-A and growth including interim data required by ETL/ELT/Cleansing/ data quality process with retention for 3 months. Adequate data cartridges to create daily copy.<Please compile this paragraph here :>

4.2.6 Vendor is responsible to perform UTP cabling for connecting servers and console to

THAI’s corporate network and is responsible to perform cabling to THAI’s storage

and Tape backup as defined in Cable Wiring Requirements

Cable Wiring Requirements

4.2.6.1 UTP Cabling for connecting server and switch to corporate network(support 1 Gb connection). The number of points required shall beaccommodated the proposed solution requirement.

Vendor is responsible for LAN wiring in THAI’s office according to the provided floor layout and LAN configuration.

Standard UTP CAT 6 is recommended to use for LAN cables with supported minimum data transfer speed 1 Gbps and supported frequency 250 MHz.

In case of open ceiling, UTP cable shall be wired in EMT conduit and close- ceiling or T-Bar ceiling UTP cable shall be wired in flexible conduit and clamped on ceiling or laid-on wire way cable tray.

Each location shall be equipped with patch panel for CAT 6 RJ-45 modular jack (Female) - and CAT 6 RJ-45 modular plug (male) with color plug boot.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 45

Page 36: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Each face plate & the end of cable shall be labeled (Nameplate & Shrink Tube Wire Marker) with Thai standard- code 9 digits. Example: "aabbccddd" aa: Building No., bb: Source Floor, cc: Destination Floor, - ddd: Cable running No.

No connection within Ethernet standard range 100 meters.

Vendor shall provide at least 10 meters of UTP CAT 6 Patch cord (molded type) with 2 male RJ-45 modular plugs & Color plugs- boot for Server side and Network side.

Vendor shall provide UTP CAT6 cable (basic link) and design by THAI (Length , Position).

Vender shall provide Wire Management Panel with Cover )ifrequired.(

Modular plug (Male) with FIX Jacket RJ-45 CAT 6.

Modular jack (Female) RJ-45 CAT 6 Keystone Lead frame technology can be mounted to face plate or blank Patch Panel.

Standard CAT6 cable, Modular plug (Male) & Modular jack (Female) RJ-45 preferable: AMP, BICC, AT&T, ALANTEK, HUBELL, AVAYA, BELDEN, PANDUIT. Ccc

Blank Patch Panel: 24-ports Modular Blank 19 inches used formounting modular jack and rack.

Vendor shall connect cable to Server, Switch, NAS, SAN or Network Equipment.

Vendor shall test all cables (end-to-end) by cable tester with report for each cable standard TIA/EIA 568B - ISO11801. (Example: Length, Attenuation, Resistance, Impedance) and test for CAT6 channel only.

Vendor shall provide cable number on drawing floor layout (AutoCAD or Visio files format and- Printed on papers).

Repair or replacement of defected equipment shall be completed within the period defined in hardware remedy services after receiving notification of failure and the vendor shall check end-to-end point with TIA/EIA 568B - ISO11801 standard. <Please compile this paragraph here :>

4.2.6.2 Fiber Optic cabling

Vendor is responsible to perform the cable wiring in THAI Office for connecting server to SAN Switch, from SAN Switch to Tape drive (if required), from disk storage to SAN Switch (if required).

Standard fiber cable with supported minimum data transfer speed 4 Gbps.

Vendor shall install fiber optic patch cable in flexible conduit.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 46

Page 37: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

The end of flexible conduit shall be fixing at on back of racks.

Vendor shall provide fiber optic, fiber optic cabling and fiber optic patch (if required).

Vendor shall install exceed length of fiber optic patch cable on shelf at Server rack.

Vendor shall label origination and destination at the end of fiber optic patch cable. <Please compile this paragraph here :>

4.3 Network Requirements 4.3.1 Vendor shall provide WS-X6148A-GE-TX Ethernet Port 10/100/1000 RJ-45 48 Ports

at least 2 Modules.

Yes SF will provide WS-X6148A-GE-TX Ethernet Port 10/100/1000 RJ-45 48 Ports 2 modules

4.4 Software Requirements 4.4.1 Vendor is requested to propose complete set of software licenses to serve all THAI’s

DW solutions, business requirements, infrastructure requirements and related

development tools with license certificate issued by product owner, and also at least

one complete set of software media. Vendor is also responsible to ensure that all

software licenses are properly validated and registered.

SF will propose set of software license to server all THAI’s DW solution. The license will serve database engine, application, and development tool. The propose software will compatible with propose operating system version. Refer to proposelicense.xls

4.4.2 Adequate numbers of software licenses shall be provided to serve all

user/administrator clients, control agents, server nodes and all business required in

this RFP.

SF will propose adequate number of software license server all4.4.3 The proposed software for system administrator, system operator and database

administrator shall provide GUI and/or web-based user interface using Internet

Explorer. SF will propose Oracle Enterprise Manager Grid Control. It comes with a comprehensive set of performance and health metrics that enables automated monitoring of key components in your environment, such as applications, application servers, databases, as well as the back-end components on which they rely (hosts, operating systems, storage)

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 47

Topology View for Infrastructure

Page 38: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Oracle Data Integrator comes with built-in a designer with graphical point-and-click interface. The designer is a tool allows developers or business users to specify the rules to apply to integration processes. With declarative design, the number and complexity of steps is greatly reduced, which in turn shortens implementation times. Automatic code generation reduces the learning curve for integration developers and streamlines access by non-IT professionals to the definition of their integration processes and data formats.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 48

Page 39: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4.4.4 The proposed software for business services shall provide web-based user interface

using Internet Explorer.

<Please compile this paragraph here :>4.4.5 Vendor is responsible to install operating system, fixes/patches and all required

drivers as agreed with THAI technical support staff.

Apply or Roll back patch by OEM

4.4.6 Vendor is also responsible to install and configure all proposed software and all

required third party software.

Oracle Exadata will implement by Oracle Advance Customer Service and co-operate with SF and THAI’s infrastructure and DBA team to prepare infrastructure and software pre-requisite requirement. Oracle Advance Customer Service will install and configure your Database Machine at your delivery location. These services include:

Install and Configure Exadata Storage Servers

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 49

Page 40: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Configure logins and network addresses

•Create a cell, cell disks, and grid disks

•Set up configuration files for a database server host

•Configure shared storage to support Oracle Real Application Clusters

Install and Configure Database Servers

•Configure logins and network addresses

•Install ASM, CRS, Database

•Install Database Machine patches

•Create an ASM disk group for Oracle Exadata Storage Server Software

•Create default Oracle database

Post-Installation Tasks

•Verify performance via predefined test

•Document configuration and maintenance procedures

refer to

For other server. SF will responsible to install and configuration third party application.

4.4.7 The proposed software should conform and be able to interface with existing THAI’sinfrastructure as defined in Appendix-B. For example: -

4.4.7.1 Support THAI’s operating system

Sun Solaris V10

IBM AIX V 5.3 or up

Windows 2003 or up (under VMWare ESX 3.5 or

up) VMWare ESX 3.5 or up

SF will propose operating system on propose hardware

Application server (OBI-EE and Essbase) is SUN Solaris V10

Console of ODI, OBI-EE, Mining and Monitoring is Window Vista

4.4.7.2 Support THAI’s backup services

system

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 50

Page 41: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Veritas NetBackup 6.5 or up

IBM 3584 - Tape Library for Distributed Systems SF will propose backup software Veritas Netbackup enterprise client 6.5, it will install on Oracle Exadata backup server and propose IBM 3584 tape drive , installed in existing THAI’s backup server robot

4.4.7.3 Support THAI’s interface software between Tape Drive and Backup Server

as following detail (license per tape drive shall be provided):

VRTS Netbackup option shared storage for tape 6.5 XPLAT STD BAND S

VRTS Netbackup library based tape drive 6.5 XPLAT STD BAND S

SF will propose VRTS Netbackup option shared storage for tape 6.5 XPLAT STD BAND

4.4.7.4 Support THAI’s high availability system

Storage Foundation & HA v5 or up.

Veritas Cluster v5 or up

SF will propose Storage Foundation & HA V5 and Veritas Cluster V5, The software will installed on application server on both production and standby environment for application server high availability

4.4.7.5 Support THAI’s database management system

IBM DB2 for AIX V 8.2 or up

ORACLE for Solaris V10g or up

Database on Oracle Database 11gR2 enterprise Edition. Oracle Database 11g Release 2 has been significantly enhanced to take advantage of Exadata storage. The Exadata software is optimally divided between the database servers and Exadata cells. The database servers and Exadata Storage Server Software communicate using the iDB – the Intelligent Database protocol. iDB is implemented in the database kernel and transparently maps database operations to Exadata-enhanced operations.

4.4.7.6 Support THAI’s LDAP server for authentication and authorization

Microsoft Active Directory 2000/2003

Sun Java Directory

IBM Directory Server

Oracle OBI-EE is able to authenticate with Microsoft Active Directory4.4.7.7 Support THAI’s Web Application server

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 51

Page 42: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

IBM WebSphere

Sun Java Enterprise System

Oracle OBI-EE is running on Siebel Application server. ODI Metadata Navigator requires a Servlet/JSP container such as Oracle Application Server, IBM WebSphere or Sun Java Enterprise System.

In case, proposed software does not conform to THAI’s infrastructure, its’ benefitshall be clearly defined.

The Sun Oracle Database Machine is a pre-configured hardware and software solution specifically created for extreme performance data warehousing solutions. It comes with the Oracle brains, but also with smart storage from Oracle, the Sun Oracle Exadata Storage Servers. All of this is fully configured using standard Sun hardware components and pre-installed with Oracle Enterprise Linux. The system comes pre-wired in a rack for easy deployment in the data center. For linear scalability simply hook multiple of these racks together.InfiniBand and the Exadata Storage Server Oracle Exadata storage uses a state of the art InfiniBand interconnect between the servers and storage. An Exadata cell has dual port Quad Data Rate (QDR) InfiniBand connectivity for high availability. Each InfiniBand link provides 40 Gigabits of bandwidth - many times higher than traditional storage or server networks

Oracle Exadata is architected to scale-out to any level of performance. To achieve higher performance and greater storage capacity, additional Exadata cells are added to the configuration. As more cells are added, capacity and performance increases linearly. No cell-to-cell communication is ever done or required in an Exadata configuration.

4.4.8 Software licenses proposed for the DW solution shall be provided (but not limited to)

the following software and features: -4.4.8.1 Operating System for all proposed servers. 4.4.8.2 Software agent for all client types such as system administrator, business

administrator, user, operator, etc. 4.4.8.3 Database Engine for all proposed solutions such as DW, metadata, business

intelligence, data mining, etc Propose and describe how the proposed solution conforms to the requirements below:

Provide Real parallel process at database engine for • load parallel: provides load and unload utilities which leveraging

all parallelism features within the DW platform.

Oracle Database 11gR2 enterprise Edition use Data Pump tool for loading data into DW platform.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 52

Page 43: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

THAI can improve job throughput with the PARALLEL parameter. The parallelism setting is enforced by the master process, which allocates work to be executed to worker processes that perform the data and metadata processing in an operation. These worker processes operate in parallel. In general, the degree of parallelism should be set to more than twice the number of CPUs on an instance. To maximize parallelism, THAI must supply at least one file for each degree of parallelism. If there are not enough dump files, the performance will not be optimal because multiple threads of execution will try to access the same dump file. The degree of parallelism can be reset at any time during a job.The example shows a full database export. All data and metadata in the database will be exported. Dump files (full101.dmp, full201.dmp, full301.dmp, and so on) will be created in a round-robin fashion in the directories pointed to by the dpdir1, dpdir2, and dpdir3 directory objects. For best performance, these should be on separate I/O channels. Each file will be up to 2 GB in size (as necessary). Up to three files will be created initially, and more files will be created if needed. The job and master table have the same name: expfull. The log file will be written to expfull.log in the dpdir1 directory.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 53

Page 44: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle Database Utilities.pdf page 1-8Refer to database-11g-product-family-technical-whitepaper.pdf page 13

• query parallel: provides unconditional parallelism whereby all

parts of every query plan execution are processed in parallel

when appropriate - including local sorting and aggregating that

accelerate the building of aggregates and derived data

Scanning a Table in ParallelWhen THAI use serial execution, a single server process performs all necessary processing for the sequential execution of a SQL statement. Parallel execution is feature within Oracle Database 11gR2 enterprise Edition.Parallel execution performs these operations in parallel using multiple parallel processes. A process, known as the parallel execution coordinator, dispatches the execution of a statement to several parallel execution servers and coordinates the results from all the server processes to send the results back to the user.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 54

Page 45: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database VLDB and Partitioning Guide.pdf Chapter 8Refer to database-11g-product-family-technical-whitepaper.pdf page 13

• load and query parallel: provides concurrent load and query

process with acceptable performance. Parallel execution is feature within Oracle Database 11gR2 enterprise Edition.

Parallel execution dramatically reduces response time for data-intensive operations on large databases typically associated with decision support systems (DSS) and data warehouses. THAI can also implement parallel execution on certain types of online transaction processing (OLTP) and hybrid systems. Parallel execution is sometimes called parallelism. Simply expressed, parallelism is the idea of breaking down a task so that, instead of one process doing all of the work in a query, many processes do part of the work at the same time. An example of this is when four processes handle four different quarters in a year instead of one process handling all four quarters by itself. The improvement in performance can be quite high. In this case, each quarter will be a partition, a smaller and more manageable unit of an index or table. Parallel execution improves processing for:

Queries requiring large table scans, joins, or partitioned index scans Creation of large indexes

Creation of large tables (including materialized views)

Bulk inserts, updates, merges, and deletes

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 55

Page 46: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database VLDB and Partitioning Guide Chapter 8, Using Parallel ExecutionRefer to database-11g-product-family-technical-whitepaper page 13

• backup parallel and recovery parallel Oracle use Recovery Manager (RMAN) to automatically parallelizes backup operations.

Parallelization of Backup SetsWhen THAI create multiple backup sets and allocate multiple channels, RMAN automatically parallelizes its operation and writes multiple backup sets in parallel. The allocated server sessions share the work of backing up the specified datafiles, control files, and archived redo logs. Note that THAI cannot stripe a single backup set across multiple channels. Parallelization of backup sets is achieved by:

• Configuring PARALLELISM to greater than 1 or allocating multiple channels

• Specifying many files to back upEach channel gets enough data files to make each backup set roughly the same size. Parallelization can be accomplished manually, or automatically by using the PARALLELISM clause.run {

allocate channel t1 type 'sbt_tape'; allocate channel t2 type 'sbt_tape'; backup

...}The CONFIGURE DEVICE TYPE ... PARALLELISM command specifies the number of channels that RMAN uses when allocating automatic channels for a specified device type.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 56

Page 47: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Backup and Recovery User's Guide page 6-2Refer to database-11g-product-family-technical-whitepaper page 11

• parallel index creation

Creating Indexes in ParallelMultiple processes can work simultaneously to create an index. By dividing the work necessary to create an index among multiple server processes, the database can create the index more quickly than if a single server process created the index sequentially. When the table and index are not partitioned, parallel index creation works the same way as a table scan with an ORDER BY clause. The table is randomly sampled and a set of table keys is found that equally divides the index into the same number of pieces as the DOP. A first set of query processes scan the table, extract index key-row ID pairs, and send each pair to a process in a second set of query processes based on the index key. Each process in the second set sorts the keys and builds an index in the usual fashion. After all index pieces are built, the parallel coordinator concatenates the pieces to form the index.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 57

Page 48: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database VLDB and Partitioning Guide page 8-53Refer to database-11g-product-family-technical-whitepaper page 13

• Etc.

Parallel DML (PARALLEL, INSERT, UPDATE, DELETE, and MERGE) uses parallel execution mechanisms to speed up or scale up large DML operations against large database tables and indexes.Parallel DML (PDML) is useful in a decision support system (DSS) environment where the performance and scalability of accessing large objects are important. Parallel DML complements parallel query by providing THAI with both querying and updating

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 58

Page 49: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

capabilities for THAI’s DSS databases. Some online transaction processing (OLTP) operations may also benefit from parallel DML. It is possible to perform parallel DML on nonpartitioned tables for DELETE and UPDATE operations as long as no bitmap indexes exist.The major advantage of parallel DML is performance:

• If the underlying hardware supports parallel DML, any DML that accesses a large number of rows benefits from it.

• The performance of parallelism is based not only on the number of processes spawned. The number of CPUs, the number of disk drives on which the data is located, and some other factors, all have an impact.

• When THAI look at an Oracle Database 10g plan, THAI can see that the data is redistributed to an index maintenance row source, which also provides performance benefit.

Refer to Oracle® Database VLDB and Partitioning Guide page 8-54Refer to database-11g-product-family-technical-whitepaper page 13

Able to automatically balance user sessions across the processing nodes to spread the resource requirements of user and session management evenly.

Oracle use Oracle Real Application Cluster(RAC) to balance workload

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 59

Page 50: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Server-Side Connect-Time Load BalancingThe picture shows THAI how listeners distribute service connection requests across a RAC cluster. Here, the client application connects to the ERP service. On the server side, the database is using the dynamic service registration feature. This allows the PMON process of each instance in the cluster to register service performance information with each listener in the cluster (1). Each listener is then aware of which instance has a particular service started, as well as how that service is performing on each instance.THAI configure this feature by setting the REMOTE_LISTENER initialization parameter of each instance to a TNS name that describes the list of all available listeners. The slide shows the shared entry in the SPFILE as well as its corresponding server-side TNS entry.Depending on the load information, as computed by the Load Balancing Advisory, and sent by each PMON process, a listener redirects the incoming connection request (2) to the listener of the node where the corresponding service is performing the best (3).In the example, the listener on NODE2 is tried first. Based on workload information dynamically updated by PMON processes, the listener determines that the best instance is the one residing on NODE1. The listener redirects the connection request to the listener on NODE1 (4). That listener then starts a dedicated server process (5), and the connection is made to that process (6).

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 60

Page 51: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Real Application Clusters Administration and Deployment Guide page 4-6,4-7Refer to ds-rac_11gr2 page 2

Provides an easy to manage platform that dynamically manages data distribution and space re-collection as part of normal processing.

Automatic Storage Management (ASM) is a feature in Oracle Database 11gR2 that provides the database administrator with a simple storage management interface that is consistent across all server and storage platforms. As a vertically integrated file system and volume manager, purpose-built for Oracle database files, ASM provides the performance of async I/O with the easy management of a file system. ASM provides capability that saves the DBAs time and provides flexibility to manage a dynamic database environment with increased efficiency.

A disk group is a logical grouping of one or more disks that ASM manages as a fundamental unit of storage. Each disk group contains the metadata associated with itself. THAI can think of an ASM disk group as conceptually similar to a Logical Volume in a typical Storage Area Network.Files are allocated from the space inside a disk group. The content of files that are stored in a disk group are evenly distributed, or striped, across the disks in the disk group to eliminate hot spots and to provide uniform performance across the disks. ASM striping balances disk space usage so that all the disks in a disk group will be used evenly in percentage terms. In cases where a disk group is made up of uniform-sized disks, it means that the amount of data on each disk is approximately the same. In cases where a disk group contains different-sized disks, it means that the larger disks will contain more data than the smaller disks. This should be noted as a comparatively large disk could be an I/O bottleneck for a disk group. By default, ASM automatically rebalances storage whenever the storage configuration of a disk group changes, such as when a disk is added for example.Each ASM file is completely contained within a single disk group. However, a disk group can contain files belonging to several databases and a single database can use different files from multiple disk groups.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 61

Page 52: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Storage Administrator's Guide page 1-5Refer to database-11g-product-family-technical-whitepaper page 12

Provides non-impact business processing features to reclaim database space such as online database reorganization, or provides ability to reclaim space without database reorganization.

The Online Reorganization and Redefinition feature in Oracle Database offers administrators significant flexibility to modify the physical attributes of a table and transform both data and table structure while allowing user access to the database. This capability improves data availability, query

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 62

Page 53: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

performance, response time, and disk space usage. All of these are important in a mission-critical environment and make the application upgrade process easier, safer, and faster.

Refer to Oracle® Database High Availability Overview page 4-16Refer to database-11g-product-family-technical-whitepaper page 10

Able to accommodate system expansion easily without having to perform a load/unload of the database.

Database ExpansionTHAI can use either Oracle Enterprise Manager or DBCA to add Oracle RAC database instances to the target nodes. To add a database instance to a target node with Oracle Enterprise Manager.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 63

Page 54: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 64

Page 55: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database 2 Day + Real Application Clusters Guide Chapter 9

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 65

Page 56: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Storage ExpansionWith ASM, the rebalance process is very easy and happens without any intervention from the DBA or system administrator. ASM automatically rebalances a disk group whenever disks are added or dropped.

The following commands were used to create the griddisks. Griddisk names are the disk names used by ASM.

dcli -g cell_group "cellcli -e create griddisk all prefix=recover,size=12G"dcli -g cell_group "cellcli -e create griddisk all prefix=summ,size=71G"dcli -g cell_group "cellcli -e create griddisk all prefix=cdrdb,size=275G"dcli -g cell_group "cellcli -e create griddisk all prefix=dbfr,size=14G"dcli -g cell_group "cellcli -e create griddisk all prefix=testdb,size=7G"

The following commands were used to create the ASM disk groups as the oracle user on odmmd01.These commands are run at the SQL prompt while connected to the ASM instance.### set environment for +ASM1 Instance.Create the Diskgroup as below.

create diskgroup RECOVERDG normal redundancydisk 'o/*/recover*'attribute 'cell.smart_scan_capable'='true','compatible.rdbms'='11.1.0.7.0','compatible.asm'='11.1.0.7.0','au_size'='4M'/create diskgroup SUMMDG normal redundancydisk 'o/*/summ*'attribute 'cell.smart_scan_capable'='true','compatible.rdbms'='11.1.0.7.0','compatible.asm'='11.1.0.7.0','au_size'='4M'/create diskgroup CDRDBDG normal redundancydisk 'o/*/cdrdb*'attribute 'cell.smart_scan_capable'='true','compatible.rdbms'='11.1.0.7.0','compatible.asm'='11.1.0.7.0','au_size'='4M'/create diskgroup DBFRDG normal redundancydisk 'o/*/dbfr*'attribute 'cell.smart_scan_capable'='true','compatible.rdbms'='11.1.0.7.0','compatible.asm'='11.1.0.7.0','au_size'='4M'/create diskgroup TESTDBDG normal redundancydisk 'o/*/testdb*'attribute 'cell.smart_scan_capable'='true',

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 66

Page 57: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

'compatible.rdbms'='11.1.0.7.0','compatible.asm'='11.1.0.7.0','au_size'='4M'/

Refer to Oracle® Exadata Storage Server Software User's Guide Chapter 3

Provides open connectivity interfaces such as ODBC, OLE-DB, JDBC, CLI and others to access all data sources required in THAI’ business requirements.

Oracle offers a variety of data access methods from COM-based programming languages, such as Visual Basic and Active Server Pages. These include Oracle Objects for OLE (OO40) and the Oracle Provider for OLE DB. The latter can be used with Microsoft's ActiveX Data Objects (ADO). Server-side programming to COM Automation servers, such as Microsoft Office, is available through the COMAutomation Feature. More traditional ODBC access is available through Oracle's ODBC Driver. C/C++ applications can also use the Oracle Call Interface (OCI). These data access drivers have been engineered to provide superior performance with Oracle Database and expose the database's advanced features which may not be available in third-party drivers.

Oracle also provides optimum .NET data access support through the Oracle Data Provider for .NET, allowing .NET to access advanced Oracle features. Oracle also supports OLE DB .NET and ODBC .NET.

Open database connectivity (ODBC), is a database access protocol that lets THAI connect to a database and then prepare and run SQL statements against the database.In conjunction with an ODBC driver, an application can access any data source including data stored in spreadsheets, like Excel. Because ODBC is a widely accepted standard API, applications can be written to comply to the ODBC standard. The ODBC driver performs all mappings between the ODBC standard and the particular databasethe application is accessing. Using a data source-specific driver, an ODBC compliant program can access any data source without any more development effort. Oracle provides the ODBC interface so that applications of any type that are ODBC compliant can access Oracle Database using the ODBC driver provided by Oracle.

Java database connectivity (JDBC) is an application programming interface (API) for Java developers to access SQL data. It is available on client and server, so THAI can deploy the same code in either place.Oracle’s JDBC allows access to objects and collection types defined in the database from Java programs through dynamic SQL. Dynamic SQL means that the embedded SQL statement to be run is not known before the

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 67

Page 58: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

application is run, and requires input to build the statement. It provides for translation of types defined in the database into Java classes through default or customizable mappings, and it also enables THAI to monitor, trace, and correlate resource consumption of Java and J2EE applicationsdown to the database operation level

refer to Oracle® Database Advanced Application Developer's Guide Chapter 13

SQL*Plus is the primary command-line interface to THAI’s Oracle database. THAI use SQL*Plus to start up and shut down the database, set database initialization parameters, create and manage users, create and alter database objects (such as tables and indexes), insert and update data, run SQL queries, and more.

Before THAI can submit SQL statements and commands, THAI must connect to the database. With SQL*Plus, THAI can connect locally or remotely. Connecting locally means connecting to an Oracle database running on the same computer on which THAI are running SQL*Plus. Connecting remotely means connecting over a network to an Oracle database that is running on a remote computer. Such a database is referred to as a remote database. The SQL*Plus executable on the local computer is provided by a full Oracle Database installation, an Oracle Client installation, or an Instant Client installation.

Refer to Oracle® Database Administrator's Guide page 1-7

Provides data compression facility that can result in significant space savings in the DW environment.

Hybrid Columnar CompressionTraditionally, data has been organized within a database block in a ‘row’ format, where all column data for a particular row is stored sequentially within a single database block. Having data from columns with different data types stored close together limits the amount of storage savings achievable with compression technology. An alternative approach is to store data in a ‘columnar’ format, where data is organized and stored by column. Storing column data together, with the same data type and similar characteristics, drastically increases the storage savings achieved from compression. However, storing data in this manner can negatively impact database performance when application queries access more than one or two columns, perform even a modest number of updates, or insert small numbers of rows per transaction. Oracle’s Exadata Hybrid Columnar Compression technology is a new method for organizing data within a database block. As the name implies,

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 68

Page 59: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

this technology utilizes a combination of both row and columnar methods for storing data. This hybrid, or best of both worlds, approach achieves the compression benefits of columnar storage, while avoiding the performance shortfalls of a pure columnar format. A logical construct called the compression unit is used to store a set of Exadata Hybrid Columnar-compressed rows. When data is loaded, column values are detached from the set of rows, ordered and grouped together and then compressed. After the column data for a set of rows has been compressed, it is fit into the compression unit

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 69

Page 60: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Exadata Hybrid Columnar Compression Technical White Paper

Provides the following high availability features for DBMS to perform: -

• Automatic node fail-over to surviving nodes or to a hot standby

node, if so equipped.

Oracle RAC provides very high availability for applications by removing the single point of failure with a single server. If a node in the cluster fails, the Oracle Database continues running on the remaining nodes. Individual nodes can be shutdown for maintenance while application users continue to work

Oracle RAC has feature Transparent Application Fail-Over When a connection to an Oracle instance is unexpectedly severed,

TransparentApplication Failover (TAF) seamlessly attempts to failover to another

Oracle instance.Due to the delay that a failover can incur, the application may wish to be notified by aTAF callback.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 70

Page 61: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Net Services Administrator's Guide page 13-12Refer to ds-rac_11gr2.pdf page 1(High Availability)

Optional Fallback capability (Fallback provides a software level

protection over and above RAID to support the highest level of

data availability)

Oracle database will provide 2 levels of fallback failure database in level of database and storage

Flashback technology is unique to the Oracle Database and supports recovery at all levels including the row, transaction, table, table space, and database wide. Flashback is unique to the Oracle Database 10g and supports recovery at any level of granularity including the row, transaction, table, and database wide.

Flashback Query allows the user to query data at some point-in-time in the past to reconstruct lost data that may have been deleted or changed by accident

Flashback Version Query provides a mechanism to view changes made to the database over time at the row level.

Flashback Transaction Query provides a mechanism to view changes made to the database at the transaction level.

Flashback Database is a new strategy for doing point-in-time recovery. It quickly rewinds an Oracle database to a previous time

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 71

Page 62: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

to correct any problems caused by logical data corruption or user error.

Flashback Table provides the ability to recover a table, or a set of tables, to a specified point in time in the past very quickly and easily.

Flashback Drop provides a safety net when dropping objects as THAI can very quickly and easily undrop a table and its dependent objects

Refer to Oracle® Database Concepts page 18-13

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 72

Page 63: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to database-11g-product-family-technical-whitepaper.pdf page 10

In Storage level Failure groups define ASM disks that share a common potential failure mechanism. An example of a failure group is a set of SCSI disks sharing the same SCSI controller. Failure groups are used to determine which ASM disks to use for storing redundant copies of data. For example, if two-way mirroring is specified for a file, ASM automatically stores redundant copies of file extents in separate failure groups. Failure groups apply only to normal and high redundancy disk groups. THAI define the failure groups in a disk group when THAI create or alter the disk group.

Refer to Oracle® Database Storage Administrator's Guide page 4-24Refer to database-11g-product-family-technical-whitepaper.pdf page 12

Provides a comprehensive set of DBMS auditing capabilities.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 73

Page 64: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Security Guide Chapter 9Refer to database-11g-product-family-technical-whitepaper.pdf page 11

Able to authenticate database users and password through LDAP v.3 (Light-Weighted Directory Access Protocol)

Enterprise User Security Enterprise User Security addresses user, administrative, and security challenges by relying on the identity management services supplied by Oracle Internet Directory, an LDAP-compliant directory service. Identity management is the process by which the complete security life cycle for network entities is managed in an organization. It typically refers to the management of an organization's application users, where steps in the security life cycle include account creation, suspension, privilege modification, and account deletion.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 74

Page 65: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Enterprise User Security Administrator's Guide page 1-2Refer to database-11g-product-family-technical-whitepaper.pdf

page 12

Able to provide single sign-on capability for all proposed software.

The Enterprise User Security architecture is transparent to the end user. In the example shown in the slide, a client can submit the same connect command, whether connecting as a database user or an enterprise user. The enterprise user has the additional benefit of allowing the use of a shared schema.

The authentication process is as follows:

1. The user presents a username and password (or other credentials).

2. The directory returns the authorization token to the database.

3. The schema is mapped from OID information.

3. The directory supplies the global roles for the user. Enterprise roles are defined in OID and global roles are defined in the database. The mapping from enterprise roles to global roles is in the directory.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 75

Page 66: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

The directory can supply the application context. An application context supplied from OID is called a global context.

Refer to Oracle® Database Enterprise User Security Administrator's Guide page 1-3

Able to provide both user and role based access control to effectively reduce the complexity and cost of security administration.

The Oracle database 11gR2 software provides for easy and controlled privilege management through roles. Roles are

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 76

Page 67: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

named groups of related privileges that are granted to users or to other roles. Roles are designed to ease the administration of privileges in the database and, therefore, improve security.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 77

Page 68: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Concepts page 17-2

Provides SQL extensions to perform complex statistical functions within the database engine.

Oracle Database 11gR2 has enhanced SQL's analytical processing capabilities by introducing a new family of analytic SQL functions. These analytic functions enable THAI to calculate:

Rankings and percentiles Moving window calculations Lag/lead analysis First/last analysis Linear regression statistics

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 78

Page 69: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Ranking functions include cumulative distributions, percent rank, and N-tiles. Moving window calculations allow THAI to find moving and cumulative aggregations, such as sums and averages. Lag/lead analysis enables direct inter-row references so THAI can calculate period-to-period changes. First/last analysis enables THAI to find the first or last value in an ordered group.

Other enhancements to SQL include the CASE expression and partitioned outer join. CASE expressions provide if-then logic useful in many situations. Partitioned outer join is an extension to ANSI outer join syntax that allows users to selectively densify certain dimensions while keeping others sparse. This allows reporting tools to selectively densify dimensions, for example, the ones that appear in their cross-tabular reports while keeping others sparse.

To enhance performance, analytic functions can be parallelized: multiple processes can simultaneously execute all of these statements. These capabilities make calculations easier and more efficient, thereby enhancing database performance, scalability, and simplicity.

Analytic functions are classified as described in Table

Analytic Functions and Their Uses

Type Used ForRanking Calculating ranks, percentiles, and n-tiles of the

values in a result set.Windowing Calculating cumulative and moving aggregates.

Works with these functions: SUM, AVG, MIN, MAX, COUNT, VARIANCE, STDDEV, FIRST_VALUE, LAST_VALUE, and new statistical functions. Note that the DISTINCT keyword is not supported in windowing functions except for MAX and MIN.

Reporting Calculating shares, for example, market share. Works with these functions: SUM, AVG, MIN, MAX, COUNT (with/without DISTINCT), VARIANCE, STDDEV, RATIO_TO_REPORT, and new statistical functions. Note that the DISTINCT keyword may be used in those reporting functions that support DISTINCT in aggregate mode.

LAG/LEAD Finding a value in a row a specified number of rows from a current row.

FIRST/LAST First or last value in an ordered group.

Linear Regression

Calculating linear regression and other statistics (slope, intercept, and so on).

Inverse Percentile

The value in a data set that corresponds to a specified percentile.

Hypothetical Rank and Distribution

The rank or percentile that a row would have if inserted into a specified data set.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 79

Page 70: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

To perform these operations, the analytic functions add several new elements to SQL processing. These elements build on existing SQL to allow flexible and powerful calculation expressions. With just a few exceptions, the analytic functions have these new elements.

Refer to Oracle® Database Data Warehousing Guide page 21-1,21-2

Should provide automatic and dynamic resources allocation to serve ad-hoc and incentive queries.

I/O Resource Manager I/O Resource Management manages the Exadata Cell I/O resources on a per-cell basis. Whenever the I/O requests start to saturate the cell’s capacity, I/O Resource Management schedules incoming I/O requests, according to the configured resource plans. I/O Resource Management schedules I/O by immediately issuing some I/O requests and queuing others. The I/O requests that are immediately issued are from workloads that have not exceeded their resource allocation, according to the resource plans. The I/O requests that are queued are from workloads that have exceeded their resource allocation. They are issued when their workload no longer exceeds its resource allocation or when the cell is operating under maximum capacity. In that case, I/O Resource Manager does not queue I/O requests.For example, if a production and test database are sharing Exadata Cells, THAI can configure resource plans that give priority to the production database. In this case, whenever the test database load would affect the production database performance, I/O Resource Management will schedule the I/O requests such that the production database I/O performance is not impacted. This means that the test database I/O requests are queued until they can be issued without disturbing the production database I/O performance.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 80

Page 71: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to exadata-technical-whitepape page 19,20,21

Database Resource Manager The Database Resource Manager in Oracle Database 11gR2 controls the distribution of resources among various sessions by controlling the execution schedule inside the database. By controlling which sessions run and for how long, the Database Resource Manager can ensure that resource distribution matches the plan directive and, therefore, the business objectives. With the Database Resource Manager, THAI can guarantee groups of users a minimum amount of processing resources regardless of the load on the system and the number of users.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 81

Page 72: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 82

Page 73: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Administrator's Guide Chapter 26Refer to database-11g-product-family-technical-whitepaper.pdf

page 12

Provides on-line full & incremental backup and archive capability that permits almost full use of the tables during the backup of the tables.

Oracle Database 11gR2 provide backup features with many capability to allow using table during backup times

Backup Option:Select full or incremental backup type. If THAI are performing a full database backup, THAI can select “Use as the base of an incremental backup strategy” to make the full database backup an incremental level 0 backup. If THAI are using image copies, THAI can select “Refresh the latest datafile copy on disk to the current time using the incremental backup” to update the existing backup rather than create a new image copy.Select Online Backup if THAI want to perform this task while users are continuing to use the database. If users do not need access, select “Offline Backup,” which is performed with a mounted instance.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 83

Page 74: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Backup and Recovery User's Guide Chapter 7Refer to database-11g-product-family-technical-whitepaper.pdf

page 10

Provide point-in-time recovery capability.

Flashback TechnologyTHAI can use Flashback technology when a logical corruption occurs in the Oracle database and THAI need to recover data quickly and easily. As with human errors, it is difficult to identify the objects and rows that are affected by an erroneous transaction. With Flashback technology, THAI can diagnose how errors are introduced into the database, and then repair the damage. THAI can view the transactions that have contributed to specific row modifications, view the entire set of versions of a given row during a specific time period, or just view data as it appeared at a specific time in the past. The table in the slide shows typical uses of Flashback technology. Flashback Database depends on the flashback logs to perform flashback. Flashback Drop uses the recycle bin. All other techniques use undo data.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 84

Page 75: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 85

Page 76: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database 2 Day DBA Chapter 9Refer to database-11g-product-family-technical-whitepaper.pdf

page 11

Provides simplified management and administration of backup, archive and recovery operations.

Database Control enables THAI to perform backups and recovery operation in GUI mode, without any command to remember.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 86

Page 77: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Enterprise Manager Administration Chapter 9Refer to database-11g-product-family-technical-whitepaper.pdf

page 12

Provide database features to support cleaning-up obsolete data with high performance and minimum resource consuming, or archiving the data into cheaper media in the form that can be viewed or query by users when needed.

Information Lifecycle Management (ILM) is a set of policies and procedures for managing data during its lifetime.

The ILM Assistant manages information by recommending the correct placement of data on logical storage tiers as specified by a lifecycle definition, where a lifecycle definition describes the stages and storage tiers that data resides on during its lifetime.

Each stage specifies a retention period during which the data resides on a logical storage tier. A logical storage tier is a collection of Oracle tablespaces in which partitions may reside.

Performance of cleaning-up obsolete data is based on media technology. Now SF proposed Oracle Exadata V2 that contain 2 types of storage, flash cache(225,000 IOPS) and SAS disk(10,800 IOPS)

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 87

Page 78: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 88

Page 79: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database VLDB and Partitioning Guide Chapter 5

Provide row-level security at the database table or view level and can extend it to provide column-level security as well. Essentially the SQL clause allows only users whose credentials pass the security policy.

Fine-grained access control (FGAC) in Oracle Database 11gR2 enables THAI to build applications that enforce security policies at a low level of granularity. THAI can use FGAC to restrict access by rows and columns, as in the following examples:

• Customers can see only their own accounts.• Physicians see only the records of their own patients.• Managers see only the records of employees who work

for them.• A fulfillment clerk sees customer records for shipping

purposes, but not columns with credit card numbers.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 89

Page 80: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Security Guide Chapter 7

4.4.8.4 MetadataProvide a complete description of proposed metadata solution, including the key features of the proposed solution and products, as well as what makes vendor’s solution unique. Propose and describe how the proposed solution conforms to the requirements below:

Metadata is required and shall be tightly integrated with all DW layers designed and easily view via graphic user interface (GUI) or web browser by authorized users. The metadata will used to keep the information architecture and all data structure with detail data definition/description for both business and technical perspectives including mapping flow of how data can be derived from data sources. Provide facilities that serve the following items:-

• Serves as a guide for understanding what metadata (data about

data) is captured and maintained in the Repository, where the

described data resides in corporate databases, and what corporate

applications and reports use the data. Oracle Data Integrator Repository is built around an open, comprehensive metadata repository, which can be installed on relational databases such as Oracle, Microsoft SQL Server, IBM DB2 UDB, IBM DB2/400, Informix, Sybase AS Anywhere, Sybase AS Enterprise, and Sybase ASIQ. Because metadata is stored in database tables, the repository is completely open and can be used as a source by any reporting system.

• Serves as a translation vehicle, providing common business

names and descriptions for technical data and abbreviations

stored in the Repository. The Oracle Data Integrator Metadata Navigator in ODI is a web-based module, where users can address many of the metadata questions such as: What if the data type of this field is changed? Where does the data go, and how is it transformed? What are the rules that calculate a particular indicator? What was the last time my table was updated?Business users can also effortlessly view flow maps, data lineage

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 90

Page 81: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

for understanding the path taken by data, and execution logs with accurate job statistics.

• Empower users to access the corporate Repository with a few

clicks in a web browser. See above.

• Provide quick and easy facility for locating existing data elements

and their definitions. Oracle Data Integrator’s Meta Data Navigator supports search

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 91

Page 82: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

and browse data definition.• Provide impact analysis features for detecting data relationships

and assessing the impact of proposed changes. Though (Oracle ODI’s) the Flow Map and Column Linkage, Meta Data Navigator provides same information in a more friendly and graphical format. It can be used by business analysts to better understand the path of data within their applications.

• Provide tool to understand the impact of change to an information

system component. See above.• Provide help facility to bridge the gap between technical naming

standards and commonly understood business namesSee above.

<Please compile this paragraph here :>

4.4.8.5 Data Acquisition (ETL/ ELT), data cleansing and data quality module Provide a complete description of proposed data acquisition,

cleansing and data quality solution, including the key features of the proposed

solution and products, as well as what makes vendor’s solution unique.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 92

Page 83: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Propose and describe how the proposed solution conforms to the requirements below:

Provide interactive and easy-to-use facility to setup ETL/ELT, data cleansing, data quality criteria. Oracle Data Integrator comes with a GUI Designer, it is a tool used to design data integrity checks and to build transformations. In particular, it incorporates functions for:

- Automatic reverse-engineering of existing applications or databases

- Graphical development and maintenance of transformation and integration interfaces

- Visualization of data flows in the interfaces- Automatic documentation generation- Customization of the generated code

Perform automate functions and mapping flow to Extract all THAI’s data sources defined in this RFP, Transform Load (ETL) / Load Transform (ELT) to all levels of DW architecture.Oracle Data Integrator is organized around a modular repository that is accessed by Java graphical modules and scheduling agents. The graphical modules are used to design and build the integration process, with agents being used to schedule and coordinate the integration task. When Oracle Data Integrator projects are moved into production, data stewards can use the Web-based Metadata Navigator application to report on metadata in the repository. Out-of-the-box Knowledge Modules extract and load data across heterogeneous platforms, using

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 93

Page 84: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

platform-specific code and utilities.

Provides an optimized ETL/ELT environment that leverages on the parallel and scalable nature of the proposed hardware and database for high performance.

Oracle Data Integrator is a data integration software product, providing a new declarative design approach to defining data transformation and integration processes, resulting in faster and simpler development and maintenance. Based on an “E-L-T” architecture, Oracle Data Integrator guarantees the highest level of performance for the execution of data transformation and validation processes, along with providing one of the most cost-effective solutions available. By combining data based, event based, and service based integration, ODI is able to address varying needs from data warehousing and business intelligence to Master Data Management, Service Oriented Architecture and others. Oracle Data Integrator provides a unified infrastructure to streamline data and application integration projects.

As Oracle Data Integrator loads and transforms data from many different database platforms and uses message-based technologies such as Web services while being able to respond to events, the technology used to access and load these different datasources needs to be flexible, extensible, and yet efficient. Oracle Data Integrator solves this problem through the use of knowledge modules.Knowledge modules are “plug-ins” to Oracle Data Integrator that encapsulate a best practice in loading, transforming, or integrating data for a specific datasource or target. Oracle Data Integrator has six types of knowledge module, as shown in the following diagram:

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 94

Page 85: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Reverse-engineering knowledge modules: are used for reading the table and other object metadata from source databases.

Journalizing knowledge modules: record the new and changed data within either a single table or view or a consistent set of tables or views.

Loading knowledge modules: are used for efficient extraction of data from source databases and include database-specific bulk unload utilities where available.

Check knowledge modules: are used for detecting errors in source data.

Integration knowledge modules: are used for efficiently transforming data from staging area to the target tables, generating the optimized native SQL for the given database.

Service knowledge modules: provide the ability to expose data as Web services.

Provide a handshake and automated mechanism to ensure data sources/ files has been passed from one process to another. Allow the tracking of data that is loaded to the DW from Source to Target. Oracle Data Integrator architecture have a component call an Agent. The Agent orchestrates the inter-application interfaces developed with Designer. It integrates the Scheduler to execute the interfaces according to a predefined schedule. It can also be invoked via web services to start integration scenarios.Operator manages and monitors production. It is designed for production operators and shows execution logs with error counts, the number of rows processed, execution statistics, the actual code that is executed, and so on. At design time, developers can also use the Operator module for debugging purposes.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 95

Page 86: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Able to restart the unsuccessful ETL/ELT process at the nearest point of failure; need not to start at beginning process. Any session that has encountered an error, or been stopped by the operator can be restarted. It can be restarted from Operator, or through a command line.Only sessions in status Error or Waiting can be restarted. The session will resume from the last non-completed task (typically, the one in error).Support housekeeping processes to clean-up unnecessary data at all levels/layers of DW. Oracle Data Integrator Integrate Knowledge Module (IKM) to RDBMS supports TRUNCATE, and DELETE_ALL options. That allows developer/designer to truncate or delete data in RDBMS tables.Provide archiving processes to archive history data from active data to the inactive one. The archived data shall be designed and kept in the form that can be viewed or queried easily whenever required. SF will provides supports on this.Provide workload management for ETL/ELT processes schedule with priority and processes dependency.Oracle Data Integrator support ELT process scheduling.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 96

Page 87: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Provide easy-to-use report and print facility to produce ETL documents/report such as ETL mapping flow, schedule, data cleansing, data quality, and transformation criteria.Oracle Data Integrator is a metadata-based code generator. The Oracle knowledge modules use the metadata that’s stored in the repository to create the appropriate code and run it on existing systems. Metadata, at the center of the integration and data integrity check processes, makes maintaining these processes faster.Oracle Data Integrator can automatically generate rich Adobe PDF reports using the repository contents to document the enterprise architecture and integration processes.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 97

Page 88: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Perform data cleansing before transform and load target data as required by THAI. Please provide detail features. Provide easy-to-use cleansing module that can help data quality process with the following quality functions: -

• Free-form text investigation - to recognize and parse out

individual fields of data from free-form text, • Standardization - to allow individual fields to be made uniform

according to THAI’s defined standards, • Address verification and correction - uses postal information to

standardize, validate, and enrich address data, • Matching - allows duplicates to be removed from sources, and

common records and common records across sources to be

identified and linked, • Survivorship - allows the best data from across different systems

to be merged into a consolidated record. Oracle Data Integrator is a data integration software product, providing a new declarative design approach to defining data transformation and integration processes, resulting in faster and simpler development and maintenance. Based on an “E-L-T” architecture, Oracle Data Integrator guarantees the highest level of performance for the execution of data transformation and

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 98

Page 89: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

validation processes, along with providing one of the most cost-effective solutions available. By combining data based, event based, and service based integration, ODI is able to address varying needs from data warehousing and business intelligence to Master Data Management, Service Oriented Architecture and others. Oracle Data Integrator provides a unified infrastructure to streamline data and application integration projects.

Oracle Data Integrator customers have chosen the tool for one or more of the key reasons below:- Faster and simpler development and maintenance: The declarative rules driven approach greatly reduces the learning curve of the product and increases developer productivity while facilitating ongoing maintenance. The approach separates the definition of the processes from their actual implementation, and separates the declarative rules (the ‘what’) from the data flows (the ‘how’).

- Better execution performance: Traditional ETL software is based on proprietary engines that perform data transformations row by row, thus limiting performance. By implementing an E-L-T architecture and leveraging RDBMS engines and SQL, data transformations are executed on the target server at a set-based level yielding much higher performance.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 99

Page 90: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

- Simpler and more efficient architecture: The E-L-T architecture removes the need for an ETL hub server sitting between the sources and target server. It utilizes the target server RDBMS to perform complex transformations, most of which happen in batch mode when the server is not busy processing end-user queries.

Oracle Data Integrator is organized around a modular repository in client/server or thin client mode by components entirely written in Java: the graphical interface modules and execution agents.

The Repository is a comprehensive, open and shared metadata repository. It stores the metadata for the accessed applications involved in the transformation and integration processing, the developed project versions and all of the information required for their use (planning, scheduling and executing of reports)Topology Manager is the graphical interface module used to manage the data describing the information system’s physical and logical architecture. The site, machine, and data server descriptions will enable Oracle Data Integrator to execute the same interfaces in different environments.Designer is a tool used to design data integrity checks and to build transformations. In particular, it incorporates functions for:

- Automatic reverse-engineering of existing applications or databases

- Graphical development and maintenance of transformation and integration interfaces

- Visualization of data flows in the interfaces- Automatic documentation generation- Customization of the generated code

Security Manager is the tool for managing users and permissions in Oracle Data Integrator.Operator is the production management and monitoring module. It is designed for IT production operators.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 100

Page 91: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

The Agent orchestrates the inter-application interfaces developed with Designer. It integrates the Scheduler to execute the interfaces according to a predefined schedule. It can also be invoked via web services to start integration scenarios.Metadata Navigator is a thin client, browser based interface to access the Oracle Data Integrator Repository, browse, search and analyze all its contents, and perform advanced data lineage tracing, cross referencing impact analysis, etc. This tool can also be used to manage production processes.

(item 4, 5)

Warehouse Builder implements general-purpose data matching and merging capabilities that can be applied to any type of data.

You can write the list of rows matched by your algorithms to a target table. You can also implement complex deduplication logic to generated merged records, again using a variety of built-in merge rules or implementing your own merge rules.

Warehouse Builder matching and merging provides the following functionality:

- Determine matches using built-in algorithms, such as the Jaro-Winkler and Levenshtein edit distance algorithms, or using a custom algorithm you implement.

- Use weighting to determine matches between records.- Generate a table containing candidate matches, as input to

some other merge logic, such as an existing master data management application

- Generate a table with merged data records, with merge logic based on built-in merge rules, custom-implemented merge logic, or complex merge rules that can combine packaged and custom rules

- Cross reference data to track and audit matches.- Built-in advanced matching rules for person, firm and address

data

Warehouse Builder matching and merging can be combined with Warehouse Builder name and address cleansing functionality to support householding, which is the process of identifying unique households in name and address data.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 101

Page 92: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Warehouse Builder includes name and address cleansing functionality and can integrate with third-party name and address cleansing tools from a number of vendors. Warehouse Builder parses the names and addresses, and uses methods specific to this type of data, such as matching common nicknames and abbreviations. You can compare the input data to the data libraries supplied by third-party name and address cleansing software vendors, identify and correct errors and inconsistencies in name and address source data. You can then further augment your records with information such as postal routes and geographic coordinates.

4.4.8.6 Business Intelligence (BI) Provide a complete description of vendor’s proposed BI solution, including the key features and benefits of vendor’s BI solution and products which conform to the requirement below;

Provide report generating including graphical chart and display capability that shall be able to operate in the form of Table, and able to Drill Down for Expand information, Exception Reporting function (Color Code), and shall be able to make

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 102

Page 93: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

notes, comments, and remarks of the information showing at the relevant period. The important functions that shall be included in both report and chart capability are:

• Drag and Drop menu • Pull Down menu • Dropdown List Box; help in selecting the relevant information • Able to produce graphic output • Able to read-only access, slice and dice, drill down/up/across and

Online Analytical Processing (OLAP) on web • Able to produce Text and Graph output on the same screen • Able to export the data to slide show, Excel, Acrobat, Sequential

file and Hard Copy • Multifunction hotspot • Able to import data from various analysis tools such as Excel,

Sequential file • Able to resize and reposition objects • Customization • Able to function without additional program (Codeless

Programming)• On-line Assistance tutorials help and documentation • Able to customize and create Variety Button Styles • API provided for security protection of application, individual

screens and individual data. • Able to produce charts: Pie, Bar 2-3 dimension, Combine chart

with 2 axes, show Value and Capability to Drill down from Chart • Able to customize reports with THAI logo and any graphical

image. Provide statistic capability that shall be able to perform Forecast: Trend Analysis, Economics Model, What if Analysis, and Ad-Hoc Inquiry Analysis. Provide printing capability that shall be able to print source program, screen dumps, and reports. Provide workload management for BI processes schedule with priority. Provide analytic engine which is capable of federating highly optimized queries across multiple data sources, integrating disparate data sources and presenting intelligence back to end user through a simplified business model.

<Please compile this paragraph here :>

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 103

Page 94: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4.4.8.7 Data MiningProvide a complete analytic tool or application to discover relationships in data that were previously unknown and have considerable business value which has capability to better manage the operational aspects of the business as well as enabling an effective customer service management capability. Designed for a particular application requires less knowledge on the part of the analyst and narrows the choice of algorithms used to mine the data. To create Classification models and to validate or test these models such as;

• To analyze why a certain classification was made • To predict a classification for new data

Able the associations mining function to find items in data that are associated with each other in a meaningful way.

The Oracle Data Mining Option provides powerful data mining functionality within the Oracle Database. It enables THAI to discover new insights hidden in THAI’s data and to leverage THAI’s investment in Oracle Database technology. With Oracle Data Mining, THAI can build and apply predictive models that help THAI target THAI’s best customers, develop detailed customer profiles, and find and prevent fraud. Oracle Data Mining helps THAI better compete on analytics.

With Oracle Data Mining, everything occurs in the Oracle Database—in a single, secure, scalable platform for advanced business intelligence. Oracle Data Mining represents a breakthrough in business intelligence. In contrast to traditional statistical software that requires data extraction to separate servers, which may be insecure and costly to maintain, Oracle Data Mining embeds a wide-range of mining functions inside the database—where the data is stored. Coupled with the power of SQL, Oracle Data Mining eliminates data movement and duplication, maintains security and minimizes latency time from raw data to valuable information.

Oracle Data Mining enables THAI to:

• Leverage THAI’s data to discover patterns and valuable new insights • Build and apply predictive models and embed them into dashboards and applications • Save money. Oracle Data Mining costs significantly less than traditional statistical software. As an integrated component of THAI’s IT platform, Oracle Data Mining significantly reduces THAI’s total cost of ownership.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 104

Page 95: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 105

Page 96: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Exadata and Oracle Data Mining

Oracle Exadata is a family of high performance storage software and hardware products that can improve data warehouse query performance by a factor of 10X or more. Oracle Data Mining scoring functions in Oracle Database 11g Release 2 score in the storage layer and permit very large data sets to be mined very quickly, thus further increasing the competitive advantage already gained from Oracle's in-database analytics.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 106

Page 97: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Data Mining with Oracle Database 11g Release2 White Paper

4.4.8.8 Backup, Archive and RecoveryProvide a complete description of proposed Backup, Archive and Recovery solution, including the key features of the proposed solution and products, as well as what makes vendor’s solution unique. The backup, archive and recovery solutions should have but not limited to the following features:-

Provide backup, archive and recovery solution for all proposed software.

The backup solution will combine between third party backup solution and Oracle Exadata backup solution

SF will provide Veritas Netback V6.5 to backup ELT for file system SF will provide Oracle Secure Backup and Oracle RMAN provide a complete tape backup solution for the Oracle Database.

Oracle RMAN is the recommended backup utility for the Oracle Database. Integrated with the database kernel, Oracle RMAN verifies data blocks during backup and restores operations then passes this data to Oracle Secure Backup to be written to tape. Oracle Secure Backup provides the media management layer for RMAN. In other words, Oracle Secure Backup is responsible for copying data from Oracle Database buffers and writing these buffers to tape

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 107

Page 98: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Provide the flexibility and scalability for performance needs and configuration growth.

Oracle Secure Backup provides flexibility and ease of use with intuitive graphicalinterfaces and a uniform command line meeting the needs of multiple user-levelsand requirements:• Enterprise Manager interface is ideal for database backup and recoveryas well as most administrative tasks such as managing volumes (tapes) anddevices.• Oracle Secure Backup Web Tool interface is best used for file systembackup and restore.• Uniform command line interface provides maximum flexibility incustomizing operations meeting most any specific requirement.Using the familiar Enterprise Manager interface, Oracle Secure Backup will be anatural extension to current backup and recovery processes managed by DBAs.The Oracle Secure Backup Web Tool offers a similar presentation easily adopted byDBAs or new product users. The Oracle Secure Backup Web Tool offers averbose mode displaying underlying commands being evoked making learning abreeze. The interface is consistent across all supported platforms for streamlinedheterogeneous server management.

Oracle Secure Backup is easily scalable: It supports new nodes in a RAC cluster, new disks in an ASM disk group, new clients and media servers in the OSB domain.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 108

Page 99: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Backup and Recovery User's Guide page 3-6

Provide parallel backup and parallel recovery

Parallelization of Backup SetsWhen THAI create multiple backup sets and allocate multiple channels, RMAN automatically parallelizes its operation and writes multiple backup sets in parallel. The allocated server sessions share the work of backing up the specified datafiles, control files, and archived redo logs. Note that THAI cannot stripe a single backup set across multiple channels. Parallelization

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 109

Page 100: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

of backup sets is achieved by:• Configuring PARALLELISM to greater than 1 or allocating multiple

channels• Specifying many files to back up

Each channel gets enough data files to make each backup set roughly the same size. Parallelization can be accomplished manually, or automatically by using the PARALLELISM clause.run {

allocate channel t1 type 'sbt_tape'; allocate channel t2 type 'sbt_tape'; backup

...}The CONFIGURE DEVICE TYPE ... PARALLELISM command specifies the number of channels that RMAN uses when allocating automatic channels for a specified device type.

Refer to Backup and Recovery User's Guide page 6-2Refer to database-11g-product-family-technical-whitepaper page 11

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 110

Page 101: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Provide online archive capability that permits almost full use of the database/tables and data repository during backup the data.

Backup Option:Select full or incremental backup type. If THAI are performing a full database backup, THAI can select “Use as the base of an incremental backup strategy” to make the full database backup an incremental level 0 backup. If THAI are using image copies, THAI can select “Refresh the latest datafile copy on disk to the current time using the incremental backup” to update the existing backup rather than create a new image copy.Select Online Backup if THAI want to perform this task while users are continuing to use the database. If users do not need access, select “Offline Backup,” which is performed with a mounted instance.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 111

Page 102: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Database Backup and Recovery User's Guide Chapter 7Refer to database-11g-product-family-technical-whitepaper.pdf

page 10

Provide simplified and easy-to-use management and administration of backup, archive and recovery operations.

Database Control enables THAI to perform backups and recovery operation in GUI mode, without any command to remember.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 112

Page 103: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle® Enterprise Manager Administration Chapter 9Refer to database-11g-product-family-technical-whitepaper.pdf

page 10

Should be able to interface with THAI’s backup system - Veritas NetBackup v6.5.

SF will provide Veritas NetBackup v6.5.

Adequate backup server, media server and agents licenses to backup proposed software and database shall be provided.

SF will provide license for backup server, media server and agents for all proposed backup software and database

Provide LAN-Free backup for all servers.

Oracle Exadata support LAND Free backup architecture

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 113

pjunkhea, 02/19/10,
Page 104: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Backup license for tape drive - Adequate licenses shall be provided for the amount of tape drives. The software names are as follows

• VRTS Netbackup option shared storage option for tape 6.5 XPLAT STD BAND S with media

• VRTS Netbackup library based tape drive 6.5 XPLAT STD

BAND S with media

Oracle secure backup is the tool for database engine backup and SF will provide adequate licenses Veritas Netbackup V6.5 is the tool for file system backup on ELT, Business Intelligent and Mining server and SF will provide adequate licenses

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 114

Page 105: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 115

Page 106: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4.4.8.9 Application Development Tools Provide a complete description of proposed Application Development Tools, which shall assist THAI’s application/business developers, database administrators, and end users to speed up delivering of business services related to the DW, and provide the key features of the proposed solution and products, as well as what makes vendor’s solution unique.

Oracle SQL Developer is a graphical tool for database development. Using SQL Developer, THAI can browse database objects, run SQL statements and SQL scripts, and edit and debug PL/SQL statements. THAI can also run any number of provided reports, as well as create and save your own. SQL Developer enhances productivity and simplifies your database development tasks. Oracle SQL Developer has feature Oracle SQL Developer Data Modeler offers a full spectrum of data and database modeling tools and utilities, including Entity Relationship modeling, Relational (Schema), Data Type, and Multi-dimensional modeling and DDL script generation. It includes importing from and exporting to a variety of sources and targets, provides a variety of formatting options and validates the models through a predefined set of Design Rules.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 116

Page 107: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Oracle Data Mining is powerful software embedded in the Oracle Database that enables you to discover new insights hidden in your data. Oracle Data Mining helps businesses to target their best customers, find and prevent fraud, discover the most influential attributes that affect Key Performance Indicators (KPIs), and find valuable new information hidden in the data. Oracle Data Mining helps technical professionals find patterns in their data, identify key attributes, discover new clusters and associations, and uncover valuable insights.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 117

Page 108: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Oracle JDeveloper integrates development features for Java, SOA, Web 2.0, Database, Web, XML and Web services into a single development tool. The various artifacts share the same project structure and development experience, simplifying both the learning curve and the development process of composite applications that leverage a multitude of technologies.Oracle JDeveloper covers the full development lifecycle from initial design and analysis, through the coding and testing phases, all the way to deployment. Developers can design, generate, and visualize their code with UML, Java and database diagrams. An advanced coding environment and declarative and visual editors facilitate faster code development. Integrated testing, profiling, and code auditing features ensure the quality of the applications. Interfaces with versioning, build, and deployment tools enable packaging and deployment of the applications.

Oracle JDeveloper focuses on increasing developers productivity by offering a visual and declarative approach to application design. A combination of visual editors, property inspectors, structure panes, and editing dialogs simplify and eliminate tedious coding. These declarative features provide a simpler way to define the components that construct an application. The application’s code is always accessible for direct manipulation as well. Changes can be made by either the declarative means or directly in the code and are reflected in both simultaneously.

4.4.8.10 Other Applications

Vendor shall provide solution conforms to the requirements

below:

PNR decode application and its detail specification.

The scheduling tool suitable for a DW environment.(Control-M preferable)

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 118

Page 109: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

The Enterprise Manager Job System supports the automation of many administrative tasks, for example, backup, cloning, and patching, and enables users to create their own jobs using their own custom OS and SQL scripts. One of the advantages of the system is that THAI can schedule a job to start immediately or start at a later date and time. THAI also have the option to have the job run once or at a specific interval, for example, three times every month

4.4.9 System Security

4.4.9.1 Vendor shall follow the policy, standards and regulation established by

THAI. This includes but not limited to THAI Security policy,

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 119

Page 110: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

user authentication at the time of login, password management, user

access control, data access control, standard procedure, Building and

premises procedure, Human resources procedure, Data Center procedure, etc.

SF shall provide information for THAI

4.4.9.2 Vendor shall conduct the design session of the audit logs for DW system to identify the information needed to be kept, the log retention, the frequency of log review, the log protection according to the legal requirements (i.e. Computer Crime Act. B.E. 2550) and the business requirements.

Auditing database activities. THAI can audit database activities in general terms, such as auditing all SQL statements, SQL privileges, schema objects, and network activity. Or, THAI can audit in a granular manner, such as when the IP addresses from outside the corporate network is being used.THAI typically use auditing to perform the following activities

Enable future accountability for current actions. These include actions taken in a particular schema, table, or row, or affecting specific content.

Deter users (or others, such as intruders) from inappropriate actions based on their accountability.

Investigate suspicious activity. For example, if a user is deleting data from tables, then a security administrator might decide to audit all connections to the database and all successful and unsuccessful deletions of rows from all tables in the database.

Notify an auditor of the actions of an unauthorized user. For example, an unauthorized user could be changing or deleting data, or a the user has more privileges than expected, which can lead to reassessing user authorizations

Monitor and gather data about specific database activities. For example, the database administrator can gather statistics about which tables are being updated, how many logical I/Os are performed, or how many concurrent users connect at peak times.

Detect problems with an authorization or access control implementation. For example, THAI can create audit policies that THAI expect will never generate an audit record because the data is protected in other ways. However, if these policies generate audit records, then THAI will know the other security controls are not properly implemented.

Address auditing requirements for compliance.

Refer to Oracle® Database Security Guide page 9-2

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 120

Page 111: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

4.4.9.3 Quality assurance should be conducted to ensure that all system functional

requirements, technical requirements and security requirements are satisfied.

This includes the functionality test, performance test and security test.

Oracle Application Testing Suite allows users to create an entire suite of test scripts that automate various business transactions and can be used for ongoing functional and regression testing of each new application release or upgrade. It provides a powerful integrated scripting platform for automated functional & regression testing and load testing. Oracle Functional Testing’s OpenScript integrated scripting interface provides a unique combination of ease-of-use and flexibility through its intuitive graphical scripting interface and powerful Java IDE for extending scripts at the code-level.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 121

Page 112: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

By enabling virtual users to simulate many different end user parameters, testers can stress the application just like real users will to understand exactly how the application will scale under peak load conditions. The solution’s virtual users can generate multithreaded requests while performing rigorous functional validation under load conditions

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 122

Page 113: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

With Oracle Test Manager helps users manage the application testing process, ensuring full test coverage including functional, performance and also security concern. It allows users to define testing requirements, specify and execute manual or automated tests to validate those requirements and then manage the defects that those tests uncover.

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 123

Page 114: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

Refer to Oracle Test Manager Data Sheet

4.4.9.4 Vendor need to ensure that data is masked consistently in test environments

to a unique masked value to maintain the relationship between the data

across the test database while protecting the confidentiality of the

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 124

Page 115: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

original sensitive data.

Oracle Data Masking Pack helps organizations comply with privacy and confidentiality laws by masking sensitive or confidential data in development, test or staging environments. Oracle Data Masking Pack uses an irreversible process to replace sensitive data with realistic-looking but scrubbed data based on masking rules and ensures that the original data cannot be retrieved, recovered or restored. Oracle Data Masking Pack helps maintain the integrity of the application while masking data.

Refer to Oracle Data Masking Data Sheet

4.4.9.5 Vendor shall be included security roles and responsibilities for whom

working for THAI as part of the contracts.

SF shall provide role and responsibility for THAI

4.4.9.6 Vendor may advise and provide alternative all DW security control

functions and all other related modules which can be more favorable to

THAI.

Oracle will provide the Virtual Private Database (VPD) enables data

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 125

Page 116: 4.Technical Infrastructure Requirements-2.1

Thai Airways International Public Company LimitedDATA WAREHOUSESystem Functional

access control by user or by customer with the assurance of physical data separation to THAI. For Internet access, the Virtual Private Database can ensure that online customers see only their own accounts. THAI subsidiary companies can maintain data of multiple companies in the same Oracle database, while permitting each company to see only its own data.Within the enterprise, the Virtual Private Database results in lower costs of ownership in deploying applications. Security can be built once, in the data server, rather than in each application that accesses data. Security is stronger, because it is enforced by the database, no matter how a user accesses data. Security is no longer bypassed by a user accessing an ad hoc query tool or new report writer. The Virtual Private Database is a key technology that enables organizations to build hosted, Web-based applications.

Refer to Oracle® Database Security Guide Chapter 7

4. TECHNICAL INFRASTRUCTURE REQUIREMENTS Page 126