ibm managed file transfer portfolio - ibmimpact 2014

© 2014 IBM Corporation

Using IBM’s Managed File Transfer Portfolio to maximize data effectiveness Leif DavidsenSenior Product ManagerIBM Messaging Portfolio

Dirk ManeyProduct Line ManagerManaged File Transfer, Smarter Commerce

Please Note

IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

Files and their content drive today’s enterprise

How do most organizations move files today?

FTP• Typically File Transfer Protocol (FTP) is combined with writing

and maintaining homegrown code to address its limitations

Why is FTP use so widespread?• FTP is widely available – Lowest common denominator• Promises a quick fix – repent at leisure• Simple concepts – low technical skills needed to get started• FTP products seem “free”, simple, intuitive and ubiquitous

Legacy File Transfer products• A combination of products often used to provide silo solutions• Often based on proprietary versions of FTP protocol• Can’t transport other forms of data besides files• Usually well integrated with B2B but rarely able to work with the

rest of the IT infrastructure – especially with SOA

People• From IT Staff to Business staff and even Security Personnel• Using a combination of email, fax, phone, mail, memory keys…

Most organizations rely on a mix of home-grown code,

several legacy products and different technologies … and

even people!

Shortcomings of Basic FTP

Limited Flexibility

Limited Security

Limited visibility and traceability

Limited Reliability

� Unreliable delivery – Lacking checkpoint restart – Files can

be lost� Transfers can terminate

without notification or any record – corrupt or partial

files can be accidentally used� File data can be unusable

after transfer – lack of Character Set conversion

� Often usernames and passwords are sent with file –

as plain text!� Privacy, authentication and

encryption often not be available

� Non-repudiation often lacking

� Transfers cannot be monitored and managed centrally or remotely

� Logging capabilities may be limited and may only record transfers between directly connected systems

� Cannot track the entire journey of files – not just from one machine to the next but from the start of its

journey to its final destination

� Changes to file transfers often require updates to many ftp scripts that are typically scattered across machines

and require platform-specific skills to alter� All resources usually have to be available concurrently

� Often only one ftp transfer can run at a time� Typically transfers cannot be prioritized

FTP introduces risks in data movement

Process Risk

� Delays in transferring files impacts

collaboration with customers/partners

� Integration files that are delayed impact SLAs

� Failure of file delivery impacts the processes

themselves

Security Risk

� Data encryption and governance of sensitive

information transmitted in files

� Inability to apply corporate security policies to

person-initiated file transfers

� No visibility over the type and sensitivity of the

data being transferred

� No ability to support audit requirements

IBM’s Managed File Transfer solution addresses all of these risks

Who benefits from Managed File Transfer

Application Owners• Producers and consumers of data held in files

• Application developers likely to own files, own code and own existing file transfer mechanisms

• Increase reliability, improved timely access to data

Infrastructure owners• Currently provide connectivity between systems, through middleware solutions

• Provide technical expertise to assist application owners

• Reduce recurring error handling and recovery, leverage middleware tools

CxOs• Need to improve productivity of staff and IT

• Speed up business performance without impacting security

Customers• Less risk of loss or exposure of data

• Improved business effectiveness and better, more accurate fulfilment

IBM MFT Vision

Accelerate and simplify governance of the growing volume of business-

critical data movement within and beyond the enterprise with Smarter MFT

Maximize the agility and performance of dynamic business networks by reducing

the complexity, risk, and cost of file transfer

Visibility• Single view of transfer activity

• Transaction and business monitoring• Dashboards, analytics, and scorecards

Usability & Management• Persona-based, easy-to-use interfaces

• Unified control and configuration of infrastructure

• Community on-boarding and coordination

Universal

standards

Universal• Any transport, any protocol, and any

partner• Global and cloud-enabled deployment• Broad platform coverage and industry

standards

Security & Performance• Assured delivery and high availability

• Protection of file data in transit and at rest• Accelerated transport and low latency

Connectivity• Integration with BPM to drive business processes

• Leveraging ESBs to enable service orientation• SOA Registry/Repository for lifecycle governance

Comprehensive IBM Managed File Transfer

Monitor file transfer activity & SLAsIBM® Sterling Control Center

Peer-to-peer file transfers via file system

IBM® Sterling Connect:Direct®

Message Centric Transfers

MQ MFT

Scope of this presentation

• A single packaged offering for IBM Managed File Transfer• Sterling Connect:Direct and Sterling Control Center are now packaged with

IBM MQ Managed File Transfer as WebSphere Managed File Transfer• IBM MQ Advanced is also enhanced with these additional capabilities

B2B Onboarding and file transfer via mailboxing

IBM® Sterling File Gateway

Cloud service for B2B file exchangeIBM® Sterling File Transfer Service

IBM offers comprehensive MFT Capabilities

� IBM MQ Managed File Transfer provides file transfer optimized for data delivery across IBM MQ networks

� Sterling Connect Direct provides peer-to-peer file transfer optimized for data delivery within and between enterprises across Connect:Directprotocol

� Sterling Control Center Manage file transfer activity across your file transfer servers including Connect:Direct, FTP, MQ MFT and Sterling File Gateway

Addressing multiple use cases and scenarios for both internal and multi-

enterprise file transfer

MQ V8 Advanced – Universal Messaging including Managed File Transfer

WebSphere Managed File Transfer

All functions available for one single price

Sterling C:D

Sterling C:C

MQ V8

MQ Telemetry

MQ AMS

MQ MFT

Sterling C:D

Sterling C:C

MQ MFT

MQ Advanced V8 � Enterprise Messaging with publish/subscribe and

queuing for any application, on any OS, using any language

� Connects applications reliably and securely to send data anywhere to any solution

� Extends application messaging to Mobile, Internet of Things and Managed File Transfer

� Single, simplified licensing to provide all the capabilities to connect the business, and maximize data value

� Do more with your MQ investment, lowering operational overheads, and raising efficiencies

� Ensures all possible functions and capabilities are available instantly to allow the business to respond faster to changing needs

� Moves data from anywhere to anywhere with included end to end monitoring and management

MQ Advanced V8

Available as WebSphere Managed File Transfer Service, or WebSphere Managed

File Transfer Managed Endpoints

A consolidated transport for both files and messages

Traditional approaches to file transfer result in parallel infrastructures

• One for files – typically built on FTP• One for application messaging – based on

IBM MQ, or similar

High degree of duplication in creating and maintaining the two infrastructures

MQ MFT reuses the MQ network for managed file transfer and yields

• Operational savings and simplification• Reduced administration effort• Reduced skills requirements and

maintenance

File TransfersApplication Messaging

Consolidated Transportfor Messages & Files

Handling both files and messages across MQ MFT

One file to one message

MQMFT

One file to a group of messages

One message to one file

A group of messages (or all messages on the queue) to one file

File can be split based on:

• Size

• Binary delimiter

• Regular expression

• One message becomes one file

• Optionally, a delimiter can be inserted between each message

used to compose the file

• One file becomes one message

MQMFT

MQMFT

MQMFT

Universalmessaging backbone

IBM MQ Advanced V8 Architecture Summary

WebSphere Managed File Transfer

(Includes MQ MFT, Sterling C:D,

Sterling C:C)

• End-to-end audit trail across file transfers

• Reliable and efficient transfer of file data regardless of size

• Centralized monitoring of transfer events and management of transfers

MQ Advanced Message Security

� Signs and encrypts data sent over MQ to provide privacy and integrity

IBM MQ

� Scalable, reliable, and efficient transport for data

File-to-File

Message-to-File

File-to-Message

Message LevelSecurity

Mobile & M2M Messaging

IBM MQ Telemetry

� Lightweight, low power, low bandwidth messaging to mobiles and sensors

A grocery retailerIBM messaging backbone delivers transaction data to central hub in near-real time

The need:

At this company, transaction data from more than 2,400 grocery stores reached a central data warehouse via daily batch transfers, delaying analysis and hampering theft prevention efforts.

The solution:

The company implemented an integrated message queuing infrastructure that can transfer data from any store endpoint to the central hub in near-real time

IBM MQ MFT software transfers files between the central hub and the stores’ ESBs and in turn to other endpoint applications in the store.

The benefit:

� Dramatically reduces time between customer transaction in store and data reaching data warehouse

� Provides a rock-solid messaging integration engine in a small footprint

� Delivers a reliable infrastructure for transaction data and file-based information

“WebSphere Message

Broker is rock-solid. It has

a relatively small footprint,

and it is a world-class

integration engine.”

—A software engineer, grocery retailer

Solution components:

Software

� IBM® Integration Bus (formerly known as IBM WebSphere® Message Broker)

� IBM MQ

� IBM MQ Managed File Transfer


� IBM MQ Managed File Transfer provides file transfer optimized for data delivery across WebSphere MQ networks



Addressing multiple use cases and scenarios for both internal and multi-enterprise file transfer

IBM® Sterling Connect:Direct

• What it does– High volume, large size, mission-critical file transfers– Automation, retry-restart, for unattended operation, with never breached security

• What it allows clients to do– Move files with confidence and upgrade unreliable, unsecured FTP– Handle growth in data volume and size without increase in staff

• How do I know I need it?– Regulatory, industry, or company security/compliance requirements continue to grow– Business operations require assured delivery of critical data

Reliable and high performance solution for secure, point-to-point, bulk data transfers

Peer-to-peer file transfersIBM® Sterling Connect:Direct®

Detail: IBM® Sterling Connect:Direct

• MFT solution using peer-to-peer file transfer to move data across the enterprise and between trading partners

• Remediates FTP and failed audits by adding security, monitoring, and reliability without replacing FTP scripts

• High-volume, bulk data transfers for corporate-to-bank and financial data connectivity

• Data movement across a broad range of platforms, including mainframe, midrange, and distributed

• Small footprint, robust integration with 3rd party schedulers, and rapid deployment

IBM Sterling Connect:Direct Delivers Significant Value

• Assured, “lights out” data delivery

• Automatic recovery

• Optimized for performance and throughput

• Helps meet SLA’s with IBM Sterling Control Center integration

• High availability, cluster aware

Increased Customer Satisfaction

• Strong authentication and encryption

• Integration with existing security infrastructure

• Perimeter and firewall best practices

• Data integrity checking

• Customizable security exits

Solving Internal Security Mandates

• Extensive audit and logging (SOX)

• Can help meet industry requirements such as PCI and HIPAA

• Support for latest security standards and toolkits (FIPS, NIST SP800-131a)

Compliance with Regulatory Requirements

Sterling Connect:Direct Customer Reference

� Sterling Connect:Direct provides the sheer capacity of

transfer rates that simply cannot be done manually, and

performs such tasks in a security-enhanced or security-

rich manner; efficiently, and quickly.

� Scalability helping ensure Kookmin would be able to

handle peak demand and keep pace with volume growth.

� Satisfies regulatory and industry requirements.

� For Kookmin to remain competitive they needed to be

able to reallocate assets from an IT focus to a customer

focus and implement a system that will shift toward a

multi-specialist strategy of approaching customers.

� They decided to implement Sterling Connect:Direct from

IBM for its ability to transfer high volumes and large files

with no defined limits on file sizes.

� The scalability helped ensure that Kookmin would be

able to handle peak demand and keep pace as their

volume grew.

Customer Profile

Kookmin Bank merged with Housing &

Commercial Bank in 2001, making it the largest

bank by both asset value and market

capitalization in South Korea. Private banking

was launched late last year at Kookmin

in order to shift away from the company’s

traditional universal banking approach.

Challenge

Results

Solution

Trading Partner

Integrating IBM Sterling Connect:Direct and IBM MQ MFT

MFTAudit

Agent

IBM MQ

Agent Agent

C:DBridgeAgent

C:DNode

C:DNode

C:DNode

C:DNode

C:DAudit

Reference

Inside the MFT audit trail…

The audit information for each MFT transferreferences related C:D audit information

� The Connect:Direct Bridge capability supports managed file transfers that span MFT and C:D with a joined up audit trail

Bridging MQ and C:D networks at a large publisherSolution architecture for a large publisher using the C:D bridge as a way to consolidate its IT

infrastructure while still retaining the communication protocols used to communicate with partners

MQ

Pain Points

� Existing solution is a hodgepodge of different data transports from different vendors

� Difficult to integrate existing applications, built on MQ messaging, with file data arriving from business partners

IBM’s MFT suite helps

� Bridge the MQ and C:D environments

� Leverage existing MQ skills and investment

� Message-to-file and file-to-message

� End-to-end visibility of files and messages

� Modernize batch applications

� Modernize MFT with RESTful Web 2.0 interfaces

Internal connectivity standardized on an MQ-backbone

Existing MQ applications Customer #1

Customer #2

Customer #n

…

C:D bridge

Customers request that publications

can be submitted to the publisher via the C:D

protocol

Publisher


� IBM MQ Managed File Transfer provides file transfer optimized for data delivery across WebSphere MQ networks




IBM® Sterling Control Center

Delivering higher levels of service for key integration and transfer services

What it does

• Consolidated logging, reporting, and analytics for all transfers and integration processes

• Rule-driven service level management

• Alerts and notifications

• Configuration management

How it is delivered

• Java-based solution for management and visibility of the file transfer and B2B integration infrastructure

• Engine, agents, and user consoles

• Interfaces to existing system management tools

IBM® Sterling Control Center

What it allows customers to do

• Have visibility into all file transfer activity including Sterling Connect:Direct and IBM MQ MFT from a central console

• React to transfer events before they impact SLAs

• Easily provide compliance reporting and mobile monitoring

• Central configuration management for Sterling Connect:Direct® servers

How do I know I need it?

• Increasing numbers of transfers or B2B interactions are governed by SLAs

• Increasing compliance, governance and audit requirements

• Pressure to decrease IT operational cost for B2B or file transfer operations

What differentiates IBM Sterling?

• Product specific knowledge of file transfer events, business processes and SLAs to build rules around

• Access from mobile devices

• Scale and performance – test environment with moderately-sized hardware performed well with 5K servers producing 540K processes and 4.3M events per day

IBM® Sterling Control Center value opportunity

Improved service level achievement

• Reduced fines due to missed SLA s

• Improved customer retention and reputation risk by proactively addressing issues before an outage is declared

Improved operational efficiencies

• Reduced support costs though centralization

• Reduced support costs by reducing platform specific staff

• Reduce troubleshooting costs for B2B transfers by 90+%*

• Reduce average cost per transfer to troubleshoot to $.0392*

Auditability

• Reduced support costs tracking who-what-when

• Policy management helps proactively identify non-compliance

• Minimize fines by complying with privacy and SOX regulations

1Data points referenced in this presentation represent findings from an internal IBM Sterling research study - December 10, 2009

• Separate file processing and monitoring• Visibility and notifications• Secure connections• Integration with enterprise management systems

• Separate file processing and monitoring• Visibility and notifications• Secure connections• Integration with enterprise management systems

Enable good monitoring practices

• Processes & process steps• File transfers, inbound and outbound• Complex monitoring scenarios• Environment health , including for clusters

• Processes & process steps• File transfers, inbound and outbound• Complex monitoring scenarios• Environment health , including for clusters

Provide visibility and monitoring

• Centralized configuration audit information• Single console to maintain all Connect:Direct

configs

• Centralized configuration audit information• Single console to maintain all Connect:Direct

configs

Ensure compliance and respond to audits

• Ad-hoc and scheduled reports• Interoperability with 3rd party reporting tools• Web console and mobile app

• Ad-hoc and scheduled reports• Interoperability with 3rd party reporting tools• Web console and mobile app

Track and publicize results

Deliver higher levels of service with IBM Sterling Control Center


� IBM MQ Managed File Transfer provides file transfer optimized for data delivery across IBM MQ networks.

� Sterling Connect Direct provides peer-to-peer file transfer optimized for data delivery within and between enterprises across Connect:Direct protocol



Available together today as WebSphere Managed File Transfer, or as Sterling Connect:Direct Advanced. These entitlements are also combined inside the IBM MQ Advanced offering

Proven to Meet the Most Demanding Business Requirements�Over 30 years of experience working with the world’s largest businesses�Over 4,700 customers – top 10 banking and financial services firms�File transfer backbone of the banking sector, processing billions of transactions each year

Comprehensive MFT Suite for Complete Range of Use Cases� Internal and external transport for automated and ad hoc file transfers� Integration of files with enterprise applications, services, and systems

Universal Connectivity, Dynamic Community, End-to-End Visibility� Interoperability between file transfer styles to enable seamless flow of data�Broad set of protocols, i.e. HTTP/S, FTP/, SFTP, C:D, MQ, AS1/2/3, EDI, EBICS, RosettaNet, etc.�Tight integration with ESB style of integration

Built on the Most Modern Technologies�Application of J2E, ESB, SOA, SOAP, Web Services, REST, AJAX, etc.� Leverages your existing skills and investments

Superior Consulting and Professional Services Expertise�Experienced in building MFT centers of excellence providing guidance in MFT best practices�Global deployment experience across industries

5/1/2014 IBM Confidential

IBM’s commitment to Managed File Transfer (MFT)

IBM has a 20 year track record of innovation in Messaging

1990s 2000s 2010s

JMS

MQIAssured delivery

IBM MQSeries

Multi-platform

Mobile

.NET

Common criteriaEclipse

JMS 1.1RCMS

IBM MQ Low Latency

V1.1V2

V5V5.1

V5.3

V2.1

V5.2

V6

V7V7.0.1

SSLSOAP

XML

IBM MQ Managed File Transfer

IBM MQTT

HTTPAJAXREST

Web 2.0Managed

File Transfer

Pub/sub

IBM MQ Everyplace

IBM MQ Advanced Message Security

V7.1V7.5

Integrated Messaging

Hypervisors

IBM MQ Advanced

System PatternApplication Pattern

IBM MQ Advanced for Developers

IBM MessageSight

Multiple clusterXMIT queue

Multi-instanceQMGR

IBM MQ Low Latency

V8

Questions?

Thank You

We Value Your Feedback

Don’t forget to submit your Impact session and speaker feedback! Your feedback is very important to us – we use it to continually improve the conference.

Use the Conference Mobile App or the online Agenda Builder to quickly submit your survey

• Navigate to “Surveys” to see a view of surveys for sessions you’ve attended

32

Legal Disclaimer

• © IBM Corporation 2014. All Rights Reserved.• The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained

in this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

• References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

• If the text contains performance statistics or references to benchmarks, insert the following language; otherwise delete:Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

• If the text includes any customer examples, please confirm we have prior written approval from such customer and insert the following language; otherwise delete:All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer.

• Please review text for proper trademark attribution of IBM products. At first use, each product name must be the full name and include appropriate trademark symbols (e.g., IBM Lotus® Sametime® Unyte™). Subsequent references can drop “IBM” but should include the proper branding (e.g., Lotus Sametime Gateway, or WebSphere Application Server). Please refer to http://www.ibm.com/legal/copytrade.shtml for guidance on which trademarks require the ® or ™ symbol. Do not use abbreviations for IBM product names in your presentation. All product names must be used as adjectives rather than nouns. Please list all of the trademarks that you use in your presentation as follows; delete any not included in your presentation. IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.

• If you reference Adobe® in the text, please mark the first use and include the following; otherwise delete:Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

• If you reference Java™ in the text, please mark the first use and include the following; otherwise delete:Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

• If you reference Microsoft® and/or Windows® in the text, please mark the first use and include the following, as applicable; otherwise delete:Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.

• If you reference Intel® and/or any of the following Intel products in the text, please mark the first use and include those that you use as follows; otherwise delete:Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

• If you reference UNIX® in the text, please mark the first use and include the following; otherwise delete:UNIX is a registered trademark of The Open Group in the United States and other countries.

• If you reference Linux® in your presentation, please mark the first use and include the following; otherwise delete:Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.

• If the text/graphics include screenshots, no actual IBM employee names may be used (even your own), if your screenshots include fictitious company names (e.g., Renovations, Zeta Bank, Acme) please update and insert the following; otherwise delete: All references to [insert fictitious company name] refer to a fictitious company and are used for illustration purposes only.