what's new for sap hana smart data integration & smart data quality

1© 2014 SAP AG or an SAP affiliate company. All rights reserved.

SAP HANA SPS 11 - What’s New? Enterprise Information Management

SAP HANA EIM Product Management December, 2015(Delta from SPS 10 to SPS 11)

© 2015 SAP SE or an SAP affiliate company. All rights reserved. 2Public

Agenda

SAP HANA smart data integration Workload Management New Remote Sources Enhanced Flowgraph Capabilities Enhanced Operations Capabilities Enhanced Data Provisioning Adapter Capabilities


Agenda

SAP HANA smart data quality Enhanced Geocoding Capabilities Enhanced Match Capabilities


Agenda

SAP Enterprise Semantic Search New administration UI for scheduling and monitoring Enhanced Content Type Identification Remote Source Crawling

SAP HANA smart data integration


SAP HANA smart data integration – What’s New in SPS 11?

Workload ManagementProvides user and application based workload management Applies to Tasks, which is the runtime object in HANA smart data integration responsible for initial loads and the

batch or real time transformation of data Is configurable by the system administrator as follows

– Number of threads– Memory Consumption– Priority, as defined by a system administrator



New Remote SourcesNew Data Provisioning adapters are available for the following sources SAP Business Suite Tables and ODP enabled DataSources (a.k.a. BW Extractors)

– Accesses data via RFC and JCO SAP ECC on SAP ASE Microsoft Excel® SOAP Web Services

– These services are exposed as virtual functions



New Remote SourcesNew Data Provisioning adapters are available for the following sources CamelAdapter

– This is not an adapter you can use as is but is rather a framework adapter that you can use to create your own custom adapters with little or no coding effort required

– Can connect to existing Apache Camel components CamelFacebookAdapter



Enhanced Flowgraph CapabilitiesThe Flowgraph editor in the HANA Web-based Development Workbench has been enhanced with the following capabilities Just-In-Time Data Preview

– Provides the ability to view the results of each transform in order to detect potential problems



Enhanced Flowgraph Capabilities New Data Sources

– Virtual Functionso Currently only available when using the SOAPAdapter

– SQL View– Calculation Viewo With support for input parameters



Enhanced Flowgraph Capabilities Hierarchical Transform

– Provides the ability to map a nested XML structure into a relational model

– Can only currently be used with a virtual function as a source



Enhanced Flowgraph Capabilities During execution, the system can populate

existing target columns with the following values– Change Type (i.e. insert/update/delete)– Change Time



Enhanced Flowgraph Capabilities Custom Parameter for Virtual Tables

– Can be used for Virtual Tables used as sources or targets– Are passed to the Virtual Tables during execution



Enhanced Flowgraph Capabilities Auto Arrange Before



Enhanced Flowgraph Capabilities Auto Arrange After



Enhanced Operational CapabilitiesThe monitoring user interface has been enhanced and now includes the following system operations capabilities Start a Task immediately



Enhanced Operational Capabilities Schedule a Task



Enhanced Operational Capabilities Stop a running Task



Enhanced Operational Capabilities Process a Remote Subscription Exception



Enhanced Data Provisioning Adapter CapabilitiesData Definition Language(DDL) operations can be replicated just like insert, update and delete operations Supported only when using a Replication Task

– Must be enabled for real time– Must be configured for Table Level Replication

Supports the following operations– Add Column– Drop Column

Is now supported by the HanaAdapter and TeradataAdapter in addition to…–DB2LogReaderAdapter, OracleLogReaderAdapter,

MssqlLogReaderAdapter, DB2ECCAdapter, OracleECCAdapter, MssqlECCAdapter,



Enhanced Data Provisioning Adapter Capabilities SAP ASE

– Support for compressed LOB columns

SAP HANA smart data quality



Enhanced Geocoding Capabilities Reverse geocode is a new capability of the

Geocode transform where the input is a coordinate



Enhanced Geocoding Capabilities The default setting returns the closest address Can be configured to return census data Can be configured to return nearby addresses

within a given radius



Best Record Is a new capability of the Match transform Takes data from a group of matching records

and, based on survivorship rules, creates a new record

Survivorship rules can be based on the following criteria– Source– Lengtho Based on one or many selected columns

– Date

SAP Enterprise Semantic Search



New administration UI for scheduling and monitoring Schedule the publication of HANA artifacts into the entity grid Schedule the profiling of HANA artifacts stored in the entity grid, which includes

– Content Type Identification– Extraction of enumerated, geography and time values

Monitor and manage the following outstanding requests– Publish– Unpublish– Profile

Manage the size and contents of the entity grid



Enhanced Content Type IdentificationWhen the content of a column can’t be determined with certainty, a list of possible content types will be provided for the user to choose the correct one

Remote Source CrawlingRemote sources can now be crawled in order to make them available via keyword search based on metadata and semantic informationCrawlers for the following remote sources are now available OracleECCAdapter OracleLogReaderAdapter


Disclaimer

This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP.

SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP’s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice.

This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent.

what's new for sap hana smart data integration & smart data quality

Data & Analytics