software-defined and hyperscaling storage for exponential data growth

23
0 Copyright 2014 FUJITSU Human Centric Innovation Fujitsu Forum 2014 19th – 20th November

Upload: fujitsu-global

Post on 30-Jun-2015

304 views

Category:

Technology


0 download

DESCRIPTION

Mr. Marcus Schneider (Fujitsu) Mr. Dr Andreas Neupert (Profi AG)

TRANSCRIPT

Page 1: Software-defined and Hyperscaling Storage for Exponential Data Growth

0 Copyright 2014 FUJITSU

Human CentricInnovation

Fujitsu Forum2014

19th – 20th November

Page 2: Software-defined and Hyperscaling Storage for Exponential Data Growth

1FUJITSU CONFIDENTIAL

Marcus SchneiderHead of Product Management and Development Storage

Service Platform Business

DARZ

XYZ

Software-defined and Hyperscaling Storage for Exponential Data Growth

Page 3: Software-defined and Hyperscaling Storage for Exponential Data Growth

2FUJITSU CONFIDENTIAL Copyright 2014 FUJITSU

Page 4: Software-defined and Hyperscaling Storage for Exponential Data Growth

3FUJITSU CONFIDENTIAL Copyright 2014 FUJITSU

Page 5: Software-defined and Hyperscaling Storage for Exponential Data Growth

4FUJITSU CONFIDENTIAL Copyright 2014 FUJITSU

Fujitsu waves 50PB+ MONSTER at hyperscale

storage freaks

Page 6: Software-defined and Hyperscaling Storage for Exponential Data Growth

5FUJITSU CONFIDENTIAL Copyright 2014 FUJITSU

Who on earth needs 50 PB of storage?

Page 8: Software-defined and Hyperscaling Storage for Exponential Data Growth

7FUJITSU CONFIDENTIAL

3rd Platform: a New Dimension of Data Growth

Cloud will account for 20% of the EMEA

external storage user value by 2018

2015 it will already be 14%

Copyright 2014 FUJITSU

Page 9: Software-defined and Hyperscaling Storage for Exponential Data Growth

8FUJITSU CONFIDENTIAL

The Petabyte Scale Needs New Storage

Traditional RAID based storage systems meet their limits when reaching petabyte scale

Massive number of files

RAID rebuild times

Backup breaks

Laborious tech refresh / migration

Utilisation / hot spots

0.5PB 1PB 10PB 20PB 100PB

Traditional RAID storage systems

Next generation storage

Copyright 2014 FUJITSU

Page 10: Software-defined and Hyperscaling Storage for Exponential Data Growth

9FUJITSU CONFIDENTIAL

Everlasting and designed for change

StorageNode

StorageNode

StorageNode

StorageNode

StorageNode

StorageNode

pseudo-random distribution

transparent creation of data copies automatic recreation of lost redundancy

automated tech refresh

Page 11: Software-defined and Hyperscaling Storage for Exponential Data Growth

10FTS CONFIDENTIAL

Ceph

ETERNUS CD10000 is based on Ceph

Ceph is an open-source software-defined storage platform

Designed to present object, block, and file storage

from a distributed x86 compute cluster,

scalable to the Exabyte level

OpenStack

Ceph is the #1storage element for OpenStack

OpenStack enables IT organizations building private

and public cloud environments with open source software

Based on Open Standards

Source: Spring 2014 Open Stack UserSurvey

Page 12: Software-defined and Hyperscaling Storage for Exponential Data Growth

11FTS CONFIDENTIAL

New Development Paradigm

Global Development

Team (Europe, US,

Asia)

100% Agile from day 1

Embracing

partnerships

Inktank/RedHat

Intel

Selected Universities and

Research Facilities

Copyright 2013 FUJITSU

Page 13: Software-defined and Hyperscaling Storage for Exponential Data Growth

12FTS CONFIDENTIAL

More than CEPH:Three Areas of FUJITSU added value

BackupSync

& ShareArchive Tiering

ET

ER

NU

S C

D10000

Object Level

Access

Block Level

Access

File Level

Access

Central Management

Ceph plus Fujitsu Extensions

10GbE Frontend Network

High Banddwith Backend

Network

Perf

orm

ance N

odes

Capacity N

odes

Copyright 2014 FUJITSU

1. Fundamental Appliance Extensions

• E.g. Communication with Server HW

2. Ceph Enhancements

• E.g. SNMP, will be handed over to

Open Source Community

• TTM advantage for Fujitsu

• Own IP (e.g.potentially Fujitsu Lab

Erasure code). Will stay with Fujitsu.

3. Application/Middleware Blocks

• They can come from partners

(e.g. iRods, with University of Mainz)

• They can be own Fujitsu IP Functions

(e.g. Backup, with FORTH)

3

2

1

Page 14: Software-defined and Hyperscaling Storage for Exponential Data Growth

13FTS CONFIDENTIAL

CD10000 – Enterprise Storage based on Ceph

Most easy to deploy and operate Ceph

package in the industry

Complete Enterprise Class Services – best

service package in the industry

More functionality – the most complete Ceph

based storage device in the industry

Page 15: Software-defined and Hyperscaling Storage for Exponential Data Growth

14FTS CONFIDENTIAL

Typical Usage Areas

Generic

250TB and beyond

online

Exponential and

unknown data growth

Typical industries and use cases

Open Stack users

(Cloud) service providers

Telecommunications providers

R&D, public institutions, universities

Companies with large R&D activities

Public institutions with

huge document repositories

Cloud projects of financial

institutions

Multimedia, Video Streaming

Copyright 2014 FUJITSU

Page 16: Software-defined and Hyperscaling Storage for Exponential Data Growth

15FTS CONFIDENTIAL

Customer Case: Service Provider DARZ

ETERNUS CD10000 at the Data Center Darmstadt

Implemented by

Fujitsu SELECT EXPERT Partner – Profi AG

Copyright 2014 FUJITSU

Page 17: Software-defined and Hyperscaling Storage for Exponential Data Growth

16FTS CONFIDENTIAL

The New Unified

Remember the good old 1980s, when life was still uncomplicated:

Unified = Block + File

Today:

Block

File

Object

vVol

And More?

Copyright 2013 FUJITSU

Source: SNIA

Page 18: Software-defined and Hyperscaling Storage for Exponential Data Growth

17FTS CONFIDENTIAL

ETERNUS CD10000 – Storage Nodes

Basic Storage Node

Delivers 12.6TB using

2.5" SAS disks (10k rpm)

Performance Node

Adds 21.6TB of 2.5"

SAS disks (10k rpm), 34.2TB total capacity

Capacity NodeAdds 240TB of

3.5" SATA disks (7.2k rpm),

252.6TB total capacity

Economy Node*

1u, Desktop drives

48TB in 1u(Conceptional)

4u, Desktop drives, 94*5TB

Ecology Node*All Flash TLC

Node500TB in 3u

(Conceptional)

*Economy and Ecology nodes are roadmap options

Page 19: Software-defined and Hyperscaling Storage for Exponential Data Growth

18FTS CONFIDENTIAL

Unlimited Scalability

Cluster of storage nodes

Capacity scales by adding storage nodes

Theoretically scalable to Exabytes of data

First version of CD10000 is released for

a maximum of 224 nodes

enabling a maximum capacity of

56 petabytes

But nobody starts at 50PB:

Does start with 4 nodes, 50TB.

You can grow as you need.

Copyright 2014 FUJITSU

Basic node 12 TB Performance node 35 TB Capacity node 252 TB

Page 20: Software-defined and Hyperscaling Storage for Exponential Data Growth

19FTS CONFIDENTIAL

Efficiency through cost optimization

Inherent business continuity functions at no extra cost

High system automation reduces operational efforts

Less downtime costs through online maintenance

Extremely long lifecycle protects investments

End-to-end design an maintenance from Fujitsu

reduces, evaluation, integration, maintenance costs

Serverized hardware base helps to leverage

innovations faster

Page 21: Software-defined and Hyperscaling Storage for Exponential Data Growth

20FTS CONFIDENTIAL

The Hyperscale Storage System

Copyright 2014 FUJITSU

ETERNUS CD10000

ETERNUS

CD10000

Hyper-

scale

Open

Stack

Cost

optimized

The new

unified

Ever-

lasting

Hyper

converged

Page 22: Software-defined and Hyperscaling Storage for Exponential Data Growth

21FUJITSU CONFIDENTIAL Copyright 2014 FUJITSU

It's possibly one of the most scalable scale-out systems on

the planet, certainly out-scaling EMC's Isilon product

Page 23: Software-defined and Hyperscaling Storage for Exponential Data Growth

22FUJITSU CONFIDENTIAL