mediagrid overview

Upload: zenht

Post on 05-Apr-2018

231 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/31/2019 MediaGrid Overview

    1/27

    MediaGrid Overview

    Omneon proprietary - do not duplicate or distribute

    Omneon CONFIDENTIAL

  • 7/31/2019 MediaGrid Overview

    2/27

    MediaGrid Overview

    What is a MediaGrid?

    Active Disk Storage System

    Designed for large file storage and

    access

  • 7/31/2019 MediaGrid Overview

    3/27

    Typical Usage

    FileFileFileFile----BasedBasedBasedBased

    Content LibraryContent LibraryContent LibraryContent Library

    RealRealRealReal----Time ServersTime ServersTime ServersTime Servers

    IngestIngestIngestIngest

    SDISDISDISDI

    High Performance

    real-time (isochronous)High Performance

    asynchronous file access over IP

    EditEditEditEditBrowseBrowseBrowseBrowse

    ArchiveArchiveArchiveArchive

    PlayoutPlayoutPlayoutPlayout

    SDISDISDISDI

  • 7/31/2019 MediaGrid Overview

    4/27

    MediaGrid Hardware Components

    MediaGrid Hardware Components

    ContentDirector

    ContentServer

    ContentBridge

    Network Switches

    SystemManager

  • 7/31/2019 MediaGrid Overview

    5/27

  • 7/31/2019 MediaGrid Overview

    6/27

    MediaGrid Hardware Components - ContentServer

    ContentServer

    Handles the replication of

    ContentDirectors

    ContentServers

    Stores Slices

    Intelligent storage device

    Adding more ContentServers

    increases the access bandwidth of the

    system

    s ces GigE NetworkGigE NetworkGigE NetworkGigE Network

  • 7/31/2019 MediaGrid Overview

    7/27

    MediaGrid Hardware Components - ContentBridge

    ContentBridge

    Provides data access to the MediaGrid via open protocols

    ClientsClientsClientsClients

    Facilitates active transfers

    ContentServersContentServersContentServersContentServers

    ContentBridgeContentBridgeContentBridgeContentBridge

    on en rec orson en rec orson en rec orson en rec ors

    Spectrum

    Linux

    MAC Client

  • 7/31/2019 MediaGrid Overview

    8/27

    MediaGrid Hardware Components - NetworkSwitches

    Network Switches

    Gigabit Ethernet Switches are usedto interconnect system components:

    - ContentServers

    -ContentDirectors

    - ContentBridge

    - SystemManager

  • 7/31/2019 MediaGrid Overview

    9/27

    MediaGrid Hardware Components - SystemManager

    SystemManager

    SystemManager

    ContentBridge

    ContentDirector

    ContentDirector

    ContentDirector

    10GbE Switch

    1GbE Switch 1

    1GbE Switch 2

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    Ke board/Mouse/Monitor

    Hardware platform is a 1RU WindowsPC SystemManager application is the

    software component that runs on

    Omneon Content Library Rack

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServerContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    ContentServer

    any supported Windows PCrunning XP

  • 7/31/2019 MediaGrid Overview

    10/27

    MediaGrid Software Components

    MediaGrid Software Components

    SystemManager GUI

    ContentManager GUI

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    SystemManagerSystemManagerSystemManagerSystemManager

    Windows Client

    Filesystem Driver

    ContentBridge

    ContentServersContentServersContentServersContentServers

    ContentBridgeContentBridgeContentBridgeContentBridge

    Linux Client

    MAC ClientContentManagerContentManagerContentManagerContentManager

  • 7/31/2019 MediaGrid Overview

    11/27

    MediaGrid Software Components

    SystemManager

    Web-based GUI for configuringand monitoring:

    - ContentServers

    - ContentDirectors

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    SystemManagerSystemManagerSystemManagerSystemManager

    Windows Client

    - ContentBridges

    Configure Replication factor at

    the file system level.

    ContentServersContentServersContentServersContentServers

    ContentBridgeContentBridgeContentBridgeContentBridge

    Linux Client

    MAC ClientContentManagerContentManagerContentManagerContentManager

  • 7/31/2019 MediaGrid Overview

    12/27

    MediaGrid Software Components

    ContentManager

    Windows-based GUI applicationUsed for setting, reviewing, changing

    - Replication factor

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    SystemManagerSystemManagerSystemManagerSystemManager

    Windows Client

    - ccess on ro s

    - Directory Quota

    - Directory Reservations

    ContentServersContentServersContentServersContentServers

    ContentBridgeContentBridgeContentBridgeContentBridge

    Linux Client

    MAC ClientContentManagerContentManagerContentManagerContentManager

  • 7/31/2019 MediaGrid Overview

    13/27

    MediaGrid Software Components

    Filesystem Driver

    The Filesystem driver is

    installed on the clients

    computer

    Allows a client to communicate

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    SystemManagerSystemManagerSystemManagerSystemManager

    Windows Client

    ContentServersContentServersContentServersContentServers

    ContentBridgeContentBridgeContentBridgeContentBridge

    Linux Client

    MAC ClientContentManagerContentManagerContentManagerContentManager

  • 7/31/2019 MediaGrid Overview

    14/27

    MediaGrid Software Components

    ContentBridge

    Clients that do not have the FSD

    installed, communicate with theMediaGrid via the ContentBridge

    Supported open protocols:

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    SystemManagerSystemManagerSystemManagerSystemManager

    Windows Client

    -FTP (File Transfer Protocol)

    - CIFS (Common Internet Filesystem)

    - AFP (Apple Filing Protocol)

    -NFS (Network File System)

    ContentServersContentServersContentServersContentServers

    ContentBridgeContentBridgeContentBridgeContentBridge

    Linux Client

    MAC Client

    ContentManagerContentManagerContentManagerContentManager

  • 7/31/2019 MediaGrid Overview

    15/27

    Write Operation

    ClientsClientsClientsClients

    GigE NetworkGigE NetworkGigE NetworkGigE Network

    ContentServersContentServersContentServersContentServers Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis

    for data storage.for data storage.for data storage.for data storage.

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    (File System)(File System)(File System)(File System)

    ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define

    namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients

    with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual

    data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on

    several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers

    Metadata

    1

    2

    3

    5

    Content is chopped into slices and stored across multiple ContentServers.

    Slices are replicated on more than one ContentServer for protection. No RAID.

    Content File 1 2 3 4 5

    4

  • 7/31/2019 MediaGrid Overview

    16/27

    Read Operation

    ClientsClientsClientsClients

    GigE NetworkGigE NetworkGigE NetworkGigE Network

    Metadata

    2

    5

    1

    1

    2

    3

    4

    5

    1

    4

    2

    3

    5

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    (File System)(File System)(File System)(File System)

    ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define

    namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients

    with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual

    data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on

    several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers

    Metadata

    Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis

    for data storage.for data storage.for data storage.for data storage.

    ContentServersContentServersContentServersContentServers

    Clients ask ContentDirectors for pointers, then interact directly withContentServers to access file slices.

    No NAS head involved in data transferno bottlenecks

    4

    All interconnect via Ethernetno SAN complexity

  • 7/31/2019 MediaGrid Overview

    17/27

    How Omneon MediaGrid Provide High AccessBandwidth

    ClientsClientsClientsClients

    GigE NetworkGigE NetworkGigE NetworkGigE Network

    1

    4

    2

    3

    5

    2

    5

    1

    1

    2

    3

    4

    5

    1

    2

    5

    Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis

    for data storage.for data storage.for data storage.for data storage.

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    (File System)(File System)(File System)(File System)

    ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define

    namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients

    with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual

    data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on

    several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers

    Metadata

    ContentServersContentServersContentServersContentServers

    Access bandwidth scales with number of ContentServers and replication factor

    Simultaneous file operations are distributed across all ContentServers whichhave relevant content

    44

    Each ContentServer operates independently and directly with clients to satisfyaccess requirements

  • 7/31/2019 MediaGrid Overview

    18/27

    Recovery in the event of component loss

    ClientsClientsClientsClients

    GigE NetworkGigE NetworkGigE NetworkGigE Network

    1

    4

    2

    5

    5

    1

    1

    2

    4

    5

    1

    5

    3 2

    3

    Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis

    for data storage.for data storage.for data storage.for data storage.

    ContentDirectorsContentDirectorsContentDirectorsContentDirectors

    (File System)(File System)(File System)(File System)

    ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define

    namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients

    with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual

    data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on

    several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers

    Metadata

    ContentServersContentServersContentServersContentServers

    Lost drives or ContentServers do not necessitate a volume rebuild, as in RAID

    The ContentDirector initiates creation of additional copies of missing filesegments in parallel across all ContentServers

    When a ContentServer or drive is replaced, it appears as new storage to beutilized in the system

    44

    2

  • 7/31/2019 MediaGrid Overview

    19/27

  • 7/31/2019 MediaGrid Overview

    20/27

  • 7/31/2019 MediaGrid Overview

    21/27

    Cluster, Volume, Group, ReplicationFactor

    Omneon proprietary - do not duplicate or distribute

  • 7/31/2019 MediaGrid Overview

    22/27

    Cluster, Volume, Group

    A MediaGrid Cluster refers toa collection of one Volume

    and their associatedContentDirectors andContentServers within anOmneon MediaGrid.

    Volumes can be consideredthe same as filesystems

    One or more ContentServerscreate a group.

    One or more groups create avolume.

  • 7/31/2019 MediaGrid Overview

    23/27

    Cluster, Volume, Group

    Grouping ContentServers is a simple yet powerful way to

    orchestrate the placement of replicated images of slices

    across ContentServers and to align slices with thephysical characteristics of the Cluster.

    possible and never within the same ContentServer.

    Groups should only consist of ContentServers in the

    same physical enclosure (rack). This implementationprovides the ability to access a replicated slice even in

    the case of an entire lost/failed enclosure (rack).

  • 7/31/2019 MediaGrid Overview

    24/27

    Cluster, Volume, Group

    Avoid making more than one Group per rack (applicable

    only to 1RU CSS) in a Cluster unless needed. There are

    some cases where you may be tempted to use multipleGroups:

    Power supply isolation of ContentServers: If ContentServers are on

    separa e power s r ps, en crea e a roup or eac power s r p. o

    not create too many Groups.

    Network isolation of ContentServers. If ContentServers are on

    separate network switches, then create a Group for each network

    switch. Do not create too many Groups.

  • 7/31/2019 MediaGrid Overview

    25/27

    Cluster, Volume, Group

    The suggested maximum number of Groups is less than

    nine. Once you have more than two racks of

    ContentServers, Omneon suggests limiting a Group to awhole rack, instead of multiple Groups within a rack.

    higher than the expected replication factor. More Groupsdo not help.

  • 7/31/2019 MediaGrid Overview

    26/27

    About Replication Factor

    Omneon recommends the following:

    Set the replication factor to less than or equal to the number of

    Groups within a Cluster.

    Do not set the replication factor to 1 or 0. Factors of 1 or 0 mean no

    replication will take place.

    Note that the default replication factor is 3 which means 3copies of the file will be created.

  • 7/31/2019 MediaGrid Overview

    27/27

    The End

    Omneon proprietary - do not duplicate or distribute