mediagrid overview
TRANSCRIPT
-
7/31/2019 MediaGrid Overview
1/27
MediaGrid Overview
Omneon proprietary - do not duplicate or distribute
Omneon CONFIDENTIAL
-
7/31/2019 MediaGrid Overview
2/27
MediaGrid Overview
What is a MediaGrid?
Active Disk Storage System
Designed for large file storage and
access
-
7/31/2019 MediaGrid Overview
3/27
Typical Usage
FileFileFileFile----BasedBasedBasedBased
Content LibraryContent LibraryContent LibraryContent Library
RealRealRealReal----Time ServersTime ServersTime ServersTime Servers
IngestIngestIngestIngest
SDISDISDISDI
High Performance
real-time (isochronous)High Performance
asynchronous file access over IP
EditEditEditEditBrowseBrowseBrowseBrowse
ArchiveArchiveArchiveArchive
PlayoutPlayoutPlayoutPlayout
SDISDISDISDI
-
7/31/2019 MediaGrid Overview
4/27
MediaGrid Hardware Components
MediaGrid Hardware Components
ContentDirector
ContentServer
ContentBridge
Network Switches
SystemManager
-
7/31/2019 MediaGrid Overview
5/27
-
7/31/2019 MediaGrid Overview
6/27
MediaGrid Hardware Components - ContentServer
ContentServer
Handles the replication of
ContentDirectors
ContentServers
Stores Slices
Intelligent storage device
Adding more ContentServers
increases the access bandwidth of the
system
s ces GigE NetworkGigE NetworkGigE NetworkGigE Network
-
7/31/2019 MediaGrid Overview
7/27
MediaGrid Hardware Components - ContentBridge
ContentBridge
Provides data access to the MediaGrid via open protocols
ClientsClientsClientsClients
Facilitates active transfers
ContentServersContentServersContentServersContentServers
ContentBridgeContentBridgeContentBridgeContentBridge
on en rec orson en rec orson en rec orson en rec ors
Spectrum
Linux
MAC Client
-
7/31/2019 MediaGrid Overview
8/27
MediaGrid Hardware Components - NetworkSwitches
Network Switches
Gigabit Ethernet Switches are usedto interconnect system components:
- ContentServers
-ContentDirectors
- ContentBridge
- SystemManager
-
7/31/2019 MediaGrid Overview
9/27
MediaGrid Hardware Components - SystemManager
SystemManager
SystemManager
ContentBridge
ContentDirector
ContentDirector
ContentDirector
10GbE Switch
1GbE Switch 1
1GbE Switch 2
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
Ke board/Mouse/Monitor
Hardware platform is a 1RU WindowsPC SystemManager application is the
software component that runs on
Omneon Content Library Rack
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServerContentServer
ContentServer
ContentServer
ContentServer
ContentServer
ContentServer
any supported Windows PCrunning XP
-
7/31/2019 MediaGrid Overview
10/27
MediaGrid Software Components
MediaGrid Software Components
SystemManager GUI
ContentManager GUI
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
SystemManagerSystemManagerSystemManagerSystemManager
Windows Client
Filesystem Driver
ContentBridge
ContentServersContentServersContentServersContentServers
ContentBridgeContentBridgeContentBridgeContentBridge
Linux Client
MAC ClientContentManagerContentManagerContentManagerContentManager
-
7/31/2019 MediaGrid Overview
11/27
MediaGrid Software Components
SystemManager
Web-based GUI for configuringand monitoring:
- ContentServers
- ContentDirectors
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
SystemManagerSystemManagerSystemManagerSystemManager
Windows Client
- ContentBridges
Configure Replication factor at
the file system level.
ContentServersContentServersContentServersContentServers
ContentBridgeContentBridgeContentBridgeContentBridge
Linux Client
MAC ClientContentManagerContentManagerContentManagerContentManager
-
7/31/2019 MediaGrid Overview
12/27
MediaGrid Software Components
ContentManager
Windows-based GUI applicationUsed for setting, reviewing, changing
- Replication factor
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
SystemManagerSystemManagerSystemManagerSystemManager
Windows Client
- ccess on ro s
- Directory Quota
- Directory Reservations
ContentServersContentServersContentServersContentServers
ContentBridgeContentBridgeContentBridgeContentBridge
Linux Client
MAC ClientContentManagerContentManagerContentManagerContentManager
-
7/31/2019 MediaGrid Overview
13/27
MediaGrid Software Components
Filesystem Driver
The Filesystem driver is
installed on the clients
computer
Allows a client to communicate
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
SystemManagerSystemManagerSystemManagerSystemManager
Windows Client
ContentServersContentServersContentServersContentServers
ContentBridgeContentBridgeContentBridgeContentBridge
Linux Client
MAC ClientContentManagerContentManagerContentManagerContentManager
-
7/31/2019 MediaGrid Overview
14/27
MediaGrid Software Components
ContentBridge
Clients that do not have the FSD
installed, communicate with theMediaGrid via the ContentBridge
Supported open protocols:
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
SystemManagerSystemManagerSystemManagerSystemManager
Windows Client
-FTP (File Transfer Protocol)
- CIFS (Common Internet Filesystem)
- AFP (Apple Filing Protocol)
-NFS (Network File System)
ContentServersContentServersContentServersContentServers
ContentBridgeContentBridgeContentBridgeContentBridge
Linux Client
MAC Client
ContentManagerContentManagerContentManagerContentManager
-
7/31/2019 MediaGrid Overview
15/27
Write Operation
ClientsClientsClientsClients
GigE NetworkGigE NetworkGigE NetworkGigE Network
ContentServersContentServersContentServersContentServers Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis
for data storage.for data storage.for data storage.for data storage.
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
(File System)(File System)(File System)(File System)
ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define
namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients
with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual
data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on
several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers
Metadata
1
2
3
5
Content is chopped into slices and stored across multiple ContentServers.
Slices are replicated on more than one ContentServer for protection. No RAID.
Content File 1 2 3 4 5
4
-
7/31/2019 MediaGrid Overview
16/27
Read Operation
ClientsClientsClientsClients
GigE NetworkGigE NetworkGigE NetworkGigE Network
Metadata
2
5
1
1
2
3
4
5
1
4
2
3
5
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
(File System)(File System)(File System)(File System)
ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define
namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients
with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual
data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on
several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers
Metadata
Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis
for data storage.for data storage.for data storage.for data storage.
ContentServersContentServersContentServersContentServers
Clients ask ContentDirectors for pointers, then interact directly withContentServers to access file slices.
No NAS head involved in data transferno bottlenecks
4
All interconnect via Ethernetno SAN complexity
-
7/31/2019 MediaGrid Overview
17/27
How Omneon MediaGrid Provide High AccessBandwidth
ClientsClientsClientsClients
GigE NetworkGigE NetworkGigE NetworkGigE Network
1
4
2
3
5
2
5
1
1
2
3
4
5
1
2
5
Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis
for data storage.for data storage.for data storage.for data storage.
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
(File System)(File System)(File System)(File System)
ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define
namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients
with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual
data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on
several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers
Metadata
ContentServersContentServersContentServersContentServers
Access bandwidth scales with number of ContentServers and replication factor
Simultaneous file operations are distributed across all ContentServers whichhave relevant content
44
Each ContentServer operates independently and directly with clients to satisfyaccess requirements
-
7/31/2019 MediaGrid Overview
18/27
Recovery in the event of component loss
ClientsClientsClientsClients
GigE NetworkGigE NetworkGigE NetworkGigE Network
1
4
2
5
5
1
1
2
4
5
1
5
3 2
3
Commodity storage chassisCommodity storage chassisCommodity storage chassisCommodity storage chassis
for data storage.for data storage.for data storage.for data storage.
ContentDirectorsContentDirectorsContentDirectorsContentDirectors
(File System)(File System)(File System)(File System)
ContentDirectors defineContentDirectors defineContentDirectors defineContentDirectors define
namespace and provide clientsnamespace and provide clientsnamespace and provide clientsnamespace and provide clients
with pointers to the actualwith pointers to the actualwith pointers to the actualwith pointers to the actual
data, which typically resides ondata, which typically resides ondata, which typically resides ondata, which typically resides on
several ContentServersseveral ContentServersseveral ContentServersseveral ContentServers
Metadata
ContentServersContentServersContentServersContentServers
Lost drives or ContentServers do not necessitate a volume rebuild, as in RAID
The ContentDirector initiates creation of additional copies of missing filesegments in parallel across all ContentServers
When a ContentServer or drive is replaced, it appears as new storage to beutilized in the system
44
2
-
7/31/2019 MediaGrid Overview
19/27
-
7/31/2019 MediaGrid Overview
20/27
-
7/31/2019 MediaGrid Overview
21/27
Cluster, Volume, Group, ReplicationFactor
Omneon proprietary - do not duplicate or distribute
-
7/31/2019 MediaGrid Overview
22/27
Cluster, Volume, Group
A MediaGrid Cluster refers toa collection of one Volume
and their associatedContentDirectors andContentServers within anOmneon MediaGrid.
Volumes can be consideredthe same as filesystems
One or more ContentServerscreate a group.
One or more groups create avolume.
-
7/31/2019 MediaGrid Overview
23/27
Cluster, Volume, Group
Grouping ContentServers is a simple yet powerful way to
orchestrate the placement of replicated images of slices
across ContentServers and to align slices with thephysical characteristics of the Cluster.
possible and never within the same ContentServer.
Groups should only consist of ContentServers in the
same physical enclosure (rack). This implementationprovides the ability to access a replicated slice even in
the case of an entire lost/failed enclosure (rack).
-
7/31/2019 MediaGrid Overview
24/27
Cluster, Volume, Group
Avoid making more than one Group per rack (applicable
only to 1RU CSS) in a Cluster unless needed. There are
some cases where you may be tempted to use multipleGroups:
Power supply isolation of ContentServers: If ContentServers are on
separa e power s r ps, en crea e a roup or eac power s r p. o
not create too many Groups.
Network isolation of ContentServers. If ContentServers are on
separate network switches, then create a Group for each network
switch. Do not create too many Groups.
-
7/31/2019 MediaGrid Overview
25/27
Cluster, Volume, Group
The suggested maximum number of Groups is less than
nine. Once you have more than two racks of
ContentServers, Omneon suggests limiting a Group to awhole rack, instead of multiple Groups within a rack.
higher than the expected replication factor. More Groupsdo not help.
-
7/31/2019 MediaGrid Overview
26/27
About Replication Factor
Omneon recommends the following:
Set the replication factor to less than or equal to the number of
Groups within a Cluster.
Do not set the replication factor to 1 or 0. Factors of 1 or 0 mean no
replication will take place.
Note that the default replication factor is 3 which means 3copies of the file will be created.
-
7/31/2019 MediaGrid Overview
27/27
The End
Omneon proprietary - do not duplicate or distribute