distributed storage, rennes, september 2011

32
System view Serge Defrance, Rémy Gendrot, Jean Le Roux, Gilles Straub, Thierry Tapie Technicolor R&D, Rennes, France. Distributed Storage, Rennes, September 2011

Upload: olive

Post on 19-Jan-2016

43 views

Category:

Documents


0 download

DESCRIPTION

Distributed Storage, Rennes, September 2011. Home Networking as a Distributed File System view Serge Defrance , Rémy Gendrot, Jean Le Roux, Gilles Straub, Thierry Tapie Technicolor R&D, Rennes, France. Outline. The problem and our approach How to implement the proposed solution - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Distributed Storage, Rennes, September 2011

Home Networking as a Distributed File System view

Serge Defrance, Rémy Gendrot, Jean Le Roux, Gilles Straub, Thierry Tapie

Technicolor R&D, Rennes, France.

Distributed Storage, Rennes, September 2011

Page 2: Distributed Storage, Rennes, September 2011

The problem and our approachHow to implement the proposed solutionThe potential benefits for user

applications

Outline

2 04/21/23

Page 3: Distributed Storage, Rennes, September 2011

Heterogeneous home network environment

Organize the access to the content stored in or from the various devices.

Where our reflexion starts…

3 04/21/23

PCs

TabletsGameConsoles

TV sets

NAS?

Page 4: Distributed Storage, Rennes, September 2011

UPNP/DLNA, the most accomplished candidate Zero configuration protocol Targets unskilled users

Still evolving Requires updates May generate incompatibilities

A unique protocol

4 04/21/23

PCs

TabletsGameConsoles

TV sets

NAS

Page 5: Distributed Storage, Rennes, September 2011

Minimize software installation on devices Central Equipment connected to each device Always powered on May be controlled by the ISP (or a “service” provider)

Move all software installation on the gateway Use it as a protocol translator

Our gateway-centric approach

5 04/21/23

PCs

TabletsGameConsoles

TV sets

NAS

Page 6: Distributed Storage, Rennes, September 2011

Take benefits of the VFS abstraction layer A connected device appears as a folder in the tree structure of

the gateway This choice ensures backward compatibility with the existing

applications

The challenge : automate VFS modules installation and setup

Organize a file system view

6 04/21/23

Page 7: Distributed Storage, Rennes, September 2011

An automation software running on the gateway Communication starts via http on user initiative

The home network organizer

7 04/21/23

VFS

DJMountDropbox clientGdataFS NFS SMB

Network organizer

HTTP Server http communication

http communication

Gateway

Page 8: Distributed Storage, Rennes, September 2011

Zero configuration protocol solves the automation problem A Fuse module to map under the VFS other UPNP/DLNA servers

Djmount

Access to UPNP/DLNA devices

8 04/21/23

VFS

DJMount

Upnp/Dlna servers… …

… …

Network organizer

HTTP ServerGateway

Page 9: Distributed Storage, Rennes, September 2011

Experimented Dropbox and GdataFS for Youtube and Picassa Automate the installation and configuration of the modules

Cloud storage systems

9 04/21/23

VFS

DJMount …Dropbox clientGdataFS

Network organizer

HTTP Server http communication

Gateway

Page 10: Distributed Storage, Rennes, September 2011

Collects information via http (user name, type of device, IP…) Creates appropriate folders and associated exports… …on the gateway and on the device via an appropriate script

SMB/NFS devices

10 04/21/23

VFS

DJMountDropbox clientGdataFS NFS SMB

Network organizer

HTTP Server http communication

http communication

Gateway

Page 11: Distributed Storage, Rennes, September 2011

Tree structure

11 04/21/23

OtherShares

Serge

Jean

Bob

Gateway view

NetworkShares

DJMount

Dropbox

GdataFS

UsersShares

User (Bob) PC view

OtherNetworks

NetworkShares

Dropbox

DJMount

GdataFS

OtherShares

Jean

Serge

Bob

MyShare

Page 12: Distributed Storage, Rennes, September 2011

Backward compatibility : distant storage appears as local. Use of previous file manager or media player

Benefits for the applications

12 04/21/23

...

VFSDLNA TV

UPNP DLNA Server

Network Organizer

HTTP Server http communication

Gateway

Indexation

DJMountDropbox clientGdataFS NFS SMB

SMB

Local FS

Page 13: Distributed Storage, Rennes, September 2011

Enhanced navigation

13 04/21/23

Page 14: Distributed Storage, Rennes, September 2011

Enhanced navigation

14 04/21/23

Page 15: Distributed Storage, Rennes, September 2011

Via a UPNP/DLNA media server on top of the VFS Offers any VFS content to a UPNP/DLNA client PS3 Media Server, MiniDlna

Enhanced navigation

15 04/21/23

...

VFSDLNA TV

or

miniDlnaNetwork Organizer

HTTP Server http communication

http communication

Gateway

Indexation

DJMountDropbox clientGdataFS NFS SMB

Page 16: Distributed Storage, Rennes, September 2011

Enhanced navigation

16 04/21/23

Page 17: Distributed Storage, Rennes, September 2011

Enhanced navigation

17 04/21/23

Page 18: Distributed Storage, Rennes, September 2011

Enhanced navigation

18 04/21/23

Page 19: Distributed Storage, Rennes, September 2011

Open source software. Merge indexation and Network Organizer functions

Content indexation : DAM

19 04/21/23

VFS

(Indexation + NetworkOrganizer)

HTTP ServerGateway

DAM

DJMountDropbox clientGdataFS NFS SMB

Page 20: Distributed Storage, Rennes, September 2011

Unique interface : DAM

20 04/21/23

Page 21: Distributed Storage, Rennes, September 2011

Via a web browser Same menu for all devices

Advanced remote control

21 04/21/23

...

DLNA TV

Upnp Media Server(Indexation + NetworkOrganizer)

HTTP ServerGateway

DAM Upnp Control PointUPnP Control

http Control Tablet

VFS

DJMountDropbox clientGdataFS NFS SMB

Page 22: Distributed Storage, Rennes, September 2011

Backup software runs on the gateway Local or distant safe storage.

Home network content backup

22 04/21/23

Back Up application

DLNA TV

Upnp Media Server(Indexation + NetworkOrganizer)

HTTP ServerGateway

DAM Upnp Control PointUPnP Control

http Control Tablet

VFSDLNA TV

DJMountDropbox clientGdataFS NFS SMB

Page 23: Distributed Storage, Rennes, September 2011

High peer availability Cloud/peer to peer/hybrid Home systems may contribute to cloud storage capabilities

New Home storage architecture

23 04/21/23

Storage in the Cloud

50 % free space

Page 24: Distributed Storage, Rennes, September 2011

Unify the content access in the home network heterogeneous environment

Automate the deployment of the Unix VFS Network Organizer running on the gateway Leveraging user experience

Navigation, indexation, remote control, backup

Many open tracks Home storage architecture Data sharing Security …

Conclusion

24 04/21/23

Page 25: Distributed Storage, Rennes, September 2011

Technicolor Innov8 expo, June 21 – 23, 2011, London, UK.

25 04/21/23

Page 26: Distributed Storage, Rennes, September 2011

This study was partially funded by the FIGARO (Future Internet Gateway-based Architecture of Residential networks, FP7-ICT-258378) collaborative project.

Acknoledgement

26 04/21/23

Page 27: Distributed Storage, Rennes, September 2011

Thank you [email protected]

Distributed Storage, Rennes, September 2011

Page 28: Distributed Storage, Rennes, September 2011

Collects information relative to the new comer Creates appropriates folders and exports on the gateway and

generates an appropriate script for the client…..

SMB/ NFS devices : first Registration (1/2)

28 04/21/23

Gateway

Network Organizer

HTTP Server

Lea Client

User information

Make client scriptand build folders

Share_dir

John Client

John_dirLea_dir

HTTPWindows

HTTP Linux

User information

Page 29: Distributed Storage, Rennes, September 2011

Proposes the appropriate script for execution to the new comer Script, which creates appropriates folders and exports on the client

(new comer) .

SMB/ NFS devices : first Registration (2/2)

29 04/21/23

Network Organizer

HTTP Server

Lea Client

Share_dir

John Client

John_dirLea_dir

HTTPWindows

HTTP Linux

MyShares

OtherShares

Launch installationand build folders!

MyShares

OtherShares

Launch installationand build folders!

GatewayDownload client batch Download client script

Page 30: Distributed Storage, Rennes, September 2011

Each time a user/device joins the home network Activate the prepared mounts/exports

SMB / NFS Devices : then Connection (1/2)

30 04/21/23

Gateway

Network Organizer

HTTP Server

Lea Client

Share_dir

John Client

John_dirLea_dir

HTTPWindows

HTTP Linux

MyShares

OtherShares

MyShares

OtherShares

Connect Connect

Export and mount folders

share export

Page 31: Distributed Storage, Rennes, September 2011

Disconnection (unmount) when leaving the home network An absent device appears as disconnected (regular pings)

SMB / NFS Devices : then Connection (2/2)

31 04/21/23

Gateway

Network Organizer

HTTP Server

Lea Client

Share_dir

John Client

John_dir

Lea_dir_disconnected

HTTPWindows

HTTP Linux

MyShares

OtherShares

MyShares

OtherShares

User disconnection requestor cable disconnection

Umount folder andrename it as disconnected

Page 32: Distributed Storage, Rennes, September 2011

UPNP/DLNA devices

32 04/21/23

VFS DLNA TV

DJMount

Upnp Media Server

Dropbox clientGdataFS NFS SMB

(Indexation + NetworkOrganizer)

HTTP ServerGateway

DAM Upnp Control PointUPnP Control

http Control Tablet

Back Up application