introducing ds3 - a restful interface to deep storage
DESCRIPTION
In this video, Molly Rector and David Trachy from Spectra Logic describe the new DS3 RESTful interface to Deep Storage. "Designed by Spectra Logic, DS3 is the first native REST-based interface to deep storage which enables the easy archival of large amounts of bulk data. It is a data transport and communication interface that allows software clients to direct and manage "bulk" storage read or write operations to and from deep storage. DS3 utilizes the standard S3 command set plus additional commands specifically designed to optimize the transport of data objects to and from tape. These additional commands enable modern architecture frameworks to easily and efficiently communicate with massively scalable deep storage technologies. The DS3 interface utilizes the traditional REST client/server architecture and high-level PUT and GET commands to move objects to and from deep storage. The interface is media agnostic such that over long data retention periods data can be migrated from older storage types to newer ones transparently." Learn more: http://www.spectralogic.com/index.cfm?fuseaction=products.displayContent&CatID=2222TRANSCRIPT
![Page 1: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/1.jpg)
Interfaces to Deep Storage
![Page 2: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/2.jpg)
REST (Representa4onal State Transfer)
• REST is the primary set of principles used on the Web • Cloud architectures are RESTful • A REST architecture uses a client and server model • REST architectures use simple commands to offer high value services
![Page 3: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/3.jpg)
REST Behind the Scene S3 REST Command: PUT
S3 REST Command: GET
![Page 4: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/4.jpg)
REST Behind the Scene S3 REST Command: PUT
S3 REST Command: GET
![Page 5: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/5.jpg)
Example REST Interfaces
• Simple Storage Services (S3) • OpenStack • Atmos • Cloud Data Management Interface (CDMI)
![Page 6: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/6.jpg)
S3 (Simple Storage Service)
Created by Amazon, S3 simplifies web-‐scale storage and compu4ng development. – Defines a cloud storage web service – Proven technology and wide adop4on (2+ trillion objects) – Many clients and client developers
![Page 7: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/7.jpg)
S3 + + Sequen4al Media Support
Removable Media Support =
![Page 8: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/8.jpg)
A REST/S3 interface
David Trachy Senior Director Emerging Markets
![Page 9: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/9.jpg)
What is DS3?
• A Defined Web Service • Uses HTTP(s) • RESTful (the way the web works) • Inherently WAN compa4ble • Modeled a\er Amazon S3
![Page 10: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/10.jpg)
Why Amazon Simple Storage Service?
• Defines a cloud storage web service • Most popular cloud storage interface – Proven technology (2+ trillion objects) – Many clients and client developers
![Page 11: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/11.jpg)
Why We Like about S3
• Security model • Data integrity • Encryp4on support • Par4al data object restore • Meta-‐data per data object • Infinite scale-‐out
![Page 12: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/12.jpg)
S3 Concepts
• Object – A hunk of data (ex: file, medical image) – “Put” or “Get” object from S3 – Objects are typically files from a file system – Small or large objects are supported
• Bucket – A large collec4on of objects
![Page 13: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/13.jpg)
What did we add to get DS3?
• For sequen4al storage medium – Bulk Put, write a large number of objects – Bulk Get, read a large number of objects
• For removal storage medium – Export Bucket, Eject all pieces of media associated with a bucket
![Page 14: Introducing DS3 - a RESTful Interface to Deep Storage](https://reader033.vdocuments.site/reader033/viewer/2022051612/54c4199e4a7959f9278b45de/html5/thumbnails/14.jpg)
DS3 Availability
• Public announcement – Today, October 8, 2013 @ 12:30 pm MST – No embargo on DS3 or Vision informa4on
• Availability – Immediately to development community