aws summit berlin 2013 - doo - a scalable sync framework infrastructure based on clojure, dynamodb...

20
Every Document of Your Life Access your documents wherever they are. Find them in seconds whenever you need them.

Upload: aws-germany

Post on 19-Jun-2015

300 views

Category:

Technology


1 download

DESCRIPTION

doo collects all of your documents and intelligently organizes and secures them for you. Finding a document is a matter of seconds. Share and collaborate with colleagues, friends and family on your favorite device. Speaker: Frank Thelen, Founder & CEO, doo GmbH

TRANSCRIPT

Page 1: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Every Document of Your LifeAccess your documents wherever they are.Find them in seconds whenever you need them.

Page 2: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Agenda

1. Our Mission

2. doo Applications

3. Why we love AWS

Page 3: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Our Mission

Page 4: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

CommunicationVideoMusicPhoto

• Today we have the technology and infrastructure to provide new distribution models, user experiences and revolutionize the use of information.

• There are great digital solutions for photo, music, video, communication, ...

A new “digital experience”

Page 5: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

... however, many of our documents are still paper-based: receipts, invoices, contracts and so forth. We spend hours organizing and archiving documents and still can’t retrieve them when needed.

Not to mention the cost of producing, transporting, processing and archiving paper-based documents.

The problem with paper documents

Page 6: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Cloud ServicesEmailsFilebrowserWeb Interfaces

www.webinterfaces.com/?id=qiv302

www.your!les.com

/user=pref

www.bankingstatements.com/user=idquip

• In the digital sphere, we are facing the challenge of an ever increasing amount of documents scattered across an ever increasing number of “document sources” and “storage locations” - locally and in the cloud.

• There is no solution providing access to all our documents or helping us to get and keep them organized.

The problem with our digital documents

Page 7: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

+ Text extraction

+ Language detection

+ OCR

+ Auto-tagging algorithms

= The most advanced document search

• Intelligent tags

• Type-ahead search

• Dynamic tag scope

Find any documentin seconds...

Access alldocuments.

Cloud services

Email

Local documents

Web Interfaces

www.webinterfaces.com/?id=qiv302

www.your!les.com

/user=pref

www.bankingstatements.com/user=idquip

Page 8: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Find any documentin seconds...

Access alldocuments.

Cloud services

Email

Local documents

Web interfaces

www.webinterfaces.com/?id=qiv302

www.your!les.com

/user=pref

www.bankingstatements.com/user=idquip

...whenever youneed it.

Always in sync

Page 9: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

• Full TLS/SSL encryption up to 256-Bit 

• OAuth2 authentication

• Server-side encryption

• ISO 27001 certified data center, Amazon S3

Legally safe document transfer

Page 10: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

doo Applications

Page 11: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Mac OS X

Page 12: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Windows 8

Page 13: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

iOS

Page 14: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Android

Page 15: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Why we love AWS

Page 16: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

Our learnings from experience

• Using own hardware leads to lack of flexibility for seasonal peaks • 6-8 weeks to have newly ordered hardware up and running • Huge challenges associated with setups in foreign regions

• Expensive hardware is under-utilized outside of seasonal peaks

• Storage and bandwidth are problems for file transferring services

• We needed to rethink hosting options for a new business

Page 17: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

AWS services doo uses and howThe important ones

• EC2 • As many instances as needed• Dependent on needs and pricing: reserved, on-demand or spot• Flexible sizing from small as web box to huge SSD as DB server

• S3 Storage as main storage • As much storage as needed

• Upload and download scale very well

• Fairly priced

• Server Side Encryption

• CloudFront• Best content delivery network

• Dynamo DB• High-performance key value store for many purposes

• Virtual Private Cloud

• Secure network in the virtual world

Page 18: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

AWS services doo uses and howAdditional helpful services

• Elastic Load Balancer

• Flexible load balancing solution

• SSL termination

• IAM (Identity and Access Management)

• Highly granular permission management

• Security groups as Firewall

• Simple configuration of firewalls

• CloudWatch

• Optimal monitoring

• Route 53

• DNS service flexible and simple to configure

• S3 as static web server

Page 19: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL
Page 20: AWS Summit Berlin 2013 - doo - A Scalable Sync Framework Infrastructure based on Clojure, DynamoDB and PostgreSQL

@frank_thelen

fb.com/frank42

sk8.de/xing

sk8.de/linkedin

Frank Thelen | CEO

doo.net @doo

@alexkoche42

xing.com/profile/Alex_Koch

de.linkedin.com/in/alexkoche42/

Alex Koch | CTO

fb.com/alekseko