using pivotal cloud foundry with google’s bigquery and cloud vision api

Using Pivotal Cloud Foundry with Google BigQuery and Vision APIJoshua McKenty, Pivotal

Tino Tereshko, GoogleMichael Goddard, Pivotal

We believe transforming how the world builds software will shapethe future of our world

2

“A company’s core advantage is in the applications it builds.”

Diane Greene, GoogleInfoworld Q&A, May 23, 2016

Both speed and safety are required

• Addressing customer needs faster, with less downtime retains your customers

• Protecting market share from disruptors or something unforeseen

• Being able to make quick experiments (that aren’t destabilizing) gives you more chances at success

• The first to successfully rollout the innovation tends to win, defines the category

Enterprise Pattern: Cloud Native

Cloud Native

DevOps ContinuousDelivery

ContainersMicro services

Why Go Cloud Native?

▪ Cloud Portability▪ Operational Efficiencies▪ Autoscaling▪ Automated Patching & Upgrading▪ Standardization of Tooling & Platform-Provided Services▪ Management & Monitoring through the platform▪ Runtime consolidation ▪ Reduction of multiple vendors

Cloud Native • Microservices architecture• API-first design

• Fault-tolerant and resilient design• Cloud-agnostic runtime implementation• Bundled metrics and monitoring• Proactive failure testing

Cloud Resilient

Cloud Friendly

Cloud Ready• No permanent disk access• Self-contained application• Platform-managed ports and networking• Consumes platform-managed backing services

• 12 Factor App methodology• Horizontally scalable• Leverages platform for high availability

A Cloud Application Maturity Model

Cloud native and microservice models are moving into the Fortune 500

“Two people built an app and got it into the App Store in five weeks”

“I said to my vendors, I don’t want five years ago. I want five years from now.

“The adopters we speak to today, like GE, HP, Equinix, PayPal, Capital One, Goldman Sachs, Airbnb, Medallia, Square, and Xoom say that microservices are well worth the tradeoffs.”

Application Framework

Infrastructure Automation

Platform Runtime

Language framework for microservice-based architectures including components for service discovery, metrics, and circuit breakers.

Application container runtime with attachable backing services, automated CI/CD, routing, health management and logging.

A single deployment API for provisioning for bit-for-bit, consistent, self-healing deployments across any private or public cloud.

Dev

Dev Ops

Ops

SpringCloud

SpringBoot

BOSH

Cloud FoundryPivotal

Cloud FoundryPivotal

Contract: 12 Factor Application

Contract: BOSH Release

Cloud Native with Pivotal

Connect to Data-Driven Business Apps with theservice broker for GCP:

• Cloud SQL

• BigQuery

• Cloud PubSub

• Google Cloud Storage

• Vision API

• Speech API

• Natural Language API

• Translate API

Service Broker

Pivotal Cloud Foundry with GCP Services

Enterprise Pattern: Extending Cloud Native with Data & Analytics

Google Cloud Platform Services

VIRTUAL NETWORK

LOAD BALANCING

CDN

DNS

INTERCONNECT

Management Compute Storage Networking Data Machine Learning

STACKDRIVER

IDENTITY AND ACCESS

MANAGEMENT

CLOUD ML

SPEECH API

VISION API

TRANSLATE API

NATURAL LANGUAGE API

Google Cloud Platform Services

VIRTUAL NETWORK

LOAD BALANCING

CDN

DNS

INTERCONNECT

Management Compute Storage Networking Data Machine Learning

STACKDRIVER

IDENTITY AND ACCESS

MANAGEMENT

CLOUD ML

SPEECH API

VISION API

TRANSLATE API

NATURAL LANGUAGE API

Google BigQuery

1616

Demo

Most importantly, complexity is hidden from end user

We only paid $20

We just rented ~3000 cores from Google for ~20 seconds1

2

3

BigQuery - explained @thetinot

18

What is BigQuery?

Durable and Highly Available

Convenience of SQL

Petabyte-Scale and Fast

Fully Managed, No-Ops Data Warehouse

19

BigQuery: 5 years of seamless innovation2010 2011 2012 2013 2014

Public launch

Large query results

2015 2016

900

300

0

1,200

Code Submits

Beta Release at Google I/O

Dremel X

Big JOIN support

Dynamic Execution

Capacitor

Faster shuffle

100k qps streaming

User-defined functions

BigQuery - The Database is The Data Center(s)@thetinot

Machine Learning for Everyone

22

AndroidAppsGmailMapsPhotosSpeechSearchTranslationYouTubeand many others ...

Used across products:

2012 2013 2014 2015

1500

1000

500

0

Number of directories containing model description files

Rapidly accelerating use of deep learning at Google

Google confidential | Do not distribute

Applications that can see, hear and understand

Google Cloud Platform 24

AlphaBeta

Cloud Natural Language

Pre-Trained Machine Learning Models

BetaGAGA

Cloud Speech

Cloud Translate

Cloud Vision CloudML

Fully trained ML models from Google that allow a developer to easily take advantage of rich machine learning capabilities.

Custom ML

Managed TensorFlow service to train and predict custom models on customer-provided datasets.

Sample App: Landmark Vanguard

App

Data & Analytics

Platform

Infrastructure

Sample App: Landmark Vanguard

Demo

Thanks - Questions?Overview of PCF on GCP

http://www.pivotal.io/google Download a trial of PCF for GCP

https://network.pivotal.io/products/ops-manager GCP Service Broker for PCF

https://network.pivotal.io/products/gcp-service-broker/ Free trial of Pivotal Web Services

http://run.pivotal.io Landmark Vanguard Sample App

https://github.com/cf-platform-eng/gcp-ml-sentimentImage resizing service

https://github.com/cf-platform-eng/image-resizing-service

30