big data and wee data by avery rosen

MongoDB and Wee Data

hacking a workflow

what it’s all about

• MongoDB lets you persist and investigate your application data while getting out of your way

• p.s. BDD

me

• http://bringingfire.com/

• @4BringingFire

• expertise at the intersection of technology, product formulation, and business strategy

stuff I’m into

• products > tech

• UX testing

• iterative, analytics-driven dev

• agility in production

http://www.shopwiki.com

these guys © wired.com

http://penrosejudaica.com

total projectsbig data projects= ?< 1%NOT AN

ACTUAL FACT

what is wee data?

• query performance is not an issue

• in fact it might fit in RAM

• in fact it might fit in 2MB

where mongo fits

• scales down nicely

• access programmatically without SQL

• persists for free

• query later, too

ORMpuh-lease.

http://penrosejudaica.com

Behavior Driven Development

• “Outside-in” approach

• Everything is behavior

• Acceptance-test-driven planning

• Ubiquitous language

Cucumber

Cucumber

Cucumber

Cucumber

rspec

• specification

• object doubles (mocks, fakes, stubs, spies)

• method stubbing

• expectations

Behavior Driven Development

• http://cukes.info/

• http://rspec.info/

Name Materials Price Description

fancy menorah gold, silver 600

plain menorah pewter 150

the Penrose ETL pipeline

Product Spreadsheets

.csv.csv.csv

CSV files Product Descriptions

Blah blah blah exquisite

craftsmanship

db.products.aggregate( { $match : { product_type : “menorah” } }, { $group : { _id: “$material”, count:

{ $sum : 1 } } )

Buy AdWords?

Q & A