Download - Eat Sleep Tweet Repeat
Transcript
Barsha ShresthaInsight Data Engineering
Motivation:
APIs:
>300GB
DATA INGESTION FILE SYSTEM/
FRONT-END
BATCH PROCESSING
DATABASE
DATA INGESTION FILE SYSTEM/
BATCH PROCESSING
DATABASE
FRONT-END
PRODUCER
PRODUCER
CONSUMER
DATA INGESTION FILE SYSTEM/
BATCH PROCESSING
DATABASE
FRONT-END
TMDB
DATA INGESTION FILE SYSTEM/
FRONT-END
BATCH PROCESSING
DATABASE
Challenges1. Learning new technologies!2. Next steps
About me:
Barsha Shrestha
Chemistry and Computer Science Movies, Soccer, Science Jokes, Bad puns