The Transporter4

MySQL

A visual Guide 4 Importing & Exporting

csv, xml, tsv, text, sql, MySql, HDFS, Hive, HBase

contents

• Export 2 csv

• Import csv

• Exporting 2 sql

• Importing sql

• Exporting 2 xml

• Importing xml

• Exporting 2 tsv

• Exporting 2 text

• Exporting 2 HDFS

• Installing Apache Sqoop

• exporting 2 HDFS

• Importing 2 MySQL

• Exporting 2 Hive

• Exporting 2 HBase

open MySQL

exporting to CSV

exporting CSV – Problem ?

check Appamor status

AA Status

AA

go to apparmor.d

edit usr.sbin.mysqld

usr.sbin.mysqld

after editing usr.sbin.mysqld

make /tmp/data directory

make /data directory

mounting

reload apparmor

restarting apparmor . . .

exporting .csv

Importing csv

importing .csv – problem ?

importing .csv

edit my.cnf

my.cnf file

after editing my.cnf

importing .csv

exporting sql

view tables

create country table

inserting data into country table

exporting .sql

exported .sql file

Importing sql

importing .sql

exporting xml

exporting .xml

importing xml

importing xml

exporting tsv

exporting .tsv

exported .tsv file

exporting txt

exporting .txt

exported .txt file

exporting to HDFS

installing Apache Sqoop

Apache Sqoop Home Page

Sqoop folder structure

add mysqlJ connector in SqoopHome/lib

export & check version

sqoop help

list databases

make dir in HDFS

check mysql tables

grant permissions

exporting 2 HDFS

exporting completes

Intermediate .java file (mapReduce)

HDFS table

exporting to HDFS

exporting to HDFS

importing to MySQL (4m HDFS)

HDFS table

make MySQL table structure

importing to MySQL

importing completes

imported table

exporting to Hive

check Hive for redundant table

exporting 2 Hive

libthrift version error

export fake HBase_Home

check Hive tables

export to HBase

mysql table

employee table

start HBase daemons

exporting to HBase

exporting completes

all Sqoop queries

finish