tms training

TMS system and MongoDB introduction

RICH LEE

CHT TMS Developer

richleethinkpowercomtw

TMS System Architecture

MongoDB Introduction

TMS MongoDB

QampA

2014826 CHT TMS Training 2

TMS Module CDR Parser

CDR Consolidator Data Voice Mvpn

CSV Generator

Report Usage Lumsum Frozen

Performance Report

SNMP Alarm

API


TMS Module Diagram


CDR process flow


Parser multi-thread conceptsbull Three stages of the CDR Parser

1st Decoder (Decode worker and MongoBO)

2nd Queues (Mongo Queue)

3rd Insert into DB (Mongo worker)bull Three parser instances

Parser (CCN)

Parser (SDP)

Parser (AIR)


What is MongoDB MongoDB is an open source document-oriented

database designed with both scalability and developer agility in mind

Instead of storing your data in tables and rows as you would with a relational database in MongoDB you store JSON-like documents with dynamic schemas(schema-free schemaless)


MongoDB Feature

Schema-less

Document-oriented (Bson)

Scale-out

Replica set

Sharding

Rich functionality

Index Aggregation Backup


Why use MongoDB bridge the gap between key-value stores (which are fast and

scalable) and relational databases (which have rich functionality)


MongoDB vs RDBMS


Data model

Using BSON (binary JSON) developers can easily map to modern object-oriented languages without a complicated ORM layer


Schema design


Schema design


Basic operator



Read Command in MySQL

Read Command in MongoDB

Replica set ndash scale out


1 Availability

2 Fault tolerance

Replica set - election


Replica set consistency Only one server is active for writes (the primary) at a given time ndash

this is to allow strong consistent (atomic) operations

One can optionally send read operations to the secondaries when eventual consistency semantics are acceptable


DB list


User role

Login TMS MongoDB mongo --host 1010660654001 --username tmsdb mdashpassword xxxx --

authenticationDatabase admin

Use DB and count show dbs (only root uesr) use TMS_CCN_1_DB dbTMS_CCN_1_140506count()


Account DB Role Description

tmsdb ROOT Super admin

cht_app Read Write Can CRUD

cht_report Read Only query data

cht_cluster Cluster admin View replica status

Field mapping


Query definition

Equal Query

dbTMS_CCN_2_140715find(MSISDN886988413631)

Regex Query

dbTMS_CCN_2_140715find(MSISDN$regex 988413631)

And Query

dbTMS_CCN_4_140804find( $and [ MSISDN886988413631rdquo

rdquoBP886905001256rdquo ] )

Project (Select feild)

dbTMS_CCN_4_140724find( MSISDN886905004094rdquo

MSISDN 1 BP 1 TT 1 DT 1)



Query by date range GMT not local timezone

dbTMS_CCN_1_140609find( $and [ MSISDN 886905001250 TT $gte new ISODate(2014-06-16 010050652Z) DT $lte new ISODate(2014-06-16 015950652Z) ] )

Distinct Query dbTMS_CCN_1_140822distinct( MSISDN

TT $gt new ISODate(2014-08-22 050000294Z) )

Sort Query dbTMS_CCN_4_140722find( ISCSVfalse )sort( OCCR8 1 )

Check Replica set status rsstatus()

View Replica set configuration rsconf()

Set secondary node can read rsslaveOk()


Http Rest interface httphostportport is mongod port +1000


MongoDB monitor mongostat --host localhost27017 --username accountmdashpassword

pass --authenticationDatabase admin

Check MongoDB log Mongolog (optmongodatalog)



TMS System Architecture

MongoDB Introduction

TMS MongoDB

QampA




CSV Generator


Performance Report

SNMP Alarm

API


TMS Module Diagram


CDR process flow






Parser (CCN)

Parser (SDP)

Parser (AIR)






MongoDB Feature

Schema-less


Scale-out

Replica set

Sharding

Rich functionality






MongoDB vs RDBMS


Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query


























CSV Generator


Performance Report

SNMP Alarm

API


TMS Module Diagram


CDR process flow






Parser (CCN)

Parser (SDP)

Parser (AIR)






MongoDB Feature

Schema-less


Scale-out

Replica set

Sharding

Rich functionality






MongoDB vs RDBMS


Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























TMS Module Diagram


CDR process flow






Parser (CCN)

Parser (SDP)

Parser (AIR)






MongoDB Feature

Schema-less


Scale-out

Replica set

Sharding

Rich functionality






MongoDB vs RDBMS


Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























CDR process flow






Parser (CCN)

Parser (SDP)

Parser (AIR)






MongoDB Feature

Schema-less


Scale-out

Replica set

Sharding

Rich functionality






MongoDB vs RDBMS


Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query




























Parser (CCN)

Parser (SDP)

Parser (AIR)






MongoDB Feature

Schema-less


Scale-out

Replica set

Sharding

Rich functionality






MongoDB vs RDBMS


Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query




























MongoDB Feature

Schema-less


Scale-out

Replica set

Sharding

Rich functionality






MongoDB vs RDBMS


Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query



























MongoDB vs RDBMS


Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























Data model



Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























Schema design


Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























Schema design


Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























Basic operator







1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query





























1 Availability

2 Fault tolerance







DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query






























DB list


User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























User role










Field mapping


Query definition

Equal Query


Regex Query


And Query
























Field mapping


Query definition

Equal Query


Regex Query


And Query
























Query definition

Equal Query


Regex Query


And Query
























tms training

Technology