server log, monitoring and qo s platform of a messaging app

16
Log, monitoring and QoS platform of a large scale service Phan Huy Hoàng Lead Engineer Web Mobile Zing [email protected]

Upload: zaloapp

Post on 22-Jan-2018

817 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Server   log, monitoring and qo s platform of a messaging app

Log, monitoring and QoS platform of a large

scale servicePhan Huy Hoàng – Lead Engineer

Web Mobile – Zing

[email protected]

Page 2: Server   log, monitoring and qo s platform of a messaging app

Agenda

• 1/ Quality of Service Platform: Why we need pay attention to QoS

• 2/ Logging: Handling lots of data

• 3/ Monitoring

• 4/ Questions & Answers

Page 3: Server   log, monitoring and qo s platform of a messaging app

Quality of Service PlatformWhy we need to pay attention to QoS ?

Page 4: Server   log, monitoring and qo s platform of a messaging app

Why we need QoS?

• How your app actually works in real-life ?

• Users are using which functions ? Chat, social, search nearby… ?

• Do those functions even work at all ?

• If it does work, how good, in which environment ?

Page 5: Server   log, monitoring and qo s platform of a messaging app

A few numbers

• Lots of data

• 3M users

• 28M messages chat/day

• 600M million events/day

Page 6: Server   log, monitoring and qo s platform of a messaging app

Too much data

Page 7: Server   log, monitoring and qo s platform of a messaging app

Logging Handling lots of data

Page 8: Server   log, monitoring and qo s platform of a messaging app

Logging Flow v1

Page 9: Server   log, monitoring and qo s platform of a messaging app

Logging Flow v2

Page 10: Server   log, monitoring and qo s platform of a messaging app

Monitoring

Page 11: Server   log, monitoring and qo s platform of a messaging app

Charting

• Live data

• Trends data

Page 12: Server   log, monitoring and qo s platform of a messaging app

Dashboard

• Simplified your life

• Concentrate on drastic change

Page 13: Server   log, monitoring and qo s platform of a messaging app

Anomaly data points detection

• How to deal with stuff like this ?• Too many data point deviated from normal deviation

should trigger an alert

• You will get a lot of false positive

Page 14: Server   log, monitoring and qo s platform of a messaging app

What’s next ?

• Sending alert• By Zalo, SMS, email

• Happy life

Page 15: Server   log, monitoring and qo s platform of a messaging app

Questions?

Page 16: Server   log, monitoring and qo s platform of a messaging app