introduction of endosnipe

APM Solution with powerful diagnosis function

Introduction of

Acroquest Technology Co.,Ltd.

Introduction

1. This presentation explains about which was released as an OSS product on July 10, 2013.

2. You can get information and its data of from these sites.

I. http://www.endosnipe.com/II. http://github.com/endosnipe/ENdoSnipe

2Copyright © Acroquest Technology Co., Ltd. All rights reserved.

http://www.endosnipe.com/

http://github.com/endosnipe/ENdoSnipe

[0. Introduction]

1. Introduction of Acroquest Technology Co.,Ltd.

1. Our main mission is an entrusted development of software monitoring and controlling of network.

2. We specialized in Linux and Java 13 years ago and have accumulated knowledge since then.

3

2000 Built “GNMS” the platform about monitoring and controlling of network by Java and sell it as a package software.

2001 Opened Java Trouble Shooting（JTS） site.（http://www.acroquest.co.jp/webworkshop/JavaTroubleshooting/index.html）

2004 Started Java Trouble Shooting Service ”JaTS”

2008

1. Started Java Trouble Shooting mail magazine.（http://www.acroquest.co.jp/webworkshop/JTSMM/index.html）

2. Released ENdoSnipe 3.4 and 3.53. Released ”PROMA-C DevNavi 1.0”, the configuration management

SaaS

2009 1. Released ENdoSnipe Ver. 4.0 and 4.1

2012 1. Released ENdoSnipe Ver. 4.7

http://www.acroquest.co.jp/webworkshop/JavaTroubleshooting/index.html

http://www.acroquest.co.jp/webworkshop/JTSMM/index.html

[0. Introduction]

2. About

4

1. Rare trouble shooting service which guarantees solving problems within fixed term.

2. We provide this service to more than 60 troubles a year.3. Currently, solution rate is 100%.

（Except for the cases which finished investigation because of no recurrence）

4. is a product that packages know-hows of Java trouble shooting accumulated in

If we can’t solve the problem within the term, we cash back the half the amount of the charge.

Contents

1. Feature of ENdoSnipe Ver. 5.02. Powerful functions3. FAQ4. Roadmap

5Copyright © Acroquest Technology Co., Ltd. All rights reserved.

1. Feature of ENdoSnipe Ver. 5.0

Powerful diagnosis function• Detect the problems which lead system stop and performance problem,

and support to solve them.• Measure and analyze not only Java program but also SQL and so on.

Implemented system visualization• Visualize processing frequency and time• Visualize the operation flow of the system• Visualize the change of resource usage by Excel report

Big enhancement of monitoring function• Add judgment of threshold which enables user to monitor resource

usage.• Offer map function which enables user to design unique dashboard.• Offer UIs for each monitoring target by plugin structure.

Copyright © Acroquest Technology Co., Ltd. All rights reserved.6


[2-1 Powerful diagnosis function]

1. Automatic diagnosis by PerformanceDoctor

Detect problems which lead system halt and performance problem, and support to find causes.

No. Category Summary1

Java

Call count of method2 Turn around time of methods3 CPU usage of thread4 Thread block wait count and time5 GC count and stop time by GC6 Long time stop by full GC7 Occurrence of memory leak

8

Typical frequent operation such as initialization of framework(It is usually operated once when the system launches.Frequent operation leads waste of resources, CPU, disk I/O and so on)

9 Risk of infinite loop by HashMap access(Data destruction by the same time access by plural thread）

10 Occurrence of dead lock

8

It point out directly why the operation takes long time. This feature is different from profiler and debugger.

Rules written with red letters alarms you when problem is detected.


2-1. Detect memory leak and risk of hung-up

No. category summary711

JavaFailure in designation of time out in socket communication

12 Frequency of linear search to List13

JDBC

Turn around time of performing queries14 The number of issuance of queries15 The number of issuance of the same query16 Risk of the large number of issuance of SQL17

SQL

Operation of full scan18 Cost of execution plan19 The number of combination by JOIN within a query20 The number of “or” and “union” within a query

9


2-2. Detect inefficient database access


[2-2. Implemented system visualization]

1. Visualize processing frequency and time for each function

This shows graphs of average, max. and min. time, call count and the number of operations which stop long time for each function.You can see execution plan of SQL.



2. Visualizing the operation flow

You can see operation of the system as a sequence diagram using ArrowVision, other software we released.

You can see contents and execution plans of issued SQL.Of course, you can also see calls of Java method and return values of the method.



3. Offer the powerful reporting function

0

10

20

30

40

50

60

70

80

90

100

2009/11/04

11:27:00

2009/11/04

13:43:09

2009/11/04

15:59:17

2009/11/04

18:15:26

2009/11/04

20:31:34

2009/11/04

22:47:43

2009/11/05

01:03:52

2009/11/05

03:20:00

2009/11/05

05:36:09

2009/11/05

07:52:17

CPU使用率

(％)

CPU使用率

CPU使用率(最大) CPU使用率(最小) CPU使用率(平均)

0

10

20

30

40

50

60

70

80

90

100

2009/11/04

11:27:00

2009/11/04

13:43:09

2009/11/04

15:59:17

2009/11/04

18:15:26

2009/11/04

20:31:34

2009/11/04

22:47:43

2009/11/05

01:03:52

2009/11/05

03:20:00

2009/11/05

05:36:09

2009/11/05

07:52:17

CPU使用率

(％)

CPU使用率

CPU使用率(最大) CPU使用率(最小) CPU使用率(平均)

You can customize it easily because it is output as Excel format.

Set up the report output settings with target node and term.(We will offer regular report output in the future.)

Show the list of the output reports.


[2-3. Big enhancement of monitoring function]

1. Offer Strong Monitoring by The Function of The Judgment of Threshold

Judge whether the values exceeded the threshold, and show the result with signal color.

Appoint the signal with thetarget data and threshold.


2. Offer map function which enables you to design unique Dashboard


①

②

③

You can design the unique monitoring screen by arranging 1.graph, 2.signal and 3.links to other maps.


Offer an exclusive UI for Hadoop and HBase by plugin structure.http://gihyo.jp/admin/serial/01/halook

HDFS View MR Arrow Chart

MR Gantt Chart MR Bubble Chart HBase Grow Map

HBase Region Map


3. Offer UI expansion by plugin structure

http://gihyo.jp/admin/serial/01/halook


[3. FAQ]

1. How high is the overhead?

25.66（60.7%）

25.99（61.5%）

41.40（98.0%）

41.91（99.2%）

42.24

0.00 10.00 20.00 30.00 40.00 50.00 60.00

性能診断

標準

性能試験

性能監視

ENdoSnipe未適用

Throughput(responses/sec)

Get lower only 2%.We realize low overhead in performance monitoring and performance test.

The overheads occurred by each settings are shown below.(Please see as reference because it depends on environment. ）

With no ENdoSnipe

Performance monitor

Standard

Performance test

Performance diagnosis

Function Test Performance and Load Test Operation


MonitoringYou can notify the increase of GC time and response getting worse. Recording rich information and it helps trouble shooting.

TestConfirm the achievement for performance and stable operation by ENdoSnipe.

DiagnosisYou can reduce man-hour because you can detect the problems before performance test.

[3. FAQ]

2. Use and efficiency of ENdoSnipe

Performance Management (APM).

You can use ENdoSnipe for wide purpose and stage of process from trouble shooting to Application Performance Management (APM).

18

20132013 20142014

• Poring PerformanceDoctor

• Porting report export function

• Hadoop/Hbase monitoring

• Linux monitoring

• Apache monitoring

• PostgreSQL/MySQLmonitoring

• PHP/Python/Rubymonitoring

Ver. 5

• Porting ArrowVision

• Porting BottleneckEye

• Enhancement of Linuxmonitoring

• Enhancement of Apachemonitoring

• Enhancement of PostgreSQL/MySQL monitoring

• Enhancement of PHP/Python/Ruby monitoring

Ver. 7Enhanced monitoring target.Performance monitoring to operational environment.

• Outlier detection

• System map

• AWS support

• Add Backend DBMS（SQLite）

Ver. 6

Plan to enhance APM function such as outlier detection. You can start diagnostics and monitoring without configuration.

Plan to enhance monitoring function

【Extra】

3. Roadmap of ENdoSnipe

Contact us


Infrastructures Evolution

ContactAcroquest Technology Co., Ltd.

TEL ：+81-(0)45-476-3171 E-Mail：[email protected]

mailto:[email protected]