navigating your product's growth with embedded analytics

© 2016 Progress Software Corporation and/or its subsidiaries or affiliates. All rights reserved. 1

Navigating your Product's Growth with Embedded Analytics.


Discussion Flow

•  Why Analytics

•  Customer Challenges

•  Key Benefits

•  Monitor & Client Overview

•  Use Cases

•  Internal Case Study

•  What Customers Say

•  Product Roadmap


Why Analytics

Leaders need insights to grow their business

Right insights at the right time to keep pace with customer expectations

Key to business strategy High performers embrace a culture of Analytics

Data driven decision making drives better profitability


Challenges Software Development Managers/QA Engineers Face

Manage Release Schedule

Keep up with upcoming

technologies

Better App Performance

Coordinate / Execute Testing

Negotiate roadmap with

Product Managers

Support older

releases

Minimize Bugs

Eliminate Crashes


Challenges Product Managers Face

Product Launches

Deliver Best User Experience

Increase Retention

Grow Products – Revenue / Adoption

Reduce Churn Prioritize

Support & Releases

Product Roadmap

Negotiate Roadmap with Engineering


They All Need to Know...

Most Loyal Audience

Audience Location

Most Used Features

Popular Business

Flows

Frequent App Errors

Average Time Spent

in App

User traffic – # of sessions, session length

Peak Usage Time


Embedded Analytics - Key Benefits

Prioritize Your Product Roadmap –

Stay ahead of the game by knowing which features are

used most. Keep engineering focused on

features that matter most.



Grow Your Business via High-value, Loyal Customers –

Track Your User Loyalty through Cohorts.

Drive monetization through loyalty insights.



Target Your Audience Better – Paint a complete picture of your

audience and uncover their usage pattern.

Get a grip on your audience to send them the right promotions

and offers.



One Solution to Analyze Them All - Any app, Any device, Any

technology – Works with desktop, web or mobile

apps. Supports tablets, smartphones, wearables.

Integrates in multiple technologies (e.g. .NET, Java, Android, C++).



Improve User Experience by Eliminating Crashes -

Automatically capture crash reports and exceptions.

Instantly receive detailed stack traces for engineering to act on.

Because five star reviews matter.



Improve App Performance by Detecting Bottlenecks –

Detect performance bottlenecks you may be unaware of, by

measuring the duration of specific end-user actions.

Invaluable for user base retention.



Shorten Your Development Cycle –

Stop supporting outdated environments.

Improve product stability. Prioritize your engineering

dollars.


Mapping Benefits to Charts

Track Engagement -> Validate Design, Grow

Revenue

•  Most used feature •  Time spent per feature •  Sessions/day, # of

Sessions •  Time of day

Track Audience -> Know your Audience/

Personas, Do better targeting

•  Geolocation •  Loyalty cohort

Track Install mix -> Prioritize Product

Support

•  Browser •  Architecture •  Languages •  OS versions


Telerik Platform

Increase Developer Productivity

Create Great User Experiences

Simplify Data and Services

Engage with the Business and Users


Telerik Analytics

Quick and easy integration into desktop, web or mobile apps Anonymous and Secure User Monitoring Real-time app analytics displayed in fully customizable dashboard Wrap and monitor app features for usage Capture and Fix Run-Time Crashes


Development Platforms Supported - Monitors

Application types: •  Mobile (native, hybrid, web)

•  Desktop

•  Web

Monitor Implementations: •  C++

•  C#

•  Java

•  JavaScript

API •  Uniform for all platforms

•  Small footprint and very low performance impact

•  Supports off-line data collection


How does it work?


Demo: Telerik Analytics in Action


Analytics Charts Demonstration - Features Examples


Analytics Charts Demonstration - Health Overview


Analytics Charts Demonstration - Users Overview


Analytics Charts Demonstration - User Cohorts


Analytics Charts Demonstration - User Loyalty


Analytics Charts Demonstration - User Location


Analytics Charts Demonstration - Environment


Analytics Charts Demonstration - Filtering Options


Use Case – Testing + Embedded Analytics

Why: Testing is an integral part of any product development process

Regression testing is key to uncover reintroduced bugs

Limited testing resources

Better ROI – focus on most popular features

Advantages: Know which test plans matter most

Minimize unexpected crashes on most popular features

Better product stability and user experience


Telerik Test Studio

Test Web, Desktop & Mobile Apps. Point-and-Click Recording. Programming Flexibility.


Use case – UI framework + Embedded Analytics

Why: UX is a key part of any Web/Hybrid/Mobile app

UI controls are key to UX

Invest in UI to make it more polished

Advantages: Enhance the customer journey

Drive more user engagement

Get better app ratings


Telerik Kendo UI

70+ UI Components. Beautiful Themes. AngularJS Ready. Any Platform, Any Device, Any Browser.


Eat Your Own Dogfood?


Case Study - Lessons learnt from Integrating Analytics with Test Studio

Product Support decisions: •  Tricky decisions about supporting different technologies:

•  Limited engineering resources to support and test everything •  Cutting widely used technologies negatively impacts revenue

•  Analytics played a huge role deciding end of support for XP, Vista,

Visual Studio 2008, IE 7 etc.

•  “Environments” metric was key



Better Product Stability via Crash Tracking: •  The aggregate dashboard helped in seeing a bird's eye view

versus getting one email/crash

•  Tracked crash reports religiously to know most common crashes

•  Helped a lot in product stability & improving user experience



Improving the Product: • Wanted to measure TestStudio performance and make improvements

• QA team found out real time information (average project size, average

test step count, min/max test, step counts) - Created test cases based on the real product usage

• Performance testing was accurate. The improvements hit a nerve with the customers and their real-life projects



Tracking Adoption of new releases: •  Could see how many people were adopting a new release a month

later

•  Based on results, we either fine tuned our product strategy or worked with marketing to push more lead generation campaigns


Telerik Analytics Customers


Customer Testimonials

“Telerik Analytics paints a picture for us of what features are of highest value to our users, so we can make smart decisions about what to include in our product and how to present the features in the interface.”

Scott Kingsley, Software Development Manager, Schneider Electric


Customer Testimonials

“We are using Telerik Analytics mainly to view exceptions that are occurring onsite and to improve the stability of our software. We really like the ability to view environmental information and the portal is really simple and easy to use. Another really useful feature is the fact that we can view information by version. We will expand our use to track features in the future.”

Aleksandar Mitrović, Software Engineer, Kimley Horn & Associates, Inc.


Future Analytics Roadmap Ideas

Machine learning & predictive analytics

Track user business flows

Full fledged REST API for integration with external systems

More filtering options for interactive drill down


Future Roadmap - Machine Learning & Predictive Analytics

• Customers collect all sorts of meaningful data, but they have to work hard to make correlations

Problem

• Unmask secret relations between metrics and present insights in the dashboard that would help in forming hypotheses for further action

Benefit

• A month after the new release, the # of visits in North America gone up by 350%, especially 80% of them are during 1-6pm PST, 40% of exceptions are happening with the keyword “null.pointer.exception” on Samsung Galaxy 6s devices

Use case


Future Roadmap - Track Business Flows

•  Product Managers need to know how users are interacting across screens for an atomic business flow for monetization

Problem

•  Better User Experience •  Optimize UI to fit what people are actually doing across different

screens into one screen •  More Revenue

•  Define and measure conversion goals, which is directly tied to monetization

Benefits


Reflections/Comments

§  How do you see Telerik Analytics benefiting your customers ?

§  What enhancements do you think are important to support more use

cases for your customers ?

§  Any feedback on the product roadmap based on market view ?


Thank You!