top rated continuous delivery tools...

9
Copyright ©2016 IT Central Station Top Rated Continuous Delivery Tools Based on product reviews, crowdsourced rankings, and buyer intent data as of May 1, 2016 2016

Upload: others

Post on 03-Jun-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

Copyright ©2016 IT Central Station

Top RatedContinuous Delivery Tools

Based on product reviews, crowdsourced rankings, and buyer intent data as of May 1, 2016

2016

Page 2: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

User reviews, candid discussions, and more for enterprise technology profes-

sionals.

The Internet has completely changed the way we make buying decisions. We

now use ratings and review sites to see what other real users think before we

buy electronics, book a hotel, visit a doctor or choose a restaurant. But in the

world of enterprise technology, most of the information online and in your inbox

comes from vendors but what you really want is objective information from

other users. IT Central Station provides technology professionals with a com-

munity platform to share information about enterprise solutions.

IT Central Station is committed to offering user-contributed information that is

valuable, objective and relevant. We validate all reviewers with a triple authen-

tication process, and protect your privacy by providing an environment where

you can post anonymously and freely express your views. As a result, the

community becomes a valuable resource, ensuring you get access to the right

information and connect to the right people, whenever you need it.

IT Central Station does not endorse or recommend any products or services.

The views and opinions of reviewers quoted in this document, IT Central Sta-

tion websites, and IT Central Station materials do not reflect the opinions of IT

Central Station.

The total ranking of a product (i.e. bar length) is based on a weighted aggregate ranking of a product’s Buyer intent, Total Number of Reviews on IT Central Station, and Average Rating Based on Reviews. For each ranking factor, the score is calculated as a product of the weighting factor and its position for that ranking factor. For example, if a product has 80% of the number of reviews compared to the product with the most reviews in its category, then the product’s ranking score for reviews would be 17.5% (weighting factor) * 80% = 14.

About This Report

About Us

Rankings

IDG Enterprise, an International Data Group (IDG) division, brings together the

leading B2B editorial brands (CIO, Computerworld, CSO, InfoWorld and Network

World) to serve the information needs of our technology- and security-focused

audiences.

As the leading enterprise technology media, data and services company, IDG En-

terprise unites the enterprise technology ecosystem. We leverage the strengths

of our premium brands, while also harnessing their collective reach and audi-

ence affinity. We provide converged marketing solutions for tech marketers to

engage IT and security decision-makers across our portfolio of award-winning

websites, events, digital magazines, products and services. IDG’s Insider pro-

gram offers premium content (such as reviews, research, guides and interviews)

for registered IT buyers.

Company information is available at http://www.idgenterprise.com.

IDG is the world’s leading technology media, events and research company,

reaching 280 million technology buyers in 97 countries.

[email protected]

IT Central Station Ltd. does not endorse or recommend any products or services. The views and opinions of reviewers quoted in this document, IT Central Station websites, and IT Central Station materials (i.e. Content) do not reflect the opinions of IT Central Station. We make no guarantees about the accuracy, currency, suitability, or quality of the content, and we assume no responsibility for unintended, objectionable, inaccurate, misleading, or unlawful content made available by Content authors or other third parties.

Page 3: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

SV

When evaluating Service Virtualization tools, IT Central Station users explain that it is important to understand your specific needs as well as the capabili-ties of the various tools. Users note that earlier defect identification as well as the ability to spin up virtual services without purchasing additional hard-ware are valuable features of these tools. Buyers should also take into consideration the types of licenses available, associated costs and integration

with other products.

Top Rated Service Virtualization Tools

… It allows you to not be so dependent on systems that in traditional testing causes you delays and impacts your overall time testing schedule, and just creates an efficiency in your overall process. It allows you to duplicate those systems or

mimic them in a way that creates greater efficiency and increases time to market overall.

… In my current role, we use Parasoft Service Virtualization to fill gaps within our environments, to enable testing ear-lier, and to enable us to test situations within our test environments long before the environments are ready for use. I would have to say that the Environment Manager (EM) component is one of the cleanest, easiest, and most impacting

part of the application.

… I think a big thing for us is a tighter market and a reduction of wastage. We have a number of endpoints in the envi-ronment that are not terribly reliable. If they failed, then we could end up with tens of hundreds of people suddenly not

being able to test or validate. We’re early in the journey, but so far no issues with scalability.

Access all reviews at

- Review Excerpt from a Real User | See all reviews

- Review Excerpt from a Real User |

- Review Excerpt from a Real User |

computerworld.itcentralstation.com/categories/service-virtualization

Page 4: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

Valuable Features

I think the most valuable feature is the ability to quickly create simulations of

APIs that you use to disconnect you from your dependencies as part of your

testing process.

We’ve really done two different scenarios. One is the creation of a new API.

We were able to create a simulation before we ever wrote a line of code,

and so all of our customers who would use that gave us direct feedback very

quickly. In a performance environment, we have lots of dependencies, lots of

services that we talk to. Having the simulations gave us the ability to run test

when we want rather than when they’re available.

room For ImproVement

The things that we’re interested mostly are deployment kinds of capability.

We would like to deploy these simulators as part of our continuous deploy-

ment process. We would like to be able to auto-deploy them as part of the test

mechanism to help test teams without having to set up the infrastructure in

advance.

use oF solutIon

6 months.

stabIlItY Issues

We’ve had no issues with the stability of the solution, had no problems at all in

the six months we’ve had it deployed.

sCalabIlItY Issues

One of the requirements that we had early on was the ability to handle high

transaction rates. Our target was 700 transactions a second. We were just

able to prove with our mix of services over 750 so very, very comfortable.

This is one development group. We have lots of different groups that are

standing at the doorway to get in. It’s a very exciting time.

teChnICal support

We didn’t use technical support during the evaluation. We’ve used it a lot

since, mostly to try and fix things that we didn’t quite understand properly, not

bug fixes.

preVIous solutIons

Listening to our executives, one of the key difficulties that the development

teams were having is the ability to test faster, so they can’t deliver content

faster to our customers because they can’t test fast enough mostly because of

these dependencies and the outside suppliers. Having a service virtualization

solution gives us the ability to disconnect ourselves from our suppliers and

those blocking dependencies, allows us to go faster.

We’re not really KPI-driven. It’s really can we allow the team to test without the

dependencies where they weren’t able to do that before?

Sr. SDLC Architect at a tech services company with 100-1000 employees

sam D.

Real User Reviews of CA Service Virtualization

Real User Reviews of CA Service Virtualization

InItIal setup

One of the reasons we picked the product was it was easy to set up. We

signed our contract at the end of May, and we had our production instance up

and running in the second week of June, so it was very easy to set up and it’s

been running solid since.

other aDVICe

We really disconnected ourselves from the IT department. They run the infra-

structure. It’s then very stable and performant. Most of the administration is

done by the engineering team itself, product engineering.

This solution is very valuable in terms of being able to speed up. One of the

primary capabilities was the ability to consume it by our teams. How hard is it

to learn? How hard is it to set up? Of the three vendors in the evaluation, the

CA Service Virtualization was the easiest license model and the easiest to

stand up and configure.

I’ve never really given anybody a 10 so I give them a 9. It’s done everything it

said it would do. We’ve got great consumption, early acquisition of the product.

Support has been fantastic as we hope it would. The user interface is easy to

learn. All of the things we set out as objectives have been met in the primary

deployment.

CA Service Virtualization is an amazing solution, very easy to use, easy to train

others on how to take advantage of it. I’d say jump on it.

Disclosure: IT Central Station contacted the reviewer to collect the review and to validateauthenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.

See More CA Customer Stories

I think the most Valuable Feature Is the ability to Quickly

Create simulations of apIs.

See All Reviews

Watch Video Review

Learn how you can accelerate your continuous delivery efforts.

Page 5: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

Real User Reviews of CA Service Virtualization

Valuable Features

Service Virtualization allows you to function in an isolated manner. It allows you

to not be so dependent on systems that, in traditional testing, causes you delays,

causes impacts to your overall time testing schedule, and just creates an efficiency

in your overall process. It allows you to duplicate those systems or mimic them in a

way that just creates greater efficiency and increases time to market overall.

ImproVements to mY organIzatIon

The biggest thing, the huge time to market gain. The other thing is just financial

efficiency. We’re seeing huge financial gains in terms of using the tools. One of the

biggest things that I like about the CA products is they do what they say they’re

going to do. From financials, we’re seeing millions of dollars worth of savings.

We’re also seeing time to market gains, just based on the fact that we’re not de-

pendent or delayed by back end systems and other environments that traditionally

caused us delays.

room For ImproVement

I think some of the monitoring capabilities could be enhanced. Those aren’t

necessarily major gaps for us, but I think that would be good. Just some of the real

time monitoring and reporting capabilities. Some of the solutions that we’ve had

to create weren’t necessarily out of the box. They were successful and again, CA

supported them. Some of the reporting capabilities would be good. Additionally,

when you’re starting to identify your value ads, some of that reporting would help

in identifying and calculating your savings.

stabIlItY Issues

It does what it says it’s going to do. It’s a very stable platform. The initial installation

and coming in and bringing it into your organization, it can be a little disruptive, but

once you create some real strategies around how to deploy the solution in your

platform, the gains far out weight what the delays would have been or the chal-

lenges would have been in getting it up and going.

sCalabIlItY Issues

It scales wonderfully. We’ve scaled it from doing isolated projects, one or two

projects in terms of our pilots and proof of concepts, to putting it in an organiza-

tion as an enterprise solution going across huge organizations with millions of hits

to the actual platform.

teChnICal support

The technical support is great. They’re very responsive. Even on top of that, the

resources that CA provides, whether it’s your account director, your strategist, your

sales people, are also very supportive. They’re there when you need them. I’ve

called them at seven in the morning, I’ve called them at ten at night. I’ve never had

an issue getting the right people engaged when I needed them. They also are re-

ally supportive of providing escalations when need be. In some of their platforms

that are even growing and migrating, if they need to enhance their solutions to fit

your needs, they’re also there to do that and support you.

preVIous solutIons

Prior to engaging with CA, I had identified the need. In terms of needing to isolate

myself from both data environments, back end systems. I knew I needed to do it. I

had actually started on a personal journey, working with a couple of other vendor

companies to try to figure out if we could actually build the solution. At that point,

I was introduced to someone from CA and the initial LISA product, as it was called

at the time. That product matched exactly what we needed at the time. It was a

match made in heaven at that point. We started down the journey at that point.

other solutIons ConsIDereD

There were definitely other vendors on our short list. They all had quality or de-

Director of Quality Engineeringat a financial services firm with 100-1000 employees

Kazi W.

cent products. Where they fell short was on the service side, which is why I pushed

for the CA solution. Backend services, web services, is its primary function. We also

use it for some MQ services.

other aDVICe

We initially started with a small proof of concept. For a product like this, that’s what

you would normally do. With that proof of concept being successful, we migrated to

supporting an entire organization within the bank that I was working at at the time.

We took that solution from there to actually doing an enterprise deal and now push-

ing it across the entire company.

The product is obviously key. You want a product that meets the needs that you

have. The other thing is the service that I get provided by those people that are

coming in. Whether it’s the sales or some of the pre-sales folks that are coming in.

The support that I’m getting from them, the responsiveness that I’m getting from

that, is critical. If you don’t have a company that’s going to be good to you when

they’re trying to sell something to you, they’re not going to be good to you when

they’re supporting you later. That’s all obviously been key for me.

In terms of the value that we were able to get out of the tool, I would definitely prob-

ably give it a nine. The only reason I wouldn’t push for a ten is ... When we initially

got the product, we were growing and the product was growing at the same time,

so there were some things that had to be tweaked and some support we needed

that wouldn’t have made it a ten out of the box tool. I would say where we got it and

the way we were able to use it, that definitely pushed it to a ten. Out of the box, I

would say I felt like it was a strong nine product.

I would say if you’ve had the engagement with the CA tool and you’ve heard the

sales presentations and you’ve heard all the hoopla about what the tool will do,

know that what they say it will do, it does. It does it very well. From a market stand-

point, it does it as a market leader. Overall, I haven’t had any complaints with the

tool in terms of the organizations that we’ve deployed the tool, they love what the

tool has done for them in terms of their development, their development cycles, and

the quality of the testing and the coding they’ve been able to do using the tool.

Not in terms of comparing it with a different solution, but realize that it is a disruptive

tool in terms of the initial deployment. They need to understand it’s going to take

some heavy lifting. If their philosophy on deploying a tool is stand it up and every-

body’s going to come to you and want to use it, that’s a poor solution and poor

thought process. It is a tool that you’re going to have to actively work to deploy. If

you put together a strategy around deploying the tool and you do the work, the tool

will get you the gains and the advantages and the saving that you’re looking for in

your organization.

I think it’s great to hear what the industry is saying, what peers in the industry are

saying is important. Some of our pain points generally are about the same. If they’re

showing how they can use the tool, how it’s be successful for them, it is definitely

something I want to hear.

It allows us to Function In an Isolated manner by allowing us to Duplicate or mimic systems.

Disclosure: IT Central Station contacted the reviewer to collect the review and to validateauthenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.

Watch Video Review

See All Reviews

Page 6: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

RA

We asked the IT Central Station users to rate the most important components of successful and quality release management software. The most widespread opinion was that users should have a very clear understanding of the platforms that will be operating under the software since each one will require its own, sometimes differing functions. Users should ensure that the release management solution is a good fit for their system, and then

determine the cost of installing, configuring, and implementing the option.

Top Rated Release Automation Tools

… We previously used a home grown tool which was no longer scalable. [CA Release Automation] allows us to do multiple things at once as opposed to serially. I think the pre-codified actions for doing the release activities is a major benefit. It’s

something that we don’t have to write scripts for, they’re already written. We just need to pull them together.

… Before we automated deployments, there was a big problem with manual intervention and people making changes on production services and forgetting what they did. ... Then there’s the traceability aspect -- you can

trace back to the code which is stored in ClearCase through the build. All the deployment artifacts can be traced back to the original source.

… The Pipeline concept, Fan-in Fan-out, and Compare build are the most valuable [features] to me. Before implementing Go we used librarian-puppet to deploy code to different Puppet master servers. With Go we were

able to automate that process, implement extra code checking functionality and get a nice visual view of our environments state.

Access all reviews at computerworld.itcentralstation.com/categories/release-automation

- Review Excerpt from a Real User |

- Review Excerpt from a Real User |

- Review Excerpt from a Real User |

Page 7: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

Valuable Features

One, it’s agent-based. It allows us to do multiple things at once as opposed to

serially, which we had a home grown tool that did it serially. We’ve reduced our

time frames. I think the pre-codified actions for doing the release activities, also

is a major benefit. It’s something that we don’t have to write scripts for, they’re

already written. We just need to pull them together. Those are the two major

things.

The other thing that the tool does that we’re beginning to realize is it’s address-

ing what Gartner’s calling this bi-modal approach. What we’re realizing is that

Mode 1, which is your old legacy type of approach, which is why we got the

tool. It’s fantastic for, but now the new fast speeds using it in the Mode 2 type

thing, we’re finding it bullet-proof there as well.

ImproVements to mY organIzatIon

One of the key benefits, what really we’re looking at is the quality of the

releases, not necessarily the code quality, but the actual deployments and the

speed at which we’re doing it. Things that we automate are taking upwards of

8 to 10 times less. Now, what we can do is we can do 3 to 4 times more on a

release. We just had our largest release ever. Without CA Release Automation,

there’s no way we could deliver that level of code to our end-customers. It’s

very stable.

room For ImproVement

We’re using it more on the deployment side. What we really want to do is see a

stronger or easier user interface. I think the biggest complaint that we’ve gotten

from the development side is that the user interface, the experience is not as

good as they’d like it to be. It’s hard to comprehend. We’ve overcome that with

a lot of our own solutions, but we’d really like to see that user interface, and

would like to see them get into more of the release orchestration aspect. We’re

actually using an internal solution for that. I know they’re heading in that direc-

tion, we’re really looking for that, and again, that needs to be ease of use. That

user experience is critical. The developers have their critical time frames, and

for them to figure out and comprehend a new tool is not acceptable. We need it

to be simplistic and easy to use. There are some challenges, we’ve overcome a

lot of them though.

stabIlItY Issues

Very stable. We were fortunate that early on, one of our internal technicians/

architects sat down with CA. Went through the process of designing what the

solution should look like. We’re benefiting from that up front set up and struc-

ture of the tool in order to make it very reliable. It’s enterprise wide, it’s being

used by all groups.

sCalabIlItY Issues

Extremely scalable, that’s one of the main reasons why we bought it. It’s ex-

tremely scalable. We’ve been able to scale up from probably 100 or so automa-

tions to where we’re doing 700 now, per release. It’s been a very powerful tool.

Broad set of technologies as well.

See All Reviews

Real User Reviews of CA Release Automation

Real User Reviews of CA Release Automation

teChnICal support

The tool has been so bullet-proof, we haven’t had to tap it, but when we have

tapped it, it’s been spot on.

preVIous solutIons

Our releases were getting bigger and bigger. The demand was getting larger

and larger. We knew that the home grown tool was not going to be able to be

scalable, basically. It was elongating our releases. We need to get our stuff

done in a weekend, and it was beginning to drift into the following week. We

went to the marketplace, CA Release Automation was a market leader, we

made a quick decision in that direction. We haven’t regretted it.

The support we’ve had with CA in the past had been very strong, those were

important to us. Then, the depth of the solution. I think we’re looking into

the depth of the solution, and the agility and flexibility of that solution, I think

were important to us in this decision. We’re with a large player, somebody

that could support us if we needed. The tool, from everything we had been

reading and researching, it could stand up to it. I think those were the things

that we were looking for.

InItIal setup

The initial set up itself as relatively straightforward, what was a challenge was

the roll out. You had competing priorities, you had adoption issues, you had

skill set gaps. Not only on the roll out team, but on our development team.

What we were able to do was close some of those skill set gaps. It became a

journey where we had to show the value to each of the individual develop-

ment groups, and it created momentum. As we got these development

groups onto the CA release automation, they saw the benefit. We were able

to take internal environments, and be able to turnaround those environments

in seconds as opposed to days. We began to get the adoption. It’s getting

that initial movement forward which was really the challenge. I don’t know

that there’s anything that CA could’ve done. It was something that we had to

do internally.

Continued on next page...

Director DevOps at a financial services firm with 1000+ employees

steve s.

We previously used a home grown tool Which Was no longer scalable. We Found that Ca’s tool Is stable and It’s able to adapt.

See More CA Customer Stories

Watch Video Review

Learn how you can accelerate your continuous delivery efforts.

Page 8: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

We’ve been able to stack multiple Different server type Deployments along the Database Deployments, have them all Dependent on each other appropriately

and report out the successes or problems.

other solutIons ConsIDereD

At the time we did the selection, no. They were out there. I was not part

of the selection process, I know the person that was, and we got release

automation before it was known as CA Release Automation. It was then

purchased by CA. It was a clear market leader, so we basically went in that

direction.

other aDVICe

My recommendation would be: a) buy the tool, b) recognize that it’s a

journey. It’s not something that it’s a binary thing that’s going to happen

overnight. You’ve got to continually sell it and treat it as an ongoing initia-

tive. We’re post the projectization of it, and we’re still bringing people on

board to the process. I would recognize that this is a continuous delivery,

Real User Reviews of CA Release Automation

if you will, exercise that I don’t think ever stops because your code and your

code base is constantly evolving. There are things that you can continually

do, integrate it with your change management environments, integrate it with

some of the other DevOps tools that you can’t even imagine what you can

do with it. I would say, recognize that it is a great foundation for your release

automation, but it doesn’t stop there. This tool is holding up to the new re-

quirements that are coming, and that’s what we really like about the tool is as

the world evolves, this tool is stable. It’s stable and it’s able to adapt.

Valuable Features

The best thing that it offers us is the opportunity to streamline our deployment

so that we can have serial and horizontal dependencies. We have been able to

stack multiple different server type deployments along the database deploy-

ments, have them all dependent on each other appropriately and report out the

successes or problems at the end of the process.

ImproVements to mY organIzatIon

We have the repeatability, we have the confidence that it’s doing the same

thing each time the way we’ve set it up to do and just being able to have the

expectation of knowing exactly what’s going to happen in the order that our

infrastructure needs it to happen.

We rely on it quite often. We use it many, many times during the course of a

week or a month and it’s held up for us, so it’s doing what we need it to do.

room For ImproVement

Well, I’m looking forward to seeing different kinds of scheduling options and

being able to troubleshoot more real time if something does go wrong. Those

would be two things that would be very helpful to us.

DeploYment Issues

Deployment was pretty big and there were a lot of dependencies between the

different components and we just weren’t able to make it work manually.

sCalabIlItY Issues

Scalability, we have added in more and more. We don’t have the largest imple-

mentation by any means but we’ve got a very complex system and we add

more to it on a regular basis as our application grows.

adina K.

Manager, SCM and Releaseat a cloud provider with 100-1000 employees

other solutIons ConsIDereD

It goes back quite a few years that we’ve been using this and at the time we

were either going to do a homegrown solution or this. Those were the two

options.

See More CA Customer Stories

Disclosure: IT Central Station contacted the reviewer to collect the review and to validateauthenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.

Disclosure: IT Central Station contacted the reviewer to collect the review and to validateauthenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.

Watch Video Review

Learn how you can accelerate your continuous delivery efforts.

See All Reviews

Continuation of Review by Steve S.

Page 9: Top Rated Continuous Delivery Tools 2016go.itcentralstation.com/wp-content/uploads/2016/07/Continuous-Delivery... · Continuous Delivery Tools Based on product reviews, crowdsourced

© 2016, IT Central Station.

Valuable Features

There are a lot of great features with Test Data Manager. It’s allowed us to

really revolutionize the way that we are doing our testing. We use Test Data

Manager to create synthetic data for our testing purposes. We have a legacy

application that has been around for a very long time, and a lot of the people

that originally developed it are no longer with the company, so we’ve had

to do a lot what we call, “Data Archaeology,” to go in and recreate our data

model. Test Data Manager has allowed us to do that, capture that model, and

then create that data on demand, saving us a huge amount of time and money

in the process.

ImproVements to mY organIzatIon

It’s really allowed us to focus on the craft of testing, and not focus on the creat-

ing data, spending time setting up the scenario that we need, or trying to find

that sort of thing. It’s allowed us to be more focused on our efforts, it’s allowed

us to be faster. We run an agile shop, and so we’ve been able to use that data

in our pipeline as we deliver stuff in a CICD world. It’s been great.

sCalabIlItY Issues

It’s been very stable. We haven’t had any issues with the technology at all.

teChnICal support

It’s been great. They’re very knowledgeable in the tool, they’ve helped us

overcome some hurdles as we’ve been evolving in the practice ourselves and

they’ve been super.

preVIous solutIons

Test data creation, for us, was a very manual process. The options were either

creating it with hands-on keyboards with people actually having to spend time

creating it, and we would also do some things where we would just grab data

out of production. That didn’t always work for us, because you didn’t know

what you were going to get when you captured that data.

Not being able to create your own data was very time consuming to create

data on your own. Or, when you did things like grab things out of production.

You didn’t always get all the data combinations that you might need, it just

happened to be whatever was there at the time. You certainly weren’t getting

some of the negative scenarios that we need to test with also.

InItIal setup

CA and one of our vendor partners came in and helped us do a Proof of Con-

cept. They helped set up the infrastructure, and then walked us through the

application, and actually proved out that we could do in in our environment,

because it was, for us, an interesting environment. It was, I wouldn’t say easy,

but we were able to get it done.

roI

The return on investment for us has been great. In the last year, we captured

some metrics around our ROI, and we’ve saved over eleven thousand hours

in manual time of trying to create test data. In that same time, that eleven

thousand hours, has translated to about eleven million dollars in cost savings,

just from that. Additional benefits around being able to shorten our test cycle

time, allow us to go deeper and further into our testing and freeing up people

to actually do the work that they’re paid to do, and not being doing things like

creating data so that they can actually do the work.

Real User Reviews of CA Test Data Manager

Real User Reviews of CA Test Data Manager

other solutIons ConsIDereD

It was a green field for us. We just really didn’t know what, where, so we

looked at everything that was available in the space, and we chose CA

because they probably did have the best offering that would support the most

technologies. We have everything from legacy, RPG iSeries type stuff, all the

way up to applications in the cloud, and we needed something that would

scale for all of those.

other aDVICe

Important criteria when selecting a vendor: we want to work with somebody

that’s going to help us solve the problem that we’re trying to solve. Do it in a

way that works for our enterprise. We don’t want to do something that only

works for one team or one solution, something that’s scalable. We have a lot

of different technologies in our organization, so we need something that will

work with all of them.

We need a partner that will help us. This was something new to us, and so we

needed somebody to help us dive in, figure out how to do it in our world, and

translate that out and help us be successful with the implementation.

Rating: I would say it is a 10/10. It’s been a great experience for us. We really

have benefited a lot from it. It’s been a great story, as we’ve learned how to

sell it and embed it into our process, and it’s been really beneficial for us. We

got a lot of conversations with people while we’ve been here about recom-

mending the application. It’s been transformative for us in order to implement

that.

It’s an interesting process to go through. Organizations need to change their

model and stop thinking about how they’ve always done things, and so the

challenge is really getting people to think in a new way, but once they do, it’s

been a terrific experience. It’s really allowed us to focus on the craft of what

we’re trying to do, rather than lots of other activities that we don’t need to be

spending time on.

Virginia m.

Sr. Test Manager at a transportation company with 100-1000 employees

In the past, Creating test Data Was a manual process. We now use Ca tDm to Capture our Data model, and then Create Data on Demand.

See More CA Customer Stories

Disclosure: IT Central Station contacted the reviewer to collect the review and to validateauthenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.

Watch Video Review

Learn how you can accelerate your continuous delivery efforts.

See All Reviews