microsoft testing tour - setting up a test environment
DESCRIPTION
How do I set up a dev/test environment? Today’s applications are more complex than ever and it can be very challenging to set up and maintain these environments. Many organizations resort to a small number of shared environments, but you are trying to keep up with frequent developer builds, concurrent projects, and ever-changing data. This session introduces Microsoft’s Lab Management solution which allows developers and QA to self-provision their own environments. We’ll look at you can take advantage of virtualization (on-premises or cloud) to create environments, roll them back to known states, and attach them to bugs while minimizing the labor in your data center.TRANSCRIPT
With TFS and Visual Studio
Angela Dugan
ALM Practice Manager
Polaris Solutions
Angela Dugan
User
Interface
Services
Business Processes
Business Rules and Logic
Service integrations
Data access
Identity
Data
Automated testing Unit testing Integration testing Performance testing Load testing
Manual testing User testing Ad-hoc exploratory testing Planned manual testing
Automated testing Keyword testing UI automation testing Performance testing
Continuous integrationsBuild | Deploy | Test
Testing toolboxRole tailored tools
Lab manager
Lab management services
Test execution services
Build services
Pluggable components
Test runners Build enginesLab
environmentsDiagnostic data
collectors
Modern apps run in diverse environments
Difficult to repro issues found
Replicating environments for test is time-consuming, costly
Virtualization reduces cost to provision environments
Templates allow a wide range of baselines to be spun up quickly and on demand
Snapshots capture states for reproducing test conditions and verifying defects
Dramatically reduced hardware and maintenance expenses
Improved quality and reliability of apps across platforms
Operations engaged in earlier phases of testing
On-premise | Cloud
Create and manage virtual or physical environments for Dev/Test
Take snapshots or revert to existing snapshots for any virtual machine
Deploy current or any build to environment
Interact with virtual machines through the environment viewer
Define test settings for environments
Test Agent
Controller
Register with Team
Project Collection
Team
Foundation
Server
Web Server
Collect Intellitrace
Information
Test Agent
Client
Network Emulation
Test Agent
Run Tests
Client
Collect Test Impact
Data
Test Agent
Run Tests
Database Server
Collect System
Information
Test Agent
Where to
run Tests?
Collect
Data?Affect
Machine
Test Controllers and Agents Test agent controller
manages test agents
Test agents run tests and collect
data or impact the system
Installed on the “client” machines
Three types of agentsTest Agent-Enables automated testing
Build Agent-Enables automated deployment
Lab Agent-Enables network isolation
Install from the Lab Management or TFS media
Can be installed/maintained using the VMPrepTool
Create new multi-machine environment choices
Create a new
environment using virtual
machine templates in
SCVMM
Create an
environment using
machines running on
SCVMM
Create new
environments on
existing machines
Quickly choose multiple
test suites to run after
deployment
Choose your environment,
and build, deploy and test in
that environment from a
single dialog
Snapshot environments
during manual testing to
increase reproducibility
Spin up virtual test environments
from within Test Manager, or attach a
virtual environment to a manual
testing session
Thumbnail view of each
machine in the environment
Environment snapshot
taken and attached as a
link with bug
Developers can quickly debug
issues on the exact same
testing environment
Test run results are attached to
specific builds and environments
Collect all the data required
to recreate bugs from virtual
environments
SCVMM Environment Standard Environment
Build-Deploy-Test
Snapshot / Restore
Share Bug Snapshots
Network Fencing
3rd Party Virtualization
Physical Machines
Lab Management is included with Visual Studio Premium/Test Pro
SCVMM license for dev/test is included
MSDNHeadless Hyper-V as the host OS
Guest OS license is part of MSDN subscription
Each person accessing the Virtual Machine Host (or accessing a virtual machine on that host) must have an MSDN subscription
ULTIMATE
Premium
Professional
Test
Professional
Team Explorer Everywhere
SharePoint
Office
Web Access
Creating VMsCreate and store VMs - MSDN doc
Prepare a domain controller VM
Manage virtual environmentsCreating virtual envs - MSDN doc
Creating and working with virtual envs
Concepts and guidelines
Creating network isolated environments
NetworkingNetworking basics
Network isolation
Topology 1 - Multiple AT, Load Balancer and Test network with firewall settings, controlling the test traffic in and out of Corp network
Network load balancer
Firewall rules
Topology 2 - Multiple ATs and DTs without load balancers and Test network with SAN based library and host
SAN support
Topology 3 - TMG, Windows NLB and with Test apps having DB tier outside of virtual environment
Setting up rules in Threat Management Gateway
Deployment and testing on a shared machine outside the envt
Topology 4 - Multiple ATs and DTs, load balancers and environments joined to a different domain
DNS conditional forwarding
