Download Automation Testing

Automation
Testing
Trainer: Eran Ruso
Training Agenda
• Automation Testing Introduction
• Microsoft Automation Testing Tool Box
• Coded UI Test and Unit Test
• Performance Testing
ALM
ALM (2)
QA Process
QA Process
Tester’s Role In Agile
•
•
•
•
•
Part of the team
Little Planning and Test Case writing
Plans only for the functionality in the Iteration/Spring
Functional Testing happens in each Iteration/Spring
System Testing and Performance Testing happens in
last sprints
Automation Testing Definition
Test automation is the use of software to
control the execution of tests, the comparison
of actual outcomes to predicted outcomes, the
setting up of test preconditions, and other test
control and test reporting functions.
Commonly, test automation involves automating
a manual process already in place that uses a
formalized testing process. (Wiki pedia)
When?
•
•
•
•
•
Repeatable Test Scenarios
Application Logic Level
Unit Test the code
Checking the Performance
Data Driven Tests
When Not?
• Test Cases that are complicated for coding like
image comparison
• Test Cases that we run only a small number of
times
• Complex to code
• Premature parts in the Application (Constant
Changes)
Why not Automate Everything?
• Low ROI (Return On Investment)
• Many times the Test Case is too complicated
for a machine
• Most of the time the Look and Feel needs to
be done by Human Tester
Motivation
Project
Manager
Infrastructure
Architect
Business
Stakeholder
Developer
Tester
Solution
Architect
Visual Studio 2010
VSTS 2010 Test Capabilities
Test Runner
Web Test
Coded UI
Test
Manual Test
Load Test
Unit Testing
Test Case Management
Virtual Lab Management
Data Collectors (Historic Debugging, System Info.)
Team Foundation Server with Reporting
Silverlight Tools
Multi-core Development
SharePoint Development
Cloud Development
Web Development
Windows Development
Generate from Usage
Office Development
New WPF Editor
Customizable IDE
Manage Test Cases
Code UI Test
Unit Test
Performance Testing
• LESS Approach: Less is the initials of: Load,
Endurance, Stress and Spike
• Load Test: The test target is to check that the
system can handle expected load of users
doing different scenarios in the system.
• Endurance Test: The test target is to check the
reliability of the system.
Performance Testing (2)
• Stress Test: The test target is to find the upper
limit that the system can handle.
• Spike Test: The test target is to check that the
system can handle spikes of users and can
gracefully handle a sudden load in the system.
Performance Testing
Summary
• Automation Testing Introduction
• Microsoft Automation Testing Tool Box
• Coded UI Test and Unit Test
• Performance Testing
For More Information…
• Eran Ruso Blog:
http://blogs.microsoft.co.il/blogs/eranruso/
• Team System Guides:
http://tfsguides.codeplex.com/