Download Testing at Vattenfall IT

Testing at Vattenfall IT
15 September 2011, Stockholm
© Vattenfall AB
Agenda
•  Introduction
•  Vattenfall IT - Test Centre of Excellence
•  Testing Framework
•  Implementation ITIL3 - SVT
•  Next steps
•  Questions & Answers
© Vattenfall AB
2
Introduction
•  About me
•  My move to Sweden
•  Role within Vattenfall
© Vattenfall AB
3
Vattenfall IT - Test Centre of Excellence
Antonio Boogaers
Test Architect
© Vattenfall AB
Test Centre of Excellence
•  Get better quality when releasing
software to production, hence lowering
the operational costs by introducing
less incidents in production
Test CoE
Processes
© Vattenfall AB
•  Test more using less man hours by
running test automation scripts
Test support
Acceptance test
support
Performance test
Test automation
Functional test
Test assets
•  Create efficiency by performing test
activities within the Software
Development Life Cycle (SDLC) in the
same way for every project and making
use of central expertise
5
Test Centre of Excellence
The focus for Test CoE is to secure quality
from development units (internal and/or
external), before deployment
Test CoE
•  Service providing
Processes
© Vattenfall AB
Test support
–  Process support, guidelines and templates
Acceptance test
support
Performance test
Test automation
Functional test
Test assets
–  Test tool supporting the test process
HP Quality Center
–  Development of Test automation
HP Quick Test Professional
–  Performance testing HP LoadRunner
–  Test expertise
•  Virtual organisation – network of test managers and
local test coordinators
•  Members of the network are responsible to contribute
continuous improvements of processes and tools
•  Test Centre advices on training and certification
6
Wanted position – Vision
”Vattenfall has a world wide best in class Test Centre of Excellence
that serves the entire Vattenfall group with a standard process,
expertise, guidelines and services in the area of Quality Assurance /
testing of software deliverables. The CoE serves as a test ”hub” for
all development sites within Vattenfall.”
© Vattenfall AB
7
Roll out: Key success factors
•  Commitment from management
•  Appointed resource(s)
•  Clear business requirements
•  Implemented change/release process
•  Stable system
© Vattenfall AB
8
Testing Framework
From methodology to test tool implementation
© Vattenfall AB
Vattenfall Test methodology
•  International standards
– 
– 
– 
– 
– 
ISTQB
TPI & TMap Next
Risk & Requirement Based Testmanagement (RRBT)
HP Business Process Testing
TestFrame
•  International knowledge and expertise
•  Automation Framework
–  Focus on Business Process
© Vattenfall AB
10
Test process overview
Focus on:
•  Involving business representatives/process
owner
•  In order to identify “product” risk
•  Involving development/upgrade team and
infrastructure in order to identify technical risks
•  Test strategy based on risk
© Vattenfall AB
11
Test process overview – Test preparation
© Vattenfall AB
12
Test process overview – Test execution
© Vattenfall AB
13
Implementation ITIL3
Service Validation & Testing
© Vattenfall AB
Purpose
”The purpose of the SVT process is to plan and implement a
structured validation and testing process which provides objective
evidence that the new or changed service will support the
Customer’s business and stakeholder requirements, including the
agreed service levels.”
© Vattenfall AB
15
Goals
• 
• 
• 
• 
• 
• 
© Vattenfall AB
Service Assurance
Fit for Use
Fit for Purpose
Early lifecycle approach
Defect free applications
Resilient IT services and IT infrastructure
16
Process Scope
IS
IS NOT
•  Validating
that a design, as realized in its target
environment, is Fit for Purpose and Fit for Use
•  Verification to ensure that the service
component(s) or service environment is to
specification (what it should be)
•  Developing
a service design
(Service Design)
Identifying failures in testing scenarios and
environments
•  Root
cause analysis of a failure
(Problem Management)
•  Developing a fix for the problem
(Service Design)
•  Implementing changes to the controlled
environment
(Release and Deployment Management)
Scheduling and providing resources to perform
Service Validation and Testing activities
Providing a degree of confidence that services will
deliver negotiated capabilities
© Vattenfall AB
Defining and negotiating Service Level
Agreements (SLAs)
(Service Level Management)
17
Process Relationships
Release and Deployment
Management
Planning for New or
Changed Services
Test
Strategy
from SDP
Tasks
Service Validation and Testing
Validation and
Test Report
RFC updated
with SVT
Report
Change
Management
Evaluation
Trigger
Input/Output
© Vattenfall AB
18
Triggers, Input & Output
environment
validate an
Request to
Trigger
Output
Input
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
• 
© Vattenfall AB
Quality Plan
Test Acceptance Criteria
Service Package
Service Level Package
Service Design Package
(including Service Model)
IT Technology Standards
IT Technology Catalogs
Service Operations Plan
Service Assets and Components
Test Models and Templates
Problem Records
Service Validation & Testing
• 
• 
Plan and Design Test
Verify Test Plan and Test
Design
Prepare Test Environment
• 
• 
• 
• 
• 
Perform Test
Evaluate Exit Criteria
Test Clean up and Closure
Validation and Test
Management
19
• 
• 
• 
• 
Test Strategy
Service Test Plan
Test scripts
Test results reports
Test Schedule
Testing Results Reports
Incident records
Re-initialized test
environments
Problems and known error
records related to the release
Validated service capabilities
Validated Acceptance Criteria
Updated Workorders
Next steps
© Vattenfall AB
Next steps
•  Upgrade to HP ALM 11
•  Customizing ALM for supporting SVT process
•  Building-up automation framework
•  …
© Vattenfall AB
21
Questions & Answers
© Vattenfall AB