Sherry Tang's CS Notes: Software Performance Testing

Wednesday, April 11, 2007

Software Performance Testing

PaC Definition - 1

#Definition
Performance testing is testing that is performed, from one perspective, to determine how fast some aspect of a system performs under a particular workload. It can also serve to validate and verify other quality attributes of the system, such as scalability and reliability.
#Purpose
It can demonstrate that the system meets performance criteria.
It can compare two systems to find which performs better.
It can measure what parts of the system or workload cause the system to perform badly.
#Specifications
Requirements development phase - Ideally, this is done during the requirements development phase of any system development project, prior to any design effort. See Performance Engineering for more details.
Performance profile tuning - Performance testing is frequently used as part of the process of performance profile tuning. The idea is to identify the “weakest link” of a system.
Peak time - It is always helpful to have a statement of the likely peak numbers of users that might be expected to use the system at peak times.
#Test Questions
1.What is the performance test scope?
2. For involved UI, how many concurrent users are expected for each specify peak vs. nominal?
3. What does the target system hardware look like?
4. What is the Application Workload Mix of each application component? (For example: 20% login, 470% search, 10% checkout).
5. What is the System Workload Mix? (For example: 30% Workload A, 20% B, 50% C)
6. What are the time requirements of processes?
#Tasks to undertake
Gather performance requirements
Develop a high-level plan, including requirements, resources, timelines and milestones
Develop a detailed performance test plan
Choose test tool
Specify test data needed and charter effort
Develop scripts for each application/component under test
Develop detailed performance test project plan
Configure the test environment
Execute tests
Analyze the results