Friday, May 4, 2007

Performance Measurement

PaC Definition - 2

Configuration changes
Algorithm design: bubblesort, shellsort, quicksort
Compiler flags: Debug, base optimization (-o), high optimization (-fast)
I/O library: stdio.h, direct unbuffered read/write, mmap, asynchronous I/O
Filesystem type: some subset of: NFS, ufs, tempfs, raw disk, cachefs, logfs, VxFS
Application version: Compare new and old releases of the application
User count: Vary the number of simultaneously active users of the machine
Database shared mem: Minimum default, 100MB
Database parameters: Defaults,simple DB tuning guide changes, database guru fixes
OS version: compare several releases of the OS
Kernel buffer sizes: Defaults, minimum sizes, extra large sizes
Paging parameters: Defaults, reduces values
Cache configuration: On-chip + external
Memory size: subset of 2G, 4G, 8G, 16G
Disk Type: 2G
Disk Configuration: 4 striped, 8 individual, 6 mirrored, RAID5
CPU Type: UltraSPARC-IIIi, UltraSPARC-T1
CPU clock rate: subset of 167MHz, 200MHz, 250MHz, 300MHz, 600MHz
CPU count: subset of 1, 2, 4, 8, 10, 12, 16, 20, 32, 48, 64
Backplane type: 100-MHz UPA, 83-MHz GigaPlane, 83-MHz Crossbar
Network type: Ethernet, Token Ring, FDDI, 100BaseT, Switched, Duplex, Gigabit, ATM
Network protocol: TCP/IP, UDP/IP, PPP, NFS, SMB, HTTP, etc
Network count: 1,2,3,4

Measurement types
Throughput: the amount of work that is completed in a given amount of time. The throughput is usually measured in bit per second (bit/s or bps). Maximum throughput is how much work you can actually get done at 100% utilization(capacity).
Response time: the time a system or functional unit takes to react to a given input.
Think time: a measure of how long the user waits before starting another operation.
Service time: the time taken to process the request once it has reached the front of the queue.
Queue length: the number of requests that are waiting for service.
Utilization: a measure of how much of the computer's resources were used to do this work.

Reference: Adrian Cockcroft, Sun Performance and Tuning: Java and the Internet, Prentice Hall, 1998

Labels: