Fundamental of Performance Testing
Agenda
Ø
Basics of Performance Testing?
Ø
Performance testing tool – LoadRunner Overview
Ø
Key Concepts – Transactions, Think Time,
Correlation
Ø
Demo – Recording a Script
What is Performance Testing?
Ø
Ensures system stability, scalability and speed
Performance testing helps identify
how systems behave under expected and peak load. Each type targets a specific concern.
Ø
Types of tests:
ü
Load
ü
Stress
ü
Spike
ü
Endurance
ü
Soak
Notes: Under a load
how an application is behaving and what is the response time?
How quick the end user is getting the web page and what is the throughput?
How many end users? Can able to access the application without any performance
degradation without any issues? For end user two key performance aspects 1. One
how quickly you are getting the page. 2.how many users (volume)
Test case to simulate the load, concurrent users doing the
same functionality, how the application is behaving and how the application
response.
Types: Load: Online application, 200 end users uploading
the document in one hour. Create 200 users and upload the document, check the
response time. My load, expected load.
Stress: More load on
the system, simulate with 300 or 400 end user.
Spike: Ramp up the
users in 5 minutes,
Endurance: Run the
test for long time.
Soak: Similar of load test
It comes under non-functional testing.
Response time, throughput and security is beyond the
functional.
Performance Testing
Lifecycle
Analysis and Planning -> Test Design->Test Execution->Result
Analysis & Reporting
Ø
Analysis and Planning
ü
Requirement gathering
Ø
Test Design
ü
Scripting
ü
Scenario creation
Ø
Test Execution
Ø
Result Analysis
Performance Testing
Process
Test Phases
Initiate->Estimate->Strategize->Design->Execute->Analyze->Final
Report
Automation test using Loader tool.
Open-Source &
Licensed Tools
|
Feature/Aspect
|
Open-Source Tools (Jmeter, k6, Gatling)
|
Licensed Tools(LoadRunner) (Self performer, VCS)
|
|
Cost
|
Free
|
Expensive (based on protocol, Vusers, etc.)
|
|
Protocol Support
|
Mostly HTTP, Web APIs
|
Extensive (SAP, Citrix, Siebel, Oracle, TruClient, etc.)
|
|
Ease of Use
|
Varies (some CLI, some GUI)
|
Full-featured GUI, user-friendly
|
|
Community Support
|
Large (for JMeter, k6)
|
Vendor Support (OpenText)
|
|
Customization
|
High(open code base)
|
Moderate (through APIs or custom scripting)
|
|
Scalability
|
Depends on scripting and infrastructure
|
Highly scalable with built-in controllers and load generators
|
|
Reporting
|
Good (especially Gatling, k6)
|
Advanced Analytics and built-in reporting
|
|
Monitoring
|
Needs integration(AppDynamics, InfluxDB, etc.)
|
Built-in monitoring and third-party integration
|
|
CI/CD Integration
|
Strong (JMeter, K6, Gatling)
|
Possible but needs ALM Integration
|
Load Runner
Load Runner is a suite of tools. VuGen is where scripts are
built. Controller manages the scenario. Load Generators simulate users.
Analysis gives insights into performance
Ø
VuGen: Script creation
Ø
Controller: Test Scenario creation
Ø
Load Generators: Vitrual users
Ø
Analysis: Post-run reports
Load runner is a threat based tool like Java. Load can run
the test scripts parallel.
Controller can run the 100 users means 100 threads parallel.
Load generator to run those threads using virtual users.
Controller sets a timer and ends when user logs off. It gives
you response time.
All the logs will be collected in the controller, the tool
analysis tools gives the nice presentable format of logs.
One controller machines acts as a Master and the other
controller machines are slaves.
At present, everyone is using the Performance Centre. PC is
a web based application.
PC application is hosted in web server; it connects to
controller and load generator.
Going forward, LRE is in cloud
Performance Centre
PC is an enterprise-grade, web-base performance testing
platform from OpenText that enables centralized test execution, monitoring and
analysis.
Ø
PC Host- Controller & Load generators
Ø
PC Server-Test Scheduling, Results analysis and
User management
Ø
ALM Server – Script & file storage and
Project tracking
Load Runner
Enterprise (LRE) Cloud
LRE is a cloud-based performance testing platform by
OpenText that enables teams to plan, run and manage large-scale load tests
across distributed environments.
Key Concepts
Ø
Transaction: Measures response time between
checkpoints
Ø
Think Time: Simulates user wait
Ø
Pacing: Time between iterations
Ø
Correlation: Handles dynamic values
Ø
Parameterization: Replaces hardcoded values
OpenText had given the framework
1.
Virtual User Generator (Install in your machine)
2.
Analysis (Install in your machine) (Install in
your machine)
Agenda
Ø
Vugen Recording Traffic
Ø
Load Runner Test Execution Architecture
Ø
Performance Center ALM
Ø
Monitoring Agent
