| Subject |
SmarteLoad
|
MS Visual Studio Load Test Virtual User Pack and Load
Test Analyzer
|
| Performance Methodology |
| Technology Foundation |
Record and Playback - well-organized
user-friendly grid script with server requests and responses in easy
to read format
Extensible using JavaScript
|
Record and Playback
Code is .NET, extension beyond .NET required APIs
|
| Test Suite Optimization |
Migration uses consistent flow implemented in the
functional test but enhanced for performance testing usage.
|
|
| General Features |
Execution Scheduler Tool (per
Group - ramp up, ramp down, duration)
|
|
No ramp down |
| Synopsis/Scenario Execution |
|
|
| Reuse Functional and/or Performance/Load
Scripts from Other Sources |
Leverage automated script migration from existing SmarteScript scripts
or other functional test tools or migrate scripts from other performance/load
tool scripts for maximum re-usability; create scripts with open source
|
Conversion or migration of scripts from MS Visual Studio Test Tools
|
Automated Transaction Measurements
|
|
|
SimUser Activity
|
Tracks SimUser activity to very detailed level |
|
Supports Internet Explorer, Firefox,
Chrome and eProgesa
|
|
Internet Explorer and Firefox only |
Enter Transaction Names During
Recording
|
|
|
| Record Init, Actions and End
Components |
|
|
Pacing and Iteration Configurations
|
|
Limited configurations only |
| Monitor Users Progress, Synopsis
Status, Execution Progress |
|
|
Data Generation Tool
|
|
|
| Automated Remote Agent Installations |
Remote Host Agent installation is performed from remote through the
Host Management facility |
|
Complex Dynamic Correlation (Boundary
Change)
|
Fully automated process with advanced Regular Expression pattern matching
approach |
|
Complex Sequential Dynamic Correlations
with Numerous Embedded Correlations
|
Fully automated process with advanced Regular Expression pattern matching
approach |
|
Controller Automated Transaction
|
Automated transactions in the Controller; no need to go back to the
script |
|
| Easy Implement of SyncPoints
(Multi-user Intersect Points for Stress Testing) |
|
|
Java Protocol Libraries and Customization
|
Easily integrates with Java libraries for additional Java custom protocols.
Java (Included) |
|
| Analysis and Statistics |
Multiple Real-Time Graphs View
|
|
|
| Monitors |
Included in the tool's price - no hidden costs |
Additional costs per monitor |
|
Analysis View and Summary Report
|
|
Limited functionality |
Analysis Graphs Add and Merge
|
Automatic merge and scale |
Limited functionality |
| Reporting |
Export Report to Various Formats
|
|
MS Excel |
| Transaction Summary Report, Report
Filtering |
|
Limited functionality |
| Script Generation |
Script Customization
|
Uses pre and post conditions JavaScript commands for functional and
data validation as well as script enhancements |
Requires .NET customization |
| Data Input Methods |
Random and Sequential and Unique
Data Testing
|
|
Limited functionality |
| Import and Export Test Data |
|
Limited functionality |
| Investment |
| All Inclusive Price |
Out of the box price includes all protocols, monitors
and extensions
No hidden or additional costs for additional components
|
Part of Virtual Studio Ultimate bundle may include
unnecessary components and higher cost.
Purchased separately may limit some functionality.
|
| Resources Skill Level |
Users can operate within hours. Minimal training,
significantly short ramp up period to create and run a Synopsis,
a suite of multi-user integrated performance/load scripts.
|
Requires familiarity with Visual Studio methods and
.NET programming skills.
|
| Budget/Costs |
Overall low cost, project and time-to-test cycles.
|
Purchased as part of Virtual Studio Ultimate package
may include unnecessary components and higher cost. Purchased separately
may limit some functionality.
|
Performance/Load Test
QA Infrastructure
|
Long-term solution with consistent performance testing
methodology. Every user employs the same methodology and process. Extensible,
open architecture for future platform changes.
|
Extensible with APIs
Not consistent performance testing methodology. Each user may record
scripts and code in his/her own method.
|
| ROI |
Significantly high; increases over time due to users
increase in productivity
|
Quantify load/performance testing as part of overall
bundle software cost. As a part of complex software bundle, it has limited
load testing for scalability and stress testing.
|
| Overall Testing Results |
Test Development Cycle
Effectiveness and Efficiency
|
Highly predictable script development throughout the
performance test cycles. Scripts can be automatically migrated from
another tool for efficiency.
|
Load and performance testing is one part of large,
complex software bundle.
|
| Total Test Solution |
| Responsive to Customer Requests |
Customer requests are
Fast-tracked
|
Support calls are fee based.
|
| Flexible Product Offering |
Flexible tools and culture to adapt to customer's
needs.
|
Out of the box basic load testing tool. Significant
customization is always required as a part of load testing development.
|
| Professional Services |
Dedicated team to assist from start to finish or at
any step along the way.
|
Outsourced
|
| On-Site Training |
Personalized training focused on your application
|
|
| Web-Based Training |
Personalized training focused on your application
|
|
| Technical Support |
Personalized Technical Support
Available
|
|
|
Technical Support On-site Available
|
|
|
| Technical Support Over the Web |
|
|
All entries in the comparison table have been made on the basis of information
available on respective product websites. The analysis and views expressed
in this section and the information made available are purely those of SmarteSoft,
Inc. It is possible that competing products have additional features not mentioned
on the product websites. ©2008-2011 SmarteSoft, Inc. SmarteSoft and SmarteLoad
are trademarks of SmarteSoft, Inc. All other company, brand, or product names
are marks of their respective holders.
