Comparison Analysis: Visual Studio vs QTP vs Silk

Comparison Analysis: Visual Studio vs QTP vs Silk

Abstract – Why compare Visual Studio, QTP, Silk?

Well, Comparison Analysis: Visual Studio vs QTP vs Silk is put together due to the questions Technical Community is required to answer on day to day basis.

What about Selenium/ Other Open Source Tools?

Well, it will be an overkill and something like comparing Oranges to Apples

 

One of the key factors considered during feasibility studies is a decision on Tool Selection. The Test automation tools offered by respective vendors come** with their own strengths and weaknesses.  and There have been so many occasions when Organizations end up buying a tool only to realize later that it can’t be used for the task at hand and often are not able to justify the returns they sought after investing on the tool. The investment includes both monetary and time.

This need has been the source of inspiration to put together the current comparison matrix. We hope it helps Project Managers/Testers make a more informed decision before making a recommendation on Tool selection.

Table – Comparison Analysis Visual Studio vs QTP vs Silk

No.

Tool Feature

VSTS Coded UI

Silk

QTP 10.0

1.

IDE Support

Comes integrated with Visual Studio Environment

Comes with Standard IDE

Comes with a Standard IDE which is built to support automation

2.

Browser Support

It supports multiple browser types/versions for example multiple versions of IE, Firefox, Chrome (via selenium)

3.

Languages supported

VB.Net, C# are supported.

No language support. Only vbs (scripting language) is supported.

4.

Add ins for supported environments

Addition Add ins are not required to support the environment under test

Licences Add ins are required to support the environment under test

Support for Object Repository

Object Properties are stored in UIMap

UI Based Object repository works in 2 modes, i.e., Shared and Local

6

Object Spy

Coded UI builder using cross hair utility to identify the objects. But the objects are spied with limited set of properties those are supported by MSAA and UIA technology

In built Spy utility displays Test object as well as run time properties.

7

Checkpoints

Assert methods are available but it provides access to limited set of properties

Rich set of checkpoints including Bitmap, XML , Standard are available for verifications

8

Recovery scenario

Recovery has to handle through coding

Recovery Scenario manager provides simple way to recover out of unexpected application behaviour

9

Source Controlling

Excellent Source controlling features are available

Limited set of Source controlling is available when connected with Quality Centre

10

Connection with Test Management tool

Can be connected with TFS

Can be connected with QC

11

Active screen

AUT screen is not captured automatically

If active screens are captured then functionalities like checkpoints can be implemented

12

Output value

Can be achieved through code

Exclusive output value feature is available to capture the values from application

13

Step Generator

Step Generator not available

Using this feature, steps can be generated in QTP.

14

Function Generator

This us supported via Method Generator

Using this feature, functions can be generated in QTP.

15.

Record and Run

Basic Record and Run is available

Basic Record and Run is available

5.

Record actions only desired application

No such setting is available

Done in Record and Run Settings

6.

Customization of properties needed for object identification

No such setting is available.
It can be implemented by writing a extension

Done in Object Identification Settings

7.

Virtual Object Concept

No such feature is available

Virtual objects can be created using Virtual Object Manager

8.

Save test with Resources

Resources can be saved with the Coded UI test

Only resources like library files can be saved with the Coded UI test

9.

Analog Recording

No such recoding mode is available

Analog recording mode enables to record the exact mouse and keyboard operations performed in relation to either the screen or the application window.

10.

Low Level Recording

No such recoding mode is available

Low Level recording mode enables to record on any object in application, whether or not QTP

recognises the specific object or the specific operation

11.

Code Analysis

Coded Analysis can detect possible flaws in the code

No such feature available in QTP

12.

Generate Architectural Diagram of the code

It is possible to generate Architectural Diagram of the code.

No such feature available in QTP

13.

Generate code coverage report

It is possible to generate code coverage report

No such feature available in QTP

14.

Calculation of Code Metrics

Code is calculated against parameters like Maintainability, Complexity etc

No such feature available in QTP

15.

Map the test against the Requirement, Manual test case

Possible to map the test against the Requirement, Manual test case

No such feature available in QTP

16.

List of impacted test when the code is changed

List of impacted test case can be generated when the code change occur

No such feature available in QTP

17.

Smart Identification

VSTS has inbuilt mechanism to identify the objects even if there is small change in the object properties

Smart Identification can be used to identify the objects

18.

Support for unsupported platforms Extension

VSTS has open architecture so that the Extension can be written to support the environment under test

No such feature available in QTP

19.

Supported Built in Configuration file

Configuration files can be used to store the global data

Only Environment variables, output parameters can be used to share data across the test

20.

package used for performance testing, web testing

Coded UI test be used for performance, web, load testing

No such feature available in QTP

21.

Support for Online Help

Not integrated with the tool but can be browsed via MSDN

In built Help library is available

22.

User Manuals/documen tation/books and references

No Support

Extensive Support

Extensive Support

23.

Technology behind Object Identification

VSTS uses MSAA and UIA technologies for Object Identification

Coded injection approach is used for Object Identification

Submit a Comment

Your email address will not be published. Required fields are marked *

Skip to toolbar