Execution Dashboard

PostedDecember 12, 2022

UpdatedDecember 12, 2022

ByAdmin

Execution Dashboard

The Execution Dashboard is a place where users can see all the triggered runs by a specific user. Runs such as pending runs, completed runs, currently running runs, terminated runs, and canceled runs are displayed under the Execution Dashboard.

Why do we need an Execution Dashboard?

When multiple runs are triggered by the user, to view the result of those triggered runs with the help of the Execution Dashboard, the user can see the status of triggered runs.

In how many ways can the user be navigated to the Execution Dashboard?

1. Select a script from the test development main tree structure and click on the run button, if the machine is not available for execution, then you will navigate to the Execution Dashboard.

2. When you select a script from the test development main tree structure and click on the run button if the machine is available for execution, the user is navigated to the Execution Dashboard.

3. When the user triggers a run from a specific execution page and if the machine is not available for execution, the user is navigated to the Execution Dashboard.

4. When a user is triggering Multiple runs from Test Development main tree structure or in a specific execution page and if the user wants to see the result of that triggered script, upon clicking on “Execution Dashboard” in breadcrumb or “Execution Dashboard” inside script tab, the user is navigated to Execution Dashboard tab.

Column in Execution Dashboard:

1. Execution ID: The unique execution id is generated for all triggered runs.

2. Execution Name: “Module name” or “script name” is displayed as the execution name.

3. Machine: Machines that are used for respective execution will be mentioned.

Upon clicking on this, <<machine name>> the popup header “Machine details <<machine name>> is prompted. Information regarding the run that is triggered by the different users’ different projects under respective “machine name” is displayed.
Click on the Machine Name.

Machine Details pop mainly contains 2 sections:

1st section:

Name: Machine<<name>> is displayed under a name.
OS: Used OS information will be displayed under OS.
Browser: The used browser for execution will be displayed under the browser.
Device: If the selected project is “mobile” or “web and mobile” then “device attribute name” will be present. The respective device name will be displayed under the device.
Status: Status such as “Available”, “busy”, “inactive”, “disable”, and “enable” respective machine status is displayed under the Status column.
Owner: The owner’s name is displayed.

2nd section:

The column under Execution details:

Execution id: Generated unique execution id for a respective run is displayed.
Execution name: <<script name>> or <<module name>> is present as the execution name for the respective execution id.
Project: Project name of the respective run is displayed.
Total script: The aggregate count of the script under a specific run is displayed.
Run initiated by: The user who has initiated the run <<name>> is displayed.
Run initiated: The date and time when the run is initiated are displayed.
Execution start time: The date and time when the execution is started are displayed.
Status: By default, all the “running” runs and “pending” runs are displayed in the table and, the respective status under the status column is displayed.

4. Total steps: Total steps present under scripts are displayed here.

5. Run Initiated by: The name of the user <<name>> who has initiated the run is displayed.

6. Run Initiated On: This displays the actual triggered run time.

7. Execution start time: The exact start time of the script execution is displayed here.

For example:

When the run is triggered, the machine set by the user is available immediately after the execution starts. In this scenario, the “Run Initiated on” and “Execution start time” timings will be the same.
When the run is triggered and the machine set by the user is busy with another run, in this scenario “Run Initiated on” and “Execution start time” times will not be the same.

8. Status: Under the status column, depending upon the following scenarios the status column is updated.

Scenario 1:

If execution is completed and all the modules are “Passed”, then “Passed” is displayed under the Status column in “green” color for the respective execution id, and the “Passed” status is “clickable”. Upon clicking on the “Passed” status, you are navigated to the “result page”.

If the execution is completed and, if at least one module is “Failed”, then the “Failed” status is displayed under the Status column in “red” for the respective run id, and the “Failed” status is “clickable”. Upon clicking on the “Failed” status user is navigated to the “result page”.

Scenario 2: When the execution is still in progress, the “Running” status is displayed under the Status column in “blue” for the respective execution id, and the “Running” status is clickable. Upon clicking on the “running” status user is navigated to the “specific execution page” and the “Sync” API is called implicitly.

Scenario 3: When the execution is triggered and a particular run is waiting for the machine, the “pending” status is displayed under the Status column in “yellow” for the respective execution id, and the “pending” status is clickable. Upon clicking on “Pending” status, the user is navigated to the “specific execution page, and ”Sync API will be called implicitly.

Scenario 4: If “pending” execution is canceled by the user, then the “Canceled” status is displayed under the “status” column, and the “canceled” status is in a disabled form.

Scenario 5: When the user has terminated the execution while running, the “Terminated” status is displayed under the Status column, and the “Terminated” status will be “clickable”. Upon clicking on the “terminated” status user is navigated to the result on the page.

Scenario 6: When execution is triggered and aborted, upon clicking “Aborted” status user is navigated to the result on the page.

(screen)

Scenario 7: When execution is triggered and execution status is N/A because of the following reasons:

When you trigger only an empty step group under the script you will get the status N/A.
When you select only cascaded pre/post conditions from the Module level or root module level and trigger the execution then the status will be N/A.
When you trigger an empty script or empty module then the status will be N/A
N/A status is non-clickable.

9. Actions: When hovering the mouse on status, a different set of icons are displayed.

a. When hovering the mouse on a particular run, the description under status is “Passed”, the “Rerun” icon, “Edit” icon, and “delete icon” are displayed and all are enabled.

Icons:

1. Rerun icon:

When you click on the “Rerun” icon the entire execution will start again if the machine is available then the specific execution is moved to the top of the table as a new run.
When you click on the “Rerun” icon and if the machine is not available then the specific run will be updated as a “Pending” row below the runs whose respective status is “Running”.

2. Edit icon

When you click on the Edit icon the popup with “Edit execution name <<execution name>>” is prompted.

In the Edit execution name pop-up, you can Edit the execution name
After Editing the execution name, click on the update button and the execution name is updated and the popup is closed.

3. Delete icon:

When you click on the delete icon, the Warning pop-up will be displayed.

The Warning popup contains 3 options-

Delete all: By default, this option is selected and when you click on the “Delete” button, both screenshots and videos are deleted.
Delete only screenshots: When you select this option and click on the “Delete” button, only the screenshots are deleted.
Delete only videos: When you select this option and click on the “Delete” button, only the videos are deleted.

b. When the user hovers the mouse on a particular run, the description under status is “Failed”, “rerun” icon, “run only Failed”, “Edit” icon, and “delete icon” are present in the enabled form under the action column.

Icons:

1. Rerun icon:

When you click on the “Rerun” icon the entire execution will start again if the machine is available then the specific execution is moved to the top of the table as a new run.
When you click on the “Rerun” icon and if the machine is not available then the specific run will be updated as a “pending” row below the runs whose respective status is “running”.

2. Run only Failed:

When you click on the “run only Failed icon”, all the Failed scripts along with pre/post conditions and depend-on scripts are executed once again.

3. Edit icon:

When you click on the Edit icon the popup with “Edit execution name <<execution name>>” is prompted.

In the Edit execution name pop-up, you can Edit the execution name.
After Editing the execution name, click on the update button and the execution name is updated and the popup is closed.

4. Delete icon:

When you click on the delete icon, a Warning pop-up will be displayed.

The Warning popup contains 3 options-

Delete all: By default, this option is selected and when you click on the “Delete” button, both screenshots and videos are deleted.
Delete only screenshots: When you select this option and click on the “Delete” button, only the screenshots are deleted.
Delete only videos: When you select this option and click on the “Delete” button, only the videos are deleted.

c. When the user hovers the mouse on a particular run, the description under status is “running”; the “terminate” icon and “Edit icon” are present in the enabled form under the action column.

d. The Delete icon will be in the “Disabled” form under the action column.

Icons:

1. Edit icon: When you click on the Edit icon the popup with “Edit execution name <<execution name>>” is prompted.

In the Edit execution name pop-up Edit, the execution name.
After Editing the execution name, click on the update button and the execution name is updated and the popup is closed.

2. Terminate icon: When you click on the terminate icon the execution will get terminated.

e. When the user hovers the mouse on a particular run, the description under status is “pending”, “cancel” icon, and “Edit” icon” is present in enable form under the action column.

The Delete icon is in the disabled form under the action column.

Icons:

1. Edit icon: When you click on the Edit icon the popup with “Edit execution name <<execution name>>” is prompted.

In the Edit execution name pop-up, you can Edit the execution name.
After Editing the execution name, click on the update button and the execution name is updated and the popup is closed.

2. Cancel: When you click on the cancel icon the pending execution will get canceled.

f. When the user hovers the mouse on a particular run, the description under status is “terminated”; then the “run” icon, “Edit” icon, and “delete icon” are present in an enabled form under the action column.

Icons:

1. Rerun icon:

When you click on the “Rerun” icon the entire execution will start again if the machine is available then the specific execution is moved to the top of the table as a new run
When you click on the “rerun” icon and if the machine is not available then the specific run will be updated as a “pending” row below the runs whose respective status is “running”.

2. Edit icon: When you click on the Edit icon the popup with “Edit execution name <<execution name>>” is prompted.

In the Edit execution name pop-up, you can Edit the execution name.
After Editing the execution name, click on the update button and the execution name is updated and the popup is closed.

3. Delete icon: When you click on the delete icon, the “Warning” pop-up will be displayed.

The Warning popup contains 3 options-

Delete all: By default, this option is selected and when you click on the “Delete” button, both screenshots and videos are deleted.
Delete only screenshots: When you select this option and click on the “Delete” button, only the screenshots are deleted.
Delete only videos: When you select this option and click on the “Delete” button, only the videos are deleted.

g. When the user hovers the mouse on a particular run, the description under status is “canceled”; the “run” icon, “Edit” icon, and “delete icon” are present in an enabled form under the action column.

Icons:

1. Rerun icon:

When you click on the “Rerun” icon the entire execution will start again if the machine is available then the specific execution is moved to the top of the table as a new run.
When you click on the “Rerun” icon and if the machine is not available then the specific run will be updated as a “pending” row below the runs whose respective status is “running”.

2. Edit icon: When you click on the Edit icon the popup with “Edit execution name <<execution name>>” is prompted.

In the Edit execution name pop-up, you can Edit the execution name.
After Editing the execution name, click on the update button and the execution name is updated and the popup is closed.

3. Delete icon: When you click on the delete icon, the “Warning” pop-up will be displayed.

The Warning popup contains 3 options-

Delete all: By default, this option is selected and when you click on the “Delete” button, both screenshots and videos are deleted.
Delete only screenshots: When you select this option and click on the “Delete” button, only the screenshots are deleted.
Delete only videos: When you select this option and click on the “Delete” button, only the videos are deleted.

h. When the user hovers the mouse on a particular run, the description under status is “Aborted”; the “Rerun” icon, “Edit” icon, and “delete icon” are present in the enabled form under the action column.

Icons:

1. Rerun icon:

When you click on the “Rerun” icon the entire execution will start again if the machine is available then the specific execution is moved to the top of the table as a new run
When you click on the “rerun” icon and if the machine is not available then the specific run will be updated as a “pending” row below the runs whose respective status is “running”.

2. Edit icon: When you click on the Edit icon the popup with “Edit execution name <<execution name>>” is prompted.

In the Edit execution name pop-up, you can Edit the execution name.
After Editing the execution name, click on the update button and the execution name is updated and the popup is closed.

3. Delete icon: When you click on the delete icon, the “Warning” pop-up will be displayed.

The Warning popup contains 3 options-

Delete all: By default, this option is selected and when you click on the “Delete” button, both screenshots and videos are deleted.
Delete only screenshots: When you select this option and click on the “Delete” button, only the screenshots are deleted.
Delete only videos: When you select this option and click on the “Delete” button, only the videos are deleted.

Example 2: Examples for triggering multiple runs and navigating to the result page through Execution Dashboard are:

Select the checkbox beside Script<<name>> [example: username].
Next, click on the run button. The execution starts in the default machine set by the user.
The user is navigated to the Execution Dashboard.
Next, click on test development in the breadcrumb. The user is navigated to the script tab under test development. Click on the Quick run setting, by selecting another machine if needed, after selection, select a checkbox beside Script<<name>>[login].
Next, click on the run button. The execution starts in the default machine set by the user.
The user is navigated to the Execution Dashboard.
Now, if the user wants to see the result of the previous run[username] then you can click on the “Execution Dashboard” tab if the previous execution is completed, then click on status and you will be navigated to the result in the page.
When the previous run [Username] is still in “running” or in “pending” status, upon single click on <execution name> under the execution name column or upon clicking on “running” or “pending” status> under the status column of respective execution id, the user is navigated to specific execution page.
On a specific execution page, upon a single click on any status of any script, under the Status column, the user is navigated to the result page.
When the previous run[username] has completed the execution, upon clicking on “Passed”, “terminated” or “Failed” status under the Status column of the respective execution id, the user is navigated to the result page.

3rd way: In how many ways can the user navigate to the result page when you are triggering the execution from the steps tab:

User can be navigated to the script result tab in the following way:

1st way:

Upon a single click on the script’s name, under the module column in the test development main tree structure, the user is navigated to the stepped tab.

If the user is executing the script from the steps tab, after execution the status of the Script is displayed within a capsule beside the <<Script name>> present below the tabs section.

The status to be displayed in a capsule depends on the following scenarios:

During the execution of a script, if the user terminates the execution by clicking on the terminate button, the step which is executing will execute completely and the remaining steps of the script are Skipped and the status will be displayed as “Terminated” as shown in the screen below.

After the execution of the script, if at least one of the steps under the script got Failed then, the status will be displayed as “Failed” as shown on the screen below.

If one of the steps under the script is Failed and if the user has selected the “If Failed” checkpoint for that step as “Mark this step as Warning and continue script execution” after the execution “Warning” status is displayed.
The status is displayed as “Skipped” if complete script execution is Skipped.
After the execution of the script, if all the steps under the script are Passed, the status is displayed as “Passed” as shown in the below screen.

Note: The Hierarchy/Priority of the status is followed as,

Terminated.
Aborted
Failed.
Warning.
Skipped.
Passed.
N/A

Note: When you will get the status as N/A:

When you trigger only an empty step group under the script you will get the status N/A.
When you select only cascaded pre/post condition from the Module level or root module level and trigger the execution then the status will be N/A.
When you trigger an empty script or empty module then the status will be N/A.

Important Note: You cannot be navigated to the result page upon clicking on the N/A status

Upon clicking on any capsule beside <<script name>>, the user will be navigated to the result tab.

How will the count be displayed beside the steps?

1. In the “Steps” tab, under the “Description” column if it contains “steps”, besides steps you have the count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green”, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red”, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “yellow” and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “grey ” and “down arrow” will be in disabled form.

2. On the “Steps” tab, then under the “Description” column, you have “Depends On Scripts” and beside Depends On Scripts, the count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green”, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red”, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” will be displayed.

3. On the “Steps” page, the under “Description” column you have “Pre-condition” and beside the pre-condition, the count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green”, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red”, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” will be displayed.

4. Under the “Description” column, you have “Post-condition”, and beside the postcondition, the count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red”, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” is displayed.

Upon clicking on any one of the step statuses, the Step Result pop-up of that particular step is prompted. The step Result pop-up is explained in detail below.

Scenario 1: The user can run the entire Script in three ways: –

a. When the user hovers the mouse over steps, the Run icon is displayed under actions. Upon clicking on the Run icon, the user can run the script.

b. Users can manually select the checkbox that is present on the left side of the Description. Upon selecting the checkbox of the description, the checkbox that is present towards the left side of the Steps text will be selected and can click on the Run icon.

c. Upon hovering the mouse on the Steps text row the checkbox of the Steps text is displayed and when the user selects the checkbox, the checkbox that is present towards the left side of all the steps is displayed and selected, and then the user can click on the Run icon.

Upon clicking on the Run icon the entire script starts to execute in the default machine that is set. During the execution, if the user clicks on the “Sync Results” icon if the execution of certain steps is completed, the Result for those steps is updated and for the remaining steps “in progress” status is updated.

Note: After the execution of the complete script the Result column and status column are refreshed and they will be updated with the result for each of the steps.

d. Without selecting any steps click on the “Run icon”, and the complete script execution will start.

2nd way:

1. After triggering the execution from the steps tab, each execution will be stored in Execution Dashboard, after triggering the execution from the steps tab, you can see the “banner message” Such as “Execution has been triggered please check the Execution Dashboard for more info”, you can navigate to Execution Dashboard by clicking on “test development icon at left navigating panel and click on Execution Dashboard beside script tab.

2. In the Execution Dashboard, you can see the triggered execution from the steps tab, if the execution is completed click on the status of the respective execution, and you will be navigated to the root module result page, click on the script name, you will navigate to “script result page”.

Note1: If you are navigating to the result in page from Execution Dashboard you will be navigated to root module result page, from root module result page click on the module name to be navigated to the specific module result page or click on the script name to be navigated to script result page.

Note 2: If you get navigated to the result page from the steps tab then you will reach directly to the script result tab.

Result page

The result page is explained in detail above.

Example 3:

When the user clicks on script<<name>> from the Test development main tree structure, the user is navigated to the stepped tab.
Select the checkbox beside the description and click on the run button.
After complete execution, the user can click on the result tab or click on the “capsule status” beside the Script name or click on the count of “N(Passed)/N(total)” with the respective result as “Passed” in “green”, click on the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” or click on the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” or click on the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” beside “Steps” title or beside “Depend on script”, besides “pre-condition”, besides “post-condition” or click on any status under the status column
The user is navigated to the result tab.

In How many ways the “Step Result” popup will be displayed?

1. When you are under the stepped tab, after the execution, upon clicking on status under the Status column as shown in the below screen.

concerning step, the “Step Result” popup is prompted.

2. When the user is under the result tab, upon clicking on any step under the results column or upon clicking on the status of any step under the status column “step Result” pop-up is prompted.

3. For every step group that is added as post-conditions to the script, upon a single click on any step under the step group, a step result popup is prompted.

4. For every step group that is added as post-conditions to the script, upon a single click on each step under the step group, the “Step Result” popup is prompted.

What are the bases on which step result is being generated?

Step Result popup is generated based on the status of each step as discussed below.

When you click on the status of the step which is Passed, the popup with the popup header “step result” is prompted as shown in the below screen.

The popup mainly contains 2 sections such as :

1st section: 1st section contains 3 column attributes

The 1st column contains,

1. Description: The step description along with “page name” is displayed.

Ex: If the User clicks on the login button, it will be displayed as “Click on the login button on the login page”.

2. Screenshot:

Attribute value as “Download screenshot” text is displayed with the “Download” icon.
On hovering the mouse on the Download icon, a tooltip is displayed as “Download”.
Click on the download icon to download the screenshot.

The 2nd column contains-

1. Result: The result of the respective step present under the stepped tab is displayed here and “page name” will be appended at the end.

Ex: If the result is, click on the login button, it will be displayed as “Clicked on the login button in login page”.

2. Video:

Attribute value as “Download video” text will be displayed with the “Download” icon.
On hovering the mouse on the Download icon, a tooltip is displayed as “Download”.
Click on the download icon to download the video.

The 3rd column contains-

1. Return: If the step returns any value, the value will be displayed under the “return” attribute. If the step is not returning any value, then no text is displayed.

2nd section: In the second section there are 3 tabs

Elements tab

1. If the element is successfully identified or found on the specific page a text is displayed in “green” color stating “<<Element name>> in <<page name>> page found” as shown on the below screen.

Columns under the elements tab:

SL. No: The serial number is displayed.
Locator Type: Locator type such as “CSS selector”, “name”, “tag name” or “Xpath” etc. is displayed.
State: Depending on the state, whether the locator is Static or Dynamic is displayed for the respective locator.
Locator Value: The value of the locator is displayed.

NOTE: If the locator used is a Dynamic locator, then the locator value is displayed in the below-mentioned format.

<<Locator Value>>
<<locator variable which will be passed as dynamic variable>>
<<locator value in place of locator variable is displayed>>

Identifier: If the element is identified manually, “manual” text is displayed. If the element is recorded, using the “fireflink” finder, “recorded” text will be displayed.
Status: if the identification of an element got Failed, the column will be displayed with an “X” icon.
Hovering a mouse over the “X” icon, a tooltip with the message “Not Found” is displayed.
If the element is successfully identified using the locator, then it displays the “Right mark” (refer to the design). Upon hovering a mouse, a tooltip “Found” will be displayed.
If the step is Skipped, then under this column the “null” icon is displayed for all locators. Upon hovering a mouse, the “Skipped” tooltip will be displayed.

Variable: Columns under variable as shown on the below screen.

1. Sl. No: The serial number is displayed.

2. Name: Variable name used in the script is displayed.

3. Type: The type of variable, that is, “global variable”, “local variable”, “project environment variable” or “data provider” is displayed

4. Value: The value that is assigned to a variable is displayed.

Logs:

If you click on the Passed step, then the logs tab will not be present under the step result popup.

Upon clicking on the step that is Failed, the popup with the popup header “step result” is prompted as shown on the screen below.

This popup contains mainly 2 sections:

1st section: In the 1st section you have the following attributes in the 3 columns

In 1st column contains,

1. Description: The step description along with “page name” is displayed.

Ex: If the description is “Click on login button” then it is displayed as “Click on the login button on login page”

2. Return: If the step returns any value, that value is displayed under this attribute. If it is not returning any value, then no text is displayed.

3. Video:

Attribute value as “Download video” text is displayed with the “Download” icon.
On hovering the mouse on the Download icon, a tooltip is displayed as “Download”.
Click on the download icon to download the video.

In 2nd column contains

Result: The result of the respective step present under the stepped tab is displayed here and “page name” will be appended at the end.
Example: If the result is Clicked on the login button, it is displayed as “Clicked on the login button on login page”.
If Failed: Selected if Failed option while creating the step is displayed here.

In 3rd column contains

1. Error: An error message is displayed.

Ex: Search with all elements but login button not found

2. Screenshot:

Attribute value as “Download screenshot” text is displayed with the “Download” icon.
Hovering the mouse on the Download icon, the “Download” tooltip will be displayed.
Click on the download icon to download the screenshot.

2nd section contains 3 tabs:

Elements: Assume that you have to search for Two elements, out of which, one element is found and the other element couldn’t be found, the elements will display a capsule with “1/2” in “red” beside the elements.

Elements tab

If the element is successfully identified or found on the specific page, a text will be displayed in “green” color as “<<Element name>> in <<page name>> page found” as shown in the screen below.

Screenshot:

Columns under the element tab:

1. SL. No: Serial numbers are displayed

2. Locator Type: Locator types such as “CSS selector”, “name”, “tag name” or “Xpath” etc. will be displayed.

3. State: Depending on the state, whether the locator is Static or Dynamic is displayed for the respective locator.

4. Locator Value: The value used is displayed.

NOTE: If the locator used is a Dynamic locator, the locator value is displayed in the below-mentioned format.

<<Locator Value>>
<<locator variable which was Passed as dynamic variable>>
<<locator value in place of locator variable will be displayed>

5. Identifier: If the element is identified manually then the manual text is displayed. If the element is recorded using the “fireflink” finder, then the “recorded” text is displayed.

6. Status:

When the identification of the element is Failed by using the locator, the status column displays an icon “X”

7. hovering the mouse over the icon “X”, a tooltip “Not Found” is displayed.

8. If the element is successfully identified using the locator, then it displays the “Right mark” (refer to the design) icon. Hover a mouse on the right mark icon, and a tooltip “Found” is displayed.

9. If the step is Skipped, then under the status column, the “null” icon is displayed for all locators. Hover a mouse, and a tooltip “Skipped” is displayed.

Variable: columns under variable as shown in the screen below.

1. SL.No: The serial number is displayed.

2. Name: Variable name used in the script is displayed.

3. Type: The type of variable that is “global variable”, “local variable”, “project environment variable” or “data provider is displayed.

4. Value: The value that is assigned to a variable is displayed.

Logs tab:

1. If you have clicked on the Failed step, the logs tab is present with 2 rows as shown on the below screen.

1. In the 1st row

Message: Here the type of exception that occurred is displayed.
Suggestion: This attribute displays four suggestions. The suggestions are the steps regarding how to avoid the exceptions.

2. In the 2nd row

Exception: This displays the exception that occurred. Here you can see only 997 characters and 3 dots.

Note 1: Skipped step status will be non-clickable.

Data provider Results:

How the results of the data provider will look when you trigger the execution from the steps tab?

Let’s assume that you have created a data provider with data provider type as excluding pre-post condition which is added in steps, now click on the run icon, and wait till the complete execution. After execution is completed, click on the sync icon present beside the “clear result” icon, the latest result and status will be updated, and the “Passed”, “Failed”, “Warning” and “Skipped” count be displayed beside the start iteration and last iteration results and status will be updated under result and status column under steps tabs.

Click on capsule status beside the script name, and you will navigate to the script result page.

On the script result page

The info and graph section is explained above,
Under the result column, The count of “Passed” steps is “N(total Passed count of steps from all the iterations)/N(total count of steps from all the iterations)” with the individual result as “Passed” in “green”, the count of “Failed” steps “N(total count of failed steps from all the iteration)/N(total count of steps from all the iteration)” with the individual result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of steps from all the iteration)/N(total count of steps from all the iteration)” with the individual result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of steps from all the iteration)/N(total count of steps from all the iteration)” with the individual result as “Warning” in “yellow” is displayed beside steps text and info icon is displayed beside count. Hover the mouse on the info icon, a tooltip is displayed as “Aggregated count of steps from all iteration is <<total count of steps from all the iteration>>, Go to result to view all the iterations”.
Click on expand icon present beside the start iteration using the data provider, all the iterations will be displayed.
The count of “passed” iteration “N(total Passed count of iteration)/N(total count of iteration under start iteration)” with the individual result as “Passed” in “green”, the count of “Failed” steps “N(total count of failed iteration)/N(total count of iteration under start iteration)” with the individual result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of iteration)/N(total count of iteration under start iteration)” with the individual result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of iteration)/N(total count of iteration under start iteration)” with the individual result as “Warning” in “yellow” is displayed beside each iteration and beside the count “Data set” capsule is displayed, click on Data set capsule, “View Data set” table is displayed and table consists of step, name and value.

1. Step: You can get to know the step number where the data provider variable is used.

2. Name: You can get to know the data provider variable name used.

3. Value: You can get to know the data provider value used.

Click on expand icon beside iteration, and steps under iteration will be displayed
The status and execution duration column is the same as explained above

How the results of the nested data provider will look when you trigger the execution from the steps tab?

Let’s assume that you have created a nested data provider with data provider type exclude pre-post condition which is added in steps, now click on the run icon and wait till the execution is complete. After the execution is completed, click on the sync icon present beside the “clear result” icon, the latest result and status will be updated, and the “Passed”, “Failed”, “Warning” and “Skipped” counts are displayed beside the start iteration and last iteration results and status will be updated under result and status column under steps tabs.

Click on capsule status beside the script name, and you will navigate to the script result page

On the script result page

The info and graph section is explained above,
Under the result column, The count of “Passed” steps is “N(total Passed count of steps from all the iterations)/N(total count of steps from all the iterations)” with the respective result as “Passed” in “green”, the count of “Failed” steps “N(totally failed count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Warning” in “yellow” is displayed beside steps text and info icon is displayed beside count. Hovering the mouse on the info icon a tooltip is displayed as “Aggregated count of steps from all iteration is <<total count of steps from all the iteration>>, Go to result to view all the iterations”.
Click on expand icon present beside the start iteration using the data provider, and all the iterations will be displayed.
Click on expand icon beside the iteration the inner start iteration will be displayed.
The count of “passed” iteration “N(total Passed count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Passed” in “green”, the count of “Failed” steps “N(total count of failed iteration)/N(total count of iteration under start iteration)” with the respective result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Warning” in “yellow” is displayed beside each iteration and beside the count “info icon” is displayed, you can mouse hover on info icon and tooltip is displayed as “Aggregated count of steps from all iteration is << total count of iteration under start iteration>>, in which Step No. – <<step number>> is not part of any iteration” and beside the info icon “Data set” capsule is displayed. Click on the Data set capsule, “View Data set” table is displayed table consisting of steps, names, and values.

1. Step: You can get to know the step number where the data provider variable is used.

2. Name: You can get to know the data provider variable name used.

3. Value: You can get to know the data provider value used.

Click on expand icon beside iteration, and steps under iteration will be displayed
The status and execution duration column is the same as explained above

Module result:

Under the module, you have a script. The result of those scripts are present under the module result and complete information about the info panel, with graphical information of Passed scripts, Failed scripts, warning scripts, Skipped scripts, and complete scripts under modules and the result concerning the script is present under respective columns.

In how many ways a user can run the modules

Users can run the module in the following ways:

If you are under the Test development main tree structure, select the checkbox beside the “expand all” icon under the module column. All the modules, pre/post conditions, and scripts concerning the root module will be selected and displayed in expanded form. Click on the run button.
If you are under the Test development main tree structure, you can select the checkbox beside module<<name>> under the module column, and click on the run button.
If you are under the Test development main tree structure, click on any module<<name>> user will navigate to the module tab, where only a specific family concerning that module will be displayed, select a module and click on the run button.
Navigate to Module Result.

1. If the user is executing the module from the Test development main tree structure, after selecting a module, when clicking on the run button, the executions start with the default machine set by the user, the user is navigated to Execution Dashboard, and after complete execution, the status will be updated under the Status column, click on completed status you will be navigated to result in the page.

Example 1:

Select the checkbox beside the login module.
Next click on the run button.
The user is navigated to Execution Dashboard, if the triggered execution is completed then click on completed status under status.
The user is navigated to the result page.

Specific execution page:

The specific execution page is explained in detail.

Note: The user is navigated to a specific execution page in two ways.

When the user clicks on a specific run id for the first time, the user is navigated to a specific execution page but in the Specific Execution Page, initially, the status column is empty.
When the user clicks on the specific status description in Execution Dashboard, the user is navigated to a specific execution page and sync API is called implicitly and execution completed results will be updated in the Status column.

Execution Dashboard

The Execution Dashboard is explained below.

Result page:

On the result page there are four main sections:

1st section:

1. The First row contains,

Execution ID: The execution id of the execution script is displayed.
Status: Status such as “Passed”, “Failed”, “Skipped”, “terminated” and “Warning” is displayed.
Module Name: <<Module name>> is displayed.
Machine: <<machine name>> is displayed.
Execution Environment: <<execution environment name>> is displayed

E.g.: “local”

2. The Second row contains,

OS: The name of the OS used is displayed
- Examples: windows 7, windows 8, windows 10, etc.
- Upon clicking on the OS, the more detail tab is highlighted.
Browser: The name of the browser used for execution is displayed.
- Example: Chrome, Firefox, etc.
- When the selected project is web or web and mobiles, then the browser attribute is present.
- Upon clicking on the browser, the more details tab is highlighted.
Device:
- The name of the device used is displayed.
- Examples: galaxy, Samsung, etc.
- When the selected project is mobile or web and mobiles, then the device attribute is present.
- Upon clicking on the device, the more details tab is highlighted.
Duration: The time duration for execution is displayed.
Executed On: Execution start date and time are displayed.

2nd section:

There are graphs for the following attributes-

Modules (Total number of modules present under root module)
Scripts (Total number of Scripts present under each module)
Pre-Condition (Total number of Step groups added as pre-conditions to this module and script.
Post-Condition (Total number of Step groups added as postconditions to this module and script)

Note: Hovering the mouse on the Steps graph, a tooltip will be displayed with the following details-

In the First row

It displays a text as Passed: <<The total number of Passed modules>.
It displays a text as Failed: <<The total number of Failed modules>>.

In the Second row

It displays a text as Warning: << The total number of modules whose status is Warning >>.
It displays a text as Skipped: <<The total number of Skipped modules>>.

Similarly, when the user hovers the mouse on the graph of other attributes, a tooltip is displayed with respective details.

3rd section:

More details: There is a section with the header “more details” on the right side.

columns under more details:

1. Browser/Device:

When the selected project type is the web, the browser column name is displayed.
When the selected project type is Mobile, the Device column name is displayed.
When the selected project type is “web and mobile”, the “device/browser” column name is displayed.
The used browser or device is displayed.

2. Total script: Total number of scripts used under the root module is displayed.

3. Total Passed: A total number of scripts Passed is displayed.

4. Total Failed: Total number of scripts that Failed is displayed.

5. Total Warning: Total number of scripts under Warning is displayed.

6. Total Skipped: Total number of Skipped scripts is displayed.

7. Duration: The total time taken to execute the modules is displayed.

8. Executed On: The time taken for executing that respective result is displayed.

4th section:

Columns under “<<root module>>or <<module name>> or <<script name>>”

Icons:

Expand all:-

Initially Expand all icon is in an inactive state.
When you click on Expand all icon, all the Modules and Submodules will be expanded.

Collapse all:-

Initially Collapse all icon is in an active state.
When you click on the Collapse all icon, all the Modules and Submodules will be Collapse state.

Expand all scripts:-

Initially Expand all scripts are in an active state, and all the scripts under modules and sub-modules will be displayed.

Collapse all scripts:-

When you click on Collapse all script icons the script under modules and sub-modules will be hidden.

Show Pre/Post Conditions

When you click on this icon, all the Pre-Post conditions are expanded.

Hide Pre/Post Conditions:-

When you click on this icon, all the Pre-Post conditions are collapsed.

Expand-

When you click on expand icon, the content is displayed in expanded form.

Collapse:-

When you click on the collapse icon, the content is hidden.

Module:

This column displays the result of the selected module.

“Expand all”, “show all scripts”, “show pre-post condition”, “Root” title with a capsule “M<<number of modules present under root module>>”, “S<<number of scripts present under root module>>” is displayed as the first description.
The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green”, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red”, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” is displayed beside “Pre-condition” title under module column.
The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green”, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red”, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” is displayed beside “Post-condition” under module column.
The module name with a capsule “S<<number of scripts present under respective module>>” is displayed.
Upon clicking on expand icon which is present beside Module, Scripts and Submodules will expand. Upon clicking on the collapse icon, which is present beside the parent level module, the parent module is displayed in collapsed format.
Upon clicking on any expand icon, which is present beside the step group, all steps under the step group are displayed. Upon clicking on the collapse icon, which is present next to the step group, the step group is displayed in collapsed format.

Type: “Type” column is empty for pre and post-conditions concerning the “root and parent” module and it will be present for individual step groups and individual scripts.

Step: “step” column description is present only if the “type” column is specified and it will be “N/A” if the “type” column is not specified.

Upon mouse hovering on the “step” column description concerning pre-condition, a tooltip appears as “Pre-condition step count is shown in individual step group”.
Upon mouse hovering on the “step” column description concerning the module, a tooltip appears as “Module-level steps count is shown in individual script”.
Upon mouse hovering on the “step” column description of the respective post-condition, a tooltip appears as “Post-condition step count is shown in individual step group”.
Under Pre-condition, if Step-Group-cascaded is present then the “status” column for the respective Step-group-cascaded will be “N/A”. Upon hovering the mouse on a tooltip, it appears as “Results of cascaded Pre-conditions are visible at each script level”.

Passed: Total Passed steps are displayed.

Failed: Total Failed steps are displayed.

Warning: Total Warning steps are displayed.

Skipped: Total Skipped steps are displayed.

Status with filter icon: Status such as “Passed” in “green” color, “Failed” in “red” color, “Warning” in “yellow” color, and “Skipped” in “grey” color are displayed under the status column.

Upon clicking on the Filter icon beside status, a context menu is displayed with “All” text in “blue”, “Passed” text in “green”, “Failed” text in “red” and “Warning” text in “yellow”.
If the user selects “All” status from the drop-down, the steps that are “Passed”, “Failed”, “Warning”, and “Skipped” are displayed under the module column with a respective result under the status column.

a. Passed: When the user selects “Passed” which is in “green” from the context menu, all the Passed steps are displayed under the result column with the respective result displayed under the Status column.

b. Failed: When the user selects “Failed” which is in “red” from the context menu, all the Failed steps are displayed under the result column with the respective result displayed under the Status column.

c. Warning: When the user selects “Warning” which is in “golden” from the context menu, all the Warning steps are displayed under the result column with the respective results displayed under the Status column.

d. Skipped: When the user selects “Skipped” which is in “grey” from the context menu, all the Skipped steps are displayed under the result column with the respective result displayed under the Status column.

Start time: The start time of the execution is displayed here.

Execution duration: Time taken for complete execution is displayed.

Example 2: Example for triggering multiple runs and navigating to result in page through Execution Dashboard.

1. Select the checkbox of highlighted one as shown on the screen.

screenshot

2. Next, click on the run button, and execution starts in the default machine set by the user.

3. User is navigated to Execution Dashboard.

4. Next, click on test development in the breadcrumb. The user is navigated to the script tab under test development and clicks on the Quick run setting to select another machine if needed. After selecting, select a module.

5. Next, click on the run button, execution starts in the default machine set by the user.

6. User is navigated to Execution Dashboard.

7. Now, if the user wants to see the result of the previous run then the user can see the execution name in the “Execution Dashboard”, if the previous execution is completed then the status will be updated accordingly [Passed, Failed, Warning, terminated]

8. Click on the completed status you will be navigated to the root module result page or in Execution Dashboard click on the execution name you will be navigated to a specific execution page. On a specific execution page, click on “status” under the status column concerning the module then you will be navigated to the result page

9. When the previous run [Username] is still in “running” or “pending” status, upon single click on <execution name> under the execution name column or upon clicking on < “running” or “pending” status> under the status column of respective execution id, the user is navigated to specific execution page.

10. On a specific execution page, after completion of execution click on the sync icon the result will be updated under the status column, upon a single click on any status of any module, under the Status column, the user is navigated to the result page.

11. When the previous run[username] has completed the execution, upon clicking on <execution name> under the execution name column or upon clicking on < “Passed”, “terminated” or “Failed” status> under the status column of the respective execution id, the user is navigated to result in the page.

Note: If the user clicks on any specific module or the status of that module under the result page, the user is navigated to the result page of the respective module. The “expand all” icon, “show all scripts” icon, and “show pre/post condition” icon will retain their previous state and the result of a specific family is displayed in the result page, info panel, and the graph section is displayed according to the result of that specific family.

The info and graph content is the same on the Module result page as explained above.

Data provider Results:

How the results of the data provider will look when you trigger the execution from the test development main tree?

Let’s assume that you have created a data provider with data provider type as excluding pre-post condition which is added in steps, now select the script and click on the run icon, you will be navigated to the execution dashboard. After execution click on the sync icon, the status will be updated and now click on status you will be navigated to the Root module result page. In the root module result or from the module result page, click on <<script name>> you will be navigated to the script result page.

In the script result page

The info and graph section is explained above,
Under result column, The count of “Passed” steps “N(total Passed count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Passed” in “green”, the count of “Failed” steps “N(total failed count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Warning” in “yellow” is displayed beside steps text and info icon is displayed beside count, hover the mouse on info icon a tooltip is displayed as “Aggregated count of steps from all iteration is <<total count of steps from all the iteration>>, Go to result to view all the iterations”.
Click on expand icon present beside the start iteration using the data provider, and all the iterations will be displayed
The count of “passed” iteration “N(total Passed count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Passed” in “green”, the count of “Failed” steps “N( total failed count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Warning” in “yellow” is displayed beside each iteration and beside the count “Data set” capsule is displayed. Click on the Data set capsule, “View Data set” table is displayed the table consists of step, name, and value.

1. Step: You can get to know the step number where the data provider variable is used.

2. Name: You can get to know the data provider variable name used.

3. Value: You can get to know the data provider value used.

Click on expand icon beside iteration, and steps under iteration will be displayed.
The status and execution duration column is the same as explained above.

How the results of the nested data provider will look when you trigger the execution from the steps tab?

Let’s assume that you have created a data provider with data provider type as excluding pre-post condition which is added in steps, now select the script and click on the run icon, and you will be navigated to the execution dashboard. After execution click on the sync icon, and the status will be updated, click on status you will navigate to the Root module result page. In the root module result or from the module result page, click on <<script name>> and you will navigate to the script result page.

In the script result page

The info and graph section is explained above,
Under the result column, The count of “Passed” steps “N(total Passed count of steps from all the iterations)/N(total count of steps from all the iterations)” with the respective result as “Passed” in “green”, the count of “Failed” steps “N(total failed count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of steps from all the iteration)/N(total count of steps from all the iteration)” with the respective result as “Warning” in “yellow” is displayed beside steps text and info icon is displayed beside count, hover the mouse on info icon, a tooltip is displayed as “Aggregated count of steps from all iteration is <<total count of steps from all the iteration>>, Go to result to view all the iterations”.
Click on expand icon present beside the start iteration using the data provider, all the iterations will be displayed
Click on expand icon beside iteration the inner start iteration will be displayed
The count of “passed” iteration “N(total Passed count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Passed” in “green”, the count of “Failed” steps “N(total failed count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Failed” in “red”, the count of “Skipped” steps “N(total skipped count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Skipped” in “grey” and the count of “Warning” steps “N(total warning count of iteration)/N(total count of iteration under start iteration)” with the respective result as “Warning” in “yellow” is displayed beside each iteration and beside the count “info icon” is displayed, you can mouse hover on info icon a tooltip is displayed as “Aggregated count of steps from all iteration is << total count of iteration under start iteration>>, in which Step No. – <<step number>> are not part of any iteration” and beside the info icon “Data set” capsule is displayed, click on Data set capsule, “View Data set” table is displayed and table consist of step, name and value.

1. Step: You can get to know the step number where the data provider variable is used.

2. Name: You can get to know the data provider variable name used.

3. Value: You can get to know the data provider value used.

You can get to know the data provider value used.
Click on expand icon beside iteration, and steps under iteration will be displayed
The status and execution duration column is the same as explained above

Based on how the step result popup will be generated?

Note:

For every step group that is added as pre/post conditions to the script, and after the execution in the result section, you have to expand/collapse the icon next to each step group.
Upon clicking on expand/collapse icon, the steps of the step groups are displayed with the respective result.

a single click on each step, the “Step Result” popup is displayed

Step Result popup is generated based on the status of each step as discussed below.

On the result page, click on the step, which is Passed, and the popup with the popup header “step result” is prompted.

The popup mainly contains Two sections such as:

1st section: 1st section contains 3 column attributes:

In 1st column contains the: –

1. Description: The step description along with “page name” is displayed.

Ex: If the description is Click on the login button, then it is displayed as “Click on the login button on the login page”.

2. Screenshot:

Attribute value as “Download screenshot” text is displayed with the “Download” icon.
On hovering the mouse on the Download icon, a tooltip is displayed as “Download”.
Click on the download icon to download the screenshot.

In 2nd column contains:

1. Result: The result of the respective step present under the stepped tab is displayed here and “page name” will be appended at the end.

Ex: If the result is Click on the login button then is displayed as Clicked on the login button on the login page.

2. Video:

Attribute value as “Download video” text is displayed with the “Download” icon.
On hovering the mouse on the Download icon, a tooltip is displayed as “Download”.
Click on the download icon to download the video.

In 3rd column contains: –

Return: If the step is returning any value, that value is displayed under the return attribute. If it is not returning any value, then the “none” text is displayed.

2nd section: The second section contains three tabs

Elements tab

If the element is successfully identified or found on the specific page, a text is displayed in “green” as “<<Element name>> in <<page name>> page found”.

Columns under the elements tab:

1. SL. No: The serial number is displayed.

2. Locator Type: Locator type such as “CSS selector” “name” “tag name” or “Xpath” etc. is displayed.

3. State: Depending on the state, whether the locator is Static or Dynamic, is displayed for the respective locator.

4. Locator Value: The value used is displayed.

NOTE: If the locator used is a Dynamic locator, the locator value is displayed in the below-mentioned format.

<<Locator Value>>

<<locator variable which was Passed as dynamic variable>>

<<locator value in place of locator variable is displayed>

5. Identifier: If the element is identified manually, the manual text is displayed. If the element is recorded using the plugin, then the “recorded” text is displayed.

6. Status: When the element identification is Failed using the locator, this column displays an icon as “X”. Upon hovering a mouse on the “X” icon, a tooltip with the message “Not Found” is displayed.

If the element is successfully identified using the locator, then it displays the “Right mark”. Upon hovering a mouse, a tooltip “Found” is displayed.
If the step is Skipped, then under this column the “null” icon is displayed for all locators. Upon hovering a mouse, a tooltip as “Skipped” is displayed

Variable: columns under variable:

Sl. No: The serial number is displayed.
Name: Variable name used in the script is displayed.
Type: The type of variable, “global variable”, “local variable”, “project environment variable” or “data provider is displayed.
Value: The value that is assigned to a variable is displayed.

Logs:

If a user clicks on the Passed step, the logs tab will not be present under the step result popup.

On the result page, upon clicking on a step that is Failed the popup with the popup header “step result” is prompted.

This popup contains two main sections:

1st section: The first section consists of the following attributes in the 3 columns-

In 1st column contains:

Description: The description of the step along with “page name” is displayed.

Ex: If the description is ‘Click on the login button then it is displayed as “Click on the login button on login page”.

Return: If the step returns any value, that value is displayed under this attribute. If it is not returning any value, then no text is displayed.
Video:
- Attribute value as “Download video” text is displayed with the “Download” icon.
- On hovering the mouse on the Download icon, a tooltip is displayed as “Download”.
- Click on the download icon to download the video.

In 2nd column contains:

1. Result: The result of the respective step present under the stepped tab is displayed here and “page name” will be appended at the end.

Ex: If the result is Clicked on the login button, then it is displayed as Clicked on the login button on the login page.

2. If Failed: Selected if Failed option while creating the step is displayed here.

In 3rd column contains:

1. Error: An error message is displayed.

Ex: Searched with all elements but login button not found

2. Screenshot:

Attribute value as “Download screenshot” text is displayed with the “Download” icon.
On hovering the mouse on the Download icon, a tooltip is displayed as “Download”.
Click on the download icon to download the screenshot.

2nd section contains 3 tabs:

Elements: Assume that you have two elements to be searched, out of which one element is found and another element couldn’t be found. It will display a capsule with “1/2” in “red” beside the elements.

Elements tab

If the element is successfully identified or found on the specific page, a text is displayed in “green” as “<<Element name>> in <<page name>> page found”.

Columns under elements tab:

1. SL. No: The serial no. is displayed.

2. Locator Type: Locator type such as “CSS selector”, “name”, “tag name” or “Xpath” etc. is displayed.

3. State: Depending on the state, whether the locator is Static or Dynamic is displayed for the respective locator.

4. Locator Value: The value used is displayed.

NOTE: If the locator used is a Dynamic locator, then the locator value is displayed in the below-mentioned format.

<<Locator Value>>

<<locator variable which is Passed as dynamic variable>>

<<locator value in place of locator variable is displayed>

5. Identifier: If the element is identified manually, then the manual text will be displayed. If the element is recorded using the plugin, then the “recorded” text is displayed.

If the element is successfully identified using the locator, then it displays the “Right mark”. Upon hovering a mouse, a tooltip “Found” is displayed.
If the step is Skipped, then under this column the “null” icon is displayed for all locators. Upon hovering a mouse, a tooltip as “Skipped” is displayed.

Columns under elements tab:

If the element is not found on the specific page, a text is displayed in “red” color as “<<Element name>> in <<page name>> not found”.

SL No: The serial number is displayed.
Locator Type: Locator type such as “CSS selector”, “name”, “tag name” or “Xpath” etc. is displayed.
State: Depending on the state, whether the locator is Static or Dynamic is displayed for the respective locator.
Locator Value: The value used is displayed.

NOTE: If the locator used is a Dynamic locator, then the locator value is displayed in the below-mentioned format

<<Locator Value>>

<<locator variable which was Passed as dynamic variable>>

<<locator value in place of locator variable is displayed>>

Identifier: If the element is identified manually then the manual text is displayed. If the element is recorded using the plugin, then the “recorded” text is displayed.
Status: When the element identification is Failed using the locator, this column displays an icon as “X”. Upon hovering a mouse on the “X” icon, a tooltip with the message “Not Found” is displayed.

Variable: columns under variable:

SL. No: The serial number is displayed.
Name: Variable name used in the script is displayed.
Type: The type of variable is “global variable”, “local variable”, “project environment variable” or “data provider is displayed.
Value: The value that is assigned to the variable is displayed.

Logs tab:

1. If a user has clicked on the Failed step, the logs tab will be present with 2 rows:

In 1st row

Message: Here, the type of exception that occurred is displayed.
Suggestion: This attribute displays four suggestions. The suggestions are the steps regarding how to avoid the exceptions.

In 2nd row

Exception: This displays the exception that occurred. Here you can see only 997 characters with 3 dots.

Note1: Skipped step is not clickable, and if the whole script is Skipped, in the result page, the Skipped script is not clickable

Important note: From Execution Dashboard, if we are navigating to the result page, initially you will navigate to the module result page, upon a single click on <<module name>> to be navigated to “module-specific result page” or a single click on <<script name>> to be navigated to script result page.

Test Execution Results:

Execution Dashboard

All the execution which is triggered by the user concerning a particular suite will be stored under Execution Dashboard and through the Execution Dashboard user can navigate to the result page.

How to Navigate to suite Execution Dashboard?

Click on the Run icon of a particular suite in the Suites table to navigate to the Execution Dashboard, and also by clicking the on-suite name present in the name column.

Columns under Execution Dashboard Table

Execution Id:

Under this column, the Execution Id is displayed for the particular suite. Upon clicking on any execution Id, it will navigate to the Suite details page.

Parent Id:

Under this column execution Id is displayed for a suite of suites whenever we Rerun the suite of the suite and whenever the scheduled suite of suite got triggered execution

Machines:

Under this column machines for the particular Suite are displayed. Upon clicking on the machine name, it will navigate to the machine details popup.

Execution Type:

Under this column, the Execution type for the particular suite is displayed.

Run Initiated By:

Under this column, the run initiated by the user name is displayed. In this column, the run initiated implies the user name who initiated the run the last time. Upon clicking on the user name, it will navigate to the user details popup.

Run Initiated On:

Under this column, Run Initiated On details is displayed. In this column run, initiated-on means, and the last time run-initiated details are displayed.

Execution Start Time:

Under this column, Execution Start Time details are displayed. In this column execution, start time means after the run is initiated, when execution starts in the assigned machine. that date and time will be considered as the execution start time.

Status:

Under this column, the execution Status of the particular execution id is displayed. Users can filter the status by applying the filter. Upon clicking on status, the user will navigate to the result page.

Note: The user will not navigate to the result page by clicking on “Pending” and “Cancelled” status execution IDs.

Actions:

Under this column, on hovering the mouse, icons are displayed based on execution id status.

“Terminate”, “Edit” and “Delete” (in disabled state) icons are displayed by hovering the mouse on the execution id row present in the “Running” status.
“Run” “Delete” and “Edit” icons are displayed by hovering the mouse on the execution id row present in the status of “Passed”, “Terminated”, “Cancelled”, “Aborted” and “N/A”.
“Cancel”, “Edit” and “Delete” (in disabled state) icons are displayed by hovering the mouse on the execution id row which is in “Pending” status.
“Rerun Failed”, “run”, “Edit” and “Delete” icons are displayed by hovering the mouse on the execution id row present in the “Failed” status.

How to search the Execution Id in the table?

Click on the search icon present in the scheduled Instances table to search the execution IDs in the table.

How to see the Execution Id details?

Click on the particular execution Id present in the Execution Id column to see the execution Id details on the page.

How to see the machine details?

Click on the machine name present in the machine column to see the machine details in the popup.

How to see the Run Initiated by details?

Click on the user name present in the run initiated by the column to see the user details in the popup.

How to see the result of the execution Id?

Click on the status present in the status column to see the result.

Note: For pending and canceled status user cannot see the result.

How to filter the execution Id based on Status?

Click on the Filter icon present in the status column header and then apply the filter.

How to re-run the Execution Id?

Click on the Run icon present in the Action column to start the execution.

How to delete the execution Id?

Click on the delete icon present in the Action column to delete the execution Id

How to run only Failed script in Execution Dashboard?

Click on run only Failed script icon in the Action column
Will navigate to create suite page, where only Failed script will be present in the modules/scripts table
Provide a name and create the suite
Click on the “run” icon to execute the suite

How to terminate the execution of execution Id?

Click on the terminate icon present in the action column to terminate the execution.

How to cancel the execution of the execution Id?

Click on the Cancel icon present in the action column to cancel the execution.

How to navigate to the sequential result page?

You can navigate to the sequential result page in 2 ways:

1st way

After execution from Execution Dashboard, upon clicking on completed statuses such as “Passed”, “Failed”, “Terminated”, “Warning” and “Aborted” you can navigate to the result page

2nd way

when you trigger the execution from the suites tab, will be navigated to Execution Dashboard. If the machine is available for execution, then the execution status will be “Running” status, and if the machine is not available for execution then the execution status will be “Pending”.
Click on either “Running” or “Pending” status will navigate to the “Specific execution page”, click on the sync icon to know the latest results and after complete execution, the status will be updated under the status column and the overall status will be updated as capsule beside suite name
Upon clicking on the capsule beside the suite name or status of any module, you will navigate to the root module result page and click on script status and navigate to the script result page.

Result page:

On the result page there are four main sections:

1st section:

The First row contains,

Execution ID: The execution id of the executed suite is displayed.
Status: Status such as “Passed”, “Failed”, “Skipped”, “Terminated” and “Warning” is displayed.
Suite Name: <<suite name>> is displayed.
Machine: <<machine name>> is displayed.
Execution Environment: <<execution environment name>> is displayed

E.g.: “local”

The second row contains,

OS: The name of the OS used is displayed

Example: windows 7, windows 8, windows10, etc.

Upon clicking on OS, the more details tab is highlighted.

Browser: The name of the browser used for execution is displayed.

Example: Chrome, Firefox, etc.

When the selected project is web or web and mobiles, then the browser attribute is present.
Upon clicking on the browser, the more details tab is highlighted.
- Device:
The name of the device used is displayed.

Examples: galaxy, Samsung, etc.

When the selected project is mobile or web and mobiles, then the device attribute is present.
Upon clicking on the device, the more details tab is highlighted.
- Duration: The time duration for execution is displayed.
- Executed On: Execution start date and time are displayed.

In 2nd section:

There are graphs for the following attributes: –

Modules (Total number of modules present under root module)
Scripts (Total number of Scripts present under each module)
Pre-Condition (Total number of Step groups added as pre-conditions to this module and script).
Post-Condition (Total number of Step groups added as post-conditions to this module and script).

Note: Upon hovering the mouse on the Steps graph, a tooltip is displayed with the following details-

In the First row

It displays a text as Passed: <<The total number of Passed modules>.
It displays a text as Failed: <<The total number of Failed modules>>.

In the second row

It displays a text as Warning: << The total number of modules whose status is Warning >>.
It displays a text as Skipped: <<The total number of Skipped modules>>.

Similarly, when the user hovers the mouse on the graph of other attributes, a tooltip is displayed with respective details.

3rd section → More details: There is a section with the header “More details” on the right side.

columns under more details:

1. Browser/Device:

When the selected project type is the web, the browser column name is displayed.
When the selected project type is Mobile, the Device column name is displayed.
When the selected project type is “web and mobile”, the “device/browser” column name is displayed.
The used browser or device is displayed.

2. Total script: Total number of scripts used under the root module is displayed.

3. Total Passed: A total number of scripts Passed is displayed.

4. Total Failed: Total number of scripts that Failed is displayed.

5. Total Warning: Total number of scripts under Warning is displayed.

6. Total Skipped: Total number of Skipped scripts is displayed.

7. Duration: The total time taken to execute the modules is displayed.

8. Executed On: The time taken for executing that respective result is displayed.

4th section → Columns under “<<root module>>or <<module name>> or <<script name>>”

Icons:

1. Expand all

Initially Expand all icon is in an inactive state.
When you click on Expand all icon, all the Modules and Submodules will be expanded.

2. Collapse all

Initially Collapse all icon is in an active state.
When you click on the Collapse all icon, all the Modules and Submodules will be Collapse state.

3. Expand all scripts

Initially Expand all scripts are in an active state, and all the scripts under modules and sub-modules will be displayed.

4. Collapse all scripts

When you click on Collapse all script icons the script under modules and sub-modules will be hidden

5. Show Pre/Post Conditions

When you click on this icon, all the Pre-Post conditions are expanded.

6. Hide Pre/Post Conditions

When you click on this icon, all the Pre-Post conditions are collapsed.

7. Expand

When you click on expand icon, the content is displayed in expanded form.

8. Collapse

When you click on the collapse icon, the content is hidden.

Module: This column displays the result of the selected module.

“Expand all”, “Show all scripts”, “Show pre-post condition”, “Root” title with a capsule “M<<number of the module present under root module>>”, “S<<number of scripts present under root module>>” is displayed as the first description.

Note 1: Based on priority wise, the count will be displayed beside Pre/Post-condition.

The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” color, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” color, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” color and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” color is displayed beside “Pre-condition” title under module column.
The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” color, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” color, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” color and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” color is displayed beside “Post-condition” under module column.
The module name with a capsule “S<<number of scripts present under respective module>>” is displayed.
Upon clicking on expand icon, which is present beside the Module, it is expanded and all modules and scripts are displayed under the parent module, click on each Module name in order to navigate to a specific module result page and click on <<script name>> in order to navigate to script result page. Upon clicking on the collapse icon, which is present beside the parent level module, the parent module is displayed in collapsed format.
Upon clicking on any expand icon, which is present beside the step group, all steps under the step group are displayed. Upon clicking the collapse icon, which is present next to the step group, the step group is displayed in collapsed format.

Type: “Type” column is empty for pre and post-conditions concerning the “root and parent” module and it will be present for individual step groups and individual scripts.

Step: “Step” column description is present only if the “type” column is specified and it will be “N/A” if the “type” column is not specified.

Upon mouse hovering on the “step” column description concerning pre-condition, a tooltip appears as “Pre-condition step count is shown in individual step group”.
Upon mouse hovering on the “step” column description concerning the module, a tooltip appears as “Module-level steps count is shown in individual script”.
Upon mouse hovering on the “step” column description of the respective post-condition, a tooltip appears as “Post-condition step count is shown in individual step group”.
Under Pre-condition, if Step-Group-cascaded is present then the “status” column for the respective Step-group-cascaded will be “N/A”. Upon hovering the mouse on a tooltip, it appears as “Results of cascaded Pre-conditions are visible at each script level”.

Passed: Total Passed steps are displayed.

Failed: Total Failed steps are displayed.

Warning: Total Warning steps are displayed.

Skipped: Total Skipped steps are displayed.

Status with filter icon: Status such as “Passed” in “green” color, “Failed” in “red” color, “Warning” in “yellow” color, and “Skipped” in “grey” is displayed under the Status column.

Upon clicking on the Filter icon beside status, a context menu is displayed with “All” text in “blue” color, “Passed” text in “green” color, “Failed” text in “red” color, and “Warning” text in “yellow” color.
If the user selects “All” status from the drop-down, the steps that are “Passed”, “Failed”, “Warning” and “Skipped” are displayed under the module column with a respective result under the status column.

a. Passed: When the user selects “Passed” which is in the “green” from the context menu, all the Passed steps are displayed under the result column with the respective results displayed under the Status column.

b. Failed: When the user selects “Failed” which is in “red” from the context menu, all the Failed steps are displayed under the result column with the respective results displayed under the Status column.

c. Warning: When the user selects “Warning” which is in “golden” from the context menu, all the Warning steps are displayed under the result column with the respective results displayed under the Status column.

d. Skipped: When the user selects “Skipped” which is in “grey” from the context menu, all the Skipped steps are displayed under the result column with the respective results displayed under the Status column.

Start time: The start time of the execution is displayed here.

Execution duration: Time taken for complete execution is displayed.

Note1: Upon clicking on <<Module name>> in the “Root module result page”, the user will be navigated to the module result page, in the module result only module-specific family details will be displayed

Note2: Upon clicking on <<script name>> in “Root module result page”, or “Module result page”, you will be navigated to the script result page, the script result page, the info panel, the graph section, and steps table will be updated accordingly.

Specific Execution page:

How to navigate to the Specific execution page?

From Execution Dashboard, click on “Running” or “Pending” status you will be navigated to the Specific execution page

Columns under the Specific execution page

Can the user navigate to the result page from a specific execution page?

Yes, the user can navigate to the result page from a specific execution page by clicking on “capsule beside execution name” or by clicking on status with result to module or status concerning the script, if the user clicks on any status concerning the module user will be navigated to root module result page and if the user clicks on status concerning script user is navigated to script result page.

Note 1: In the specific execution page when the overall status is Running, the checkbox and Run icon are disabled. The user will not be able to trigger any execution when the status is Running.

Note 2: In the specific execution page when the overall status is pending, the checkbox is disabled as the user will not be able to trigger a run.

Icons:

1. Sync icon

Click on the sync icon to get the updated status.
Note: When execution is “pending” you cannot click on the sync icon

2. Terminate the icon

Click on the terminate icon if you what to terminate the execution in the middle of the execution
If the execution is terminated, then the “terminate” icon will change to the “run” icon or the “run only Failed” icon.

3. Run only Failed icon

If you want to run only Failed scripts then click on the run only Failed icon then execution will start only for Failed scripts, including pre and post-conditions.
After the complete execution, if one or more scripts are Failed then the “Run only Failed” icon will appear.

4. Rerun icon

On clicking on this icon, the execution will start if the machine is available.

5. Cancel icon

On clicking on this icon, the pending execution is canceled.
When the execution is pending, the “close” icon will be present.

6. Expand all

When you click on expand all icon, all the Modules and sub Modules are displayed in Expand mode.

7. Collapse all

When you click on the Collapse all icon, all the Modules and sub Modules are displayed in Collapse mode.

8. Show all scripts

Initially, by default, Show all scripts will be active.
By default, “Show all scripts” will be active. All script present under all Modules and Submodules is displayed

9. Hide all scripts

By default, “Show all scripts” will be active. If you want to hide all scripts then click on Hide all scripts, all scripts present under all Modules and Submodules will be hidden.

10. Show Pre/Post Conditions

By default, the “Show pre/post condition icon” will be active. All pre and post-condition present is displayed.

Column present under specific execution page:

1. Module: The first description under module will have “expand all”, “show all scripts”, “show pre-post condition”, and “Root” title with a capsule “M<<number of modules present under root module>>” and “S<<number of scripts present under root module>>”.

When you are in a specific script Specific Execution Page, then initially under the module column only the selected specific family is displayed.

2. Type:

Under this column, the “Type” of the script is displayed that is created during “Create Script”.
The “Type” column for “Module” and “Sub-Module” will be empty.
The “Type” of the script can be ‘WEB’, ‘WEB SERVICES’, or ‘DATABASE’ for the ‘WEB’ Project type.
The “Type” of the script can be ‘ANDROID’, ‘WEB SERVICES’, ‘DATABASE’ for ‘MOBILE’ Project type, and ‘ANDROID’ Platform type.
The “Type” of the script can be ‘ANDROID’, ‘IOS’, ‘WEB SERVICES’, ‘DATABASE’ for ‘MOBILE’ Project type and ‘ANDROID’ and ‘IOS’ Platform type.
The “Type” of the script can be ‘WEB SERVICES’, or ‘DATABASE’ for the ‘WEB SERVICE’ Project type.

3. Status: During the execution, if the user clicks on the “Sync Results” icon, if the execution of certain steps is completed then the Result for those steps is updated

4. Modified By: Under the “modified by” column, the user name who has modified/Edited is mentioned.

Parallel execution result:

How can we be navigated to the parallel execution result page?

From Execution Dashboard, upon clicking on the completed result status you will be navigated to the “Overview machine result page”

Columns under “Overview machine result page”:

On the result page, there are four main sections:

1st section:

The First row contains,

Execution ID: The execution id of the executive suite is displayed.
Status: Status such as “Passed”, “Failed”, “Skipped”, “terminated” and “Warning” is displayed. Overall status is displayed
Suite Name: <<suite name>> is displayed.
Total Machine: << Total Machine count selected for parallel execution while creating a suite>> is displayed.
Duration: The time duration for execution is displayed.
Executed On: Execution start date and time are displayed.

In the 2nd section:

There are graphs for the following attributes-

Modules (Total number of modules present under root module)

Scripts (Total number of Scripts present under each module)

Pre-Condition (Total number of Step groups added as pre-conditions to this module and script)

Post-Condition (Total number of Step groups added as postconditions to this module and script)

Note: Upon hovering the mouse on the Steps graph, a tooltip is displayed with the following details-

In the First row

It displays a text as Passed: <<The total number of Passed modules>.
It displays a text as Failed: <<The total number of Failed modules>>.

In the second row

It displays a text as Warning: << The total number of modules whose status is Warning >>.
It displays a text as Skipped: <<The total number of Skipped modules>>.

Similarly, when the user hovers the mouse on the graph of other attributes, a tooltip is displayed with respective details.

3rd section following columns:

Machine: Total number of machines that are all selected for execution while creating a suite will be displayed.

Platform: The details of the platform are displayed [ex: windows10]

Total script: Total number of scripts used is displayed

Total Passed: The total Passed script is displayed

Total Failed: Total Failed script is displayed

Total Warning: Total Warning script is displayed

Total Skipped: Total Skipped script is displayed

Status: Overall status of the respective machine such as [Passed, Failed, Warning, terminated, Aborted, Skipped] is displayed

Duration: The time duration for execution is displayed.

Executed On: Execution start date and time are displayed.

How to navigate to the individual Result page?

Upon clicking on the overall status of each machine, you will be navigated to the Root module result page of the respective machine, refer to the below screen.

The result page is explained in detail above.

Can we navigate to another machine result page from the Root module result page?

Yes, we can navigate to the top right corner. We have a machine selection drop down from the dropdown you can select another machine, selecting the machine “root module result page” of the respective machine will be displayed.