What can we help you with?
< All Topics
Print

Script Result

Posted
Updated
ByAdmin

What is the result?

Result is the final outcome, where you can get to know whether modules, scripts, and steps are “Passed”, “Failed”, “Warning”, “Skipped”, “Aborted”, or “Terminated” after the execution of a module or script.

How do we receive results from clients?

Let’s assume that you are accessing the FireFlink product from the browser under test development. The module or scripts you are creating is stored on the server. After creation, when the user selects the checkbox beside the module or script, and clicks on the run button, the execution starts. For the execution, all the selected modules or scripts are converted into the package and sent to the default machine set by the user for the execution and after the complete execution, the result from the client is pushed back to the server.

How to generate results?

  1. Navigate to “Test Development”.
  2. On the “Test Development” page, select a checkbox with respective modules or scripts.
  3. Click on the “run button” on the left corner, beside the “search” icon.
  4. After clicking on the run button, you will be navigated to the “Execution Dashboard”.
  5. After complete execution, the results such as “Passed”, “Failed”, “Skipped”, “Warning”, “Terminated” or “Aborted” status is updated under the “Status” column.

Script Result

What is the Script Result?

When you run the script from the steps tab then after execution the result and status will be updated under the result and status column

Navigate to the script result:

You can navigate to script results in three ways:

1. First way:

  • If you are executing the script from Test Development main tree structure, select a script and click on the run button. If the machine is available for execution, execution begins as shown on the screen below.

  • You will be navigated to the “Execution Dashboard” as shown on the screen below.

  • After complete execution, click on the “sync icon”, as shown on the screen below.

  • The status will get updated and click on the status of the respective execution you have triggered, as shown on the screen below.

  • You will be navigating to the result page as shown on the screen below.

  • Or in the Execution Dashboard, click on the execution name as shown on the screen below.

  • You will be navigated to a specific execution page as shown in the below screen.

  • There if you click on “Status” of the script as shown in the below screen.

  • You will navigate directly to the script results page.

  • If you click on the capsule beside the execution name or status of the root module or module, as shown in the below screen.

  • You will navigate to the root module result page as shown on the screen below.

Specific execution page:

The specific execution page contains the tree structure of the selected module and scripts selected from the test development main tree structure with respective statuses such as Passed, Failed, Warning, Skipped, Terminated, N/A and Aborted.

Note1. Upon clicking on the N/A and Aborted status of scripts, you cannot navigate to the result on the page.

How can the user navigate to a specific execution page?

  • In the Execution Dashboard, upon clicking on the execution name or “running” or “pending” status, you can navigate to a specific execution page as shown in the below screen.

Can you Navigate to the result page from the specific execution page?

Yes, you can navigate to the result page from a specific execution page by clicking on “capsule beside execution name” or by clicking on status with result to module or status concerning the script, if the user clicks on any status concerning the module user will be navigated to root module result page and if the user clicks on status concerning the script, the user is navigated to script result page as shown in the below screen.

Note 1: On the specific execution page, when the overall status is Running, the checkbox and Run icon are disabled. The user will not be able to trigger any execution when the status is Running.

Note 2: On a specific execution page when the overall status is pending, the checkbox is disabled as the user will not be able to trigger a run.

Icons:

  1. Sync icon: Click on the sync icon to get the updated status Note: When execution is “pending” you cannot click on the sync icon
  2. Terminate icon: Click on the terminate icon if you want to terminate the execution in the middle of execution. If the execution is terminated, then the “terminate” icon will change to the “run” icon or the “run only Failed” icon.
  3. Run only Failed icon: If you want to run only Failed scripts then click on the run only Failed icon then execution will start only for Failed scripts, including pre and post-condition. After the complete execution, if one or more scripts are Failed then the “Run only Failed” icon will appear
  4. Re-run icon: On clicking on this icon, the execution will start if the machine is available.
  5. Cancel icon: On clicking on this icon, the pending execution is canceled. When the execution is pending, the “close” icon will be present.
  6. Expand all: When you click on expand all icons, all the Modules and subModules are displayed in Expand mode.
  7. Collapse all: When you click on the Collapse all icon, all the Modules and subModules are displayed in Collapse mode.
  8. Show all scripts: Initially, by default, Show all scripts will be active. By default, “Show all scripts” will be active. All scripts present under all Modules and Submodules are displayed.
  9. Hide all scripts: By default, “Show all scripts” will be active. If you want to hide all scripts then click on Hide all scripts, all scripts present under all Modules and Submodules will be hidden.
  10. Show Pre/Post: By default, the “Show pre/post condition icon” will be active. All pre and post-condition presents are displayed.
  11. Hide Pre/Post Conditions: When you click on Hide pre/post condition all the Pre-Post conditions will collapse.

Column present under specific execution page:

1. Module: You can see the “expand all”, “show all scripts”, “show pre-post condition”, and “Root” titles with a capsule “M<<number of modules present under root module>>” and “S<<number of scripts present under root module>>” as the first description under module column.

  • Only selected modules and scripts are displayed under this column.

2. Type:

  • Under this column, the “Type” of the script is displayed that is created during “Create Script”.
  • The “Type” column for “Module” and “Sub-Module” will be empty.
  • The “Type” of the script can be ‘WEB’, ‘WEB SERVICES’, or ‘DATABASE’ for the ‘WEB’ Project type.
  • The “Type” of the script can be ‘ANDROID’, ‘WEB SERVICES’, ‘DATABASE’ for ‘MOBILE’ Project type, and ‘ANDROID’ Platform type.
  • The “Type” of the script can be ‘ANDROID’, ‘iOS’, ‘WEB SERVICES’, ‘DATABASE’ for the ‘MOBILE’ Project type, and ‘ANDROID’ and ‘iOS’ Platform type.
  • The “Type” of the script can be ‘WEB SERVICES’, or ‘DATABASE’ for the ‘WEB SERVICE’ Project type.

3. Status: During the execution, if the user clicks on the “Sync Results” icon, if the execution of certain steps is completed then the Result for those steps is updated.

4. Modified By: Under the “modified by” column, the user name who has modified/Edited is mentioned.

Results page: whenever you are navigating to the script result page from Execution Dashboard first you will navigate to the root module result page as shown on the screen below.

  • On the root module page, upon clicking on “script name” you will navigate to the script result page.

On the script result page:

We have 4 sections under the result tab:

1st section:

  • The First row contains,

  1. Execution ID: The execution id of the execution script is displayed.
  2. Status: Status such as “Passed”, “Failed”, “Skipped”, “terminated” and “Warning” is displayed.
  3. Script Name: <<script name>> is displayed.
  4. Machine: <<machine name>> is displayed.
  5. Execution Environment: <<execution environment name>> is displayed. EX: “local”.
  • In the Second row contains,

  • OS: The name of the OS used is displayed. Example: windows 7, windows 8, windows10, etc. Upon clicking on OS, the more details tab is highlighted.
  • Browser:
    • The name of the browser used for execution is displayed. example: chrome, firefox, etc.
    • When the selected project is web or web and mobiles, the browser attribute is present.
    • Upon clicking on the browser, the more details tab is highlighted.
  • Device:
    • The name of the device used is displayed. example: galaxy, Samsung, etc.
    • When the selected project is mobile or web and mobiles, the device attribute is present.
    • Upon clicking on the device, the more details tab is highlighted.
  • Duration: The time duration for execution is displayed.
  • Executed On: Execution started to date and time are displayed as shown in the below screen.

2nd section:

The attributes of the graph are:

  • Steps (Total number of steps present in the script)
  • Depends On Scripts (Total number of Depends on Scripts added to this Script)
  • Pre Condition (Total number of Step groups added as pre-conditions to this script)
  • Post Condition (Total number of Step groups added as postconditions to this script)

Upon hovering the mouse on the Steps graph a tooltip is displayed with the following details:

In the First row:

  • It displays a text as Passed: <<The total number of Passed steps>>.
  • It displays a text as Failed: <<The total number of Failed steps>>.

In the second row:

  • It displays a text as Warning: <<The total number of Warning steps >>.
  • It displays a text as Skipped: <<The total number of Skipped steps>>.

Note 2: Similarly, when the user hovers the mouse on the graph of other attributes a tooltip is displayed with the respective details.

Note 3:

  1. If your script contains only steps then, only the steps graph will be present under the graph section.
  2. If the script contains only a precondition then, only the precondition will be displayed under the graph section.
  3. If the script contains only post-conditions then, only post-condition graphs will be displayed under the graph section.
  4. If the script contains only depends on the script then, only depends on the script graph will be displayed under the graph section.
  5. If the script contains both pre and post-condition then both pre and post-condition graphs will be displayed.

3rd section:

Columns under <<script name>> table:

Result: This column displays the result of the selected script.

How will the steps be displayed on the result page?

If the script that you have selected from the steps tab has only Steps, then

  • The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” color, the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” color, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “grey” color and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” will be displayed beside “steps” text, as shown in the screen below.

How the steps, preconditions, and postconditions will be displayed on the result page?

If the selected script from the steps tab has some scripts that are added as a dependency, also if the user has added some step groups as Pre-conditions & Post-conditions then-

  • The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” color the counts of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” color, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “gray” color and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” color will be displayed beside “Depends On Scripts”.
  • The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” color the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” color, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “gray” color and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow” color will be displayed beside Preconditions.

    Note 1:
    1. For every step group that is added, the pre-conditions to the script and after the execution in the result column, there is an expand/collapse icon beside each step group.
    2. Upon clicking on the “expand/collapse icon” the steps of the step group are expanded with the respective result, as shown in the design.
    3. Upon a single click on each step the “Step Result” popup will be displayed.

  • The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” color the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” color, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “gray” color and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “gray” color will be displayed beside steps.

undefined

Note 2: Upon a single click on each step, the “Step Result” popup is prompted.

  • The count of “Passed” scripts “N(Passed)/N(total)” with the respective result as “Passed” in “green” color the count of “Failed” scripts “N(Failed)/N(total)” with the respective result as “Failed” in “red” color, the count of “Skipped” scripts “N(Skipped)/N(total)” with the respective result as “Skipped” in “gray” color and the count of “Warning” scripts “N(Warning)/N(total)” with the respective result as “Warning” in “yellow”color will be displayed beside post-condition as shown in the screen below.

undefined

Status:

  • Status such as “Passed” in green color, “Failed” in red color, “Skipped” in gray color, and “Warning” in yellow will be displayed.
  • Besides the Status column a Filter button.
  • Upon clicking on the Filter button, a context menu is displayed with the following options,
    • All: When the user selects “All” which will be in “blue” from the context menu, then all the “Passed”, “Failed”, “Skipped” and “Warning” steps are displayed under the result column with their respective results displayed under the Status column.
    • Passed: When the user selects “Passed” which is in “green” from the context menu, all the passed steps are displayed under the result column, with the respective result displayed under the Status column.
    • Failed: When the user selects “Failed” which is in “red” from the context menu, all the Failed steps are displayed under the result column with the respective result displayed under the Status column.
    • Warning: When the user selects “Warning” which is in “golden” from the context menu, all the Warning steps are displayed under the result column with the respective result displayed under the Status column.
    • Skipped: When the user selects “Skipped” which is in “gray” from the context menu, all the “Skipped” steps are displayed under the result column with the respective result displayed under the Status column.

Execution Duration: The time taken for execution is displayed.

Example 1: Assume that the user is executing the script from the Test development main tree structure.

1. Select a highlighted script, and the checkbox will be selected.

2. Next, click on the “run” button in the left corner.

3. User is navigated to the Execution Dashboard, in the “Execution Dashboard” click on “status” concerning triggered execution. You will navigate to the script result page or in the ‘Execution Dashboard’, click on the execution name and you will be navigated to a specific results page.

4. On a specific execution page, click on any status under the Status column.

5. You will be navigated to the script result page.

Second way:

1. If you have triggered Multiple runs from “Test Development” main tree structure or triggered multiple runs from a specific execution page.

2. If the user wants to see the result of those triggered scripts, click on “Execution Dashboard” in breadcrumb or “Execution Dashboard” inside the script tab.

3. You will be navigated to the “Execution Dashboard” tab. If the execution is completed the status will be updated accordingly [Passed, Failed, Warning, Skipped, Terminated, Aborted]. Upon clicking on a completed status you will be navigated to the result on the page.

If the execution is not completed [if the status is pending or running status] wait until the execution to complete. In the Execution Dashboard, click on the execution name, and you will be navigated to a specific execution page, click on “Pending or Running status” concerning execution you will be navigated to a specific execution page.

4. On the specific execution page, click on the status of specific scripts under the status column, then you will be navigated to the script result page.

Table of Contents