Skip to content

Testdefinition hierarchy

You manage and maintain your test definition hierarchy in four views, where two of them are located inthe sidebar:

Screenshot sidebar test definition"

The sidebar includes two followinglist view:

  • Repository list view

  • Testset list view

The sidebar appearance can be changed with the following toggles

  • Show/hide sidebar

  • Show Testsets on: will show the Testsets List View, off: will not display them.

Repository list view

A repository is an organizational bucket where you can enter your testsets and testcases. All your definitions are synchronized on your iCloud storage across your MacOS-devices.

This view displays all repositories and provides commands to create, edit, delete and test run commands. This view is intended to edit in the repository list or run a repository-based test and view the unterlying testsets at the same time. You Commands illustrated on the left side from top to down without the view toggle commented in the previous section

Repository List View"

We follow the icons from left to right and list the views from top to down.

  • Create new repository adds a new repository

  • enable/disable repository for test run includes or excludes a repository for test run or execution run

  • Delete all selected repositories performs the deletion

  • Edit repository name allows to rename a single selected repository

  • move repository up and move repository down has impact on the list order and on the order they are invoked for test runs and execution runs

  • instant run tests in repository starts a test run that walks through alls testsets and their testcase in the order they are displayed in the list views.

  • run test execution for repository starts a test run whose results are persisted and visible. See Test run.This starts a background test run that walks through alls testsets and their testcase in the order they are displayed in the list views.

  • instant test run status for repository and instant test run status for testset show the instant test run status. The test results are not persisted.

  • Search input field filters the repositories based on the input - input must be contained, case insensitive

  • selected repository defines the root element for the Testset List View

  • Documentation of the Pasteboard commands

Testset list view

The Testset list view is only visible, if the toggle Show testsets is activated

Repositories contain Testsets. They are represented in the view above with a folder icon. All command that you can perform on testsets are available through a context menu.

Testset list view

  • Create new Testset will open a dialog to create a new Testset

  • Delete all selected X testset(s) will prompt you to perform the undoable deletion.

  • Rename selected Testset will open a dialog to enter the new name.

  • export selected Testsets to JSON-file will create a JSON-representation of the Testset list with all underlying data. See Import and Export your Test definitions.

  • import Testsets from JSON-file will create new Testsets from a JSON-representation with all underlying data. see Import and Export your Test definitions

  • Toggle enabled/disabled for test run includes or excludes a Testset for a test run.

  • Instantly run Testsets starts a test run that walks through the testcases of the selected testset in the order they are displayed in the list views. The results are not persisted.

  • instant test run status for repository and instant test run status for testset show the instant test run status. The test results are not persisted.

  • move selected Testset(s) up will change the order in th Testset list.

  • move selected Testset(s) down will change the order in th Testset list.

  • Documentation of the Pasteboard commands

Testcase list view

This view displays the testcases of the selected testset

Testcase list view

A testcase includes a number of tetsteps to test a specific functionality.

Commands

  • Name of parent repository displays the current repository selection

  • Name of parent testset displays the current testset selection

  • create new data-based testcase sets up a base testcase with an input data teststep and a result teststep

  • create new testcase

  • delete all selected testcases

  • Documentation of the Pasteboard commands

Special considerations

Each testcase is displayed with an icon leading its name. An icon with a dark fill color indicates a testcase with teststeps included, an icon without fill color indicates an empty testcase - move up and move down has impact on the list order and on the order they are invoked for test runs. The order is intended to help you organize your testcases.

  • enable/disable includes or excludes a testcase on a test run

  • run test starts a test run that walks through all selected testcases in the displayed order, or all testcases, when no testcase is selected.

  • testcase list testrun result status displays the aggregrated test run result status of all executed testcases.

  • testcase testrun result status displays the test run result status of an individual testcase.

  • import testcases from JSON loads testcase information from a JSON file

  • export selected testcases as JSON creates a JSON representation of the selected testcases and stores them to a file

  • rename selected testcase

Teststep list view

This view displays the teststeps of the selected testcase

Teststep list view

A teststep performs - depending on the teststep type a type-specific task within a testcase.

Commands

  • Create SOAP Teststep opens a dialog to specify the WSDL and the operation that you want to test. See tutorial Create SOAP Teststep

  • Create HTTP Teststep creates a teststep for HTTP requests including JSON body. See tutorial Create HTTP Teststep

  • Create Datatransfer Teststep creates a teststep with an empty list of Teststep value providers such as XPath and XQuery value providers. See Datatransfer Teststep

  • Create RandomizeTeststep creates a teststep with an empty list of random value providers based on concatenated strings or uuids. See View Randomizeteststep

  • Create Randomized ValuelistTeststep creates a teststep that reads a CSV file and allows to configure output columns and their formatting. See Randomizedvaluelist Teststep View.

  • Create Manual Randomized ValuelistTeststep creates a teststep that let you edit a table and allows to configure output columns and their formatting. see Manual RandomizedvaluelistTeststep View.

  • Each Teststep type is displayed with its name and a specific icon to distinguish the teststep type.

  • delete all selected teststeps

  • rename selected teststep

  • move up and move down has impact on the list order and on the order they are invoked for test runs. The order is intended to define which teststep needs the input of another teststep.

  • enable/disable includes or excludes a teststep on a test run

  • run test starts a test run that walks through all selected teststep in the displayed order, or all teststeps, when no teststep is selected.

  • teststep list testrun result status displays the aggregrated test run result status of all executed teststeps.

  • teststep testrun result status displays the test run result status of an individual teststep.

  • Documentation of the Pasteboard commands