Consider a TAS that uses a keyword-driven framework. The SUT is a web application and there is a large set of keywords available for writing the automated tests that relate to highly specific user actions linked directly to the GUI of the SUT. The automated test written with the keywords are statically analyzed by a custom tool which highlight's repeated instances of identical sequence of keywords. The waiting mechanism implemented by the TAS for a webpage load is based on a synchronous sampling within a given timeout. The TAS allows checking a webpage load every seconds until a timeout value
You are executing the first test run of a test automation suite of 200 tests. All the relevant information related to the state of the SUT and to the automated test execution is stored in a small database. During the Automated test run you observe that the first 10 test pass, while an abnormal termination occurs when executing the 11th test. This test does not complete its execution and the overall execution of the suite is aborted. An immediate analysis of the abnormal termination is expected to be time consuming and you have been asked to produce a detailed report of the execution results for the first test run, as soon as possible.
What is the MOST important FIRST step to be taken immediately after the abnormal occurred when executing the 11th test?
Your goal is to verify completeness, consistency and correct behavior of an automated test suite. The TAS has been proven to successfully install in the SUT environment. All the preliminary checks to verify the correct functioning of the automated test environment and test tool configuration, installation and setup have successfully completed.
Which of the following is NOT a relevant check for achieving your goal in this scenario?
Consider a TAS that exclusively uses the APIs of a SUT. To make this work, significant changes have been required to the SUT by adding a set of dedicated test interfaces to the APIs. All the automated tests will use these test interfaces when interacting with the SUT. Assume that you are currently verifying the correctness of the automated test environment and test tool setup.
Which of the following would you expect to be the MOST specific risk associated with this scenario?
Consider a SUT that small run on multiple platform during the execution of automated test runs. In each test run an automated test suite needs to be executed, with the same version of the TAF, against the same version of the SUT of each platform. Each platform shall have its own dedicated test environment. Your goal is to implement a process as automated as possible ( i.e with minimal manual intervention) that allows implementing a consistent setup of the TAS across the multiple test environments.
Which two of the following aspects are MOST relevant for achieving your goal in this scenario?
The configuration of the TAS uses automated installation scripts
The TAF saves the logs needed to debug errors in XML format
C) Features of the TAF not used by the automated tests have been tested
D) All the automated test cases contain the expected results
E) The TAS components are under configuration management