(Which of the following statements refers to a typical advantage of test automation?)
You have been tasked with adding the execution of build verification tests to the current CI/CD pipeline used in an Agile project. The goal of these tests is to verify the stability of daily builds and ensure that the most recent changes have not altered core functionality. Currently, the first activity performed as part of this pipeline is the static source code analysis. Which of the following stages in the pipeline would you add the execution of these smoke tests to?
Some automated regression test scripts run by a TAS in a given test environment make calls to private APIs that require authentication for all requests (the authentication method is the same for all APIs). The SUT is a business-critical system. The following two changes are planned: a change in the authentication method of all APIs and a minor upgrade of the OS (Operating System) in the test environment. You have updated the test scripts to cope with the change in the API authentication method. Which of the following sequences of activities is BEST to ensure that the test scripts are not adversely affected by these changes?
You are employed as a TAE on a project to build a purchasing system. The main requirements for the system are:
1) Allow users to enter details of items that they wish to have purchased and, from these details, create a purchase request.
2) Take each purchase request through a workflow that will allow the requestor’s line manager to approve the request, reject it, or return it for clarification/modification.
3) Forward approved requests to the Purchasing Department.
4) Allow purchasers to find the best available supplier and place the request on that supplier as a purchase order.
Requirement 1 has now been delivered and has been satisfactorily tested manually. In parallel, you have developed a TAS so that functional suitability testing can be automated.
You have just conducted a pilot of the TAS on the implementation of Requirement 1 and several things went wrong:
• One test failed because some reference data that it needed was missing. This and several other failures were difficult to diagnose.
• Another test failed unexpectedly because an old version of the script was used.
Which three measures could mitigate these risks during deployment?
a) Full test logging down to and including trace level
b) Identification and correct configuration of all firewalls
c) Automated creation and loading of all data to meet test preconditions
d) Provision of proper device configuration plans
e) Careful packaging with thorough configuration management
Your TAF writes detailed test logs for every test that it executes. Data storage space in the test environment is limited, so after each run it is necessary to remove unnecessary detail from the log for tests that passed and move the data that must be kept to a different place.
What would be the BEST way to do this?
Which of the following should be done when checking the composition of the test suite?
Which one of the following answers does NOT refer to an example of configuration item(s) that should be specified in development pipelines to identify a test environment (and its specific test data) associated with a web app under test on which to execute automated tests?
A suite of automated test cases was run multiple times on the same release of the SUT in the same test environment. Consider analyzing a test histogram that shows the distribution of test results (pass, fail, etc.) for each test case across these runs. Which of the following potential issues is MOST likely to be identified as a result of such an analysis?
Which ONE of the four layers of the test automation architecture provides an optional capability?
You are a TAE responsible for a TAS that is used on several products, all of which have complex UIs. A substantial proportion of the automated tests break on a regular basis, usually for reasons associated with the UI. The investigation and maintenance this requires is significantly reducing the productivity of the teams and the return on investment.
You are looking for ways to improve the test cases in this TAS. Which of the following approaches would be MOST appropriate?
a) Artificial intelligence
b) Test histograms
c) Reliability growth modelling
d) Schema validation
e) Operational profiles
When a continuous integration/continuous deployment (CI/CD) pipeline is split between build and deployment phases, which statements are TRUE?
a) Component and component integration tests are part of the deployment phase.
b) System and higher-level tests may be part of the build phase.
c) Component and component integration tests are part of the build phase.
d) System and acceptance tests may be executed in a separate pipeline.
e) System integration tests cannot be run in this kind of pipeline.
Automated tests run by a TAS on a SUT can be subject to sudden bursts of messages to log during their execution. All log messages that occur during execution must be permanently stored in the corresponding test execution logs by the TAS for later analysis. If logging is not performed correctly, these bursts can reduce the execution speed of these automated tests, causing them to produce unreliable results. Which of the following solutions would you expect to be MOST useful to address this issue for TAS logging?
You have been recruited as a TAE by a large travel agency and are now responsible for a mature TAS that is dedicated to functional testing of the company’s booking system, which covers flights, hotels, and packaged holidays. This application contains a complex UI and a lot of functionality. It is undergoing constant maintenance and enhancement by an Agile team that adds tests to the regression test suite at the end of every iteration.
The TAS supports structured scripting and this has been implemented to a high standard, with a well-managed script library and minimal code duplication. The TAA will not support any more advanced scripting techniques. The test automation that has been achieved so far was well received at first but is now the target of increasing criticism. It is perceived as being old-fashioned, poorly documented and, in particular:
1. The test script maintenance overhead is becoming excessive because the test analysts frequently want data values to be changed.
2. Test analysts are complaining that a new test which is similar to an existing one, except for data values, requires a new high-level script, and that they must ask a technical test analyst to do this for them.
3. The nightly full regression run is taking a long time and there is a risk that, as more tests are added, it will soon take too long to run in the available window.
4. Some tests break frequently because of slow response from the SUT.
5. Some transactions are difficult to verify because they rely on variables that cannot be seen through the UI of the SUT.
6. The UI of the TAF is difficult to learn.
The SUT architect is planning a major new release and they have offered to include features that will enhance its testability. You already have plans to deal with items 1, 2 and 3 on the list, so now you are considering how you might mitigate items 4, 5 and 6.
Which TWO improvements will BEST address items 4, 5 and 6?
a) Add an event mechanism to the SUT which the TAF can subscribe to
b) Adopt a set of standard setup and teardown methods
c) Add an API to the SUT that will make the internal variables observable
d) Update and improve the documentation of the TAA
e) Implement hard-coded waits in scripts that have been affected by slow SUT response
(Which of the following statements about how test automation is applied across different software development lifecycle models is TRUE?)
Which of the following information in API documentation is LEAST relevant for implementing automated tests on that API?
A release candidate of a SUT, after being fully integrated with all other necessary systems, has successfully passed all required functional tests (90% were automated tests and 10% were manual tests). Now, it is necessary to perform reliability tests aimed at evaluating whether, under certain conditions, that release will be able to guarantee an MTBF (Mean Time Between Failures) in the production environment higher than a certain threshold (expressed in CPU time). Which of the following test environments is BEST suited to perform these reliability tests?
You are employed as a TAE on a project to build a purchasing system. The main requirements for the system are:
1) Allow users to enter details of items that they wish to have purchased and, from these details, create a purchase request.
2) Take each purchase request through a workflow that will allow the requestor’s line manager to approve the request, reject it, or return it for clarification/modification.
3) Forward approved requests to the Purchasing Department.
4) Allow purchasers to find the best available supplier and place the request on that supplier as a purchase order.
Requirement 1 has now been delivered and has been satisfactorily tested manually. In parallel, you have developed a TAS so that functional suitability testing can be automated.
The functional suitability testing of Requirement 1 has now been automated as fully as possible. A change to add audit logging of user activity is planned but has not yet been made. After a small change to the UI code, the last regression run contained a significant number of unexplained test failures. At the point each test stopped, the actual and expected results showed no discrepancies. In each case, the run was able to continue with the next test in the suite. Preliminary investigation showed that the points at which these tests stopped had nothing obvious in common.
Which option below contains the BEST next steps to investigate this?
Consider a TAS aimed at implementing and running automated test scripts at the UI level on web apps. The TAS must support cross-browser compatibility for a variety of supported browsers, by ensuring that the same test script will run on such browsers in the same way without making any changes to it. This is achieved by introducing appropriate abstractions into the TAA for connection and interaction with different browsers. Because of this, the TAS will be able to make direct calls to the supported browsers using each different browser’s native support for automation. Which of the following SOLID principles was adopted?
Which of the following is the BEST example of how static analysis tools can help improve the test automation code quality in terms of security?