TAE

Which of the following should be done when checking the composition of the test suite?

Your TAF writes detailed test logs for every test that it executes. Data storage space in the test environment is limited, so after each run it is necessary to remove unnecessary detail from the log for tests that passed and move the data that must be kept to a different place. What would be the BEST way to do this?

You are a TAE responsible for a TAS that is used on several products, all of which have complex UI’s. It has been decided that all radio buttons in one of the products will be changed to checkboxes, checkboxes have not been used in the UI before. You are updating the TAS to align with this change, which TWO actions would be MOST appropriate? a. Write a function to handle checkboxes and add it to the function library. b. Amend the function that handles radio buttons to also handle checkboxes. c. Update the Test Automation Architecture. d. Identify all test scripts that will be affected by the change. e. Amend the library naming conventions to accommodate the change.

You have been recruited as a TAE by a large travel agency and are now responsible for a mature TAS that is dedicated to functional testing of the company’s booking system, which covers flights, hotels and packaged holidays. This application contains a complex UI and a lot of functionality. It is undergoing constant maintenance and enhancement by an agile team that adds tests to the regression test suite at the end of every iteration. The TAS supports structured scripting and this has been implemented to a high standard, with a well-managed script library and minimal code duplication. The TAA will not support any more advanced scripting techniques. The test automation that has been achieved so far was well received at first but is now the target of increasing criticism. It is perceived as being old-fashioned, poorly documented and in particular: the test script maintenance overhead is becoming excessive because the test analysts frequently want data values to be changed; test analysts are complaining that a new test which is similar to an existing one (except for data values) requires a new high-level script, and that they must ask a technical test analyst to do this for them; the nightly full regression run is taking a long time and there is a risk that, as more tests are added, it will soon take too long to run in the available window; some tests break frequently because of a slow response from the SUT; some transactions are difficult to verify because they rely on variables that cannot be seen through the UI of the SUT; the UI of the TAF is difficult to learn. The SUT architect is planning a major new release and they have offered to include features that will enhance its testability. You already have plans to deal with items 1, 2 and 3 on the list, so now you are considering how you might mitigate items 4, 5 and 6. Which TWO improvements will BEST address items 4, 5 and 6? a. Add an event mechanism to the SUT which the TAF can subscribe to. b. Adopt a set of standard setup and teardown methods. c. Add an API to the SUT that will make the internal variables will be observable. e. Update and improve the documentation of the TAA. Implement hard-coded waits in scripts that have been affected by slow SUT response.

Topic 1 You have been recruited as a TAE by a large travel agency and are now responsible for a mature TAS that is dedicated to functional testing of the company’s booking system, which covers flights, hotels, and packaged holidays. This application contains a complex UI and a lot of functionality. It is undergoing constant maintenance and enhancement by an agile team that add tests to the regression test suite at the end of every iteration. The TAS supports structured scripting and this has been implemented to a high standard, with a well-managed script library and minimal code duplication. The TAA will not support any more advanced scripting techniques. The test automation that has been achieved so far was well received at first but is now the target of increasing criticism. It is perceived as being old-fashioned, poorly documented and in particular: the test script maintenance overhead is becoming excessive because the test analysts frequently want data values to be changed; test analysts are complaining that a new test which is similar to an existing one (except for data values) requires a new high-level script, and that they must ask a technical test analyst to do this for them; the nightly full regression run is taking a long time and there is a risk that, as more tests are added, it will soon take too long to run in the available window; some tests break frequently because of a slow response from the SUT; some transactions are difficult to verify because they rely on variables that cannot be seen through the UI of the SUT; the UI of the TAF is difficult to learn. Your new manager wants quick improvements to address items 1, 2 and 3. She has accepted that the TAA may need to be enhanced to support the improvements. Which TWO improvements will be BEST in this scenario? a. Transition the automation to data-driven testing. b. Transition the automation to keyword-driven testing. c. Adopt a set of standard verification methods. e. Review the test automation scripts for functional duplication.

You are a TAE responsible for a TAS that is used on several products, all of which have complex UI’s. A substantial proportion of the automated tests break on a regular basis, usually for reasons associated with the UI. The investigation and maintenance this requires is significantly reducing the productivity of the teams and the return on investment. You are looking for ways to improve the test cases in this TAS. Which of the following approaches would be MOST appropriate? a. Artificial intelligence. b. Test histograms. c. Reliability growth modelling. d. Schema validation. Operational profiles.

You are a TAE responsible for a TAS that is used on several products, all of which have simple UI’s and utilize a range of API’s. Automation of the regression test suites for these products is generally going well, with repeatability and pass rates both at high levels. These regression suites include a large quantity of tests and the volume of code that has been written for them is substantial. You are looking for ways to improve the test cases in this TAS. What approach would you use FIRST?

Which statement about static analysis is TRUE?

When looking for the cause of an intermittent failure, which action is MOST likely to help?

What outcome can happen as a result of a high level of test tool intrusion?

You work as a TAE for a software vendor that produces bespoke software. Your current project is developing a process control system where data from sensors on the factory floor and human input through a web-based front end, undergoes processing on backend platforms. This results in control instructions that are sent to the production line via a message broker. Your test environment contains all of these components, including the sensors which run in a test harness. These sensors are third-party components that are still under development, so they are often upgraded. The message broker is also a new third-party component which is still receiving regular patches. This requires frequent re-installation of the TAS which takes significant manual effort and there have been several occasions where it was not built correctly due to missing components and had to be rebuilt. Which action is MOST likely to solve this issue with the TAS?

You work for a company that produces a credit checking software package. This product comes in three variants, each of which is tailored to the meet the rules and attitudes of lending and borrowing money for a particular group of countries. Each variant has two different versions at any one time: the current live release, and the next release which is under development. Each variant has its own test environment; these environments are built on different platforms to reflect the diversity of real customer platforms. A single TAS meets the automation needs of all three variants, with configurable features that allow for the platform differences. The SUT’s test requirements are expanding rapidly and the TAS often needs enhancement to support this. The SUT’s platforms are also changeable, due to updates from their vendors or a desire to sample different ones. After any change, the TAS is re-installed from a central repository with automated scripts that implement the configuration parameters for the target environment. Following this, it has often been impossible to run tests properly or even at all and the installation has had to be repeated after the cause has been found. Which of the following actions are MOST likely to solve this issue?

Which items should be included in a report that is produced after execution of a test suite?

You are employed as a TAE on a project to build a purchasing system. The main requirements for the system are to: Allow users to enter details of items that they wish to have purchased and, from these details, create a purchase request. Take each purchase request through a workflow that will allow the requestor’s line manager to approve the request, reject it or return it for clarification / modification. Forward approved requests to the Purchasing Department. Allow purchasers to find the best available supplier and place the request on that supplier as a purchase order. Requirement 1 has now been delivered and has been satisfactorily tested manually. In parallel, you have developed a TAS so that functional suitability testing can be automated. The functional suitability testing of Requirement 1 has now been automated as fully as possible. A change to add audit logging of user activity is planned but has not yet been made. After a small change to the UI code, the last regression run contained a significant number of unexplained test failures and at the point the test stopped, the actual and expected results showed no discrepancies. In each case, the run was able to continue with the next test in the suite. Preliminary investigation showed that the points at which these tests stopped had nothing obvious in common. Which option below contains the BEST next steps to investigate this?

Your TAS is being used for automated functional suitability testing of a stock management system. Several tests have crashed. Despite the fact that the SUT creates detailed logs of all its activity, it has been difficult to determine the reason(s) for these crashes from the TAS and SUT test logs. What actions are MOST likely to help with debugging? a.Ensure that the TAS logs a count of how many times each test case is run. b.Ensure that the SUT logs all available configuration data when it starts up. c.Ensure that the SUT logs all available crash dumps and stack traces in the event of failure. d.Ensure that the SUT logs all values of randomly-generated test input data. e.Ensure exact time synchronization of all test logs before any tests are run.

You are working for a clothing retailer that has big stores in many cities. Your TAS, for the first time, been just been used for reliability and stress testing of the overnight batch processing that collects sales transactions from the stores and adds them to a data warehouse; functional suitability tests have been re-used for these runs. All tests have finished normally but their results have not been satisfactory; and it has been difficult to understand the nature of the defect or defects that have been causing the failures. What data, if added to the test logs, would MOST likely help with debugging in this situation? a. Dynamic data about the status of the test platforms. b. Screen shots taken during test execution. c. Crash dumps and stack traces. d. Values of randomly-generated test input data. Counts of the quantity of test cases executed during each run.

What does contract testing verify?

When is automated API testing BEST performed?

When would you be MOST likely to store a test environment configuration with other testware?

In which way would a feature toggle configuration be used?

Which statements about a continuous integration / continuous deployment (CI/CD) pipeline are TRUE? a. The pipeline can contain configuration tests for the TAF/TAS. b. The pipeline cannot contain configuration tests for the TAF/TAS. c. Component and component integration tests should be run separately. d. The pipeline can contain system integration tests. e. The pipeline cannot contain system integration tests.

Which factor will support maintainability of test automation solutions?

When a continuous integration / continuous deployment (CI/CD) pipeline is split between build and deployment phases, which statements are TRUE? a. Component and component integration tests are part of the deployment phase. b. System and higher-level tests may be part of the build phase. c. Component and component integration tests are part of the build phase. d. System and acceptance tests may be executed in a separate pipeline. e. System integration tests cannot be run in this kind of pipeline.

Which factor will support maintainability of test automation solutions?

You are employed as a TAE on a project to build a purchasing system. The main requirements for the system are to: Allow users to enter details of items that they wish to have purchased and, from these details, create a purchase request. Take each purchase request through a workflow that will allow the requestor’s line manager to approve the request, reject it or return it for clarification / modification. Forward approved requests to the Purchasing Department. Allow purchasers to find the best available supplier and place the request on that supplier as a purchase order. Requirement 1 has now been delivered and has been satisfactorily tested manually. In parallel, you have developed a TAS so that functional suitability testing can be automated. You have just conducted a pilot of the TAS on the implementation of Requirement 1 and several things went wrong: One test failed because some reference data that it needed was missing, this and several other failures were difficult to diagnose. Another test failed unexpectedly because an old version of the script was used. Which THREE measures could mitigate these risks during deployment? a.Full test logging down to and including trace level b.Identification and correct configuration of all firewalls c.Automated creation and loading of all data to meet test preconditions d.Provision of proper device configuration plans e.Careful packaging with thorough configuration management

You are employed as a TAE on a project to build a purchasing system. The main requirements for the system are to: Allow users to enter details of items that they wish to have purchased and, from these details, create a purchase request. Take each purchase request through a workflow that will allow the requestor’s line manager to approve the request, reject it or return it for clarification / modification. Forward approved requests to the Purchasing Department. Allow purchasers to find the best available supplier and place the request on that supplier as a purchase order. Requirement 1 has now been delivered and has been satisfactorily tested manually. In parallel, you have developed a TAS so that functional suitability testing can be automated. You now intend to use the implementation of Requirement 1 as a pilot for the TAS. Which TWO objectives are MOST appropriate for this pilot? a. Generate prototypes for the implementation options of the TAS. b. Demonstrate the suitability of at least one TAS implementation option. c. Expose any risks to further deployment of this TAS. d. Assess the quality of the implementation of Requirement 1. e. Enable a calculation of the likely return on investment for this TAS.

Which option correctly pairs test automation design principles and patterns with their characteristics? a.Hides implementation details to expose only what the testers need to create in their test cases. b.Creates a class file so that updates to locators need to be made in only one place. c.Includes the idea that components should be freely substitutable with no adverse impact. d.Introduces an additional facade which stores user actions that interact with page objects. 1.Facade pattern. 2.SOLID. 3.Flow model. 4.Page object model.

You are working as a TAE for a large insurance company that offers a wide range of products including home, health and motor insurance. Your next project will be a major change to the existing system for processing policy claims. The project’s objective is to provide more flexibility in the process for claim authorization, according to type of policy and nature of claim, so that simple claims can be processed faster. It will follow a hybrid methodology with development and testing completed in 3-week iterations. The most important functional and non-functional tests for the existing system have been automated. The older tests feature structured scripting, but the more recent ones have benefited from data-driven testing. Which automation approach for the system-level tests would be MOST suitable for this project?

You are working as a TAE for a small start-up insurance broker and your next project will be a new system for generating motor insurance quotes. The project will follow an Agile methodology. The stakeholders are keen to get it into production, but are realistic about the need to allow enough time for thorough testing and support automation of tests where appropriate. Which approach for automating the tests would be MOST suitable for this project?

Which statement about layering in a test automation framework is TRUE?

Which statement correctly describes what a Test Automation Architecture should do?

Which ONE of the four layers of the test automation architecture provides an optional capability?

Topic 1 Your company is about to start a project to replace an old sales and merchandising system with a new version that will be based on modern platforms. The main requirements for the system are: Loading sales data, sent electronically from the stores each evening, into a central database. Producing sales reports for the merchandisers, whose job is to manage stock levels in stores. Producing forecast reports, used to predict future demand for each product, based on a combination of sales history and forecasting parameters. The parameters will be entered by the merchandisers into a browser-based front end and the reports will be produced overnight. The users will be able to retrieve the reports, on screen or in print, via an interactive feature. Requirements 1 and 2 were already met by the old system and will be rewritten in the new system with some minor functional changes. The sales data will, as before, be loaded in an overnight batch run. There have been problems with the old system at peak periods when this run has taken longer than scheduled, so that dependent jobs could not finish before the start of the next working day. The Data Centre manager requires that the new system’s overnight batch runs take 10% less time than the old one, including the new reports, to allow time for all jobs to complete. Requirement 3 is new. The functionality provided by the UI will be simple and the Sales & Merchandising manager requires that it be easy to use. The data for testing the reports will be extracted from the old system in production and will be anonymized before use. The system will be developed using an Agile lifecycle with iterations of fixed length; this will be the first full deployment of this methodology, which has just completed a successful pilot. It is a relatively simple development and is expected to be completed in three releases, each taking approximately 2 months. You are an experienced TAE and have been recruited to implement test automation on this project and have started to evaluate candidate tools to automate functional and some non-functional testing. It is already clear that no single tool will meet all requirements; and that the developers’ existing Integrated Development Environment will meet the automation needs of their testing. The TAS will need to support CI/CD. When reviewing your tool comparison table, what TWO tool capabilities will be MOST beneficial for this project? a. The ability to support multiple and configurable test environments. b. The ability to manage test data in a way that supports version control of the data sets. c. The ability to be compatible with other tools that are likely to be used on the project. d. The ability to expand overall test architecture and to be scalable and modifiable. e. The ability for non-technical users to enter requests for customizable reports.

Your company is about to start a project to replace an old sales and merchandising system with a new version that will be based on modern platforms. The main requirements for the system are: Loading sales data, sent electronically from the stores each evening, into a central database. Producing sales reports for the merchandisers, whose job is to manage stock levels in stores. Producing forecast reports, used to predict future demand for each product, based on a combination of sales history and forecasting parameters. The parameters will be entered by the merchandisers into a browser-based front end and the reports will be produced overnight. The users will be able to retrieve the reports, on screen or in print, via an interactive feature. Requirements 1 and 2 were already met by the old system and will be rewritten in the new system with some minor functional changes. The sales data will, as before, be loaded in an overnight batch run. There have been problems with the old system at peak periods when this run has taken longer than scheduled, so that dependent jobs could not finish before the start of the next working day. The Data Centre manager requires that the new system’s overnight batch runs take 10% less time than the old one, including the new reports, to allow time for all jobs to complete. Requirement 3 is new. The functionality provided by the UI will be simple and the Sales & Merchandising manager requires that it be easy to use. The data for testing the reports will be extracted from the old system in production and will be anonymized before use. The system will be developed using an Agile lifecycle with iterations of fixed length; this will be the first full deployment of this methodology, which has just completed a successful pilot. It is a relatively simple development and is expected to be completed in three releases, each taking approximately 2 months. Until now the company has not automated test execution, but the Agile pilot identified this as a critical success factor. You are an experienced TAE and have been recruited to implement test automation and you are now considering what the TAS for this should look like. Which option contains the TWO MOST important considerations in determining the nature of the TAS that will be needed for this project? The tool(s) chosen for functional test automation should support scripting techniques that will be compatible with a performance test tool. The tool(s) chosen for functional test automation should support scripting techniques that will be useful for usability testing. The TAS should support testing at the component integration, system, system integration and acceptance levels. The TAS should support testing at the component, component integration, system and acceptance levels. The TAS should support the handling of the large quantities of data that will be needed to test the forecast reports.

What would be a goal of test automation in a local development environment?

What would be a goal of test automation in a preproduction environment?

Which part of the SUT can be changed to better support test automation

When choosing an automation tool, which would be the BEST option for automation testers who have programming skills?

How is automation typically applied in a Waterfall lifecycle model?

What is considered to be an ADVANTAGE of test automation?

Which of the following is considered a disadvantage of test automation?

Which of the following is an important success factor for any significant automation project?

You are working as a TAE for a company who are re-designing their website. The new website provides information for customers and there are two minor features being developed: Request a newsletter - Ability to contact the organisation with a question or comment The website must be “mobile friendly” and available on all major web browsers. You have been tasked to provide an automated solution for web browsers only and to concentrate on the two minor features. What would be a KEY challenge with automation in this context?

You are working as a TAE for a company who have been using a web test execution tool for a number of years. The tool has been used successfully on ten web applications in the past. The company are developing a new web application which has a friendly User Interface, but the developers have used an object throughout the application which the tool is unable to recognise. As a result, you have no way of capturing the object or verifying the contents using the automation tool. What is the first thing you should do about this problem?

Topic 1 You are evaluating several test modelling tools and are wanting to automatically generate test cases within the tool where many different combinations of input data are created. You are then wanting to export the test cases into a .csv file which can then be read by a functional test execution tool using a data-driven or keyword-driven scripting method. You have investigated several tools and there is only one tool that provides all the necessary features defined by your team with the exception of the export facility. It does not provide an export into either .xls or .csv formats. What would be the BEST next step regarding the selection of this tool?

When the SUT provides insight into the behaviour of the system, providing the users the with the status of the various actions performed so that they can check that expected behaviour equals actual behaviour, what is this called?

When the SUT provides interfaces that can then be used to perform actions on the SUT, what is this called?

What are the four horizontal layers of the gTAA?

You have been asked to develop test automation for a legacy system that is going to go through a series of infrastructure migrations. The scripts will be used to verify basic functionality during these infrastructure changes. Your Test Analysts have some programming skills and need a solution that is simple and fast. Maintainability of the scripts is not a consideration because no changes to the software are anticipated. Which of the following is the BEST scripting approach in this situation?

If model-based testing has been selected for the overall test automation approach for a project, how does that influence the layers of the TAA?

What is the PRIMARY advantage of using abstraction in the TAA?

When if the BEST time for automation to consider legal and/or standard requirements for a SUT?

You are working on a web-based application called Book Vault that allows people to upload books and order books. This application must be available on all major browsers. You have been testing the application manually and management have asked you to consider automating some of the tests. You have investigated a number of commercial and free tools which can automate tests at a web browser level and one tool in particular meets your requirements and you have implemented a trial version. You have basic programming skills and the main goal is to automate a few functional tests to see if the tool is compatible with the application and can recognise the objects and controls. Which scripting technique would be MOST suitable in this scenario in order to meet the objectives?

You are working on a government system called “Making Tax Digital” or MTD for short. This system is being implemented to stop manual human input error and also to reduce fraudulent behaviour from companies when submitting their tax and VAT returns. The key concept is that registered companies will need to use government recommended 3rd party software for their accounts and book keeping. These 3rd party applications will have a direct interface into the government’s main system for transactions and submissions. You have been using a test execution tool successfully on the project so far, and have implemented a basic “capture/replay” approach to scripting. The management have been encouraged with the automation so far, but want the following objectives to be met: Test cases added easily - Reduction in the amount of scripts and script duplication Reduction in maintenance costs - Which scripting technique would be MOST suitable in this scenario in order to meet the objectives?

You are implementing test automation for a project that has a business critical application. A test execution tool is being used to run automated regression tests. The results from the test execution tool are very important and need to be 100% accurate. You want to merge the test automation results with the test management system that also records the manual test results so that managers can make informed decisions about the progress quickly. Which layer of the gTAA will be used to ensure the proper reporting occurs and the interfaces to the test management system are handled?

You are implementing test automation for a project and you want to be able to generate test cases automatically using a series of test design tools which use a variety of test design techniques such as decision tables, pairwise testing and boundary value analysis. You also want to generate test data automatically which can then be used by the tests. Initially these tests will be run manually to verify their correctness and ultimately you want to include them in the test execution tool so that they can run unattended. Which layer of the gTAA will be used to support the specification of the test cases and preparation of the test data?

In order to achieve re-use of a TAS, where SHOULD the design for reuse occur?

You have investigated a new tool which enables the modelling of the SUT and can then generate test cases either manually or automatically. You have convinced your managers that the best way forward is to conduct a pilot project for this tool. You need to select a project to use for the pilot. You have the choice of the following projects: Project A: A two-year project that is critical to the business and is currently in the requirement phase. This project is for a new e-commerce web site and is mostly being developed “in-house” although the payment system is being developed and delivered by a 3rd party provider. Project B: A safety critical application for software to drive and park cars. Project C: An upgrade to an important HR timesheet tracking application that will be available on a desktop and mobile application. This is a 1-month project developed in-house. Project D: The payment system from project A. Which project would be BEST for the pilot?

You are planning the pilot for an in-house developed Test Automation solution (TAS). Which two of the following would be important steps to take as part of the planning process? a.Review your organisation’s current projects and identify which one would be most suitable to pilot the TAS. b.Ensure that the developers will provide the necessary commitment for the TAS deployment activities. c.Run a series of training workshops for new users of the TAS before they are asked to use it. d.Develop a project plan for the pilot and reserve the necessary budget and resources for its implementation. e.Ask the developers to provide any missing functionality during the deployment activities.

You have inherited a TAS that is working well. It uses keyword-driven scripting and was well architected. The automation architect who built the system has now moved on to another company. The TAS is working across several projects and has a multiple library of keywords, categorized by project. The individual project teams maintain these keyword scripts. Based only on the given information, what is the MOST significant risk for the TAS?

Your organisation has successfully implemented a Test Automaton Solution (TAS) for a new project which has since been delivered into production via a number of sprints. A series of maintenance releases are now planned. Some improvements were made to the Test Automation Architecture (TAA) as a result of feedback from the early sprints. The TAA improvements affected the TA, and the TAS was changed for the final sprint. The new version of the TAS was generally well received but some performance and usability issues were encountered with the TAS which have yet to be addressed. The test automation engineers supporting the maintenance releases must decide whether to use the enhanced TAS or the version that was used successfully for previous sprints. What is the BEST action to take next?

A major component of your organisation’s Test Automation Solutions (TAS) is a popular open-source third-party capture-replay tool for automated functional testing. Which two of the following must the Test Automation Engineer (TO) ensure happens for this TAS? a.The third party tool is placed under configuration management control. b.The annual support and maintenance costs are agreed with the tool’s vendor. c.It is important to obtain information about updates and new versions of the tool so that the third party tool is kept up to date. d.Ensure that the TAS test scripts are integrated into the tool’s framework. e.Ensure that no changes are made to the tool, because modifications are not allowed for third party products.

As the TAE, you are working with the organisation’s Test Manager to decide which external metrics and which internal metrics should be gathered for the new TAS. Which of the following represents the BEST internal metric that would help measure the quality of the TAS and the number of problems associated with the TAS?

You have been asked to implement test automation for a project that is not meeting its deadlines. After further analysis you discover that the manual testers are not able to keep up with the new feature testing because the regression testing is taking 75% of their time. As a result, the new features are being released with many defects and customers are complaining about the quality. Given this information, what metric SHOULD you be tracking to show the value of test automation for this project?

The Test Automation Manager has asked you to provide a solution for collecting metrics from the TAS that measures code coverage every time the automated regression test pack is run. The metrics must be trend based to ensure that the scope of the regression test pack continues to reflect enhancements made to the SUT - coverage must not drop and should ideally increase. The solution must be as automated as possible to avoid unnecessary manual overheads and errors. Which of the following approaches would BEST meet these requirements?

Your functional regression test automation suite ran successfully for the first two sprints and no failures were encountered during the runs. The automation suite records the status of each test case as either ‘pass’ or ‘fail’ and has excellent recovery capability built in. For the third sprint, the TAS log reported several test cases with a status of ‘fail’. You investigated each test case and found that most failures were due to a defect in one of the keyword scripts, rather than in the SUT. For those where the failure was in the SUT, defect reports were raised but several were returned by the developers asking for more information to enable them to reproduce the problem. Which additional log items SHOULD you add to the TAS that would BEST improve failure analysis and defect reporting for future sprints? a.Dynamic measurement information about the SUT. b.A status of ‘TAS error’, in additional to ‘pass’ and ‘fail’, for each test case. c.Use of a colour coding scheme so that ‘pass’ is in red and ‘fail’ is in green. d.A counter to determine how many times each test case has been executed. e.System configuration information including software/firmware and operating system versions.

Which of the following describes how a test execution report is likely to be used?

If you are tracking the frequency that a test automation code reports a defect that is not really a defect, what metric are you gathering?

You are implementing a TAS for a system that has been live for over three years, using a hybrid waterfall and agile lifecycle. Live updates are made on a monthly basis. There is no test team, with developers designing and executing unit and integration tests with some degree of automation and business analysts designing and executing manual tests at the system level. No formal test process exists, although the system has proved relatively stable for most of the time. Unfortunately, the last two monthly releases were problematic with regression defects found in production. Your priority is the automation of functional regression tests at the system level, the budget for this has been approved by project stakeholders. The Business Analysts have identified which test cases are most suitable for regression. You must use the organisation’s long standing commercial automation tool which has passed a proof of concept in the platform for the system in question. Which of the following suitability criteria needs the MOST attention for the TAS?

Your project is transitioning from manual to automated testing. You have decided to implement a pilot project so that lessons learned can inform future time estimates and schedules. Which two of the following represent the types of test cases that are MOST suited to a test automation pilot project? a.High added value test cases that require little effort to automate. b.Test that are run infrequently as these will be simpler to automate. c.Reliability test cases that can show added value soon. d.Technically challenging test cases to provide the best validation of manual test conversion. e.Tests that are least important to the business as these are safer to trial.

What represents good practice when automating a manual regression test suite?

New features have been added for the current release of a SUT. Which action would NOT be appropriate for the TAE to perform when evaluating the impact on the TAS?

Which of the following CORRECTLY describes how automation SHOULD be applied to confirmation testing?

You are a TAE working for a software house which provides quarterly releases of its software to its customers. There are many different versions of the SUT that need to be tested simultaneously by different tests teams. Your TAS is complex and you need to ensure it remains consistent across the different SUT environments. What is the BEST and MOST efficient way to ensure each of the test teams use the same version of the TAS to test the different versions of the SUT?

Your company is new to test automation and as TAE, you have designed a TAS which successfully supports the SUT for the current project. There are other systems currently in operation which have been tested manually and more systems are planned over the coming years. Based on this success, your company requires test automation be rolled out to other current and future SUTs with consistency being a key objective. Which of the following is the BEST way to achieve that?

You have executed an automated test suite for a product that was released into production. Although all the tests passed, there was a major failure in production in an area that was covered well by your automated tests. You have run the automated tests again and one of the tests is now failing and this is directly related to the production defect that was raised. You decide to run the automated test suite again on the same version of the SUT and the test now passes. What SHOULD you do now to verify the validity of the automated tests?

Topic 1 You are the TAE for an Agile project which has six sprints for the current release. Sprint five is underway and the automated regression suite is due to start later today. You have re-examined the results from the automated regression runs for the past four sprints. You notice that two test cases both reported a pass for sprints 1 and 4 but a fail for sprints 2 and 3. The failures have gone undetected and are therefore unexplained. Both test cases are closely coupled with other tests in the suite. What course of action SHOULD you take?

You have implemented a keyword-driven scripting framework, which uses a test execution tool to run the tests. This has been in use for the past year and all of the teams now use this framework as the standard approach for test execution. The teams all work on different aspects of the SUT and they have all experienced significant benefits in the use of this scripting framework. However, on closer examination, you have discovered that there are numerous instances where the teams have the same functionality to test but are using different keywords. One of your objectives for improvement is to create consistency among the teams. What is the BEST way to handle this situation?

You are testing a major enhancement to an air traffic control user interface. You have use of a sophisticated pre-production test environment, created specifically for large scale automated regression, performance and security testing. The window for regression testing is limited and must successfully conclude, with no major regressions remaining, before the non-functional testing starts. You have been using the same version of the TAS for the last few releases, each time completing the automated regression test suite in a single overnight run. However, due to the latest enhancements for the SUT, you believe there is a risk that the test suite may no longer complete overnight and therefore delay performance and security testing. Which option would be the BEST and MOST cost-efficient approach to mitigate this risk?

Your TAS has been running successfully on a Windows/GUI based SUT for some years. The SUT has undergone minimal change over the years to maintain business as usual, deploying six-monthly releases for minor enhancements and bug fixes using a waterfall lifecycle. The TAS has not changed at all during this period. The current project for the SUT will be using the Scrum methodology to deliver a more modern, competitive, user interface. It is in the release planning stage with an agreed release backlog and set of sprints outlined. The move from lengthy waterfall releases to shorter sprints has led you to conduct a review of the current TAS to make sure it is robust and fully optimised for the timescale challenges of the new project. What two steps would be BEST to undertake during the review? a. Ensure that new automation code is using the same naming conventions as existing code. b. Perform a full regression run in Sprint 1 to identify what improvements could be made to the TAS for c. future sprints. d. Ensure that the TAS is using the latest libraries for the operating system. e. Review the functions that act upon the controls for the GUI for possible consolidation.