3.2.6 - Testing and Running a Solution

Errors
1. Syntax
  1. Occurs when a statement has been written that breaks the rules of that programming language.
  2. Common Syntax Errors:
    1. Missing or extra punctuation.
    2. Not enough arguments.
    3. Missing part of a multi-line statement.
    4. Using unrecognised identifiers.
    5. Type mismatch.
2. Logical
  1. Occurs because of a mistake in the algorithm that results in the program doing something other than what's expected to do.
  2. Don't usually produce error messages.
    1. Discovered because the computer is producing unexpected results.
  3. Other common causes are:
    1. Instructions in the wrong order.
    2. Incorrect conditions for IF statements or Loops.
3. Run-time
  1. Occurs due to an unexpected situation with the data being processed.
    1. The program would otherwise work normally.
    2. Generally occur when the computer attempts impossible arithmetic operations.
  2. Other common causes are:
    1. Overflow error
      1. Uses a variable to store a value to large for it.
    2. Stack overflow error
      1. Program runs out of stack space to store operations.
    3. Library error
      1. Referring to an external library that does not exist.
  3. Exception Handling
    1. Handles errors that are unavoidable.
      1. Reading from a file that has been deleted.
      2. Dividing by zero.
Types of Testing
1. White Box
  1. Tests the algorithm to make sure it functions as intended.
  2. Focused on testing every path of execution through a program.
  3. Path of execution is noted, so it can be compared with other runs.
2. Black Box
  1. Inputs and Outputs
    1. Not how the program works.
    2. Test every possible input.
      1. Are the results expected?
  2. Three types of input data to consider:
    1. Valid Data
      1. Data you would expect to be input.
    2. Invalid Data
      1. Data which would generate an error message.
    3. Borderline Data
      1. Testing data at the boundaries between both cases.
3. Alpha and Beta
  1. Carried out when the software is nearly complete.
  2. Applies to commercial software being developed for external users.
  3. Difference resides in the stages and the tester.
    1. Alpha
      1. Limited to be tested by internal employees and friends/family of the company.
      2. Very early version of the software.
        Normally full of bugs.
    2. Beta
      1. Opened up to a wider audience.
      2. Almost in a finished state.
        Normally test things such as load balancing.
4. Acceptance
  1. Demonstrates to the end user that the software works correctly.
    1. All desired features have been implemented.
  2. Takes place after all development and testing is complete.
    1. The software is ready to be handed to the end user.
  3. Software is tested against all requirements.
    1. Until the user accepts the software is what is originally requested.
Running Solutions
1. Dry Runs
  1. Used to locate the cause and location of an error.
    1. You go through the code manually executing and recording each line of code.
  2. Use a trace table to keep track of all the variables.
2. Debugging Tools
  1. Translator Diagnostics
    1. Messages generated by the translator, while it's translating the source code into object code.
    2. Often includes warnings where there might be a logic error.
  2. Break Points and Stepping
    1. Breakpoints mark lines of code, requesting the program stops running when it gets to that line.
  3. Variable Checks
    1. Programmer can request variables to be checked at any time in the program.
      1. This allows the programmer to compare the value to what it should be at that time.
3. Installation Routine
  1. Installing the program.
  2. The routine does the following:
    1. 1. Checks if there is enough space.
    2. 2. Program copied to destination folder.
      1. Data files are copied with it.
    3. 3. Library files are copied and registered.
    4. 4. Executable file will create shortcut.
    5. 5. Allow user to configure and customise installation.
    6. 6. Configuration saved in system registry.

Next up

3.2.6 - Testing and Running a Solution

Description

Resource summary

Similar

	Created by AndrewZV about 10 years ago