Delta debugging testcase 02

(Back to Delta Debugging Test Cases)

Name

Sudoku Test

Description

This test case compiles and runs the Sudoku program written in C++, made by Richard Chu for the Design Patterns class. The purpose of this test is to demonstrate how the algorithm build system can be customized to use other compilers or build systems in the host environment.

Repository

The test uses svn://cdot.senecac.on.ca/deltatest.

Components

SudokuBuild.pl

• Build Script.
• It builds the program, creating an a.exe file if compilation is successful.
• If the compilation fails, a.exe file will not be generated.

SudokuTestCase1.pm

• The Test Module.
• Wrapper around the real test case (SudokuTest.cpp located in the Sudoku folder). It runs the test case and reports the results of the test (pass or fail).

SudokuTest.cpp

• The actual test case.

deltadebugsudoku.pl

• Delta Debugging Script.
• Runs the Delta Debugging Algorithm to detect the failed test (in this case, wrong output from a function) and attempt to find the failure inducing changes.

Test Method

• Download the source code from the repository!. This test can't be run from the zipped source code.

 svn checkout svn://cdot.senecac.on.ca/deltatest 

• run deltadebugsudoku.pl

perl deltadebugsudoku.pl

• It should be able to find the last known good revision (revision 4)
• Fails on finding the minimal set of failure inducing directories and files. The reason for this is still being investigated. The suspected reason is inconsistent or unreliable test case.