1
edit
Changes
→Roadmap to Version 0.3
([[Delta_debugging_framework|Back to Delta Debugging Framework]])
=Introduction=
<td bgcolor="#00FF00">Done.</td>
</tr>
<tr>
<td colspan="4"><strong>Test Framework</strong></td>
</tr>
<tr>
<td>Test Framework</td>
<td>We ideally need a way to allow users to specify the test(s) to be run easily without them having to modify the delta debugging module. </td>
<td>[[User:RichardChu|Richard Chu]]</td>
<td bgcolor="#00FF00">Framework completed. Based on my simplistic understanding of the design of the JUnit Framework. Except, no SetUp() or TearDown() capabilities.</td>
</tr>
<tr>
<td bgcolor="#FFFF00">Work in progress. Currently, it can theoretically find the failure inducing revision, and the minimal failure inducing set of directories, and the minimal failure inducing set files. It will also easily scale to find the minimal failure inducing set of code blocks and lines of code (when those changeset types get done) with only minor additions to one subroutine. Works in theory. Untested in practice.</td>
</tr>
<tr>
<td>Perform a controlled test of the framework to determine whether or not it works. Fix any bugs found that prevented the framework from properly working. Re-run tests. Validate the correctness of the results to ensure that the framework outputs the correct minimal set of failure inducing revision, directories, and files.</td>
<td>[[User:RichardChu|Richard Chu]]</td>
<td bgcolor="#FFFF00">This is a work in progress. It is able to find the last known good revision. I am indeterminate on whether or not it It can also find the minimal set of failure -inducing directories and files.</td>
</tr>
</table>
<br />
<table style="width: 100%;" class="standard-table" border="1" cellpadding="0" cellspacing="0">
<tr>
<td colspan="4"><strong>Milestone& Official Release</strong>
</td>
</tr>
<tr>
<tdcolspan="4">Version 0.1 is Feature Complete</td> <td>All of the tasks listed in the Roadmap to Version 0.1 are completed.</td> <td>---</td> <td bgcolor="#FF0000">This should only be marked green when All of the tasks listed in the Roadmap to Version 0.1 are have been completed.</td>
</tr>
</table>
=Version 0.2=
<td bgcolor="#FF0000"> </td>
</tr>
</table>
<br />
<table style="width: 100%;" class="standard-table" border="1" cellpadding="0" cellspacing="0">
<tr>
<td colspan="4"><strong>Milestone& Official Release</strong>
</td>
</tr>
<tr>
<tdcolspan="4">Version 0.2 is Feature Complete</td> <td>All of the tasks listed in the Roadmap to Version 0.2 are completed.</td> <td>---</td> <td bgcolor="#FF0000">This should only be marked green when All of the tasks listed in the Roadmap to Version 0.2 are have been completed.</td>
</tr>
</table>
=Version 0.3=
<td bgcolor="#FF0000"> </td>
</tr>
</table>
<br />
<table style="width: 100%;" class="standard-table" border="1" cellpadding="0" cellspacing="0">
<tr>
<td colspan="4"><strong>Milestone& Official Release</strong>
</td>
</tr>
<tr>
<tdcolspan="4">Version 0.3 is Feature Complete. All of the tasks listed in the Roadmap to Version 0.3 have been completed.</td> </tr></table> =Other Information= ==Other Tasks== These tasks may require being done in every version or may only have to be done only once. <table style="width: 100%;" class="standard-table" border="1" cellpadding="0" cellspacing="0"> <tr> <th>Task</th> <th>Description</th> <th>Assigned to</th> <th>Status</th> </tr> <tr> <td colspan="5"><strong>Source Documentation and Licensing</strong> </td> </tr> <tr> <td>Source Documentation</td> <td>All Unsurprisingly, the source code is not thoroughly documented. Before the end of this semester, by the time the project is due to be submitted, the tasks listed source code needs to be well documented. </td> <td>[[User:Elichak | Liz Chak]]</td> <td bgcolor="#FFFF00">There is some documentation in the Roadmap source files but not much. And it's not well documented.</td> </tr> <tr> <td>Source License</td> <td>As per the requirements, the delta debugging framework will be licensed under an open source license. Which one? we don't know yet. Though, before the due date of the project, we must select one and change the source files header comments as per the selected license's requirements.</td> <td>[[User:RichardChu|Richard Chu]], [[User:Ankuswan|Aditya Nanda Kuswanto]], [[User:Dwwoodsi|Dean William Woodside]]</td> <td bgcolor="#00FF00">Done. Decided to release the source code under the [http://www.opensource.org/licenses/gpl-license.php GPL Version 2 license].</td> </tr></table> ==Prerequisites to Testing== <table style="width: 100%;" class="standard-table" border="1" cellpadding="0" cellspacing="0"> <tr> <th>Task</th> <th>Description</th> <th>Assigned to</th> <th>Status</th> </tr> <tr> <td>Obtaination of Testcase 01</td> <td>We need a program that we could use to test the delta debugging framework. Ideally this program will be small but contain multiple source files. We need two versions of the program: a pristine working copy, and a version that has a regression.3 are completedNeed to know how to build the program.</td> <td>---[[User:Ankuswan|Aditya Nanda Kuswanto]]</td> <td bgcolor="#FF000000FF00">This should only Done. HelloWorld program has been created using the test modules ripped from Tinderbox. The test checks whether the program runs successfully by checking the log file it produces. The test has been uploaded to:svn://cdot.senecac.on.ca/deltatest</td> </tr> <tr> <td>Obtaination of Testcase 02</td> <td>We need a program that we could use to test the delta debugging framework. Ideally this program will be marked green when All small but contain multiple source files. We need two versions of the tasks listed program: a pristine working copy, and a version that has a regression. Need to know how to build the program.</td> <td>[[User:RichardChu|Richard Chu]]</td> <td bgcolor="#00FF00">Done. Going to use a C++ program I wrote in a course in a previous semester to test out the delta debugging framework. The test has been uploaded to:svn://cdot.senecac.on.ca/deltatest</td> </tr> <tr> <td>Creation of Test Case(s)</td> <td>We need test case(s) for the Roadmap test program that can return whether or not the test passes or fails so that we can test the delta debugger.</td> <td>[[User:RichardChu|Richard Chu]]</td> <td bgcolor="#00FF00">Done. The test case is real simple. It just tests the return code of a function with the expected return code. returns true/test passed if return code is equal to the expected return code.</td> </tr> <tr> <td>Creation of the necessary hooks into the framework</td> <td>The framework must be able to automatically build the test program and run the test case(s). So need to Version 0create the necessary hooks between the framework and test program.</td> <td>[[User:RichardChu|Richard Chu]]</td> <td bgcolor="#00FF00">Done.3 are completedMade real simple because of Build tree and Test framework.</td>
</tr>
<tr>
<td>Description of the test cases</td>
<td>The current test case is quite complex. A document is needed to introduce users on how to create test cases and utilize the algorithm.</td>
<td>[[User:Ankuswan|Aditya Nanda Kuswanto]]</td>
<td bgcolor="#00FF00">Done. The document and links to the testcases are located [[Delta_debugging_testcases|here]].</td>
</tr>
<tr>
<td colspan="5"><strong>Prerequisites to testing of SVN version of delta debugging framework</strong></td>
</tr>
<tr>
<td>Obtaination of test SVN Repository</td>
<td>We have an SVN repository that holds our delta debugging framework source files. We need another SVN repository that we could use to test our framework.</td>
<td>[[User:dwwoodsi|Dean Woodside]]</td>
<td bgcolor="#00FF00">Done. The URL to the test SVN repository is: svn://cdot.senecac.on.ca/deltatest</td>
</tr>
<tr>
<td colspan="5"><strong>Prerequisites to testing of CVS version of delta debugging framework</strong></td>
</tr>
<tr>
<td>Obtaination of test CVS Repository</td>
<td>When the CVS version of the framework is completed, it will be useful to have a test CVS repository that we could use to test our framework.</td>
<td>[[User:dwwoodsi|Dean Woodside]]</td>
<td bgcolor="#00FF00">The CVS repository has been created. The URL is hera.senecac.on.ca:43900/deltatest. <br />The web interface to the repository is: [http://hera.senecac.on.ca:43080/viewvc.cgi/?root=deltatest here]</td>
</tr>
<tr>
<td>Creation / Extraction of Test Case(s)</td>
<td>In the future, we would like to test our delta debugging framework on the Mozilla source tree. So it would be nice to find test cases that can test some functionality of the source code.</td>
<td>[[User:Ankuswan|Aditya Nanda Kuswanto]]</td>
<td bgcolor="#00FF00">Done. Ripped some preliminary test modules from Tinderbox. Test modules are currently used to test the HelloWorld testcase. The same modules can be used to test the success of future Mozilla build by testing the presence of Firefox executable.</td>
</tr>
</table>
==Legend==
<table style="width: 100%;" class="standard-table" border="1" cellpadding="2" cellspacing="0">
<tr><td colspan="4"><strong>Roadmap Status Legend</strong></td></tr>
