Title:

Learning Effective Oracle Comparator Combinations for Web Applications

Authors:

Sara Sprenkle, Emily Hill, and Lori Pollock

Abstract:

Web application testers need automated, effective approaches to validate the test results of complex, evolving web applications. In previous work, we developed a suite of automated oracle comparators that focus on specific characteristics of a web application's HTML response. We found that oracle comparators' effectiveness depends on the application's behavior. We also found that by combining the results of two oracle comparators, we could achieve better effectiveness than using a single oracle comparator alone. However, selecting the most effective oracle combination from the large suite of comparators is difficult. In this paper, we propose applying decision tree learning to identify the best combination of oracle comparators, based on the tester's effectiveness goals. Using decision tree learning, we train separately on four web applications and identify the most effective oracle comparator for each application. We evaluate the learned comparators' effectiveness in a case study and propose a process for testers to apply our learning approach in practice.

Publisher:

IEEE

Book Title:

First International Workshop on Software Test Evaluation (STEV 2007) co-located with the Seventh International Conference on Quality Software (QSIC)

Pages:

372--379

Date:

October 2007

Project:

Web Application Testing

Document Type:

Conference Proceedings

Key Words:

oracles, web applications

Files:

[preprint: Adobe PDF] (134 KB)
[slides: Adobe PDF] (506 KB)

Bibtex Entry:

@inproceedings{123456789/177,
author = {Sara Sprenkle and Emily Hill and Lori Pollock},
title = {Learning Effective Oracle Comparator Combinations for Web Applications},
booktitle = {First International Workshop on Software Test Evaluation (STEV 2007) co-located with the Seventh International Conference on Quality Software (QSIC)},
pages = {372--379},
publisher = {IEEE},
month = {October},
year = {2007}
}