next up previous
Next: Scenario 1: Clean Up: Evaluating Correctness and Previous: Evaluating Correctness and

Evaluating Functional Correctness Across Large Configuration Spaces

 

Our first study examine three scenarios in which we test different PSAs of ACE+TAO across its numerous configurations, exploring the following hypotheses:

  1. Our DCQA process helps to strengthen system-wide PSAs, such as portability and correctness.
  2. The DCQA process can be easily used to quickly identify problems with software portability and compile-/run-time customizations.

We implemented the DCQA processes using the model-driven Skoll environment and then installed Skoll clients and one Skoll server across 10+ workstations distributed across a network. All clients ran Linux 2.4.9-3 and used gcc 2.96 as their compiler (we used a single OS and compiler to simplify the initial study and analysis, but have since run other studies across multiple operating systems and compilers). We then applied functional correctness QA task scenarios to ACE v5.2.3 and TAO v1.2.3 to check for clean compilation and perform regression testing with both default and configurable run-time options.





Douglas C. Schmidt
Fri Sep 3 13:41:43 CDT 2004