Incremental Construction of Counterexamples in Model Checking Web Documents

A new algorithm for incrementally generating counterexamples for the temporal description logic ALCCTL is presented. ALCCTL is a decidable combination of the description logic ALC and computation tree logic CTL that is expressive for content- and structure-related properties of web documents being verified by model checking. In the case of a specification violation, existing model checkers provide a single counterexample which may be large and complex. We extend existing algorithms for generating counterexamples in two ways. First, a coarse counterexample is generated initially that can be refined subsequently to the desired level of detail in an incremental manner. Second, the user can choose where and in which way a counterexample is refined. This enables the interactive step-by-step analysis of error scenarios according to the user’s interest. We demonstrate in a case study on a web-based training document that the proposed approach reveals more errors and explains the cause of errors more precisely than the counterexamples of existing model checkers. In addition, we demonstrate that the proposed algorithm is sufficiently fast to enable smooth interaction even in the case of large documents.

[1]  Mayur Naik,et al.  From symptom to cause: localizing errors in counterexample traces , 2003, POPL '03.

[2]  Burkhard Freitag,et al.  Temporal Patterns for Document Verification , 2013, WWV.

[3]  Alex Groce,et al.  SPECIAL S ECTION O N T OOLS A ND A LGORITHMS F OR THE C ONSTRUCTION A ND A NALYSIS O F S YSTEMS , 2005 .

[4]  Helmut Veith,et al.  Tree-like counterexamples in model checking , 2002, Proceedings 17th Annual IEEE Symposium on Logic in Computer Science.

[5]  Edmund M. Clarke,et al.  Efficient generation of counterexamples and witnesses in symbolic model checking , 1995, DAC '95.

[6]  施國琛,et al.  Sharable Content Object Reference Model (SCORM) , 2008, Encyclopedia of Multimedia.

[7]  C. R. Ramakrishnan,et al.  Model checking and evidence exploration , 2003, 10th IEEE International Conference and Workshop on the Engineering of Computer-Based Systems, 2003. Proceedings..

[8]  Burkhard Freitag,et al.  Verifying the consistency of web-based technical documentations , 2011, J. Symb. Comput..

[9]  E. Allen Emerson,et al.  Temporal and Modal Logic , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[10]  Marsha Chechik,et al.  Proof-Like Counter-Examples , 2003, TACAS.

[11]  Alex Groce,et al.  Understanding Counterexamples with explain , 2004, CAV.

[12]  Franz Weitl,et al.  Document verification with temporal description logics , 2007 .

[13]  Burkhard Freitag,et al.  Structured Counterexamples for the Temporal Description Logic ALCCTL , 2010, 2010 8th IEEE International Conference on Software Engineering and Formal Methods.

[14]  Burkhard Freitag,et al.  Towards the automated verification of semi-structured documents , 2009, Data Knowl. Eng..

[15]  Kavita Ravi,et al.  Minimal Assignments for Bounded Model Checking , 2004, TACAS.

[16]  Marsha Chechik,et al.  A framework for counterexample generation and exploration , 2005, International Journal on Software Tools for Technology Transfer.

[17]  Roger Villemaire,et al.  Specifying and Validating Data-Aware Temporal Web Service Properties , 2009, IEEE Transactions on Software Engineering.

[18]  Mirjana Jak.  Verication of Web-Content: A Case Study on Technical Documentation , 2009 .

[19]  Shin Nakajima.  Model-Checking Behavioral Specification of BPEL Applications , 2006, Electron. Notes Theor. Comput. Sci..

[20]  Ying Qin,et al.  Minimizing Counterexample with Unit Core Extraction and Incremental SAT , 2005, VMCAI.

[21]  WeitlFranz,et al.  Towards the automated verification of semi-structured documents , 2009 .

[22]  Nicolas Halbwachs,et al.  Tools and Algorithms for the Construction and Analysis of Systems , 2005, Lecture Notes in Computer Science.

[23]  Nachum Dershowitz,et al.  Verification: Theory and Practice , 2004, Lecture Notes in Computer Science.

[24]  Alex Groce,et al.  What Went Wrong: Explaining Counterexamples , 2003, SPIN.

[25]  Burkhard Freitag,et al.  Logic-based verification of technical documentation , 2009, DocEng '09.

[26]  Helmut Veith,et al.  Counterexamples Revisited: Principles, Algorithms, Applications , 2003, Verification: Theory and Practice.

[27]  Marco Pistore,et al.  NuSMV 2: An OpenSource Tool for Symbolic Model Checking , 2002, CAV.

[28]  Jaco Geldenhuys,et al.  Cheap and Small Counterexamples , 2008, 2008 Sixth IEEE International Conference on Software Engineering and Formal Methods.

[29]  Diego Calvanese,et al.  The description logic handbook: theory , 2003 .