基於SVM技術之非終止系統之智慧型測試判別器

Intelligent test oracles based on SVM for non-terminating systems

姚力瑋(Li-Wei Yao)

指導教授 ： 王凡

國立臺灣大學/電機資訊學院/電機工程學研究所/碩士(2011年)

https://doi.org/10.6342/NTU.2011.02977

摘要

無資料

關鍵字

測試判別器 ； 軟體驗證 ； 自動化 ； 支持向量機

並列摘要

A test oracle is a mechanism that decides whether an SUT (software under test) fails or passes a test case. Modern software IPs (intellectual properties) usually have a long life cycle and are subject to ever-changing requirements and operating environments. Especially, programs like operating systems, embedded systems, servers, etc. may never terminate and their test oracles need to monitor execution traces of unbounded lengths in order to issue correct test verdicts. We investigate how to use machine learning techniques to automatically construct test oracles for such non-terminating programs without reliance on explicit specifications. Firstly, we present a library, called InTOL (Intelligent Test Oracle Library), for the convenient and flexible collection of test traces. We can flexibly use either user guidance or program assertions to collect verdicts to test traces. Such verdicts are used as supervisory signals to the supervised learning algorithm (SLA) for a test oracle. Secondly, we present several sets of feature variables for the temporal relation among events in test traces of unbounded lengths. Then we present procedures that convert test traces into feature vectors, train an SLA with the feature vectors and their verdicts, and use the trained SLA as a test oracle. The approach is plausible since program traces are usually much easier to collect than formal specifications to construct. We report the implementation of InTOL on top of SVM (support vector machine). We experiment with two open-source benchmark SUTs from the internet to check the performance of our techniques. Our experiment data shows that high-accuracy test verdicts can be achieved with our test oracles for the benchmark SUTs.

並列關鍵字

oracle ； verification ； SVM ； automated

參考文獻

[1] K. Aggarwal, Y. Singh, A. Kaur, and O. Sangwan. A neural net based approach to test oracle. ACM

Software Engineering Notes, 29(4), May 2004.

[2] F. Belina and D. Hogrefe. The ccitt-specification and description language sdl. Computer Networks

and ISDN Systems, 16(4):311–341, March 1989.

[3] G. Booch, I. Jacobson, and J. Rumbaugh. OMG Unified Modeling Language Specification, Version