使用權重方法於圖形使用者介面測試個案優先排序之分析與設計

Analysis and Design of GUI Test Case Prioritization Using Weight-Based Methods

張永欣(Yung-Hsin Chang)

指導教授 ： 黃慶育

國立清華大學/電機資訊學院/資訊系統與應用研究所/碩士(2008年)

摘要

測試圖形使用者介面的應用程式比起測試傳統以程式碼為基礎的程式還要複雜許多，其原因為測試圖形使用者介面程式不但要考慮底層的程式碼的執行。而且為了驗證所有可能由事件組成的圖形使用者介面輸入序列組合，測試人員需要生成大量的圖形使用者介面測試個案來達成其測試的足夠性。但是想要在有限的時間跟資源下，把所有的圖形使用者介面測試個案跑過，並且把找到的錯誤都修復完，可能會造成軟體專案時程的延誤。因此若能在早期測試過程中能儘早執行到找到較多錯誤的測試個案並且立即修復，可降低在測試後期才發現錯誤造成專案延後的風險。近幾年所提出的測試個案優先排序的技術都顯示可以改進在軟體測試過程中錯誤偵測的比率，然而針對圖形使用者介面測試個案的優先排序研究卻較少研究提出。在本論文中，我們提出權重為基礎的方法，產生具有權重的事件流程圖以及圖形使用者介面測試個案，來解決不具有權重的圖形使用者介面測試個案的問題。依據圖形使用者介面測試個案所分配到的權重數值，由高至低、由低至高、或是調整權重的排列方法，得到新的圖形使用者介面測試個案執行的優先順序，並且探討排序過後的錯誤偵測比率。實驗結果說明，權重數值依調整的方式排列會得到較好的錯誤偵測比率。

關鍵字

圖形使用者介面測試 ； 測試個案優先排序 ； 錯誤偵測比率 ； 基於權重方法

並列摘要

Testing the correctness of a GUI-based application is more complex than conventional code-based application. The underlying codes of the GUI application have to be tested and the space of possible combinations of events with a large GUI input sequence requires generating numerous test cases to confirm the adequacy of the GUI testing. Running all GUI test cases and then fixing all found bugs within time and budget constraints may delay project completion. Hence, it is important to order the test cases that uncover most faults early in the testing process. Test case prioritization has been used in recent years because they can improve the rate of fault detection during the testing phase. However, few studies have discussed GUI test case prioritization techniques. In this thesis, we propose a weighted event flow graph for solving the non-weighted GUI test case and ranking GUI test cases according to weight scores ordered by high-to-low, low-to-high, and adjusted scores. Our experiments show that the adjusted-weight method obtains better rates of fault detection.

並列關鍵字

GUI testing ； Test case prioritization ； Rate of fault detection ； Weight-based methods

參考文獻

[1] A. Memon, M. L. Soffa, “A Comprehensive Framework for Testing Graphical User Interfaces,” Ph.D. thesis, Department of Computer Science, University of Pittsburgh, 2001.

[2] A. Memon, M. E. Pollack, and M. L. Soffa, “Hierarchical GUI Test Case Generation Using Automated Planning,” IEEE Transactions on Software Engineering, Vol.27, No.2, pp.144-155, 2001.

[3] A. Memon, M. E. Pollack, and M. L. Soffa, “Using A Goal-Driven Approach to Generate Test Cases for GUIs,” Proceedings of the 15th International Conference on Software Engineering, (ICSE′99), pp.257-266, 1999.

[4] L. White, H. Almezen, and N. Alzeidi, “User-Based Testing of GUI Sequences and Their Interactions,” Proceedings of 12th International Symposium on Software Reliability Engineering (ISSRE'01), pp.54-63, 2001.

[5] F. Belli, “Finite-State Testing and Analysis of Graphical User Interfaces,” Proceedings of 12th International Symposium on Software Reliability Engineering (ISSRE'01), pp.34-43, 2001.