基於合作賽局的多類影像共分割方法

Multi-Class Image Co-segmentation Based on Cooperative Game Theory

黃一新(Yi-Sing Huang)

指導教授 ： 張隆紋

國立清華大學/電機資訊學院/資訊工程學系/碩士(2015年)

摘要

影像共分割在影像處理領域中是一種較新的分支，其目的是在一組輸入影像群組中，辨識並切割出相同或相似的物件。過去的研究大多數是以分割出二種類別為目標，也就是分割出一個共同物件，一般稱為前景，以及剩餘的背景，在這種前提下所提出的共分割方法無可避免地會受到一些限制。
本篇論文提出了運用聯盟式合作賽局的概念，來達成分割出多個類別的方法。聯盟式合作賽局代表在一個賽局裡，玩家可以組成聯盟以產生共同報酬。在我們提出的方法中，首先將影像分割為多個較小的區塊，並將這些區塊視為玩家，區塊們擁有與其他區塊結合的能力，相當於組成聯盟，聯盟的報酬即是他們相對於類別模型的分數。接著以聯盟合作賽局中的 Shapley Value 概念將報酬分配給各個聯盟成員，以決定這些區域該分配給何種類別模型來達到總體最佳分割，再利用這些分配結果訓練新的類別模型，如此將區塊分配與訓練模型迭代進行來獲得較高的分割準確率，達到最終的共分割結果。

關鍵字

影像共分割 ； 賽局理論

並列摘要

Image co-segmentation is a relatively new branch of image processing. The goal of image co-segmentation is to separate common objects or similar objects among input image sets. Most existing co-segmentation approaches focus on two-class segmentation,. It means they aim for separating only one common object of a class, usually called foreground, and the remaining background in each of input images. From this binary labeling premise those methods inevitably suffer from some limitations.
In this thesis, we propose a multi-class co-segmentation method which is in favor of coalition game theory. A game which is in a coalition form means that some players in the game can form an alliance to have a joint payoff. Our approach first over-segments input images and treat each region (superpixel) as a player; each region has the ability to ally with others regions to form a coalition. The payoffs of coalitions are determined by the scores of each class model. Therefore, we can take advantage of Shapley values to determine how the payoffs are being distributed among all coalition members. After assigning each region to one of the classes according to their scores, we can achieve the best segmentation result. Therefore, new class models can be trained by using previous region assignment. Performing those region assignment and model training iteratively, we can acquire better co-segmentation.

並列關鍵字

Image Co-segmentation ； Game Theory

參考文獻

[1] C. Rother, T. Minka, A. Blake, and V. Kolmogorov. Cosegmentation of Image Pairs by Histogram Matching Incorporating a Global Constraint into MRFs. CVPR, pp. 993 – 1000, 2006.

[2] C. Rother, V. Kolmogorov, and A. Blake. Grabcut – interactive foreground extraction using iterated graph cuts. In SIGGRAPH, 2004.

[3] S. Vicente, V. Kolmogorov, C. Rother. Cosegmentation Revisited: Models and Optinization. ECCV, pp. 465-479, 2010.

[4] Y.Y. Boykov, and M.P. Jolly. Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D images. ICCV, pp. 105-112, 2001.

[5] Y. Boykov and V. Kolmogorov. An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision. IEEE PAMI, vol. 26, no. 9, pp. 1124-1137, 2004.