應用於布阿松迴歸模型的EM改變點迴歸演算法

An EM Change-Point Algorithm for Poisson Regression Models

鄭乃瑜(Cheng Nai-Yu)

指導教授 ： 張少同

國立臺灣師範大學/理學院/數學系/碩士(2016年)

https://doi.org/10.6345/NTNU202204087

摘要

布阿松迴歸(Poisson Regression)是一種使用於計數型資料(Count Data)的迴歸分析模型，此模型已被廣泛應用於保險、生物、經濟、醫學及工程等領域。
在群集分析(Clustering Analysis)的領域，當資料具備某種機率分配特性時，EM 演算法是最常被使用，也是公認最實用且有效估計最大概似估計(Maximum Likelihood Estimate)的方法。
一般來說，改變點迴歸模型(Change-Point Regression Models)是使用於探測資料中改變點的位置，類似於使用排序的資料分群，很適合運用群集的方法。然而，在改變點迴歸模型中，EM理論卻很少被應用於估計改變點的位置。因此，我們考慮應用EM理論估計有改變點的布阿松迴歸模型。
在本篇論文中，我們提出了一個新的方法叫做EM改變點迴歸演算法 (EM Change-Point Regression Algorithm)，應用於布阿松迴歸。經由假設改變點為未知的變數，透過極大化最大概似估計函數，我們應用EM改變點迴歸演算法(EMCPR)估計改變點的位置以及布阿松迴歸模型的參數。我們同時也提供了模擬資料測試結果以及真實資料分析。結果顯示EM改變點迴歸演算法(EMCPR)是一個有效且實用的改變點迴歸演算法。

關鍵字：EM 演算法, 改變點, 改變點迴歸模型, 布阿松迴歸模型, EM 改變點迴歸演算法

關鍵字

EM 演算法 ； 改變點 ； 改變點迴歸模型 ； 布阿松迴歸模型 ； EM 改變點迴歸演算法

並列摘要

Poisson regression is a form of regression analysis used to model count data. These models have been widely applied in various fields, such as insurance, biology, economic, medical and engineering, etc.
The Expectation and Maximization (EM) algorithm is the most used method in clustering, when the data follows a known probability distribution. Furthermore, the EM algorithm is also acknowledged to the most practical and effective method to estimate the Maximum Likelihood Estimate (MLE).
Ordinarily, CP regression models deal with the problems of detecting the location of CPs which is similar to clustering with ordered data and is suitable for clustering methods. However, EM is less used in locating CPs in CP regression models. Therefore, we considered applying the EM algorithm to estimate change-points for Poisson regression models.
In this thesis, a new method called EM Change-Point regression (EMCPR) algorithm for Poisson mixture regressions is proposed. By assuming the Change-Points as unknown variables, we used the EMCPR algorithm to estimate the Change-Point and Poisson mixture regression parameters via maximizing the likelihood functions. We demonstrate the approach with several numerical examples and real datasets. The results show that the proposed EMCPR is an effective and useful CP regression algorithm.

Keywords: EM algorithm, Change-Point, Change-Point regression models, Poisson mixture regressions, EM Change-Point regression algorithm

並列關鍵字

EM algorithm ； Change-Point ； Change-Point regression models ； Poisson mixture regressions ； EM Change-Point regression algorithm

參考文獻

References

[1] Paul J. Plummera and Jie Chen, “A Bayesian approach for locating change points in a compound Poisson process with application to detecting DNA copy number variations,” Journal of Applied Statistics, Vol. 41, No. 2, pp. 423–438, 2014

[2] Taeyoung Parka, Robert T. Krafty and Alvaro I. Sánchez, “Bayesian semi-parametric analysis of Poisson change-point regression models application to policy-making in Cali, Colombia,” Journal of Applied Statistics, Vol. 39, No. 10, pp. 2285–2298, 2012

[3] Marcus B. Perry, Joseph J. Pignatiello JR and James R. Simpson, “Change point estimation for monotonically changing Poisson rates in SPC,” International Journal of Production Research, Vol. 45, No. 8, pp. 1791–1813, 2007

[4] Elnaz Asghari Torkamani, Seyed Taghi Akhavan Niaki, Majid Aminnayeri, Mehdi Davoodi2, “Estimating the Change Point of Correlated Poisson Count Processes,” Quality Engineering, Vol. 26, pp. 182–195, 2014