錯誤可能性與預期衝突對於錯誤偵測系統之影響-以回饋負波為例

Error likelihood and conflict in error monitoring system: a study of feedback negativity

張瀠方

回饋相關負波 ； 增強學習理論 ； 錯誤可能性理論 ； 錯誤偵測系統 ； 風險 ； 懊悔 ； Feedback Negativity ； Reinforcement Learning Theory ； Error-likelihood Theory ； Error Monitoring System ； Risk ； Regret

政治大學心理學研究所學位論文

2011年

碩士

顏乃欣

繁體中文

現今解釋錯誤偵測系統及前扣帶皮質（ACC）的關係之理論主要為增強學習理論。增強學習理論認為個體會在行為後對於行為結果產生預期，並將該預期與實際結果進行比較，若實際結果較預期結果差則會活化ACC進而觀察到較大的FN（Feedback Negativity）振幅。近年來有學者提出奠基於增強學習理論的錯誤可能性理論，錯誤可能性理論則認為當個體在學習到行為與結果之間的關聯後，當接收到可能犯錯的訊息時便會活化ACC而引起較大的FN。本研究主要的目的為探討增強學習理論及錯誤可能性理論的適用性，其次為探討風險之因素是否能反映於FN上。由於兩理論對於風險情境中是否會觀察到FN有不同的預測，錯誤可能性理論預測會在高風險的情況下觀察到較大的FN；而增強學習理論則預測由於風險畫面並非回饋畫面，故風險不會影響FN。實驗一藉由探討風險與FN間之關係企圖提供兩理論初步之區分並提供風險研究的實驗證據，實驗一結果顯示FN確實會反映風險之因素。也點出增強學習理論用以解釋錯誤偵測系統之不完備之處。而實驗二則利用操弄回饋結果好壞及高低錯誤可能性以檢驗錯誤可能性對於錯誤偵測系統之必要性，實驗二結果顯示錯誤可能性為事件評估之因素之一。除此之外，實驗二亦提供FN反映懊悔之支持性證據。

1. Bell, D. E. (1982). Regret in decision making under uncertainty. Operations research, 961-981.
   連結：
2. Bellebaum, C., Kobza, S., Thiele, S., & Daum, I. (2011). Processing of expected and unexpected monetary performance outcomes in healthy older subjects. Behavioral Neuroscience, 125(2), 241.
   連結：
3. Bellebaum, C., Polezzi, D., & Daum, I. (2010). It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations. Neuropsychologia, 48(11), 3343-3350.
   連結：
4. Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological review, 108(3), 624.
   連結：
5. Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., & Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron, 30(2), 619-639.
   連結：
6. Brown, J. W., & Braver, T. S. (2005). Learned predictions of error likelihood in the anterior cingulate cortex. Science, 307(5712), 1118-1121.
   連結：
7. Brown, J. W., & Braver, T. S. (2007). Risk prediction and aversion by anterior cingulate cortex. Cognitive, Affective, & Behavioral Neuroscience, 7(4), 266-277.
   連結：
8. Chang, Y. F., Yen, N. S., Lin, K. Y., Chen, C. Y., & Kao, C. H. (2010). The FRN is associated with the expectation. Paper presented at the 17th annual meeting of the Cognitive Neuroscience Society, Montreal.
   連結：
9. Cloninger, C. R. (1987). A systematic method for clinical description and classification of personality variants: A proposal. Archives of general psychiatry, 44(6), 573.
   連結：
10. de Bruijn, E. R. A., Hulstijn, W., Verkes, R. J., Ruigt, G. S. F., & Sabbe, B. G. C. (2004). Drug-induced stimulation and suppression of action monitoring in healthy volunteers. Psychopharmacology, 177(1), 151-160.
    連結：
11. Dehaene, S., Posner, M. I., & Tucker, D. M. (1994). Localization of a neural system for error detection and compensation. Psychological Science, 5(5), 303-305.
    連結：
12. Galvan, A., Hare, T., Voss, H., Glover, G., & Casey, B. (2007). Risk‐taking and the adolescent brain: who is at risk? Developmental science, 10(2), 8-14.
    連結：
13. Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993). A neural system for error detection and compensation. Psychological Science, 4(6), 385.
    連結：
14. Gehring, W. J., & Willoughby, A. R. (2002). The medial frontal cortex and the rapid processing of monetary gains and losses. Science, 295(5563), 2279-2282.
    連結：
15. Gemba, H., Sasaki, K., & Brooks, V. (1986). Error' potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning. Neuroscience letters, 70(2), 223-227.
    連結：
16. Gerra, G., Zaimovic, A., Timpano, M., Zambelli, U., Delsignore, R., & Brambilla, F. (2000). Neuroendocrine correlates of temperamental traits in humans. Psychoneuroendocrinology, 25(5), 479-496.
    連結：
17. Goyer, J. P., Woldorff, M. G., & Huettel, S. A. (2008). Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards. Journal of Cognitive Neuroscience, 20(11), 2058-2069.
    連結：
18. Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2007). It's worse than you thought: The feedback negativity and violations of reward prediction in gambling tasks. Psychophysiology, 44(6), 905-912.
    連結：
19. Hansenne, M., Pinto, E., Pitchot, W., Reggers, J., Scantamburlo, G., Moor, M., & Ansseau, M. (2002). Further evidence on the relationship between dopamine and novelty seeking: a neuroendocrine study. Personality and individual differences, 33(6), 967-977.
    連結：
20. Heldmann, M., Russeler, J., & Munte, T. (2008). Internal and external information in error processing. BMC Neuroscience, 9(1), 33.
    連結：
21. Hikosaka, O. (2010). The habenula: from stress evasion to value based decision making. Nature Reviews Neuroscience, 11(7), 503-513.
    連結：
22. Hirsh, J. B., & Inzlicht, M. (2008). The devil you know. Psychological Science, 19(10), 962.
    連結：
23. Holroyd, & Krigolson. (2007). Reward prediction error signals associated with a modified time estimation task. Psychophysiology, 44(6), 913-917.
    連結：
24. Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing : Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109(4), 679-709.
    連結：
25. Holroyd, C. B., & Krigolson, O. E. (2007). Reward prediction error signals associated with a modified time estimation task. Psychophysiology, 44(6), 913-917.
    連結：
26. Holroyd, C. B., Larsen, J. T., & Cohen, J. D. (2004). Context dependence of the event-related brain potential associated with reward and punishment. Psychophysiology, 41(2), 245-253.
    連結：
27. Holroyd, C. B., Nieuwenhuis, S., Yeung, N., Nystrom, L., Mars, R. B., Coles, M. G. H., & Cohen, J. D. (2004). Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals. Nature Neuroscience, 7(5), 497-498.
    連結：
28. Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006). Optimal decision making and the anterior cingulate cortex. Nature neuroscience, 9(7), 940-947.
    連結：
29. Kéri, S., Decety, J., Roland, P. E., & Gulyás, B. (2004). Feature uncertainty activates anterior cingulate cortex. Human Brain Mapping, 21(1), 26-33.
    連結：
30. Kerns, J. G., Cohen, J. D., MacDonald, A. W., Cho, R. Y., Stenger, V. A., & Carter, C. S. (2004). Anterior cingulate conflict monitoring and adjustments in control. Science, 303(5660), 1023-1026.
    連結：
31. KreuSSel, L., Hewig, J., Kretschmer, N., Hecht, H., Coles, M. G. H., & Miltner, W. H. (2012). The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. Psychophysiology, 49(2), 207-219.
    連結：
32. Liu, X., Powell, D. K., Wang, H., Gold, B. T., Corbly, C. R., & Joseph, J. E. (2007). Functional dissociation in frontal and striatal areas for processing of positive and negative reward information. The Journal of neuroscience, 27(17), 4587-4597.
    連結：
33. Münte, T. F., Heldmann, M., Hinrichs, H., Marco-Pallares, J., Krämer, U. M., Sturm, V., & Heinze, H. J. (2007). Nucleus accumbens is involved in human action monitoring: evidence from invasive electrophysiological recordings. Frontiers in human neuroscience, 1(11), 1-6.
    連結：
34. Miltner, W. H., Braun, C. H., & Coles, M. G. (1997). Event-related brain potentials following incorrect feedback in a time-estimation task: Evidence for a 'Generic' neural system for error-detection. Journal of Cognitive Neuroscience, 9(6), 788-798.
    連結：
35. Moser, J. S., & Simons, R. F. (2009). The neural consequences of flip flopping: The feedback related negativity and salience of reward prediction. Psychophysiology, 46, 313-320.
    連結：
36. Nieuwenhuis, S., Yeung, N., Holroyd, C. B., Schurger, A., & Cohen, J. D. (2004). Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. Cerebral Cortex, 14(7), 741-747.
    連結：
37. Niki, H., & Watanabe, M. (1979). Prefrontal and cingulate unit activity during timing behavior in the monkey. Brain research, 171(2), 213-224.
    連結：
38. O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science, 304(5669), 452-454.
    連結：
39. Oldfield, R. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia, 9(1), 97-113.
    連結：
40. Pfabigan, D. M., Alexopoulos, J., Bauer, H., & Sailer, U. (2011). Manipulation of feedback expectancy and valence induces negative and positive reward prediction error signals manifest in event‐related brain potentials. Psychophysiology, 48(5), 656-664.
    連結：
41. Potts, G. F., Martin, L. E., Burton, P., & Montague, P. R. (2006). When things are better or worse than expected: The medial frontal cortex and the allocation of processing resources. Journal of Cognitive Neuroscience, 18(7), 1112-1119.
    連結：
42. Salas, R., Baldwin, P., de Biasi, M., & Montague, P. R. (2010). BOLD Responses to Negative Reward Prediction Errors in Human Habenula. Frontiers in Human Neuroscience, 4(36).
    連結：
43. San Martín, R., Manes, F., Hurtado, E., Isla, P., & Ibañez, A. (2010). Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task. NeuroImage, 51(3), 1194-1204.
    連結：
44. Santesso, D. L., & Segalowitz, S. J. (2009). The error‐related negativity is related to risk taking and empathy in young men. Psychophysiology, 46(1), 143-152.
    連結：
45. Scheffers, M. K., Coles, M. G. H., Bernstein, P., Gehring, W. J., & Donchin, E. (1996). Event‐related brain potentials and error‐related processing: An analysis of incorrect responses to go and no‐go stimuli. Psychophysiology, 33(1), 42-53.
    連結：
46. Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science, 275(5306), 1593-1599.
    連結：
47. Schultz, W., Tremblay, L., & Hollerman, J. R. (2000). Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex, 10(3), 272-283.
    連結：
48. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction (Vol. 1): Cambridge Univ Press.
    連結：
49. Weber, E. U., Shafir, S., & Blais, A.R. (2004). Predicting risk sensitivity in humans and lower animals: risk as variance or coefficient of variation. Psychological Review, 111, 430-445.
    連結：
50. Yeung, N., Holroyd, C., & Cohen, J. (2005). ERP correlates of feedback and reward processing in the presence and absence of response choice. Cerebral Cortex, 15(5), 535-544.
    連結：
51. Yu R, Zhou W, Zhou X. (2011). Rapid Processing of Both Reward Probability and Reward Uncertainty in the Human Anterior Cingulate Cortex. PLoS ONE 6(12): e29633.
    連結：
52. Zani, A., & Proverbio, A. M. (2003). The cognitive electrophysiology of mind and brain: Academic Press.
    連結：
53. Zhou, Z., Yu, R., & Zhou, X. (2010). To do or not to do? Action enlarges the FRN and P300 effects in outcome evaluation. Neuropsychologia, 48(12), 3606-3613.
    連結：
54. Zirnheld, P. J., Carroll, C. A., Kieffaber, P. D., O'donnell, B. F., Shekhar, A., & Hetrick, W. P. (2004). Haloperidol impairs learning and error-related negativity in humans. Journal of Cognitive Neuroscience, 16(6), 1098-1112.
    連結：
55. Chang, Y. F., & Yen, N. S. (2008). The feedback-related negativity is sensitive to the delayed outcome. Paper presented at the 15th annual meeting of the Cognitive Neuroscience Society, San Francisco, CA, U.S.A.
56. Chung, H. K. (2011). Risk factor in somatic marker hypothesis. Unpublished master's thesis, Chengchi University, Taipei, Taiwan.
57. Gibson, J., Krigolson, O., & Holroyd, C. (2006). Sensitivity of the feedback error-related negativity to reward probability. Psychophysiology, 43, 41-42.
58. Hohnsbein, J., Falkenstein, M., & Hoormann, J. (1989). Error processing in visual and auditory choice reaction tasks. Journal of Psychophysiology, 3, 32.
59. Yen, N. S.*, Lai, Y. R., Chang, Y. F., Yeh, T. H., & Chen, K. H. (2007b, Sep.). The effect of expectancy on feedback-related negativity. Poster presented at the 5th Annual Meeting of Society for Neuroeconomics, Boston, U.S.A.