The purpose of this study is to explore the educational evaluation designer's competencies and heir relative weights. The framework of this approach is using a literature review method that examines the relevant literatures of evaluator's and/or evaluation designer’s roles and competencies; then, utilizing a case study to documentarily analyze the pertinent evaluation plans, to observe and to deeply interview a Taiwanese outstanding professional evaluation designer. Based on this result, the 'hierarchy weights analysis questionnaire of the competency connotation' is developed to investigate with ten experienced scholars. Finally, use the Analytic Hierarchy Process to acquire the relative weights of every hierarchy item.