Evaluation of AOTS Training Activities

Evaluation System of AOTS Training Activities

Since its foundation in 1959, the Association for Overseas Technical Scholarship (AOTS) has been conducting training programs for engineers/technicians and managers from developing countries, and the number of such training programs has steadily increased. Under the recent moves toward structural reform, however, AOTS now has to review the training projects for greater effectiveness and efficiency in implementation. Thus, AOTS established the AOTS Training Project Evaluation System Committee consisting of outside experts in fiscal 1999, and conducted studies over three years to construct a new evaluation system.

The new evaluation system, which enables micro-, mezzo-, and macro-level evaluations with six evaluation items and 20 evaluation indicators, aims to improve the AOTS training courses and its projects as a whole, and evaluate each project's contribution to AOTS's mission. The main elements of this system are an AOTS Objectives System Chart, an Evaluation Guideline, an Evaluation Conceptual Diagram, and a Survey Questionnaire.

AOTS is making concerted efforts to further improve the quality of its training projects with the feedback from the evaluation system and to fulfill its accountability through public disclosure of the evaluation results.

Keywords

Training effectiveness, human resource development, evaluation system, public-interest corporation, developing countries

Evaluation Interview Survey (FY2007-FY2009)

Overview

1) Objectives
    We have interviewed highly knowledgeable ex-AOTS training participants (ex-participants) who occupy important social positions in developing countries and other figures who have a connection to our training programs, in order to seek their opinions and qualitative analyses of the significance and effects of AOTS training in Japan, as well as seeking hints about future hopes for AOTS and needs for the cultivation of human resources in industry.

2) Countries Targeted
    China, Thailand, Indonesia, India, Mexico, Malaysia, Philippines and Vietnam

3) Target Respondents

FYCountry
2007(1) China | (2) Thailand | (3) Indonesia
2008(4) India | (5) Mexico
2009(6) Malaysia | (7) Philippines | (8) Vietnam

4) Survey Staff

FY2007
China, ThailandMr. Yuji Shimo-osawa
Manager, Training Evaluation Department, Training Division, AOTS
IndonesiaMs. Chieko Yamaguchi
Manager, Overseas Affairs Coordination Department, General Affairs Division, AOTS
FY2008
IndiaMr. Yasumi Suzuki
General Manager, AOTS New Delhi Office
MexicoMr. Yuji Shimo-osawa
Manager, Training Evaluation Department, Training Division, AOTS
FY2009
MalaysiaMs. Miho Furuhashi
Project Strategy & Evaluation Group, Management Strategy Division, AOTS
PhilippinesMr. Satoru Mitani
Project Strategy & Evaluation Group, Management Strategy Division, AOTS
VietnamMr. Kenichiro Eguchi
Project Strategy & Evaluation Group, Management Strategy Division, AOTS

5) Main Interview Topics
    1) Background to participation in AOTS training in Japan
    2) Biggest impressions left by AOTS training in Japan
    3) What you have learned from AOTS training in Japan
    4) Activities undertaken after returning home and the outcomes of these
    5) The direct and ripple effects of outcomes that emerged after your return home
    6) Personnel cultivation needs in industry at present
    7) Future hopes for AOTS