教學網站專家評估系統之設計與建置

Abstract

本研究旨在建立一套能在線上運作的教學網站專家評估系統（簡稱S3E，System of Expert Evaluation for Educational Websites），希望能藉由專家的專業知識，透過本系統來提供其對特定教學網站的專業建議，以便網站建置者或相關研究者可以有效率而便捷地蒐集網站品質的評估資料。 在系統功能與架構方面，本研究透過對專家評估法的探討，然後遵循系統生命週期開發模式，規劃分析系統所必備的機制，進而確立S3E的五項主要功能，包括：「帳號管理」、「網站設定」、「指標編輯」、「專家評估」、「評估結果」。此外，本研究根據網站評估準則相關文獻的歸納整理，提出包含「內容適切性」、「內容正確性」、「內容可信度」、「內容吸引性」、「媒體品質與融合性」、「介面設計與版面編排」、「連結品質」、「互動方式與型態」、「學習輔助工具」、「特殊功能」等10項評估教學網站的指標類別，共計81項指標項目，做為S3E內建的評估指標資料庫。 在系統評估與測試方面，本研究邀請六位專家對S3E進行捷思評估（Heuristic Evaluation），提出有關系統使用性的改進建議。而在十三位使用者對S3E的測試調查當中，大部分使用者認同S3E的資料蒐集效率與準確性都較傳統紙本方式為佳，而對於系統使用性與功能適切性方面，亦多給予正面評價。 綜合系統發展經驗與評估測試意見，S3E做為一個研究工具的輔助角色，不但可提供研究者建立教學網站評估指標資料庫的機制，同時能利用資訊科技改善若干紙本資料蒐集作業的缺點，在日後實際應用上將有助於提昇研究效益。

The purpose of this study is to design and develop the System of Expert Evaluation for Educational Websites (S3E). Experts are expected to offer their professional suggestions for particular educational websites by using this system, so as to enable site designers or to collect evaluation data efficiently and conveniently. Through the literature review on expert evaluation methods, the System Development Life Cycle (SDLC) model was employed to establish required mechanism of S3E, and then five primary functions were designed: ‘ID managing’, ‘site setting’, ‘criteria editing’, ‘expert evaluating’ and ‘result viewing’. Furthermore, according to the analysis of literature on websites evaluation guidelines, 10 criteria categories, including 81 criteria items, were drawn as built-in criteria database of S3E. Categories include: 1.Suitability of Content, 2.Accuracy of Content, 3.Credibility of Content, 4.Attraction of Content, 5.Quality and Integration of Medium, 6.Interface Design and Layout Arrangement, 7.Quality of Links, 8.Style and Types of Interaction, 9.Assisted Learning Tools, and 10.Special Functions. After system has implemented, expert evaluation and user survey were both conducted. Six experts were invited to check the usability of S3E with heuristic evaluation, and their suggestions were taken into consideration for system improvement. User survey showed that most users agreed that efficiency and exactness of data collection by using S3E were better than traditional paper-based ones, and majority of users also gave positive feedbacks on usability and functions of S3E. Based on the implementation experience and assessment result, S3E not only offers a mechanism for researchers to build evaluation criteria database, but also overcomes some disadvantages in paper-based data collection procedures. Evaluation systems like S3E would be helpful to collect efficient and effective evaluation data on any educational websites.