Browsing by Author "Chen, Pei-Hua"

Now showing 1 - 7 of 7

A sampling and classification item selection approach with content balancing
(2015-03-01)
Chen, Pei-Hua
;
交大名義發表
;
National Chiao Tung University
Existing automated test assembly methods typically employ constrained combinatorial optimization. Constructing forms sequentially based on an optimization approach usually results in unparallel forms and requires heuristic modifications. Methods based on a random search approach have the major advantage of producing parallel forms sequentially without further adjustment. This study incorporated a flexible content-balancing element into the statistical perspective item selection method of the cell-only method (Chen et al. in Educational and Psychological Measurement, 72(6), 933-953, 2012). The new method was compared with a sequential interitem distance weighted deviation model (IID WDM) (Swanson & Stocking in Applied Psychological Measurement, 17(2), 151-166, 1993), a simultaneous IID WDM, and a big-shadow-test mixed integer programming (BST MIP) method to construct multiple parallel forms based on matching a reference form item-by-item. The results showed that the cell-only method with content balancing and the sequential and simultaneous versions of IID WDM yielded results comparable to those obtained using the BST MIP method. The cell-only method with content balancing is computationally less intensive than the sequential and simultaneous versions of IID WDM.
Item Selection for the Development of Parallel Forms From an IRT-Based Seed Test Using a Sampling and Classification Approach
(2012-12-01)
Chen, Pei-Hua
;
Chang, Hua-Hua
;
Wu, Haiyan
;
應用化學系
;
管理科學系
Two sampling-and-classification-based procedures were developed for automated test assembly: the Cell Only and the Cell and Cube methods. A simulation study based on a 540-item bank was conducted to compare the performance of the procedures with the performance of a mixed-integer programming (MIP) method for assembling multiple parallel test forms. The study investigated the statistical equivalence of the forms generated by the three test assembly methods (Cell Only, Cell and Cube, and MIP) in terms of test information functions, test characteristic curves, mean square deviations, and practical constraints, such as content balancing and nonoverlap among forms. The results indicated that the 13-point MIP method outperformed the other two methods in terms of the "closeness" test information functions between the reference form and the assembled parallel tests. Regarding test characteristic curves, the Cell Only and Cell and Cube methods yielded more similar test characteristic curves than the MIP method. Constraining test information functions apparently does not guarantee that the assembled forms will yield similar test characteristic curves. Overall, the Cell Only and Cell and Cube methods have the potential to provide results similar to the optimization approach.
Should We Stop Developing Heuristics and Only Rely on Mixed Integer Programming Solvers in Automated Test Assembly? A Rejoinder to van der Linden and Li (2016)
(2017-05-01)
Chen, Pei-Hua
;
交大名義發表
;
管理科學系
;
National Chiao Tung University
;
Department of Management Science
This rejoinder responds to the commentary by van der Linden and Li entiled "Comment on Three-Element Item Selection Procedures for Multiple Forms Assembly: An Item Matching Approach" on the article "Three-Element Item Selection Procedures for Multiple Forms Assembly: An Item Matching Approach" by Chen. Van der Linden and Li made a strong statement calling for the cessation of test assembly heuristics development, and instead encouraged embracing mixed integer programming (MIP). This article points out the nondeterministic polynomial (NP)-hard nature of MIP problems and how solutions found using heuristics could be useful in an MIP context. Although van der Linden and Li provided several practical examples of test assembly supporting their view, the examples ignore the cases in which a slight change of constraints or item pool data might mean it would not be possible to obtain solutions as quickly as before. The article illustrates the use of heuristic solutions to improve both the performance of MIP solvers and the quality of solutions. Additional responses to the commentary by van der Linden and Li are included.
The Effects of Argument Stance on Scientific Knowledge Inquiry Skills
(2013-11-01)
Horng, Ruey-Yun
;
Lu, Po-Hui
;
Chen, Pei-Hua
;
Hou, Shih-Huan
;
管理科學系
This study investigates the effects of argument stance on knowledge inquiry skills. Sixty-two participants were assigned to three argument stance conditions (proponent, opponent, or control) to receive scaffolded argumentation practice on two science issues in random order. After the argumentation treatment, participants were asked to write down their own opinions regarding the claim. Their responses were analysed according to argument structure, argument content, methods of refutation, and number of new propositions. Results revealed that taking a proponent's stance increased the use of evidence in argumentation, while taking an opponent's stance enhanced both the use of evidence and alternative-based refutations to the claim, number of falsifications, and number of new propositions. This implies that arguing from an opponent's stance may increase the search for multiple causes behind observed phenomena and the need for evidence, thereby alleviating the confirmation bias in thinking.
The effects of corporate social responsibility on brand equity and firm performance
(2015-11-01)
Wang, David Han-Min
;
Chen, Pei-Hua
;
Yu, Tiffany Hui-Kuang
;
Hsiao, Chih-Yi
;
管理科學系
Over the last decade, educators, administrators, and policy makers increasingly focus on corporate social responsibility. However, no studies examine the relationships among corporate social responsibility, brand equity, and firm performance. This study uses quantile regression and structural equation modeling to explore the causal linkages among these factors in Taiwanese high-tech companies over the period 2010-2013. The results of quantile regression analysis show that the economic dimension of corporate social responsibility and the prestige driver of brand equity are positive and significant for all the quantiles. The brand extension driver provides a significant positive effect at the higher quantiles of firm performance. However, the findings indicate a significant negative effect on firm performance for the brand loyalty driver. The findings of structural equation modeling suggest that corporate social responsibility and brand equity positively affect firm performance. This study provides useful insights on brand equity and corporate social responsibility. (C) 2015 Elsevier Inc. All rights reserved.
Three-Element Item Selection Procedures for Multiple Forms Assembly: An Item Matching Approach
(2016-03)
Chen, Pei-Hua
;
交大名義發表
;
管理科學系
;
National Chiao Tung University
;
Department of Management Science
In educational measurement, building multiple alternate test forms is usually highly desirable in practice. Test assembly problems are classified as NP-hard (Non-deterministic Polynomial-time hard) problems, and their computation time increases exponentially as the problem size grows. The purpose of this study was to construct parallel forms item-by-item based on a seed test, using two proposed item selection heuristic methods (random item sequence assigned to maximum distance form with content balance [R-MD-B] and random item sequence assigned to random form with content balancing [R-R-B]) incorporating a flexible content balancing method. The results were compared with two modified versions of the Armstrong, Jones, and Wu heuristics (random item sequence assigned to maximum distance form with Armstrong\'s replacement [R-MD-R] and random item sequence assigned to random form with Armstrong\'s replacement [R-R-R]) and two models incorporating mixed integer programming (MIP) methods. The results showed that the R-MD-B and R-R-B methods yielded results comparable with the two MIP methods with less computation time in terms of the item information functions, test characteristic curves, and content coverage. The results also showed that R-MD-B and R-R-B can be extended to handle test assembly constraints in practical settings.
以自動化組卷法編製臺灣學生學習成就評量測驗之研究(1/2)
(2011)
陳姵樺
;
Chen, Pei-Hua
;
國立交通大學管理科學學系
臺灣學生學習成就評量測驗乃是評估台灣學生從國小、國中乃至高中的學習發展狀況的一項重要參考指標。而此重要參考指標本身所編的測驗是否能保持一貫高品質，乃是一件十分重要的事。近年來關於「臺灣學生學習成就評量測驗」的編製，仍採用人工組卷的方式。本研究旨在發展並導入自動化選題法以編製「臺灣學生學習成就評量測驗」，期透過本研究，將在組卷程序中大量重覆性的工作由電腦運算取代，除了能確保品質、節省時間組卷外，更能將人力作更有效的運用。本研究將運用目前兩大主流方法之一: 最佳化方法，並與學者專家商討測驗組卷標準，且運用現有題庫資料，將自動組卷方式運用在「臺灣學生學習成就評量測驗」上。本研究預期可完成「臺灣學生學習成就評量測驗」國中二年級之自動組卷系統。