Multi-Objective Flexible Job Shop Scheduling Problem Based on Monte-Carlo Tree Search

Abstract

Flexible job-shop scheduling problem (FJSP) is very important in both fields of production management and combinatorial optimization. This paper focuses on the multi-objective flexible job shop scheduling problem (MO-FJSP) with three objectives which minimizing makespan, total workload and maximal workload, respectively, with Pareto manner. In addition, Monte-Carlo Tree Search (MCTS) is successful in computer Go and many other games. Hence, solving FJSP by MCTS is a new attempt. In this paper, we propose an MCTS algorithm for FJSP, by incorporating Variable Neighborhood Descent Algorithm and other techniques like Rapid Action Value Estimates Heuristic and Transposition Table. Our algorithm finds Pareto solutions of the benchmark problems proposed by Kacem et al. within 116 seconds: 4 solutions in 4x5, 3 in 10x7, 4 in 8x8, 4 in 10x10 and 2 in 15x10. These solutions are the same as the best found to date. Although one article claimed to have an extra 8x8 solution, that article did not find some of the above solutions.