It is attractive to reduce the total cost of a manufacture system with real-time control of the production. The total cost mainly consists of the production cost, the penalty of the permanent production loss, and the Work-In-Process (WIP) inventory level cost. However, it is difficult to derive an analytical model of manufacture system due to the complexity of starved and blocked phenomena, the random failure and maintenance processes. Therefore, finding a real-time control policy for the manufacture system without exact analytical model is dearly needed. In this paper, a novel reinforcement learning based control decision policy is proposed based on the action of switching the machines on or off at the start of each time slot. Firstly, a simulation model is developed with MTBF and MTTR evaluated from the history data to collect samples. Then, a reinforcement learning method, specifically, Least-Square-Policy-Iteration method, is applied to obtain a sub-optimal policy. The simulation results show that the proposed method performs well in reducing the total cost.
Skip Nav Destination
ASME 2017 12th International Manufacturing Science and Engineering Conference collocated with the JSME/ASME 2017 6th International Conference on Materials and Processing
June 4–8, 2017
Los Angeles, California, USA
Conference Sponsors:
- Manufacturing Engineering Division
ISBN:
978-0-7918-5074-9
PROCEEDINGS PAPER
Reinforcement Learning Based Real-Time Control Policy for Two-Machine-One-Buffer Production System Available to Purchase
Qing Chang
Qing Chang
SUNY – Stony Brook University, Stony Brook, NY
Search for other works by this author on:
Wei Zheng
Zhejiang University, Hanzhou, China
Yong Lei
Zhejiang University, Hanzhou, China
Qing Chang
SUNY – Stony Brook University, Stony Brook, NY
Paper No:
MSEC2017-2771, V003T04A005; 9 pages
Published Online:
July 24, 2017
Citation
Zheng, W, Lei, Y, & Chang, Q. "Reinforcement Learning Based Real-Time Control Policy for Two-Machine-One-Buffer Production System." Proceedings of the ASME 2017 12th International Manufacturing Science and Engineering Conference collocated with the JSME/ASME 2017 6th International Conference on Materials and Processing. Volume 3: Manufacturing Equipment and Systems. Los Angeles, California, USA. June 4–8, 2017. V003T04A005. ASME. https://doi.org/10.1115/MSEC2017-2771
Download citation file:
25
Views
Related Proceedings Papers
Related Articles
Opportunity Window for Energy Saving and Maintenance in Stochastic Production Systems
J. Manuf. Sci. Eng (December,2016)
Supervisory Factory Control Based on Real-Time Production Feedback
J. Manuf. Sci. Eng (June,2007)
Digital Twinning and Optimization of Manufacturing Process Flows
J. Manuf. Sci. Eng (November,2023)
Related Chapters
Solution of Phased-Mission Benchmark Problem Using the SimPRA Dynamic PRA Methdology (PSAM-0345)
Proceedings of the Eighth International Conference on Probabilistic Safety Assessment & Management (PSAM)
Relation B Business Management and Protection Measures from the Aspect of Methodology to Define an Index Effectiveness
International Conference on Instrumentation, Measurement, Circuits and Systems (ICIMCS 2011)
Computer Aided Machine Design
Computer Aided Design and Manufacturing