The customized bus plays an important role in catering the special needs of bus travel, but it also has the problems of optimizing route, improving efficiency and reducing comprehensive costs. The optimization method of customized bus route planning was studied considering the time windows of passengers in this paper. The late or early arrival time of customized bus at stops were converted to equivalent bus travel distances. Taking the minimum weighted cost of the bus operator cost, passengers travel cost and exhaust pollution cost, a customized bus route planning model based on the time windows of passengers was developed, the aut colony algorithm was designed to obtain a feasible solution of the planning model, then Q-learning algorithm based on action model approximation was designed to optimize the feasible solution, the environment model was mapped into a two-dimensional raster model, the action space was set, and the reward and punishment functions were designed. Finally, an example is designed for analysis. The results show that compared with the preliminary bus line, the optimized bus line can more effectively screen out the service stops, and the comprehensive cost is reduced by 20.2%.

CICTP