Heuristic Algorithm for the Parallel Machine Total Weighted Tardiness Scheduling Problem

Transcription

1 Heuristic Algorithm for the Parallel Machine Total Weighted Tardiness Scheduling Problem Rosiane Rodrigues COPPE - Engenharia de Sistemas e Computação Universidade Federal do Rio de Janeiro Departamento de Ciência da Computação Universidade Federal do Amazonas Artur Pessoa, Eduardo Uchoa {artur, uchoa}@producao.uff.br Departamento de Engenharia de Produção Universidade Federal Fluminense Marcus Poggi de Aragão poggi@inf.puc-rio.br Departamento de Informática Pontifícia Universidade Católica do Rio de Janeiro Abstract This paper presents a heuristic algorithm for the parallel machine weighted tardiness scheduling problem (P w j T j ). The main innovative feature of the algorithm is its representation of a multi-machine schedule by a single sequence, greatly simplifying the treatment of that problem. The single sequence is optimized using an iterated local search over generalized pairwise interchange moves, improved with a suitable tie breaking criterion. Extensive tests on instances, with 2 and 4 machines, and with up to 50 jobs, obtained very good results, finding optimal solutions in almost all cases.

2 Relatórios de Pesquisa em Engenharia de Produção V. 8 n Introduction Let J = {1,..., n} be a set of jobs to be processed in a set of parallel identical machines M = {1,..., m} without preemption. Each machine can process at most one job at a time and each job must be processed by a single machine. Each job j has a positive processing time p j, a due date d j, and a positive weight w j. The tardiness of a job j with respect to its due date is defined as T j = max{0, C j d j }, where C j is the job completion time. The scheduling problem considered in this paper consists in sequencing the jobs in the machines in order to minimize n j=1 w jt j. This problem, referred as P w j T j in the 3-field notation [10], is strongly NP-hard, since even the single-machine case (referred as 1 w j T j ) has that complexity [12]. On the other hand, the single-machine problem without weights (1 T j ) is NP-hard in the ordinary sense [7], but can solved in pseudo-polynomial time [12]. All those problems may play an important role in real applications, such as in the manufacturing industry. We are not aware of other heuristic algorithms specially devised for the P w j T j. Recent works on related problems include Anghinolfi and Paolucci (2007) [2], that proposes a hybrid metaheuristic mixing Tabu Search, Simulated Annealing and Variable Neigborhood Search for the P T j ; and Bilge et al. (2004) [4], that proposes a Tabu Search for the P s ij T j (considering sequence dependent setup times). On the other hand, there is a rich literature on heuristics for the 1 w j T j. The most competitive heuristics for that problem are based on local searches that use both insertion moves (remove a job from the sequence and reinsert it in another position) and swap moves (swap the positions of a pair of jobs in the sequence). Those combined moves are also known as generalized pairwise interchange (GPI) moves [6]. Some 1 w j T j heuristics use the GPI moves in a traditional way, making one move at a time [20]. However, better results are obtained using dynamic programming to explore a large neighborhood that consists in certain sequences of single moves, the so-called dynasearch technique. While the size of the neighborhood is potentially exponential, the dynamic programming may determine such an optimal sequence of moves in polynomial time. This technique was introduced by Potts and Val de Verde [17] in the Traveling Salesman Problem (see the survey by Ahuja et al. [1]). Congram et al. [5] first applied dynasearch to the 1 w j T j, but only considering swaps as single moves. Grosso et al. [11] adapted the dynasearch technique in order to consider all GPI moves. Both papers present dynamic programming procedures with O(n 3 ) time complexity per search. Recently, Ergun and Orlin [9] improved this time complexity to O(n 2 ), by giving a faster dynasearch that combines GPI moves and also twist moves. Our heuristic algorithm for the P w j T j features the representation of a multi-machine schedule by a single sequence, that can be improved by a local search using the well-known GPI moves. Unfortunately, the single sequence representation does not appear to be suitable to dynasearch. This happens because this indirect representation makes the evaluation of moves to be much more costly, even a single insertion move may change the completion times of most jobs in a complex way, so the tardiness costs may have to be recomputed from scratch in O(n log m) time. Evaluating the tardiness costs of many sequences of moves is prohibitively expensive. In order to partially remedy the lack of a dynasearch, we introduce a tie breaking criterion in the GPI search. The idea is that even when the current solution has no GPI neighbor with better tardiness cost, the search is not stopped if there are neighbor solutions improving this criterion. The criterion was devised with the hope of guiding the search into solutions that more likely to be further improved. Several exact methods were proposed for the 1 w j T j, including [8, 19, 22, 21, 3, 14, 15]. The last three works describe techniques that can solve instances with up to 100 jobs consistently. However, the best heuristics typically find the optimal solutions for those instances in much less

3 Relatórios de Pesquisa em Engenharia de Produção V. 8 n time. By the way, those heuristics are often embedded as part of those branch-and-bound based exact algorithms. A good heuristic solution can reduce the search tree, leading to significant speedups. The only exact algorithm for the P w j T j that we know is proposed in [15]. It can solve most instances with up to 50 jobs. The heuristic presented in this paper was created in order to embedded in that exact algorithm. 2 The Algorithm A scheduling for the P w j T j is defined as a sequence of jobs on each machine, where each job appears in exactly one sequence. It is assumed that a machine is only idle after all jobs in its sequence are processed. Moreover, we say that a scheduling is minimal if no machine is idle before all jobs have started their processing. Of course, there is at least one optimal scheduling that is minimal. The main idea of our heuristic algorithm is to represent a minimal P w j T j scheduling as a single sequence of jobs. Let π = (π 1,..., π n ) be a permutation of the job indices 1,..., n. A minimal scheduling can be obtained from π as follows. Start with an empty schedule S, where all machines are idle at time 0. Then, for i = 1,..., n, schedule the job J πi in the first machine that becomes idle according to S. When ties occur, choose the machine with the smallest index. Denote the obtained schedule and its cost by S π and w(π), respectively. Note that every minimal schedule S can be generated in this way. To see this, construct π so that the sequence of jobs (J π1,..., J πn ) is in a non-decreasing order their starting times according to S. When ties occur, put the jobs scheduled in machines with smaller indices first. It is easy to see that S π = S. Given an initial permutation π of jobs, our algorithm performs a local search over a neighborhood defined by GPI moves. They are defined as either an exchange of two (not necessarily adjacent) jobs in π or the removal of a job from π followed by its insertion in another position. Each local search is performed until no GPI move improves the current solution. During the local search, a move is accepted only when the new solution improves upon the previous one. However, locally optimal solutions often have many neighbor solutions with the same cost. Hence, a premature stop in such local optima may be avoided using a suitable tie breaking criterion. Our criterion is based on the values of the due dates and the reverse position of the job in the sequence. In a formal way, given a sequence π = (π 1,..., π n ), we define b(π) = n d πj (n j + 1). Thus, given two neighbor sequences of jobs π and ρ with the same j=1 cost, if b(ρ) < b(π), then ρ is considered to improve over π. Note that our criterion induces the jobs having earlier due dates to be scheduled before the ones with later due dates. This criterion is motivated by the well-known Earliest Due Date first (EDD) rule [13, 16], which generates an optimal solution for the 1 w j T j when the optimum value is zero (i.e., when there is a solution without tardy jobs). Algorithm 1 below presents the general steps of our heuristic, where N, r and k are parameters.

4 Relatórios de Pesquisa em Engenharia de Produção V. 8 n Algorithm 1 Single sequence based heuristic for the P w j T j i 1; π a permutation following the EDD rule. While i N If i is a multiple of r, then π a random permutation. Apply GPI moves in π, until no improvement is possible. If w(π) < w(π ), then π π. Apply k randomly chosen 2-change moves in π. i i + 1. First, it generates a feasible solution following the EDD rule and store in π. In the first iteration, it generates a random permutation π, where the probabilities are identically distributed among all permutations. Then, GPI moves are applied to π. The search on the GPI neighborhood of the current π is stopped when the first improvement move is found, in this case π is updated and a new search starts. This is done until a search is completed without improvement (considering the tie breaking criterion). If the obtained solution improves upon the best solution found so far, then it is kept as π. Finally, k randomly chosen GPI moves are applied (regardless of whether they generate improvements or not), in an attempt to escape from bad local optimal regions. On every r iterations, a completely random permutation replaces the solution generated in the previous iteration. A complete search on the GPI neighborhood tests O(n 2 ) moves. The evaluation of each move requires the construction of the corresponding scheduling, this takes O(n log m) time. 3 Computational Experiments In all our experiments, we set N = 30mn, r = 5, and k = 3. obtained with a Intel Xeon 2.33 GHz processor. The reported times were 3.1 Single-Machine Even though our algorithm was devised for the P w j T j, we also tested it on 1 w j T j instances in order to benchmark it against other methods from the literature. The experiments were performed on the set of 375 instances of the problem available at the OR-Library. This set was generated by Potts and Wassenhove [18] and contains 125 instances for each n {40, 50, 100}. In fact, for each such n, they created 5 similar instances (changing the seed) for each of 25 parameter configurations of the random instance generator. Therefore, for each value of n there are 25 groups composed by 5 similar instances. Those parameter configurations have influence on the distribution of the due dates. Processing times and weights are always picked from the discrete uniform distribution on [1,100] and [1,10], respectively. The best known results for those instances were obtained by Grosso et al. [11] using the GPI-based Dynasearch algorithm (GPI-DS). In that paper, a comparative analysis was done between this method and an older method called Ant-Colony Optimization (ACO), proposed by Stützle et al. [20], that uses the GPI moves in an ACO framework. Table 1 contains a comparison among our algorithm and the two methods above mentioned. The comparison is done on the time (average and maximum) needed to find the optimal value. The CPU times of

5 Relatórios de Pesquisa em Engenharia de Produção V. 8 n GPI-DS were obtained in a HP Kayak 800 MHz workstation, while ACO was run on a Pentium III 450 MHz. Table 1: CPU time to find an optimal solution, GPI-DS [11], ACO [20], and our algorithm, on OR- Library instances with 40, 50 and 100 jobs (125 instances of each size). Topt,avg Topt,max GPI-DS ACO Our method GPI-DS ACO Our method GPI-DS ACO Our method Although our heuristic (as GPI-DS and ACO) eventually obtains the optimal solutions for all OR-Library instances, our CPU times are significantly higher than those by GPI-DS. However, even taking taking the difference of the processors into account, the performance of our heuristic is similar to ACO. This is quite remarkable, because when m = 1 our method reduces to a naive implementation of an iterated GPI local search. The factor that may explain why such a simple method matches the performance of a sophisticated metaheuristic using the same neighborhood is the improvement obtained by the tie-breaking criterion. In fact, without that criterion our method would fail to find the optimal solutions for 2 instances with 100 jobs, even after 3000 iterations and 160 seconds of CPU time. On the instances with 100 jobs, the average quality of the solutions found after each GPI local search iteration is 0.67% above the optimal, without the tie-breaking criteria this number would be 1.26% above the optimal. 3.2 Multi-Machines In order to perform experiments on the P w j T j problem, we derived 100 new instances from the previously mentioned 1 w j T j OR-Library instances. For m {2, 4}, n {40, 50}, we pick the first instance in each group (those with numbers ending with the digit 1 or 6) and divided each due date d j by m (and rounded down the result), processing times p j and weights w j are kept unchanged. For example, from instance wt40-1, we produced instances wt40-2m-1 and wt40-4m-1 by dividing due dates by 2 and 4, respectively. The exact algorithm presented in [15] solved to optimality 98 out of those 100 instances, so we have a good basis to assess the performance of our heuristic. Tables 2 to 5 present detailed results of our heuristic algorithm. The columns have the following meaning: (1) the instance number; (2) the optimal solution value; (3) the value of the best solution found by the heuristic; (4) the difference between the previous values; (5) the iteration in which the best value was first found; (6) the elapsed CPU time (in seconds) when the best value was first found; (7) the number of iterations where the best value was found; (8) the average value of the solutions obtained in all iterations; (9) the total number of iterations performed (given by the algorithm parameter N); and, (10) the total CPU time (in seconds). Table 2 and Table 3 present detailed results considering 2 machines, for 40 and 50 jobs, respectively. Only for a single instance (wt40-2m-116), the optimal solution (or the best known solution, in case of instance wt50-2m-31) was not found. Table 4 and Table 5 present detailed

6 Relatórios de Pesquisa em Engenharia de Produção V. 8 n results considering 4 machines, for 40 and 50 jobs, respectively. Optimal solutions (or the best known solution, in case of instance wt50-4m-56) were found for all tested instances. We also run all instances with a simpler variant of our method, without the tie-breaking criterion. Table 6 compares statistics on those runs with statistics on the runs using the complete method, with the tie-breaking criterion. For each value of m and n, it shows: (1) the number of instances where the optimal or best known solution value was not found; (2) the average quality of the solutions found after each GPI local search iteration; and (3) the total time to complete all the N iterations. It can be seen that the tie-breaking criterion makes the algorithm significantly more robust, with a modest increase on the time spent per iteration (28% in average).

7 Relatórios de Pesquisa em Engenharia de Produção V. 8 n Table 2: Results on instances with 40 jobs and 2 machines. Inst Opt BestV IterBest TBest(s) #Best AvgV TotIter TotT(s) Avg :

8 Relatórios de Pesquisa em Engenharia de Produção V. 8 n Table 3: Results on instances with 50 jobs and 2 machines. Inst Opt BestV IterBest TBest(s) #Best AvgV TotIter TotT(s) Avg :

9 Relatórios de Pesquisa em Engenharia de Produção V. 8 n Table 4: Results on instances with 40 jobs and 4 machines. Inst Opt BestV IterBest TBest(s) #Best AvgV TotIter TotT(s) Avg :

10 Relatórios de Pesquisa em Engenharia de Produção V. 8 n Table 5: Results on instances with 50 jobs and 4 machines. Inst Opt BestV IterBest TBest(s) #Best AvgV TotIter TotT(s) Avg :

11 Relatórios de Pesquisa em Engenharia de Produção V. 8 n Table 6: Effect of the tie-breaking criterion on the proposed algorithm Without tie-breaking With tie-breaking m n #N onopt AvgQ(%) AvgTotT(s) #N onopt AvgQ(%) AvgTotT(s) References [1] R. Ahuja, O. Ergun, J. Orlin, and A. Punnen. A survey of very-large scale neighborhood search techniques. Discrete Applied Mathematics, 123:75 103, [2] D. Anghinolfi and M. Paolucci. Parallel machine total tardiness scheduling with a new hybrid metaheuristic approach. Computers and Operations Research, 34: , [3] L. Bigras, M. Gamache, and G. Savard. Time-indexed formulations and the total weighted tardiness problem. INFORMS Journal on Computing, 1: , [4] U. Bilge, F. Kyraç, F. Kurtulan, and M. Pekgun. A tabu search algorithm for parallel machine total tardiness problem. Computers and Operations Research, 31: , [5] R. Congram, C. Potts, and S. van de Velde. An iterated dynasearch algorithm for the single machine total weighted tardiness scheduling problem. INFORMS Journal of Computing, 14:52 67, [6] F. Della Croce. Generalized pairwise interchanges and machine scheduling. European Journal of Operational Research, 83: , [7] J. Du and J. Leung. Minimizing total tardiness on one processor is NP-Hard. Mathematics of Operations Research, 15(3): , [8] M. Dyer and L. Wolsey. Formulating the single machine sequencing problem with release dates as a mixed integer program. Discrete Applied Mathematics, 26: , [9] O. Ergun and J. Orlin. Fast neighborhood search for the single machine total weighted tardiness problem. Operations Research Letters, 34:41 45, [10] R. Graham, E. Lawler, J. Lenstra, and A. Rinnooy-Kan. Optimization and approximation in deterministic sequencing and scheduling: a survey. Annals of Discrete Mathematics, 5: , [11] A. Grosso, F. Della Croce, and R. Tadei. An enhanced dynasearch neighborhood for the single-machine total weighted tardiness scheduling problem. Operations Research Letters, 32:68 72, [12] E. Lawler. A pseudopolynomial algorithm for sequencing jobs to minimize total tardiness. Annals of Research Letters, 1: , [13] J. Leung. Handbook of Scheduling: Algorithms, Models, and Performance Analysis. Chapman&Hall and CRS Press, 2004.

12 Relatórios de Pesquisa em Engenharia de Produção V. 8 n [14] Y. Pan and L. Shi. On the equivalence of the max-min transportation lower bound and the time-indexed lower bound for single machine scheduling problems. Mathematical Programming, 110: , [15] A. Pessoa, E. Uchoa, M. Poggi de Aragão, and R. Rodrigues. Algorithms over arc-time indexed formulations for single and parallel machine scheduling problems. Technical Report RPEP Vol.8 no.8, Universidade Federal Fluminense, Engenharia de Produção, Niterói, Brazil, [16] M. Pinedo. Scheduling: theory, algorithms, and systems. Prentice-Hall, [17] C. Potts and S. van de Velde. Dynasearch - iterative local improvement by dynamic programming. Part I: the traveling salesman problem. Technical report, University of Twente, [18] C. Potts and L. Wassenhove. A branch-and-bound algorithm for the total weighted tardiness problem. Operations Research, 32: , [19] J. Sousa and L. Wolsey. A time indexed formulation of non-preemptive single machine scheduling problems. Mathematical Programming, 54: , [20] T. Stützle, M. Den Besten, and M. Dorigo. Ant colony optimization for the total weighted tardiness problem. Technical report, Technical Report IRIDIA/99-16, [21] J. Van der Akker, C. Hurkens, and M. Savelsbergh. Time-indexed formulations for machine scheduling problems:column generation. INFORMS Journal on Computing, 12(2): , [22] J. Van der Akker, C. Van Hoesel, and M. Savelsbergh. A polyhedral approach to singlemachine scheduling problems. Mathematical Programming, 85: , 1999.