Heaps and Priority Queues

Transcription

1 Heaps and Priority Queues

2 Heaps

3 Complete Binary Tree Complete binary tree All layers (except lowest) are full. Lowest layer is filled from left to right. 3 / 28

4 Complete Binary Tree Array Representation 1-Based Array 0-Based Array i i 1 Parent 2 2 Left child 2i 2i + 1 Right child 2i + 1 2i / 28

5 (Min) Heap Property Min Heap Property A complete binary tree satisfies min heap property if, for each node i which is not the root, key(parent(i)) key(i). In case of an array A: A[parent(i)] A[i] / 28

6 Heap Heap A heap is an array based representation of a complete binary tree satisfying the heap property. 6 / 28

7 Building a Heap

8 Building a Heap We have given an unsorted array. How do we transform it into a heap? / 28

9 Building a Heap Observation Leafs are valid heaps. 9 / 28

10 Building a Heap Idea Assume left and right subtrees are valid heaps. 10 / 28

11 Building a Heap Idea Assume left and right subtrees are valid heaps. If necessary, exchange root with root of left or right subtree. 10 / 28

12 Building a Heap Idea Assume left and right subtrees are valid heaps. If necessary, exchange root with root of left or right subtree. Recursively repair subtree. 10 / 28

13 Building a Heap Idea Assume left and right subtrees are valid heaps. If necessary, exchange root with root of left or right subtree. Recursively repair subtree. 10 / 28

14 Building a Heap Idea Assume left and right subtrees are valid heaps. If necessary, exchange root with root of left or right subtree. Recursively repair subtree. 10 / 28

15 Building a Heap Idea Assume left and right subtrees are valid heaps. If necessary, exchange root with root of left or right subtree. Recursively repair subtree. 10 / 28

16 Building a Heap Algorithm 1 Procedure Min-Heapify (A, i) 2 Set l := left(i) and r := right(i). 3 If l A Then Return 4 If r < A and A[r ] < A[l ] Then smallest := r 5 Else smallest := l 6 If A[smallest] < A[i] Then 7 Exchange A[smallest] and A[i]. 8 Min-Heapify(A, smallest) The algorithm assumes 0-based arrays. 11 / 28

17 Building a Heap Algorithm 1 Procedure Build-Min-Heap (A) 2 For i := A /2 1 DownTo 0 3 Min-Heapify(A, i) The algorithm assumes 0-based arrays. Theorem The algorithm Build-Min-Heap runs in linear time. 12 / 28

18 Example / 28

19 Example / 28

20 Example / 28

21 Example / 28

22 Example / 28

23 Example / 28

24 Example / 28

25 Example / 28

26 Priority Queues

27 Queues ( FIFO") Enqueue Adds an element to the queue. O(1) Dequeue Removes the oldest element in the queue. O(1) Front Return the oldest element in the queue without removing it. O(1) Enqueue Dequeue Front 15 / 28

28 Priority Queues Enqueue Adds an element to the queue. Dequeue Removes the smallest element in the queue. Min Return the smallest element in the queue without removing it. Dequeue Enqueue Min We can implement a priority queue using a heap. 16 / 28

29 Using a Heap Min Finding the minimum The root of the heap O(1) time Min / 28

30 Using a Heap Dequeue Dequeue Remove the root: Replace it by last element / 28

31 Using a Heap Dequeue Dequeue Remove the root: Replace it by last element. Restore heap property: Call Min-Heapify(A, 0) / 28

32 Using a Heap Dequeue Dequeue Remove the root: Replace it by last element. Restore heap property: Call Min-Heapify(A, 0) O(log n) time / 28

33 Using a Heap Enqueue Enqueue Add new element at the end Enqueue 19 / 28

34 Using a Heap Enqueue Enqueue Add new element at the end. Restore heap property: Exchange with parent until parent is smaller or equal / 28

35 Using a Heap Enqueue Enqueue Add new element at the end. Restore heap property: Exchange with parent until parent is smaller or equal. O(log n) time / 28

36 Heapsort

37 Heapsort Idea Make array A to a heap and use it as priority queue. Order of removing is order in sorted array. 21 / 28

38 Heapsort Algorithm Make array A to a max heap. Max-Heap Sorted 22 / 28

39 Heapsort Algorithm Make array A to a max heap. Exchange A[0] (root of the heap) with A[heapSize 1] 22 / 28

40 Heapsort Algorithm Make array A to a max heap. Exchange A[0] (root of the heap) with A[heapSize 1] Decrease heapsize by 1 22 / 28

41 Heapsort Algorithm Make array A to a max heap. Exchange A[0] (root of the heap) with A[heapSize 1] Decrease heapsize by 1 Call Max-Heapify(A, 0). 22 / 28

42 Heapsort Algorithm Make array A to a max heap. Exchange A[0] (root of the heap) with A[heapSize 1] Decrease heapsize by 1 Call Max-Heapify(A, 0). Max-Heap Sorted 22 / 28

43 Heapsort Properties Runtime: O(n log n) Memory: O(1) (if implemented correctly) Not stable 23 / 28

44 Exercises

45 Exercises You wish to store a set of n numbers in either a max-heap or a sorted array. For each application below, state which data structure is better, or if it does not matter. Explain your answers. (a) Want to find the maximum element quickly. (b) Want to be able to delete an element quickly. (c) Want to be able to form the structure quickly. (d) Want to find the minimum element quickly. 25 / 28

46 Exercises Give an O(n log k) time algorithm to merge k sorted lists into one sorted list, where n is the total number of elements in all the input lists. 26 / 28

47 Exercises Design a data structure that supports the following two operations: addnum(i) Adds an integer to the data structure. findmedian() Returns the median of all elements so far. 27 / 28

48 Exercises You are given a max-heap with n elements. Give an algorithm to find the k largest elements. You are allowed to destroy the heap. How fast is your algorithm? 28 / 28