|
|
<!DOCTYPE html>
|
|
|
<html lang="en">
|
|
|
<head>
|
|
|
<meta charset="UTF-8">
|
|
|
<title> | tait.tech</title>
|
|
|
<link rel="stylesheet" href="/assets/css/style.css" id="main-stylesheet">
|
|
|
<meta name="viewport" content="width=device-width, initial-scale=1.0"><link rel="stylesheet" href="/assets/css/katex.css" id="math-stylesheet">
|
|
|
|
|
|
|
|
|
|
|
|
</head>
|
|
|
<body>
|
|
|
<main>
|
|
|
<div id="wrapper">
|
|
|
<h1 id="sorting">Sorting</h1>
|
|
|
|
|
|
<h2 id="sorting-1">Sorting</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>re-arranging elements of a sequence <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi>S</mi><mtext> s.t. </mtext><msub><mi>S</mi><mn>0</mn></msub><mo>≤</mo><msub><mi>S</mi><mn>1</mn></msub><mo>≤</mo><msub><mi>S</mi><mn>2</mn></msub><mo>≤</mo><mo>⋯</mo><mo>≤</mo><msub><mi>S</mi><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></msub></mrow><annotation encoding="application/x-tex">S \text{ s.t. } S_0 \leq S_1 \leq S_2 \leq \cdots \leq S_{n-1}</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:0.83333em;vertical-align:-0.15em;"></span><span class="mord mathnormal" style="margin-right:0.05764em;">S</span><span class="mord text"><span class="mord"> s.t. </span></span><span class="mord"><span class="mord mathnormal" style="margin-right:0.05764em;">S</span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.30110799999999993em;"><span style="top:-2.5500000000000003em;margin-left:-0.05764em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight">0</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.15em;"><span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:0.83333em;vertical-align:-0.15em;"></span><span class="mord"><span class="mord mathnormal" style="margin-right:0.05764em;">S</span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.30110799999999993em;"><span style="top:-2.5500000000000003em;margin-left:-0.05764em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight">1</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.15em;"><span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:0.83333em;vertical-align:-0.15em;"></span><span class="mord"><span class="mord mathnormal" style="margin-right:0.05764em;">S</span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.30110799999999993em;"><span style="top:-2.5500000000000003em;margin-left:-0.05764em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight">2</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.15em;"><span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:0.7719400000000001em;vertical-align:-0.13597em;"></span><span class="minner">⋯</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:0.891661em;vertical-align:-0.208331em;"></span><span class="mord"><span class="mord mathnormal" style="margin-right:0.05764em;">S</span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.301108em;"><span style="top:-2.5500000000000003em;margin-left:-0.05764em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathnormal mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.208331em;"><span></span></span></span></span></span></span></span></span></span></li>
|
|
|
<li>We will look at 5 sorting algorithms:
|
|
|
<ul>
|
|
|
<li>3 iterative</li>
|
|
|
<li>2 recursive</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<h2 id="the-iterative-algorithms">The iterative algorithms</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>maintain a partition: “unsorted part” & “srtoed part”</li>
|
|
|
<li>sort a sequence of n elements in n-1 stages</li>
|
|
|
<li>at each stage, move 1 element from the unsorted part to the sorted part:
|
|
|
<ul>
|
|
|
<li>(Diagram of a generic array with unseen “sorted” items on the left and “unsorted” elements on the right. Caption: “1 stage moves 1 element”)</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>sort(A){
|
|
|
* initialize
|
|
|
* repeat n-1 times
|
|
|
* move 1 element from unsorted and sorted part
|
|
|
}
|
|
|
</code></pre></div></div>
|
|
|
|
|
|
<ul>
|
|
|
<li>The algorithms differ in how they:
|
|
|
<ul>
|
|
|
<li>select an element to remove from the unsorted part</li>
|
|
|
<li>insert it into the sorted part</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<h2 id="insertion-sort">Insertion Sort</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>Initially sorted part is just A[0]</li>
|
|
|
<li>Repeat n-1 times
|
|
|
<ul>
|
|
|
<li>remove the first element from the unsorted part</li>
|
|
|
<li>insert it into the sorted part (shifting elements to the right as needed)</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Diagram of array as it gets sorted in three stages:</p>
|
|
|
|
|
|
<ul>
|
|
|
<li>Stage 1: sorted is leftmost (0th) element; n-1 elements are unsorted on the right.</li>
|
|
|
<li>Stage 2: approximately half of the array is sorted; an arrow points from the leftmost value inside the unsorted side to an arbitrary position inside the sorted side.</li>
|
|
|
<li>Stage 3: just over half of the array is sorted now.</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Code:</p>
|
|
|
|
|
|
<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>insertion sort(A){
|
|
|
for(i=1 to n-1){
|
|
|
pivot = A[i] // first element in unsorted part
|
|
|
j=i-1
|
|
|
// The following loop shifts all elements in sorted parts that are larger than pivot 1 "to the right"
|
|
|
while(j>=0 AND A[i] > pivot){
|
|
|
A[j+i] = A[j] // shift jth
|
|
|
j = j-1
|
|
|
}
|
|
|
A[j+i] = pivot // move pivot into position.
|
|
|
}
|
|
|
}
|
|
|
</code></pre></div></div>
|
|
|
|
|
|
<h2 id="insertion-sort-example">Insertion Sort Example</h2>
|
|
|
|
|
|
<p>Stages:</p>
|
|
|
|
|
|
<ul>
|
|
|
<li>Stage 0: Original
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>5</td>
|
|
|
<td>4</td>
|
|
|
<td>2</td>
|
|
|
<td>6</td>
|
|
|
<td>1</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 1: (label: 4)
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>2</td>
|
|
|
<td>6</td>
|
|
|
<td>1</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 2: (label: 2)
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>2</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
<td>1</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 3: (label: 6)
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>2</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
<td>1</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 4: (label: 1)
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 5: (label: 3)
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<h2 id="selection-sort">Selection Sort</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>initially sorted part is empty</li>
|
|
|
<li>repeat n-1 times
|
|
|
<ul>
|
|
|
<li>find the smallest element in the unsorted part</li>
|
|
|
<li>make it the first position which becomes the now last position of sorted part.</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Diagram of parts:</p>
|
|
|
|
|
|
<ul>
|
|
|
<li>Initially, the entire array is all unsorted.</li>
|
|
|
<li>Over time the sorted elements stack up on the left.</li>
|
|
|
<li>Every time an element is moved, it is moved from the unsorted part (lowest element) and swapped with the element just after the end of the sorted part, making the sorted part one element bigger.</li>
|
|
|
<li>Eventually all elements are sorted in descending order.</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Code:</p>
|
|
|
|
|
|
<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>selection_sort(A){
|
|
|
for(i=1 to n-1){
|
|
|
// find min element of unsorted
|
|
|
j=i-1 // j is index of min found so far.
|
|
|
k=i
|
|
|
while(k<n){
|
|
|
if(A[k]<A[j]) j=k;
|
|
|
k=k+1
|
|
|
}
|
|
|
swap A[i-1] and A[j]
|
|
|
}
|
|
|
}
|
|
|
</code></pre></div></div>
|
|
|
|
|
|
<p>Process of Selection Sort:</p>
|
|
|
|
|
|
<ul>
|
|
|
<li>Original: all unsorted
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>5</td>
|
|
|
<td>4</td>
|
|
|
<td>2</td>
|
|
|
<td>6</td>
|
|
|
<td>1</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 1: [0] is sorted; 1 and 5 swap
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>4</td>
|
|
|
<td>2</td>
|
|
|
<td>6</td>
|
|
|
<td>5</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 2: [0..1] is sorted; 2 and 4 swap
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>4</td>
|
|
|
<td>6</td>
|
|
|
<td>5</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 3: [0..2] is sorted; 3 and 4 swap
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>6</td>
|
|
|
<td>5</td>
|
|
|
<td>4</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 4: [0..3] is sorted; 4 and 6 swap
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Stage 5: [0..4] is sorted; annotation: s.t. s (final stage)
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<h2 id="heapsort-selection-sort-is-crossed-out">Heapsort (Selection Sort is crossed out)</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>Initially sorted part empty</li>
|
|
|
<li>(highlighted) make unsorted part into a heap</li>
|
|
|
<li>repeat n-1 times
|
|
|
<ul>
|
|
|
<li>find the smallest element in the unsorted part (Note: heap extract takes log(n) time vs. Θ(n) for the scan in selection sort)</li>
|
|
|
<li>move it to the first position which becomes the new last position of the started part.</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Consider the organization of array contents:</p>
|
|
|
|
|
|
<ol>
|
|
|
<li>(Diagram of array with sorted half on the right and the unsorted half on the left.) A purple arrow points to the leftmost element in the unsorted portion. The note reads: “if this is the root of the heap, then it is also the smallest element in the unsorted part, so is in its correct final position.
|
|
|
To use this arrangement, the root of the heap keeps moving, so we have lots of shifting to do.”</li>
|
|
|
<li>(A diagram showing the same array with sorted and unsorted halves.) A purple arrow points to the last element in the array; it points to a purple circle. A purple square is at the leftmost element of the unsorted half (the one discussed in the last item). The note reads: “If this is the root of the, then everything works:
|
|
|
<ul>
|
|
|
<li>We extract the final element (purple circle); move the last leaf (purple square) to the root + do a percolate-down;
|
|
|
store the final element (purple circle) where the last element of the unsorted list (purple square) <em>was</em>,
|
|
|
which is now free, and is the correct final location for the previously final element (purple circle); after which we have:</li>
|
|
|
</ul>
|
|
|
<ul>
|
|
|
<li>(Diagram of array with the “sorted” half extended one cell over to encompass the purple circle)
|
|
|
* <strong>But</strong>: we must re-code our heap implementation s.t. the root is at A[n-1], with the result that the indexing is now less intuitive.</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Instead, we use a max-heap, and this arrangement:
|
|
|
<ul>
|
|
|
<li>(Diagram showcasing, as previously, a sorted half to the right and an unsorted half on the left. An orange circle labeled “root of heap” is the very first element of the list and the unsorted half; an orange square labeled “last leaf” sits at the end (rightmost side) of the unsorted half.)</li>
|
|
|
<li>The heap root is at A[0]</li>
|
|
|
<li>Heap Extraction remove the root of the heap (orange circle), moves the last leaf (orange square) to A[0],
|
|
|
freeing up the spot where the root of the heap (orange circle) belongs.</li>
|
|
|
<li>This leaves us with: (Diagram of the orange circle near the middle of the array, at the leftmost portion of the sorted half. The orange square is in the center of the unsorted half.)</li>
|
|
|
<li>Re-coding a min heap into a max heap is just replacing < with > and vice versa.</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ol>
|
|
|
|
|
|
<h2 id="heapsort-selectioon-sort-is-crossed-out">Heapsort (Selectioon Sort is crossed out)</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>initially sorted part empty</li>
|
|
|
<li>(highlighted) make unsorted part into a max heap</li>
|
|
|
<li>repeat n-1 times:
|
|
|
<ul>
|
|
|
<li>find the largest (smallest is crossed out) element in the unsorted part</li>
|
|
|
<li>move it to the last (first is crossed out) position which becomes the new first (last is crossed out) position of the sorted part.</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Code:</p>
|
|
|
|
|
|
<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>heapsort(A){
|
|
|
buildMaxHeap(A)
|
|
|
for(i=1 to n-1){
|
|
|
A[n-1] extractMax()
|
|
|
}
|
|
|
}
|
|
|
</code></pre></div></div>
|
|
|
|
|
|
<p>Stages of sorting:</p>
|
|
|
|
|
|
<ul>
|
|
|
<li>(Diagram of unsorted array with first element labeled as “heap with max here”.)</li>
|
|
|
<li>(Diagram of a half-sorted array showing the swap between the first and last elements of the unsorted portion of the array. Labeled as “take max element from root…” and “take last leaf from end of heap” with arrows pointing to one another.)</li>
|
|
|
<li>(Diagram of a half+1 sorted array, displaying the new sorted element that has been swapped from the root element of the heap. Labeled as “newest element of sorted part” and “this is the <em>final</em> location” (the new element just swapped), and “y new root of heap (which then gets percolated down)” (what is now the first element of the array, which was also just swapped).)</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Unsorted heap of size 1 has smallest element.</p>
|
|
|
|
|
|
<h2 id="heapsort-with-in-line-percolate-down">Heapsort with in-line percolate-down</h2>
|
|
|
|
|
|
<p>Code:</p>
|
|
|
|
|
|
<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>heapsort(A){
|
|
|
makeMaxHeap(A)
|
|
|
for(i=1 to n-1){
|
|
|
swap A[0] and A[n-1] // move last leaf to root and old root to where last leaf was
|
|
|
size <- n-i+1 // size of heap = size of unsorted part
|
|
|
// start of percolate down
|
|
|
j <- 0
|
|
|
while(2j+1 < size){
|
|
|
child <- 2j+1
|
|
|
if(2j+2 < size AND A[2j+2] < A[2j+1]){
|
|
|
child <- 2j+2
|
|
|
}
|
|
|
if(A[child]<A[j]){
|
|
|
swap A[child] and A[j]
|
|
|
j <- child
|
|
|
} else {
|
|
|
j <- size // termite the while
|
|
|
}
|
|
|
} // end of percolate down
|
|
|
}
|
|
|
}
|
|
|
</code></pre></div></div>
|
|
|
|
|
|
<h2 id="heapsort-example">Heapsort Example</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>Original:
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>5</td>
|
|
|
<td>4</td>
|
|
|
<td>2</td>
|
|
|
<td>6</td>
|
|
|
<td>1</td>
|
|
|
<td>3</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Turn into heap:
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>6</td>
|
|
|
<td>5</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Swap root (6) and last unsorted element (2):
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>2</td>
|
|
|
<td>5</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>1</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Re-heap the unsorted portion: [0..4]
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>5</td>
|
|
|
<td>4</td>
|
|
|
<td>3</td>
|
|
|
<td>2</td>
|
|
|
<td>1</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Swap root (5) and the last unsorted element (2):
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>4</td>
|
|
|
<td>3</td>
|
|
|
<td>2</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Re-heap the unsorted portion: [0..3]
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>4</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>1</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Swap root (4) and the last unsorted element (1):
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Re-heap unsorted portion: [0..2]
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>3</td>
|
|
|
<td>2</td>
|
|
|
<td>1</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Swap root (3) and last unsorted element (1):
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Re-heap unsorted portion: [0..1]
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>2</td>
|
|
|
<td>1</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Swap root (2) and last unsorted element (1):
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>1</td>
|
|
|
<td>2</td>
|
|
|
<td>3</td>
|
|
|
<td>4</td>
|
|
|
<td>5</td>
|
|
|
<td>6</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>Array is sorted because unsorted portion is only 1 element.</li>
|
|
|
</ul>
|
|
|
|
|
|
<p>Tree version of above (heap):</p>
|
|
|
|
|
|
<p>Original:</p>
|
|
|
|
|
|
<!-- AUTO GENERATED FROM CUSTOM PYTHON CODE -->
|
|
|
<ul role="tree">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t11_5">
|
|
|
5
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t11_4">
|
|
|
4
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t11_6">
|
|
|
6
|
|
|
</span>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t11_1">
|
|
|
1
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t11_2">
|
|
|
2
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t11_3">
|
|
|
3 (left)
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
<!-- END OF GENERATED CODE -->
|
|
|
|
|
|
<p>After re-heap and one removal:</p>
|
|
|
|
|
|
<!-- AUTO GENERATED FROM CUSTOM PYTHON CODE -->
|
|
|
<ul role="tree">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_2">
|
|
|
2
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_5">
|
|
|
5
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_2">
|
|
|
2
|
|
|
</span>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_1">
|
|
|
1
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_3">
|
|
|
3
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
<!-- END OF GENERATED CODE -->
|
|
|
|
|
|
<p>After a second re-heap and removal:</p>
|
|
|
|
|
|
<!-- AUTO GENERATED FROM CUSTOM PYTHON CODE -->
|
|
|
<ul role="tree">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_1">
|
|
|
1
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_4">
|
|
|
4
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_2">
|
|
|
2 (left)
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_3">
|
|
|
3
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
<!-- END OF GENERATED CODE -->
|
|
|
|
|
|
<p>After a third:</p>
|
|
|
|
|
|
<!-- AUTO GENERATED FROM CUSTOM PYTHON CODE -->
|
|
|
<ul role="tree">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_1">
|
|
|
1
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_2">
|
|
|
2
|
|
|
</span>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_3">
|
|
|
3
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
<!-- END OF GENERATED CODE -->
|
|
|
|
|
|
<p>Examples stop here.</p>
|
|
|
|
|
|
<h2 id="heapsort-example-2">Heapsort Example (2)</h2>
|
|
|
|
|
|
<p>(Repeat same as above, except with different trees.)</p>
|
|
|
|
|
|
<p>Trees (Transcriber’s note: these trees don’t seem relavant to me…. but maybe I’m wrong):</p>
|
|
|
|
|
|
<!-- AUTO GENERATED FROM CUSTOM PYTHON CODE -->
|
|
|
<ul role="tree">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_2">
|
|
|
2 (crossed out with orange 5)
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_5">
|
|
|
5 (crossed out next to orange 2 which is also crossed out; an orange 4 is not crossed out)
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_4">
|
|
|
4 (crossed out with orange 2)
|
|
|
</span>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_1">
|
|
|
1
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_3">
|
|
|
3
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
<!-- END OF GENERATED CODE -->
|
|
|
<!-- AUTO GENERATED FROM CUSTOM PYTHON CODE -->
|
|
|
<ul role="tree">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_1">
|
|
|
1 (crossed out with an orange 4)
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_4">
|
|
|
4 (crossed out with orange 1, which is also crossed out; an orange 2, not crossed out is next to it)
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_2">
|
|
|
2 (left; crossed out with orange 1)
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_3">
|
|
|
3
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
<!-- END OF GENERATED CODE -->
|
|
|
<!-- AUTO GENERATED FROM CUSTOM PYTHON CODE -->
|
|
|
<ul role="tree">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_1">
|
|
|
1 (orange 2)
|
|
|
</span>
|
|
|
<ul role="group">
|
|
|
<li role="treeitem" tabindex="-1">
|
|
|
<span id="t0_2">
|
|
|
2 (left; orange 1)
|
|
|
</span>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
</ul>
|
|
|
<!-- END OF GENERATED CODE -->
|
|
|
|
|
|
<h2 id="time-complexity-of-iterative-sorting-algorithms">Time Complexity of Iterative Sorting Algorithms</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>each algorithm does exactly n-1 stages</li>
|
|
|
<li>the work done at the i<sup>th</sup> stage varies with the algorithm (& input).</li>
|
|
|
<li>we take # from item comparisons as a measure of work/time*.</li>
|
|
|
</ul>
|
|
|
|
|
|
<dl>
|
|
|
<dt>Selection Sort</dt>
|
|
|
<dd>exactly n-i comparisons to find num element in unsorted part</dd>
|
|
|
<dt>Insertion Sort</dt>
|
|
|
<dd>between 1 and i comparisons to find location for pivot</dd>
|
|
|
<dt>HeapSort</dt>
|
|
|
<dd>between 1 and <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mn>2</mn><msub><mo><mi>log</mi><mo></mo></mo><mn>2</mn></msub><mo stretchy="false">(</mo><mi>n</mi><mo>−</mo><mi>i</mi><mo>−</mo><mn>1</mn><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">2\log_{2} (n-i-1)</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:1em;vertical-align:-0.25em;"></span><span class="mord">2</span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop"><span class="mop">lo<span style="margin-right:0.01389em;">g</span></span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.20696799999999996em;"><span style="top:-2.4558600000000004em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.24414em;"><span></span></span></span></span></span></span><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span></span><span class="base"><span class="strut" style="height:0.74285em;vertical-align:-0.08333em;"></span><span class="mord mathdefault">i</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span></span><span class="base"><span class="strut" style="height:1em;vertical-align:-0.25em;"></span><span class="mord">1</span><span class="mclose">)</span></span></span></span> comparisons for percolate-down</dd>
|
|
|
</dl>
|
|
|
|
|
|
<h2 id="-number-of-comparisons">* Number of comparisons</h2>
|
|
|
|
|
|
<ul>
|
|
|
<li>We must verify # comparisons (or some constant times # comparisons) is an upper bound on work done by each algorithm.</li>
|
|
|
<li>
|
|
|
<h1 id="of-assignments--swaps-also-matters-in-actual-run-time">of assignments (& swaps) also matters in actual run time.</h1>
|
|
|
</li>
|
|
|
</ul>
|
|
|
|
|
|
<h2 id="selection-sort-1">Selection Sort</h2>
|
|
|
|
|
|
<p>On input of size n, # of comparisons is always (regardless of input):</p>
|
|
|
|
|
|
<p><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mtable rowspacing="0.24999999999999992em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><mo stretchy="false">(</mo><mi>n</mi><mo>−</mo><mi>i</mi><mo stretchy="false">)</mo></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><mi>i</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mi>S</mi><mo stretchy="false">(</mo><mi>n</mi><mo>−</mo><mi>i</mi><mo stretchy="false">)</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mfrac><mrow><mo stretchy="false">(</mo><mi>n</mi><mo>−</mo><mn>1</mn><mo stretchy="false">)</mo><mo stretchy="false">(</mo><mi>n</mi><mo stretchy="false">)</mo></mrow><mn>2</mn></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mfrac><mrow><msup><mi>n</mi><mn>2</mn></msup><mo>−</mo><mi>n</mi></mrow><mn>2</mn></mfrac></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mi mathvariant="normal">Θ</mi><mo stretchy="false">(</mo><msup><mi>n</mi><mn>2</mn></msup><mo stretchy="false">)</mo></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">
|
|
|
\begin{aligned}
|
|
|
\sum_{i=1}^{n-1} (n-i) & = \sum_{i=1}^{n-1} i\\
|
|
|
& = S(n-i)\\
|
|
|
& = \frac{(n-1)(n)}{2}\\
|
|
|
& = \frac{n^2 -n}{2}\\
|
|
|
& = \Theta(n^2)
|
|
|
\end{aligned}
|
|
|
</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:11.292998em;vertical-align:-5.396499000000001em;"></span><span class="mord"><span class="mtable"><span class="col-align-r"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:5.8964989999999995em;"><span style="top:-7.896499em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mop op-limits"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.8011130000000004em;"><span style="top:-1.872331em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">i</span><span class="mrel mtight">=</span><span class="mord mtight">1</span></span></span></span><span style="top:-3.050005em;"><span class="pstrut" style="height:3.05em;"></span><span><span class="mop op-symbol large-op">∑</span></span></span><span style="top:-4.300005em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:1.277669em;"><span></span></span></span></span></span><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord mathdefault">i</span><span class="mclose">)</span></span></span><span style="top:-5.47883em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span><span style="top:-3.3918299999999997em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span><span style="top:-0.9147220000000001em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span><span style="top:0.9353860000000007em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:5.396499000000001em;"><span></span></span></span></span></span><span class="col-align-l"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:5.8964989999999995em;"><span style="top:-7.896499em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mop op-limits"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.8011130000000004em;"><span style="top:-1.872331em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">i</span><span class="mrel mtight">=</span><span class="mord mtight">1</span></span></span></span><span style="top:-3.050005em;"><span class="pstrut" style="height:3.05em;"></span><span><span class="mop op-symbol large-op">∑</span></span></span><span style="top:-4.300005em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:1.277669em;"><span></span></span></span></span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mord mathdefault">i</span></span></span><span style="top:-5.47883em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord mathdefault" style="margin-right:0.05764em;">S</span><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord mathdefault">i</span><span class="mclose">)</span></span></span><span style="top:-3.3918299999999997em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord"><span class="mopen nulldelimiter"></span><span class="mfrac"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.427em;"><span style="top:-2.314em;"><span class="pstrut" style="height:3em;"></span><span class="mord"><span class="mord">2</span></span></span><span style="top:-3.23em;"><span class="pstrut" style="height:3em;"></span><span class="frac-line" style="border-bottom-width:0.04em;"></span></span><span style="top:-3.677em;"><span class="pstrut" style="height:3em;"></span><span class="mord"><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord">1</span><span class="mclose">)</span><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mclose">)</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.686em;"><span></span></span></span></span></span><span class="mclose nulldelimiter"></span></span></span></span><span style="top:-0.9147220000000001em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord"><span class="mopen nulldelimiter"></span><span class="mfrac"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.491108em;"><span style="top:-2.314em;"><span class="pstrut" style="height:3em;"></span><span class="mord"><span class="mord">2</span></span></span><span style="top:-3.23em;"><span class="pstrut" style="height:3em;"></span><span class="frac-line" style="border-bottom-width:0.04em;"></span></span><span style="top:-3.677em;"><span class="pstrut" style="height:3em;"></span><span class="mord"><span class="mord"><span class="mord mathdefault">n</span><span class="msupsub"><span class="vlist-t"><span class="vlist-r"><span class="vlist" style="height:0.8141079999999999em;"><span style="top:-3.063em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight">2</span></span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord mathdefault">n</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.686em;"><span></span></span></span></span></span><span class="mclose nulldelimiter"></span></span></span></span><span style="top:0.9353860000000007em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord">Θ</span><span class="mopen">(</span><span class="mord"><span class="mord mathdefault">n</span><span class="msupsub"><span class="vlist-t"><span class="vlist-r"><span class="vlist" style="height:0.8641079999999999em;"><span style="top:-3.113em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight">2</span></span></span></span></span></span></span></span><span class="mclose">)</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:5.396499000000001em;"><span></span></span></span></span></span></span></span></span></span></span></span></p>
|
|
|
|
|
|
<h2 id="insertion-sort--worst-case">Insertion Sort – Worst Case</h2>
|
|
|
|
|
|
<p>Upper Bound: <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mtext># comparisons</mtext><mo>≤</mo><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><mi>i</mi><mo>=</mo><mfrac><mrow><msup><mi>n</mi><mn>2</mn></msup><mo>−</mo><mi>n</mi></mrow><mn>2</mn></mfrac><mo>=</mo><mi>O</mi><mo stretchy="false">(</mo><msup><mi>n</mi><mn>2</mn></msup><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">\text{\# comparisons} \leq \sum_{i=1}^{n-1} i = \frac{n^{2} -n}{2} = O(n^{2})</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:0.8888799999999999em;vertical-align:-0.19444em;"></span><span class="mord text"><span class="mord"># comparisons</span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:3.0787820000000004em;vertical-align:-1.277669em;"></span><span class="mop op-limits"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.8011130000000004em;"><span style="top:-1.872331em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">i</span><span class="mrel mtight">=</span><span class="mord mtight">1</span></span></span></span><span style="top:-3.050005em;"><span class="pstrut" style="height:3.05em;"></span><span><span class="mop op-symbol large-op">∑</span></span></span><span style="top:-4.300005em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:1.277669em;"><span></span></span></span></span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mord mathdefault">i</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:2.177108em;vertical-align:-0.686em;"></span><span class="mord"><span class="mopen nulldelimiter"></span><span class="mfrac"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.491108em;"><span style="top:-2.314em;"><span class="pstrut" style="height:3em;"></span><span class="mord"><span class="mord">2</span></span></span><span style="top:-3.23em;"><span class="pstrut" style="height:3em;"></span><span class="frac-line" style="border-bottom-width:0.04em;"></span></span><span style="top:-3.677em;"><span class="pstrut" style="height:3em;"></span><span class="mord"><span class="mord"><span class="mord mathdefault">n</span><span class="msupsub"><span class="vlist-t"><span class="vlist-r"><span class="vlist" style="height:0.8141079999999999em;"><span style="top:-3.063em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord mathdefault">n</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.686em;"><span></span></span></span></span></span><span class="mclose nulldelimiter"></span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:1.1141079999999999em;vertical-align:-0.25em;"></span><span class="mord mathdefault" style="margin-right:0.02778em;">O</span><span class="mopen">(</span><span class="mord"><span class="mord mathdefault">n</span><span class="msupsub"><span class="vlist-t"><span class="vlist-r"><span class="vlist" style="height:0.8641079999999999em;"><span style="top:-3.113em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span></span></span></span></span><span class="mclose">)</span></span></span></span></span></p>
|
|
|
|
|
|
<p>Lower Bound:</p>
|
|
|
|
|
|
<ul>
|
|
|
<li>Worst case initial sequence is in reverse order. e.g.:
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>n</td>
|
|
|
<td>n-1</td>
|
|
|
<td>n-2</td>
|
|
|
<td>…</td>
|
|
|
<td>1</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>In the i<sup>th</sup> stage we have:
|
|
|
<ul>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>n-i+1</td>
|
|
|
<td>n-1+2</td>
|
|
|
<td>…</td>
|
|
|
<td>n</td>
|
|
|
<td>n-1</td>
|
|
|
<td>n-1-1</td>
|
|
|
<td>…</td>
|
|
|
<td>2</td>
|
|
|
<td>1</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
<li>
|
|
|
<table>
|
|
|
<tbody>
|
|
|
<tr>
|
|
|
<td>n-i</td>
|
|
|
<td>n-i+1</td>
|
|
|
<td>…</td>
|
|
|
<td>n-1</td>
|
|
|
<td>n</td>
|
|
|
<td>n-i-1</td>
|
|
|
<td>…</td>
|
|
|
<td>2</td>
|
|
|
<td>1</td>
|
|
|
</tr>
|
|
|
</tbody>
|
|
|
</table>
|
|
|
</li>
|
|
|
</ul>
|
|
|
</li>
|
|
|
<li>This takes i comparisons, because the sorted part is of size i.</li>
|
|
|
<li>So, <span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mtext># comparisons</mtext><mo>≤</mo><mo>∑</mo><msup><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></msup><mo>=</mo><mi mathvariant="normal">Ω</mi><mo stretchy="false">(</mo><msup><mi>n</mi><mn>2</mn></msup><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">\text{\# comparisons} \leq \sum{i=1}^{n-1} = \Omega(n^{2})</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:0.8888799999999999em;vertical-align:-0.19444em;"></span><span class="mord text"><span class="mord"># comparisons</span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:1.6000100000000002em;vertical-align:-0.55001em;"></span><span class="mop op-symbol large-op" style="position:relative;top:-0.000004999999999977245em;">∑</span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mord"><span class="mord"><span class="mord mathdefault">i</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord">1</span></span><span class="msupsub"><span class="vlist-t"><span class="vlist-r"><span class="vlist" style="height:0.864108em;"><span style="top:-3.113em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:1.1141079999999999em;vertical-align:-0.25em;"></span><span class="mord">Ω</span><span class="mopen">(</span><span class="mord"><span class="mord mathdefault">n</span><span class="msupsub"><span class="vlist-t"><span class="vlist-r"><span class="vlist" style="height:0.8641079999999999em;"><span style="top:-3.113em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span></span></span></span></span><span class="mclose">)</span></span></span></span></span></li>
|
|
|
</ul>
|
|
|
|
|
|
<p>So, insertion sort worst case is <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mi mathvariant="normal">Θ</mi><mo stretchy="false">(</mo><msup><mi>n</mi><mn>2</mn></msup><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">\Theta(n^{2})</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:1.064108em;vertical-align:-0.25em;"></span><span class="mord">Θ</span><span class="mopen">(</span><span class="mord"><span class="mord mathnormal">n</span><span class="msupsub"><span class="vlist-t"><span class="vlist-r"><span class="vlist" style="height:0.8141079999999999em;"><span style="top:-3.063em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span></span></span></span></span><span class="mclose">)</span></span></span></span></p>
|
|
|
|
|
|
<p>(Transcriber’s note: I’m fairly certain you can only use big-O notation when talking about worst case scenario, not Theta. But I’m leaving it as written.)</p>
|
|
|
|
|
|
<h2 id="insertion-sort-best-case">Insertion Sort Best Case</h2>
|
|
|
|
|
|
<p>Best case: initial sequence is fully ordered.</p>
|
|
|
|
|
|
<p>Then: In each stage, exactly 1 comparison is made.</p>
|
|
|
|
|
|
<p>So, <span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mrow><mtext># comparisons</mtext><mo>=</mo><mi>n</mi><mo>−</mo><mn>1</mn><mo>=</mo><mi mathvariant="normal">Θ</mi><mo stretchy="false">(</mo><mi>n</mi><mo stretchy="false">)</mo></mrow><annotation encoding="application/x-tex">\text{\# comparisons} = n-1 = \Theta(n)</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:0.8888799999999999em;vertical-align:-0.19444em;"></span><span class="mord text"><span class="mord"># comparisons</span></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:0.66666em;vertical-align:-0.08333em;"></span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span></span><span class="base"><span class="strut" style="height:0.64444em;vertical-align:0em;"></span><span class="mord">1</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span></span><span class="base"><span class="strut" style="height:1em;vertical-align:-0.25em;"></span><span class="mord">Θ</span><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mclose">)</span></span></span></span>.</p>
|
|
|
|
|
|
<h2 id="heapsort-worst-case">Heapsort Worst Case</h2>
|
|
|
|
|
|
<p>Upper bound:</p>
|
|
|
|
|
|
<p><span class="katex-display"><span class="katex"><span class="katex-mathml"><math xmlns="http://www.w3.org/1998/Math/MathML"><semantics><mtable rowspacing="0.24999999999999992em" columnalign="right left" columnspacing="0em"><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mtext># comparisons</mtext></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>≤</mo><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><mn>2</mn><msub><mo><mi>log</mi><mo></mo></mo><mn>2</mn></msub><mo stretchy="false">(</mo><mi>n</mi><mo>−</mo><mi>i</mi><mo>+</mo><mn>1</mn><mo stretchy="false">)</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mn>2</mn><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><msub><mo><mi>log</mi><mo></mo></mo><mn>2</mn></msub><mo stretchy="false">(</mo><mi>i</mi><mo>+</mo><mn>1</mn><mo stretchy="false">)</mo></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mo>≤</mo><mn>2</mn><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mrow><mi>n</mi><mo>−</mo><mn>1</mn></mrow></munderover><msub><mo><mi>log</mi><mo></mo></mo><mn>2</mn></msub><mi>n</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mo>≤</mo><mn>2</mn><mi>n</mi><msub><mo><mi>log</mi><mo></mo></mo><mn>2</mn></msub><mi>n</mi></mrow></mstyle></mtd></mtr><mtr><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow></mrow></mstyle></mtd><mtd><mstyle scriptlevel="0" displaystyle="true"><mrow><mrow></mrow><mo>=</mo><mi>O</mi><mo stretchy="false">(</mo><mi>n</mi><mi>log</mi><mo></mo><mi>n</mi><mo stretchy="false">)</mo></mrow></mstyle></mtd></mtr></mtable><annotation encoding="application/x-tex">
|
|
|
\begin{aligned}
|
|
|
\text{\# comparisons} & \leq \sum_{i=1}^{n-1} 2\log_{2} (n-i+1)\\
|
|
|
& = 2\sum_{i=1}^{n-1} \log_{2} (i+1)\\
|
|
|
& = \leq 2\sum_{i=1}^{n-1} \log_{2} n\\
|
|
|
& = \leq 2n\log_{2} n\\
|
|
|
& = O(n \log n)
|
|
|
\end{aligned}
|
|
|
</annotation></semantics></math></span><span class="katex-html" aria-hidden="true"><span class="base"><span class="strut" style="height:13.136346000000001em;vertical-align:-6.318173000000001em;"></span><span class="mord"><span class="mtable"><span class="col-align-r"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:6.818173000000001em;"><span style="top:-8.818173000000002em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord text"><span class="mord"># comparisons</span></span></span></span><span style="top:-5.4393910000000005em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span><span style="top:-2.0606089999999995em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span><span style="top:0.35706000000000016em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span><span style="top:1.8570600000000002em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:6.318173000000001em;"><span></span></span></span></span></span><span class="col-align-l"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:6.818173000000001em;"><span style="top:-8.818173000000002em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mop op-limits"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.8011130000000004em;"><span style="top:-1.872331em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">i</span><span class="mrel mtight">=</span><span class="mord mtight">1</span></span></span></span><span style="top:-3.050005em;"><span class="pstrut" style="height:3.05em;"></span><span><span class="mop op-symbol large-op">∑</span></span></span><span style="top:-4.300005em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:1.277669em;"><span></span></span></span></span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mord">2</span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop"><span class="mop">lo<span style="margin-right:0.01389em;">g</span></span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.20696799999999996em;"><span style="top:-2.4558600000000004em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.24414em;"><span></span></span></span></span></span></span><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">−</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord mathdefault">i</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">+</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord">1</span><span class="mclose">)</span></span></span><span style="top:-5.4393910000000005em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord">2</span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop op-limits"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.8011130000000004em;"><span style="top:-1.872331em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">i</span><span class="mrel mtight">=</span><span class="mord mtight">1</span></span></span></span><span style="top:-3.050005em;"><span class="pstrut" style="height:3.05em;"></span><span><span class="mop op-symbol large-op">∑</span></span></span><span style="top:-4.300005em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:1.277669em;"><span></span></span></span></span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop"><span class="mop">lo<span style="margin-right:0.01389em;">g</span></span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.20696799999999996em;"><span style="top:-2.4558600000000004em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.24414em;"><span></span></span></span></span></span></span><span class="mopen">(</span><span class="mord mathdefault">i</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mbin">+</span><span class="mspace" style="margin-right:0.2222222222222222em;"></span><span class="mord">1</span><span class="mclose">)</span></span></span><span style="top:-2.0606089999999995em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord">2</span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop op-limits"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:1.8011130000000004em;"><span style="top:-1.872331em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">i</span><span class="mrel mtight">=</span><span class="mord mtight">1</span></span></span></span><span style="top:-3.050005em;"><span class="pstrut" style="height:3.05em;"></span><span><span class="mop op-symbol large-op">∑</span></span></span><span style="top:-4.300005em;margin-left:0em;"><span class="pstrut" style="height:3.05em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mathdefault mtight">n</span><span class="mbin mtight">−</span><span class="mord mtight">1</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:1.277669em;"><span></span></span></span></span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop"><span class="mop">lo<span style="margin-right:0.01389em;">g</span></span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.20696799999999996em;"><span style="top:-2.4558600000000004em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.24414em;"><span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mord mathdefault">n</span></span></span><span style="top:0.35706000000000016em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mrel">≤</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord">2</span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop"><span class="mop">lo<span style="margin-right:0.01389em;">g</span></span><span class="msupsub"><span class="vlist-t vlist-t2"><span class="vlist-r"><span class="vlist" style="height:0.20696799999999996em;"><span style="top:-2.4558600000000004em;margin-right:0.05em;"><span class="pstrut" style="height:2.7em;"></span><span class="sizing reset-size6 size3 mtight"><span class="mord mtight"><span class="mord mtight">2</span></span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:0.24414em;"><span></span></span></span></span></span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mord mathdefault">n</span></span></span><span style="top:1.8570600000000002em;"><span class="pstrut" style="height:3.8011130000000004em;"></span><span class="mord"><span class="mord"></span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mrel">=</span><span class="mspace" style="margin-right:0.2777777777777778em;"></span><span class="mord mathdefault" style="margin-right:0.02778em;">O</span><span class="mopen">(</span><span class="mord mathdefault">n</span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mop">lo<span style="margin-right:0.01389em;">g</span></span><span class="mspace" style="margin-right:0.16666666666666666em;"></span><span class="mord mathdefault">n</span><span class="mclose">)</span></span></span></span><span class="vlist-s"></span></span><span class="vlist-r"><span class="vlist" style="height:6.318173000000001em;"><span></span></span></span></span></span></span></span></span></span></span></span></p>
|
|
|
|
|
|
<p>Lower Bound? (empty space)</p>
|
|
|
|
|
|
<p>Base Case? (What input would lead to <strong>no</strong> movement during percolate-down?
|
|
|
What if we exclude this case?)</p>
|
|
|
|
|
|
<h2 id="recursive-divide--conquer-sorting">Recursive Divide & Conquer Sorting</h2>
|
|
|
|
|
|
<p>TODO</p>
|
|
|
|
|
|
<footer>
|
|
|
</footer>
|
|
|
</div>
|
|
|
</main>
|
|
|
</body>
|
|
|
</html>
|
