A library of internal sorting routines
Ariel Faigon

insertion sort, shellsort, radixsort, heapsort, quicksort, quickersort, sedgesort (Robert Sedgewick quicksort optimization)

This is a collection of sorting algorithms, in C. All the examples are thoroughly tested using random input generation and assertions, there are no known bugs. I've been using these, especially the fastest ``sedgesort'', in production code.

Licensing: This code is released under the GNU GPL. You are free to use it in any way as long as you comply with the GNU GPL (General Public License) version 2 which you can find at gnu.org.

The source of these algorithms are classic algorithms and C texts/books which I most highly recommend. In some cases I had to convert the original pseudocode to the 'C' programming language to make it actually work (Note: Sedgewick, "Algorithms in C" wasn't yet published when I wrote this code (way back in the 1980's). I used the First edition which used pseudocode for all examples). In addition I have introduced some minor modifications to the code over time to improve style, readability, and efficiency and added a unit-test suite to ensure correctness:

All the sorting routines are internal sorts, they assume your data is in memory. When sorting big arrays that do not fit in memory on virtual memory systems, performance may suffer significantly.

Certain current implementations of sorting in C++ standard libraries like STL (the HP/SGI Standard Template Library which is now a part of the GNU free software collection) are comparable in speed to ``sedgesort''. Note however that the general C/Unix ``qsort'' routine is much slower due to its generality (e.g. element compare is done via an indirect function call passed as a function pointer.)

You may download the whole sort library or browse the individual files below.

Here are some brief descriptions of the sort library source files:

Simple makefile to build the library sort.a and the test program sorttest.

Header file. defines the key_t type, the type of the items we are sorting, macros for key-comparisons: GT (greater than), LT (less than), GE (greater or equal), LE (less or equal). SWAP macro to swap elements in the array. Macros are used instead of a compare function for speed. You may define all the above to your liking and recompile the library.

Insertion sort. Most efficient for small arrays (about 15 elements or less). For greater arrays, use one of the O(n*log(n)) methods. If you have small arrays, use this. Other methods are an overkill, and are not faster.

Shell Sort. Named after its inventor, D.L. Shell (1959) More efficient than insertion sort for arrays larger than about 15 elements, but less efficient than the O(n*log(n)) methods. The beauty of this method is how small the code is. Its average time is O(n^1.2) and the worst case bound is O(n*(log(n)^2)).

A radix sort based on bits in the binary representation of the sorted numbers. Contributed by José Gama. Gamasort will work only on unsigned integers in 2-complement representation. Thus it is less general than the other methods, it also has a relatively high complexity factor. On the positive side this is an O(n*log(n)) algorithm in which the 'n' is proportional to the largest number in the sorted array so it scales well to the cases where the array is very big but the numbers in it are relatively small like a million element array containing unsigned bytes.

quicksort. Invented by C.A.R. Hoare. Very good average time n*log(n), where the constant K is very small. but worst case is bad: O(n^2). See, sedgesort for a significant practical improvement.

An optimization of quicksort. Use a sentinel containing MAXINT, to make the constant K even smaller. This is similar to the qsort libc function, but without the (*compar)() call penalty.

Robert Sedgewick optimization. Use partial quickersort with a sentinel to reach a partial order, leave the unsorted segments of length == CUTOFF unsorted. Then apply a simpler one-pass low-overhead insertion sort on the whole array to reach complete order. This method was found empirically to be one of the fastest sorting methods in practice. If you don't believe it, try to beat it. Note, worst cases are rare in big arrays, so to keep the overhead to minimum, this sort does not try to avoid worst cases (e.g. using median of three to select a random pivot).

Heap sort. This is on average, slower than quicksort. But is has the advantage that it worst case is still O(n*log(n)) rather than O(n^2). Like quicksort, and other methods which pick elements at random positions in order to possibly exchange their positions, it is not 'stable'; elements of the same magnitude, might switch their relative order.

This is a relatively optimized version of heap-sort which minimizes neighboring elements exchanges in the innermost loop, using an insertion strategy. To do this, it first finds the final locations, and only then does the exchanges. Another advantage of heapsort over quicksort/sedgesort is that it enables you to do complete sorts on a top-subset of the elements. I.e. if you want only the top C (constant) elements out of N elements, heap-sort is the way to go; just create a heap, then call the 'sift' function, C times only. This feature is sometimes referred to as a heap implementation of a priority-queue.

Auxilliary test routines:
  • sorttest.c: Program containing main() to test the sort library sort.a.
  • bstest.c: Program containing main() to test the binary search routine that is included here as well.
  • sorted.c: Test routine to verify that an array is sorted.

Feedback to:

If you used this, and found it useful, please let me know.
I'd be more inclined to enrich this collection if I know people find it useful.
Please note that this software is released under the GNU General Public License v2.