Project Nayuki


Native hash functions for Java

This is a library of popular cryptographic hash functions implemented in pure Java, along with speed-optimized versions in C, x86 assembly, and x86-64 assembly. The Java Native Interface (JNI) is used to achieve this functionality.

Benchmark

Hash function Java speed C speed (-O0) C speed (-O1) x86-64 speed Native speedup
MD29.42 MiB/s3.55 MiB/s4.74 MiB/s0.50×
MD4249 MiB/s145 MiB/s452 MiB/s576 MiB/s2.31×
MD5187 MiB/s108 MiB/s326 MiB/s418 MiB/s2.24×
RIPEMD-128148 MiB/s63 MiB/s197 MiB/s190 MiB/s1.33×
RIPEMD-16059 MiB/s49 MiB/s139 MiB/s134 MiB/s2.36×
RIPEMD-256139 MiB/s111 MiB/s265 MiB/s1.91×
RIPEMD-32065 MiB/s83 MiB/s196 MiB/s3.02×
SHA-1123 MiB/s110 MiB/s305 MiB/s322 MiB/s2.62×
SHA-22478 MiB/s71 MiB/s118 MiB/s131 MiB/s1.68×
SHA-25678 MiB/s71 MiB/s118 MiB/s131 MiB/s1.68×
SHA-384106 MiB/s106 MiB/s176 MiB/s200 MiB/s1.89×
SHA-512106 MiB/s106 MiB/s176 MiB/s200 MiB/s1.89×
Tiger145 MiB/s136 MiB/s284 MiB/s1.96×
Tiger2145 MiB/s136 MiB/s284 MiB/s1.96×
Whirlpool23.7 MiB/s11.3 MiB/s44.2 MiB/s61.5 MiB/s2.59×

Higher GCC optimization levels than -O1 produced slower C code in most cases. For -O2 and -O3, most algorithms were a few percent slower, SHA-1 was 25% slower, RIPEMD-320 achieved 199 MiB/s at -O2, and Whirlpool achieved 46.7 MiB/s at -O3. As for the x86-64 code, testing was done at -O1, which was about a percent faster than -O0 (no meaningful difference).

All the benchmark results above are based on: CPU = Intel Core 2 Quad Q6600 2.40 GHz (single-threaded), OS = Ubuntu 10.04 (64-bit), compiler = GCC 4.4.3, JVM = OpenJDK 1.6.0_33 HotSpot server. All benchmarks ran in 64-bit mode.

Source code

Browse the full source code at GitHub: https://github.com/nayuki/Native-hashes-for-Java

Or download a ZIP of all the files: https://github.com/nayuki/Native-hashes-for-Java/archive/master.zip

The code is open source under the GNU Public License v3.0+.

Overview

How to use one of these hash functions:

import nayuki.nativehash.*;

Sha1 hasher = new Sha1();
byte[] b = (... read stuff ...);
hasher.update(b);
byte[] hash = hasher.getHash();

The source code comes in a number of parts:

Java programs

Examples: java/demo/sha1sum.java, java/demo/nayuki/nativehash/BenchmarkHashes.java

These are main programs runnable from the command line. They illustrate how this hashing library is used in practice.

Java hashers

Examples: java/src/nayuki/nativehash/BlockHasher.java, java/src/nayuki/nativehash/Md5.java

These implement the non-speed-critical parts of the hash function such as initialization, block accumulation, final padding, and hash value serialization. The compression function can be either pure Java or native code.

Java compressors

Example: java/test/nayuki/nativehash/Sha1Java.java

These implement the speed-critical compression function of each hash function in pure Java. These classes provide full hashing capability on any platform (even if the C or assembly code is ignored), a reference implementation to check that the native implementation produces the same values, and a comparison point for speed benchmarking (to see how much gain the native code yields).

Java main tests

Examples: java/test/nayuki/nativehash/HashTest.java, java/test/nayuki/nativehash/Sha256Test.java

These test suites include test vectors (known input-output values) for each hash function, as well as generic tests for block splitting equivalence and Java vs. native implementation value checking. For production usage with native code only, the entire java/test directory can be disregarded.

C wrappers for JNI

Example: native/sha512-jni.c

These implement the interfacing and data conversion between Java data types and native data types. The Java code calls into these native functions, which do some processing before calling the native compression functions.

C and assembly compressors

Examples: native/ripemd160-compress.c, native/whirlpool-compress-x86.S

These implement the hash function’s main compression function in C code (good for any platform), or assembly code for the x86 or x86-64 CPU instruction sets. For the x86/x86-64 code, SSE2 is often required.

Instructions

To build and run the code, follow these steps (Linux only, not supported on Windows):

  1. Download the full ZIP archive from the repository and unpack it.

  2. Compile the Java classes as per the normal procedure, using javac, your favorite Java build system, or by setting up a project in an IDE. Compiling the runnable main test classes (all the *Test.java files) is optional.

  3. For the native code, choose whether you want to use the hash compression functions from C, x86, or x86-64.

    • If using the C compression functions, then invoke the C compiler with a command like this (split into multiple lines for clarity):

      gcc -Wall -shared -fPIC -O1
          -I /usr/lib/jvm/java-1.6.0-openjdk/include/
          -o libnayuki-native-hashes.so
          native/*.c

      Note that you will need to change the -I argument to the appropriate include path provided by your Java VM installation. The directory contains jni.h and other C/C++ header files.

    • If using the x86 compression functions, then invoke the C compiler with a command like this (some hashes don’t have an x86 implementation):

      gcc -Wall -shared -fPIC -O1
          -I /usr/lib/jvm/java-1.6.0-openjdk/include/
          -o libnayuki-native-hashes.so
          native/*-jni.c  native/*-x86.S
          native/{md2,ripemd256,ripemd320,tiger}-compress.c
    • If using the x86-64 compression functions, then invoke the C compiler with a command like this (some hashes don’t have an x86-64 implementation):

      gcc -Wall -shared -fPIC -O1
          -I /usr/lib/jvm/java-1.6.0-openjdk/include/
          -o libnayuki-native-hashes.so
          native/*-jni.c  native/*-x8664.S
          native/{md2,ripemd256,ripemd320,tiger}-compress.c

    Now you should have produced a file libnayuki-native-hashes.so in your current working directory. This will be loaded by the JVM later.

  4. To run the Java VM and be able to load the native library, either add the directory of libnayuki-native-hashes.so to the environment variable LD_LIBRARY_PATH or give the JVM the appropriate -D option.

    For example: java -Djava.library.path=/home/user/nativehash -cp /home/user/nativehash/javabin nayuki/nativehash/Sha256Test

Notes