0809bd6859
full diff: https://github.com/klauspost/compress/compare/v1.12.3...v1.14.2 Relevant changes affecting vendor: - docs: Add combined LICENSE file - Add snappy replacement package - tests: Remove snappy dependency for tests - huff0: Add size estimation function - huff0: Improve 4X decompression speed - huff0: Improve 4X decompression speed 5-10% - huff0: Faster 1X Decompression - zstd: Spawn decoder goroutine only if needed - zstd: Detect short invalid signatures - zstd: Add configurable Decoder window size - zstd: Add stream content size - zstd: Simplify hashing functions - zstd: use SpeedBestCompression for level >= 10 - zstd: Fix WriteTo error forwarding - zstd: Improve Best compression - zstd: Fix incorrect encoding in best mode - zstd: pooledZipWriter should return Writers to the same pool - zstd: Upgrade xxhash - zstd: Improve block encoding speed - zstd: add arm64 xxhash assembly - zstd: Minor decoder improvements - zstd: Minor performance tweaks - zstd: Add bigger default blocks - zstd: Remove unused decompression buffer - zstd: fix logically dead code - zstd: Add noasm tag for xxhash - zstd: improve header decoder Signed-off-by: Sebastiaan van Stijn <github@gone.nl> |
||
|---|---|---|
| .. | ||
| LICENSE.txt | ||
| README.md | ||
| xxhash.go | ||
| xxhash_amd64.s | ||
| xxhash_arm64.s | ||
| xxhash_asm.go | ||
| xxhash_other.go | ||
| xxhash_safe.go | ||
README.md
xxhash
VENDORED: Go to github.com/cespare/xxhash for original package.
xxhash is a Go implementation of the 64-bit xxHash algorithm, XXH64. This is a high-quality hashing algorithm that is much faster than anything in the Go standard library.
This package provides a straightforward API:
func Sum64(b []byte) uint64
func Sum64String(s string) uint64
type Digest struct{ ... }
func New() *Digest
The Digest type implements hash.Hash64. Its key methods are:
func (*Digest) Write([]byte) (int, error)
func (*Digest) WriteString(string) (int, error)
func (*Digest) Sum64() uint64
This implementation provides a fast pure-Go implementation and an even faster assembly implementation for amd64.
Benchmarks
Here are some quick benchmarks comparing the pure-Go and assembly implementations of Sum64.
| input size | purego | asm |
|---|---|---|
| 5 B | 979.66 MB/s | 1291.17 MB/s |
| 100 B | 7475.26 MB/s | 7973.40 MB/s |
| 4 KB | 17573.46 MB/s | 17602.65 MB/s |
| 10 MB | 17131.46 MB/s | 17142.16 MB/s |
These numbers were generated on Ubuntu 18.04 with an Intel i7-8700K CPU using the following commands under Go 1.11.2:
$ go test -tags purego -benchtime 10s -bench '/xxhash,direct,bytes'
$ go test -benchtime 10s -bench '/xxhash,direct,bytes'