diff options
| author | Costa Tsaousis <costa@netdata.cloud> | 2023-10-27 15:37:34 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-10-27 17:37:34 +0300 |
| commit | cd584e0357b82ec5cad12156fd7a5b65f545a0d0 (patch) | |
| tree | 3acca5ef3a84c5ed1defab0588431f71950d6e39 /Makefile.am | |
| parent | 89978b5b84297596af969358bd159e87f71cab64 (diff) | |
ZSTD and GZIP/DEFLATE streaming support (#16268)
* move compression header to compression.h
* prototype with zstd compression
* updated capabilities
* no need for resetting compression
* left-over reset function
* use ZSTD_compressStream() instead of ZSTD_compressStream2() for backwards compatibility
* remove call to LZ4_decoderRingBufferSize()
* debug signature failures
* fix the buffers of lz4
* fix decoding of zstd
* detect compression based on initialization; prefer ZSTD over LZ4
* allow both lz4 and zstd
* initialize zstd streams
* define missing ZSTD_CLEVEL_DEFAULT
* log zero compressed size
* debug log
* flush compression buffer
* add sender compression statistics
* removed debugging messages
* do not fail if zstd is not available
* cleanup and buildinfo
* fix max message size, use zstd level 1, add compressio ratio reporting
* use compression level 1
* fix ratio title
* better compression error logs
* for backwards compatibility use buffers of COMPRESSION_MAX_CHUNK
* switch to default compression level
* additional streaming error conditions detection
* do not expose compression stats when compression is not enabled
* test for the right lz4 functions
* moved lz4 and zstd to their own files
* add gzip streaming compression
* gzip error handling
* added unittest for streaming compression
* eliminate a copy of the uncompressed data during zstd compression
* eliminate not needed zstd allocations
* cleanup
* decode gzip with Z_SYNC_FLUSH
* set the decoding gzip algorithm
* user configuration for compression levels and compression algorithms order
* fix exclusion of not preferred compressions
* remove now obsolete compression define, since gzip is always available
* rename compression algorithms order in stream.conf
* move common checks in compression.c
* cleanup
* backwards compatible error checking
Diffstat (limited to 'Makefile.am')
| -rw-r--r-- | Makefile.am | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/Makefile.am b/Makefile.am index 405fd862a3..3996c91097 100644 --- a/Makefile.am +++ b/Makefile.am @@ -666,6 +666,13 @@ API_PLUGIN_FILES = \ STREAMING_PLUGIN_FILES = \ streaming/rrdpush.c \ streaming/compression.c \ + streaming/compression.h \ + streaming/compression_gzip.c \ + streaming/compression_gzip.h \ + streaming/compression_lz4.c \ + streaming/compression_lz4.h \ + streaming/compression_zstd.c \ + streaming/compression_zstd.h \ streaming/sender.c \ streaming/receiver.c \ streaming/replication.h \ @@ -1143,6 +1150,7 @@ NETDATA_COMMON_LIBS = \ $(OPTIONAL_MQTT_LIBS) \ $(OPTIONAL_UV_LIBS) \ $(OPTIONAL_LZ4_LIBS) \ + $(OPTIONAL_ZSTD_LIBS) \ $(OPTIONAL_DATACHANNEL_LIBS) \ libjudy.a \ $(OPTIONAL_SSL_LIBS) \ |