diff options
| author | Stelios Fragkakis <52996999+stelfrag@users.noreply.github.com> | 2022-10-16 23:15:14 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2022-10-16 23:15:14 +0300 |
| commit | 08cab7222478d06481c070b7f5027ead1c5d2b01 (patch) | |
| tree | a7089ad0e88f6b14601a5de888c3699dd0af859e /CMakeLists.txt | |
| parent | 70dad7e1263d066319ad13f13ea0c5b39cf664f5 (diff) | |
Add a thread to asynchronously process metadata updates (#13783)
* Remove old metalog text fle processing
* Add metadata event loop
* Move functions from sqlite_functions.c to sqlite_metadata.c
Queue updates to the metadata event loop
Migration to remove unused tables
Cleanup unused functions
* Queue chart labels to metadata
* Store chart labels to metadata
* During shutdown, run full speed
* Add shutdown prepare
Handle SHUTDOWN in the cmd queue function
Add worker thread to handle host/chart/dimension metadata doing dictionary traversals
* Remove unused RRDIM_FLAG_ACLK
Add flags to trigger host/chart/dimension metadata processing
* Incremental processing of chart metadata writes
* Store host labels
* Remove redundant return statements
* Change unit tests / cleanup
* Fix rescheduling
* Schedule chart labels update by setting the RRDSET_FLAG_METADATA_UPDATE flag
* Queue commands to update metadata for dimension and host labels
* Make sure we do a final scan to store metadata during shutdown (if needed)
* Remove unused structures
Adjust queue size since we do batch processing of updates without queueing individual messages
Remove pragma mmap for now
Fix memory leak during sqlite unittest (minor)
* Dont update if we are in archive mode
* Cleanup
* Build entire message payload and store
* Initialize worker completion properly
* Properly skip host check for pending metadata updates
* Report bind param failures
Add worker request inside the data payload
Initialize variables to silence warnings
Rebase on master
* Report the chart id (not the dimension) and the dimension id when storing a dimension
* Compilation warnings in 32bit
* Add DEFINE for the queries
* Remove commented out code
* * Remove items parameter from unitest
* Remove commented out code
* sqlite_metadata.h contains only public items
* Use sleep_usec instead of usleep
* Rename metadata_database_init_cmd_queue to metadata_init_cmd_queue
* Rename metadata_database_enq_cmd_noblock to metadata_enq_cmd_noblock
Diffstat (limited to 'CMakeLists.txt')
| -rw-r--r-- | CMakeLists.txt | 12 |
1 files changed, 2 insertions, 10 deletions
diff --git a/CMakeLists.txt b/CMakeLists.txt index 9e380b6a69..088f12800d 100644 --- a/CMakeLists.txt +++ b/CMakeLists.txt @@ -748,6 +748,8 @@ set(RRD_PLUGIN_FILES database/storage_engine.h database/ram/rrddim_mem.c database/ram/rrddim_mem.h + database/sqlite/sqlite_metadata.c + database/sqlite/sqlite_metadata.h database/sqlite/sqlite_functions.c database/sqlite/sqlite_functions.h database/sqlite/sqlite_context.c @@ -779,16 +781,6 @@ set(RRD_PLUGIN_FILES database/engine/pagecache.h database/engine/rrdenglocking.c database/engine/rrdenglocking.h - database/engine/metadata_log/metadatalog.h - database/engine/metadata_log/metadatalogapi.c - database/engine/metadata_log/metadatalogapi.h - database/engine/metadata_log/logfile.h - database/engine/metadata_log/logfile.c - database/engine/metadata_log/metadatalogprotocol.h - database/engine/metadata_log/metalogpluginsd.c - database/engine/metadata_log/metalogpluginsd.h - database/engine/metadata_log/compaction.c - database/engine/metadata_log/compaction.h database/KolmogorovSmirnovDist.c database/KolmogorovSmirnovDist.h ) |