summaryrefslogtreecommitdiffstats
path: root/database/engine
AgeCommit message (Collapse)Author
2019-10-07Handle cases where metric timestamps are inversed and data collection ↵Markos Fountoulakis
interval rounds to 0 (#7008)
2019-10-07Remove hard cap from page cache size to eliminate deadlocks. (#7006)Markos Fountoulakis
* Remove page cache error detection and deadlock resolution * Change page cache logic to disallow deadlocks due to too many API users * Updated documentation * Changed default and minimum page cache size values to 32 and 8 MiB respectively
2019-10-05Increase dbengine default cache size (#6997)Markos Fountoulakis
* Increase database engine default page cache size to support up to 32K metrics out of the box * Reduce mass flood effect of dbengine page cache alarm * changed repeating notification to every hour
2019-10-03Make dbengine the default memory mode (#6977)Markos Fountoulakis
* Basic functionality for dbengine stress test. * Fix coverity defects * Refactored dbengine stress test to be configurable * Added benchmark results and evaluation in dbengine documentation * Make dbengine the default memory mode
2019-10-02Fix dbengine consistency when a writer modifies a page concurrently with a ↵Markos Fountoulakis
reader querying its metrics (#6979)
2019-09-29Fix Remark Lint for READMEs in Database (#6942)Promise Akpan
* fix remark lint Database engine * fix remark lint of database README * rewrap dbengine readme for consistency * rewrap database README * make character limit to 120 not 80
2019-09-28Reduce overhead during write io (#6964)Markos Fountoulakis
* Reduce CPU overhead when flushing dirty pages to disk
2019-09-24Detect deadlock in dbengine page cache (#6911)Markos Fountoulakis
* Detect deadlock in dbengine page cache when there are too many metrics and print error message * Resolve dbengine deadlock by dropping metrics when page cache is too small and define relevant alarms * Changed printing deadlock errors to only happen once per dbengine instance
2019-09-12Stress test insertions into dbengine and bugfixes (#6814)Markos Fountoulakis
* Fix memory corruption during deallocation of page cache * Refactored dataset generator in order to support the upcoming self-validating stress test and multithreading. * Fix starvation in database engine loop when the command queues are continuously populated * Fixing disk quota limits for dbengine dataset generator
2019-08-28Fix corrupted transaction payload handling during start-up of the database ↵Markos Fountoulakis
engine. (#6731)
2019-08-28Variable Granularity support for data collection (#6430)Markos Fountoulakis
* Variable Granularity support for data collection in the dbengine. * Variable Granularity support for data collection in the daemon. * Added tests to validate the data being queried after having been collected by changing data collection interval * Fix memory corruption * Updated database engine documentation about data collection frequency behaviour
2019-08-15Fix Markdown Lint warnings (#6664)Promise Akpan
* make remark access all directories * detailed fix after autofix by remark lint * cross check autofix for this set of files * crosscheck more files * crosschecking and small fixes * crosscheck autofixed md files
2019-08-13 Change "netdata" to "Netdata" in all docs (#6621)Joel Hans
* First pass of changing netdata to Netdata * Second pass of netdata -> Netdata * Starting work on netdata with no whitespace after * Pass for netdata with no whitespace at the end * Pass for netdata with no whitespace at the front
2019-07-15Fix CRC and I/O error handling in dbengine so that netdata is not halted and ↵Markos Fountoulakis
relevant error messages are printed and alarms are raised (#6452)
2019-07-02Update README.md (#6372)Markos Fountoulakis
Improve documentation about file descriptors and systemd configuration.
2019-06-21Update documentation about dbengine (#6264)Markos Fountoulakis
* Update README.md with more up-to-date information regarding dbengine
2019-06-21Handle file descriptors running out (#6303)Markos Fountoulakis
* Handle file descriptors running out * Added alarm for dbengine FS and I/O errors * more verbose alarm message * * Added File-Descriptor budget to Database Engine instances. * Changed FD budget of the web server from 50% to 25%. * Allocated 25% of FDs to dbengine. * Created a new dbengine global FD utilization chart.
2019-06-07Force page alignment per dimension of chart. (#6240)Markos Fountoulakis
2019-06-04Fill chart gaps efficiently. (#6216)Markos Fountoulakis
2019-06-04Fix page cache descriptor race condition (#6202)Markos Fountoulakis
2019-06-03Support falling back to buffered I/O when direct I/O is unavailable (#6174)Markos Fountoulakis
2019-05-30Add empty page detection in DB engine (#6173)Markos Fountoulakis
2019-05-30DB engine optimize RAM usage (#6134)Markos Fountoulakis
* Optimize memory footprint of DB engine * Update documentation with the new memory requirements of dbengine * Fixed code style * Fix code style * Fix compile error
2019-05-22Fix race condition in DB engine API (#6079)Markos Fountoulakis
2019-05-22Fix creating chart directories when not necessary with memory mode dbengine ↵Markos Fountoulakis
(#6078)
2019-05-20Fix delete datafile error (#6057)Markos Fountoulakis
* Added print to debug failure to delete page during datafile deletion * Detect case of corrupted pages not being in page cache when deleting file
2019-05-15Database engine (#5282)Markos Fountoulakis
* Database engine prototype version 0 * Database engine initial integration with netdata POC * Scalable database engine with file and memory management. * Database engine integration with netdata * Added MIN MAX definitions to fix alpine build of travis CI * Bugfix for backends and new DB engine, remove useless rrdset_time2slot() calls and erroneous checks * DB engine disk protocol correction * Moved DB engine storage file location to /var/cache/netdata/{host}/dbengine * Fix configure to require openSSL for DB engine * Fix netdata daemon health not holding read lock when iterating chart dimensions * Optimized query API for new DB engine and old netdata DB fallback code-path * netdata database internal query API improvements and cleanup * Bugfix for DB engine queries returning empty values * Added netdata internal check for data queries for old and new DB * Added statistics to DB engine and fixed memory corruption bug * Added preliminary charts for DB engine statistics * Changed DB engine ratio statistics to incremental * Added netdata statistics charts for DB engine internal statistics * Fix for netdata not compiling successfully when missing dbengine dependencies * Added DB engine functional test to netdata unittest command parameter * Implemented DB engine dataset generator based on example.random chart * Fix build error in CI * Support older versions of libuv1 * Fixes segmentation fault when using multiple DB engine instances concurrently * Fix memory corruption bug * Fixed createdataset advanced option not exiting * Fix for DB engine not working on FreeBSD * Support FreeBSD library paths of new dependencies * Workaround for unsupported O_DIRECT in OS X * Fix unittest crashing during cleanup * Disable DB engine FS caching in Apple OS X since O_DIRECT is not available * Fix segfault when unittest and DB engine dataset generator don't have permissions to create temporary host * Modified DB engine dataset generator to create multiple files * Toned down overzealous page cache prefetcher * Reduce internal memory fragmentation for page-cache data pages * Added documentation describing the DB engine * Documentation bugfixes * Fixed unit tests compilation errors since last rebase * Added note to back-up the DB engine files in documentation * Added codacy fix. * Support old gcc versions for atomic counters in DB engine
generated by cgit v1.2.3 (git 2.25.1) at 2024-08-28 23:15:21 +0000