summaryrefslogtreecommitdiffstats
path: root/daemon
AgeCommit message (Collapse)Author
2019-07-18Do not try to write log in /tmp (#6491)Chris Akritidis
2019-07-12Add global configuration option for zero metrics (#6419)Vladimir Kobal
* Add global configuration option for zero metrics * Add the option to the cgroup plugin * Add the option to the proc plugin (diskstats, meminfo, net_dev, netstat, sctp_snmp, snmp, snmp6, sockstat, sockstat6, synproxy, vmstat, system_edac_mc, system_node, btrfs, ksm, zfs) * Add the option to the macos plugin * Add the option to the freebsd plugin (devstat, getifaddrs, getmntinfo, sysctl) * Change the option behaviour with the 'auto' value * Add the option to the tc plugin * Update the documentation
2019-07-01Easily disable alarms, by persisting the silencers configuration (#6360)thiagoftsm
This PR was created to fix #3414, here I am completing the job initiated by Christopher, among the newest features that we are bring we have JSON inside the core - We are bringing to the core the capacity to work with JSON files, this is available either using the JSON-C library case it is present in the system or using JSMN library that was incorporated to our core. The preference is to have JSON-C, because it is a more complete library, but case the user does not have the library installed we are keeping the JSMN for we do not lose the feature. Health LIST - We are bringing more one command to the Health API, now with the LIST it is possible to get in JSON format the alarms active with Netdata. Health reorganized - Previously we had duplicated code in different files, this PR is fixing this (Thanks @cakrit !), the Health is now better organized. Removing memory leak - The first implementation of the json.c was creating SILENCERS without to link it in anywhere. Now it has been linked properly. Script updated - We are bringing some changes to the script that tests the Health. This PR also fixes the race condition created by the previous new position of the SILENCERS creation, I had to move it to daemon/main.c, because after various tests, it was confirmed that the error could happen in different parts of the code, case it was not initialized before the threads starts. Component Name health directory health-cmd Additional Information Fixes #6356 and #3414
2019-07-01Repeating alarm notifications (#6309)thiagoftsm
* Alarm_repeat mergin the original! * Alarm_repeat binary tree! * Alarm_repeat binary tree finished! * Alarm_repeat move function and format string * Alarms bringing a new Binary tree * Alarms fixing the last two * Alarm_repeat useless var! * Alarm fix format and repeat alarm! * Alarm_backend steps! * Alarm_repeat stopping to test cloud! * Alarm_repeat stopping to test cloud 2! * Alarm_repeat fixing when restart!
2019-06-21Handle file descriptors running out (#6303)Markos Fountoulakis
* Handle file descriptors running out * Added alarm for dbengine FS and I/O errors * more verbose alarm message * * Added File-Descriptor budget to Database Engine instances. * Changed FD budget of the web server from 50% to 25%. * Allocated 25% of FDs to dbengine. * Created a new dbengine global FD utilization chart.
2019-06-20Update the documentation on charts with zero metrics (#6314)Vladimir Kobal
2019-06-18Add note regarding libexecdir (#6301)Chris Akritidis
2019-06-05netdata/daemon: Eliminate a couple of warnings, plus tabs removal (#6222)Paul Emm. Katsoulakis
* netdata/daemon: Eliminate a couple of warnings, plus tabs removal on that file * netdata/daemon: fix indent
2019-05-31SSL implementation for Netdata (#5956)thiagoftsm
* SSL implementation for Netdata * Upload of fixes asked by @paulkatsoulakis and @cakrit * Fix local computer * Adding openssl to webserver * fixing.. * HTTPS almost there * Codacity * HTTPS day 3 * HTTPS without Bio step 1 * HTTPS without Bio step 2 * HTTPS without Bio step 3 * HTTPS without Bio step 4 * HTTPS without Bio step 5 * HTTPS without Bio step 6 * HTTPS without Bio step 7 * HTTPS without Bio step 8 * HTTPS without Bio step 9 * HTTPS without Bio step 10 * SSL on streaming 1 * Daily pull * HTTPS without Bio step 11 * HTTPS without Bio step 12 * HTTPS without Bio step 13 * HTTPS without Bio step 14 * SSL_Interception change documentation * HTTPS without Bio step 15 * HTTPS without Bio step 16 * SSL_Interception fix codacity * SSL_Interception fix doc * SSL_Interception comments * SSL_Interception fixing problems! * SSL_Interception killing bugs * SSL_Interception changing parameter * SSL_Implementation documentation and script * SSL_Implementation multiple fixes * SSL_Implementation installer and cipher * SSL_Implementation Redirect 301 * SSL_Implementation webserver doc and install-or-update.sh * SSL_Implementation error 00000001:lib(0):func(0):reason(1) * SSL_Implementation web server doc * SSL_Implementation SEGFAULT on Fedora * SSL_Implementation fix ^SSL=force|optional * SSL_Implementation Redirect and Ciphers * SSL_Implementation race condition 1 * SSL_Implementation Fix Location * SSL_Implementation Fix Location 2 * SSL_Implementation Fix stream * SSL_Implementation Fix stream 2 * SSL_Implementation Fix stream 3 * SSL_Implementation last problems! * SSL_Implementation adjusts to commit! * SSL_Implementation documentation permission! * SSL_Implementation documentation permission 2! * SSL_Implementation documentation permission 3!
2019-05-30DB engine optimize RAM usage (#6134)Markos Fountoulakis
* Optimize memory footprint of DB engine * Update documentation with the new memory requirements of dbengine * Fixed code style * Fix code style * Fix compile error
2019-05-27Remove unecessary 2nd call of get_system_info at startup (#6128)Chris Akritidis
2019-05-24Remove system_info copying (#6113)Vladimir Kobal
* Remove system_info copying * Return res flag
2019-05-24Revert "Move call to send_statistics later, to get more events from docker ↵Pavlos Emm. Katsoulakis
(#6096)" This reverts commit a941d189a6d38c82662f25cd30184a7fd7797e49. Revert broken commit until revised!
2019-05-23Move call to send_statistics later, to get more events from docker (#6096)Chris Akritidis
* Move call to send_statistics later, to get info from more docker containers * Test using localhost instead of ip
2019-05-23Fix small typos (#6090)Steve8291
2019-05-22Shorten netdata version and correctly send OS_VERSION_ID (#6082)Chris Akritidis
2019-05-15Database engine (#5282)Markos Fountoulakis
* Database engine prototype version 0 * Database engine initial integration with netdata POC * Scalable database engine with file and memory management. * Database engine integration with netdata * Added MIN MAX definitions to fix alpine build of travis CI * Bugfix for backends and new DB engine, remove useless rrdset_time2slot() calls and erroneous checks * DB engine disk protocol correction * Moved DB engine storage file location to /var/cache/netdata/{host}/dbengine * Fix configure to require openSSL for DB engine * Fix netdata daemon health not holding read lock when iterating chart dimensions * Optimized query API for new DB engine and old netdata DB fallback code-path * netdata database internal query API improvements and cleanup * Bugfix for DB engine queries returning empty values * Added netdata internal check for data queries for old and new DB * Added statistics to DB engine and fixed memory corruption bug * Added preliminary charts for DB engine statistics * Changed DB engine ratio statistics to incremental * Added netdata statistics charts for DB engine internal statistics * Fix for netdata not compiling successfully when missing dbengine dependencies * Added DB engine functional test to netdata unittest command parameter * Implemented DB engine dataset generator based on example.random chart * Fix build error in CI * Support older versions of libuv1 * Fixes segmentation fault when using multiple DB engine instances concurrently * Fix memory corruption bug * Fixed createdataset advanced option not exiting * Fix for DB engine not working on FreeBSD * Support FreeBSD library paths of new dependencies * Workaround for unsupported O_DIRECT in OS X * Fix unittest crashing during cleanup * Disable DB engine FS caching in Apple OS X since O_DIRECT is not available * Fix segfault when unittest and DB engine dataset generator don't have permissions to create temporary host * Modified DB engine dataset generator to create multiple files * Toned down overzealous page cache prefetcher * Reduce internal memory fragmentation for page-cache data pages * Added documentation describing the DB engine * Documentation bugfixes * Fixed unit tests compilation errors since last rebase * Added note to back-up the DB engine files in documentation * Added codacy fix. * Support old gcc versions for atomic counters in DB engine
2019-05-13Add system info streaming (#5996)Vladimir Kobal
* Add system info streaming * Fix segmentation fault in unit testing
2019-05-03Fix coverity warnings on get_system_info (#5952)Chris Akritidis
2019-05-02Add support for Mac OS X Name and Version (#5949)Chris Akritidis
* Add support for Mac OS X Name and Version * Fix codacy warnings
2019-04-18Extend netdata info API call (#5889)Chris Akritidis
* Add array of collector plugins-modules to api/v1/info * Add system info to api/v1/info, collect data from separate script, use environment vars in anonymous statistics script
2019-04-05Support configurable syslog facilities (#5792)thiagoftsm
* Changes in libnetdata/log/log.c to append facility * Fixing compilatioN * Fixing compilation problem! * Remove comments and adjust indentation inside log * Update log.c * Elimination of unnecessary calls to function
2019-03-13When running from within a k8s pod, use the k8s API to get the cgroup name ↵Chris Akritidis
(#5576) * When running from within a k8s pod, use the k8s API to get the pod name * Check the last part of an underscore-delimited or slash-delimited container id * Add a docker image builder that adds a single image to a user-specified registry, for use in k8s * When running in k8s, disable cgroups that the pod API does not return * Use longer name for k8s containers * Add reference to build-test.sh to packaging/docker/README.md * Anonymous statistics should not break when /proc/1/sched is not available
2019-03-08Wait for logs to be opened before calling anonymous statistics (#5573)Chris Akritidis
2019-03-05Minor fixes around plugin_directories initialization (#5536)Paul Katsoulakis
* Daemon minor cleanups: 1) pull in plugin directories logic, inside the pluginsd where it belongs and call a method from the daemon to do so, 2) Magic numbers are evil, give a meaningful definition for that plugin directories retrieval * Rename netdata_configured_plugins_dir -> netdata_configured_primary_plugins_dir. We allow multiple plugin directories and this is actually the primary (or stock?) directory, just make it clear to avoid confusion * In this new wrapper, just return whatever the string splitter would return * Reduce the scope - consider moving this to somewhere else in a common place if needed by other modules later
2019-02-25Fix SIGSEGV crash during shutdown of tc plugin. (#5495)Markos Fountoulakis
2019-02-18When running a binary with CLOCK_BOOTTIME defined on a system with a linux ↵Markos Fountoulakis
(#5415) kernel older than Linux 2.6.39 the clock_gettime(2) system call fails with EINVAL. In that case it must fall-back to CLOCK_MONOTONIC.
2019-02-13Split nfacct plugin into separate process (#5361)Vladimir Kobal
* Prepare build configuration * Prepare plugin for separating * Add command line options * Add debug messages * Use text API * Minor fixes * Update the documentation * Minor documentation formatting * Fix LGTM alerts * Fix building with CMake * Add nfacct and cups plugins to apps.plugin groups
2019-02-11Add message queue statistics (#5115)Vladimir Kobal
* Add IPC message queue charts * Add obsolete flag for dimensions * Delete obsolete dimensions from memory * Remove files for obsolete dimensions, filter requests * Make empty charts obsolete * Minimize obsolete dimension checks * Limit the number of dimensions in memory * Remove obsolete dimensions on netdata exit * Update documentation * Move flag to the end * Fix typo * Fix typo
2019-01-30Minor updates to anonymous statistics (#5295)Chris Akritidis
2019-01-27Anonymous statistics (#5113)Chris Akritidis
* Added shell and dashboard anonymous statistics * Check for environment var NETDATA_REGISTRY_UNIQUE_ID * Fix indentation * Removed health-cmdapi-test * docs/anonymous-statistics.md
2019-01-15Port ACLs, Management API and Health commands (#4969)Chris Akritidis
##### Summary fixes #2673 fixes #2149 fixes #5017 fixes #3830 fixes #3187 fixes #5154 Implements a command API for health which will accept commands via a socket to selectively suppress health checks. Allows different ports to accept different request types (streaming, dashboard, api, registry, netdata.conf, badges, management) Removes support for multi-threaded and single-threaded web servers. ##### Component Name health, daemon
2018-12-17Make units compliant with IEC standard (#4985)Vladimir Kobal
* Change GB to GiB * Change MB to MiB in apps.plugin * Change MB to MiB in cgroups.plugin * Change MB to MiB in freebsd.plugin and macos.plugin * Change MB to MiB in proc.plugin * Change KB to KiB * Change kB to KiB for divisor 1024 * Fix units for memory.failcnt * Fix other units * Change CPU time percentage * Change kilobytes to KiB in apps.plugin * Small fixes
2018-12-07Ga (#4938)Chris Akritidis
* Added GA tags to markdowns * Add GA tags to mds
2018-12-06Config docs improvements (#4918)Chris Akritidis
* WIP to add a new config readme * WIP * WIP * WIP * WIP * WIP * Major rewrite of configuration instructions and minor improvements to the html doc site * Major rewrite of configuration instructions and minor improvements to the html doc site * Major rewrite of configuration instructions and minor improvements to the html doc site * Major rewrite of configuration instructions and minor improvements to the html doc site * Major rewrite of configuration instructions and minor improvements to the html doc site * Major rewrite of configuration instructions and minor improvements to the html doc site * Major rewrite of configuration instructions and minor improvements to the html doc site * Major rewrite of configuration instructions and minor improvements to the html doc site
2018-11-25Rename `doc` to `docs` and move `htmldoc` (#4741)Paweł Krupa
* rename doc dir; move htmldoc under docs/generator * run shellcheck and shfmt on docs generator
2018-11-23Sanitize headers and htmlstructure (#4713)Chris Akritidis
* Restructured html site, corrected header in REDISTRIBUTED * Added header * Header updates and restructuring * Move requirements and runtime txts to htmldoc, by adding a netlify.toml that changes the base directory * Minor corrections to support the html doc restructuring * Debugging netlify * Debugging netlify * Debugging netlify * Beautify headers, comment in buildhtml * Beautify headers * Sanitize headers and reorganize static html site * Updated Makefile with moved and created htmldoc scripts
2018-11-22Documentation links sanity checker (#4701)Chris Akritidis
* Fix broken links * Fixed link * Added links checker * link updates from the link checker * Final corrections to allow checklinks to run without errors * Removed whitespace * Fixed codacy errors/warnings
2018-11-21Fix broken links (#4700)Chris Akritidis
##### Summary <!--- Describe the change below, including rationale and design decisions --> Fixes #4672 The name of the branch is misleading, don't worry about it. Details on the fixes below. ##### Additional Information > Checking links in ./doc/Netdata-Security-and-Disclosure-Information.md > 1. [L13] 404 https://github.com/netdata/netdata/.github/ISSUE_TEMPLATE.md Fixed > Checking links in ./REDISTRIBUTED.md > 1. [L190] 404 https://github.com/netdata/netdata/blob/master/python.d/python_modules/urllib3/packages/six.py Fixed > Checking links in ./web/api/queries/ses/README.md > 1. [L53] https://en.wikipedia.org/wiki/Moving_average#exponential-moving-average](https://en.wikipedia.org/wiki/Moving_average bad URI(is not URI?): https://en.wikipedia.org/wiki/Moving_average#exponential-moving-average](https://en.wikipedia.org/wiki/Moving_average False, link works > Checking links in ./packaging/README.md > 1. [L52] 404 https://github.com/firehol/infrastructure/raw/master/doc/release.txt Fixed > Checking links in ./installer/README.md > 1. [L089] 404 https://github.com/netdata/netdata/blob/master/MAINTAINERS.md Fixed > 2. [L241] 404 http://pkg.freebsd.org/FreeBSD:11:amd64/latest/All/netdata-1.10.0.txz Fixed > Checking links in ./daemon/README.md > 1. [L080] 404 https://github.com/netdata/netdata/pull/403_ False. The URL is without the underscore > 2. [L116] 404 https://github.com/netdata/netdata/blob/master/LICENSE.md Fixed > Checking links in ./collectors/python.d.plugin/web_log/README.md > 1. [L026] 404 https://github.com/netdata/netdata/tree/master/conf.d/python.d Fixed > 2. [L030] 404 https://github.com/netdata/netdata/blob/master/conf.d/python.d/web_log.conf Fixed > 3. [L187] 404 https://github.com/netdata/netdata/blob/master/conf.d/health.d/web_log.conf Fixed > 4. [L200] 404 https://github.com/netdata/netdata/tree/master/conf.d/health.d Fixed > Checking links in ./collectors/python.d.plugin/apache/README.md > 1. [L52] 404 http://www.apache.org/server-status?auto Can't fix. Can't find a URL that will return server-status > Checking links in ./collectors/freeipmi.plugin/README.md > 1. [L090] 404 https://github.com/ktsaou/netdata/tree/master/plugins/freeipmi.plugin Fixed (also in the c code) > Checking links in ./CONTRIBUTORS.md > 1. [L013] http://producingoss.com/en/copyright-assignment.html Failed to open TCP connection to producingoss.com:80 (Connection refused - connect(2) for "producingoss.com" port 80) Fixed
2018-11-13Configuration readme links (#4642)Chris Akritidis
* Replaced links to wiki to point to netdata repo * Link to header of charts.d.plugin * Link to node.d.plugin header * Fixed daemon/config/README.md links
2018-11-12Update README.md (#4629)Chris Akritidis
Added 's' to allow connection
2018-11-12Htmldoc (#4607)Chris Akritidis
* First html documentation debug set * Test 2 * Relative path changed * Updated comments * Cleanup, installation draft added * fixes * test * test * test * First html documentation debug set * Test 2 * Relative path changed * Updated comments * Cleanup, installation draft added * fixes * test * test * test * First set of major cleanup/deduplication * 2nd major cleanup * update getting started structure * Cleanup in using netdata * Final cleanup/deduplication * Added initial CONTRIBUTING.md, updated some info related to contributing on the orchestrators * Removed Why-Netdata (included in new README in master), added link to CONTRIBUTING.md * First html documentation debug set * Updated Makefile.am to ignore the new md and htmldoc generation files * Removing files from rebase * First html documentation debug set * Test 2 * Relative path changed * Updated comments * Cleanup, installation draft added * fixes * test * test * test * First html documentation debug set * Test 2 * Relative path changed * Updated comments * Cleanup, installation draft added * test * test * First set of major cleanup/deduplication * 2nd major cleanup * update getting started structure * Cleanup in using netdata * Final cleanup/deduplication * Added initial CONTRIBUTING.md, updated some info related to contributing on the orchestrators * Removed Why-Netdata (included in new README in master), added link to CONTRIBUTING.md * First html documentation debug set * Updated Makefile.am to ignore the new md and htmldoc generation files * Removing files from rebase * Fixed Makefile.am * Same line header and badges * Fixed broken link * CPU monitoring is in apps plugin * Removed obsolete files * Remove obsolete files * - Make the Health API part of health/README.md new file web/api/health/README.md - Make installer/LAUNCH.md part of deamon/README.md - Move installer/MAINTAINERS.md to packaging/maintainers/README.md - Move installer/DOCKER.md to docker/README.md - Move system/README.md to daemon/config/README.md - Move web/CUSTOM-DASHBOARDS.md to web/gui/custom/README.md - Move web/CONFLUENCE-DASHBOARDS.md to web/gui/confluence/README.md * Resolve codacy issue $(..) syntax instead of `..` * Fix following warnings and add svgs to the data_structures/README.md - CHANGELOG.md - CODE_OF_CONDUCT.md - CONTRIBUTORS.md - REDISTRIBUTED.md - diagrams/data_structures/README.md - docker/README.md WARNING - Documentation file 'README.md' contains a link to 'collectors/plugins.d' which does not exist in the documentation directory. WARNING - Documentation file 'README.md' contains a link to 'collectors/statsd.plugin' which does not exist in the documentation directory. WARNING - Documentation file 'CONTRIBUTING.md' contains a link to 'web/CUSTOM-DASHBOARDS.md' which does not exist in the documentation directory. WARNING - Documentation file 'CONTRIBUTING.md' contains a link to 'web/CONFLUENCE-DASHBOARDS.md' which does not exist in the documentation directory. * Wrong urls in data_structures/README.md svgs * Fix svg URLs number 2 * Modify the first line of the main README.md, to enable proper static html generation. Executed after copying the file to htmldoc/src * Added back Why Netdata * Fixed link to registry in Why-Netdata.md * Added Why-Netdata to buildyaml and to Makefile.am * Replaced http links causing mixed content warnings * Made buildhtml ignore the directory node_modules created by Netlify * Corrected CONTRIBUTING.MD to CONTRIBUTING.md
2018-11-04incremental overflows should not show zeros values (#4538)Costa Tsaousis
* incremental overflows do not show zeros; fixes #4533 * use the max per metric per session for detecting counter size
2018-10-26add option to run netdata in the background (#4364)Poh Zi How
* run netdata in foreground * add contributors * readd -D option * revert some changes * add explicit value for default case
2018-10-25query engine documentation and stats (#4483)Costa Tsaousis
2018-10-18moved related wiki pages into the repo (#4428)Costa Tsaousis
* moved related wiki pages into the repo * updated web server docs * fixed typos
2018-10-17moved stream.conf initialization after log files have been open; fixes #4403 ↵Costa Tsaousis
(#4422)
2018-10-15modularized all source code (#4391)Costa Tsaousis
* modularized all external plugins * added README.md in plugins * fixed title * fixed typo * relative link to external plugins * external plugins configuration README * added plugins link * remove plugins link * plugin names are links * added links to external plugins * removed unecessary spacing * list to table * added language * fixed typo * list to table on internal plugins * added more documentation to internal plugins * moved python, node, and bash code and configs into the external plugins * added statsd README * fix bug with corrupting config.h every 2nd compilation * moved all config files together with their code * more documentation * diskspace info * fixed broken links in apps.plugin * added backends docs * updated plugins readme * move nc-backend.sh to backends * created daemon directory * moved all code outside src/ * fixed readme identation * renamed plugins.d.plugin to plugins.d * updated readme * removed linux- from linux plugins * updated readme * updated readme * updated readme * updated readme * updated readme * updated readme * fixed README.md links * fixed netdata tree links * updated codacy, codeclimate and lgtm excluded paths * update CMakeLists.txt * updated automake options at top directory * libnetdata slit into directories * updated READMEs * updated READMEs * updated ARL docs * updated ARL docs * moved /plugins to /collectors * moved all external plugins outside plugins.d * updated codacy, codeclimate, lgtm * updated README * updated url * updated readme * updated readme * updated readme * updated readme * moved api and web into webserver * web/api web/gui web/server * modularized webserver * removed web/gui/version.txt