summaryrefslogtreecommitdiffstats
path: root/collectors/python.d.plugin/anomalies
AgeCommit message (Collapse)Author
2023-07-28comment out anomalies metadata and add note (#15573)Andrew Maguire
* comment out anomalies metadata and add note
2023-07-28remove metrics.csv files (#15593)Ilya Mashchenko
2023-07-20meta schema change multi-instance to multi_instance (#15470)Ilya Mashchenko
2023-07-19Updates to metadata.yaml (#15452)Shyam Sreevalsan
* Updates to metadata.yaml * Fixing formatting
2023-07-18Fix multiline (#15449)Fotis Voutsas
* add python.d/alarms yaml * long string fix * run the script without a limit on characters on line length
2023-07-18Bugfix on alerts generation for yamls (#15420)Fotis Voutsas
2023-07-14Make yamls pass the schema, and use decided temporary naming scheme (#15401)Fotis Voutsas
2023-07-11Add yaml metadata for metrics.csv files (#15238)Fotis Voutsas
2023-04-27Add metadata.csv to python.d.plugin (#14959)Fotis Voutsas
* add metadata.csv to several modules * second batch of adding metadata.csv * more metrics.csv's, also do a fix * revert READMEs and some fixes * add metrics.csv for ceph * evaluate dovecot metrics.csv * add metrics.csv for fail2ban * add metrics.csv to gearman * revert go_expvar README * revert dovecot README * minor fix * add metrics.csv for hddtemp * add metrics.csv for hpssa * Revert icecast README * add metrics.csv for ipfs * evaluate lightspeed metrics.csv * add metrics.csv to megacli * add metrics.csv for memcached * revert nsd readme * improve memcached metric titles * add metrics.csv for openldap * add metrics.csv for oracledb * revert postfix README * evaluate retroshare * evaluate samba * evaluate sensors * evaluate squid * evaluate tor * evaluate traefik * evaluate w1sensor * add metrics.csv for zscores * add metrics.csv for varnish * add metrics.csv for uwsgi * add metrics.csv for tomcat * add metrics.csv for spigotmc * add metrics.csv for smartd_log * add metrics.csv for riakkv * add metrics.csv for rethinkdbs * add metrics.csv for puppet * add metrics.csv for nvidia_smi * add metrics.csv for haproxy * make use of quotation marks only when needed * revert exim README * revert rest of READMEs * updates --------- Co-authored-by: ilyam8 <ilya@netdata.cloud>
2023-02-28fix python version check to work for 3.10 and above (#14616)Andrew Maguire
2023-02-20Include troubleshooting section in the docs of python.d modules (#13721)Tasos Katsoulas
Add troubleshooting sections to all python modules Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-02-15Reorganize learn documents under Integrations part 2 (#14538)Chris Akritidis
* Reorge exporter integrations * Reorg alert notifications. change mdx to md for alert related files * Move all .mdx to .md, including links.
2023-02-12Learn integrations category changes (#14510)Chris Akritidis
* Better present netdata pandas and fix how to add new charts to netdata * Properly categorize statsd and show it as a generic collector. Move asterisk and k6 Elevate anomaly detection to "monitor anything"
2023-02-12Move collectors under Integrations/Monitoring (#14509)Chris Akritidis
* Move collectors under Integrations/Monitoring * Correct Monitoring to Monitor
2023-02-10Fix broken links in collectors/COLLECTORS.md (#14502)Fotis Voutsas
* Publish collectors/python.d.plugin/anomalies/README.md to Learn * Update README.md * fix broken links in COLLECTORS.md
2023-02-02Covert our documentation links to GH absolute links (#14344)Tasos Katsoulas
Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-01-25Introduce the new Structure of the documentation (#13915)Fotis Voutsas
* Moving the cloud docs under /docs/cloud (previous location: netdata/learn/*) * Added metadata on almost every document of the old learn site for the new ingest process of learn. * Map old learn document to their best fit as topic related docs. Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: DShreve2 <david@netdata.cloud> Co-authored-by: hugovalente-pm <hugo@netdata.cloud>
2023-01-04Fix typos (#14194)Dimitris Apostolou
2022-06-01add note about anomaly advisor (#13042)Andrew Maguire
2022-02-17Docs: Removed Google Analytics tags (#12145)Tina Luedtke
2021-12-20add note with link to guide for using on Pi (#11605)Andrew Maguire
* add note with link to guide for using on Pi * Update collectors/python.d.plugin/anomalies/README.md Co-authored-by: DShreve2 <david@netdata.cloud> Co-authored-by: DShreve2 <david@netdata.cloud>
2021-11-16Fix typos (#11782)Dimitris Apostolou
Co-authored-by: ilyam8 <ilya@netdata.cloud>
2021-05-28rename default from job 'local' to 'anomalies' (#11178)Andrew Maguire
- 'Anomalies local' is not as nice as a 'Anomalies' menu item when using default settings and just enabling it for local node.
2021-04-21improvements to anomalies collector following dogfooding (#11003)Andrew Maguire
* improvements to anomalies collector following dogfooding - add check for python 3. - add ability to reinitialize models and data regulary if needed (off by default). - change check() to be less error prone when running on a parent node (direct learning from dogfooding on netdata parent). - add some model initialization functions to enable reinitialization if model gets into a "bad state". - add some logic to check for models that have not been trained and reinitialize and train them as needed. - add logic to validate_charts() to maintain dimensions by adding and removing as needed. * add newline at end of file * rename `verify` param to `tls_verify` for clarity
2021-03-03Change all refs from service to systemctl (#10703)Joel Hans
2021-01-19Spelling python plugin (#10525)Josh Soref
2021-01-19Add link to specific feedback megathread for the anomalies collector (#10506)Andrew Maguire
Add link to specific feedback megathread for the anomalies collector
2021-01-18Spelling md (#10508)Josh Soref
* spelling: activity Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: adding Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: addresses Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: administrators Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: alarm Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: alignment Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: analyzing Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: apcupsd Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: apply Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: around Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: associated Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: automatically Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: availability Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: background Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: bandwidth Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: berkeley Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: between Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: celsius Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: centos Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: certificate Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: cockroach Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: collectors Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: concatenation Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: configuration Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: configured Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: continuous Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: correctly Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: corresponding Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: cyberpower Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: daemon Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: dashboard Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: database Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: deactivating Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: dependencies Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: deployment Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: determine Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: downloading Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: either Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: electric Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: entity Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: entrant Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: enumerating Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: environment Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: equivalent Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: etsy Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: everything Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: examining Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: expectations Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: explicit Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: explicitly Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: finally Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: flexible Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: further Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: hddtemp Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: humidity Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: identify Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: importance Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: incoming Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: individual Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: initiate Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: installation Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: integration Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: integrity Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: involuntary Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: issues Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: kernel Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: language Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: libwebsockets Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: lighttpd Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: maintained Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: meaningful Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: memory Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: metrics Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: miscellaneous Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: monitoring Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: monitors Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: monolithic Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: multi Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: multiplier Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: navigation Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: noisy Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: number Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: observing Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: omitted Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: orchestrator Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: overall Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: overridden Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: package Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: packages Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: packet Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: pages Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: parameter Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: parsable Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: percentage Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: perfect Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: phpfpm Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: platform Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: preferred Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: prioritize Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: probabilities Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: process Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: processes Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: program Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: qos Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: quick Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: raspberry Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: received Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: recvfile Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: red hat Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: relatively Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: reliability Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: repository Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: requested Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: requests Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: retrieved Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: scenarios Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: see all Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: supported Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: supports Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: temporary Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: tsdb Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: tutorial Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: updates Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: utilization Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: value Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: variables Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: visualize Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: voluntary Signed-off-by: Josh Soref <jsoref@users.noreply.github.com> * spelling: your Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
2021-01-14Anomalies collector custom model bugfix for issue #10456 (#10459)Andrew Maguire
* Fix for #10456 - Add "|" as delimiter in custom_models_dims_renamed as opposed to ".". The "|" is how the collector knows what cols to pull from the dataframe for each model. Expected colnames in the df are "model_name|dim...." so it looks for "model_name" for example. - Remove `[self.expected_cols]` check on df_allmetrics. This will avoid failing if you happen to use a dim in a custom model that belongs to a chart that has one or more `null` values from /api/v1/allmetrics. If you happen to use such a dim in your model it will still fail as we can't make a prediction when one of the features is `null`. * add filters for some irrelevant warnings * add newline at end of file * fully remove self.expected_cols since no longer used
2021-01-13Add guide: Monitor and visualize anomalies with Netdata (#10480)Joel Hans
* Init new anomalies guide * Continuing work * Finish draft of part 1 * Tweak to opening * Change headline * Copyediting and fixes * Fix link * Remove with Netdata from title * Init new guide * Rename guide * Continue work on part 2 * Finish draft of part 2 * Editing pass * Fixes for Amy * Restore part 1 * Restore anomalies doc * Fixes for Jen
2021-01-07Add guide: Detect anomalies in nodes and applications with Netdata (#10451)Joel Hans
* Init new anomalies guide * Continuing work * Finish draft of part 1 * Tweak to opening * Change headline * Copyediting and fixes * Fix link * Remove with Netdata from title * Clean up frontmatter * Update docs/guides/monitor/anomaly-detection.md Co-authored-by: Andrew Maguire <andrewm4894@gmail.com> * Update docs/guides/monitor/anomaly-detection.md Co-authored-by: Andrew Maguire <andrewm4894@gmail.com> * Fixes for Jen * Fixes and improvements for Andy Co-authored-by: Andrew Maguire <andrewm4894@gmail.com>
2021-01-07Docs housekeeping for SEO and syntax, part 1 (#10388)Joel Hans
* First pass to get the script working right * Finish adding analytics tags
2020-12-14add paragraph in anomalies collector README to ask for feedback (#10363)Andrew Maguire
* add paragraph to ask for feedback * Clean up text Co-authored-by: Joel Hans <joel@netdata.cloud> * add callout for community forums as well * Update collectors/python.d.plugin/anomalies/README.md Co-authored-by: Odysseas Lamtzidis <odyslam@gmail.com> Co-authored-by: Joel Hans <joel@netdata.cloud> Co-authored-by: Odysseas Lamtzidis <odyslam@gmail.com>
2020-12-11add two more insignificant warnings to suppress in anomalies collector (#10369)Andrew Maguire
Following some discussion here: https://community.netdata.cloud/t/collector-anomalies-error-on-loading-source/581/11 The underlying python libraries, mainly numpy and sklearn can sometimes generate warnings for numerous, typically transient reasons relating to some quirk of the underlying data. For the purpose of the anomalies collector they don't really matter as worst case you would end up with the predict step failing and your predictions just becoming a constant values of last successful prediction and charts would just become flat lines making it obvious something is wrong. So warnings like this are expected to pop up every now and then from individual charts/models. For the most common and harmless ones we explicitly suppress them in the collector code itself so as to avoid risk of excessive logging of them to logs. This change just add's two more warning message filters.
2020-12-02Anomalies collector (#10060)Andrew Maguire
ML based anomaly detection python collector built on top of PyOD.
generated by cgit v1.2.3 (git 2.25.1) at 2024-08-22 17:35:36 +0000