summaryrefslogtreecommitdiffstats
path: root/packaging/makeself
AgeCommit message (Collapse)Author
2024-01-11packaging: add cap_dac_read_search to go.d.plugin (#16754)Ilya Mashchenko
2023-12-29add --disable-logsmanagement when building static (#16684)Ilya Mashchenko
2023-12-15ndsudo - a helper to run privileged commands (#16614)Costa Tsaousis
* ndsudo command * added help * make ndsudo setuid to root * fix megacli binary name on FreeBSD * move ndsudo to collectors/plugins.d/ * address PR comments * do not print the command line argument, instead print its index --------- Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
2023-11-22New logging layer (#16357)Costa Tsaousis
* cleanup of logging - wip * first working iteration * add errno annotator * replace old logging functions with netdata_logger() * cleanup * update error_limit * fix remanining error_limit references * work on fatal() * started working on structured logs * full cleanup * default logging to files; fix all plugins initialization * fix formatting of numbers * cleanup and reorg * fix coverity issues * cleanup obsolete code * fix formatting of numbers * fix log rotation * fix for older systems * add detection of systemd journal via stderr * finished on access.log * remove left-over transport * do not add empty fields to the logs * journal get compact uuids; X-Transaction-ID header is added in web responses * allow compiling on systems without memfd sealing * added libnetdata/uuid directory * move datetime formatters to libnetdata * add missing files * link the makefiles in libnetdata * added uuid_parse_flexi() to parse UUIDs with and without hyphens; the web server now read X-Transaction-ID and uses it for functions and web responses * added stream receiver, sender, proc plugin and pluginsd log stack * iso8601 advanced usage; line_splitter module in libnetdata; code cleanup * add message ids to streaming inbound and outbound connections * cleanup line_splitter between lines to avoid logging garbage; when killing children, kill them with SIGABRT if internal checks is enabled * send SIGABRT to external plugins only if we are not shutting down * fix cross cleanup in pluginsd parser * fatal when there is a stack error in logs * compile netdata with -fexceptions * do not kill external plugins with SIGABRT * metasync info logs to debug level * added severity to logs * added json output; added options per log output; added documentation; fixed issues mentioned * allow memfd only on linux * moved journal low level functions to journal.c/h * move health logs to daemon.log with proper priorities * fixed a couple of bugs; health log in journal * updated docs * systemd-cat-native command to push structured logs to journal from the command line * fix makefiles * restored NETDATA_LOG_SEVERITY_LEVEL * fix makefiles * systemd-cat-native can also work as the logger of Netdata scripts * do not require a socket to systemd-journal to log-as-netdata * alarm notify logs in native format * properly compare log ids * fatals log alerts; alarm-notify.sh working * fix overflow warning * alarm-notify.sh now logs the request (command line) * anotate external plugins logs with the function cmd they run * added context, component and type to alarm-notify.sh; shell sanitization removes control character and characters that may be expanded by bash * reformatted alarm-notify logs * unify cgroup-network-helper.sh * added quotes around params * charts.d.plugin switched logging to journal native * quotes for logfmt * unify the status codes of streaming receivers and senders * alarm-notify: dont log anything, if there is nothing to do * all external plugins log to stderr when running outside netdata; alarm-notify now shows an error when notifications menthod are needed but are not available * migrate cgroup-name.sh to new logging * systemd-cat-native now supports messages with newlines * socket.c logs use priority * cleanup log field types * inherit the systemd set INVOCATION_ID if found * allow systemd-cat-native to send messages to a systemd-journal-remote URL * log2journal command that can convert structured logs to journal export format * various fixes and documentation of log2journal * updated log2journal docs * updated log2journal docs * updated documentation of fields * allow compiling without libcurl * do not use socket as format string * added version information to newly added tools * updated documentation and help messages * fix the namespace socket path * print errno with error * do not timeout * updated docs * updated docs * updated docs * log2journal updated docs and params * when talking to a remote journal, systemd-cat-native batches the messages * enable lz4 compression for systemd-cat-native when sending messages to a systemd-journal-remote * Revert "enable lz4 compression for systemd-cat-native when sending messages to a systemd-journal-remote" This reverts commit b079d53c11f6687cd64d804fdd7b24c0492bf245. * note about uncompressed traffic * log2journal: code reorg and cleanup to make modular * finished rewriting log2journal * more comments * rewriting rules support * increased limits * updated docs * updated docs * fix old log call * use journal only when stderr is connected to journal * update netdata.spec for libcurl, libpcre2 and log2journal * pcre2-devel * do not require pcre2 in centos < 8, amazonlinux < 2023, open suse * log2journal only on systems pcre2 is available * ignore log2journal in .gitignore * avoid log2journal on centos 7, amazonlinux 2 and opensuse * add pcre2-8 to static build * undo last commit * Bundle to static Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Add build deps for deb packages Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Add dependencies; build from source Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Test build for amazon linux and centos expect to fail for suse Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * fix minor oversight Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Reorg code * Add the install from source (deps) as a TODO * Not enable the build on suse ecosystem Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> --------- Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-11-07fix zstd in static build (#16349)Ilya Mashchenko
2023-11-06Update packaging instructions (#16344)Tasos Katsoulas
1. Add repo clean up instructions for the netdata/netdata repo (clean up from previous builds) 2. Make the static build instruction to use the more generic script --------- Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: Austin S. Hemmelgarn <austin@netdata.cloud>
2023-10-30bump openssl for static in 3.1.4 (#16303)Tasos Katsoulas
2023-10-20Introduce workflow to always update bundled packages (static builds) into ↵Tasos Katsoulas
their latest release (part1) (#16191) * Make bundled-packages file as the source of truth for all the bundled packages Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-10-13Update bundled static packages (#16177)Tasos Katsoulas
Update bundle versions static packages * Bump curl to v8_4_0 * Bump openssl to version 3.1.3 Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-09-27Update to use versioned base images for CI. (#16053)Austin S. Hemmelgarn
* Update to use versioned base images for CI. * Fix typos.
2023-09-22Disable mongodb exporter builds where broken. (#16033)Austin S. Hemmelgarn
2023-08-21packaging cleanup after #15842 (#15857)Ilya Mashchenko
2023-08-21fix packaging static build openssl 32bit (#15855)Ilya Mashchenko
2023-08-21Fix static build SSL (#15842)Costa Tsaousis
2023-08-14Bump openssl version of static builds to 1.1.1v (#15779)Tasos Katsoulas
Update openssl.version
2023-08-09fix claiming via UI for static build (#15774)Ilya Mashchenko
2023-07-18Build optimizations (#15381)Tasos Katsoulas
Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-07-06Code reorg and cleanup - enrichment of /api/v2 (#15294)Costa Tsaousis
* claim script now accepts the same params as the kickstart * rewrote buildinfo to unify all methods * added cloud unavailable in cloud status * added all exporters * renamed httpd to h2o * rename ENABLE_COMPRESSION to ENABLE_LZ4 * rename global variable * rename ENABLE_HTTPS to ENABLE_OPENSSL * fix coverity-scan for openssl * add lz4 to coverity-scan * added all plugins and most of the features * added all plugins and most of the features * generalize bitmap code so that we can have any size of bitmaps * cleanup * fix compilation without protobuf * fix compilation with others allocators * fix bitmap * comprehensive bitmaps unit test * bitmap as macros * added developer mode * added system info to build info * cloud available/unavailable * added /api/v2/info * added units and ni to transitions * when showing instances and transitions, show only the instances that have transitions * cleanup * add missing quotes * add anchor to transitions * added more to build info * calculate retention per tier and expose it to /api/v2/info * added currently collected metrics * do not show space and retention when no numbers are available * fix impossible overflow * Add function for transitions and execute callback * In case of error, reset and try next dictionary entry * Fix error message * simpler logic to maintain retention per tier * /api/v2/alert_transitions * Handle case of recipient null Convert after and before to usec * Add classification, type and component * working /api/v2/alert_transitions * Fix query to properly handle context and alert name * cleanup * Add search with transition * accept transition in /api/v2/alert_transitions * totaly dynamic facets * fixed debug info * restructured facets * cleanup; removal of options=transitions * updated alert entries flags * method to exec * Return also exec run timestamp Temp table cleanup only when we don't execute with a transition * cleanup obsolete anchor parameter * Add sql_get_alert_configuration function * added options=config to alert_transitions * added /api/v2/alert_config * preliminary work for /api/v2/claim * initialize variables; do not expose expected retention if no disk space info is available; do not report aclk as initializing when not claimed * fix claim session key filename * put a newline into the session key file * more progress on claiming * final /api/v2/claim endpoint * after claiming, refresh our state at the output * Fix query to fetch config * Remove debug log * add configuration objects * add configuration objects - fixed * respect the NETDATA_DISABLE_CLOUD env variable * NETDATA_DISABLE_CLOUD env variable sets the default, but the config sets the final value * use a new claimed_id on every claiming * regenerate random key on claiming and wait for online status * ignore write() return value when writing a newline * dont show cloud status disabled when claimed_id is missing * added ctx to alert instances * cleanup config and transitions from /api/v2/alerts * fix unused variable * in /api/v2/alert_config show 1 config without an array * show alert values conditionally, by appending options=values * When storing host info if the key value is empty, store unknown * added options=summary to control when the alerts summary is shown * increased http_api_v2 to version 5 * claming random key file is now not world readable * added local-listeners binary that detects all the listening ports, their IPs and their command lines --------- Co-authored-by: Stelios Fragkakis <52996999+stelfrag@users.noreply.github.com>
2023-06-28Add hardening options to CFLAGS by default if they are available. (#15087)Austin S. Hemmelgarn
* Enable SSP if available. * Add control flow protection options. * Add -D_FORTIFY_SOURCE option if supported. * Add stack-clash-protection option if supported. * Further build flags cleanup.
2023-06-22Fix handling of plugin ownership in static builds. (#15230)Austin S. Hemmelgarn
* Fix handling of plugin ownership in static builds. * Address review feedback. * Update packaging/makeself/install-or-update.sh --------- Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
2023-05-15Debugfs collector (#15017)thiagoftsm
Co-authored-by: Fotis Voutsas <fotis@netdata.cloud> Co-authored-by: Austin S. Hemmelgarn <ahferroin7@gmail.com> Co-authored-by: ilyam8 <ilya@netdata.cloud>
2023-05-11Fix handling of permissions in static installs. (#15042)Austin S. Hemmelgarn
2023-05-11Remove old logic for handling of legacy stock config files. (#14829)Austin S. Hemmelgarn
2023-05-07Fix typo in file capabilities settings in static installer. (#15023)Austin S. Hemmelgarn
2023-05-05Set file capabilities correctly on static installs. (#15018)Austin S. Hemmelgarn
Instead of just making all the files SUID 0, set capabilities when we know which ones are needed and `setcap` is installed. If setcap is not available, we still fall back properly to SUID on plugins that truly need it.
2023-04-25Prevent pager from preventing non-interactive install (#14950)Aaron Queen
* prevent pager from preventing non-interactive install * Update makeself-header.sh
2023-04-12Update the bundled version of makeself used to create static builds. (#14822)Austin S. Hemmelgarn
* Update bundled makeself to v2.5.0. It includes numerous fixes that should resolve a number of the problems we’ve seen crop up recently with our static build installation process. * Update static archive metadata. * Add the makeself scripts to the shellcheck CI exclude list. They have numerous warnings, but we intentionally want to stay as close as possible to being in-sync with the upstream copies, so just ignore them with shellcheck in CI. * Silence shellcheck warnings. * Ensure required directories actually exist in static archive.
2023-03-23Fix handling of logrotate on static installs. (#14792)Austin S. Hemmelgarn
* Fix handling of logrotate on static installs. * Correctly fix handling of logrotate config in static builds.
2023-03-01Link statically libnetfilter_acct into our static builds (#14516)Tasos Katsoulas
Bundle the nfacct dependencies libnetfilter_acct as static lib from source archives and libmnl as static lib from the alpines' packages (regular package manager) into our Netdata static binaries Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: Austin S. Hemmelgarn <ahferroin7@gmail.com>
2023-02-28Make the title metadata H1 in all markdown files (#14625)Fotis Voutsas
* make the title metadta the H1 * Update collectors/python.d.plugin/zscores/README.md * Update libnetdata/ebpf/README.md * Update ml/README.md * Update libnetdata/string/README.md --------- Co-authored-by: Chris Akritidis <43294513+cakrit@users.noreply.github.com>
2023-02-27Reorganize system directory to better reflect what files are actually used ↵Austin S. Hemmelgarn
for. (#14544) * Move systemd-specific system files to their own directory. * Move non-systemd init scripts to individual subdirectories. * Move cron files to their own directory. * Move logrotate config to it’s own directory. * Fix typos in Makefile.am. * Fix Debian package builds. * Fixed issues reported by @andrewm4894.
2023-02-21Learn installation reorg part 2 (#14579)Chris Akritidis
installation reorg part 2
2023-02-21Update static binary readme (#14574)Chris Akritidis
Update README.md
2023-02-16Assorted shellcheck cleanup. (#14524)Austin S. Hemmelgarn
* Add shellcheck config file to globally disable dead code checks. These checks have an extremely high false positive rate and even when they’re correctly flagging code the impact is generally very low. * Fix assorted shellcheck errors in installer code. This should make reviewing PRs relating to this code much easier. * Make shellcheck quit complaining about shellcheckrc formatting.
2023-02-08Add markdown files in Learn (#14466)Fotis Voutsas
* add metadata for learn * first batch of adding metadata to md files * second batch of adding metadata to md files * third batch of adding metadata to md files * test one sidebar_label * add missing sidebar_labels * add missing sidebar_labels to files left behind * test, ansible doc is stubborn * fix * fix * fix * don't use questionmarks in the sidebar label * don't use exclamation marks and symbols in the sidebar label * fix style guide * fixes * fixes
2023-02-08Update static build packages (#14450)Tasos Katsoulas
* bump openssl to v1.1.1t * bump ioping to v1.3 * bump curl to v7.87 Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-01-25Assorted infrastructure cleanup. (#14223)Austin S. Hemmelgarn
* Remove old documentation check related config files. These are no longer used by any of our CI as far as I can tell. * Purge LGTM configuration and references. It has been fully shut down, so none of this works anymore. * Purge Travis CI config, scripts, and references. We are no longer using Travis CI, so all of this is useless. * Pureg config for other CI tools we are no longer using. * Remove old packaging related test scripts. These haven’t been used in years, and are potentially confusing for new contributors. * Restore MLC configuration. It is, in fact, still in use. * Fix bogus CI config in dist files. * Fix botched merge in CODEOWNERS.
2023-01-04Finish renaming the `--install` option to `--install-prefix`. (#13881)Austin S. Hemmelgarn
* Finish renaming the `--install` option to `--install-prefix`. * Fix remaining references to `--install` option.
2022-12-22feat(packaging): add netdata to www-data group on Proxmox (#14168)Ilya Mashchenko
2022-12-09remove deprecated fping.plugin in accordance with v1.37.0 deprecation notice ↵Ilya Mashchenko
(#14073)
2022-10-31feat(packaging): add CAP_NET_RAW to go.d.plugin (#13909)Ilya Mashchenko
2022-08-11fix(packaging): add CAP_NET_ADMIN for go.d.plugin (#13507)Ilya Mashchenko
2022-07-14Add basic runtime checks to static build process. (#13339)Austin S. Hemmelgarn
* Enable use of Podman for static builds. This way those of us who have migrated away from Docker can still easily test static builds. * Add basic runtime testing to the static build process. This will help catch basic runtime issues that would not show up just from building the agent.
2022-06-09Remove unnescesary ‘cleanup’ code. (#13103)Austin S. Hemmelgarn
This was causing the updter to be unconditionally disabled on static builds, and we don’t actually _need_ any of it anymore since we’ve already decoupled the auto-update handling state from the installation process (in fact, this should have been removed then, but it got missed somehow).
2022-05-27Cache invariant components in static builds to reduce build times. (#12877)Austin S. Hemmelgarn
* Add basic build caching support to static builds. Cache is store din `artifacts/cache/${BUILDARCH}`. Each third-party component utilizes a separate build cache. Invalidation is only done for version changes (more rigorous invalidation is expected to be handled externally). * Integrate static build caching with CI. * Fix fping cache handling. * Test caching in CI. * Properly skip rebuilds on cache hits. * Remove static build container when done with it. * Reuse existing image automatically if it’s for the correct platform. * Test CI build caching. * Fix static build job names.
2022-05-10Use prebuilt builder images for static builds. (#12826)Austin S. Hemmelgarn
2022-05-02Add `-pipe` to CFLAGS in most cases for builds. (#12709)Austin S. Hemmelgarn
* Add `-pipe` to CFLAGS in most cases for builds. This trades marginally higher memory usage at build time (on the order of a few hundred kB in the worst case scenario) for improved build times by avoiding using temporary files for passing data from the compiler to commands it invokes. * Suppress bogus shellcheck warnings. * Fix handling of CFLAGS in netdata-installer.sh.
2022-04-28Tweak static build process to improve build speed and debuggability. (#12708)Austin S. Hemmelgarn
- Switch from `-O3` to `-O2` for optimization CFLAGS, bringing us in-line with all of our other builds. This should help avoid strange edge cases specific to static builds resulting from the build process. - Stop stripping binaries in static builds so that we can get proper symbolic backtraces when the agent crashes in the static builds.
2022-04-18Disable automake dependency tracking in our various one-time builds. (#12701)Austin S. Hemmelgarn
* Disable automake dependency tracking in our various one-time builds. * Also disable dependency tracking code in package builds.
2022-04-13Fix the static build code in light of CVE-2022-24765 (#12683)Austin S. Hemmelgarn
Also, fix handling of the source directory in the builds so that we don’t leave behind a dirty source directory.