summaryrefslogtreecommitdiffstats
path: root/.github/scripts
AgeCommit message (Collapse)Author
2024-07-17Remove logs-management plugin. (#18186)Austin S. Hemmelgarn
It’s not been supported properly pretty much since it was introduced.
2024-07-16Create release branches for major releases as well. (#18184)Austin S. Hemmelgarn
2024-07-15Fix logic bug in platform EOL check code. (#18172)Austin S. Hemmelgarn
2024-07-08Track LTS for Debian EOL status. (#18084)Austin S. Hemmelgarn
Unlike most other platforms we support, it’s trivial for us to support Debian’s LTS distros, and we’ve effectively been doing that for quite some time now, so just make it official in the CI jobs.
2024-07-02restructure go.d (#18058)Ilya Mashchenko
* restruture go.d * update gitignore * update ci files * update gen_docs_integrations.py * update link in go.d conf files * update go.d modules metadata files * update metadata files * update packaging * add log files * integrations commit * update get-go-version.py * go fmt * fix packaging * update go.d readme --------- Co-authored-by: Fotis Voutsas <fotis@netdata.cloud>
2024-06-26Fix key ID handling for DEB package signing.Austin S. Hemmelgarn
2024-06-25Fix DEB package signing issues.Austin S. Hemmelgarn
2024-06-25Sign DEB packages in the GHA runners that build them. (#17949)Austin S. Hemmelgarn
* Sign DEB packages in the GHA runners that build them. This provides a stronger signature guarantee than we currently provide, and simplifies handling of multiple repository servers. * Skip package signing on PRs. It’s unlikely to work correctly, and has little to no value.
2024-06-18Move to using CPack for repository configuration packages. (#17930)Austin S. Hemmelgarn
* Move to using CPack for repository configuration packages. This simplifies testing of changes to the configuration itself, as well as making package builds marginally faster. * Fix CMake handling for old RPM distros. * Fix openSUSE detection. * Fix file installation. * Override code ownership for packaging/repoconfig/CMakeLists.txt This way changes won’t bother people who aren’t actually responsible for it. * Update CI skip logic to work correctly with new repoconfig setup. * Add improved status messages.
2024-06-12Update CI infrastructure to publish to secondary packaging host. (#17863)Austin S. Hemmelgarn
* Update CI infrastructure to publish to secondary packaging host. * Fix typo.
2024-05-31Correctly handle eBPF check in package test script. (#17794)Austin S. Hemmelgarn
2024-05-28Fix DEB package builds. (#17765)Austin S. Hemmelgarn
* Check for supplementary components in libexec during runtime checks. This should catch issues like what the PR it’s part of is fixing. * Fix building DEB packages with CPack. This both disables the logs-management plugin in the builds (which has never actually worked properly in our packages for multiple reasons) and fixes a botched merge involving the OS detection in the build system. * Fix up CI checks.
2024-04-30Use CPack to generate Debian packages (#17475)vkalintiris
* CPack * Add script to build all artifacts. * Add infrastructure to run package builds via CPack in CI. * Fix typos in distro config. * Fix permissions on package-build script. * Control files for netdata package * pre/post inst files for debugfs. * Fix directory name handling for package build. * pre/post inst scripts for cups * pre/post inst scripts for xenstat * pre/post inst scripts for slabinfo * pre/post inst scripts for apps * pre/post inst scripts for network-viewer * pre/post inst script for nfacct * pre/post inst scripts for freeipmi * pre/post inst scripts for logs-management * pre/post inst perf * pre/post inst scripts for systemd-journal * pre/post init scripts for go.d * pre/post inst scripts for ebpf * pre/post init files for charts.d & python.d * Skip eBPF in packaging. * Fix most of the package names * Add copyright * etc/default/netdata * Bump * Enable all packages except for ebpf. * Add log2journal to netdata component. * Produce pretty-much the same RFS. - No README.md docs - /var/run/netdat missing on CPack's side - No ebpf - No changelogs * Enable ebpf plugin * Fix runtime path * Build debug symbol packages * Update package directory * Fix eBPF and Xenstat conditionals. * Fixes for package build process. * Package version for cpack * Add ebpf-code-legacy package * Update extraction logic * Fix control info for netdata package * Fix control file for chartsd plugin package * Fix typos in package build script. * Update dependencies * Add python3 * Fix verbose option to cpack * Add whitespace in package description field. * SKip adding files that might break rpm packages * Final fixups to package handling. * Fix architecture matching for package build options. * Fix dependency handling. * Remove top-level scripts --------- Co-authored-by: Austin S. Hemmelgarn <austin@netdata.cloud>
2024-04-15Split Sentry enablement to be per-architecture. (#17383)Austin S. Hemmelgarn
And only enable it on 64-bit x86 for the moment.
2024-04-10Skip Go code in CI if it hasn’t changed. (#17077)Austin S. Hemmelgarn
* Skip building Go components for Docker CI if they have not changed. * Properly handle Go code in general checks PR. * Skip Go code in build checks if it hasn’t changed. * Fix linting issues. * Fix propagation of installer flags. * Fix propagation of environment variables through static build process. * Fix handling of extra install options in static builds. * Skip starting the agent in updater checks. * Fix actionlint warning.
2024-04-02Fix assorted issues in the Docker build process. (#17312)Austin S. Hemmelgarn
* Fix assorted issues in the Docker build process. * Correctly add stable tag to tag list.
2024-03-06Switch publishing Docker images to regular repo.Austin S. Hemmelgarn
2024-03-05Push Docker images to registries individually.Austin S. Hemmelgarn
Because docker/build-push-action can't handle the case of pushing to multiple registries by digest.
2024-03-05Rework Docker CI to build each platform in it's own runner. (#17088)Austin S. Hemmelgarn
* Rework Docker CI to build each platform in it's own runner. * Remove bogus conditional in publish step.
2024-02-29Cache key wasn't taking account changes in the version of bundled software ↵Tasos Katsoulas
(#16985) To optimize the CI we are trying to cache build artifacts such as all the software we build and statically bundle for static binaries (for each arch) In a nutshell the artifacts of these https://github.com/netdata/netdata/tree/master/packaging/makeself/jobs source files. With this https://github.com/netdata/netdata/blob/master/.github/scripts/get-static-cache-key.sh script we generate the keys for these cached artifacts taking into account the (source files of the jobs, version of the software, static packages bundled in the base images). The effort #16303 to make a centralized file for all the versions expanded the problem of not considering the exact versions. Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2024-02-27Add CI checks for Go code. (#17066)Austin S. Hemmelgarn
Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
2024-01-30Setup sentry-native SDK. (#16798)vkalintiris
* Setup sentry-native SDK. * Integrate Sentry into our CI Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * minor fix Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Include sentry field to the build matrix Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Update the bundle_sentry flag for all the distros Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * more changes Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * NON mergeable change Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * . Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Enable fetch content. * Abort in profile plugin * Update plugin_profile.cc * NON MERGABLE COMMIT, just for testing purposes * NON MERGEABLE CHANGE, jsut for testing purposes * Bump * Use breakpad backend * Multiple changes - Make DSN variable that we read from the CI from the CI - Upload debug symbols - Fix packaging workflow; include new env vars & fix shecllchecks Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Modify sentry dif command * fix merge conf Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Fix merge conflict * Undo file prefix map. * Fix typo * Cleanup stuff. * Add 256-checksum * Renable ML for debs * Finalize CI changes Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Update rules * final touches Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * merge the two if, no point to have them sep Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> * Update contrib/debian/rules Co-authored-by: Tasos Katsoulas <12612986+tkatsoulas@users.noreply.github.com> * Update contrib/debian/rules Co-authored-by: Tasos Katsoulas <12612986+tkatsoulas@users.noreply.github.com> * Add license * Enable sentry for debian 12. * Update .github/workflows/packaging.yml Co-authored-by: Austin S. Hemmelgarn <ahferroin7@gmail.com> --------- Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: Tasos Katsoulas <12612986+tkatsoulas@users.noreply.github.com> Co-authored-by: Austin S. Hemmelgarn <ahferroin7@gmail.com>
2024-01-17CI runtime check cleanup (#16713)Austin S. Hemmelgarn
* Centralize runtime check code used throughout CI. * Add checks to confirm that each of the agent dashboards can be fetched.
2024-01-17Add check to avoid auto-installing new major versions of Netdata. (#15898)Austin S. Hemmelgarn
* Add check to avoid auto-installing new major versions of Netdata. With the specific intent of avoiding breaking user’s systems. * Add latest tag check override. * Fix local testing fallback case. * Fix version parsing code. * Allow major version updates in CI jobs. * Fix fetching latest tag. * Properly fix CI jobs. * Switch to using a list of accepted major versions. And pre-populate it with versions we think are fine. * Fix CI again. * Fix check logic.
2023-12-27remove unused github scripts (#16661)Ilya Mashchenko
* remove build-artifacts.sh * remove build-dist.sh * remove run_install_with_dist_file.sh
2023-12-13CMake build system. (#15996)vkalintiris
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Austin S. Hemmelgarn <austin@netdata.cloud> Co-authored-by: Tasos Katsoulas <12612986+tkatsoulas@users.noreply.github.com> Co-authored-by: Emmanuel Vasilakis <mrzammler@mm.st> Co-authored-by: Stelios Fragkakis <52996999+stelfrag@users.noreply.github.com> Co-authored-by: netdatabot <bot@netdata.cloud> Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
2023-11-16Introduce agent release metadata pipelines (#16366)Tasos Katsoulas
* For stable releases we updated when an new version published or deleted in netdata/netdata repo * You can manually update to the latest (per channel) major versions. * We update the newly published version during CI build process (if an release occurred) for nightly releases. --------- Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud> Co-authored-by: Austin S. Hemmelgarn <austin@netdata.cloud>
2023-09-27Update to use versioned base images for CI. (#16053)Austin S. Hemmelgarn
* Update to use versioned base images for CI. * Fix typos.
2023-08-18Added CentOS-Stream to distros (#15742)Konstantin Shalygin
* Added CentOS-Stream to distros Containers added https://github.com/netdata/helper-images/pull/219 * Update .github/scripts/pkg-test.sh Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud> * pkg-test.sh: disable shellcheck for bad shell function --------- Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
2023-06-14Add support for openSUSE 15.5 (#15189)Tasos Katsoulas
Signed-off-by: Tasos Katsoulas <tasos@netdata.cloud>
2023-06-07Make plugin packages hard dependencies. (#15160)Austin S. Hemmelgarn
* Make plugin packages hard dependencies. May (hopefully) be reverted eventually, but for now this should resolve most if not all, of the current problems with native packages. * Fix typo in Debian control file. * Fix package test script. * Fix dependency ordering for DEB plugin packages. * Fix CUPS RPM dependency. * Fix package test script again. * Fix RPM nfacct plugin deps. * Split out user and group handling for DEB packages. This is needed to make the plugin package dependencies work correctly. * Final fix for package test script. * Fix permissions handling for RPM package. * Fix typo in spec file. * Fix another typo in RPM spec file.
2023-03-29Add Amazon Linux 2023 to CI, packaging, and platform support. (#14771)Austin S. Hemmelgarn
* Add Amazon Linux 2023 to CI, packaging, and platform support. * Fix dependencies for AL2023 in RPM spec file. * Fix handling of package tests with DNF.
2023-03-21Assorted improvements for our platform EOL check code. (#14768)Austin S. Hemmelgarn
* Fix typos in EOL check matrix generation. * Allow specifying a different name for distro for EOL check. If the `eol_check` property of a distro entry is a string, use that as the product name when querying https://endoflife.date/api * Add failure notifications for scheduled runs of EOL check workflow.
2023-03-13Add Amazon Linux 2 to CI and platform support. (#14599)Austin S. Hemmelgarn
* Add Amazon Linux 2 to CI and platform support. * Fix conditional in repoconfig spec file. * Fix package testing script. * Add support to kickstart.sh. * Fix pkg-test.sh typo. * Fix CI support package handling. * Make updater log to stderr if running under CI. * Fix broken sed expressions in installer. * Fix updater CI check WRT auto-update checking. * Update .github/scripts/pkg-test.sh Co-authored-by: Tasos Katsoulas <12612986+tkatsoulas@users.noreply.github.com> * Clean up package testing code. * Fix filename matching for package testing. --------- Co-authored-by: Tasos Katsoulas <12612986+tkatsoulas@users.noreply.github.com>
2023-03-07Fix build matrix generation for platform EOL check.Austin S. Hemmelgarn
It was missing a key in the matrix itself.
2023-03-07Fix platform EOL checks to properly return success. (#14681)Austin S. Hemmelgarn
2023-02-28Fix handling of no data in platform EOL checks. (#14617)Austin S. Hemmelgarn
Also, re-enable EOL checking for Debian.
2023-02-24Add a scheduled CI job to flag supported platforms going EOL upstream. (#14581)Austin S. Hemmelgarn
* Add a scheduled CI job to flag supported platforms going EOL upstream. By default, it runs at 03:00 UTC every Monday and checks the upstream EOL date for each platform we support that needs such checking. If the platform will be EOL upstream within the next 30 days, an issue is opened flagging the platform for removal from CI and our support document and auto-assigned to the agent SRE team members. The workflow can also be manually triggered (mostly intended for testing). Data about upstream EOL dates is retrieved from https://endoflife.date via their new public API. Happily, our own definition of what constitutes EOL for our purposes matches up 1:1 with how they categorize platforms as EOL. * Fix logic issue in issue creation. * Explicitly enable error handling for issue checks.
2023-02-15Add Debian 12 to our CI and platform support document. (#14529)Austin S. Hemmelgarn
* Fix handling of base images for CI jobs. This allows us to continue using properly descriptive names despite Debian not publishing docker images with version numbers. * Add Debian 12 to CI and platform support documentation. * Fix build matrix generation scripts.
2023-01-31Fix publishing Docker Images to secondary registries. (#14389)Austin S. Hemmelgarn
2023-01-16Fix conditional in matrix generation for packaging jobs. (#14274)Austin S. Hemmelgarn
This will bring us back to running only native packaging jobs on most PRs instead of running all packaging jobs on all PRs.
2023-01-16Set an explicit timeout in updater checks. (#14273)Austin S. Hemmelgarn
If it takes more than an hour to run the updater, something has gone horribly wrong, so just kill it instead of letting it keep running.
2023-01-16Switch nightlies to GitHub releases. (#14020)Austin S. Hemmelgarn
* Switch nightlies to GitHub releases. Instead of using GCS. * Fix CI handling. * Fix handling of download URLs for nightly builds. * Fix handling of redirects for consolidated artifact checks. * Avoid redirect issues with the test environment. * Add more info to logs for updater checks. * Ignore redirect issues for updater checks. * Fix base URL handling in updater. * Dump post-update info in CI before checking if the update worked. * Special-case a version of `latest` in updater. This is to allow CI to work correctly. * Update nightly release badge in README.md. * Fix updater check variable name. * Add a comment documenting the magic number in parse_version.
2023-01-12Update handling of uploads of DEB packages to our new infrastructure. (#14253)Austin S. Hemmelgarn
This significantly simplifies handling on the server itself.
2023-01-10ci: show docker logs if docker-test fails (#14219)Ilya Mashchenko
2023-01-04Finish renaming the `--install` option to `--install-prefix`. (#13881)Austin S. Hemmelgarn
* Finish renaming the `--install` option to `--install-prefix`. * Fix remaining references to `--install` option.
2022-12-14Really, truly fix the repoconfig package upload process.Austin S. Hemmelgarn
Now with extra certainty.
2022-12-14Correctly fix repoconfig package uploads.Austin S. Hemmelgarn
For real this time...
2022-12-02Update workflows to use $GITHUB_OUTPUT instead of ::set-output:: (#13960)Austin S. Hemmelgarn
* Update workflows to use $GITHUB_OUTPUT instead of ::set-output:: * Fix python code. * Fix handling of python-based build matrix generation.
2022-10-11Add Ubuntu 22.10 to supported distros, CI, and package builds. (#13785)Austin S. Hemmelgarn
* Add Ubuntu 22.10 to supported distros, CI, and package builds. Expected release date is 2022-10-20. * Fix handling of netcat in newer Debian and Ubuntu distros.