Commit Graph

58 Commits

Author SHA1 Message Date
Marc Wrobel
7c9f3f5146 [linuxkernel] Use git.kernel.org tags page to retrieve versions (closes #94)
Automation for the Linux Kernel was based on the mirror https://github.com/gregkh/linux, which is updated infrequently. The reason for that is documented on 2ecd6ee9df (e.g. we need the git repository to support partial clone).

Using https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/refs/tags allows us to retrieve new versions much quicker.
2023-05-04 13:05:08 +00:00
Nemo
6ec64a5c8d [cos] Workaround for broken table for cos-105 2023-04-28 07:36:14 +00:00
Nemo
b85e8650e0 [php] Fix sorting 2023-04-18 18:36:03 +05:30
Nemo
81b5c4d122 [php] Switches to a custom PHP automation
This uses the PHP releases API. Limitations:

1. New Major versions will needed to be added manually

The src for the API is at https://github.com/php/web-php/blob/master/releases/index.php
The data comes from https://github.com/php/web-php/blob/master/include/releases.inc

This commit keeps the old sort method for a cleaner diff. Next commits
in this PR will fix the sorting to be standardized.

The difference from using tags is:

1. One additional version shows up (4.0.4) which we'd missed previously
   due to being tagged as php-4.0.4REL.
2. Slightly more accurate dates.
2023-04-18 18:36:03 +05:30
Martin Petkov
267cf16568 Automatically find COS milestones in the web page (#89) 2023-04-04 18:17:23 +00:00
Coda Bool
4dcdad39e0 [rds] Adds automation (#86)
This is a Python rewrite of the code at #83.

Co-authored-by: Nemo <commits@captnemo.in>
Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2023-03-30 18:15:16 +02:00
Nemo
819dba26dd [apple] Fix regex to exclude non-macos releases
This also drops 11.0 and 12.0, which is okay since the dates
we have are technically for 11.0.1 and 12.0.1 anyway.
2023-03-16 17:24:35 +05:30
Marc Wrobel
adb7cbfdeb [github_releases] Add automation (closes #34)
This script is using the GitHub CLI with the GraphQL API in order to retrieve releases. The reasons are:

- using 'gh release list' does not return all the releases
- using the API, directly or via GitHub CLI, is slow, produces a lot of 502 errors, and is harder due to pagination.
- using the GraphQL API directly is hard due to pagination.
- using a library, such as graphql-python, is sightly harder than using the GitHub CLI (and still requires a GITHUB_TOKEN).

Access to the GitHub token is required when using GitHub CLI, hence the update.yml workflow update.
2023-03-03 09:24:02 +01:00
Alexey Yuzhakov
c0b1cee8cb [plesk] Add automation (closes #79)
Only 18.0.20.3 and later are picked up :
- format of the title for 18.0.20 and 18.0.19 are different,
- there is not entry for GA of versions 18.0.18 and older.

Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2023-02-22 20:41:39 +01:00
Robin Laurén
aed62e8f5e [apple] Fix regex for macOS Sierra and beyond (fixes #76)
Apple changed the format or made a mistake for MacOS Ventura 13.2 : it is labeled 'MacOS 13.2.1' on https://support.apple.com/en-us/HT201222.
2023-02-17 21:00:56 +01:00
Marc Wrobel
803a8be040 Improve and fix haproxy.py
- Get cycles URL by parsing https://www.haproxy.org/download/:
  - This way the script does not have to be updated each time a new minor version is released.
  - The old algorithm was missing some versions (such as 1.6.x).
- Use a GitHub actions log group to wrap the script logs.
- Display version like the other scripts.
2023-01-13 11:02:32 +01:00
Marc Wrobel
3d16eeb5e2 [maven] Retry on timeout 2023-01-13 10:47:54 +01:00
Marc Wrobel
569f3a402c [maven] Sort versions by date then version 2023-01-11 16:54:26 +00:00
Marc Wrobel
7c047202b3 [firefox] Retry on timeout 2023-01-08 14:36:21 +01:00
Benji Visser
f9597f55d7 [firefox] Add automation (#67)
Signed-off-by: Benji Visser <benji@093b.org>
2023-01-08 12:43:43 +01:00
Marc Wrobel
9197848310 [java] Sort versions by date then version 2023-01-08 12:33:15 +01:00
Marc Wrobel
a0d1701b23 [debian] Sort versions by date then version
I also took the opportunity to fix the logs.
2023-01-08 12:25:39 +01:00
Marc Wrobel
29c3f752f5 [java] Fix java.py (closes #65) 2023-01-05 10:22:59 +01:00
Marc Wrobel
082b165d5d Add Java automation
Fetch Java versions with their dates from https://www.java.com/releases/.

This script is using a new dependency: requests-html (https://requests-html.kennethreitz.org/). This is because https://www.java.com/releases/ needs JavaScript to render correctly. And for this to work requests-html automatically downloads Chromium because of its dependency to pyppeteer.

Chromium is downloaded into PYPPETEER_HOME, so the workflow has been modified to set this directory as a subdirectory of ~/.cache. Note that declaring the same environment variable from the python script does not work.
2023-01-03 18:23:19 +01:00
Marc Wrobel
1e45de3c58 [macOS] Accept all kind of spaces in regexes (fixes #47)
There were two issues with the macOS regexes:

- The regexex accepted only spaces separator. But non-breakable spaces are also used from time to time. Replacing spaces by \s fixed the issue (other product regexes were also updated - never know).
- The first regex, the one that accepted major releases with no minor version, were not useful (covered by the second regex) and partly catched valid versions (such as 13.1), who was then ignored. I removed it.
2022-12-20 15:25:55 +05:30
Marc Wrobel
634e8668d3 [debian] Add releaseDate for major releases (fixes #49)
Unfortunately major releases cannot be parse like point releases.
2022-12-20 08:30:54 +01:00
Marc Wrobel
91dac82e02 Add Debian automation (closes #42)
Use www.debian.org source repository to fetch versions.
2022-12-19 12:40:32 +01:00
Nemo
b5cc28f87e [cos] Retry requests on failure
Google Docs website returns a lot of SSL errors, so retry
2022-12-17 16:25:25 +05:30
Nemo
4670ff7336 [maven] Updates to maven automation
1. Drop RC and milestone releases by adopting a simple
   version regex. Drops a few non-stable releases from
   jreleaser and tomcat. Tested against all of the maven
   automated pages

2. Fix pages with multiple auto: maven entries. In particular,
   groovy was using this, but the newer 4.0 releases were not
   being written correctly to disk.
2022-12-17 16:19:24 +05:30
Rajat Jaiswal
05b0977241 NPM automation (#36)
Initial support for NPM Automation. This isn't widely used, since most NPM projects
will use git tags as well, but helpful for a few projects.

Co-authored-by: Hugo van Kemenade <hugovk@users.noreply.github.com>

* Fix fstrings and remove unused imports

* Fix the merge of product config with default config in npm.py and pypi.py

If product config is first, default config overrides product config.

* Simplify npm.py

Co-authored-by: Nemo <me@captnemo.in>
Co-authored-by: Hugo van Kemenade <hugovk@users.noreply.github.com>
Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2022-12-16 17:08:24 +05:30
Nemo
cc624a7cd4 [pan] Fix new date ingestion 2022-12-16 16:40:36 +05:30
Nemo
2f68b7ffd5 [xdr] Rename file to pan-cortex-xdr
Ref: https://github.com/endoflife-date/endoflife.date/pull/2053
2022-12-15 16:15:35 +05:30
Nemo
6a3d2f72be COS automation (#40) 2022-12-15 12:08:58 +05:30
Marc Wrobel
b65b5ad4ee Cleanup code (#37)
* [apple,distrowatch,pypi] Remove unused imports

* [maven] use snake_case for variable names

* [eks,palo-alto-networks] Rename variables shadowing names from outer scopes

* [eks,palo-alto-networks] Remove unused variables

* [apple,haproxy,palo-alto-networks,rhel,ros,unrealircd] Rename variables shadowing built-in names
2022-12-14 09:20:45 +05:30
Nemo
1e7d583a9a [gke] Adds GKE automation
This avoids using the GKE APIs, much cleaner as a result.
The downside is that we need to keep track of all channels
separately. This also tracks the date a version is made available
on a channel, not the date it is made the default. This is being
slightly optimistic, but I think works well
2022-12-13 12:57:13 +05:30
Nemo
931ff74010 [haproxy] v2.7.0 2022-12-02 16:26:19 +05:30
Nemo
ee9757a195 Rename distowatch.py to distrowatch.py 2022-12-02 16:22:13 +05:30
Nemo
92864aab8b [apple] Update Mac regex to support Ventura
No dots in the version number was tripping the regex
2022-11-08 16:56:12 +05:30
Nemo
706b5e218b [pypi] Very old releases don't have data on the API
See https://pypi.org/pypi/numpy/json
2022-10-17 14:21:36 +05:30
Nemo
fac9620241 [py] Fix styling 2022-10-17 14:21:36 +05:30
Nemo
f4036b7b0d [ros] Automate ROS 2022-10-10 18:38:56 +05:30
Nemo
ece13651d6 [pan] Add PAN Cortex XDR
Fix PAN-OS versions
2022-10-10 18:29:40 +05:30
Nemo
5fadca4939 Add RHEL releases (#22)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2022-10-10 12:31:26 +00:00
Nemo
0a992286b2 [pan] Support PAN-OS as well 2022-10-10 17:37:38 +05:30
Nemo
f8af1626c9 PyPi Automation 2022-10-08 19:37:27 +05:30
Nemo
f8b505409d [eks] Use the new platform-versions page.
- See https://github.com/awsdocs/amazon-eks-user-guide/issues/603
- Tracking eks release numbers makes more sense here
2022-09-19 19:41:32 +05:30
Nemo
1c603de65d Update maven.py 2022-09-07 14:27:15 +00:00
Nemo
b65e752084 [maven] Log releases 2022-09-07 19:51:38 +05:30
Nemo
3277e99bf8 Maven Automation
Apache projects don't consider git tags as the final release, only
maven publishes. This applies for tomcat/zookeeper primarily.
2022-09-07 19:51:38 +05:30
Nemo
33331288fa [eks] Fix EKS regex 2022-08-26 22:19:35 +05:30
Nemo
e018736fbe [distrowatch] Support running single product 2022-07-13 13:21:53 +05:30
Nemo
5962146a16 [distrowatch] Distrowatch update script 2022-07-10 15:44:09 +05:30
Nemo
55aef74d45 [pan-gp] Fix filename for PAN-GP 2022-07-10 12:58:02 +05:30
Nemo
202e2cfd8b [eks] Fix repo cloning 2022-07-10 12:51:13 +05:30
Nemo
b83e1ee375 [eks] Add EKS release automation 2022-07-10 12:47:14 +05:30