Commit Graph

344 Commits

Author SHA1 Message Date
Marc Wrobel
da4c1d6e29 [ibm-aix] Use fetch_javascript_url instead of fetch_html 2025-10-28 22:26:11 +01:00
Marc Wrobel
85689649e0 [discourse] Remove debug logs 2025-10-11 19:47:05 +02:00
Marc Wrobel
74cc23ed97 [release_table] Declare latestReleaseDate in date fields 2025-10-11 19:26:39 +02:00
Marc Wrobel
9364fee53c Warn when releases have not been updated for a long time (#521)
Raise an alert during the daily auto-update about stale releases, e.g.:

- non-EOL releases with latest releases not updated in a year,
- non-EOL releases with a release date older than a year.

The threshold is configurable.
2025-09-20 09:43:39 +02:00
Marc Wrobel
a842011cf8 [amazon-neptune] Update script to rely on documentation (#519)
Use https://docs.aws.amazon.com/neptune/latest/userguide/toc-contents.json instead of https://docs.aws.amazon.com/neptune/latest/userguide/rssupdates.rss for automation, as it contains a longer versions history.
2025-09-14 18:42:28 +02:00
Marc Wrobel
d82426182c Stop auto-updating release dates (#518)
Often the actual release date does not exactly match with the first version date of for a given release.
Moreover the release date is simple to set : this is a one-time update that is not subject to change.
2025-09-14 13:54:23 +02:00
Marc Wrobel
0a8610fd69 [libreoffice] Ignore prereleases (#517)
LibreOffice data may contain prerelease versions. Those should not be included in release data: endoflife.date only list GA releases.

Fixes #511.
2025-09-14 10:58:43 +02:00
Marc Wrobel
4980f92f64 Handle dates with 'Sept' instead of 'Sep' globally (#516)
There are often failures due to the use of 'Sept' instead of 'Sep' in dates (for example https://github.com/endoflife-date/release-data/actions/runs/17707933881). Manage this globally so that it's not needed do it in each script / config.
2025-09-14 10:30:38 +02:00
Marc Wrobel
d190da8073 [discourse] Add auto method (#515)
Closes #505.
2025-09-11 12:21:20 +02:00
Marc Wrobel
5d43007994 [looker] Fix and improve auto method
Fix regex and update release data instead of version data.
2025-09-11 10:32:27 +02:00
Marc Wrobel
81d2647969 [ghc-wiki] Improve script to better ignore unreleased releases 2025-09-11 08:57:10 +02:00
Marc Wrobel
20b0c8d1ff [version_table] Add auto method (#514)
Similar to release_table, but for versions.
2025-09-10 18:12:11 +02:00
Marc Wrobel
c43a24fb19 Improve string to identifier transformation (#512)
Include all spaces characters (matching \s in a regex), not just the standard space character.
2025-09-08 17:45:45 +02:00
Nemo
d3723a2c5e [firefox] Fetch first 200 versions (#508)
* [firefox] Fetch first 200 versions

115 ESR does not get picked up otherwise.

Ref: https://github.com/endoflife-date/endoflife.date/issues/8324

* 🤖: coder, firefox

coder:
- Item root['versions']['2.24.4'] ({'name': '2.24.4', 'date': '2025-09-04'}) added to dictionary.

firefox:
- Item root['versions']['115.27.0'] ({'name': '115.27.0', 'date': '2025-08-19'}) added to dictionary.
- Item root['versions']['115.26.0'] ({'name': '115.26.0', 'date': '2025-07-22'}) added to dictionary.
- Item root['versions']['115.25.0'] ({'name': '115.25.0', 'date': '2025-06-24'}) added to dictionary.
- Item root['versions']['115.24.0'] ({'name': '115.24.0', 'date': '2025-05-27'}) added to dictionary.
- Item root['versions']['115.23.1'] ({'name': '115.23.1', 'date': '2025-05-17'}) added to dictionary.

* Increase MAX_VERSIONS_LIMIT from 200 to 250

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 12:03:27 +05:30
Marc Wrobel
9f05d4d9af [docker_hub] Make use of version template (#504) 2025-08-31 19:58:48 +02:00
Nemo
e0a2812a78 [pypi] Fix yank condition lint 2025-08-28 23:52:57 +05:30
Nemo
29b8bc46bb [pypi] Ignore yanked releases 2025-08-28 23:51:11 +05:30
Marc Wrobel
d87e10eefc [splunk] Fetch page with javascript
The site has been revamped and now require Javascript.
2025-08-15 21:31:31 +02:00
Marc Wrobel
df980e5c5e [freebsd-releases] Pick up more releases 2025-08-15 18:44:12 +02:00
Marc Wrobel
4498cff3e1 [freebsd-releases] Add auto method (#498)
Closes #401.
2025-08-15 17:50:11 +02:00
Marc Wrobel
e74cc3e786 [sles] Remove auto method (#489)
It has been replaced by a release_table configuration in https://github.com/endoflife-date/endoflife.date/pull/8060.
2025-08-15 10:46:33 +02:00
Marc Wrobel
d1396beed8 [chef-infra] Handle versions starting with 'v' (#496)
Such as chef-infra-client.

Closes #394.
2025-08-15 10:44:34 +02:00
Marc Wrobel
cc3fb54fc6 [couchbase-server] Update script
Version dates are approximate, set version day to 1 instead of the last day of the month.
2025-08-15 10:42:20 +02:00
Marc Wrobel
8fe1728263 [rtpengine-release] Add auto method (#495)
Closes #413.
2025-08-14 07:56:34 +02:00
Marc Wrobel
c7faf9545f [release_table] Add remove_if_undefined parameter (#494)
remove_if_undefined allows to exclude unreleased release more easily.
2025-08-12 22:39:39 +02:00
Marc Wrobel
050b9eacd2 [release_table] Add debug logs 2025-08-11 23:50:53 +02:00
Marc Wrobel
e75e8729f2 [ibm-product-lifecycle] Add auto method (#490)
For https://github.com/endoflife-date/endoflife.date/pull/8061.
2025-08-09 22:37:28 +02:00
Nemo
44bee91053 [git] Add a user-agent to git clone (#487)
Following #474, also use the endoflife.date user agent when cloning git repositories.
2025-08-06 23:42:13 +02:00
Marc Wrobel
1735954764 [release-table] Implement render_js_click_selector parameter (#485)
This parameter allows clicking on an element of the page after it was loaded when using `render_javascript`.
2025-08-03 21:43:16 +02:00
Marc Wrobel
3da8561d4b [ros] Remove auto method (#484)
All Ros 1 version are now EOL.
2025-08-03 00:05:03 +02:00
Marc Wrobel
72b9be8955 Normalize release names (#483)
Automatically normalize release names. This may be useful in a few situations to avoid having to write a custom script.
2025-08-02 15:52:03 +02:00
Marc Wrobel
3f65ff9d9e [update-product-data] Allow disabling auto configuration (#482) 2025-08-02 15:01:47 +02:00
Nemo
d63d0e0cc1 [virtualbox-version] Add method (#480)
Track versions using https://download.virtualbox.org/virtualbox/.

Also rename virtualbox to virtualbox-releases.

---------

Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2025-08-01 22:03:40 +02:00
Marc Wrobel
7368e073dc [amazon-neptune] Fix date parsing 2025-07-27 23:34:49 +02:00
Marc Wrobel
7dfcfb2903 [citrix-vad-rss] Add auto method 2025-07-27 19:25:09 +02:00
Marc Wrobel
3b8adee264 [nvidia-driver] Add automation script (#476)
Closes #368.
2025-07-27 18:29:58 +02:00
Marc Wrobel
e1e93dc841 [motorola-security] Add auto method (#475)
Based on https://gist.github.com/ab/67c6343530c6b8e599f07cedccbcba3d.

Closes #277.
2025-07-27 12:23:20 +02:00
Marc Wrobel
c4fa5b187c [http] Improve User-Agent handling (#474)
- Simplify overriding the User-Agent by replacing the generic (unused) `headers` parameter by a new `user_agent` parameters.
- Take into account the User-Agent even in `fetch_javascript_url` : Playwright user agent is `Playwright/1.12.0` by default anyway.
- Make it possible to override the User-Agent with the `release_table` method.
- Update splunk to use Firefox's User-Agent.

This follows #470.
2025-07-26 10:24:54 +02:00
Maxim Ivanov
68c69aa3d1 [common http] improve the User-Agent identification (#470)
Properly identifying endoflife.date bot is more fair for website administrators, and give them the ability to more easily authorize the bot if they want to.

---------

Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2025-07-26 09:45:54 +02:00
Marc Wrobel
d8f05b91cd [netbsd] Skip invalid EOL date (#473)
Empty EOL cells are now recognized as `Â`, adding a condition to ignore them.
2025-07-25 22:24:17 +02:00
Marc Wrobel
f9d3757694 [red-hat-jboss-eap-7] Filter releases 2025-07-16 07:08:44 +02:00
Marc Wrobel
a985e6218f [chrome-releases] Add auto method (#469)
Based on https://chromiumdash.appspot.com API.
2025-07-15 23:37:16 +02:00
Marc Wrobel
54ff914f34 [http] Improve fetch_javascript_url error handling (#468) 2025-07-13 13:30:52 +02:00
Marc Wrobel
fa1eab8d21 [apple] Add 2020-2021 and 2022-2023 security update pages (#467) 2025-07-13 13:08:03 +02:00
Marc Wrobel
081d884abe Remove invalid releases automatically (#466)
Automatically remove empty releases or releases which are released in the future, regardless of the product.

Also refactored a bit releasedata.py to use better names and clarify types.
2025-07-13 11:36:13 +02:00
Marc Wrobel
ec6217b3cf [http] Improve caching management 2025-07-13 10:59:35 +02:00
Marc Wrobel
42c1189781 Copy releases from products frontmatter (#465)
Copy releases, without their properties, from product data (frontmatter) to release data.

This script is not intended to be declared in the frontmatter: it is for internal use only.
It executes before all other scripts, and helps the following scripts to work with releases.
2025-07-12 16:47:36 +02:00
Marc Wrobel
bccac7033d Fix github groups
github groups were written using logging, which was added the date as a prefix.
This were breaking the grouping of logs on GHA.
2025-07-12 11:44:08 +02:00
Marc Wrobel
e62676b5c4 [google-kubernetes-engine] Normalize script (#464)
The script used to parse different channel for historical (forgotten) reasons. This is the only script that works that way, and release data is not supposed to be consumed by other clients than endoflife.date. So aligning this script for all the other scripts.

In case other channel data is useful for someone, it would be preferable to create multiple products so that the data is available through our official API.
2025-07-12 10:29:33 +02:00
Marc Wrobel
1f7a3772d6 [http] Improve fetch_javascript_url (#462)
Replace `click_selector` by `wait_for,` which is a selector that we must wait for before considering the page loaded.

Also added `select_wait_for`, which returns the waited for element. Oddly this may be needed in some case (such as `artifactory.py`) where the `page.content()` does not contain the waited for element.
2025-07-09 23:20:39 +02:00