Commit Graph

317 Commits

Author SHA1 Message Date
Nemo
44bee91053 [git] Add a user-agent to git clone (#487)
Following #474, also use the endoflife.date user agent when cloning git repositories.
2025-08-06 23:42:13 +02:00
Marc Wrobel
1735954764 [release-table] Implement render_js_click_selector parameter (#485)
This parameter allows clicking on an element of the page after it was loaded when using `render_javascript`.
2025-08-03 21:43:16 +02:00
Marc Wrobel
3da8561d4b [ros] Remove auto method (#484)
All Ros 1 version are now EOL.
2025-08-03 00:05:03 +02:00
Marc Wrobel
72b9be8955 Normalize release names (#483)
Automatically normalize release names. This may be useful in a few situations to avoid having to write a custom script.
2025-08-02 15:52:03 +02:00
Marc Wrobel
3f65ff9d9e [update-product-data] Allow disabling auto configuration (#482) 2025-08-02 15:01:47 +02:00
Nemo
d63d0e0cc1 [virtualbox-version] Add method (#480)
Track versions using https://download.virtualbox.org/virtualbox/.

Also rename virtualbox to virtualbox-releases.

---------

Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2025-08-01 22:03:40 +02:00
Marc Wrobel
7368e073dc [amazon-neptune] Fix date parsing 2025-07-27 23:34:49 +02:00
Marc Wrobel
7dfcfb2903 [citrix-vad-rss] Add auto method 2025-07-27 19:25:09 +02:00
Marc Wrobel
3b8adee264 [nvidia-driver] Add automation script (#476)
Closes #368.
2025-07-27 18:29:58 +02:00
Marc Wrobel
e1e93dc841 [motorola-security] Add auto method (#475)
Based on https://gist.github.com/ab/67c6343530c6b8e599f07cedccbcba3d.

Closes #277.
2025-07-27 12:23:20 +02:00
Marc Wrobel
c4fa5b187c [http] Improve User-Agent handling (#474)
- Simplify overriding the User-Agent by replacing the generic (unused) `headers` parameter by a new `user_agent` parameters.
- Take into account the User-Agent even in `fetch_javascript_url` : Playwright user agent is `Playwright/1.12.0` by default anyway.
- Make it possible to override the User-Agent with the `release_table` method.
- Update splunk to use Firefox's User-Agent.

This follows #470.
2025-07-26 10:24:54 +02:00
Maxim Ivanov
68c69aa3d1 [common http] improve the User-Agent identification (#470)
Properly identifying endoflife.date bot is more fair for website administrators, and give them the ability to more easily authorize the bot if they want to.

---------

Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2025-07-26 09:45:54 +02:00
Marc Wrobel
d8f05b91cd [netbsd] Skip invalid EOL date (#473)
Empty EOL cells are now recognized as `Â`, adding a condition to ignore them.
2025-07-25 22:24:17 +02:00
Marc Wrobel
f9d3757694 [red-hat-jboss-eap-7] Filter releases 2025-07-16 07:08:44 +02:00
Marc Wrobel
a985e6218f [chrome-releases] Add auto method (#469)
Based on https://chromiumdash.appspot.com API.
2025-07-15 23:37:16 +02:00
Marc Wrobel
54ff914f34 [http] Improve fetch_javascript_url error handling (#468) 2025-07-13 13:30:52 +02:00
Marc Wrobel
fa1eab8d21 [apple] Add 2020-2021 and 2022-2023 security update pages (#467) 2025-07-13 13:08:03 +02:00
Marc Wrobel
081d884abe Remove invalid releases automatically (#466)
Automatically remove empty releases or releases which are released in the future, regardless of the product.

Also refactored a bit releasedata.py to use better names and clarify types.
2025-07-13 11:36:13 +02:00
Marc Wrobel
ec6217b3cf [http] Improve caching management 2025-07-13 10:59:35 +02:00
Marc Wrobel
42c1189781 Copy releases from products frontmatter (#465)
Copy releases, without their properties, from product data (frontmatter) to release data.

This script is not intended to be declared in the frontmatter: it is for internal use only.
It executes before all other scripts, and helps the following scripts to work with releases.
2025-07-12 16:47:36 +02:00
Marc Wrobel
bccac7033d Fix github groups
github groups were written using logging, which was added the date as a prefix.
This were breaking the grouping of logs on GHA.
2025-07-12 11:44:08 +02:00
Marc Wrobel
e62676b5c4 [google-kubernetes-engine] Normalize script (#464)
The script used to parse different channel for historical (forgotten) reasons. This is the only script that works that way, and release data is not supposed to be consumed by other clients than endoflife.date. So aligning this script for all the other scripts.

In case other channel data is useful for someone, it would be preferable to create multiple products so that the data is available through our official API.
2025-07-12 10:29:33 +02:00
Marc Wrobel
1f7a3772d6 [http] Improve fetch_javascript_url (#462)
Replace `click_selector` by `wait_for,` which is a selector that we must wait for before considering the page loaded.

Also added `select_wait_for`, which returns the waited for element. Oddly this may be needed in some case (such as `artifactory.py`) where the `page.content()` does not contain the waited for element.
2025-07-09 23:20:39 +02:00
Marc Wrobel
7d78021706 [artifactory] Remove outdated overwrite
This has been fixed since.
2025-07-08 00:18:26 +02:00
Marc Wrobel
08808282dd Add new declare method (#461)
For manually declare (or overwrite) missing or erroneous versions.
2025-07-08 00:16:08 +02:00
Marc Wrobel
391d65ad8a Simplify argument parsing (#459)
With the current state of automation scripts, this is not possible anymore to launch script with multiple auto configs.
2025-07-06 22:42:01 +02:00
Marc Wrobel
ea740397da [oracle-jdk] Use javascript for fetching the page (#458)
Despite working in local, not using javascript for fetching https://www.java.com/releases/ does not work on GHA runners.
2025-07-06 15:39:05 +02:00
Marc Wrobel
6af48b24b4 [oracle-jdk] Stop using javascript for fetching the page
It's not needed, and started failing : https://github.com/endoflife-date/release-data/actions/runs/16085523550.
2025-07-05 09:40:08 +02:00
Marc Wrobel
c78d1fe2b5 Refactor scripts arguments handling (#456)
- remove the use of environment variables to get directory paths,
- make use of arguments / argparse instead of environment variables in `update.py` and `report.py`,
- automatically guess the data directory in `latest.py` based on the script's location,
- propagate log level to auto scripts,
- move `list_configs_from_argv` from `endoflife` module to `releasedata` module,
- use `list_products` in `latest.py` to load the product's frontmatters.
2025-06-28 19:05:07 +02:00
Marc Wrobel
3beb0f6e34 Respect HTTP Cache-Control header if available (#450)
Allow stale responses in case of error in order to reduce the number of temporary errors.

Note that the cache will be reset on the first build of every week in any cases, see .github/workflows/update.yml.
2025-06-28 12:57:41 +02:00
Marc Wrobel
312ce078bb Improve HTTP handling in scripts (#449)
Provide some helper methods to hide the complexity of parsing HTML, JSON, YAML, XML or Markdown.
2025-06-28 12:26:10 +02:00
Marc Wrobel
f404274310 Align custom scripts with generic scripts (#445)
Align custom scripts with generic scripts, making them configurable. This has a few advantages:

- script code is more unified,
- no more hard-coded method names in scripts, which is less error prone and make it easier to rename scripts,
- no more hard coded product names in scripts, which is less error prone and make it easier to rename products,
- less hard-coded URLs and regexes in scripts, which makes auto-configuration more expressive / updatable,

Also added method `endoflife.list_configs_from_argv()` so that it is easier to manipulate scripts arguments.
2025-06-07 17:25:05 +02:00
Marc Wrobel
92b263f114 [graalvm] Generify script (#440)
So that it can be used for both GraalVM CE and Oracle GraalVM.
2025-06-02 23:57:53 +02:00
Marc Wrobel
d3adaa2b77 [rocky-linux] Use the published wiki sources instead of the development sources
The development sources may contain upcoming information that are not yet true, such as upcoming release dates.
2025-05-31 07:58:43 +02:00
Marc Wrobel
c2a22dd150 [samsung-security] Generify samsung-mobile method (#439)
- Make section and inclusions/exclusions configurable,
- Remove Galaxy Tabs from samsung-mobile data (following https://github.com/endoflife-date/endoflife.date/pull/7513),
- Initialize Galaxy Tabs dataset (following https://github.com/endoflife-date/endoflife.date/pull/7513).
2025-05-19 19:06:45 +02:00
Marc Wrobel
64e1cde72e [ghc] Ignore unreleased releases 2025-05-17 12:45:33 +02:00
Marc Wrobel
aa43bf6602 [virtualbox] Add automation (#438)
Using https://www.virtualbox.org/wiki/Download_Old_Builds.
2025-05-17 11:55:38 +02:00
Marc Wrobel
f2931fd1e2 [firefox] Increase max versions limit 2025-05-17 10:24:20 +02:00
Marc Wrobel
6091ef55fe [samsung-mobile] Add automation (#437)
Detect new models and aggregate EOL data for Samsung Mobile devices.

This script works cumulatively: when a model is not listed anymore on https://security.samsungmobile.com/workScope.smsb
it retains the date and use it as the model's EOL date.
2025-05-07 23:29:33 +02:00
Marc Wrobel
97790695ee [red-hat-jboss-eap-7] Adapt script because of typo in the source file 2025-05-07 23:28:07 +02:00
Marc Wrobel
e97ee6ded1 Align markdown filenames with their respective permalinks
This update JSON / Python file names following https://github.com/endoflife-date/endoflife.date/pull/7369.
2025-05-04 11:48:07 +02:00
Denis Fuenzalida
54ef082add [red-hat-jboss-eap] Automation version retrieval (#414)
red-hat-jboss-eap-7.py retrieves all the 7.x versions based on https://access.redhat.com/articles/2332721.

red-hat-jboss-eap-8.py retrieves only the last 8.x version based on https://maven.repository.redhat.com/ga/org/jboss/eap/channels/eap-8.0/maven-metadata.xml (the version date is approximated using the lastUpdated tag).

---------

Co-authored-by: Denis Fuenzalida 🐙 <defuenza@microsoft.com>
Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2025-05-02 17:31:12 +02:00
Marc Wrobel
2b6e4f17c9 [release_table] Add the identifier type (#435)
With https://github.com/endoflife-date/endoflife.date/pull/7340 this is now needed for some products.
2025-05-02 16:26:33 +02:00
Marc Wrobel
3dd5eda8dc [veeam] Enable column name customization
This is required for https://github.com/endoflife-date/endoflife.date/pull/6614.
2025-04-27 19:46:59 +02:00
Marc Wrobel
72f4fff217 [eks] Add temporary fix for a typo in the source
Replaces 'April 18.2025' by 'April 18 2025'.
2025-04-27 19:10:53 +02:00
Marc Wrobel
9d2e8e33f2 [redhat_lifecycles] Stop setting field names to lower case
Fields in endoflife.date are case sensitive.
2025-04-05 20:02:53 +02:00
Marc Wrobel
d356d9643b Add redhat_lifecycles auto method (#428)
An auto method based on the Red Hat Product Life Cycle Data API (https://access.redhat.com/product-life-cycles/api/v1/products).
2025-04-05 19:04:43 +02:00
Marc Wrobel
e56b642326 Add github_tags auto method (#427)
Add a new method to fetch tags with their related commit date using GitHub GraphQL API.

For large repositories, such as https://github.com/gregkh/linux, it may be more performant than the git auto method.
2025-04-05 16:40:29 +02:00
Marc Wrobel
27a73c706f [veeam] Generify veeam-backup-and-replication auto method (#421) (#421)
Make veeam-backup-and-replication more generic so that it can be used for other veeam products, such as https://github.com/endoflife-date/endoflife.date/pull/6613 or https://github.com/endoflife-date/endoflife.date/pull/6614.
2025-03-30 15:44:35 +02:00
Maxim Ivanov
baf8b1b90e [ghc] Add automation (#395)
Based on https://gitlab.haskell.org/ghc/ghc/-/wikis/GHC-status.

---------

Co-authored-by: Marc Wrobel <marc.wrobel@gmail.com>
2025-03-28 20:28:01 +01:00