Commit Graph

13 Commits

Author SHA1 Message Date
Marc Wrobel
94e04f3b4f Increase the default timeout value
Recently links to web.archive.org were added for various products. Such links are very long to load. This increases the default timeout value so that such links do not make the update fail.
2023-09-11 23:00:51 +02:00
Marc Wrobel
208ab8e2f8 Apply various minor refactorings
Improve readability and fix a few Python warnings (line too long, exception too broad...) through various minor refactorings.
2023-06-11 12:45:59 +02:00
Marc Wrobel
6ba7828f96 Refactor product releases writing
Create a common function to write resulting JSON files to the releases directory.
It makes this task simpler to read and maintain, while making it modifiable at a central point in the future.
One example of such modification could be the sorting of the versions in a uniform way for all the scripts.
2023-06-11 12:45:59 +02:00
Marc Wrobel
a16d9090d3 Refactor HTTP URL fetching scripts
This creates a common function to fetch HTTP URLs, with enhanced capabilities (retry, use of a known User-Agent).
It makes scripts that need those capabilities simpler, while improving other scripts.

This commit also fixes some scripts that did not log properly (cos.py, eks.py, haproxy.py, palo-alto-networks.py, rhel.py, ros.py, unrealircd.py).
2023-06-11 12:45:59 +02:00
Marc Wrobel
5176abd4d4 Refactor product filtering and loading for generic scripts
Generic scripts are scripts that handle multiple product based on some identifier (URL, coordinates...).
This creates a common function to list and load product configurations for those scripts.

It makes them simpler to read and maintain, while making the way they work much more consistent.
2023-06-11 12:45:59 +02:00
Marc Wrobel
3d16eeb5e2 [maven] Retry on timeout 2023-01-13 10:47:54 +01:00
Marc Wrobel
569f3a402c [maven] Sort versions by date then version 2023-01-11 16:54:26 +00:00
Nemo
4670ff7336 [maven] Updates to maven automation
1. Drop RC and milestone releases by adopting a simple
   version regex. Drops a few non-stable releases from
   jreleaser and tomcat. Tested against all of the maven
   automated pages

2. Fix pages with multiple auto: maven entries. In particular,
   groovy was using this, but the newer 4.0 releases were not
   being written correctly to disk.
2022-12-17 16:19:24 +05:30
Marc Wrobel
b65b5ad4ee Cleanup code (#37)
* [apple,distrowatch,pypi] Remove unused imports

* [maven] use snake_case for variable names

* [eks,palo-alto-networks] Rename variables shadowing names from outer scopes

* [eks,palo-alto-networks] Remove unused variables

* [apple,haproxy,palo-alto-networks,rhel,ros,unrealircd] Rename variables shadowing built-in names
2022-12-14 09:20:45 +05:30
Nemo
fac9620241 [py] Fix styling 2022-10-17 14:21:36 +05:30
Nemo
1c603de65d Update maven.py 2022-09-07 14:27:15 +00:00
Nemo
b65e752084 [maven] Log releases 2022-09-07 19:51:38 +05:30
Nemo
3277e99bf8 Maven Automation
Apache projects don't consider git tags as the final release, only
maven publishes. This applies for tomcat/zookeeper primarily.
2022-09-07 19:51:38 +05:30