a0ba2d687e
Until now products could declare multiple auto-update methods, but they all had to be of the same kind. For example if you used the git auto-update method, you could not use an additional github_releases or custom auto-update method. This is an issue as it prevents us to extend the auto-update process, for example by having a product using the 'git' auto-update method to retrieve all the versions, and a custom script to retrieve support and EOL dates. This improve the scripts execution orchestration to be able to support auto configurations using a mix of methods, meaning: - multiple kind of methods, such as git and github_release, - or multiple custom methods. A side-effect of those changes is that now a failure in a generic script does not cancel the update of subsequent products. Another side-effect, unwanted this time, is that now custom scripts managing multiple products, such as apple.py, are now executed multiple times instead of once.
27 lines
1.1 KiB
Python
27 lines
1.1 KiB
Python
import sys
|
|
|
|
from bs4 import BeautifulSoup
|
|
from common import dates, endoflife, http, releasedata
|
|
|
|
METHOD = 'distrowatch'
|
|
|
|
p_filter = sys.argv[1] if len(sys.argv) > 1 else None
|
|
m_filter = sys.argv[2] if len(sys.argv) > 2 else None
|
|
for config in endoflife.list_configs(p_filter, METHOD, m_filter):
|
|
with releasedata.ProductData(config.product) as product_data:
|
|
response = http.fetch_url(f"https://distrowatch.com/index.php?distribution={config.url}")
|
|
soup = BeautifulSoup(response.text, features="html5lib")
|
|
|
|
for table in soup.select("td.News1>table.News"):
|
|
headline = table.select_one("td.NewsHeadline a[href]").get_text().strip()
|
|
versions_match = config.first_match(headline)
|
|
if not versions_match:
|
|
continue
|
|
|
|
# multiple versions may be released at once (e.g. Ubuntu 16.04.7 and 18.04.5)
|
|
versions = config.render(versions_match).split("\n")
|
|
date = dates.parse_date(table.select_one("td.NewsDate").get_text())
|
|
|
|
for version in versions:
|
|
product_data.declare_version(version, date)
|