Mike Fährmann f7b5c4c3e7 use values of 'retries' options correctly ...

The RE-tries option now specifies exactly that: the maximum number a
failed HTTP request is re-tried. For example a value of 2 will now
correctly stop after 3 attempts: the initial one + 2 re-tries.

The maximum wait-time now also caps at 30min and increases exponentially
for both extractor.request() and downloader.http.download().

2019-06-30 23:10:18 +02:00

3.8 KiB

Raw Blame History

View Raw