implement 'sleep-request' option

2020-09-19 22:07:41 +02:00
parent 65744a7a31
commit 1e313d5b84
2 changed files with 23 additions and 0 deletions
--- a/docs/configuration.rst
+++ b/docs/configuration.rst
@@ -218,6 +218,16 @@ Description Number of seconds to sleep before handling an input URL,
 =========== =====


+extractor.*.sleep-request
+-------------------------
+=========== =====
+Type        ``float``
+Default     ``0``
+Description Minimal time interval in seconds between each HTTP request
+            during data extraction.
+=========== =====
+
+
 extractor.*.username & .password
 --------------------------------
 =========== =====