[deviantart] implement 'pagination' option (#2488)

2022-04-18 18:08:01 +02:00
parent 1f9a0e2fd8
commit 97e8a15295
2 changed files with 22 additions and 2 deletions
--- a/docs/configuration.rst
+++ b/docs/configuration.rst
@@ -1077,6 +1077,19 @@ Description
    everything else (archives, etc.).


+extractor.deviantart.pagination
+-------------------------------
+Type
+    ``string``
+Default
+    ``"api"``
+Description
+    Controls when to stop paginating over API results.
+
+    * ``"api"``: Trust the API and stop when ``has_more`` is ``false``.
+    * ``"manual"``: Disregard ``has_more`` and only stop when a batch of results is empty.
+
+
 extractor.deviantart.refresh-token
 ----------------------------------
 Type