[kemonoparty] skip duplicate files (#2032, #1991, #1899)

Extract the SHA-256 file hash from URLs
and skip files with the same hash in the same post.

- provide a 'hash' metadata field (empty string if not available)
- remove 'patreon-skip-file' option
This commit is contained in:
Mike Fährmann
2021-11-17 22:20:18 +01:00
parent d4ec245554
commit d433735750
2 changed files with 20 additions and 17 deletions

View File

@@ -1370,16 +1370,6 @@ Description
Extract ``username`` metadata
extractor.kemonoparty.patreon-skip-file
---------------------------------------
Type
``bool``
Default
``true``
Description
Skip main files in Patreon posts to avoid duplicates.
extractor.khinsider.format
--------------------------
Type