Commit Graph

542 Commits

Author SHA1 Message Date
Mike Fährmann
3e4ffb0821 [gelbooru] add extractor for '/redirect.php' URLs (#1530) 2021-05-07 15:34:53 +02:00
Mike Fährmann
15b0241bbc [imagebam] fix extraction 2021-05-06 16:47:36 +02:00
Mike Fährmann
38ae61edd4 [inkbunny] add 'favorite' extractor (#1521) 2021-05-04 19:28:48 +02:00
Mike Fährmann
e300da1424 add 'output.skip' option 2021-05-04 19:27:18 +02:00
Mike Fährmann
2133f1d77f [readcomiconline] change domain to 'readcomiconline.li'
(closes #1517)
2021-05-01 16:41:16 +02:00
Mike Fährmann
fa519f9202 [pixiv] change 'translated-tags' option (#1507)
- rename to 'tags'
- use string-values: "japanese", "translated", "noop"
- remove duplicate entries for "translated" tags
2021-04-29 19:30:43 +02:00
Mike Fährmann
c6c4a73f87 update fanbox entry in supportedsites.md 2021-04-25 19:44:19 +02:00
thatfuckingbird
e47952ac14 add extractors for fantia and fanbox (#1459)
* add extractors for fantia and fanbox

* appease linter

* make docstrings unique

* [fantia] refactor post extraction

* [fantia] capitalize

* [fantia] improve regex pattern

* code style

* capitalize

* [fanbox] use BASE_PATTERN for url regexes

* [fanbox] refactor metadata and post extraction

* [fanbox] improve url base pattern

* [fanbox] accept creator page links ending with /posts

* [fanbox] more tests

* [fantia] improved pagination

* [fanbox] misc. code logic improvements

* [fantia] finish restructuring pagination code

* [fanbox] avoid making a request for each individual post when processing a creator page

* [fanbox] support embedded videos

* [fanbox] fix errors

* [fanbox] document extractor.fanbox.videos

* [fanbox] handle "article" and "entry" post types, all embeds

* [fanbox] fix downloading of embedded fanbox posts
2021-04-25 19:39:13 +02:00
Mike Fährmann
77a9cc6fd6 update supportedsites.md entry for Instagram 2021-04-23 23:21:01 +02:00
Mike Fährmann
9514cb8c12 [exhentai] update 'limits' check (#1487)
Only use 'limits' to set a custom upper bound.
Checking if the actual maximum gets exceeded is not necessary.
2021-04-23 23:20:45 +02:00
Renan Vedovato Traba
9322c5e43b [exhentai] restore limit config (#1487)
This partially reverts commit e9ec91c8
2021-04-22 21:21:41 +02:00
Hans Christian Gunawan
334d690687 [hentaicosplays] Add extractor (#1473) 2021-04-18 20:28:00 +02:00
Mike Fährmann
086925e685 [shopify] support omgmiamiswimwear.com (closes #1280) 2021-04-13 23:54:03 +02:00
thatfuckingbird
224b883ff4 [danbooru] add option for extended metadata extraction (#1458)
* [danbooru] add option for extended metadata extraction

* appease linter

* [danbooru] update docs/configuration.rst

* [danbooru] rename extended-metadata -> metadata
2021-04-13 23:41:30 +02:00
thatfuckingbird
dff03a6605 [booru] add an option to extract notes (only gelbooru for now) (#1457)
* [booru] add an option to extract notes (currently implemented only for gelbooru)

* appease linter

* [gelbooru] rename "text" to "body" in note extraction

* add a code comment about reusing return value of _extended_tags
2021-04-13 23:40:24 +02:00
Mike Fährmann
78d7ee3ef4 [yuki] remove module for yuki.la 2021-04-12 21:42:32 +02:00
Mike Fährmann
a86ffb04bb add 'output.fallback' option
to enable/disable fallback URLs for -g/--get-urls
2021-04-12 02:00:41 +02:00
FollieHiyuki
e3b9f88540 Add manganelo extractor (#1415) 2021-04-02 21:01:31 +02:00
Mike Fährmann
105f3c9666 [twitter] add extractor for direct image links (closes #1417) 2021-04-02 02:45:23 +02:00
Mike Fährmann
ec3d5d58a8 [vk] improve extractor (#474)
- fetch all photos
- add 'metadata' option
- fix extracting photos without '?' in URL
2021-04-01 14:35:56 +02:00
Mike Fährmann
d5aad999dc [tapas] implement login with username & password (#692) 2021-03-30 01:45:28 +02:00
Mike Fährmann
e9ec91c811 [exhentai] improve image limits check
- check if current image is the '509 Bandwidth Exceeded' notification
  (https://ehgt.org/g/509.gif or https://exhentai.org/img/509.gif)
- remove 'limits' option
2021-03-29 19:01:13 +02:00
Mike Fährmann
36291176bc [pinterest] add 'search' extractor (#1411) 2021-03-29 01:41:28 +02:00
Mike Fährmann
5aa30c3669 [tapas] add 'series' and 'episode' extractors (#692) 2021-03-27 18:28:16 +01:00
Mike Fährmann
62cfee4d28 [vk] initial support for albums (#474) 2021-03-23 19:02:16 +01:00
Mike Fährmann
2846235669 [twitter] allow specifying a custom format for user results
(#1337)
2021-03-21 22:26:26 +01:00
Mike Fährmann
b0438c8f99 Revert "[deviantart] extend 'extra' option"
This reverts commit
5ad2b9c82b,
5c32a7bf58, and
83f465faca.

(#1387, #1356)
2021-03-19 16:24:23 +01:00
Mike Fährmann
58b93635ee [architizer] add 'firm' extractor (#1369) 2021-03-19 01:31:34 +01:00
Mike Fährmann
204523611c [imgclick] use 'http://' for image URLs
The TLS certificate for main.imgclick.net is invalid.
2021-03-19 01:30:49 +01:00
Mike Fährmann
69ca4e29f1 [deviantart] add 'watch' extractor (#794) 2021-03-17 22:50:02 +01:00
Mike Fährmann
fcdda6128c [mangastream] remove module 2021-03-16 23:52:36 +01:00
Mike Fährmann
c677ea19dd [mangareader] remove module 2021-03-16 23:48:55 +01:00
Mike Fährmann
71523aaab6 [architizer] add 'project' extractor (#1369) 2021-03-16 03:24:29 +01:00
Mike Fährmann
3378b39719 [twitter] implement 'users' option (#1337) 2021-03-16 00:51:05 +01:00
Mike Fährmann
466966bf83 [hentaicafe] remove module 2021-03-14 17:19:57 +01:00
Mike Fährmann
97641cd151 [hentainexus] remove module 2021-03-14 17:19:57 +01:00
Mike Fährmann
c485d0a956 [philomena] add generalized extractors for philomena sites
(closes #1379)
2021-03-14 17:19:57 +01:00
Mike Fährmann
72fe9ac0f3 [gelbooru_v01] support some more boorus by default
- https://drawfriends.booru.org/
- https://vidyart.booru.org/
- https://tlb.booru.org/
2021-03-14 17:19:56 +01:00
Mike Fährmann
ec98b2c56f categorize sites in supportedsites.md by basecategory 2021-03-12 16:53:36 +01:00
Mike Fährmann
a67e002f40 update docs/supportedsites
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
2021-03-12 03:03:48 +01:00
Mike Fährmann
df94182e11 implement 'parent-metadata' option (#1364)
experimental, might not work as expected, etc.
2021-03-11 01:10:34 +01:00
Mike Fährmann
4be27ff0fe [nozomi] support '/index-N.html' URLs (closes #1365)
and '/index-Popular-N.html'
2021-03-11 01:06:47 +01:00
Mike Fährmann
83f465faca [deviantart] refactor 'extra' (#1356)
- change its expected type to string
- let users specify a list of sources (stash, posts) or 'all'
2021-03-07 22:23:52 +01:00
Mike Fährmann
5c32a7bf58 [deviantart] allow selecting source for 'extra' (#1356)
Setting 'extra' to "stash" or "deviations" will only download embedded
sta.sh content or deviations. 'true' still downloads both.
2021-03-06 21:31:28 +01:00
Mike Fährmann
a677123abb [instagram] recognize 'reels' as option for 'include' (#1329) 2021-03-06 18:50:19 +01:00
Mike Fährmann
7440d1f112 [pixiv] add 'translated-tags' option (closes #1354)
(a lot more straight forward than I thought ...)
2021-03-05 17:18:51 +01:00
Mike Fährmann
106cdc37c0 [instagram] support '/user/reels/' URLs (closes #1329) 2021-03-04 21:31:18 +01:00
Mike Fährmann
f59e63669b [hentaicafe] add 'search' and 'tag' extractors (#1345) 2021-03-03 23:09:34 +01:00
Mike Fährmann
38e66940c1 [tumblrgallery] simplify 2021-03-03 15:37:56 +01:00
Mike Fährmann
6a28b7045c update 'docs/gallery-dl.conf' 2021-03-03 03:11:48 +01:00