github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,948 Commits 1 Branch 0 Tags
b2c3db3e24d7360de34cc0ad4cd80e623be85cd3
Commit Graph

3640 Commits

Author SHA1 Message Date
Mike Fährmann
dcb8af659a [gelbooru] extract favorites without needing cookies (#3704) 
TODO: fix --range
 2023-03-15 19:21:35 +01:00
Mike Fährmann
b756dc13aa [gelbooru] warn about missing cookies for favorites (#3704) 
and add docstring so it shows up in --list-extractors
 2023-03-15 14:58:55 +01:00
Mike Fährmann
17bd053d94 [hiperdex] fix extraction (#3768) 2023-03-15 14:28:03 +01:00
Mike Fährmann
817fc0fbd1 [nitter] remove nitter.pussthecat.org 
"Shutdown"
 2023-03-09 23:48:39 +01:00
Mike Fährmann
67ec91cdbd [downloader:http] change '_http_retry' to accept a Python function 
and rename '_http_retry_codes' to '_http_retry'

(#3569)
 2023-03-09 23:30:15 +01:00
Mike Fährmann
175822e065 merge #3738: [generic] add tests 2023-03-09 22:26:20 +01:00
Mike Fährmann
4883420e67 [generic] revert pattern change 2023-03-09 22:25:23 +01:00
Mike Fährmann
9037128315 [twitter] fix some 'original' retweets not downloading (#3744) 2023-03-08 18:33:19 +01:00
Mike Fährmann
ea3d95e7e8 merge #3740: [deviantart] add support for fxdeviantart.com URLs 2023-03-08 17:30:06 +01:00
Mike Fährmann
9abcb2b6e5 update headers and ciphers for '"browser": "chrome"' 2023-03-08 17:19:59 +01:00
ClosedPort22
c489aecb3e [deviantart] add support for fxdeviantart.com URLs 
fxdeviantart.com is a service that fixes embeds on Discord, similar to
fxtwitter.com
 2023-03-07 16:04:17 +08:00
ClosedPort22
34a7fab0e2 [generic] add support for IDNs 
(internationalized domain name)
 2023-03-06 22:42:36 +08:00
Mike Fährmann
c9a7345228 [newgrounds] prevent archive ID overlap (#3681) 
add an 'i' and 'a' prefix to image and audio files
(/art/view/, /audio/listen/)
since their numeric ID may conflict with movies and other media
 2023-03-06 15:03:49 +01:00
Mike Fährmann
da9840a39d [reddit] update 'videos' option (#3712) 
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
 2023-03-06 12:18:25 +01:00
Mike Fährmann
baf41d7437 [misskey] update (#3717) 
- add module docstring
- add options to docs/gallery-dl.conf
 2023-03-03 15:52:50 +01:00
Mike Fährmann
6762d99515 merge #3717: [misskey] add misskey extractors 2023-03-02 19:31:41 +01:00
Mike Fährmann
b8a702929d [oauth] import extractor modules on demand 2023-03-02 18:39:54 +01:00
Mike Fährmann
dd88740ec7 replace remaining instances of base64 with binascii 2023-03-02 18:25:47 +01:00
enduser420
e1867cf5eb [misskey] add 'renotes' and 'replies' options 2023-03-02 19:56:19 +05:30
enduser420
a95b5e0d8e [misskey] add misskey extractors 2023-03-02 19:49:47 +05:30
Mike Fährmann
0d142e403c [szurubooru] add 'tag' and 'post' extractors (#3583, #3713) 2023-03-01 18:47:10 +01:00
Mike Fährmann
b14f8d5817 [gelbooru] add 'favorite' extractor (#3704) 
requires logged in cookies to work
 2023-02-27 18:03:47 +01:00
Mike Fährmann
a70a3e5da6 [mangasee] extract 'author' and 'genre' metadata (#3703) 
Both are lists/arrays. Use {author!S} or {genre:J, } to format them.
 2023-02-26 14:12:19 +01:00
Mike Fährmann
6b03506655 [deviantart] allow searching when not logged in 2023-02-25 19:04:18 +01:00
Mike Fährmann
511a051705 [fanbox] fix crash with missing images (#3673) 2023-02-23 23:30:55 +01:00
Mike Fährmann
3fa456d989 [deviantart] remove mature scraps warning (#3691) 
warn about private deviations
when paginating over eclipse results
 2023-02-23 22:56:37 +01:00
Mike Fährmann
51301e0c31 replace remaining time.sleep() calls 
with Extractor.sleep() or request_interval
 2023-02-23 00:35:37 +01:00
Mike Fährmann
6ed4309aba [deviantart] add 'gallery-search' extractor (#1695) 2023-02-22 17:25:31 +01:00
Mike Fährmann
3d8777fbc1 move user agent string to util.py 2023-02-22 11:09:17 +01:00
Mike Fährmann
e1df7f73b1 [deviantart] add 'search' extractor 
(#538, #1264, #2954, #2970, #3577)

Requires login to fetch any results, since the API endpoint raises an
error for not logged in requests.

TODO: parse HTML search results
 2023-02-20 20:54:46 +01:00
Mike Fährmann
4f029ab38b [pornpics] support '/pornstar' and '/channels' listings 
- fix docstring (#3671)
- simplify code
 2023-02-18 22:38:21 +01:00
Mike Fährmann
cbe4769246 [danbooru] use gallery-dl UA (#3665) 
this removes the ability to set a custom UA via 'user-agent' option
for extractor requests
 2023-02-18 22:28:35 +01:00
Mike Fährmann
253ac08203 pre-define and use 'gallery-dö/<version>' UA string 2023-02-18 22:25:54 +01:00
Mike Fährmann
b4899c266f merge #3656: [deviantart] fix crash when handling deleted deviations in status updates 2023-02-18 13:11:47 +01:00
Mike Fährmann
bb11c2a576 merge #3662: [redgifs] add 'collection' extractors 2023-02-18 13:09:17 +01:00
Mike Fährmann
884f1848d6 [redgifs] fix syntax for older Python versions 
and update docs/supportedsites
 2023-02-18 13:07:40 +01:00
Mike Fährmann
725baedad3 [deviantart] use '/collections/all' endpoint for favorites 
(#3666 ,#3668)
 2023-02-17 23:11:35 +01:00
Mike Fährmann
2bd8f2f4bd [pornpics] add 'search' and 'tag' extractors 
(#263, #3544, #3654)
 2023-02-17 23:03:14 +01:00
Mike Fährmann
79bc82884c [pornpics] add 'gallery' extractor (#263, #3544, #3654) 2023-02-17 15:00:57 +01:00
Mike Fährmann
7bdc1d6d3d [manganelo] update and fix metadata extraction 2023-02-16 22:31:18 +01:00
Mike Fährmann
363bb76dff [manganelo] simplify URL pattern 2023-02-16 21:36:11 +01:00
enduser420
b28bd9789e [redgifs] add 'collection' extractors 2023-02-16 20:10:22 +05:30
ClosedPort22
f4e211356d [deviantart] slight refactor 2023-02-16 21:23:55 +08:00
Mike Fährmann
bd5d08abbc [catbox] add 'file' extractor (#3570) 2023-02-15 19:50:26 +01:00
Mike Fährmann
8e1e8a5bea [soundgasm] rewrite (#3578) 
use a more standard extractor structure to make -A work as expected
 2023-02-15 16:52:07 +01:00
Mike Fährmann
0b93420a81 [pinterest] unescape search terms (#3621) 2023-02-15 15:44:20 +01:00
Mike Fährmann
ad96e70546 [bunkr] fix extraction (#3636, #3655) 2023-02-15 15:42:32 +01:00
Mike Fährmann
9335d55bbc [manganelo] support mobile-only chapters 2023-02-15 00:02:28 +01:00
ClosedPort22
a74114ef7a [deviantart] fix crash when handling deleted deviations 
in status updates
 2023-02-15 00:17:11 +08:00
Mike Fährmann
75570ad3f1 [oauth] remove stray 'exit()' (#3628) 
- bug from 70ce45d9
- broke oauth:tumblr, oauth:flickr, and oauth:smugmug
 2023-02-13 15:58:34 +01:00