github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,418 Commits 1 Branch 0 Tags
67ec91cdbd680035eedea70941579036838eb799
Commit Graph

4418 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
67ec91cdbd [downloader:http] change '_http_retry' to accept a Python function 
and rename '_http_retry_codes' to '_http_retry'

(#3569)
 2023-03-09 23:30:15 +01:00
Mike Fährmann
175822e065 merge #3738: [generic] add tests 2023-03-09 22:26:20 +01:00
Mike Fährmann
4883420e67 [generic] revert pattern change 2023-03-09 22:25:23 +01:00
Mike Fährmann
9037128315 [twitter] fix some 'original' retweets not downloading (#3744) 2023-03-08 18:33:19 +01:00
Mike Fährmann
ea3d95e7e8 merge #3740: [deviantart] add support for fxdeviantart.com URLs 2023-03-08 17:30:06 +01:00
Mike Fährmann
9abcb2b6e5 update headers and ciphers for '"browser": "chrome"' 2023-03-08 17:19:59 +01:00
ClosedPort22
c489aecb3e [deviantart] add support for fxdeviantart.com URLs 
fxdeviantart.com is a service that fixes embeds on Discord, similar to
fxtwitter.com
 2023-03-07 16:04:17 +08:00
ClosedPort22
34a7fab0e2 [generic] add support for IDNs 
(internationalized domain name)
 2023-03-06 22:42:36 +08:00
Mike Fährmann
c9a7345228 [newgrounds] prevent archive ID overlap (#3681) 
add an 'i' and 'a' prefix to image and audio files
(/art/view/, /audio/listen/)
since their numeric ID may conflict with movies and other media
 2023-03-06 15:03:49 +01:00
Mike Fährmann
8148c2a097 [downloader:ytdl] prevent exception on empty results 
a7c7953107 (commitcomment-92042240)
 2023-03-06 12:25:12 +01:00
Mike Fährmann
da9840a39d [reddit] update 'videos' option (#3712) 
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
 2023-03-06 12:18:25 +01:00
Mike Fährmann
143e82258f add .editorconfig 2023-03-05 20:09:28 +01:00
Mike Fährmann
8f8b4de0e8 [ytdl] fix '--parse-metadata' (#3663) 2023-03-05 19:57:23 +01:00
Mike Fährmann
11df3a021d [formatter] enclose f-strings with """ instead of ''' 2023-03-03 20:03:27 +01:00
Mike Fährmann
baf41d7437 [misskey] update (#3717) 
- add module docstring
- add options to docs/gallery-dl.conf
 2023-03-03 15:52:50 +01:00
Mike Fährmann
7610d9cf82 merge #3675: [pixiv] fix --write-tags for '"tags": "original"' 2023-03-02 21:48:31 +01:00
Mike Fährmann
6762d99515 merge #3717: [misskey] add misskey extractors 2023-03-02 19:31:41 +01:00
Mike Fährmann
b8a702929d [oauth] import extractor modules on demand 2023-03-02 18:39:54 +01:00
Mike Fährmann
dd88740ec7 replace remaining instances of base64 with binascii 2023-03-02 18:25:47 +01:00
Mike Fährmann
83e7a25b6b extend OAuth tests 2023-03-02 17:26:51 +01:00
enduser420
e1867cf5eb [misskey] add 'renotes' and 'replies' options 2023-03-02 19:56:19 +05:30
enduser420
a95b5e0d8e [misskey] add misskey extractors 2023-03-02 19:49:47 +05:30
Mike Fährmann
0d142e403c [szurubooru] add 'tag' and 'post' extractors (#3583, #3713) 2023-03-01 18:47:10 +01:00
Mike Fährmann
075c965512 add '--config-create' command-line option 
(#2333)
 2023-03-01 14:49:40 +01:00
Mike Fährmann
26d06e0bb2 move executable check into util.py 2023-02-28 23:10:23 +01:00
Mike Fährmann
de2f35d068 simplify config.load() 2023-02-28 22:02:15 +01:00
Mike Fährmann
632d5d7745 allow loading config files in TOML format with --config-toml 2023-02-28 21:54:46 +01:00
Mike Fährmann
9e870eb930 rename --ignore-config to --config-ignore 
--ignore-config still works as before,
but is no longer shown by --help
 2023-02-28 21:07:42 +01:00
Mike Fährmann
d66257f2c8 improve option.Formatter performance 
as always, only a very marginal difference,
but it still uses less resources than before
 2023-02-28 20:57:28 +01:00
Mike Fährmann
d788e6c60c implement 'globals' option 2023-02-28 18:18:55 +01:00
Mike Fährmann
b14f8d5817 [gelbooru] add 'favorite' extractor (#3704) 
requires logged in cookies to work
 2023-02-27 18:03:47 +01:00
Mike Fährmann
e480a93337 add 'output.stdout', '.stdin', and '.stderr' options 
(#1621, #2152, #2529)

Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
 2023-02-26 14:56:19 +01:00
Mike Fährmann
a70a3e5da6 [mangasee] extract 'author' and 'genre' metadata (#3703) 
Both are lists/arrays. Use {author!S} or {genre:J, } to format them.
 2023-02-26 14:12:19 +01:00
Mike Fährmann
6b03506655 [deviantart] allow searching when not logged in 2023-02-25 19:04:18 +01:00
Mike Fährmann
511a051705 [fanbox] fix crash with missing images (#3673) 2023-02-23 23:30:55 +01:00
Mike Fährmann
3fa456d989 [deviantart] remove mature scraps warning (#3691) 
warn about private deviations
when paginating over eclipse results
 2023-02-23 22:56:37 +01:00
Mike Fährmann
51301e0c31 replace remaining time.sleep() calls 
with Extractor.sleep() or request_interval
 2023-02-23 00:35:37 +01:00
Mike Fährmann
6ed4309aba [deviantart] add 'gallery-search' extractor (#1695) 2023-02-22 17:25:31 +01:00
Mike Fährmann
3d8777fbc1 move user agent string to util.py 2023-02-22 11:09:17 +01:00
Mike Fährmann
56039d2456 add 'hash_md5' and 'hash_sha1' functions (#3679) 
... to global eval namespace
 2023-02-22 10:58:44 +01:00
Mike Fährmann
e1df7f73b1 [deviantart] add 'search' extractor 
(#538, #1264, #2954, #2970, #3577)

Requires login to fetch any results, since the API endpoint raises an
error for not logged in requests.

TODO: parse HTML search results
 2023-02-20 20:54:46 +01:00
Gray Manley
38a6389e2c Fix lint. 2023-02-20 00:33:30 -06:00
Gray Manley
56cbae92ec Use more pythony naming. 2023-02-19 06:14:34 -06:00
Gray Manley
8e2ba4f32e Add test. 2023-02-19 06:13:21 -06:00
Gray Manley
f33ac885a6 [pixiv] fix tag write when set to original 2023-02-19 00:09:05 -06:00
Mike Fährmann
4f029ab38b [pornpics] support '/pornstar' and '/channels' listings 
- fix docstring (#3671)
- simplify code
 2023-02-18 22:38:21 +01:00
Mike Fährmann
cbe4769246 [danbooru] use gallery-dl UA (#3665) 
this removes the ability to set a custom UA via 'user-agent' option
for extractor requests
 2023-02-18 22:28:35 +01:00
Mike Fährmann
253ac08203 pre-define and use 'gallery-dö/<version>' UA string 2023-02-18 22:25:54 +01:00
Mike Fährmann
b4899c266f merge #3656: [deviantart] fix crash when handling deleted deviations in status updates 2023-02-18 13:11:47 +01:00
Mike Fährmann
bb11c2a576 merge #3662: [redgifs] add 'collection' extractors 2023-02-18 13:09:17 +01:00