Commit Graph

3367 Commits

Author SHA1 Message Date
Mike Fährmann
38193dba46 support accessing environment variables in format strings (#1968)
{_env[HOME]} to get the value of $HOME
every other format string feature is supported as well
2021-10-28 19:18:55 +02:00
Mike Fährmann
e4696b40ba [instagram] update query hashes 2021-10-27 21:37:31 +02:00
Alice
bfd7401b1e [skeb] add 'user' and 'post' extractors (#1031) (#1971)
* Create skeb.py

* Update __init__.py

* Update supportedsites.py

* Update supportedsites.md

* Update supportedsites.py

* Update skeb.py
2021-10-26 20:00:41 +02:00
Ryu juheon
6b6d92d51c [hitomi]: fix image URLs (#1975) 2021-10-26 19:35:01 +02:00
Mike Fährmann
dcb201ff19 [gfycat] show warning when there are no available formats 2021-10-26 19:26:50 +02:00
Mike Fährmann
e436a2607b [gfycat] consistent 'userName' values for 'user' downloads (#1962)
by using the name from the input URL and not relying on possibly faulty
or incomplete API results.

'userData[username]', if available, will still have the original name.
2021-10-26 19:15:30 +02:00
Mike Fährmann
ba9579c504 release version 1.19.1 2021-10-24 21:48:25 +02:00
Mike Fährmann
f1487a3cfa [kemonoparty:discord] improve 'inline' extraction (#1940)
- extract media.discordapp.*NET* URLs
- rewrite media.discordapp.net to cdn.discordapp.com
- use a more restricted set of characters for the URL path
2021-10-24 21:15:21 +02:00
Mike Fährmann
02a247f4e5 [deviantart] full resolution for non-downloadable images (#293)
Many thanks to @Ironchest337 for discovering this method
and providing a well-documented implementation.
2021-10-24 21:11:12 +02:00
Mike Fährmann
a7ddb5f5fa [deviantart] update 'search' argument handling (fixes #1911)
- use 'alltime' by default
- support newer 'order' values (most-recent, this-week, etc)
2021-10-23 21:48:02 +02:00
Mike Fährmann
c19e762fdf [vk] add 'album' extractor (#474, fixes #1952)
todo: better metadata for albums
2021-10-23 00:46:20 +02:00
Mike Fährmann
8bb442f20d [redgifs][gfycat] provide fallback URLs (fixes #1962)
and extend the 'format' option
2021-10-22 22:47:29 +02:00
Mike Fährmann
b6443c576d [kemonoparty:discord] extract 'inline' files 2021-10-22 02:50:47 +02:00
Mike Fährmann
232ab626a7 [downloader:ytdl] prevent crash in '_progress_hook()'
https://github.com/mikf/gallery-dl/discussions/1964#discussioncomment-1516702
2021-10-21 22:57:04 +02:00
Mike Fährmann
bcbf9bcf36 [kemonoparty] split 'discord' extractor (#1940)
in 'server' and 'channel'
2021-10-18 04:04:58 +02:00
Mike Fährmann
db857b40d8 [kemonoparty] improve inline extraction (#1899) 2021-10-17 21:47:11 +02:00
Mike Fährmann
975e0a4fe0 [furaffinity] unquote search queries (#1958)
instead of unescape
(unquote -> url params, unescape -> html entities)
2021-10-17 20:48:08 +02:00
Mike Fährmann
8d676151b7 [patreon] implement 'files' option (#1935) 2021-10-17 04:17:10 +02:00
Mike Fährmann
6695ef2e10 [patreon] better filenames for 'content' images (#1954) 2021-10-16 23:21:14 +02:00
Mike Fährmann
80314e981b small corrections to gallery-dl-example.conf
use "'_reddit' in locals()"
instead of ""locals().get('_reddit')"
since the reddit metadata dict could be empty. The latter expression
would evaluate to False in that case, even though it has a reddit parent.
2021-10-16 20:50:39 +02:00
Mike Fährmann
3ecf4a9729 update gallery-dl-example.conf
- add comments
- remove/replace some older options
- display more post processor settings
2021-10-16 17:35:56 +02:00
Mike Fährmann
70005e3275 [kemonoparty:discord] support downloading from a specific channel
https://kemono.party/discord/server/<server-id>#<channel-name>>
2021-10-15 18:50:08 +02:00
Mike Fährmann
003f25931d [kemonoparty:discord] provide a 'channel_name' 2021-10-15 18:37:08 +02:00
Mike Fährmann
28bdd58e6d [nhentai] simplify 2021-10-14 16:45:53 +02:00
Mike Fährmann
50098762e3 [nhentai] add 'tag' extractor (closes #1950) 2021-10-14 16:23:47 +02:00
Mike Fährmann
fe6ce5495a [kemonoparty] add 'discord' extractor (#1827, #1940) 2021-10-13 20:33:05 +02:00
Mike Fährmann
f2d6b3e6b4 run tests without using 'nose'
run_tests.sh -> run_tests.py
2021-10-13 04:07:41 +02:00
Mike Fährmann
918fc9974d [picarto] add 'gallery' extractor (closes #1931) 2021-10-13 01:22:10 +02:00
Mike Fährmann
e33125ad39 [pixiv] add 'sketch' extractor (#1497) 2021-10-13 00:02:11 +02:00
Mike Fährmann
e9dc6ff262 [inkbunny] add 'following' extractor (#515) 2021-10-11 21:10:20 +02:00
Mike Fährmann
9c8fc6e7b4 [inkbunny] match "long" URLs for pools and favorites (#1937) 2021-10-11 17:24:22 +02:00
Mike Fährmann
f33c2ef73b [cyberdrop] extract direct download URLs (#1943)
do not rely on redirects from f.cyberdrop.cc
2021-10-10 23:05:29 +02:00
Mike Fährmann
b93915c113 [inkbunny] add 'pool' extractor (#1937) 2021-10-09 22:07:07 +02:00
Mike Fährmann
373d3e1c57 [seisoparty] implement login with username & password (#1906) 2021-10-08 22:44:31 +02:00
Mike Fährmann
7c5f62b453 [seisoparty] add 'favorite' extractor (#1906) 2021-10-08 22:26:34 +02:00
Mike Fährmann
d93b5474c3 [mangadex] update parameter handling for API requests
- move common parameters into '_pagination()'
- add 'ratings' (#1908) and 'api-parameters' options
2021-10-05 19:46:48 +02:00
Mike Fährmann
cd66c3c415 [twitter] add 'size' option (#1881) 2021-10-05 19:14:54 +02:00
Mike Fährmann
df8050b81d [postprocessor:compare] add 'equal' option (#1592)
Move functionality from cdd72e14 to its own option,
where it can be used with any 'action'
2021-10-05 03:03:37 +02:00
Mike Fährmann
f8410203ef release version 1.19.0 2021-10-01 22:02:07 +02:00
Mike Fährmann
cdd72e1413 [postprocessor:compare] extend 'action' option (#1592)
allow setting it to "abort", "terminate", or "exit" as with 'skip'
2021-10-01 20:18:36 +02:00
Mike Fährmann
fb98b3fdaf [redgifs][gfycat] remove webtoken code (fixes #1907) 2021-10-01 17:08:33 +02:00
Mike Fährmann
96215c926e [mangadex] fix retrieving chapters from 'pornographic' titles
(fixes #1908)
2021-10-01 16:48:53 +02:00
Mike Fährmann
da9685609c [kemonoparty] update file download URLs
(closes #1902, fixes #1903)
2021-09-30 23:02:46 +02:00
Mike Fährmann
783eae6fc5 [hiperdex] fix extraction 2021-09-30 00:32:34 +02:00
Mike Fährmann
12fc646c53 fix filename formatting tests 2021-09-29 23:39:02 +02:00
Mike Fährmann
2977f1a6b9 re-enable py2exe in setup.py
had to patch the native 'certifi' hook to

def hook_certifi(finder, module):
    import certifi
    finder.add_datafile_to_zip("certifi/cacert.pem", certifi.where())

to make everything work
2021-09-29 18:41:11 +02:00
Mike Fährmann
28f1c36da2 simplify and adjust download progress indicator (#1519) 2021-09-29 18:40:36 +02:00
Mike Fährmann
e0bdacd932 [fappic] add 'image' extractor (closes #1898) 2021-09-28 23:35:29 +02:00
Mike Fährmann
c22ff97743 remove 'unit' argument from 'util.format_value()' 2021-09-28 23:07:55 +02:00
Mike Fährmann
8c29a6e491 add example for 'url-metadata' option (closes #1884) 2021-09-28 22:59:37 +02:00