Commit Graph

3390 Commits

Author SHA1 Message Date
Mike Fährmann
f4d201f626 [ytdl] fix syntax for Python 3.4 2021-11-09 23:05:12 +01:00
Mike Fährmann
37c9dedee1 [seisoparty] remove module 2021-11-09 22:41:04 +01:00
Mike Fährmann
efa178cc91 [ytdl] implement parsing ytdl command-line options (#1680)
- adds 'config-file' and 'cmdline-args' options
  for both ytdl downloader and extractor
- create 'ytdl' helper module, which combines YoutubeDL creation
  and option parsing.
- most likely a buggy mess due to incompatibilities between the
  original youtube-dl and yt-dlp.
2021-11-07 02:44:11 +01:00
Mike Fährmann
a881305357 release version 1.19.2 2021-11-05 20:47:45 +01:00
Mike Fährmann
7cb303d745 [redgifs] improve URL extraction
Fields inside 'urls' can be None, which would have caused an exception
with the old method.
2021-11-05 20:02:43 +01:00
Mike Fährmann
2befed1a96 [redgifs] update search URL pattern (#1984) 2021-11-05 20:00:06 +01:00
Mike Fährmann
b315a0ecef [redgifs] update to API v2 (#1984) 2021-11-04 21:31:20 +01:00
Mike Fährmann
f0fc3b0ba1 [kemonoparty] add 'comments' option (#1980) 2021-11-03 23:02:13 +01:00
Mike Fährmann
1fac74b14d [reddit] prevent crash for galleries with no 'media_metadata'
(fixes #2001)
2021-11-03 17:55:40 +01:00
Mike Fährmann
2ab190ce08 add tests for special format strings 2021-11-01 23:26:18 +01:00
Mike Fährmann
211de95dd0 update extractor test results 2021-11-01 02:58:53 +01:00
Mike Fährmann
8bea02c38c [deviantart] fix 'index' values for stashed deviations 2021-11-01 01:08:24 +01:00
Mike Fährmann
dd88a7d980 {cyberdrop] restore video extraction (fixes #1993)
fixes a regression introduced in f33c2ef7
2021-10-31 04:34:01 +01:00
Mike Fährmann
fa5646eadc [mangoxo] fix login and extraction 2021-10-31 02:16:13 +01:00
Mike Fährmann
4c49174579 [mangakakalot] update domain and fix extraction 2021-10-31 02:16:13 +01:00
ImportTaste
69cd573809 add special type format strings to docs (#1987) 2021-10-30 21:46:26 +02:00
YongChan Cho
14852f7050 [hitomi] fix image path (#1988) 2021-10-30 21:45:01 +02:00
Mike Fährmann
46e17c5e61 support accessing the current local datetime in format strings
{_now}, {_now:%Y-%m-%d}, etc
(#1968)
2021-10-30 21:41:09 +02:00
Mike Fährmann
dad2875a3e fix calculating retry sleep times (fixes #1990) 2021-10-29 23:53:48 +02:00
Mike Fährmann
9156e90f1f [twitter] add 'pinned' option 2021-10-29 22:10:58 +02:00
Mike Fährmann
06b414c9a3 [redgifs] 'gfyId' -> 'id' (#1984) 2021-10-29 02:05:39 +02:00
Ryu juheon
d4614e5ba4 [hitomi] fix image URLs (#1982) 2021-10-28 19:29:48 +02:00
Mike Fährmann
6434ccf9e8 [redgifs] split from 'gfycat' (#1984)
Update API endpoints and metadata names - mostly 'gfycat' -> 'gif' -
and remove some obsolete checks.
2021-10-28 19:22:41 +02:00
Mike Fährmann
38193dba46 support accessing environment variables in format strings (#1968)
{_env[HOME]} to get the value of $HOME
every other format string feature is supported as well
2021-10-28 19:18:55 +02:00
Mike Fährmann
e4696b40ba [instagram] update query hashes 2021-10-27 21:37:31 +02:00
Alice
bfd7401b1e [skeb] add 'user' and 'post' extractors (#1031) (#1971)
* Create skeb.py

* Update __init__.py

* Update supportedsites.py

* Update supportedsites.md

* Update supportedsites.py

* Update skeb.py
2021-10-26 20:00:41 +02:00
Ryu juheon
6b6d92d51c [hitomi]: fix image URLs (#1975) 2021-10-26 19:35:01 +02:00
Mike Fährmann
dcb201ff19 [gfycat] show warning when there are no available formats 2021-10-26 19:26:50 +02:00
Mike Fährmann
e436a2607b [gfycat] consistent 'userName' values for 'user' downloads (#1962)
by using the name from the input URL and not relying on possibly faulty
or incomplete API results.

'userData[username]', if available, will still have the original name.
2021-10-26 19:15:30 +02:00
Mike Fährmann
ba9579c504 release version 1.19.1 2021-10-24 21:48:25 +02:00
Mike Fährmann
f1487a3cfa [kemonoparty:discord] improve 'inline' extraction (#1940)
- extract media.discordapp.*NET* URLs
- rewrite media.discordapp.net to cdn.discordapp.com
- use a more restricted set of characters for the URL path
2021-10-24 21:15:21 +02:00
Mike Fährmann
02a247f4e5 [deviantart] full resolution for non-downloadable images (#293)
Many thanks to @Ironchest337 for discovering this method
and providing a well-documented implementation.
2021-10-24 21:11:12 +02:00
Mike Fährmann
a7ddb5f5fa [deviantart] update 'search' argument handling (fixes #1911)
- use 'alltime' by default
- support newer 'order' values (most-recent, this-week, etc)
2021-10-23 21:48:02 +02:00
Mike Fährmann
c19e762fdf [vk] add 'album' extractor (#474, fixes #1952)
todo: better metadata for albums
2021-10-23 00:46:20 +02:00
Mike Fährmann
8bb442f20d [redgifs][gfycat] provide fallback URLs (fixes #1962)
and extend the 'format' option
2021-10-22 22:47:29 +02:00
Mike Fährmann
b6443c576d [kemonoparty:discord] extract 'inline' files 2021-10-22 02:50:47 +02:00
Mike Fährmann
232ab626a7 [downloader:ytdl] prevent crash in '_progress_hook()'
https://github.com/mikf/gallery-dl/discussions/1964#discussioncomment-1516702
2021-10-21 22:57:04 +02:00
Mike Fährmann
bcbf9bcf36 [kemonoparty] split 'discord' extractor (#1940)
in 'server' and 'channel'
2021-10-18 04:04:58 +02:00
Mike Fährmann
db857b40d8 [kemonoparty] improve inline extraction (#1899) 2021-10-17 21:47:11 +02:00
Mike Fährmann
975e0a4fe0 [furaffinity] unquote search queries (#1958)
instead of unescape
(unquote -> url params, unescape -> html entities)
2021-10-17 20:48:08 +02:00
Mike Fährmann
8d676151b7 [patreon] implement 'files' option (#1935) 2021-10-17 04:17:10 +02:00
Mike Fährmann
6695ef2e10 [patreon] better filenames for 'content' images (#1954) 2021-10-16 23:21:14 +02:00
Mike Fährmann
80314e981b small corrections to gallery-dl-example.conf
use "'_reddit' in locals()"
instead of ""locals().get('_reddit')"
since the reddit metadata dict could be empty. The latter expression
would evaluate to False in that case, even though it has a reddit parent.
2021-10-16 20:50:39 +02:00
Mike Fährmann
3ecf4a9729 update gallery-dl-example.conf
- add comments
- remove/replace some older options
- display more post processor settings
2021-10-16 17:35:56 +02:00
Mike Fährmann
70005e3275 [kemonoparty:discord] support downloading from a specific channel
https://kemono.party/discord/server/<server-id>#<channel-name>>
2021-10-15 18:50:08 +02:00
Mike Fährmann
003f25931d [kemonoparty:discord] provide a 'channel_name' 2021-10-15 18:37:08 +02:00
Mike Fährmann
28bdd58e6d [nhentai] simplify 2021-10-14 16:45:53 +02:00
Mike Fährmann
50098762e3 [nhentai] add 'tag' extractor (closes #1950) 2021-10-14 16:23:47 +02:00
Mike Fährmann
fe6ce5495a [kemonoparty] add 'discord' extractor (#1827, #1940) 2021-10-13 20:33:05 +02:00
Mike Fährmann
f2d6b3e6b4 run tests without using 'nose'
run_tests.sh -> run_tests.py
2021-10-13 04:07:41 +02:00