Commit Graph

6454 Commits

Author SHA1 Message Date
Mike Fährmann
c4d08b24e9 [pinterest] ignore 'story_pin_static_sticker_block' blocks (#7251) 2025-03-28 20:20:29 +01:00
Mike Fährmann
e0211bdaa5 merge #7261: [deviantart] support multiple images for single posts
(#6653)
2025-03-28 17:26:48 +01:00
Mike Fährmann
677c187800 [deviantart] add multi-file test 2025-03-28 17:19:31 +01:00
Mike Fährmann
1e498a04f3 [deviantart] update
- use 'index_file' for additional file IDs
- rename 'img_count' to 'count'
- update 'archive_fmt'
2025-03-28 17:15:56 +01:00
Mike Fährmann
8bfb5054c1 merge #7191: [tiktok] add retry mechanism to rehydration data extraction 2025-03-28 16:42:36 +01:00
Mike Fährmann
e381c482ec [sexcom] extract 'date_url' metadata (#7239) 2025-03-28 16:30:12 +01:00
Bishop Red
af23894911 Fixing formatting of a line that is too long 2025-03-27 21:44:36 -06:00
Bishop Red
a854d6060e Removing a test flag (is_downloadable) to true. 2025-03-27 21:41:46 -06:00
Bishop Red
3cbb88b4b5 Adding support for the Multi Image Gallery 2025-03-27 21:40:53 -06:00
Bishop Red
17c1badb78 Adding support for the Multi Image Gallery 2025-03-27 21:34:15 -06:00
Mike Fährmann
6b4cd1b4d4 [util] update auto Firefox version 2025-03-27 21:56:55 +01:00
Mike Fährmann
d4ce8be1f5 [sexcom] support new-style '/videos' URLs (#7239) 2025-03-27 21:56:06 +01:00
Mike Fährmann
c6bc46f5ba [sexcom] support new-style '/gifs' URLs (#7239) 2025-03-27 20:01:57 +01:00
Mike Fährmann
12327b076e [sexcom] fix 'gif' pin extraction (#7239)
with much less metadata
2025-03-27 19:54:17 +01:00
Mike Fährmann
fc868b02f6 [sexcom] remove constructors 2025-03-27 19:05:44 +01:00
Mike Fährmann
7ccf64596e [mastodon] support '/statuses' URLs (#7255)
- /statuses/123456789
- /users/USER/statuses/123456789
2025-03-27 18:32:04 +01:00
Mike Fährmann
fcf76bab55 [instagram] download videos from 'video_dash_manifest' data
(#6379 #7006)

requires yt-dlp / youtube-dl
2025-03-27 18:27:37 +01:00
Mike Fährmann
81a1b647bb [dl:ytdl] support processing inline HLS/DASH manifests (#6379 #7006) 2025-03-26 22:41:40 +01:00
Mike Fährmann
6894e0bc70 [arcalive] extend 'gifs' option
use fallback URLs by default
2025-03-26 20:59:18 +01:00
Mike Fährmann
24bbcbcfa3 [danbooru] add 'favgroup' extractor 2025-03-26 20:58:49 +01:00
Mike Fährmann
93675b8e97 [skeb] make exceptions when extracting posts non-fatal (#7250) 2025-03-26 12:35:38 +01:00
Mike Fährmann
a3a61317d6 [kemonoparty:discord] look up 'channel_name' when missing (#7245) 2025-03-26 11:33:32 +01:00
Mike Fährmann
32a06961ba [mangapark] support v3 URLs (#2072) 2025-03-25 20:01:45 +01:00
Mike Fährmann
ebf05e53fe [mangapark] support mirror domains 2025-03-25 19:37:26 +01:00
Mike Fährmann
03c87b71ca [nozomi] fix extractors (#7242)
update internal domains to 'gold-usergeneratedcontent.net'
2025-03-25 16:54:15 +01:00
Mike Fährmann
0ffef58779 merge #7232: [mangapark] fix extractors (#4999 #5883 #6507 #6908) 2025-03-24 20:36:18 +01:00
vonProteus
58e7808bbb [mangapark] utilizing more graphql and adjust functionality for new site (#4999)
- undo formatting changes
- simplify code
- update and fix tests
2025-03-24 20:34:23 +01:00
Mike Fährmann
e1aabf01e4 merge #7220: [deviantart] add subfolder support (#4988 #7185) 2025-03-24 18:43:11 +01:00
Mike Fährmann
7a6899c647 [imhentai] support 'hentaienvy.com' and 'hentaizap.com' (#7192 #7218)
and move 'hentaifox' support to this module as well
2025-03-24 15:33:19 +01:00
Mike Fährmann
b3500b41dd [bunkr] fix filename extraction (#7237) 2025-03-24 13:25:33 +01:00
Mike Fährmann
fd8f652490 [hitomi] fix extractors (#7230) 2025-03-23 20:32:27 +01:00
Mike Fährmann
5bceb0eb27 [deviantart] add 'subfolder' tests 2025-03-23 17:59:56 +01:00
Mike Fährmann
b52c21186b [deviantart] add 'subfolders' option 2025-03-23 17:58:58 +01:00
Mike Fährmann
ffdec0cc04 [deviantart] match subfolders by name 2025-03-23 17:41:42 +01:00
Mike Fährmann
9a64c3d5fd [deviantart] update code formatting 2025-03-23 17:41:26 +01:00
Mike Fährmann
b20777e68b [bbc] extract more metadata (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-2745905375

- title
- title_image
- description
- synopsis
2025-03-23 15:20:12 +01:00
Mike Fährmann
62f9335b82 [kemonoparty] use '"type": "archive"' for 'archives' files (#7195) 2025-03-23 15:07:15 +01:00
Mike Fährmann
4a74bc6e30 [kemonoparty] extract 'archives' metadata (#7195)
add 'archives' option for additional data
2025-03-22 18:38:21 +01:00
Mike Fährmann
63a1052970 [aes] simplify 'block_count' calculation
abfb3e2277
2025-03-22 13:40:41 +01:00
Mike Fährmann
af57ab3233 [subscribestar] detect redirects to '/age_confirmation_warning' pages 2025-03-22 11:42:50 +01:00
Mike Fährmann
4807bc215c [subscribestar] extract 'title' metadata (#7219) 2025-03-22 09:46:08 +01:00
Bishop Red
3973481460 Merge pull request #2 from BishopRed90/DA_Subfolder_Support
[DeviantArt] Adding support for sub-folders
2025-03-21 22:54:02 -06:00
Bishop Red
e454ded442 Adding functionality for subfolder support from Deviant Art 2025-03-21 22:39:06 -06:00
Mike Fährmann
f8ef9a7b35 [kemonoparty] enable 'username'/'user_profile' metadata by default 2025-03-21 20:01:06 +01:00
CasualYT31
685660bcb1 [tiktok] Don't skip last retry 2025-03-19 19:21:33 +00:00
CasualYT31
7b791405b6 [tiktok] Address review comments on _extract_rehydration_data() 2025-03-19 19:14:02 +00:00
CasualYT31
d6d2b1fba0 [tiktok] Queue links from user profiles instead of returning a list of links
[tiktok] Move avatar download to the user extractor, which results in more accurate metadata output (it would previously write the metadata of the video which the avatar was scraped from)
[tiktok] Fix tests and remove redundant user profile test
2025-03-19 18:50:06 +00:00
Mike Fährmann
070b75aa82 [patreon] do not match '/messages' URLs as creators (#7187) 2025-03-18 22:07:44 +01:00
Mike Fährmann
a6b8569037 [tests] implement expected failures 2025-03-18 21:48:17 +01:00
Mike Fährmann
d4915900ed [patreon] include subdomains in 'session_id' cookie check (#7188) 2025-03-18 15:00:48 +01:00