Mike Fährmann
6c9dff1e29
[docs/options] add Table of Contents
2026-01-27 19:27:40 +01:00
SubmarineScurvy
ef8f2869e7
[listal] add 'image' & 'people' extractors ( #1589 #8921 )
...
* listal extractor
* add listal to init
* fix flake8 & formatting & extractor names/subcategories
* remove 're' import
* remove 'datetime' import
* update & simplify extractors
* update supportedsites
* add tests
---------
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de >
2026-01-27 18:26:41 +01:00
Mike Fährmann
eaaa25b6e4
[job] enable all 'parent-…' options for parent extractors by default
...
- parent-directory
- parent-metadata
- parent-session
- parent-skip
- add general 'parent' option
2026-01-27 12:05:19 +01:00
Mike Fährmann
b67e3c15ff
[xenforo] support 'titsintops.com' ( #8945 )
2026-01-27 10:31:26 +01:00
Mike Fährmann
93bf4ccc18
merge #8928 : [mangafreak] add support
2026-01-25 19:52:34 +01:00
Mike Fährmann
7026611f31
merge #8925 : [mangatown] add support
2026-01-25 18:35:39 +01:00
Duy Nguyen
8b0e8c656d
feat(mangafreak): add support for MangaFreak
...
Add chapter and manga extractors for ww2.mangafreak.me with support
for bonus chapters (e.g., 167e suffix).
2026-01-25 15:56:52 +01:00
Mike Fährmann
adca123646
[weibo:user] add 'subalbums' include ( #8792 )
2026-01-25 11:16:41 +01:00
Duy Nguyen
9f2d5cbd5d
docs: add mangatown to supported sites
2026-01-25 00:04:23 +01:00
Mike Fährmann
1530778bfb
merge #8917 : [kaliscan] add support
2026-01-23 21:04:48 +01:00
Duy Nguyen
5c71993e0b
docs: add kaliscan to supported sites
2026-01-23 20:29:24 +01:00
Mike Fährmann
e93cfa3348
[twitter] implement '"ratelimit": "abort:N"' ( #5251 #8864 )
2026-01-23 19:54:28 +01:00
Mike Fährmann
f869085476
[weebdex] add 'data-saver' option ( #8914 )
2026-01-23 09:22:41 +01:00
Mike Fährmann
fb0d639f68
[xenforo] add 'media-album' extractor ( #8902 )
2026-01-22 09:10:31 +01:00
Mike Fährmann
18fabb9605
[batoto] remove module ( #8908 )
...
"Bato.to has shut down."
There are mirror sites, but they are unscrapeable
due to heavily obfuscated HTML and JS
2026-01-21 20:33:08 +01:00
Mike Fährmann
4798ac4836
[common] implement 'parent-session'
2026-01-21 20:33:08 +01:00
Mike Fährmann
9ca45aae73
[nitter] re-add instances
2026-01-21 20:32:58 +01:00
Mike Fährmann
63df6423bf
[nitter] use 'gallery-dl/<version>' User-Agent ( #7045 #8130 #8409 )
2026-01-21 18:07:47 +01:00
Mike Fährmann
78da7edde8
[common] add 'googlebot' User-Agent preset
2026-01-21 17:57:26 +01:00
brerk
e00c717b15
[turbo] update 'saint' extractors ( #8893 #8896 )
...
* Implements turbo.py & remove from domain pattern from saints.py
* Remove leftover commented pattern from saints.py
* Make turbo.py comply with flake8
* Add album support
* Improved metadata extracion for albums and single files & created turbo.py tests using saints.py test
* Align turbo.py extractor with flake8 rules
* Fix #class name on turbo.py tests
* Fix #category test
* Fix #category test x2
* Fix #category tests
* Fix #category tests
* Fix TurboMediaExtractor self.groups unpacking
* update basic module formatting
* replace 'saint' with 'turbo' in modules list
* remove saint extractors and tests
* update & simplify 'media' extractor
* update & simplify 'album' extractor
* update tests
* update supportedsites
* update 'category-map' & 'config-map'
---------
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de >
2026-01-19 22:20:13 +01:00
Mike Fährmann
cc5bfa6eb0
[xenforo] support 'celebforum.to' ( #8902 )
2026-01-19 16:04:33 +01:00
Mike Fährmann
254bb4505c
[chevereto] implement password support
2026-01-16 09:33:55 +01:00
Stephon Parker
43387c535d
[thefap] add support ( #8821 #8822 )
...
* adding site support for thefap.com
* fixing typo in url tld
* improve & simplify 'model' extractor
* update 'post' extractor
* update docs/supportedsites
* add tests
---------
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de >
2026-01-14 21:11:56 +01:00
Mike Fährmann
fea4f4c30b
[pixeldrain:album] add 'zip' option
2026-01-14 12:03:52 +01:00
Mike Fährmann
29e8440ec4
[formatter] add 'format-operator-dot' option
...
to allow disabling the behavior introduced in commit
a79a945494
2026-01-13 22:25:37 +01:00
Mike Fährmann
d7c1c30c62
[booth] add 'category' extractor ( #8867 )
2026-01-11 22:17:01 +01:00
camellia2077
084a6d73e0
[bilibili] add support for Live Photo (video) downloads ( #8860 )
...
* bilibili: add support for live photo downloads
* fix: resolve flake8 linting errors (whitespace and line length)
* fix: resolve flake8 E302 and W293 linting errors
* fix: resolve flake8 W293 and E302 linting errors
* simplify syntax
* add 'livephoto' option
* add tests
2026-01-10 19:27:34 +01:00
Mike Fährmann
7e513f35f2
[wikimedia] use 'gallery-dl/<version>' User-Agent ( #8770 #8861 )
2026-01-10 18:08:13 +01:00
Mike Fährmann
76930ad44c
[saint] support 'turbovid.cr' URLs ( #8851 )
2026-01-10 18:08:13 +01:00
Mike Fährmann
bb7d540c7a
[xenforo] add 'media-category' extractor ( #8785 )
2026-01-10 18:08:05 +01:00
Mike Fährmann
60104f20af
[xenforo] implement 'media' support ( #8785 )
...
add 'media-user' and 'media-item' extractors
TODO: 'media-category' extractor (?)
2026-01-09 21:21:19 +01:00
Mike Fährmann
b1a708beb9
[weibo:album] implement 'subalbum' support ( #8792 )
...
https://weibo.com/u/USER?tabtype=album-1
https://weibo.com/u/USER?tabtype=album-NAME
https://weibo.com/u/USER?tabtype=album-all
https://weibo.com/u/USER?tabtype=album-only
2026-01-07 19:23:54 +01:00
Mike Fährmann
6cc7153b6c
[webtoons] extend 'bgm' option ( #8733 )
...
allow remuxing bgm audio into a different format/container
2026-01-06 21:53:16 +01:00
Mike Fährmann
cf96fc6ebe
[koofr] refactor ( #8803 )
...
https://github.com/mikf/gallery-dl/issues/8803#issuecomment-3708215475
https://github.com/mikf/gallery-dl/issues/8803#issuecomment-3708358606
- add 'recursive' option, remove 'zip'
- recurse into subdirectories
- add 'path' metadata
- remove 'count' & 'num' metadata
- update default directory & archive format
2026-01-06 21:52:58 +01:00
Mike Fährmann
2cfe2b3b04
[common] implement '"user-agent": "+PRESET"'
...
support using a 'User-Agent' header preset, e.g. "+firefox"
2026-01-03 21:07:45 +01:00
Mike Fährmann
fcf6f05a0d
[koofr] implement 'zip' option ( #6582 #8700 )
...
Download individual files instead of '.zip' bundle by default.
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3679504391
2026-01-01 19:13:31 +01:00
Mike Fährmann
5e94bae906
[pixiv] support 'sketch' include ( #8789 )
2026-01-01 10:49:41 +01:00
Mike Fährmann
8792d7faea
[whyp] add support ( #8725 )
2025-12-31 18:58:33 +01:00
Mike Fährmann
add9fbc13b
[manganelo] add 'bookmark' extractor ( #8776 )
2025-12-31 11:06:08 +01:00
Mike Fährmann
239de3f092
[civitai] update 'quality-videos' default ( #8787 )
...
from "quality=100" to "original=true,quality=100"
to prevent a server timeout / error
2025-12-31 09:56:39 +01:00
Mike Fährmann
51c155df94
[yourlesbians] add 'album' extractor ( #8713 )
2025-12-30 20:33:50 +01:00
CasualYouTuber31
a6c845bdc8
[tiktok] remove yt-dlp dependency & add support for more post types ( #8715 )
...
#7246 #8035 #8466 #8730
* [tiktok] support extracting videos directly without yt-dlp
* [tiktok] support extracting users directly without yt-dlp
* [tiktok] fixing logic, tests, linting errors
* [tiktok] implement tiktok-range support for non-yt-dlp user extractor
* [tiktok] Skip range filter if no ranges are given
* [tiktok] Remove debug code
* [tiktok] only check for faulty device IDs during the first couple of passes
I think the original yt-dlp solution assumes that if a device ID works once, it will always work.
Plus, my approach would cause needless retries in certain cases if hasMorePrevious does end up being wrong like the original algorithm accounts for. So let's copy the original algorithm here, too.
* [tiktok] support stories
* [tiktok] you can now extract audio without extracting photos
* [tiktok] add TiktokFollowingExtractor
* [tiktok] update supportedsites to include stories
* [tiktok] Keep tiktok-range option for no content user account test
It acts as a nice guard against that account suddenly having lots of posts to extract
* [tiktok] TiktokUserExtractor and TiktokFollowingExtractor rewrite
* [tiktok] Fix avatar naming convention to match that of posts
* [tiktok] remove type hints for compatibility with older Python versions
* [tiktok] Improve performance of TiktokFollowingExtractor
This was largely achieved using the story/batch/item_list endpoint
* [tiktok] Forgot to run flake8
* [tiktok] remove old constant
* [tiktok] Support order-posts config item
* [tiktok] flake8
* [tiktok] Older Python versions don't support match
* [tiktok] always ask for posts in chronological order when in "desc" mode
We should aim to avoid having pinned posts returned before non-pinned ones
* [tiktok] Add liked posts extraction
* [tiktok] Add reposts extraction
* [tiktok] Add saved posts extraction
* cleanup imports
* remove '# MARK:' comments
* remove & simplify 'except' statements
KeyboardInterrupt & SystemExit inherit from BaseException (not Exception)
and therefore don't need special handling
* split 'user' extractor
* move PATTERNs into their respective functions
* use dict comprehensions
* add only-matching test URLs for split user extractors
* update config docs
rename 'tiktok-user-extractor' to 'ytdl'
* document '"popular"' 'order-posts' value
* inline and remove 'util.chunk()'
2025-12-30 17:17:57 +01:00
Mike Fährmann
c2917ad5c5
[ahottie] add aupport ( #8710 )
2025-12-29 18:47:10 +01:00
Mike Fährmann
4f535ec606
[imgpv] add 'image' extractor ( #8773 )
2025-12-28 21:36:06 +01:00
Mike Fährmann
daf6cc2c78
[twitter] add 'notifications' extractor ( #7974 )
2025-12-26 18:06:00 +01:00
Mike Fährmann
c384cd06c2
[fansly] add 'previews' option ( #8686 )
2025-12-25 20:25:47 +01:00
Mike Fährmann
01fe6870a3
[fansly] disable 'formats' check by default ( #8757 )
...
should allow downloading and selecting the highest resolution video format
regardless of its 'type' / format code
2025-12-25 19:15:21 +01:00
Mike Fährmann
cc8cd78103
[webtoons] download episode background music ( #8733 )
...
add 'bgm' option
2025-12-23 19:08:30 +01:00
Mike Fährmann
2be54be692
[subscribestar] merge 'user-tag' into regular 'user' extractor ( #8737 )
2025-12-23 18:58:25 +01:00
Mike Fährmann
c3ef760a9f
[discord] add 'server-assets' extractor ( #8589 )
2025-12-22 21:08:33 +01:00
