Commit Graph

6988 Commits

Author SHA1 Message Date
Mike Fährmann
efd7821075 merge #7952: [hentaifoundry] add 'descriptions' option 2025-08-02 17:30:38 +02:00
Mike Fährmann
afa720d3e0 [hentaifoundry] add 'html' description test case 2025-08-02 17:29:07 +02:00
Mike Fährmann
1fbc341e60 [facebook] ensure numeric 'user_id' values (#7953)
handle 'pfbid…' IDs
2025-08-02 10:28:41 +02:00
Mike Fährmann
491d70f918 [job] apply 'extension-map' to 'SimulationJob' results 2025-08-02 07:28:12 +02:00
Mike Fährmann
8a97a1dad0 [docs/options] update '-A' & '-T' descriptions
2eb5e52055
2025-08-01 23:31:14 +02:00
Mike Fährmann
9eb88905bc [comick] add 'lang' option (#7938) 2025-08-01 23:28:09 +02:00
Mike Fährmann
52ffe53315 [booth] use proper headers for JSON requests (#7920) 2025-08-01 23:27:48 +02:00
sarma-tyrant
12f56b888c Added to docs 2025-08-01 16:36:20 -04:00
sarma-tyrant
48e091ed71 Linting 2025-08-01 16:29:33 -04:00
sarma-tyrant
e75a4138c1 [hentai-foundry] Html description option 2025-08-01 16:08:43 -04:00
Mike Fährmann
df4f823f6e [booth] add 'strategy' option (#7920)
- extract file URLs from HTML webpages
- fix 'adult' cookie value
2025-08-01 21:21:41 +02:00
Mike Fährmann
328932d422 [tests/results] extend "len:…" to support generators
or general iterables without __len__
2025-08-01 20:42:20 +02:00
Mike Fährmann
7f414cdb4e [common] add 'interval' argument to 'request()'
to disable 'request_interval' sleeps for "background" requests
2025-08-01 20:40:20 +02:00
Mike Fährmann
9a50588792 [pixiv] fix 'IndexError' for unviewable works (#7940) 2025-08-01 17:59:39 +02:00
Mike Fährmann
8286476c4b [scrolller] limit 'title' length in default filenames 2025-08-01 17:40:59 +02:00
Mike Fährmann
380bd8eeec [scrolller] fix NSFW subreddit pagination (#7945) 2025-08-01 17:39:43 +02:00
Marcus Minhorst
65fbd3972d [picstate] add 'image' extractor (#7946) 2025-08-01 07:48:00 +02:00
missionfloyd
952fcb1b8b [xasiat] add support (#4161 #5929 #7934)
* [xasiat] Album extractor
* [xasiat] Tags, categories, Models
* [xasiat] Tests
* update 'album' extractor
    - provide 'album_id' metadata
    - use redirected 'album_url' value
    - update metadata extraction in general
* extend test result data
2025-07-30 19:38:33 +02:00
Mike Fährmann
3b93184997 [twitter] fix potential 'UnboundLocalError' (#7932)
this happens with Tweets containing both images and video
when 'videos' are disabled.
2025-07-30 16:45:48 +02:00
Mike Fährmann
e5c91d33ec [blogger] fix video extraction (#7892) 2025-07-30 16:45:29 +02:00
Mike Fährmann
206d3954f5 [wikimedia:wiki] fix "AttributeError: 'subcategories'" (#7931) 2025-07-30 08:13:33 +02:00
Mike Fährmann
a08144b77b [deviantart:tiptap] fix "KeyError: 'attrs'" (#7929) 2025-07-30 00:06:18 +02:00
Mike Fährmann
2eb5e52055 extend '-A / --abort' & '"skip": "abort"' functionality (#7891)
implement ascending by more than 1 level or
up to an extractor with a specific subcategory
2025-07-30 00:01:49 +02:00
Mike Fährmann
64de6605ce [job] improve URL 'scheme' extraction performance 2025-07-29 22:26:21 +02:00
Mike Fährmann
a0b96bf0d6 [booth] extract 'shop[id]' & 'shop[uuid]' metadata (#7920) 2025-07-29 20:16:58 +02:00
Mike Fährmann
78f81ee48a [booth] add 'shop' extractor (#7920) 2025-07-29 16:52:27 +02:00
Mike Fährmann
8aa2fe33d5 [booth] add 'item' extractor (#7920) 2025-07-29 16:52:27 +02:00
Mike Fährmann
a26d71c228 [cien] provide 'author['id']' metadata (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3131187851
2025-07-29 16:52:26 +02:00
Mike Fährmann
8d167610ac [instagram] warn about lower quality image downloads (#7921) 2025-07-29 16:52:26 +02:00
Mike Fährmann
3c4459c0a0 [docs/configuration] improve 'client-id' / 'api-key' instructions
- better align description format
- make http://localhost:6414/ clickable (#7905)
2025-07-29 16:52:26 +02:00
Mike Fährmann
64f6547aef [scripts/run_tests] use 'TestResult.wasSuccessful()' 2025-07-29 16:52:26 +02:00
Mike Fährmann
1f08f81e67 [scripts/pyprint] fix typo in list generation 2025-07-28 21:50:28 +02:00
Mike Fährmann
876df379f4 [scripts/init] add '-C' command-line option 2025-07-28 21:50:28 +02:00
Mike Fährmann
0a7546201c [scripts/pre-commit] detect debug 'elif' statements 2025-07-28 18:49:08 +02:00
Mike Fährmann
7faa46b90f [misskey] support 'misskey.art' (#7923) 2025-07-28 16:39:43 +02:00
Mike Fährmann
74573118f2 [dankefuerslesen:manga] fix metadata being overwritten 2025-07-28 15:36:32 +02:00
Mike Fährmann
b986edd1ed [dankefuerslesen] extract more metadata (#7915)
- author
- artist
- description
2025-07-28 10:43:13 +02:00
Mike Fährmann
15517ad45c release version 1.30.2 2025-07-27 19:57:22 +02:00
Mike Fährmann
013307af80 [itaku] add 'bookmarks' extractor (#7707) 2025-07-27 19:35:56 +02:00
Mike Fährmann
022f216217 [itaku] add 'posts' extractors (#7707) 2025-07-27 19:30:44 +02:00
Mike Fährmann
be975b7be1 [itaku] update 'items()' to be able to handle all result types 2025-07-27 16:34:04 +02:00
Mike Fährmann
b8fb9c061e [itaku] update API methods 2025-07-27 16:12:39 +02:00
CautiouslyKate
ed2d07181a [kemono] update extractor to use new domains (#7902 #7907 #7904)
* Update kemono.py
* Update coomer.py
* Update kemono.py
* Fixed TypeError
    - Fixed a regex mistake I made
* Make legacy domains resolve as current domains
* Update gallery_dl/extractor/kemono.py
* remove legacy .su domain support
* fixed accidental regex change
* update docs/supportedsites
* update test results
    - (re)add legacy domain URLs
    - update URL pattern TLDs
* restore support for '.su' TLDs

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-07-27 10:10:35 +02:00
cenodis
8b6fffe866 [pp:exec] use 'False' as default for 'start_new_session' to avoid TypeError (#7899)
in Python <= 3.11

* Use False as default instead of None to avoid TypeError
* Update postprocessor tests
2025-07-27 09:41:27 +02:00
Mike Fährmann
c3d385bce0 [scripts/pyprint] support datetime objects 2025-07-27 09:37:46 +02:00
Mike Fährmann
07af386700 [scripts/pyprint] support sets 2025-07-27 09:37:46 +02:00
Mike Fährmann
14c29fe3e0 [scripts/pyprint] restructure dict/list handling 2025-07-27 09:37:46 +02:00
Mike Fährmann
11127726e4 [scripts/pyprint] update maxlen selection
- consider only values smaller than 'lmax' instead of taking the max of
  all lengths and trimming that
- remove 'lmin'
2025-07-27 09:37:45 +02:00
Mike Fährmann
9872a9eae3 [tests/postprocessor] fix 'TypeError' when logging an error (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3121493719
2025-07-27 09:37:06 +02:00
Mike Fährmann
31de2e8299 release version 1.30.1 2025-07-26 09:52:41 +02:00