28 Commits

Author SHA1 Message Date
Mike Fährmann
968597a302 yield 3-tuples for Message.Directory
adapt tuples to the same length and semantics as other messages
2025-12-05 21:39:52 +01:00
Mike Fährmann
085616e0a8 [dt] replace 'text.parse_datetime()' & 'text.parse_timestamp()' 2025-10-17 17:43:06 +02:00
Mike Fährmann
f2a72d8d1e replace 'request(…).json()' with 'request_json(…)' 2025-06-29 17:50:19 +02:00
Mike Fährmann
9dbe33b6de replace old %-formatted and .format(…) strings with f-strings (#7671)
mostly using flynt
https://github.com/ikamensh/flynt
2025-06-29 17:50:19 +02:00
Mike Fährmann
dba45923c8 [dl:http] fail downloads with HTML content (#7697)
add 'validate-html' option
2025-06-20 14:34:40 +02:00
Mike Fährmann
41191bb60a 'match.group(N)' -> 'match[N]' (#7671)
2.5x faster
2025-06-18 13:05:58 +02:00
Mike Fährmann
e41c317039 [fantia] prevent '.html' file downloads 2025-06-12 20:41:47 +02:00
Mike Fährmann
91e20eb59b [fantia] simplify 'tags' to a list of strings (#4752) 2023-11-02 15:25:01 +01:00
Mike Fährmann
830a48bca4 [fantia] bad workaround for 833dce14 (#4627)
at least this makes "filter": "content_num == content_count+1"
with "event": "post-after" work
2023-10-13 23:04:47 +02:00
Mike Fährmann
833dce141f [fantia] add 'content_count' and 'content_num' metadata fields (#4627) 2023-10-13 20:10:55 +02:00
Mike Fährmann
3ecb512722 send Referer headers by default 2023-09-19 00:02:04 +02:00
Mike Fährmann
a453335a9f remove test results in extractor modules
and add generic example URLs
2023-09-11 16:30:55 +02:00
Mike Fährmann
c79359eb3a [fantia] improve metadata extraction (#4126)
extract all metadata and URLs before starting to download
2023-07-31 22:31:50 +02:00
Mike Fährmann
d97b8c2fba consistent cookie-related names
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
2023-07-22 01:20:50 +02:00
Mike Fährmann
384337d3dd [fantia] send 'X-Requested-With' header only for API requests (#4273) 2023-07-07 15:16:18 +02:00
Mike Fährmann
c2ac665ff7 [fantia] send 'X-Requested-With' header (#4273) 2023-07-06 19:03:53 +02:00
Mike Fährmann
ef9891ec9d [fantia] extract 'plan' metadata (#2477, #4128) 2023-06-16 15:43:07 +02:00
Mike Fährmann
f8452984fa [fantia] emit warning for non-visible contents (#4128) 2023-06-16 15:40:59 +02:00
Mike Fährmann
dc7af00014 [fantia] refactor
- embed response data as hidden '_data' field
  (instead of returning/passing 'resp')
- split _get_urls_from_post()
2023-06-15 20:11:54 +02:00
Mike Fährmann
dd884b02ee replace json.loads with direct calls to JSONDecoder.decode 2023-02-09 15:22:00 +01:00
Mike Fährmann
0d818d3540 [fantia] send 'X-CSRF-Token' headers (#3576) 2023-01-27 16:18:57 +01:00
Mike Fährmann
e64c2b85d0 [fantia] apply patch (#2381)
from @thatfuckingbird with small adjustments

https://github.com/mikf/gallery-dl/issues/2381#issuecomment-1063208696
2022-03-11 18:02:31 +01:00
Orkun Koçyiğit
eb2bb7d998 [fantia] add 'num' enumeration index (#2377)
* Adding numerical ordering to fantia

* Fixed line to fit PEP8 line size limit
2022-03-08 22:06:41 +01:00
Mike Fährmann
9a25534490 use Extractor._check_cookies() for all cookie checks 2021-12-16 02:21:16 +01:00
Mike Fährmann
e4684c5cb9 [desktopography] simplify (#1740) 2021-09-17 20:09:24 +02:00
Alice
9992ff38da [fantia] add 'date' metadata field (#1853) 2021-09-17 19:59:00 +02:00
Mike Fährmann
bd08ee2859 remove most 'yield Message.Version' statements
only leave them in oauth.py as noop results
2021-08-16 03:10:48 +02:00
thatfuckingbird
e47952ac14 add extractors for fantia and fanbox (#1459)
* add extractors for fantia and fanbox

* appease linter

* make docstrings unique

* [fantia] refactor post extraction

* [fantia] capitalize

* [fantia] improve regex pattern

* code style

* capitalize

* [fanbox] use BASE_PATTERN for url regexes

* [fanbox] refactor metadata and post extraction

* [fanbox] improve url base pattern

* [fanbox] accept creator page links ending with /posts

* [fanbox] more tests

* [fantia] improved pagination

* [fanbox] misc. code logic improvements

* [fantia] finish restructuring pagination code

* [fanbox] avoid making a request for each individual post when processing a creator page

* [fanbox] support embedded videos

* [fanbox] fix errors

* [fanbox] document extractor.fanbox.videos

* [fanbox] handle "article" and "entry" post types, all embeds

* [fanbox] fix downloading of embedded fanbox posts
2021-04-25 19:39:13 +02:00