Commit Graph

4712 Commits

Author SHA1 Message Date
Mike Fährmann
b480b7076a [paheal] fix a78f8ce5 for enabled 'metadata' (#4262) 2023-07-07 20:00:49 +02:00
Mike Fährmann
384337d3dd [fantia] send 'X-Requested-With' header only for API requests (#4273) 2023-07-07 15:16:18 +02:00
Mike Fährmann
c2ac665ff7 [fantia] send 'X-Requested-With' header (#4273) 2023-07-06 19:03:53 +02:00
Mike Fährmann
7444fc125b [gfycat] implement login support (#3770, #4271)
For the record: '/webtoken' and '/weblogin' are not the same ...
2023-07-06 18:56:34 +02:00
Mike Fährmann
e9b9f751bf [gfycat] support '@me' user (#3770, #4271) 2023-07-06 16:03:35 +02:00
Mike Fährmann
5b59a0d143 update default User-Agent header to Firefox 115 ESR 2023-07-05 15:12:50 +02:00
Mike Fährmann
0556e1ad45 merge #4268: [newgrounds] extract & pass auth token for login 2023-07-04 21:51:03 +02:00
Mike Fährmann
a16d7c59cb [newgrounds] access 'response.text' only once 2023-07-04 21:49:57 +02:00
Mike Fährmann
1bf9f52c99 [twitter] add 'ratelimit' option (#4251) 2023-07-04 18:17:32 +02:00
Mike Fährmann
f86fdf64a6 [twitter] use GraphQL search by default (#4264) 2023-07-04 17:55:22 +02:00
Mike Fährmann
1d4db83d49 [weibo] fix end of cursor based pagination 2023-07-04 17:41:22 +02:00
Mike Fährmann
a78f8ce5b0 [paheal] fix extraction (#4262)
swap ' and "
2023-07-04 17:36:41 +02:00
FrostTheFox
9576652fa5 extract & pass auth token for newgrounds 2023-07-04 02:35:48 -04:00
Mike Fährmann
5457007dd3 release version 1.25.7 2023-07-02 22:25:45 +02:00
Mike Fährmann
3d8de383bf [mangapark] extract 'source_id' for manga
forgot to add this to 6ae3101f
2023-07-02 15:17:10 +02:00
Mike Fährmann
6ae3101fd0 [mangapark] add 'source' option (#3969) 2023-07-02 15:07:22 +02:00
Mike Fährmann
c45a913bfd [flickr] add 'exif' option 2023-07-01 19:19:39 +02:00
Mike Fährmann
3845c0256d [sankaku] improve warnings for unavailable posts 2023-07-01 19:11:41 +02:00
Mike Fährmann
46cae04aa3 [piczel] update API server (#4244) 2023-06-30 17:19:53 +02:00
Mike Fährmann
3479646f65 [mangapark] update and fix 'manga' extractor (#3969)
TODO:
- non-English chapters
- 'source' option
2023-06-30 17:17:54 +02:00
Mike Fährmann
10786c657e [mangapark] update and fix 'chapter' extractor (#3969) 2023-06-29 23:44:44 +02:00
Mike Fährmann
9c31c2daef [poipiku] improve error detection (#4206) 2023-06-27 23:12:26 +02:00
Mike Fährmann
260ff55e19 [senmanga] ensure download URLs have a scheme (#4235) 2023-06-27 13:49:33 +02:00
Mike Fährmann
ccbc1a1d55 [flickr] add 'metadata' option (#4227) 2023-06-26 16:49:48 +02:00
Mike Fährmann
25c5a6ffcb no f-strings 2023-06-25 14:01:26 +02:00
Mike Fährmann
23469837cd attempt to fix file permission tests 2023-06-25 00:48:40 +02:00
Mike Fährmann
c1cce4a80b [twitter] extend 'conversations' option (#4211) 2023-06-24 21:34:34 +02:00
Mike Fährmann
b6c959744d [furaffinity] improve 'description' HTML (#4224)
- ignore header
- include footer and closing <div> if present
2023-06-24 20:30:40 +02:00
Mike Fährmann
8357acf359 [gelbooru_v01] replace 'extract_all()' with 'extract_from()'
It's even slightly faster, especially on Python before 3.11
2023-06-23 15:17:42 +02:00
Mike Fährmann
068aa26c3e [gelbooru_v01] fix '--range' (#4167) 2023-06-22 11:54:33 +02:00
Mike Fährmann
ec64cbefeb [postprocessor:exec] add tests 2023-06-21 23:54:35 +02:00
Mike Fährmann
3e7ac5ec3a check file mode bits
ensure every file in ./gallery_dl has mode 644
2023-06-19 17:53:40 +02:00
Mike Fährmann
f50b81d3e9 [docs] add novel-related keys to 'pixiv.include' (#4111) 2023-06-19 15:01:53 +02:00
Mike Fährmann
2052e7ce59 [hentaifox] fix titles containing '@' (#4201) 2023-06-18 20:01:33 +02:00
Mike Fährmann
92d98697b2 [wallhaven] update API error message 2023-06-18 20:00:34 +02:00
Mike Fährmann
a673998b1e release version 1.25.6 2023-06-17 15:27:09 +02:00
Mike Fährmann
339fcdb8ad [wallhaven] handle '429 Too Many Requests' errors (#4192)
- set 1.4s delay between API requests
  (WH allows 45 requests per minute)
- wait and retry on 429 errors
2023-06-17 13:47:00 +02:00
Mike Fährmann
ef9891ec9d [fantia] extract 'plan' metadata (#2477, #4128) 2023-06-16 15:43:07 +02:00
Mike Fährmann
f8452984fa [fantia] emit warning for non-visible contents (#4128) 2023-06-16 15:40:59 +02:00
Mike Fährmann
dc7af00014 [fantia] refactor
- embed response data as hidden '_data' field
  (instead of returning/passing 'resp')
- split _get_urls_from_post()
2023-06-15 20:11:54 +02:00
Mike Fährmann
6c8bf9a762 [pornhub] improve redirect handling (#4188) 2023-06-15 16:32:53 +02:00
Mike Fährmann
654267a335 [weibo] fix 'json' extension for some videos 2023-06-15 13:49:17 +02:00
Mike Fährmann
ce93c460a6 [formatter] implement 'H' conversion (#4164)
to remove HTML tags and unescape HTML entities
2023-06-15 13:07:51 +02:00
Mike Fährmann
deff3b434d [vipergirls] implement login support (#4166) 2023-06-13 21:05:09 +02:00
Mike Fährmann
db20a645c5 [vipergirls] use API endpoints (#4166) 2023-06-13 20:54:02 +02:00
Mike Fährmann
0b34a444e0 [pixiv:novel] only detect Pixiv embeds (#4175) 2023-06-13 18:58:35 +02:00
Mike Fährmann
9f1aee3884 [vipergirls] limit number of requests per second (#4166) 2023-06-10 17:57:04 +02:00
Mike Fährmann
21c75d03a3 merge #4133: [furaffinity] extract 'favorite_id' metadata 2023-06-09 16:37:52 +02:00
Mike Fährmann
5e3a1749c8 [furaffinity] simplify 'favorite_id' assignment 2023-06-09 16:35:59 +02:00
Mike Fährmann
ad882291d3 [instagram] fix retrieving '/tagged' posts (#4122)
reduce number of retrieved posts per API request from 50 to 20
2023-06-09 16:04:39 +02:00