github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,714 Commits 1 Branch 0 Tags
f6553ffd2f2fb515be35c50dae4e303fa252a954
Commit Graph

3460 Commits

Author SHA1 Message Date
Mike Fährmann
f6553ffd2f [twitter] simplify '_pagination_users' 
- remove 'stop' variable
- call 'cursor.startswith()' only once
 2023-07-10 14:39:09 +02:00
ActuallyKit
c321c773f2 make the code less ugly 2023-07-09 02:52:04 +07:00
ActuallyKit
a437a34bcf fix lint i guess? 2023-07-09 02:41:46 +07:00
ActuallyKit
6cbc434b54 Fix users pagination 2023-07-09 02:28:35 +07:00
Mike Fährmann
c2ac665ff7 [fantia] send 'X-Requested-With' header (#4273) 2023-07-06 19:03:53 +02:00
Mike Fährmann
7444fc125b [gfycat] implement login support (#3770, #4271) 
For the record: '/webtoken' and '/weblogin' are not the same ...
 2023-07-06 18:56:34 +02:00
Mike Fährmann
e9b9f751bf [gfycat] support '@me' user (#3770, #4271) 2023-07-06 16:03:35 +02:00
Mike Fährmann
5b59a0d143 update default User-Agent header to Firefox 115 ESR 2023-07-05 15:12:50 +02:00
Mike Fährmann
0556e1ad45 merge #4268: [newgrounds] extract & pass auth token for login 2023-07-04 21:51:03 +02:00
Mike Fährmann
a16d7c59cb [newgrounds] access 'response.text' only once 2023-07-04 21:49:57 +02:00
Mike Fährmann
1bf9f52c99 [twitter] add 'ratelimit' option (#4251) 2023-07-04 18:17:32 +02:00
Mike Fährmann
f86fdf64a6 [twitter] use GraphQL search by default (#4264) 2023-07-04 17:55:22 +02:00
Mike Fährmann
1d4db83d49 [weibo] fix end of cursor based pagination 2023-07-04 17:41:22 +02:00
Mike Fährmann
a78f8ce5b0 [paheal] fix extraction (#4262) 
swap ' and "
 2023-07-04 17:36:41 +02:00
FrostTheFox
9576652fa5 extract & pass auth token for newgrounds 2023-07-04 02:35:48 -04:00
Mike Fährmann
3d8de383bf [mangapark] extract 'source_id' for manga 
forgot to add this to 6ae3101f
 2023-07-02 15:17:10 +02:00
Mike Fährmann
6ae3101fd0 [mangapark] add 'source' option (#3969) 2023-07-02 15:07:22 +02:00
Mike Fährmann
c45a913bfd [flickr] add 'exif' option 2023-07-01 19:19:39 +02:00
Mike Fährmann
3845c0256d [sankaku] improve warnings for unavailable posts 2023-07-01 19:11:41 +02:00
Mike Fährmann
46cae04aa3 [piczel] update API server (#4244) 2023-06-30 17:19:53 +02:00
Mike Fährmann
3479646f65 [mangapark] update and fix 'manga' extractor (#3969) 
TODO:
- non-English chapters
- 'source' option
 2023-06-30 17:17:54 +02:00
Mike Fährmann
10786c657e [mangapark] update and fix 'chapter' extractor (#3969) 2023-06-29 23:44:44 +02:00
Mike Fährmann
9c31c2daef [poipiku] improve error detection (#4206) 2023-06-27 23:12:26 +02:00
Mike Fährmann
260ff55e19 [senmanga] ensure download URLs have a scheme (#4235) 2023-06-27 13:49:33 +02:00
Mike Fährmann
ccbc1a1d55 [flickr] add 'metadata' option (#4227) 2023-06-26 16:49:48 +02:00
Mike Fährmann
c1cce4a80b [twitter] extend 'conversations' option (#4211) 2023-06-24 21:34:34 +02:00
Mike Fährmann
b6c959744d [furaffinity] improve 'description' HTML (#4224) 
- ignore header
- include footer and closing <div> if present
 2023-06-24 20:30:40 +02:00
Mike Fährmann
8357acf359 [gelbooru_v01] replace 'extract_all()' with 'extract_from()' 
It's even slightly faster, especially on Python before 3.11
 2023-06-23 15:17:42 +02:00
Mike Fährmann
068aa26c3e [gelbooru_v01] fix '--range' (#4167) 2023-06-22 11:54:33 +02:00
Mike Fährmann
2052e7ce59 [hentaifox] fix titles containing '@' (#4201) 2023-06-18 20:01:33 +02:00
Mike Fährmann
92d98697b2 [wallhaven] update API error message 2023-06-18 20:00:34 +02:00
Mike Fährmann
339fcdb8ad [wallhaven] handle '429 Too Many Requests' errors (#4192) 
- set 1.4s delay between API requests
  (WH allows 45 requests per minute)
- wait and retry on 429 errors
 2023-06-17 13:47:00 +02:00
Mike Fährmann
ef9891ec9d [fantia] extract 'plan' metadata (#2477, #4128) 2023-06-16 15:43:07 +02:00
Mike Fährmann
f8452984fa [fantia] emit warning for non-visible contents (#4128) 2023-06-16 15:40:59 +02:00
Mike Fährmann
dc7af00014 [fantia] refactor 
- embed response data as hidden '_data' field
  (instead of returning/passing 'resp')
- split _get_urls_from_post()
 2023-06-15 20:11:54 +02:00
Mike Fährmann
6c8bf9a762 [pornhub] improve redirect handling (#4188) 2023-06-15 16:32:53 +02:00
Mike Fährmann
654267a335 [weibo] fix 'json' extension for some videos 2023-06-15 13:49:17 +02:00
Mike Fährmann
deff3b434d [vipergirls] implement login support (#4166) 2023-06-13 21:05:09 +02:00
Mike Fährmann
db20a645c5 [vipergirls] use API endpoints (#4166) 2023-06-13 20:54:02 +02:00
Mike Fährmann
0b34a444e0 [pixiv:novel] only detect Pixiv embeds (#4175) 2023-06-13 18:58:35 +02:00
Mike Fährmann
9f1aee3884 [vipergirls] limit number of requests per second (#4166) 2023-06-10 17:57:04 +02:00
Mike Fährmann
21c75d03a3 merge #4133: [furaffinity] extract 'favorite_id' metadata 2023-06-09 16:37:52 +02:00
Mike Fährmann
5e3a1749c8 [furaffinity] simplify 'favorite_id' assignment 2023-06-09 16:35:59 +02:00
Mike Fährmann
ad882291d3 [instagram] fix retrieving '/tagged' posts (#4122) 
reduce number of retrieved posts per API request from 50 to 20
 2023-06-09 16:04:39 +02:00
Mike Fährmann
0a9aaa7a8d [weibo] prevent fatal exception due to missing video (#4150) 2023-06-08 22:22:43 +02:00
Mike Fährmann
ac651c604c [senmanga] fix and update (#4160) 2023-06-08 22:18:43 +02:00
Mike Fährmann
df106fb58b [bunkr] fix video downloads 2023-06-08 17:21:37 +02:00
Mike Fährmann
aad5e6490c merge #4159: [bunkr] update domain to bunkrr.su 2023-06-08 17:02:54 +02:00
Mike Fährmann
e0522ffb3d [bunkr] update 2023-06-08 17:01:04 +02:00
Mike Fährmann
e04796e04b merge #3447: [jschan] add generic extractors for jschan imageboards 2023-06-08 16:52:26 +02:00