Mike Fährmann
4fd6da474f
merge #3473 : [twitter] fix crash when using 'expand' and 'syndication'
2023-01-05 14:19:47 +01:00
Mike Fährmann
a918ce29b5
run tests on ubuntu-20.04
...
and remove Python 3.4, since that's no longer available
on this test runner
2023-01-05 13:33:27 +01:00
Mike Fährmann
6514828d4e
emit debug logging message when loading cookies from file
2023-01-05 12:40:22 +01:00
Mike Fährmann
3a238fd490
[poipiku] warn about login requirements
2023-01-05 12:29:31 +01:00
Mike Fährmann
fa144f38ed
[ytdl} fix dfe4f00c for legacy yt-dlp
2023-01-04 21:42:22 +01:00
Mike Fährmann
f29ba089ff
merge #3474 : [fanleaks] add 'post' and 'model' extractors
2023-01-04 17:39:17 +01:00
Mike Fährmann
6933727b45
merge #3483 : [twitter] implement 'syndication=extended'
2023-01-04 17:36:17 +01:00
Mike Fährmann
07ed3a1fbf
merge #3460 : [poipiku] fix extraction for a different warning button style
...
(#3493 , #3492 )
2023-01-04 17:29:27 +01:00
Mike Fährmann
9116398c1c
[pinterest] add 'domain' option ( #3484 )
...
use input URL domain by default
2023-01-04 17:20:14 +01:00
Mike Fährmann
6f6af36cad
use double quotes for --help examples
2023-01-04 14:30:27 +01:00
Mike Fährmann
dfe4f00ca2
[ytdl] update for yt-dlp changes
2023-01-04 13:12:24 +01:00
blankie
2f985bcddb
[poipiku] fix extraction for a different warning button style
2023-01-04 08:28:31 +07:00
Mike Fährmann
294108c90a
[pinterest] support 'All Pins' boards ( #2855 , #3484 )
2023-01-03 19:11:20 +01:00
Mike Fährmann
77df8d3116
[deviantart] implement username&password login for scraps ( #1029 )
...
re-login when getting prematurely logged out by dA
is missing at the moment
2023-01-03 18:42:28 +01:00
Mike Fährmann
ed2d715019
fix 'keywords' in extractor tests ( #3491 )
2023-01-03 15:14:23 +01:00
Mike Fährmann
3f29b8fe91
[cookies] convert browser names to lowercase
2023-01-03 14:58:48 +01:00
ClosedPort22
6853b14be3
[twitter] apply suggestions from code review
...
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de >
2023-01-02 21:03:01 +08:00
Mike Fährmann
4611237f8c
merge #3457 : [danbooru] extract uploader metadata (if option is set)
2023-01-01 21:20:39 +01:00
Mike Fährmann
e7522482bb
merge #3463 : [lynxchan] support 'bbw-chan.nl'
2023-01-01 15:50:09 +01:00
Mike Fährmann
7d6c846176
[fanbox] return 'imageMap' files in order ( #2718 )
2023-01-01 15:12:05 +01:00
Mike Fährmann
dc8e7ff54e
[bunkr] fix URLs returned by API ( #3481 )
2023-01-01 14:07:15 +01:00
enduser420
5fedef3a1a
[fanleaks] update 'model' URL pattern
2022-12-30 19:29:55 +05:30
enduser420
5a740ef78b
[fanleaks] add 'post' and 'model' extractors
2022-12-30 19:24:05 +05:30
ClosedPort22
7c8eab8d52
[twitter] implement 'syndication=extended'
...
to be able to fetch extended user metadata
2022-12-30 20:48:41 +08:00
ClosedPort22
be3286206a
[twitter] assume 'conversation_id' when using syndication
...
not possible to expand replies at the momemt
2022-12-30 13:57:37 +08:00
ClosedPort22
ce8dbb1ccc
[twitter] fix crash when using 'expand' and 'syndication'
...
caused by KeyError: 'conversation_id_str'
2022-12-30 12:45:44 +08:00
Mike Fährmann
d651d45239
implement specifying ranges in slice notation ( #918 , #2865 )
...
e.g.
- '1:101' or ':101' or ':101:' for files 1 to 100
- '1::2' or '::2' for every second file
- '1:101:5' or ':101:5' for files 1, 6, 11, ..., 91, 96
(the second argument specifies the first index NOT included)
2022-12-27 18:21:12 +01:00
Mike Fährmann
3616adfc75
implement '--range' with Python ranges
2022-12-26 18:32:34 +01:00
enduser420
527bb2c4ab
[lynxchan/bbw-chan] add 'thread' and 'board' extractors
2022-12-26 20:59:42 +05:30
blankie
f82ee93676
[danbooru] extract uploader metadata (if metadata is set)
2022-12-25 11:00:59 +07:00
Mike Fährmann
1800bd7d14
allow '*-filter' options to be a list of expressions
2022-12-23 22:20:21 +01:00
Mike Fährmann
73ab5d84c0
update docs/configuration.rst
2022-12-20 17:30:46 +01:00
Mike Fährmann
2d7d80d302
release version 1.24.2
2022-12-18 14:41:03 +01:00
Mike Fährmann
bee354c264
Merge pull request #3415 from enduser420/extractor/fapello
...
[fapello] add 'post', 'user' and 'path' extractors
2022-12-17 20:05:46 +01:00
Mike Fährmann
8d7585534e
Merge pull request #3367 from the-blank-x/deviantart-view
...
[deviantart] add /view URL support
2022-12-17 20:05:35 +01:00
blankie
6614d94b08
[deviantart] add /view URL support
2022-12-17 23:27:55 +07:00
Mike Fährmann
dd6eeb4336
Merge pull request #3366 from ClosedPort22/da-extra-stash
...
[deviantart] extract sta.sh URLs from `text_content`
2022-12-17 15:42:12 +01:00
Mike Fährmann
f36cbb3911
Merge pull request #3413 from ClosedPort22/e621-manual-pagination
...
[e621] implement manual pagination
2022-12-17 15:42:00 +01:00
ClosedPort22
dd4a4a3fa6
[e621] softcode the pagination threshold
2022-12-17 21:06:47 +08:00
ClosedPort22
9faa4ed738
[e621] refactor pagination control
...
as suggested by @mikf
2022-12-17 20:05:34 +08:00
Mike Fährmann
7851a2c520
[seiga] raise error when redirected to login page ( #3401 )
2022-12-17 12:52:17 +01:00
Mike Fährmann
68ce5f965d
[instagram] remove unused code
2022-12-17 12:52:17 +01:00
Mike Fährmann
4063563cd7
[zerochan] update for layout v3
...
- remove cookie disabling v3
- fix and improve metadata extraction
2022-12-17 12:51:51 +01:00
Mike Fährmann
1e6407ca98
Merge pull request #3414 from pubak42/master
...
[sex.com] Download videos from cdn (#3408 )
2022-12-17 12:30:34 +01:00
ClosedPort22
bf1649dadb
[imgur] add support for imgur.io URLs
2022-12-17 14:33:44 +08:00
enduser420
7e08e2d982
[fapello] set 'filename_fmt'
2022-12-16 20:57:39 +05:30
enduser420
e5076ba056
[fapello] add 'post', 'user' and 'path' extractors
2022-12-16 16:53:32 +05:30
pubak42
e7326cdf1d
[sex.com] Download videos from cdn ( #3408 )
...
The format of video sources was changed recently to be a full URL with https:// in the beginning.
The original extractor code appended the video source URL to root url of the website, thus yielding
invalid url in format ...sex.comhttps... that failed to resolve.
2022-12-16 10:16:40 +01:00
ClosedPort22
d0ad6d0e67
[e621] implement manual pagination mode
2022-12-16 16:15:36 +08:00
Mike Fährmann
6f0735568c
[2chen] fix file URLs
2022-12-15 18:05:32 +01:00