Commit Graph

4243 Commits

Author SHA1 Message Date
Mike Fährmann
d1dd52349a merge #3189: [tcbscans] add 'chapter' and 'manga' extractors 2023-01-06 13:42:27 +01:00
Mike Fährmann
ac78712618 merge #3496: [docs] update OAuth guide in README.rst 2023-01-06 13:36:23 +01:00
Mike Fährmann
2f31d21509 merge #3455: [twitter] apply tweet type checks before uniqueness check 2023-01-06 13:32:50 +01:00
Mike Fährmann
64435cc37e [twitter] update docs 2023-01-06 13:32:08 +01:00
Mike Fährmann
b125fcafc5 update docs/configuration.rst
- document metadata.indent
- add concrete mappings to object types
- fix lists for code examples
- fix typos
2023-01-06 13:07:33 +01:00
enduser420
e8541a131d [tcbscans] add 'chapter' and 'manga' extractors 2023-01-06 16:16:31 +05:30
Mike Fährmann
3c03928d75 simplify 'docs/options.md' generation
use the plain text output from '--help'
instead of trying to generate 'fancy' HTML with Markdown restrictions
2023-01-06 11:21:47 +01:00
Mike Fährmann
9695c4e88d emit debug logging message when loading cookies from file
attempt nr. 2
no idea how I managed to remove 6514828d in a918ce29
2023-01-06 11:13:44 +01:00
ClosedPort22
c94692f39b [docs] document 'access-token' for Mastodon instances 2023-01-06 13:20:41 +08:00
Mike Fährmann
30a31836e7 merge #3449: [twitter] force HTTPS for TwitPic URLs 2023-01-05 14:57:03 +01:00
Mike Fährmann
e18482e9ae [twitter] improve 'http' -> 'https' replacement 2023-01-05 14:55:55 +01:00
Mike Fährmann
4fd6da474f merge #3473: [twitter] fix crash when using 'expand' and 'syndication' 2023-01-05 14:19:47 +01:00
Mike Fährmann
818f6fa71f merge #3453: [twitter] document #1396 and #2712 2023-01-05 14:18:21 +01:00
Mike Fährmann
a918ce29b5 run tests on ubuntu-20.04
and remove Python 3.4, since that's no longer available
on this test runner
2023-01-05 13:33:27 +01:00
Mike Fährmann
708fa3c296 run tests on ubuntu-latest 2023-01-05 13:19:43 +01:00
Mike Fährmann
6514828d4e emit debug logging message when loading cookies from file 2023-01-05 12:40:22 +01:00
Mike Fährmann
3a238fd490 [poipiku] warn about login requirements 2023-01-05 12:29:31 +01:00
ClosedPort22
0e8657edc2 [docs] update OAuth guide in README.rst
The Pixiv extractor requires a 'refresh-token' since 8974f0361c (mikf#1304).
2023-01-05 17:37:22 +08:00
ClosedPort22
455481ad76 [twitter] improve documentation
This includes:
- The automatic expansion of conversations (#2712)
- How to retrieve age-restricted content from search results (#1396)
2023-01-05 12:14:42 +08:00
Mike Fährmann
fa144f38ed [ytdl} fix dfe4f00c for legacy yt-dlp 2023-01-04 21:42:22 +01:00
Mike Fährmann
f29ba089ff merge #3474: [fanleaks] add 'post' and 'model' extractors 2023-01-04 17:39:17 +01:00
Mike Fährmann
6933727b45 merge #3483: [twitter] implement 'syndication=extended' 2023-01-04 17:36:17 +01:00
Mike Fährmann
07ed3a1fbf merge #3460: [poipiku] fix extraction for a different warning button style
(#3493, #3492)
2023-01-04 17:29:27 +01:00
Mike Fährmann
9116398c1c [pinterest] add 'domain' option (#3484)
use input URL domain by default
2023-01-04 17:20:14 +01:00
Mike Fährmann
f1a715dbcd improve docs/options.md
- use non-breaking hyphens
- don't replace '…' in examples
- don't force width for long option column
2023-01-04 14:41:05 +01:00
Mike Fährmann
6f6af36cad use double quotes for --help examples 2023-01-04 14:30:27 +01:00
Mike Fährmann
dfe4f00ca2 [ytdl] update for yt-dlp changes 2023-01-04 13:12:24 +01:00
blankie
2f985bcddb [poipiku] fix extraction for a different warning button style 2023-01-04 08:28:31 +07:00
Mike Fährmann
294108c90a [pinterest] support 'All Pins' boards (#2855, #3484) 2023-01-03 19:11:20 +01:00
Mike Fährmann
13c16490bd handle subcategory names ending with 'y' 2023-01-03 18:51:42 +01:00
Mike Fährmann
77df8d3116 [deviantart] implement username&password login for scraps (#1029)
re-login when getting prematurely logged out by dA
is missing at the moment
2023-01-03 18:42:28 +01:00
Mike Fährmann
d4a461387f update README.rst
more needs to be done, but at least it's a start
2023-01-03 18:40:16 +01:00
Mike Fährmann
50d89d4acb docs/options.md: use a separate table for each option group 2023-01-03 16:04:48 +01:00
Mike Fährmann
ed2d715019 fix 'keywords' in extractor tests (#3491) 2023-01-03 15:14:23 +01:00
Mike Fährmann
3f29b8fe91 [cookies] convert browser names to lowercase 2023-01-03 14:58:48 +01:00
Mike Fährmann
7de6b7f489 add list of command-line options as docs/options.md (#3464) 2023-01-02 19:14:16 +01:00
ClosedPort22
6853b14be3 [twitter] apply suggestions from code review
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2023-01-02 21:03:01 +08:00
Mike Fährmann
4611237f8c merge #3457: [danbooru] extract uploader metadata (if option is set) 2023-01-01 21:20:39 +01:00
Mike Fährmann
b843eeb65a merge #3436: Add Homebrew instructions to installation list 2023-01-01 21:17:28 +01:00
Mike Fährmann
22ab2cad17 fix whitespace 2023-01-01 21:17:03 +01:00
Mike Fährmann
e7522482bb merge #3463: [lynxchan] support 'bbw-chan.nl' 2023-01-01 15:50:09 +01:00
Mike Fährmann
7d6c846176 [fanbox] return 'imageMap' files in order (#2718) 2023-01-01 15:12:05 +01:00
Mike Fährmann
dc8e7ff54e [bunkr] fix URLs returned by API (#3481) 2023-01-01 14:07:15 +01:00
Mike Fährmann
1fc3845cf6 Revert "add liberapay to FUNDING.yml"
This reverts commit 2bdcd85ced.
2023-01-01 13:54:09 +01:00
Mike Fährmann
0ed5986062 document custom 'output.mode' (#2529) 2022-12-30 17:14:42 +01:00
enduser420
5fedef3a1a [fanleaks] update 'model' URL pattern 2022-12-30 19:29:55 +05:30
enduser420
5a740ef78b [fanleaks] add 'post' and 'model' extractors 2022-12-30 19:24:05 +05:30
ClosedPort22
7c8eab8d52 [twitter] implement 'syndication=extended'
to be able to fetch extended user metadata
2022-12-30 20:48:41 +08:00
ClosedPort22
be3286206a [twitter] assume 'conversation_id' when using syndication
not possible to expand replies at the momemt
2022-12-30 13:57:37 +08:00
ClosedPort22
ce8dbb1ccc [twitter] fix crash when using 'expand' and 'syndication'
caused by KeyError: 'conversation_id_str'
2022-12-30 12:45:44 +08:00