Commit Graph

8 Commits

Author SHA1 Message Date
Mike Fährmann
3ecb512722 send Referer headers by default 2023-09-19 00:02:04 +02:00
Mike Fährmann
a453335a9f remove test results in extractor modules
and add generic example URLs
2023-09-11 16:30:55 +02:00
Mike Fährmann
a383eca7f6 decouple extractor initialization
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().

This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
2023-07-25 22:16:16 +02:00
Mike Fährmann
d97b8c2fba consistent cookie-related names
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
2023-07-22 01:20:50 +02:00
Mike Fährmann
deff3b434d [vipergirls] implement login support (#4166) 2023-06-13 21:05:09 +02:00
Mike Fährmann
db20a645c5 [vipergirls] use API endpoints (#4166) 2023-06-13 20:54:02 +02:00
Mike Fährmann
9f1aee3884 [vipergirls] limit number of requests per second (#4166) 2023-06-10 17:57:04 +02:00
Mike Fährmann
6f1e34ec69 [vipergirls] add 'thread' and 'post' extractors
(#731, #2720, #3812)
2023-04-19 15:28:26 +02:00