Mike Fährmann
eee78f8148
[pp:python] restore archive functionality
...
fixes regression introduced in 09f0ba8e9c
2025-09-27 09:59:47 +02:00
Mike Fährmann
e5db6efca9
[pp] close archive database connections ( #8243 )
2025-09-19 22:12:35 +02:00
Mike Fährmann
a097a373a9
simplify if statements by using walrus operators ( #7671 )
2025-07-22 20:57:54 +02:00
Mike Fährmann
fd4de02e67
[archive] support PostgreSQL archives for post processors ( #6152 )
2025-02-17 14:58:14 +01:00
Mike Fährmann
d8cf381904
[archive] use defaults when 'prefix'/'format' are 'null'
2024-11-29 16:36:35 +01:00
Mike Fährmann
88f94190f4
[archive] move DownloadArchive into its own module
2024-05-10 01:05:28 +02:00
Mike Fährmann
92fbf09643
remove single quotes in some logging messages ( #4908 )
...
('FileNotFoundError: [Errno 2] No such file or directory: ''')
->
(FileNotFoundError: [Errno 2] No such file or directory: '')
2023-12-11 19:13:45 +01:00
Mike Fährmann
6c9432165e
add return value to 'PostProcessor._init_archive()'
2023-07-24 14:32:25 +02:00
Mike Fährmann
762a68996b
implement 'archive-pragma' option
2023-02-05 17:00:31 +01:00
Mike Fährmann
78d3960a31
[postprocessor:exec] implement archive options ( #3584 )
2023-02-01 13:57:16 +01:00
Mike Fährmann
9fffa9c343
rework post processor callbacks
2020-11-19 02:29:06 +01:00
Mike Fährmann
ece73b5b2a
make 'path' and 'keywords' available in logging messages
...
Wrap all loggers used by job, extractor, downloader, and postprocessor
objects into a (custom) LoggerAdapter that provides access to the
underlying job, extractor, pathfmt, and kwdict objects and their
properties.
__init__() signatures for all downloader and postprocessor classes have
been changed to take the current Job object as their first argument,
instead of the current extractor or pathfmt.
(#574 , #575 )
2020-05-18 19:04:51 +02:00
Mike Fährmann
63e6993716
merge 'bypost' functionality into metadata postprocessor
2019-12-16 17:19:23 +01:00
Mike Fährmann
9e88e7a344
[postprocessor:exec] improve ( #421 , #413 )
...
- add 'final' option
- include job status in pp finalization
- improve and extend documentation
2019-11-03 21:45:45 +01:00
Mike Fährmann
ad81c07204
[postprocessor] match logger names of downloader modules
...
The logger name for a postprocessor object got changed to
"postprocessor.<module-name>" instead of just
"postprocessor"
2019-10-06 23:30:18 +02:00
Mike Fährmann
03bc8adfc7
[postprocessor:exec] run after file moved to target location
...
(#421 )
2019-10-06 23:12:22 +02:00
Mike Fährmann
5f8621b29d
improve output of active post processor modules
2019-08-15 13:31:04 +02:00
Mike Fährmann
d3d7f01543
add 'prepare()' step for post-processors
...
This allows post-processors to modify the destination path before
checking if a file already exists.
2018-10-18 22:32:03 +02:00
Mike Fährmann
baccf8a958
improve postprocessor handling
...
- add pathfmt argument for __init__()
- add finalization step
- add option to keep or delete zipped files
2018-06-08 17:39:02 +02:00
Mike Fährmann
2628911ba0
[pp:exec] add 'async' option
2018-06-07 23:35:18 +02:00
Mike Fährmann
76c32d58e5
[postprocessor] initial code
2018-05-22 14:59:22 +02:00
