1
0
mirror of https://github.com/pirate/ArchiveBox.git synced 2025-09-08 21:30:57 +02:00
Commit Graph

3699 Commits

Author SHA1 Message Date
Nick Sweeting
fe11e1c2f4 check if COOKIE_FILE is file 2024-02-28 18:19:44 -08:00
jim winstead
ccabda4c7d Handle list of tags in JSON, and be more clever about comma vs. space 2024-02-28 17:38:49 -08:00
jim winstead
178e676e0f Fix JSON parser by not always mangling the input
Rather than by assuming the JSON file we are parsing has junk at the beginning
(which maybe only used to happen?), try parsing it as-is first, and then fall
back to trying again after skipping the first line

Fixes #1347
2024-02-27 14:48:19 -08:00
Ben Muthalaly
68326a60ee Add cookies file to http request in download_url 2024-02-27 15:30:31 -06:00
jim winstead
22f9a289d3 Use feedparser for RSS parsing in generic_rss and pinboard_rss parsers
The feedparser packages has 20 years of history and is very good at parsing
RSS and Atom, so use that instead of ad-hoc regex and XML parsing.

The medium_rss and shaarli_rss parsers weren't touched because they are
probably unnecessary. (The special parse for pinboard is just needing because
of how tags work.)

Doesn't include tests because I haven't figured out how to run them in the
docker development setup.

Fixes #1171
2024-02-25 12:34:51 -08:00
Nick Sweeting
f02b27920c Update README.md 2024-02-23 23:21:23 -08:00
Nick Sweeting
597f1a39e0 Update README.md 2024-02-23 23:20:48 -08:00
Ben Muthalaly
4d9c5a7b4b Add CHROME_EXTRA_ARGS
Also fix `YOUTUBEDL_EXTRA_ARGS`.
2024-02-23 18:40:03 -06:00
Ben Muthalaly
ab8f395e0a Add YOUTUBEDL_EXTRA_ARGS 2024-02-23 15:40:31 -06:00
Nick Sweeting
a00b34cc13 Update README.md 2024-02-23 12:58:28 -08:00
Nick Sweeting
c7cdc2fc27 Update README.md 2024-02-23 12:55:36 -08:00
Nick Sweeting
ab225104c5 Update README.md 2024-02-23 12:54:56 -08:00
Ben Muthalaly
4e69d2c9e1 Add EXTRA_*_ARGS for wget, curl, and singlefile 2024-02-22 23:04:11 -06:00
Nick Sweeting
31d05d8526 Merge branch 'main' into dev 2024-02-22 04:50:46 -08:00
Nick Sweeting
8b9bc3dec8 minor fixes 2024-02-22 04:50:22 -08:00
Nick Sweeting
6a4e568d1b new archivebox update speed improvements 2024-02-22 04:50:22 -08:00
Nick Sweeting
2d32f05a62 lower default sonic log level 2024-02-22 04:50:22 -08:00
Nick Sweeting
3afd7b0cf0 add healthcheck to Dockerfile 2024-02-22 04:50:22 -08:00
Nick Sweeting
0899c298c0 ignore data dirs 2024-02-22 04:50:22 -08:00
Nick Sweeting
743e1ca7ad Update README.md 2024-02-22 03:07:16 -08:00
Nick Sweeting
52faf81096 Update README.md 2024-02-22 02:42:25 -08:00
Nick Sweeting
9026726a00 Update README.md 2024-02-22 01:23:51 -08:00
Nick Sweeting
113895277d Update README.md 2024-02-21 17:14:09 -08:00
Nick Sweeting
b3be86f2cf Update .readthedocs.yaml 2024-02-20 17:58:27 -08:00
Nick Sweeting
8a25502650 Merge branch 'main' into dev 2024-02-20 17:41:10 -08:00
Nick Sweeting
87a86dd111 Update README.md 2024-02-19 00:23:44 -08:00
Nick Sweeting
9b1df2b381 Update README.md 2024-02-19 00:21:45 -08:00
Nick Sweeting
6de23cd8fe Update README.md 2024-02-19 00:19:48 -08:00
Nick Sweeting
335e3aadb0 revert main changes 2024-02-18 20:01:06 -08:00
Nick Sweeting
20575e7cc8 Merge branch 'main' into dev 2024-02-18 19:15:40 -08:00
Nick Sweeting
841c01ec2c bump required python version to 3.10 to match brew and apt 2024-02-18 19:14:08 -08:00
Nick Sweeting
f554ae903e fix requirements.txt so docks build doesnt crash on missing ldap c headers 2024-02-18 19:13:40 -08:00
Nick Sweeting
fa24136ff7 Update setup.sh 2024-02-18 05:46:53 -08:00
Nick Sweeting
b706ab390d Merge branch 'main' into dev 2024-02-18 05:40:49 -08:00
Nick Sweeting
84fe8e1c75 Update setup.sh 2024-02-18 05:40:30 -08:00
Nick Sweeting
8519c81711 Update setup.sh 2024-02-18 05:32:38 -08:00
Nick Sweeting
9373a2853e Update setup.sh 2024-02-18 05:32:20 -08:00
Nick Sweeting
0b8ff4c84c Update setup.sh 2024-02-18 05:28:48 -08:00
Nick Sweeting
0cdfab7f45 Update setup.sh 2024-02-18 05:27:17 -08:00
Nick Sweeting
e9f3b041ec Update setup.sh 2024-02-18 05:21:27 -08:00
Nick Sweeting
968cd8f19c Update README.md 2024-02-18 05:03:08 -08:00
Nick Sweeting
ae7cbf4c54 Update README.md 2024-02-18 04:55:33 -08:00
Nick Sweeting
f9ad8e911b Update README.md 2024-02-18 04:54:27 -08:00
Nick Sweeting
bf0983ce77 Update README.md 2024-02-18 04:48:37 -08:00
Nick Sweeting
dd6bb4b274 Update README.md 2024-02-18 04:46:25 -08:00
Nick Sweeting
a79bfde0db Update README.md 2024-02-18 04:17:25 -08:00
Nick Sweeting
74e3645c6a Update README.md 2024-02-18 04:14:57 -08:00
Nick Sweeting
2a845d1976 Update README.md 2024-02-18 04:13:55 -08:00
Nick Sweeting
903c72fa88 fix typing errors 2024-02-12 21:28:52 -08:00
Nick Sweeting
91c4641199 skip dir size calculation when path is too long 2024-02-12 21:26:34 -08:00