mirror/archivebox
1
0
Fork 0
mirror of https://github.com/pirate/ArchiveBox.git synced 2025-08-08 15:46:42 +02:00
Code Issues Releases Wiki Activity

Commit Graph

  • b852951c58 fix cli loading edge case where setup_django wasnt running when it should Nick Sweeting 2024-11-19 05:27:35 -08:00
  • 6b47510f70 always pre-setup binproviders Nick Sweeting 2024-11-19 05:24:12 -08:00
  • f8e2f7c753 restore missing archivebox_update work Nick Sweeting 2024-11-19 05:09:19 -08:00
  • 52446b86ba restore missing archivebox_status work Nick Sweeting 2024-11-19 05:08:41 -08:00
  • 0f536ff18b restore missing archivebox_schedule work Nick Sweeting 2024-11-19 05:07:55 -08:00
  • fe3320eff0 restore missing archivebox_remove work Nick Sweeting 2024-11-19 05:07:12 -08:00
  • 230bf34e14 restore missing archivebox_config work Nick Sweeting 2024-11-19 05:05:06 -08:00
  • ee548eb16e fix archivebox install not using LIB_DIR Nick Sweeting 2024-11-19 04:44:43 -08:00
  • 6740202d78 fix cli loading edge case where setup_django wasnt running when it should Nick Sweeting 2024-11-19 04:20:00 -08:00
  • f21b86aba8 better cli colors Nick Sweeting 2024-11-19 04:10:07 -08:00
  • 0f860d40f1 working archivebox_status CLI cmd Nick Sweeting 2024-11-19 04:05:05 -08:00
  • 292730ebad working archivebox_schedule cmd Nick Sweeting 2024-11-19 03:54:47 -08:00
  • 3a64ced697 fix archivebox delete errors Nick Sweeting 2024-11-19 03:45:44 -08:00
  • 0347b911aa archivebox add and remove CLI cmds Nick Sweeting 2024-11-19 03:40:01 -08:00
  • 2595139180 improve statemachine logging and archivebox update CLI cmd Nick Sweeting 2024-11-19 03:31:05 -08:00
  • c9a05c9d94 working archivebox update CLI cmd Nick Sweeting 2024-11-19 02:31:59 -08:00
  • a0edf218e8 fix archivebox init and archivebox install CLI commands Nick Sweeting 2024-11-19 01:04:56 -08:00
  • 5f01fc8307 fix archivebox shell and manage CLI commands Nick Sweeting 2024-11-19 00:48:39 -08:00
  • 328eb98a38 move main funcs into cli files and switch to using click for CLI Nick Sweeting 2024-11-19 00:18:51 -08:00
  • 569081a9eb rename abid_utils to base_models Nick Sweeting 2024-11-18 19:40:05 -08:00
  • 0db6437c4e fix plural name for output_dir Nick Sweeting 2024-11-18 19:27:21 -08:00
  • 65afd405b1 merge seeds and crawls apps Nick Sweeting 2024-11-18 19:23:14 -08:00
  • 4c25e90378 move monkey_patches.py into archivebox.misc subfolder Nick Sweeting 2024-11-18 19:10:42 -08:00
  • 4a5d607296 move logging_util into archivebox.misc subfolder Nick Sweeting 2024-11-18 19:08:49 -08:00
  • e469c5a344 merge queues and actors apps into new workers app Nick Sweeting 2024-11-18 18:52:48 -08:00
  • e50f8cb3b6 fix abx handling of obj, module, and class based plugins, fix archivebox version cmd Nick Sweeting 2024-11-18 18:30:28 -08:00
  • 0acd388c02 fix imports and deps Nick Sweeting 2024-11-18 18:07:34 -08:00
  • 6b83b4c995 leave archivebox running when in archivebox update Nick Sweeting 2024-11-18 04:27:32 -08:00
  • eeb2671e4d API improvements Nick Sweeting 2024-11-18 04:27:19 -08:00
  • c7bd9449d5 better jobs dashboard with faster refresh Nick Sweeting 2024-11-18 04:26:09 -08:00
  • eb53145e4e working state machine flow yay Nick Sweeting 2024-11-18 04:25:45 -08:00
  • 9adfe0e2e6 add code to log all SQL queries for DEBUG Nick Sweeting 2024-11-18 02:26:17 -08:00
  • 385ccaa14d extend core models with ModelWithOutputDir Nick Sweeting 2024-11-18 02:26:08 -08:00
  • 1e3ce67834 fix API and CLU calls Nick Sweeting 2024-11-18 02:25:49 -08:00
  • f65c2b40f8 tweak dashboard UI css Nick Sweeting 2024-11-18 02:25:33 -08:00
  • f5727c7da2 rename actors to workers Nick Sweeting 2024-11-18 02:25:00 -08:00
  • 9b8cf7b4f0 simplify actor and orchestrator by removing threading code, fixing bugs Nick Sweeting 2024-11-18 02:24:52 -08:00
  • af21c3428b add ModelWithOutputDir base model to manage output directories and index writing Nick Sweeting 2024-11-18 02:24:10 -08:00
  • c8b830b8dc add ABIDModel.update_for_workers to update-in-place + bump retry_at time Nick Sweeting 2024-11-18 02:23:50 -08:00
  • b852442efc add crawls app back to django admin Nick Sweeting 2024-11-17 22:57:20 -08:00
  • 1ec2753664 fix statemachine create_root_snapshot and retry timing Nick Sweeting 2024-11-17 22:57:09 -08:00
  • 67c22b2df0 fix config set not working with constants Nick Sweeting 2024-11-17 22:56:30 -08:00
  • 2a66bb9a57 flip queue processing order to do most recent first Nick Sweeting 2024-11-17 22:56:13 -08:00
  • 148ea907bd fix serious bug with Actor.get_next updating all rows instead of only top row Nick Sweeting 2024-11-17 22:56:03 -08:00
  • 18403b72f0 Update config.yml (#1598) Nick Sweeting 2024-11-17 23:40:51 -05:00
  • 3e5ae1600c Update config.yml Nick Sweeting 2024-11-17 20:40:38 -08:00
  • 2ae70deaae Update config.yml Nick Sweeting 2024-11-17 20:36:29 -08:00
  • dbd6272d18 Update config.yml Nick Sweeting 2024-11-17 20:34:21 -08:00
  • c206056f07 add better docstrings to abx package Nick Sweeting 2024-11-17 20:26:56 -08:00
  • 2c59524821 bump docs build Nick Sweeting 2024-11-17 20:15:47 -08:00
  • 2f30a35d2b add extractors files to favicon and title plugins Nick Sweeting 2024-11-17 20:11:43 -08:00
  • 1b8bafdb56 add abx-spec-abx-pkg pkg Nick Sweeting 2024-11-17 20:10:33 -08:00
  • 36d24cd8d7 add jobs dashboard Nick Sweeting 2024-11-17 20:09:55 -08:00
  • fb82fdae16 make actor pending include all obj with retry_at in the past Nick Sweeting 2024-11-17 20:09:38 -08:00
  • 8f8fbbb7a2 API fixes and add actors endpoints Nick Sweeting 2024-11-17 20:09:06 -08:00
  • c8e186f21b fix plugin loading order, admin, abx-pkg Nick Sweeting 2024-11-16 06:43:06 -08:00
  • 210fd935d7 make orchestrator run as long as any tasks are pending Nick Sweeting 2024-11-16 06:42:04 -08:00
  • a4635fe65d bump rc version Nick Sweeting 2024-11-16 02:49:38 -08:00
  • b7df1ca3a7 add start orchestrator management command Nick Sweeting 2024-11-16 02:49:01 -08:00
  • 2291f02147 setup seed model Nick Sweeting 2024-11-16 02:48:17 -08:00
  • 8cd285e273 add Seed admin Nick Sweeting 2024-11-16 02:48:06 -08:00
  • c2add7119c make supervisord start orchestrator on startup Nick Sweeting 2024-11-16 02:47:51 -08:00
  • ba26d75079 add notes and label fields, fix model getters Nick Sweeting 2024-11-16 02:47:35 -08:00
  • 227fd4e1c6 fix statemachine progression for Snapshot, Crawl, and ArchiveResult Nick Sweeting 2024-11-16 02:46:45 -08:00
  • 684a394cba add HOSTNAME to config.permissions Nick Sweeting 2024-11-16 02:45:58 -08:00
  • b4a5da3ffd update archivebox add CLI command to use new actor system Nick Sweeting 2024-11-16 02:45:37 -08:00
  • 43514da0d0 add crawl and seed endpoints to REST API Nick Sweeting 2024-11-16 02:45:11 -08:00
  • 48bb634b75 fix orchestrator startup and add exit_on_idle option Nick Sweeting 2024-11-16 02:44:57 -08:00
  • c3d692b5d5 fix minor actor erros around CLAIM_ATOMIC Nick Sweeting 2024-11-16 02:44:33 -08:00
  • 7c0e3dcc21 load crawls,seeds,actors apps as pluggy plugins Nick Sweeting 2024-11-16 02:44:11 -08:00
  • ed43f1d027 better docstrings and comments Nick Sweeting 2024-11-15 23:21:34 -08:00
  • 6448968952 Use archivebox/sonic multi-arch container with bundled config file Nick Sweeting 2024-11-13 11:08:00 -05:00
  • 5cb1fd7803 bump docs changes Nick Sweeting 2024-11-13 03:19:34 -08:00
  • ec100bfe29 fix docs build for vendored pkgs v0.8.6rc0 Nick Sweeting 2024-11-12 23:53:34 -08:00
  • f0a7198861 bump docs changes Nick Sweeting 2024-11-12 22:51:22 -08:00
  • 57852fd89e fix sphinx docs build Nick Sweeting 2024-11-12 22:20:11 -08:00
  • 840f831572 move readthedocs config into subdir Nick Sweeting 2024-11-12 22:10:00 -08:00
  • c6710a8df3 Delete CNAME Nick Sweeting 2024-11-13 01:02:04 -05:00
  • 5ce25d7518 Delete click_test.py Nick Sweeting 2024-11-13 00:57:50 -05:00
  • ad7eec26b2 bump docs changes Nick Sweeting 2024-11-12 21:57:03 -08:00
  • a0f9d3fdbc Update README.md Nick Sweeting 2024-11-12 06:55:39 -08:00
  • a9a3b153b1 more StateMachine, Actor, and Orchestrator improvements Nick Sweeting 2024-11-04 07:08:31 -08:00
  • 5d3c2a8a99 Update docker_entrypoint.sh Nick Sweeting 2024-11-03 17:02:36 -08:00
  • 99ed97836f Prevent accidentally mounting home folder as DATA_DIR Nick Sweeting 2024-11-03 16:40:23 -08:00
  • cad1be950b Require bash for setup.sh script instead of sh Nick Sweeting 2024-11-03 16:20:50 -08:00
  • fd89de5b91 Update setup.sh Nick Sweeting 2024-11-03 16:15:09 -08:00
  • 1148cadd7a Update __init__.py Nick Sweeting 2024-11-03 16:12:29 -05:00
  • 5872375a50 Update Dockerfile.simple Nick Sweeting 2024-11-03 16:04:04 -05:00
  • b7b3addbab v0.8.6-rc: Moving plugins to independent python packages with finite state machine interfaces (#1576) Nick Sweeting 2024-11-03 15:57:12 -05:00
  • b6ab4e298e merge dev Nick Sweeting 2024-11-03 12:56:44 -08:00
  • 758c0c6774 add user providable PLAYWRIGHT cache dir Nick Sweeting 2024-11-03 12:54:04 -08:00
  • cc49ecb1b5 playwright: support PLAYWRIGHT_BROWSERS_PATH environment variable (#1583) Nick Sweeting 2024-11-03 15:47:47 -05:00
  • 50a85ec97b Update archivebox/plugins_pkg/playwright/binproviders.py Nick Sweeting 2024-11-03 15:47:00 -05:00
  • 49c520914c playwright: support PLAYWRIGHT_BROWSERS_PATH environment variable Andrew Dunham 2024-11-03 13:59:20 -05:00
  • 48f8416762 add new core and crawsl statemachine manager Nick Sweeting 2024-11-03 00:41:11 -07:00
  • 41efd010f0 add wip crawl actor spec Nick Sweeting 2024-11-02 19:54:37 -07:00
  • 2337f874ad better actor atomic claim Nick Sweeting 2024-11-02 19:54:25 -07:00
  • 9b24fe7390 merge dev Nick Sweeting 2024-11-02 17:34:33 -07:00
  • dbe5c0bc07 more orchestrator and actor improvements Nick Sweeting 2024-11-02 17:25:51 -07:00
  • 27f26fdde8 Update config.yml Nick Sweeting 2024-11-02 20:07:29 -04:00