From 434f362ea850c7f0fb5cef7393786f2faef3b405 Mon Sep 17 00:00:00 2001 From: Nick Sweeting Date: Fri, 10 May 2024 14:03:42 -0700 Subject: [PATCH] Updated Setting Up Storage (markdown) --- Setting-Up-Storage.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/Setting-Up-Storage.md b/Setting-Up-Storage.md index aed77c7..3fdf658 100644 --- a/Setting-Up-Storage.md +++ b/Setting-Up-Storage.md @@ -108,7 +108,8 @@ The `data/archive/` subfolder contains the bulk archived content, and it support > `data/index.sqlite3` is your main archive DB, *it must be on a fast, reliable, local filesystem* which supports [FSYNC](https://stackoverflow.com/questions/40849596/git-clone-fsync-input-output-error-in-linux#:~:text=Some%20filesystems%20%2D%20especially%20remote%20filesystems%20like%20NFS%2C%20sshfs%2C&text=do%20not%20support%20fsync()%20but%20git%20has%20no%20flag%20to%20disable%20these%20calls) (SSD/NVMe recommended for best experience). > [!TIP] -> If you use a remote filesystem for your archive, the default `ripgrep` search backend will likely be too slow to be usable. (it scans over every byte in your archive for each search). You should [change your search backend](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search) to use [`sonic`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sonic-%EF%B8%8F-the-recommended-upgrade-path-for-most-people) or [`FTS5`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sqlite-fts5) instead. +> If you use a remote filesystem for your archive, you will want to switch from the default `ripgrep` search backend to use [`sonic`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sonic-%EF%B8%8F-the-recommended-upgrade-path-for-most-people) or [`FTS5`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sqlite-fts5) instead. +> (`ripgrep` scans over every byte in the archive on each search, which would be terribly slow/expensive on remote storage) ### `NFS` (Docker Driver)