1
0
mirror of https://github.com/pirate/ArchiveBox.git synced 2025-08-17 20:01:44 +02:00

Updated Setting Up Storage (markdown)

Nick Sweeting
2024-05-10 14:05:08 -07:00
parent 434f362ea8
commit 50d5a50318

@@ -108,8 +108,8 @@ The `data/archive/` subfolder contains the bulk archived content, and it support
> `data/index.sqlite3` is your main archive DB, *it must be on a fast, reliable, local filesystem* which supports [FSYNC](https://stackoverflow.com/questions/40849596/git-clone-fsync-input-output-error-in-linux#:~:text=Some%20filesystems%20%2D%20especially%20remote%20filesystems%20like%20NFS%2C%20sshfs%2C&text=do%20not%20support%20fsync()%20but%20git%20has%20no%20flag%20to%20disable%20these%20calls) (SSD/NVMe recommended for best experience). > `data/index.sqlite3` is your main archive DB, *it must be on a fast, reliable, local filesystem* which supports [FSYNC](https://stackoverflow.com/questions/40849596/git-clone-fsync-input-output-error-in-linux#:~:text=Some%20filesystems%20%2D%20especially%20remote%20filesystems%20like%20NFS%2C%20sshfs%2C&text=do%20not%20support%20fsync()%20but%20git%20has%20no%20flag%20to%20disable%20these%20calls) (SSD/NVMe recommended for best experience).
> [!TIP] > [!TIP]
> If you use a remote filesystem for your archive, you will want to switch from the default `ripgrep` search backend to use [`sonic`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sonic-%EF%B8%8F-the-recommended-upgrade-path-for-most-people) or [`FTS5`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sqlite-fts5) instead. > If you use a remote filesystem, you should switch ArchiveBox's search backend from `ripgrep` to [`sonic`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sonic-%EF%B8%8F-the-recommended-upgrade-path-for-most-people) (or [`FTS5`](https://github.com/ArchiveBox/ArchiveBox/wiki/Setting-up-Search#sqlite-fts5)) instead.
> <sub>(`ripgrep` scans over every byte in the archive on each search, which would be terribly slow/expensive on remote storage)</sub> > <sub>(`ripgrep` scans over every byte in the archive to do each search, which is slow and potentially costly on remote storage)</sub>
### `NFS` (Docker Driver) ### `NFS` (Docker Driver)