mirror/archivebox
1
0
Fork 0
mirror of https://github.com/pirate/ArchiveBox.git synced 2025-08-25 15:31:22 +02:00
Code Issues Releases Wiki Activity

Updated Configuration (markdown)

Nick Sweeting
2021-07-06 23:13:04 -04:00
parent 921dc04fdb
commit 6444eae199
1 changed files with 6 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
Configuration.md

@@ -114,15 +114,15 @@ When building your blacklist, you can check whether a given URL matches your reg
True True
``` ```
You can also use this to **whitelist** certain patterns and exclude all others by adding `(?!`*pattern*`)` around the pattern to negate it. For example, to match only URLs `*.example.org` you could do: You can also use this to **whitelist** certain patterns and exclude all others by adding `(?!`*pattern*`)` around the pattern to negate it. For example, to match only URLs `*.example.com` you could do:
```python ```python
>>> URL_BLACKLIST = r'(?!http(s)?:\/\/(.+)?example\.org\/?.*)' >>> URL_BLACKLIST = r'(?!http(s)?:\/\/(.+\.)?example\.com\/?.*)'
>>> bool(re.compile(URL_BLACKLIST, re.IGNORECASE).match('https://example.org/example.php?abc=123') >>> bool(re.compile(URL_BLACKLIST, re.IGNORECASE).match('https://example.com/example.php?abc=123'))
False # this URL would not be excluded (i.e. it will be archived) False # this URL would not be excluded (i.e. it will be archived)
>>> bool(re.compile(URL_BLACKLIST, re.IGNORECASE).match('https://abc.example.org') >>> bool(re.compile(URL_BLACKLIST, re.IGNORECASE).match('https://abc.example.com'))
False # this URL would not be excluded (i.e. it will be archived) False # this URL would not be excluded (i.e. it will be archived)
>>> bool(re.compile(URL_BLACKLIST, re.IGNORECASE).match('https://test.youtube.com/example.php?abc=123') >>> bool(re.compile(URL_BLACKLIST, re.IGNORECASE).match('https://example.youtube.com/example.php?abc=123'))
True # but this would be excluded and not archived, because it does not match *.example.org True # but this would be excluded and not archived, because it does not match *.example.com
``` ```
*Related options:* *Related options:*