mirror/ripme
1
0
Fork 0
mirror of https://github.com/RipMeApp/ripme.git synced 2025-08-20 12:42:06 +02:00
Code Issues Releases Wiki Activity

Updated How To Create A Ripper for HTML websites (markdown)

4_pr0n
2015-04-05 00:00:42 -07:00
parent 109ef89de9
commit 2e319f81fc
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
How-To-Create-A-Ripper-for-HTML-websites.md

@@ -132,7 +132,7 @@ Input: Jsoup `Document` retrieved in the `getFirstPage()` method (and optionally
Returns: **List of URLs to be downloaded** or retrieved. Returns: **List of URLs to be downloaded** or retrieved.
This is where the URLs are *extracted* from the page Document. This is where the URLs are *extracted* from the page Document.
Some rippers return a list of subpages to be ripped in separate threads (e.g. [`ImagevenueRipper.java](https://github.com/4pr0n/ripme/blob/master/src/main/java/com/rarchives/ripme/ripper/rippers/ImagevenueRipper.java#L67) Some rippers return a list of subpages to be ripped in separate threads (e.g. [`ImagevenueRipper.java`](https://github.com/4pr0n/ripme/blob/master/src/main/java/com/rarchives/ripme/ripper/rippers/ImagevenueRipper.java#L67))
This is when CSS-Selectors come in handy. Say you wanted to grab every image that appears on the page: This is when CSS-Selectors come in handy. Say you wanted to grab every image that appears on the page:
@@ -141,7 +141,7 @@ This is when CSS-Selectors come in handy. Say you wanted to grab every image tha
public List<String> getURLsFromPage(Document doc) { public List<String> getURLsFromPage(Document doc) {
List<String> result = new ArrayList<String>(); List<String> result = new ArrayList<String>();
for (Element el : doc.select("img")) { for (Element el : doc.select("img")) {
el.add(el.attr("src")); result.add(el.attr("src"));
} }
return result return result
} }