No description
Find a file
2025-12-26 21:36:59 +00:00
scraper Upload files to "scraper/extractors" 2025-12-25 11:27:42 +00:00
.gitignore Upload files to "/" 2025-12-25 11:22:33 +00:00
app.js Upload files to "/" 2025-12-25 11:22:33 +00:00
docker-compose.yml Upload files to "/" 2025-12-25 11:22:33 +00:00
Dockerfile Upload files to "/" 2025-12-25 11:22:33 +00:00
package.json Upload files to "/" 2025-12-25 11:22:33 +00:00
readme.md Add readme.md 2025-12-26 21:36:59 +00:00

Paste webscrape.io exported sitemap into the sitemap data field in the body of the request. Post request example:

curl --location 'http://192.168.20.126/scrape'
--header 'Content-Type: application/json'
--data '{"sitemap": {"_id":"XXXX","startUrl":["XXXX"],"selectors":[{"id":"link","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":"a.name","type":"SelectorLink","version":2}]} }'