No description
| scraper | ||
| .gitignore | ||
| app.js | ||
| docker-compose.yml | ||
| Dockerfile | ||
| package.json | ||
| readme.md | ||
Paste webscrape.io exported sitemap into the sitemap data field in the body of the request. Post request example:
curl --location 'http://192.168.20.126/scrape'
--header 'Content-Type: application/json'
--data '{"sitemap":
{"_id":"XXXX","startUrl":["XXXX"],"selectors":[{"id":"link","linkType":"linkFromHref","multiple":true,"parentSelectors":["_root"],"selector":"a.name","type":"SelectorLink","version":2}]}
}'