Website Scraping? Anyone have advice for me?

[WhiteRaven]

So i've been looking for a way to run something to reap .co.za sites that have /vacancies /join us etc. in the url, to help find positions for people who have asked me to market their c.v.'s. Is web scraping the way to go? Can it search multiple sites based on the .co.za or find Gauteng in the contact us page? or do these tools need you to actually add the website address's in?

Anyone have some experience with this that could give me some guidance on this please?

 

[ToxicBunny]

Yeah don't do it...

You'll be wasting your time, the companies change the way their sites run relatively regularly from what i know, and they don't really like people doing what you're thinking of, they get paid to have the positions advertised, and if you're scraping them they might try come after you somehow.

 

[GoofySmurf]

So i've been looking for a way to run something to reap .co.za sites that have /vacancies /join us etc. in the url, to help find positions for people who have asked me to market their c.v.'s. Is web scraping the way to go? Can it search multiple sites based on the .co.za or find Gauteng in the contact us page? or do these tools need you to actually add the website address's in?

Anyone have some experience with this that could give me some guidance on this please?

On my servers and any isp worth their salt will pick this up and automatically be ip banned in a few seconds by the intrusion detection.

 

[WhiteRaven]

Ok well there goes that idea into file 13.. thanks so much really appreciate the input.

 

[yebocan]

try http://mozenda.com/ -