Help: Fill form on new post

[eternaloptimist]

Hey all. Need some help here.
I need to write a script that will start on a page like this:



Then get the newest post and fill in the form with some details.



What should I look into i.e which libraries, packages etc? I'm comfortable with Javascript/node, Python and Ruby.
Thanks

 

[[)roi(]]

For Python try either Mechanize or Scrapy.
For Ruby try Nokogiri in combination with Mechanize

Just google for code examples; many easy to follow tutorials exist.

 

[eternaloptimist]

For Python try either Mechanize or Scrapy.
For Ruby try Nokogiri in combination with Mechanize

Just google for code examples; many easy to follow tutorials exist.

Thanks!
Looking at Mechanize right now. I basically need to be the first to respond to a post within my search criteria. Any ideas on monitoring new posts?

 

[[)roi(]]

Thanks!
Looking at Mechanize right now. I basically need to be the first to respond to a post within my search criteria. Any ideas on monitoring new posts?

Timing is probably key and that really comes down to how often new listing appear. Frequency Risk: most sites will employ some safeguards against bot searches; e.g. too frequent or too many searches and you might find your IP is blacklisted (banned) for a period.

There is probably a pattern to when the listings appear; for example: is it more likely for new listings to be added in the PM or the AM. This might imply you only need to scan in those time slots; and probably no more than once every hour.

 

[eternaloptimist]

Timing is probably key and that really comes down to how often new listing appear. Frequency Risk: most sites will employ some safeguards against bot searches; e.g. too frequent or too many searches and you might find your IP is blacklisted (banned) for a period.

There is probably a pattern to when the listings appear; for example: is it more likely for new listings to be added in the PM or the AM. This might imply you only need to scan in those time slots; and probably no more than once every hour.

Makes so much sense now, thanks! I think I'm gonna have to take a risk.

 

[[)roi(]]

Makes so much sense now, thanks! I think I'm gonna have to take a risk.

good luck with the coding; can help if you get stuck.