Topic: Screen Scraping with Mechanize
I'm must admit, that I'm just restarting my ruby/rails experience. Maybe, I start already with some too difficult stuff? I would to scrape some data from the german immobilienscout24.de site with mechanize. However, I have got already to some problems before I come to the interesting data. This is my try:
agent = WWW::Mechanize.new
form = agent.page.form_with(:name => "ambitsearch")
form['addressGroupCriteria.streetControl'] = 'Poststrasse'
form['addressGroupCriteria.cityControl'] = 'Hamburg'
form['addressGroupCriteria.houseNrControl'] = '10'
However, the response is not what I get in my web browser. Can anybody help and tell my what's wrong?
I have also another question: How can I submit german 'special characters like ö' or spaces like in 'Alter Weg'?
Thanks for your support!