7 Replies - 3121 Views - Last Post: 04 November 2009 - 01:46 PM Rate Topic: -----

#1 alpergn  Icon User is offline

  • New D.I.C Head

Reputation: 0
  • View blog
  • Posts: 3
  • Joined: 14-December 08

Bot

Posted 14 December 2008 - 08:25 AM

I want to create a windows application to enter a web site and collect some data. Firstly it should open the site. Then it clicks some buttons according to code and finally it must get the data form new opening page. I am not sure about how can I do it. My question is how can a bot program open a web site and then click some buttons. Thanks for your help
Is This A Good Question/Topic? 0
  • +

Replies To: Bot

#2 PsychoCoder  Icon User is offline

  • Google.Sucks.Init(true);
  • member icon

Reputation: 1619
  • View blog
  • Posts: 19,853
  • Joined: 26-July 07

Re: Bot

Posted 14 December 2008 - 09:32 AM

It's called Screen Scraping, but be warned, many site owners don't like you scraping their data (basically stealing it)

[rules][/rules]
Was This Post Helpful? 0
  • +
  • -

#3 ValPaliy  Icon User is offline

  • D.I.C Lover
  • member icon

Reputation: 12
  • View blog
  • Posts: 1,392
  • Joined: 06-December 07

Re: Bot

Posted 14 December 2008 - 10:01 AM

I don't think that's legal - getting info without its owners ;-)
Was This Post Helpful? 0
  • +
  • -

#4 alpergn  Icon User is offline

  • New D.I.C Head

Reputation: 0
  • View blog
  • Posts: 3
  • Joined: 14-December 08

Re: Bot

Posted 14 December 2008 - 10:10 AM

If the site allows to copy information why it is illegal. I can acquire all data from web site legally. I just do not want to spend to much time for it. I prefer to create a program to get data.
Was This Post Helpful? 0
  • +
  • -

#5 fremgenc  Icon User is offline

  • D.I.C Head

Reputation: 3
  • View blog
  • Posts: 119
  • Joined: 15-November 07

Re: Bot

Posted 14 December 2008 - 02:15 PM

View PostValPaliy, on 14 Dec, 2008 - 09:01 AM, said:

I don't think that's legal - getting info without its owners ;-)


Its perfectly legal. All screen scraping does is get the underlying code behind the page. Its basically the same as right click-> show source from a webpage. The only difference is you're automating this process. If it were illegal Google would be screwed.

As for code, look into the WebRequest or WebClient classes

MSDN Documentation on WebClient

Cheers

This post has been edited by fremgenc: 14 December 2008 - 02:15 PM

Was This Post Helpful? 0
  • +
  • -

#6 alpergn  Icon User is offline

  • New D.I.C Head

Reputation: 0
  • View blog
  • Posts: 3
  • Joined: 14-December 08

Re: Bot

Posted 14 December 2008 - 02:22 PM

Actually I have no problem with taking data from the site. The part I could not is clicking some buttons according to code. I should open a web site and then a bot must manage this web page instead of me. How can I make it
Was This Post Helpful? 0
  • +
  • -

#7 morph106  Icon User is offline

  • New D.I.C Head

Reputation: 0
  • View blog
  • Posts: 1
  • Joined: 04-November 09

Re: Bot

Posted 04 November 2009 - 01:37 PM

View Postalpergn, on 14 Dec, 2008 - 01:22 PM, said:

Actually I have no problem with taking data from the site. The part I could not is clicking some buttons according to code. I should open a web site and then a bot must manage this web page instead of me. How can I make it


This might help, I know I was certainly happy to find it:
*** MOD EDIT: Removed link ***
Was This Post Helpful? 0
  • +
  • -

#8 Aeternalis  Icon User is offline

  • D.I.C Regular

Reputation: 28
  • View blog
  • Posts: 291
  • Joined: 13-July 09

Re: Bot

Posted 04 November 2009 - 01:46 PM

Try AutoIt , its a scripting suite that allows you to automate alot of different tasks.
AUTOIT

Aet

PS I also have that BLackHat site linked above listed as a malicious / virus site. Just FYI. Can a mod please remove it?

This post has been edited by Aeternalis: 04 November 2009 - 01:49 PM

Was This Post Helpful? 0
  • +
  • -

Page 1 of 1