Hi folks,
I am designing a web image crawler that focuses on using an initial image to find where the object in the image can be purchased.
Basically the aim is to upload an image, use an image processing software package and then find a similar image online including details for purchase i.e. what the object is, where can it be bought, how much is costing etc.
I was thinking that my crawling would be focused in type and target marketing websites like ebay.com, amazon.com, comparethemarket.com etc. but I am not sure if this is reliable method and if I may run into legal problems.
Another possibility is to try and use search engines (Google, Yahoo, Bing, MSN etc.): the image search tool to find and compare their indexed images with my uploaded image. However I am not sure if it's possible to browse their entire image index and if it's allowed.
I am requesting any ideas/ suggestions on how I might proceed or any concepts I should look up.
Thanks in advance for your time,
Regards,
RA
Web Image Crawler: Shopbot
Page 1 of 14 Replies - 1442 Views - Last Post: 19 December 2011 - 03:49 AM
Replies To: Web Image Crawler: Shopbot
#2
Re: Web Image Crawler: Shopbot
Posted 18 December 2011 - 02:46 PM
#3
Re: Web Image Crawler: Shopbot
Posted 18 December 2011 - 06:19 PM
I am sorry mate, I didn't ask for any code. I am just bouncing ideas; if you got any ideas how I might proceed it'd be very helpful.
Further background info
For the moment I am able to crawl to a depth 3 and extract all images SRC, starting from a given a URL. However I am out of ideas on how to proceed because I heard from a mate that it was not reliable crawling from marketing websites because eventually my IP address would be blocked and my application would not work.
Also I am wondering if there's a search word that would return all images indexed by the search engines.
Kind Regards,
RA
Further background info
For the moment I am able to crawl to a depth 3 and extract all images SRC, starting from a given a URL. However I am out of ideas on how to proceed because I heard from a mate that it was not reliable crawling from marketing websites because eventually my IP address would be blocked and my application would not work.
Also I am wondering if there's a search word that would return all images indexed by the search engines.
Kind Regards,
RA
#5
Re: Web Image Crawler: Shopbot
Posted 19 December 2011 - 03:49 AM
I think that you should first look up to how to make a ordinary web crawler, then focus on image specific.
Refer to these links for more info:
Web Crawler (DotNetSpider Article)
C# A Simple Web Crawler (ExampleCode Article)
Building a web crawler (developerfusion Tutorial)
Refer to these links for more info:
Web Crawler (DotNetSpider Article)
C# A Simple Web Crawler (ExampleCode Article)
Building a web crawler (developerfusion Tutorial)
Page 1 of 1
|
|

New Topic/Question
Reply




MultiQuote





|