Subscribe to calebj's Blog        RSS Feed
- - - - -

Crawler is going to be getting a backend

Icon Leave Comment
Lately I have been going through a rather large push to do three things. Index as much of the web as I can with 1 50mb/s connection, parse the content and make it searchable, and create a nice back-end for these operations. Thus far the project is going quite nicely. I had to move away from a hosting provider and start hosting the crawler from...
- - - - -

The Web Crawler

Icon Leave Comment
In 2004 I started a project on a search engine but I have thus far closed down the project due to a lack of content that I have to search through. It did crawl a page but it wouldn't index the links or check through them at a later date. Recently I started working on a web crawler that goes though a page, copy the links, store them into the...
- - - - -

I'm Building a New Computer

Icon 3 Comments
For Christmas I received a Asus Sabertooth X58 and the first thing that went through my mind was "oh (insert dirty word). What is this going to cost me?" And fortunately it didn't actually cost that much. It is amazing what you can purchase for $1200. The build list currently looks like this.
Image reduced in size...
Page 1 of 1

September 2014

S M T W T F S
 123456
78910111213
14151617181920
21222324252627
2829 30     

Recent Entries

Recent Comments

Search My Blog

0 user(s) viewing

0 Guests
0 member(s)
0 anonymous member(s)

Categories