Thinking of starting a search engine.

M

muzix1

Active Member
Joined
Mar 8, 2007
Messages
80
Reaction score
0
Location
Durban
How much n how long would it take to start a basic search engine, seeing that i dont know how to desing one?
 
eish...

here's a tip - you need to make a program to gather text from websites, and maybe even check the websites links, and go to them (crawler) and then bring back the keywords and organise it into a database.

then you need to code a website that will search your database.

GOOD LUCK LOL
 
question is what do uknow about search algorithms... Do u have a specific market you're after and a plan on being better than any of the edtablished players?
 
i dont think coding the actual engine would be the biggest problem, you are gonna pay quite allot for the servers and bandwidth in SA if you want it at all to be useful.
 
cbrunsdonza said:
Lots of bandwidth, lots of servers to crawl the web, and big hard drives. Sorry but 1Tb won't cut it here.
Click to expand...

actually you can get a crapload of indexes on 1 TB, but it's still a pitty as that mega 1TB index will only add up to 0.0001 % of the Web - so your crawlers might index a crapload, but when searching for "balloon baboon sport" you would get only a few or even 0 results, instead of millions like google.

also, if you gonna index the web (as far as you can), I hope you're using uncapped :D
 
I saw something about open source search engines on wikipedia. Would it be possible for me to just get one of them, customise a bit and launch my own search engine? If so, which one would be easier to manage?
 
There are quite a few scripts available which retrieve results from Google, Yahoo and Live, and which you can customize to create your "own" search engine.
 
Some one else went and did the search engine i had in mind. It's called monstercrawler.com. To start a search engine that's going to go head to head with this monster crawler, what do I need to do or have?
 
muzix1 said:
To start a search engine that's going to go head to head with this monster crawler, what do I need to do or have?
Click to expand...
Off the top of my head:
1. Move to a country with proper internet
2. Organize some venture capital....probably a million as a bare minimum
3. Read up on GFS
4. Give up

The problem is, that half of a search database is useless...you need something to indexes a major part of the internet before it becomes anything close to useful...and then you need a major epiphany to sort everything in a way that makes sense and is useful.

Also look a cuil.com. They had $33 million and the end result is pretty useless imo.:rolleyes:
 
What about a search engine that specializes in Local only traffic and then uses google for international? Local bandwidth is cheap and half of my searches is local anyway.
 
You must log in or register to reply here.
Back
Top
Sign up to the MyBroadband newsletter
X