Build a Custom Open Source Search Index

Here’s a little plug for something we’ve been working hard at over at Koders. Everyone knows that if you want to find open source code, you go to http://www.koders.com/ (it recently got a minor new facelift so check it out). That’s my area of responsibility here. However, after many many months of hard work, we released Koders Pro Edition 1.0 this week. I helped a bit with this, but it’s mostly due to the hard work of the rest of the team that this is out there, especially Ben, the product manager for Pro.

The Yin-Yang of Open Source and Private CodePro Edition is the yin to the Koders.com yang. Pro Edition is great for searching and sharing your and your team’s internal code.

This should not be confused with desktop code search, although it can certainly be used in that manner. Rather, it’s more similar to the Google Search Appliance. Something you can install on a server, point it to your source control or files system, and now your whole team can quickly search and find your internal code.

While the focus of Pro Edition is on indexing your internal code, it doesn’t preclude you from indexing public open source code. After all, Pro Edition is cut from the same cloth (though scaled down) as the indexer we use for http://www.koders.com/, so you’re getting a lot of power under the hood.

Pro Edition allows private and public code to be intermingled if you so desire. For example, suppose your company has a limited set of open source projects you’d like to be able to search. Because Pro Edition supports indexing any CVS and Subversion repository (the two most widely used source control systems used by open source projects), there’s nothing stopping you from pointing your local Pro Edition at an open source code repository and start indexing that code along with your internal code.

Doing this would allow you to create a private searchable index of “approved” open source code. If this sounds interesting to you, try out the free trial.

Technorati Tags: , ,

What others have said

Requesting Gravatar... beebe4 Sep 14, 2007 11:11 AM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
Once again you didn't warn me that Paris Hilton was going to link to my blog. You really are going to make me start writing some real content, aren't you.
Requesting Gravatar... Sean Chambers Sep 14, 2007 5:17 PM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
Phil,

I normally enjoy all of your posts, although this one not so much so. Even though this is very interesting, it sounds more like a product pitch than something you would normally blog about.

I agree that this is a very cool tool, although I couldn't say this is something that I would use. Come up with a tool like CruiseControl or NUnit and you have my attention. Coming up with something like this just seems futile to me.

Sorry, just honesty.

Sean
Requesting Gravatar... Haacked Sep 14, 2007 5:39 PM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
Hey Sean,

I appreciate the honesty. I suppose it's a fine line between writing about what you do at work and coming across as "pitching" a product.

This is pretty much what we've spent the bulk of our time working on in the last few months on. I'm more on the website integration aspect, while my coworker Ben on Pro Edition.

I was trying to find an interesting angle on Pro Edition that I thought would fit my blog, because I think writing about what I do at work might be mildly interesting. The product pitch feel is due to my lack of writing skills, perhaps.

In any case, have you tried www.koders.com and do you find that useful at all?

One thing I like about Koders.com (and by association Pro edition) is being able to share code easily. For example, it's easy to email someone a link to a specific line of code.

In any case, I promise I won't pitch anything unless I can write a really interesting use case for it from now on. :)
Requesting Gravatar... Mads Kristensen Sep 15, 2007 12:52 AM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
Great news! I use koders.com from time to time and find it very useful, but it has a serious bug. The BlogEngine.NET project on CodePlex isn't indexed :)
Requesting Gravatar... Sean Chambers Sep 15, 2007 6:36 AM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
Phil,

Thank you for the polite response. You are very polite with all of your comments and that pleases me.

As far as koders.com, I beleive that I do need to use it more. I made my last comment without full knowledge of koders.com and I need to spend more time to take a look at it before I make a judgement on it I think.

Sorry if I came off a little snippy. I had just downed a 6 pack of Grolsch after a stressful week =)

Keep up with the posts! I love reading your blog.
Requesting Gravatar... Jason Haley Sep 15, 2007 8:42 AM
# Interesting Finds: September 15, 2007
Requesting Gravatar... Haacked Sep 15, 2007 3:23 PM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
@Sean, what are you doing reading my blog after a 6-pack? You should write code after a 6-pack! ;)

@Mads, I sent a reminder email to my work address to make sure it gets in the index.
Requesting Gravatar... Mads Kristensen Sep 15, 2007 5:56 PM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
Thanks Phil
Requesting Gravatar... Simone Busoli Sep 16, 2007 2:54 PM
# re: Build A Custom Open Source Search Index With Koders Pro Edition
It's not even comparable to the features provided by Koders Pro but CS2 (http://code.google.com/p/cs2project/) is an open source free personal code search engine.
Requesting Gravatar... Sameer Sep 18, 2007 1:39 PM
# re: Build a Custom Open Source Search Index
Hey Phil, those colored blocks around the word "open source" are very distracting...
Requesting Gravatar... Haacked Sep 18, 2007 3:43 PM
# re: Build a Custom Open Source Search Index
@Sameer thanks for the heads up. I had to recreate the post from the Google cache and forgot to clean it up.
Requesting Gravatar... mausch Sep 19, 2007 7:26 PM
# re: Build a Custom Open Source Search Index
There's also OpenGrok, although it doesn't nearly have as many features as koders, and it doesn't parse C# or VB.NET correctly (yet)

What do you have to say?

(will show your gravatar)
Please add 3 and 8 and type the answer here: