Code Indexer

Project Name

Source Code Indexing Service Analysis

Project Description

Mozilla’s source code is enormous—millions of lines of C, C++, JavaScript, Perl, Python, Java, C#, etc. Developers currently use the lxr system to quickly search and browse it on-line: http://lxr.mozilla.org. Mozilla is planning a move from CVS to Subversion for revision control, and at the same time wants to evaluate other source indexing services. Two BSD students are working to setup, document, and test other potential services (e.g., fisheye, opengrok, mxr) on one of the Seneca-Mozilla servers (see below). In each case this requires configuration changes and some scripting to get the services to properly integrate with Mozilla’s other on-line tools. When the test services are installed and synched with the live source tree, Mozilla will point its developers to them and get feedback—the students will help collect and synthesize this feedback.

Project Leader(s)

John Ford (John64)

Project News and Details

Status

• Waiting to see about a license for fisheye
• OpenGrok has rudimentary (ie a kludge) support for branching.

Candidates

Serious Candidates

• LXR/MXR/Bonsai - Not working on setting one up because there is already one
• OpenGrok - As this is becoming my main focus, I am breaking it out into its own page.
• Fisheye - Commercial Solution that is free (as in beer) for open source projects.

Others

• Horus - Not really what is needed, but its a nice interface for programming students own code. I will not be actively doing anything to it.
• Sourcenav - investigating this project
• Gonzui - Fairly basic on second examination
• Google Code Search - No way to specify the Mozilla project only

Links

• Official Blurb just in case I forget what I am doing :P
• John's School Page
• CVS2SVN Tool to convert CVS to SVN. Will be used to test SVN interop.
• Tomcat on Wikipedia
• CVS Checkout
• Rsyncing the CVS
• Tomcat5 on Ubuntu
• Tomcat Tips
• CVS on non-gnu.org
• CVS "Guide"
• Subversion
• Blog Entry on OpenGrok
• Java5 on Ubuntu - "sudo update-alternatives --config java" and "apt-get remove --purge java-gcj-compat"
• Tomcat4 Doc - possibilities for setting up catalina.policy correctly
• CVS Tags - to get the branches to checkout
• Tomcat SSI Howto
• CVSUP Guide for FreeBSD
• Mozilla Jargon
• link 45

Notes on Accessing Test Server

If you want to access the test server through anything other than port 80, you are going to have to type in the following address into a browser and note the IP address you get in your address bar. This is because I have dynamic DNS. Everything, including the source itself, will be in the http root for easy access to the files. This is not optimal, and will not stay this way once things advance.

Superfind - Will resolve as www.no-ip.com computer, which is why you have to use a browser to get the IP

Services

Service	Port
OpenGrok	8180 or 80
Fisheye	81

Questions

Please edit in an answer if you know

Pulling CVS

This code will pull the CVS for the branches specified in @branches

#!/usr/bin/perl
use strict;
use warnings;

# Pull CVS from the mozilla project server
my $src_root = "/var/mozilla";

# Where is your make executable (Mozilla needs 3.80, nothing else)
my $make = "/home/jhford/oldmake/make";

# Where is your run.sh for opengrok???
my $opengroker = "/var/opengrok/run.sh";

# Branches to be pulled
my @branches = (
  "HEAD", 
  "REFLOW_20061031_BRANCH", 
  "MOZILLA_1_8_0_BRANCH", 
  "MOZILLA_1_8_BRANCH", 
  "MOZILLA_1_7_BRANCH", 
  "AVIARY_1_0_1_20050124_BRANCH"
);

system ("rm -rf ${src_root}/*");

foreach (@branches){
  system("
    mkdir ${src_root}/$_;
    cd ${src_root}/$_;
    cvs -d :pserver:anonymous:anonymous\x40cvs-mirror.mozilla.org:/cvsroot co -r $_ mozilla/client.mk;
    make -f ${src_root}/${_}/mozilla/client.mk checkout MOZ_CO_PROJECT=all;
  ");
}

system ("bash $opengroker");