The Ex-Crawler Project is divided into three subprojects. The main part is the Ex-Crawler daemon server, a highly configurable and flexible Web crawler written in Java. It comes with its own socket server, with which you can manage the server, users, distributed grid/volunteer computing, and much more. Crawled information is stored in a database (Currently MySQL, PostgreSQL, and MSSQL are supported). The second part is a graphical (Java Swing) distributed grid/volunteer computing client, including user computer state detection, based on JADIF Project. The Web search engine is written in PHP. It comes with a Content Management System, user language detection and multi-language support, and templates using Smarty, including an application framework that is partly forked from Joomla 1.5, so that Joomla components can be adapted quickly.
Web Search Script can search the contents of a text file stored on your server by editing the script source code, or the file location can be left blank to allow your users to enter a URL to a text document stored on a remote Web server. Search results will be listed by line number, with contextual information surrounding the search term. Clicking search results will scroll the complete text in the right pane to the result's location in the complete text.