ASPseek is an Internet search engine, written in C++ using the STL library. It consists of an indexing robot, a search daemon, and a search frontend (CGI or Apache module). It can index as many as a few million URLs and search for words and phrases, use wildcards, and do a Boolean search. Search results can be limited to time period given, site, or Web space (set of sites) and sorted by relevance (PageRanks are used) or date. It is optimized for multiple sites (threaded index, async DNS lookups, grouping results by site, and Web spaces), but can be used for searching one site as well. It can work with multiple languages/encodings at once (including multi-byte encodings such as Chinese) due to optional Unicode storage mode. Other features include stopwords and ispell support, a charset and language guesser, HTML templates for search results, excerpts, and query words highlighting.
Deadman's Redirect is designed to replace whatever is loaded when you click on the Home button in your browser. It is a Web surfer's power tool that can be completely customized, using HTML, to fit the needs of the user. It allows for URL redirection as well as an interface to various search engines through its aliasing system. It also supports user-set aliases with functional arguments, RSS headlines, and a history of all the URLs that pass through it.
DirList is a user directory system that runs as a CGI to serve up user lists, search for various user attributes, view their web sites, define personalised user attributes, and keep it all synchronized automatically with the underlying operating system's user database on periodic intervals with cron.
eXist is a native XML database featuring efficient, index-based XPath query processing, extensions for keyword search, XUpdate support, and tight integration with existing XML development tools. The database is lightweight and may be easily deployed in a number of ways, running either as a stand-alone server process, inside a servlet engine, or directly embedded into an application.
mp3riot (formerly known as f2html.pl) is a command line utility that searches recursively through directories, builds a file list (with additional file information), and generates HTML files, playlists, etc. The output can be controlled, links can be corrected, and more. The script is mainly desigend to create Web pages, playlists, and databases for MP3 and Ogg files, but can also used for other purposes.
FemFind is a crawler and search engine for SMB shares (provided by Samba/Unix or Windows) and FTP servers. The crawler maps the filesystem structure of your shares to a MySQL database. Then, the Web interface or a Windows client can be used to quickly locate any file on the network.