Version 0.78 of Yioop!
Release Notes: Character n-grams are now supported for many languages that did not have a stemmer. Language detection was improved and better UTF-8 preparation was provided for downloads. Yioop!'s ability to following redirects, including bit.ly redirects, was improved. Proximity scoring of text in documents has also been enhanced.
Other releases
Release Notes: This release adds a simple language called Page Rules for controlling how data is extracted from webpages during the summary creation phase of indexing. It also adds the ability to index records coming from a database query and adds a generic text importer which works on plain text, gzip'd, and bzip'd text records. Other features in this version of Yioop are Atom support as a News Feed Search Source, a dedicated process new_updater.php for handling news updates, and a better algorithm for distributing archive data during an archive crawl. Many other minor improvements have been made.
Release Notes: This release supports materializing as new indexes query-based combinations (crawl mixes) of old search indexes. This should make query performance of crawl mixes much better. Cache pages of search results now have a new history UI which allows you to search cache pages in all indexes you have, much like the way Internet Archive does. Yioop now supports spell corrections on searches after they have been performed, and it has an API for transliterating between roman and other scripts. Query performance has been improved over previous versions, and lots of minor bugs have been fixed.
Release Notes: This release adds an activity to manage search media sources. For now, one can add Video and RSS sources. When configured, RSS feeds download hourly and are integrated into search results. Also new is a command line tool for configuring Yioop in VPS settings. An Italian stemmer has been added, as well as more translations. This version implements some important bugfixes in robot handling, as well as unit testing of these. Yioop! now works in PHP 5.4 as well as PHP 5.3, and plays friendlier with more recent versions of Xampp on Windows.
Release Notes: This release adds image and video subsearch abilities and improves the formatting of Yioop on smart phones. Exact phrase searching is now done using only posting list information, rather than regex. Archive crawls can now, like Web crawls, exploit the presence of multiple queue_servers. Index iterators and summary lookup operations have been factored apart to better optimize Yioop search speed. Improvements have also been made to keyword suggestions.
Release Notes: This release adds initial support for word suggestions as a user types in queries. The bigramming used to speed common two word queries now works with n word grams. N word gram filter files can now be created using Wikipedia raw page count dumps. This version adds support for * and $ in allowed- and disallowed-to-crawl sites. Using this, the user can crawl sites to a fixed depth. Robots.txt processing now supports * and $ in robot.txt paths. Support for NOSNIPPET, NOARCHIVE, and X-Robots-tag HTTP headers has also been implemented. A tool for editing search summaries after a crawl has also been added.
