loggerfs is a FUSE-based virtual file system that automatically parses log files and sends that information to a MySQL or PostgreSQL database. Existing log parsers usually run periodically and scan the entire file for changes. loggerfs takes a different approach by providing a virtual file system. Whenever data is appended to a virtual file by the logging daemon, the information is directly stored in the database. There is no need to poll the file and monitor for changes.
|Tags||Database Systems Administration Logging Filesystems|
Release Notes: There is now some good documentation on how to install and use loggerfs. This release features man pages, MySQL caching, various improvements, and .deb packages for those using an OS that supports the Debian package manager.
Release Notes: Some minor features were added, such as support for fuse-options and setting owner permissions. Some performance enhancements were made. This release has been tested in a production environment for a while.
Release Notes: PostgreSQL database connections may now be cached. loggerfs now first splits the input buffer by newlines, which means that you'll be able to feed an existing log file into loggerfs by writing it to a file in the filespace of loggerfs.
Release Notes: Most notably, support for storing log files in MySQL was added. Two simple shell scripts were created: createlog and loggerfs-reload. The former asks you a series of questions and then creates the correct XML in the logs.xml configuration file. The latter script can be called to reload the configuration files (schema.xml and logs.xml) while the file system is mounted. Support for the Syslog format was improved, and the ability to store PostgreSQL logs was added.
Release Notes: A minor bug was fixed where it wouldn't look at the right configuration directory if --prefix wasn't given during the ./configure step. More importantly, the ability to reload the configuration files while the file system is mounted was added. What this means is that now you won't need to unmount and remount the file system every time you want to add or delete another log file or schema. This should make using and debugging the system a whole lot easier.