Projects / loggerfs

loggerfs

loggerfs is a FUSE-based virtual file system that automatically parses log files and sends that information to a MySQL or PostgreSQL database. Existing log parsers usually run periodically and scan the entire file for changes. loggerfs takes a different approach by providing a virtual file system. Whenever data is appended to a virtual file by the logging daemon, the information is directly stored in the database. There is no need to poll the file and monitor for changes.

Tags
Licenses
Implementation

Recent releases

  •  23 Oct 2007 09:30

    Release Notes: There is now some good documentation on how to install and use loggerfs. This release features man pages, MySQL caching, various improvements, and .deb packages for those using an OS that supports the Debian package manager.

    •  10 Oct 2007 13:00

      Release Notes: Some minor features were added, such as support for fuse-options and setting owner permissions. Some performance enhancements were made. This release has been tested in a production environment for a while.

      •  23 Jul 2007 06:54

        Release Notes: PostgreSQL database connections may now be cached. loggerfs now first splits the input buffer by newlines, which means that you'll be able to feed an existing log file into loggerfs by writing it to a file in the filespace of loggerfs.

        •  15 Jul 2007 06:51

          Release Notes: Most notably, support for storing log files in MySQL was added. Two simple shell scripts were created: createlog and loggerfs-reload. The former asks you a series of questions and then creates the correct XML in the logs.xml configuration file. The latter script can be called to reload the configuration files (schema.xml and logs.xml) while the file system is mounted. Support for the Syslog format was improved, and the ability to store PostgreSQL logs was added.

          •  09 Jul 2007 13:35

            Release Notes: A minor bug was fixed where it wouldn't look at the right configuration directory if --prefix wasn't given during the ./configure step. More importantly, the ability to reload the configuration files while the file system is mounted was added. What this means is that now you won't need to unmount and remount the file system every time you want to add or delete another log file or schema. This should make using and debugging the system a whole lot easier.

            Recent comments

            24 Oct 2007 03:31 MarcusWolschon

            nice
            Sounds like a nice hack to get programs that can only

            log to files to log into a DBMS.

            Screenshot

            Project Spotlight

            OpenStack4j

            A Fluent OpenStack client API for Java.

            Screenshot

            Project Spotlight

            TurnKey TWiki Appliance

            A TWiki appliance that is easy to use and lightweight.