The Pegasus Workflow Management System encompasses a set of technologies which help workflow-based applications execute in a number of different environments, including desktops, campus clusters, grids, and clouds. It bridges the scientific domain and the execution environment by automatically mapping high-level workflow descriptions onto distributed resources. It automatically locates the necessary input data and computational resources necessary for workflow execution. It enables scientists to construct workflows in abstract terms without worrying about the details of the underlying execution environment or the particulars of the low-level specifications required by the middleware (Condor, Globus, or Amazon EC2). It bridges the current cyberinfrastructure by effectively coordinating multiple distributed resources.
Django-live-profiler is a low-overhead data access and code profiler for Django-based applications. Profiling Web applications on a development environment often produces misleading results due to different patterns in the data, different patterns in user behavior, and differences in infrastructure. All existing DB access profiling solutions for Django seem to focus on a single request, but in the real world certain queries might be negligible in a single request while still putting a considerable strain the database across all requests. Django-live-profiler aims to solve these issues by collecting database usage data from a live application.
WTMParse is a script originally intended for use in forensic examinations which parses WTMP files from Unix-like operating systems and generates a CSS-styled HTML report containing the login terminal, username, log start date, and login time/date in a table. It's good for postmortem forensic examinations or as a way of getting "last"-like information when you don't have the ability to boot the machine in question but can grab the wtmp.
git-flow Python Edition is a a pure Python implementation of git-flow. All sub-commands share a common back-end to ensure features behave the same, whatever branch-type they are working on. New workflow behavior can also be added easily by simply sub-classing existing ones. It also includes a comprehensive unit test suite, decent man pages, and HTML docs.
MASTIFF is a static analysis framework which automates the process of extracting key characteristics from a number of different file formats. To ensure the framework remains flexible and extensible, a community-driven set of plugins is used to perform file analysis and data extraction. While originally designed to support malware, intrusion, and forensic analysis, the framework is well-suited to support a broader range of analytic needs. In a nutshell, MASTIFF allows analysts to focus on analysis rather than figuring out how to parse files.
copymon provides file copying processes with a progress bar. Neither cp nor rsync provide means to monitor the copying process, nor a progress bar. copymon is a wrapper which performs a scan of the directory to be copied and collects information about the files to be copied. After that, it spawns the actual copying program (which can be cp, rsync, or tar) and monitors its progress. copymon can be easily enhanced to support more programs and can be extended to provided different types of progress bars.