VoltDB is a blazingly fast relational database system. It is specifically designed to run on modern scale-out architectures: fast, inexpensive servers connected via high-speed data networks. It is aimed at a new generation of database applications - real-time feeds, sensor-driven data streams, micro-transactions, low-latency trading systems - requiring database throughput that can reach millions of operations per second. What’s more, the applications that use this data must scale on demand, provide flawless fault tolerance, and enable real-time visibility into the data that drives business value. It includes client application drivers for applications written in Java, C++, C#, PHP, and Python. VoltDB community members have also authored client libraries for Erlang, Ruby and Node.js. There are streaming export capabilities for leading analytic database environments, including Apache Hadoop.
Ebot is a scalable and distribuited Web crawler. The URLs are saved to a NOSQL database (which supports map/reduce queries) that you can query via RESTful HTTP requests or using your preferred programming languages. The URLs that need to be analyzed are sent to AMQP queues. In this way, it is possible to run several crawlers in parallel and stop and start them without losing URLs.