ANN: DBFunctor – Functional Data Management / ETL Data Processing in Haskell
I am pleased to announce the release on Hackage of a new Haskell ETL Library, namely DBFunctor-0.1.0.0.
(“ETL” stands for Extract Transform and Load and is the standard technology for accomplishing data management tasks in Data Warehouses / Data Marts and in general for data migrations, or for preparing data for any analytic purpose (Ad hoc queries, data exploration/data analysis, Reporting and Business Intelligence, feeding Machine Learning algorithms, etc.))
Version 0.1.0.0 can be used for in-memory data processing without the need of some external database. It is just a Haskell library linked in your Haskell program that enables full SQL functionality over tabular data (e.g., CSV files) but also the ability to write a full ETL data processing flow.
Key features of this release are:
1. Julius DSL: A Type-Level Embedded Domain Specific Language (EDSL) for ETL 2. Supports all known relational algebra operations 3. Implements the ETL Mapping and other typical ETL constructs and operations 4. Applicable to all kinds of tabular data 5. In-memory, database-less data processing
* Learn how to implement your ETL flows with Julius DSL * Learn how to implement common ETL operations (append a delta to some target table, or create a surrogate key column etc.) * Build your own aggregate or analytic functions (string_agg, or a montlhy running total) * Express complex queries with Julius (equivalent to the WITH-clause in SQL) * and many more ...
For any issues/problems with the DBFunctor package please open an issue on github.