ANN: DBFunctor – Functional Data Management / ETL Data Processing in Haskell

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

ANN: DBFunctor – Functional Data Management / ETL Data Processing in Haskell

Nikos Karagiannidis
Dear all,

I am pleased to announce the release on Hackage of a new Haskell ETL Library, namely DBFunctor-0.1.0.0.

(“ETL” stands for Extract Transform and Load and is the standard technology for accomplishing data management tasks in Data Warehouses / Data Marts and in general for data migrations, or for preparing data for any analytic purpose (Ad hoc queries, data exploration/data analysis, Reporting and Business Intelligence, feeding Machine Learning algorithms, etc.))

Version 0.1.0.0 can be used for in-memory data processing without the need of some external database. It is just a Haskell library linked in your Haskell program that enables full SQL functionality over tabular data (e.g., CSV files) but also the ability to write a full ETL data processing flow.

Key features of this release are:

1. Julius DSL: A Type-Level Embedded Domain Specific Language (EDSL) for ETL
2. Supports all known relational algebra operations
3. Implements the ETL Mapping and other typical ETL constructs and operations
4. Applicable to all kinds of tabular data
5. In-memory, database-less data processing

For more information please check out the project homepage: https://github.com/nkarag/haskell-DBFunctor

Also there is a tutorial that can help you to easily get started with Julius DSL:
https://github.com/nkarag/haskell-DBFunctor/blob/master/doc/JULIUS-TUTORIAL.md

* Learn how to implement your ETL flows with Julius DSL
* Learn how to implement common ETL operations (append a delta to some target table, or create a surrogate key column etc.)
* Build your own aggregate or analytic functions (string_agg, or a montlhy running total)
* Express complex queries with Julius (equivalent to the WITH-clause in SQL)
* and many more ...

For any issues/problems with the DBFunctor package please open an issue on github.

Happy data processing!

Thank you.

Best Regards,
Nikos

_______________________________________________
Haskell mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/haskell