TechAscent - DuckDB - Data power tools for your laptop, now in Clojure
- 2023-09-02Establishing the NeedOur in-memory column-major data processing platform, tech.ml.dataset (TMD), drives the future of functional data science.
- When data gets large enough not to fit in memory, one can continue with TMD by operating on samples of data, or otherwise filtering to relevant subsets to fit in bounds imposed by the working environment.
- Moreover, one can accomplish persistence, for data small and large, with nippy, arrow, or parquet.
Unverified
- 2023-09-02Establishing the NeedOur in-memory column-major data processing platform, tech.ml.dataset (TMD), drives the future of functional data science.
- When data gets large enough not to fit in memory, one can continue with TMD by operating on samples of data, or otherwise filtering to relevant subsets to fit in bounds imposed by the working environment.
- Moreover, one can accomplish persistence, for data small and large, with nippy, arrow, or parquet.
Sources: Techascent