Tins · File formats
arrow-mlake
The Apache Arrow memory layout, the C Data Interface and IPC streams in pure Mojo, with no FFI: its one dependency is memory-region-mojo. A stopgap until marrow, the community Arrow for Mojo, builds on Mojo 1.x.
What it does
Works today
- ArrayData and ArrayArena: flat, nested and extension types
- Export and import over the C Data Interface, release callbacks and all
- IPC stream writer and reader, with a bounds-checked FlatBuffers reader
- What parquet hands its batches back in
Correctness
Checked against pyarrow imports what it exports over C, and reads and writes its IPC streams both ways
Also in File formats
- parquet read · write · every encoding · Arrow out
- parquet-full parquet · plus ZSTD, BROTLI and LZ4
- avro object container files, both ways
- roaring 32/64-bit · deletion vectors
- Every tin