A pure Julia implementation of the apache arrow memory format specification.

This implementation supports the 1.0 version of the specification, including support for:

  • All primitive data types
  • All nested data types
  • Dictionary encodings, nested dictionary encodings, and messages
  • Extension types
  • Streaming, file, record batch, and replacement and isdelta dictionary messages
  • Buffer compression/decompression via the standard LZ4 frame and Zstd formats

It currently doesn't include support for:

  • Tensors or sparse tensors
  • Flight RPC
  • C data interface

Third-party data formats:

See docs for official Arrow.jl API with the User Manual and reference docs for Arrow.Table, Arrow.write, and Arrow.Stream.