# magmalake > Data pipelines in Mojo: Orca schedules them, Dista runs them across a cluster, and a native Iceberg, Parquet and codec stack, published as tins on mojoshelf, reads and writes the data. No Python or JVM in the path. Every page below is the Markdown twin of a page on https://magmalake.dev: the same URL with .md appended (the home page is /index.md). /llms-full.txt has them all in one file. ## Start here - [Data processing in Mojo](https://magmalake.dev/index.md): Data pipelines in Mojo: checked by the compiler, distributed with Dista, recorded in Postgres so they resume and retry, documented for coding agents, and built on a native Iceberg stack published as tins on mojoshelf. - [Getting started](https://magmalake.dev/getting-started.md): Build a lake of GitHub activity on magmalake: see it running, then build it by handing a coding agent the skills and a prompt, or step by step from pixi and mojoshelf to Orca pipelines, a flare console, a local run and a deploy to AWS. - [Let an agent build it — Getting started](https://magmalake.dev/getting-started/agent.md): Let a coding agent build a lake of GitHub activity on magmalake: install the skills for Mojo, magmalake, mojoshelf and AWS, and give it the prompt that built mojo-census. - [Step by step — Getting started](https://magmalake.dev/getting-started/step-by-step.md): Build a lake of GitHub activity on magmalake by hand: pixi and mojoshelf, a project with Orca in it, the pipelines and the flare console of mojo-census, a local run, and a deploy to AWS with orca aws. ## Orca - [Orca: orchestration for Mojo data pipelines](https://magmalake.dev/s/orca.md): Orca orchestrates data pipelines written in Mojo: DAGs declared in Mojo and checked by the compiler, cron schedules and backfills, steps that run on Dista, datasets in Iceberg tables and state in Postgres. Early, open source, four phases of five done. - [Docs · Orca](https://magmalake.dev/s/orca/docs.md): How to use Orca: installing it, then writing a pipeline, its command line, scheduling and running it here or on Kubernetes or EC2, the web UI, and debugging failed runs, each on a page of its own. - [Writing a pipeline · Orca docs](https://magmalake.dev/s/orca/docs/build.md): Writing an Orca pipeline: steps and pipelines checked by the compiler, partitions by date or by name, cron schedules in time zones, keyed pipelines, Iceberg tables and datasets, sensors, Dista inside steps, and building the pipeline binaries and the orca command. - [The command line · Orca docs](https://magmalake.dev/s/orca/docs/cli.md): Orca's command line: the two binaries you run, a pipeline's own and the orca command; the commands you type on each; the commands orca runs for you and you'll see in its logs; exit codes; and how the same binary acts on this machine or on AWS through its environment. - [Debugging failures · Orca docs](https://magmalake.dev/s/orca/docs/debug.md): Debugging a failed Orca run: where its errors and logs are, in the UI and in S3, what a raised error carries and how to add context to it, crash stack dumps and how the image symbolizes them, reproducing a partition locally, and resuming or rerunning it. - [Scheduling and running · Orca docs](https://magmalake.dev/s/orca/docs/run.md): Scheduling and running Orca pipelines: the scheduler and its fires, retries and limits, runs on this machine, on Kubernetes or on EC2, runs recorded and resumed in Postgres, logs and machine metrics, lineage and rebuilds, every environment variable, and what happens when things fail. - [The UI · Orca docs](https://magmalake.dev/s/orca/docs/ui.md): Orca's web UI: its pages and their JSON, the actions that start, backfill, resume, rerun and cancel runs, logins and sessions, a run's Dista timeline and instances, and links to the code. ## Dista - [Dista: distributed tasks for Mojo](https://magmalake.dev/s/dista.md): Dista runs Mojo functions across a cluster: declare a task, call it, and the work spreads over the machines, with results staying where they were computed. Early, open source, and measured against Ray and Rust. - [Docs · Dista](https://magmalake.dev/s/dista/docs.md): How to use Dista: installing it and a first program, then tasks and results, shuffles, actors, running a cluster, the dista command, failure and recovery, and tuning, each on a page of its own. - [Actors and checkpoints · Dista docs](https://magmalake.dev/s/dista/docs/actors.md): Dista's actors: state on a worker of its own with methods called in order, handles passed to tasks and other actors, restarts when a worker dies, checkpoints to a directory or S3, and actors moving off a draining worker. - [The dista command · Dista docs](https://magmalake.dev/s/dista/docs/cli.md): The dista command: a generic head, status and status --json, drain, scale --once, timeline and stop; Prometheus metrics on the head and workers; and the task timeline in Chrome's trace format. - [Running a cluster · Dista docs](https://magmalake.dev/s/dista/docs/cluster.md): Running Dista: local mode, roles from the environment, the generic dista head, Kubernetes manifests and EC2, draining a worker on SIGTERM or by name, autoscaling with dista scale, and every environment variable. - [Failure and recovery · Dista docs](https://magmalake.dev/s/dista/docs/failures.md): What Dista does when things fail: a task that raises, a worker that dies or goes silent, a peer that can't be reached, a task that runs too long, a driver that leaves, and a head that restarts; and how it's tested. - [Shuffles · Dista docs](https://magmalake.dev/s/dista/docs/shuffles.md): Shuffles in Dista: TaskMany for a task with several results, TaskWith for a value beside other tasks' results, partitioning again what earlier tasks made, placement by data location, and spilling past the node store. - [Tasks and results · Dista docs](https://magmalake.dev/s/dista/docs/tasks.md): Dista's tasks: declaring them with up to three arguments, where their results live, freeing results with take and release, tasks on other tasks' results, cancelling and waiting with a timeout, and what can cross the wire. - [Tuning · Dista docs](https://magmalake.dev/s/dista/docs/tuning.md): Tuning Dista: tasks in flight per worker, backpressure limits on the head's queue and a slow driver, the node store and spilling, the memory a driver's results hold, large results in parts, and logging a task's inputs. - [Performance · Dista](https://magmalake.dev/s/dista/performance.md): Dista measured against Ray and Rust on 1.4 billion taxi trips in S3: distributed runs on 3 to 12 nodes, a shuffle against Ray, a task timeline, single-process references, image sizes, and how to reproduce every number. ## Tins - [Performance](https://magmalake.dev/performance.md): The strongest magmalake benchmarks against pyarrow and other references, including where it loses, with links to each tin's full numbers and to Dista's. - [arrow-mlake](https://magmalake.dev/s/arrow-mlake.md): arrow-mlake, a magmalake tin: The Apache Arrow memory layout, the C Data Interface and IPC streams in pure Mojo, with no FFI: its one dependency is memory-region-mojo. - [arrow-mlake docs](https://magmalake.dev/s/arrow-mlake/docs.md): How to use arrow-mlake, a magmalake tin. - [avro](https://magmalake.dev/s/avro.md): avro, a magmalake tin: Pure-Mojo Apache Avro: schema parsing, the binary encoding, Object Container Files both ways, and schema resolution. - [avro docs](https://magmalake.dev/s/avro/docs.md): How to use avro, a magmalake tin. - [avro performance](https://magmalake.dev/s/avro/performance.md): How fast avro is: measured numbers, what profiling found, and its benchmark history. - [brotli](https://magmalake.dev/s/brotli.md): brotli, a magmalake tin: A Mojo binding to libbrotli, the last of the seven Parquet page codecs. - [brotli docs](https://magmalake.dev/s/brotli/docs.md): How to use brotli, a magmalake tin. - [brotli performance](https://magmalake.dev/s/brotli/performance.md): How fast brotli is: measured numbers, what profiling found, and its benchmark history. - [deflate](https://magmalake.dev/s/deflate.md): deflate, a magmalake tin: DEFLATE (RFC 1951) and gzip (RFC 1952) in pure Mojo, the compression inside Avro's deflate codec and Parquet's GZIP codec. - [deflate docs](https://magmalake.dev/s/deflate/docs.md): How to use deflate, a magmalake tin. - [flare_mlake](https://magmalake.dev/s/flare_mlake.md): flare_mlake, a magmalake tin: A packaged build of flare by Ehsan M. Kermani — TCP, UDP, TLS, HTTP/1.1, HTTP/2, HTTP/3, QUIC, WebSocket and gRPC for Mojo — republished only because flare is not on a conda channel. - [flare_mlake docs](https://magmalake.dev/s/flare_mlake/docs.md): How to use flare_mlake, a magmalake tin. - [hashes](https://magmalake.dev/s/hashes.md): hashes, a magmalake tin: The three hashes Iceberg and Parquet actually need — CRC-32, MurmurHash3 x86-32 and XXH64 — in pure Mojo, with no dependencies and no FFI. - [hashes docs](https://magmalake.dev/s/hashes/docs.md): How to use hashes, a magmalake tin. - [hashes performance](https://magmalake.dev/s/hashes/performance.md): How fast hashes is: measured numbers, what profiling found, and its benchmark history. - [iceberg](https://magmalake.dev/s/iceberg.md): iceberg, a magmalake tin: Native Apache Iceberg. - [iceberg-rs](https://magmalake.dev/s/iceberg-rs.md): iceberg-rs, a magmalake tin: Apache Iceberg over a thin Rust cdylib wrapping iceberg-rust behind a C ABI. Superseded — no longer required for any operation — and kept only as a third independent implementation to check the native one against. - [iceberg-rs docs](https://magmalake.dev/s/iceberg-rs/docs.md): How to use iceberg-rs, a magmalake tin. - [iceberg docs](https://magmalake.dev/s/iceberg/docs.md): How to use iceberg, a magmalake tin. - [iceberg performance](https://magmalake.dev/s/iceberg/performance.md): How fast iceberg is: measured numbers, what profiling found, and its benchmark history. - [json_mlake](https://magmalake.dev/s/json_mlake.md): json_mlake, a magmalake tin: A packaged build of json by Ehsan M. Kermani — simdjson-backed JSON parsing for Mojo, CPU and GPU — republished only because json is not on a conda channel. - [json_mlake docs](https://magmalake.dev/s/json_mlake/docs.md): How to use json_mlake, a magmalake tin. - [k8s](https://magmalake.dev/s/k8s.md): k8s, a magmalake tin: A small Kubernetes client for Mojo: pods, jobs and services created, listed, watched and deleted, and pods' logs, in a pod with its service account or from a kubeconfig. - [k8s docs](https://magmalake.dev/s/k8s/docs.md): How to use k8s, a magmalake tin. - [lint](https://magmalake.dev/s/lint.md): lint, a magmalake tin: mojolint, a linter for the origin and threading mistakes the Mojo compiler accepts, asking mojo-lsp-server, the compiler's own frontend, for resolved types and uses. - [lint docs](https://magmalake.dev/s/lint/docs.md): How to use lint, a magmalake tin. - [lz4](https://magmalake.dev/s/lz4.md): lz4, a magmalake tin: A Mojo binding to liblz4 covering the block format, the frame format and the legacy Hadoop framing that older Parquet files still use. - [lz4 docs](https://magmalake.dev/s/lz4/docs.md): How to use lz4, a magmalake tin. - [lz4 performance](https://magmalake.dev/s/lz4/performance.md): How fast lz4 is: measured numbers, what profiling found, and its benchmark history. - [maws](https://magmalake.dev/s/maws.md): maws: the resources in an AWS account, their cost per hour and the bill so far, shown in one terminal screen. Written in Mojo. - [memory-region](https://magmalake.dev/s/memory-region.md): memory-region, a magmalake tin: A region of bytes, on the heap or in a shared mapping, carved by a bump allocator that returns offsets rather than pointers, so whatever is built in it reads the same in any process that maps it. - [memory-region docs](https://magmalake.dev/s/memory-region/docs.md): How to use memory-region, a magmalake tin. - [memory-region performance](https://magmalake.dev/s/memory-region/performance.md): How fast memory-region is: measured numbers, what profiling found, and its benchmark history. - [mozz_mlake](https://magmalake.dev/s/mozz_mlake.md): mozz_mlake, a magmalake tin: A packaged build of mozz by Ehsan M. Kermani — pure-Mojo fuzzing and property-based testing, with shrinking — republished only because mozz is not on a conda channel. - [mozz_mlake docs](https://magmalake.dev/s/mozz_mlake/docs.md): How to use mozz_mlake, a magmalake tin. - [objectstore](https://magmalake.dev/s/objectstore.md): objectstore, a magmalake tin: Storage and HTTP for Iceberg tables: a FileIO abstraction over local files, HTTP(S) range reads and S3, with the pooled HTTP transport the rest of the stack was missing. - [objectstore docs](https://magmalake.dev/s/objectstore/docs.md): How to use objectstore, a magmalake tin. - [objectstore performance](https://magmalake.dev/s/objectstore/performance.md): How fast objectstore is: measured numbers, what profiling found, and its benchmark history. - [parquet](https://magmalake.dev/s/parquet.md): parquet, a magmalake tin: The first native Apache Parquet reader and writer in Mojo. - [parquet-full](https://magmalake.dev/s/parquet-full.md): parquet-full, a magmalake tin: Every Parquet codec the spec defines: parquet-mojo, plus ZSTD, BROTLI and LZ4 through libzstd, libbrotli and liblz4. It lives in the full/ directory of the parquet repository and depends on parquet-mojo, so adding it gives you both, and the import is unchanged. - [parquet-full docs](https://magmalake.dev/s/parquet-full/docs.md): How to use parquet-full, a magmalake tin. - [parquet docs](https://magmalake.dev/s/parquet/docs.md): How to use parquet, a magmalake tin. - [parquet performance](https://magmalake.dev/s/parquet/performance.md): How fast parquet is: measured numbers, what profiling found, and its benchmark history. - [postgres](https://magmalake.dev/s/postgres.md): postgres, a magmalake tin: A PostgreSQL client over libpq: parameterized statements, typed text-format results, transactions with savepoints and COPY, every error carrying its SQLSTATE — and, in a module of its own, a connection pool for a threaded service. - [postgres docs](https://magmalake.dev/s/postgres/docs.md): How to use postgres, a magmalake tin. - [restate](https://magmalake.dev/s/restate.md): restate, a magmalake tin: Durable execution in Mojo, via Restate. - [restate docs](https://magmalake.dev/s/restate/docs.md): How to use restate, a magmalake tin. - [roaring](https://magmalake.dev/s/roaring.md): roaring, a magmalake tin: Pure-Mojo Roaring bitmaps, 32- and 64-bit, implementing the portable RoaringFormatSpec serialization plus Iceberg's deletion-vector v1 blob framing. - [roaring docs](https://magmalake.dev/s/roaring/docs.md): How to use roaring, a magmalake tin. - [roaring performance](https://magmalake.dev/s/roaring/performance.md): How fast roaring is: measured numbers, what profiling found, and its benchmark history. - [snappy](https://magmalake.dev/s/snappy.md): snappy, a magmalake tin: Snappy in pure Mojo — the raw block format and the CRC-32C-checksummed framing format. - [snappy docs](https://magmalake.dev/s/snappy/docs.md): How to use snappy, a magmalake tin. - [snappy performance](https://magmalake.dev/s/snappy/performance.md): How fast snappy is: measured numbers, what profiling found, and its benchmark history. - [sqlite](https://magmalake.dev/s/sqlite.md): sqlite, a magmalake tin: An embedded SQL database: connections, prepared statements, typed columns and RAII transactions over libsqlite3. A fork of ehsanmok/sqlite, made dependency-free so it installs from the registry with no external git repos. - [sqlite docs](https://magmalake.dev/s/sqlite/docs.md): How to use sqlite, a magmalake tin. - [threads](https://magmalake.dev/s/threads.md): threads, a magmalake tin: Minimal OS threads for Mojo: spawn and join pthreads, share state through atomics and a mutex, and fan a loop out over cores with parallel_for. - [threads docs](https://magmalake.dev/s/threads/docs.md): How to use threads, a magmalake tin. - [threads performance](https://magmalake.dev/s/threads/performance.md): How fast threads is: measured numbers, what profiling found, and its benchmark history. - [thrift](https://magmalake.dev/s/thrift.md): thrift, a magmalake tin: Apache Thrift serialization in pure Mojo — compact and binary protocols — plus every struct, union and enum of the Parquet metadata schema, generated ahead of time. - [thrift docs](https://magmalake.dev/s/thrift/docs.md): How to use thrift, a magmalake tin. - [thrift performance](https://magmalake.dev/s/thrift/performance.md): How fast thrift is: measured numbers, what profiling found, and its benchmark history. - [xml](https://magmalake.dev/s/xml.md): xml, a magmalake tin: A small pure-Mojo XML parser for API responses (EC2, S3, Azure Blob): a pull parser, and a flat read-only tree that answers path queries. - [xml docs](https://magmalake.dev/s/xml/docs.md): How to use xml, a magmalake tin. - [zstd](https://magmalake.dev/s/zstd.md): zstd, a magmalake tin: A Mojo binding to libzstd — one-shot and streaming, both directions — through a small C shim loaded at runtime, so consumers need no link flags. - [zstd docs](https://magmalake.dev/s/zstd/docs.md): How to use zstd, a magmalake tin. - [zstd performance](https://magmalake.dev/s/zstd/performance.md): How fast zstd is: measured numbers, what profiling found, and its benchmark history. - [Tins](https://magmalake.dev/tins.md): Every magmalake tin, layer by layer — execution, tables and catalogs, file formats, storage, primitives and utilities — each linking to its own page: what it is, how to install it, what proves it and how fast it is. ## Blog - [Writing](https://magmalake.dev/blog.md): Notes from building a data stack in Mojo — durable execution, file formats, and what the measurements actually say. - [Arrow Flight to integrate your Mojo code in your legacy pipelines](https://magmalake.dev/blog/arrow-flight-as-an-interop-seam.md): Flight allows you to distribute processing between servers. - [Arrow through shared memory, between two processes](https://magmalake.dev/blog/arrow-through-shared-memory.md): What each way of handing Arrow data across a process boundary costs, and how to pick one. - [DuckDB and Mojo: a sound example](https://magmalake.dev/blog/duckdb-and-mojo-a-sound-example.md): Five audio features as ordinary SQL expressions, computed in Mojo on the bytes of the DuckDB vector. What it guarantees, what it costs to carry, and where the speed actually comes from. - [The parquet.mojo correctness bar](https://magmalake.dev/blog/how-far-parquet-mojo-is-validated.md): Our native Parquet reader now reads 66 of the 69 files in Apache's own corpus. - [Multithreading with origins in Mojo 1.0](https://magmalake.dev/blog/multithreading-with-origins-in-mojo.md): The typed context in the previous post erased the origin of the state it shared, and the compiler destroyed that state before the threads started. Here is the one-line fix, the library change behind it, and a test harness that holds the compiler to what it catches and what it does not. - [One source tree, two Mojo versions](https://magmalake.dev/blog/one-source-tree-two-toolchains.md): Mojo 1.0 and nightly will diverge over time. Here is one possible pattern on how to handle that. - [The parquet.mojo performance bar](https://magmalake.dev/blog/parquet-mojo-against-pyarrow.md): Flat columnar reads are ahead of pyarrow on one core and on four, writes are at parity, and nested data loses before threading comes into it. - [Writing async-like code in durable execution](https://magmalake.dev/blog/writing-async-like-code-in-durable-execution.md): Write straight-line Mojo. If the process dies halfway through, it resumes without redoing the work that already succeeded. Here is the whole API, and how to handle every way a step can fail. - [Writing ergonomic multithreaded code in Mojo 1.0, 1.0, 1.0, …](https://magmalake.dev/blog/writing-multithreaded-code-in-mojo.md): First-class async is explicitly post-1.0, and the concurrency library Mojo 1.0 does ship is one its own team tells you to avoid. Here is what you can use today — a thin function, a typed context, and about twenty lines you write once. ## Optional Each tin's API reference: - [arrow-mlake API](https://magmalake.dev/s/arrow-mlake/api.md): The API of arrow-mlake: the arrow_mlake package's modules, structs, traits and functions, with their signatures and docstrings. - [arrow-mlake API: arrow_mlake.arrow](https://magmalake.dev/s/arrow-mlake/api/arrow.md): arrow_mlake.arrow, in arrow-mlake's API: Arrow types and Arrow array data, in the layout the C Data Interface wants. - [arrow-mlake API: arrow_mlake.batch](https://magmalake.dev/s/arrow-mlake/api/batch.md): arrow_mlake.batch, in arrow-mlake's API: `RecordBatch` — a run of rows as Arrow arrays, one per column. - [arrow-mlake API: arrow_mlake.carrow](https://magmalake.dev/s/arrow-mlake/api/carrow.md): arrow_mlake.carrow, in arrow-mlake's API: The Arrow C Data Interface — this library's public output contract. - [arrow-mlake API: arrow_mlake.carrow_import](https://magmalake.dev/s/arrow-mlake/api/carrow_import.md): arrow_mlake.carrow_import, in arrow-mlake's API: The Arrow C Data Interface, inbound — another runtime's arrays read into this one. - [arrow-mlake API: arrow_mlake.carrow_shared](https://magmalake.dev/s/arrow-mlake/api/carrow_shared.md): arrow_mlake.carrow_shared, in arrow-mlake's API: Publish a batch into a shared mapping, for a consumer in another process. - [arrow-mlake API: arrow_mlake.carrow_stream](https://magmalake.dev/s/arrow-mlake/api/carrow_stream.md): arrow_mlake.carrow_stream, in arrow-mlake's API: Producing an `ArrowArrayStream`: the C Data Interface, outbound, in batches. - [arrow-mlake API: arrow_mlake.flatbuf](https://magmalake.dev/s/arrow-mlake/api/flatbuf.md): arrow_mlake.flatbuf, in arrow-mlake's API: FlatBuffers, as much as Arrow IPC metadata needs: a builder and a reader. - [arrow-mlake API: arrow_mlake.ipc](https://magmalake.dev/s/arrow-mlake/api/ipc.md): arrow_mlake.ipc, in arrow-mlake's API: The Arrow IPC stream format: `RecordBatch`es to bytes and back. - [arrow-mlake API: arrow_mlake.memory_shim](https://magmalake.dev/s/arrow-mlake/api/memory_shim.md): arrow_mlake.memory_shim, in arrow-mlake's API: Opening a region, for a caller that does not want the allocator's types. - [avro API](https://magmalake.dev/s/avro/api.md): The API of avro: the avro package's modules, structs, traits and functions, with their signatures and docstrings. - [avro API: avro.codec](https://magmalake.dev/s/avro/api/codec.md): avro.codec, in avro's API: Object Container File block codecs. - [avro API: avro.crc32](https://magmalake.dev/s/avro/api/crc32.md): avro.crc32, in avro's API: CRC-32 (IEEE 802.3, the zlib/gzip polynomial). - [avro API: avro.cursor](https://magmalake.dev/s/avro/api/cursor.md): avro.cursor, in avro's API: `RecordCursor` — a schema-compiled, allocation-free Avro reader. - [avro API: avro.datafile](https://magmalake.dev/s/avro/api/datafile.md): avro.datafile, in avro's API: Avro Object Container Files — the reader and the writer. - [avro API: avro.decoder](https://magmalake.dev/s/avro/api/decoder.md): avro.decoder, in avro's API: The Avro binary decoder. - [avro API: avro.encoder](https://magmalake.dev/s/avro/api/encoder.md): avro.encoder, in avro's API: The Avro binary encoder — the inverse of `avro.decoder`. - [avro API: avro.json](https://magmalake.dev/s/avro/api/json.md): avro.json, in avro's API: A small, self-contained JSON reader/writer. - [avro API: avro.resolve](https://magmalake.dev/s/avro/api/resolve.md): avro.resolve, in avro's API: Schema resolution — reading data written with one schema as another. - [avro API: avro.schema](https://magmalake.dev/s/avro/api/schema.md): avro.schema, in avro's API: Avro schema parsing and printing. - [avro API: avro.value](https://magmalake.dev/s/avro/api/value.md): avro.value, in avro's API: `Value` — a dynamically typed Avro datum. - [brotli API](https://magmalake.dev/s/brotli/api.md): The API of brotli: the brotli package's modules, structs, traits and functions, with their signatures and docstrings. - [deflate API](https://magmalake.dev/s/deflate/api.md): The API of deflate: the deflate package's modules, structs, traits and functions, with their signatures and docstrings. - [deflate API: deflate.gzip](https://magmalake.dev/s/deflate/api/gzip.md): deflate.gzip, in deflate's API: gzip (RFC 1952) framing over the raw DEFLATE in `raw.mojo`. - [deflate API: deflate.raw](https://magmalake.dev/s/deflate/api/raw.md): deflate.raw, in deflate's API: Raw DEFLATE (RFC 1951) — `inflate` and `deflate`, in pure Mojo. - [Dista API](https://magmalake.dev/s/dista/api.md): The API of Dista: the dista package's modules, structs, traits and functions, with their signatures and docstrings. - [Dista API: dista.checkpoint](https://magmalake.dev/s/dista/api/checkpoint.md): dista.checkpoint, in Dista's API: Where actor checkpoints live: objects under `DISTA_CHECKPOINT_URI`. - [Dista API: dista.client](https://magmalake.dev/s/dista/api/client.md): dista.client, in Dista's API: The driver's side of the protocol: submitting tasks, calling actors and getting results back from the head. - [Dista API: dista.codec](https://magmalake.dev/s/dista/api/codec.md): dista.codec, in Dista's API: Turning task arguments and results into bytes and back. - [Dista API: dista.conn](https://magmalake.dev/s/dista/api/conn.md): dista.conn, in Dista's API: A non-blocking framed connection, for the head's event loop. - [Dista API: dista.frame](https://magmalake.dev/s/dista/api/frame.md): dista.frame, in Dista's API: Length-prefixed messages between drivers, the head and workers. - [Dista API: dista.head](https://magmalake.dev/s/dista/api/head.md): dista.head, in Dista's API: The head: one event loop that schedules every driver's tasks onto workers. - [Dista API: dista.metrics](https://magmalake.dev/s/dista/api/metrics.md): dista.metrics, in Dista's API: Prometheus metrics: counters and a histogram, and the `/metrics` page. - [Dista API: dista.runtime](https://magmalake.dev/s/dista/api/runtime.md): dista.runtime, in Dista's API: The runtime: one binary that runs as driver, head or worker. - [Dista API: dista.scale](https://magmalake.dev/s/dista/api/scale.md): dista.scale, in Dista's API: How many workers a running job wants: a policy over the head's demand. - [Dista API: dista.seq](https://magmalake.dev/s/dista/api/seq.md): dista.seq, in Dista's API: `Seq[T]`: a list that goes through the codec. - [Dista API: dista.signals](https://magmalake.dev/s/dista/api/signals.md): dista.signals, in Dista's API: SIGTERM: the head exits, and a worker drains, even as a container's PID 1. - [Dista API: dista.socket](https://magmalake.dev/s/dista/api/socket.md): dista.socket, in Dista's API: IPv4 TCP and process control over libc. - [Dista API: dista.store](https://magmalake.dev/s/dista/api/store.md): dista.store, in Dista's API: The node-local object store: large results in shared mappings. - [Dista API: dista.task](https://magmalake.dev/s/dista/api/task.md): dista.task, in Dista's API: Tasks: remote functions, their IDs, and how a worker runs one. - [Dista API: dista.worker](https://magmalake.dev/s/dista/api/worker.md): dista.worker, in Dista's API: A worker: runs tasks for the head and serves its results to peers. - [flare_mlake API](https://magmalake.dev/s/flare_mlake/api.md): The API of flare_mlake: the flare package's modules, structs, traits and functions, with their signatures and docstrings. - [flare_mlake API: flare.crypto](https://magmalake.dev/s/flare_mlake/api/crypto.md): flare.crypto, in flare_mlake's API: ``flare.crypto`` — minimal cryptographic primitives over the OpenSSL FFI. - [flare_mlake API: flare.crypto.base64](https://magmalake.dev/s/flare_mlake/api/crypto/base64.md): flare.crypto.base64, in flare_mlake's API: ``flare.crypto.base64`` -- RFC 4648 §4 standard base64 encode/decode. - [flare_mlake API: flare.crypto.hmac](https://magmalake.dev/s/flare_mlake/api/crypto/hmac.md): flare.crypto.hmac, in flare_mlake's API: HMAC-SHA256 + URL-safe base64 over the OpenSSL FFI. - [flare_mlake API: flare.crypto.random](https://magmalake.dev/s/flare_mlake/api/crypto/random.md): flare.crypto.random, in flare_mlake's API: ``flare.crypto.random`` -- bytes from the operating system's CSPRNG. - [flare_mlake API: flare.dns](https://magmalake.dev/s/flare_mlake/api/dns.md): flare.dns, in flare_mlake's API: DNS resolution via `getaddrinfo(3)`. - [flare_mlake API: flare.dns.async_resolve](https://magmalake.dev/s/flare_mlake/api/dns/async_resolve.md): flare.dns.async_resolve, in flare_mlake's API: DNS resolution on a separate thread + happy-eyeballs ordering. - [flare_mlake API: flare.dns.cache](https://magmalake.dev/s/flare_mlake/api/dns/cache.md): flare.dns.cache, in flare_mlake's API: TTL-bounded DNS resolution cache. - [flare_mlake API: flare.dns.resolver](https://magmalake.dev/s/flare_mlake/api/dns/resolver.md): flare.dns.resolver, in flare_mlake's API: DNS hostname resolution via libc ``getaddrinfo(3)``. - [flare_mlake API: flare.errors](https://magmalake.dev/s/flare_mlake/api/errors.md): flare.errors, in flare_mlake's API: Cross-module typed-error vocabulary for flare. - [flare_mlake API: flare.grpc](https://magmalake.dev/s/flare_mlake/api/grpc.md): flare.grpc, in flare_mlake's API: ``flare.grpc`` — gRPC primitives on top of the HTTP/2 reactor. - [flare_mlake API: flare.grpc.client](https://magmalake.dev/s/flare_mlake/api/grpc/client.md): flare.grpc.client, in flare_mlake's API: The gRPC unary client over the HTTP/2 ``HttpClient`` path. - [flare_mlake API: flare.grpc.client_stream](https://magmalake.dev/s/flare_mlake/api/grpc/client_stream.md): flare.grpc.client_stream, in flare_mlake's API: ``flare.grpc.client_stream`` -- server-side client-streaming + bidi. - [flare_mlake API: flare.grpc.framing](https://magmalake.dev/s/flare_mlake/api/grpc/framing.md): flare.grpc.framing, in flare_mlake's API: ``gRPC`` length-prefix-message (LPM) framing codec. - [flare_mlake API: flare.grpc.health](https://magmalake.dev/s/flare_mlake/api/grpc/health.md): flare.grpc.health, in flare_mlake's API: ``flare.grpc.health`` -- the standard ``grpc.health.v1.Health`` service (Check), implemented as a :trait:`GrpcUnary` handler. - [flare_mlake API: flare.grpc.interceptor](https://magmalake.dev/s/flare_mlake/api/grpc/interceptor.md): flare.grpc.interceptor, in flare_mlake's API: ``flare.grpc.interceptor`` -- chainable unary server interceptors. - [flare_mlake API: flare.grpc.metadata](https://magmalake.dev/s/flare_mlake/api/grpc/metadata.md): flare.grpc.metadata, in flare_mlake's API: ``gRPC`` metadata carrier (initial + trailing). - [flare_mlake API: flare.grpc.proto](https://magmalake.dev/s/flare_mlake/api/grpc/proto.md): flare.grpc.proto, in flare_mlake's API: ``flare.grpc.proto`` -- proto3 wire-format codec. - [flare_mlake API: flare.grpc.reflection](https://magmalake.dev/s/flare_mlake/api/grpc/reflection.md): flare.grpc.reflection, in flare_mlake's API: ``flare.grpc.reflection`` -- gRPC server reflection (v1alpha). - [flare_mlake API: flare.grpc.server](https://magmalake.dev/s/flare_mlake/api/grpc/server.md): flare.grpc.server, in flare_mlake's API: ``flare.grpc.server`` -- gRPC server adapter on the HTTP/2 reactor. - [flare_mlake API: flare.grpc.server_stream](https://magmalake.dev/s/flare_mlake/api/grpc/server_stream.md): flare.grpc.server_stream, in flare_mlake's API: ``flare.grpc.server_stream`` -- server-streaming gRPC adapter. - [flare_mlake API: flare.grpc.status](https://magmalake.dev/s/flare_mlake/api/grpc/status.md): flare.grpc.status, in flare_mlake's API: ``gRPC`` status codes and trailer carrier. - [flare_mlake API: flare.grpc.streaming](https://magmalake.dev/s/flare_mlake/api/grpc/streaming.md): flare.grpc.streaming, in flare_mlake's API: The gRPC streaming calls over a long-lived HTTP/2 stream. - [flare_mlake API: flare.http](https://magmalake.dev/s/flare_mlake/api/http.md): flare.http, in flare_mlake's API: HTTP/1.1 client and server. - [flare_mlake API: flare.http.alpn_dispatch](https://magmalake.dev/s/flare_mlake/api/http/alpn_dispatch.md): flare.http.alpn_dispatch, in flare_mlake's API: ``flare.http.alpn_dispatch`` -- ALPN-driven wire dispatcher. - [flare_mlake API: flare.http.async_body](https://magmalake.dev/s/flare_mlake/api/http/async_body.md): flare.http.async_body, in flare_mlake's API: Reactor-integrated external streaming source. - [flare_mlake API: flare.http.auth](https://magmalake.dev/s/flare_mlake/api/http/auth.md): flare.http.auth, in flare_mlake's API: HTTP authentication helpers. - [flare_mlake API: flare.http.auth_extract](https://magmalake.dev/s/flare_mlake/api/http/auth_extract.md): flare.http.auth_extract, in flare_mlake's API: Server-side authentication extractors + CSRF helper. - [flare_mlake API: flare.http.body](https://magmalake.dev/s/flare_mlake/api/http/body.md): flare.http.body, in flare_mlake's API: Streaming response body primitives. - [flare_mlake API: flare.http.cache](https://magmalake.dev/s/flare_mlake/api/http/cache.md): flare.http.cache, in flare_mlake's API: ``flare.http.cache`` — RFC 9111 HTTP cache primitives. - [flare_mlake API: flare.http.cache.control](https://magmalake.dev/s/flare_mlake/api/http/cache/control.md): flare.http.cache.control, in flare_mlake's API: ``Cache-Control`` header parser (RFC 9111 §5.2). - [flare_mlake API: flare.http.cache.key](https://magmalake.dev/s/flare_mlake/api/http/cache/key.md): flare.http.cache.key, in flare_mlake's API: Cache key derivation (RFC 9111 §4 "Constructing Responses from Caches"). - [flare_mlake API: flare.http.cache.middleware](https://magmalake.dev/s/flare_mlake/api/http/cache/middleware.md): flare.http.cache.middleware, in flare_mlake's API: HTTP cache middleware (RFC 9111). - [flare_mlake API: flare.http.cache.store](https://magmalake.dev/s/flare_mlake/api/http/cache/store.md): flare.http.cache.store, in flare_mlake's API: Cache store trait + in-memory implementation. - [flare_mlake API: flare.http.cancel](https://magmalake.dev/s/flare_mlake/api/http/cancel.md): flare.http.cancel, in flare_mlake's API: Cancel token plumbed from the reactor into request handlers. - [flare_mlake API: flare.http.client](https://magmalake.dev/s/flare_mlake/api/http/client.md): flare.http.client, in flare_mlake's API: HTTP/1.1 client with optional TLS support. - [flare_mlake API: flare.http.client_pool](https://magmalake.dev/s/flare_mlake/api/http/client_pool.md): flare.http.client_pool, in flare_mlake's API: HTTP/1.1 client connection pool. - [flare_mlake API: flare.http.conditional](https://magmalake.dev/s/flare_mlake/api/http/conditional.md): flare.http.conditional, in flare_mlake's API: Conditional GET / PUT middleware (RFC 9110 §13). - [flare_mlake API: flare.http.cookie](https://magmalake.dev/s/flare_mlake/api/http/cookie.md): flare.http.cookie, in flare_mlake's API: HTTP cookie support (RFC 6265). - [flare_mlake API: flare.http.cors](https://magmalake.dev/s/flare_mlake/api/http/cors.md): flare.http.cors, in flare_mlake's API: ``Cors[Inner]`` middleware (Cross-Origin Resource Sharing). - [flare_mlake API: flare.http.encoding](https://magmalake.dev/s/flare_mlake/api/http/encoding.md): flare.http.encoding, in flare_mlake's API: HTTP content-encoding helpers: gzip and deflate via zlib FFI. - [flare_mlake API: flare.http.error](https://magmalake.dev/s/flare_mlake/api/http/error.md): flare.http.error, in flare_mlake's API: HTTP-level error types. - [flare_mlake API: flare.http.extract](https://magmalake.dev/s/flare_mlake/api/http/extract.md): flare.http.extract, in flare_mlake's API: Typed request extractors with reflective auto-injection. - [flare_mlake API: flare.http.form](https://magmalake.dev/s/flare_mlake/api/http/form.md): flare.http.form, in flare_mlake's API: ``application/x-www-form-urlencoded`` parsing (WHATWG URL Living Standard, §5.1). - [flare_mlake API: flare.http.frontend](https://magmalake.dev/s/flare_mlake/api/http/frontend.md): flare.http.frontend, in flare_mlake's API: HTTP frontends for the multicore :class:`flare.runtime.Scheduler`. - [flare_mlake API: flare.http.fs](https://magmalake.dev/s/flare_mlake/api/http/fs.md): flare.http.fs, in flare_mlake's API: ``FileServer`` — serve files from a directory with HEAD + Range support. - [flare_mlake API: flare.http.handler](https://magmalake.dev/s/flare_mlake/api/http/handler.md): flare.http.handler, in flare_mlake's API: The ``Handler`` trait: flare's request-to-response contract. - [flare_mlake API: flare.http.header_phf](https://magmalake.dev/s/flare_mlake/api/http/header_phf.md): flare.http.header_phf, in flare_mlake's API: Comptime perfect-hash dispatch for ~70 standard HTTP header names. - [flare_mlake API: flare.http.header_view](https://magmalake.dev/s/flare_mlake/api/http/header_view.md): flare.http.header_view, in flare_mlake's API: Borrowed header storage. - [flare_mlake API: flare.http.headers](https://magmalake.dev/s/flare_mlake/api/http/headers.md): flare.http.headers, in flare_mlake's API: HTTP header collection with case-insensitive key lookup. - [flare_mlake API: flare.http.hpack_huffman](https://magmalake.dev/s/flare_mlake/api/http/hpack_huffman.md): flare.http.hpack_huffman, in flare_mlake's API: HPACK Huffman codec — RFC 7541 Appendix B. - [flare_mlake API: flare.http.hpack_huffman_simd](https://magmalake.dev/s/flare_mlake/api/http/hpack_huffman_simd.md): flare.http.hpack_huffman_simd, in flare_mlake's API: HPACK Huffman fast decoder. - [flare_mlake API: flare.http.intern](https://magmalake.dev/s/flare_mlake/api/http/intern.md): flare.http.intern, in flare_mlake's API: Interned ``StaticString`` table for HTTP method names + common header values. - [flare_mlake API: flare.http.metrics](https://magmalake.dev/s/flare_mlake/api/http/metrics.md): flare.http.metrics, in flare_mlake's API: Prometheus-text-exposition metrics middleware. - [flare_mlake API: flare.http.middleware](https://magmalake.dev/s/flare_mlake/api/http/middleware.md): flare.http.middleware, in flare_mlake's API: Generic middleware library for . - [flare_mlake API: flare.http.multipart](https://magmalake.dev/s/flare_mlake/api/http/multipart.md): flare.http.multipart, in flare_mlake's API: ``multipart/form-data`` parsing (RFC 7578). - [flare_mlake API: flare.http.multipart_builder](https://magmalake.dev/s/flare_mlake/api/http/multipart_builder.md): flare.http.multipart_builder, in flare_mlake's API: Client-side ``multipart/form-data`` request-body builder (RFC 7578). - [flare_mlake API: flare.http.proto](https://magmalake.dev/s/flare_mlake/api/http/proto.md): flare.http.proto, in flare_mlake's API: ``flare.http.proto`` -- pure-function HTTP wire codecs and parsers. - [flare_mlake API: flare.http.proto.ascii](https://magmalake.dev/s/flare_mlake/api/http/proto/ascii.md): flare.http.proto.ascii, in flare_mlake's API: ``flare.http.proto.ascii`` -- zero-validation ASCII helpers. - [flare_mlake API: flare.http.proto.chunked](https://magmalake.dev/s/flare_mlake/api/http/proto/chunked.md): flare.http.proto.chunked, in flare_mlake's API: Sans-I/O framing for ``Transfer-Encoding: chunked`` request bodies. - [flare_mlake API: flare.http.proto.h1_leniency](https://magmalake.dev/s/flare_mlake/api/http/proto/h1_leniency.md): flare.http.proto.h1_leniency, in flare_mlake's API: Named opt-in flags for HTTP/1.1 parser leniency. - [flare_mlake API: flare.http.proto.h2_config](https://magmalake.dev/s/flare_mlake/api/http/proto/h2_config.md): flare.http.proto.h2_config, in flare_mlake's API: HTTP/2 SETTINGS and per-connection limits. - [flare_mlake API: flare.http.proto.h2c_upgrade](https://magmalake.dev/s/flare_mlake/api/http/proto/h2c_upgrade.md): flare.http.proto.h2c_upgrade, in flare_mlake's API: HTTP/1.1 -> HTTP/2 cleartext (h2c) upgrade detection (RFC 7540 §3.2). - [flare_mlake API: flare.http.proto.huffman](https://magmalake.dev/s/flare_mlake/api/http/proto/huffman.md): flare.http.proto.huffman, in flare_mlake's API: Canonical sans-I/O HPACK / QPACK Huffman codec surface (``flare.http.proto.huffman``) -- RFC 7541 §5.2 + Appendix B. - [flare_mlake API: flare.http.proto.utf8](https://magmalake.dev/s/flare_mlake/api/http/proto/utf8.md): flare.http.proto.utf8, in flare_mlake's API: Lossy UTF-8 decoding for caller-supplied byte bodies. - [flare_mlake API: flare.http.proxy_protocol](https://magmalake.dev/s/flare_mlake/api/http/proxy_protocol.md): flare.http.proxy_protocol, in flare_mlake's API: PROXY protocol v1 + v2 parser (HAProxy spec). - [flare_mlake API: flare.http.redirect_policy](https://magmalake.dev/s/flare_mlake/api/http/redirect_policy.md): flare.http.redirect_policy, in flare_mlake's API: HTTP redirect policy: configurable cross-origin + auth gating. - [flare_mlake API: flare.http.reliability](https://magmalake.dev/s/flare_mlake/api/http/reliability.md): flare.http.reliability, in flare_mlake's API: Reliability middleware: ``Retry`` / ``PostHocDeadline`` / ``RateLimit`` / ``CircuitBreaker`` policies. - [flare_mlake API: flare.http.request](https://magmalake.dev/s/flare_mlake/api/http/request.md): flare.http.request, in flare_mlake's API: HTTP request type. - [flare_mlake API: flare.http.request_body](https://magmalake.dev/s/flare_mlake/api/http/request_body.md): flare.http.request_body, in flare_mlake's API: A request body that keeps arriving after the handler has started. - [flare_mlake API: flare.http.request_builder](https://magmalake.dev/s/flare_mlake/api/http/request_builder.md): flare.http.request_builder, in flare_mlake's API: Fluent-ish per-request builder for the HTTP client. - [flare_mlake API: flare.http.request_chunks](https://magmalake.dev/s/flare_mlake/api/http/request_chunks.md): flare.http.request_chunks, in flare_mlake's API: Streaming-shape adapter for inbound request bodies. - [flare_mlake API: flare.http.request_view](https://magmalake.dev/s/flare_mlake/api/http/request_view.md): flare.http.request_view, in flare_mlake's API: Zero-copy HTTP request view. - [flare_mlake API: flare.http.response](https://magmalake.dev/s/flare_mlake/api/http/response.md): flare.http.response, in flare_mlake's API: HTTP response type. - [flare_mlake API: flare.http.response_pool](https://magmalake.dev/s/flare_mlake/api/http/response_pool.md): flare.http.response_pool, in flare_mlake's API: Per-worker ``Response`` pool. - [flare_mlake API: flare.http.response_stream](https://magmalake.dev/s/flare_mlake/api/http/response_stream.md): flare.http.response_stream, in flare_mlake's API: Streaming-response plumbing for the normal Handler path (K1). - [flare_mlake API: flare.http.router](https://magmalake.dev/s/flare_mlake/api/http/router.md): flare.http.router, in flare_mlake's API: HTTP request router with method dispatch + path parameters. - [flare_mlake API: flare.http.routes](https://magmalake.dev/s/flare_mlake/api/http/routes.md): flare.http.routes, in flare_mlake's API: Comptime-compiled route table and ``ComptimeRouter``. - [flare_mlake API: flare.http.server](https://magmalake.dev/s/flare_mlake/api/http/server.md): flare.http.server, in flare_mlake's API: HTTP/1.1 server with buffered reads, keep-alive, and per-connection handler callbacks. - [flare_mlake API: flare.http.session](https://magmalake.dev/s/flare_mlake/api/http/session.md): flare.http.session, in flare_mlake's API: Signed cookies + typed sessions. - [flare_mlake API: flare.http.simd_parsers](https://magmalake.dev/s/flare_mlake/api/http/simd_parsers.md): flare.http.simd_parsers, in flare_mlake's API: SIMD-friendly byte-scan primitives for the HTTP/1.1 parser hot path. - [flare_mlake API: flare.http.sse](https://magmalake.dev/s/flare_mlake/api/http/sse.md): flare.http.sse, in flare_mlake's API: Server-Sent Events (W3C SSE / RFC 9110 ``text/event-stream``). - [flare_mlake API: flare.http.static_response](https://magmalake.dev/s/flare_mlake/api/http/static_response.md): flare.http.static_response, in flare_mlake's API: Pre-encoded literal HTTP responses for the fastest possible fast path. - [flare_mlake API: flare.http.streaming_response](https://magmalake.dev/s/flare_mlake/api/http/streaming_response.md): flare.http.streaming_response, in flare_mlake's API: Streaming response with a parametric body type. - [flare_mlake API: flare.http.streaming_serialize](https://magmalake.dev/s/flare_mlake/api/http/streaming_serialize.md): flare.http.streaming_serialize, in flare_mlake's API: Streaming response serializer. - [flare_mlake API: flare.http.streaming_server](https://magmalake.dev/s/flare_mlake/api/http/streaming_server.md): flare.http.streaming_server, in flare_mlake's API: Typed streaming-handler surface. - [flare_mlake API: flare.http.structured_logger](https://magmalake.dev/s/flare_mlake/api/http/structured_logger.md): flare.http.structured_logger, in flare_mlake's API: Structured (JSON-shaped) request logger middleware. - [flare_mlake API: flare.http.template](https://magmalake.dev/s/flare_mlake/api/http/template.md): flare.http.template, in flare_mlake's API: Tiny tag-based template engine. - [flare_mlake API: flare.http.url](https://magmalake.dev/s/flare_mlake/api/http/url.md): flare.http.url, in flare_mlake's API: URL parser for HTTP/HTTPS URLs. - [flare_mlake API: flare.http.wire](https://magmalake.dev/s/flare_mlake/api/http/wire.md): flare.http.wire, in flare_mlake's API: ``flare.http.wire`` -- neutral wire-shape types shared by every HTTP wire. - [flare_mlake API: flare.http2](https://magmalake.dev/s/flare_mlake/api/http2.md): flare.http2, in flare_mlake's API: ``flare.http2`` -- low-level HTTP/2 driver primitives (RFC 9113 + RFC 7541). - [flare_mlake API: flare.http2.client](https://magmalake.dev/s/flare_mlake/api/http2/client.md): flare.http2.client, in flare_mlake's API: HTTP/2 client byte driver (RFC 9113). - [flare_mlake API: flare.http2.frame](https://magmalake.dev/s/flare_mlake/api/http2/frame.md): flare.http2.frame, in flare_mlake's API: HTTP/2 frame codec (RFC 9113 §4). - [flare_mlake API: flare.http2.hpack](https://magmalake.dev/s/flare_mlake/api/http2/hpack.md): flare.http2.hpack, in flare_mlake's API: HPACK header compression (RFC 7541). - [flare_mlake API: flare.http2.server](https://magmalake.dev/s/flare_mlake/api/http2/server.md): flare.http2.server, in flare_mlake's API: HTTP/2 server glue (RFC 9113). - [flare_mlake API: flare.http2.state](https://magmalake.dev/s/flare_mlake/api/http2/state.md): flare.http2.state, in flare_mlake's API: HTTP/2 state machines (RFC 9113 §5). - [flare_mlake API: flare.http2.stream_slab](https://magmalake.dev/s/flare_mlake/api/http2/stream_slab.md): flare.http2.stream_slab, in flare_mlake's API: HTTP/2 per-connection stream slab. - [flare_mlake API: flare.http3](https://magmalake.dev/s/flare_mlake/api/http3.md): flare.http3, in flare_mlake's API: ``flare.http3`` — sans-I/O HTTP/3 codec primitives (RFC 9114). - [flare_mlake API: flare.http3.capsule](https://magmalake.dev/s/flare_mlake/api/http3/capsule.md): flare.http3.capsule, in flare_mlake's API: The Capsule Protocol (RFC 9297 sec 3). - [flare_mlake API: flare.http3.client](https://magmalake.dev/s/flare_mlake/api/http3/client.md): flare.http3.client, in flare_mlake's API: HTTP/3 client connection driver -- QUIC + H3 composition. - [flare_mlake API: flare.http3.frame](https://magmalake.dev/s/flare_mlake/api/http3/frame.md): flare.http3.frame, in flare_mlake's API: HTTP/3 frame codec (RFC 9114 §7). - [flare_mlake API: flare.http3.request_reader](https://magmalake.dev/s/flare_mlake/api/http3/request_reader.md): flare.http3.request_reader, in flare_mlake's API: HTTP/3 request-stream reader -- sans-I/O state machine. - [flare_mlake API: flare.http3.request_writer](https://magmalake.dev/s/flare_mlake/api/http3/request_writer.md): flare.http3.request_writer, in flare_mlake's API: HTTP/3 request-stream writer -- sans-I/O byte emitter. - [flare_mlake API: flare.http3.response_reader](https://magmalake.dev/s/flare_mlake/api/http3/response_reader.md): flare.http3.response_reader, in flare_mlake's API: HTTP/3 response-stream reader -- sans-I/O stateful decoder. - [flare_mlake API: flare.http3.response_writer](https://magmalake.dev/s/flare_mlake/api/http3/response_writer.md): flare.http3.response_writer, in flare_mlake's API: HTTP/3 response-stream writer -- sans-I/O byte emitter. - [flare_mlake API: flare.http3.server](https://magmalake.dev/s/flare_mlake/api/http3/server.md): flare.http3.server, in flare_mlake's API: ``flare.http3.server`` -- HTTP/3 server connection driver. - [flare_mlake API: flare.io](https://magmalake.dev/s/flare_mlake/api/io.md): flare.io, in flare_mlake's API: Buffered I/O utilities for flare streams. - [flare_mlake API: flare.io.buf_reader](https://magmalake.dev/s/flare_mlake/api/io/buf_reader.md): flare.io.buf_reader, in flare_mlake's API: Buffered reader for stream I/O. - [flare_mlake API: flare.io.byte_cursor](https://magmalake.dev/s/flare_mlake/api/io/byte_cursor.md): flare.io.byte_cursor, in flare_mlake's API: Safe, bounds-checked byte cursors. - [flare_mlake API: flare.net](https://magmalake.dev/s/flare_mlake/api/net.md): flare.net, in flare_mlake's API: Raw POSIX socket primitives — the foundation of the flare networking stack. - [flare_mlake API: flare.net.address](https://magmalake.dev/s/flare_mlake/api/net/address.md): flare.net.address, in flare_mlake's API: IP address and socket address types. - [flare_mlake API: flare.net.error](https://magmalake.dev/s/flare_mlake/api/net/error.md): flare.net.error, in flare_mlake's API: Typed network errors for flare. - [flare_mlake API: flare.net.socket](https://magmalake.dev/s/flare_mlake/api/net/socket.md): flare.net.socket, in flare_mlake's API: Raw POSIX socket wrapper — the single point where flare touches the OS. - [flare_mlake API: flare.openapi](https://magmalake.dev/s/flare_mlake/api/openapi.md): flare.openapi, in flare_mlake's API: ``flare.openapi`` — OpenAPI 3.1 spec data model + JSON emitter. - [flare_mlake API: flare.openapi.from_router](https://magmalake.dev/s/flare_mlake/api/openapi/from_router.md): flare.openapi.from_router, in flare_mlake's API: Derive an :class:`OpenApiSpec` from a runtime :class:`Router`. - [flare_mlake API: flare.openapi.spec](https://magmalake.dev/s/flare_mlake/api/openapi/spec.md): flare.openapi.spec, in flare_mlake's API: OpenAPI 3.1 spec data model + JSON serializer. - [flare_mlake API: flare.prelude](https://magmalake.dev/s/flare_mlake/api/prelude.md): flare.prelude, in flare_mlake's API: ``flare.prelude`` -- the everyday surface, in one import. - [flare_mlake API: flare.qpack](https://magmalake.dev/s/flare_mlake/api/qpack.md): flare.qpack, in flare_mlake's API: ``flare.qpack`` -- QPACK encoder/decoder (RFC 9204). - [flare_mlake API: flare.qpack.codec](https://magmalake.dev/s/flare_mlake/api/qpack/codec.md): flare.qpack.codec, in flare_mlake's API: QPACK encoder + decoder (RFC 9204) -- static-only. - [flare_mlake API: flare.qpack.dynamic](https://magmalake.dev/s/flare_mlake/api/qpack/dynamic.md): flare.qpack.dynamic, in flare_mlake's API: QPACK dynamic table + encoder/decoder stream instructions (RFC 9204). - [flare_mlake API: flare.qpack.static_table](https://magmalake.dev/s/flare_mlake/api/qpack/static_table.md): flare.qpack.static_table, in flare_mlake's API: QPACK static table (RFC 9204 Appendix A). - [flare_mlake API: flare.quic](https://magmalake.dev/s/flare_mlake/api/quic.md): flare.quic, in flare_mlake's API: ``flare.quic`` — sans-I/O QUIC v1 codec primitives (RFC 9000). - [flare_mlake API: flare.quic.cc](https://magmalake.dev/s/flare_mlake/api/quic/cc.md): flare.quic.cc, in flare_mlake's API: QUIC congestion control (RFC 9002 section 7): Reno + CUBIC (HyStart++). - [flare_mlake API: flare.quic.client](https://magmalake.dev/s/flare_mlake/api/quic/client.md): flare.quic.client, in flare_mlake's API: ``flare.quic.client`` -- QUIC v1 client connection driver. - [flare_mlake API: flare.quic.crypto](https://magmalake.dev/s/flare_mlake/api/quic/crypto.md): flare.quic.crypto, in flare_mlake's API: QUIC v1 crypto primitives (RFC 9001). - [flare_mlake API: flare.quic.frame](https://magmalake.dev/s/flare_mlake/api/quic/frame.md): flare.quic.frame, in flare_mlake's API: QUIC v1 transport-frame codec (RFC 9000 §19). - [flare_mlake API: flare.quic.packet](https://magmalake.dev/s/flare_mlake/api/quic/packet.md): flare.quic.packet, in flare_mlake's API: QUIC v1 packet header codec (RFC 9000 §17). - [flare_mlake API: flare.quic.protection](https://magmalake.dev/s/flare_mlake/api/quic/protection.md): flare.quic.protection, in flare_mlake's API: ``flare.quic.protection`` -- QUIC v1 per-packet header + AEAD protection (RFC 9001 §5.3-5.4). - [flare_mlake API: flare.quic.retry](https://magmalake.dev/s/flare_mlake/api/quic/retry.md): flare.quic.retry, in flare_mlake's API: QUIC server Retry + Version Negotiation packet codecs (RFC 9000 §8.1 / §17.2.1 / §17.2.5, RFC 9001 §5.8). - [flare_mlake API: flare.quic.server](https://magmalake.dev/s/flare_mlake/api/quic/server.md): flare.quic.server, in flare_mlake's API: ``flare.quic.server`` -- QUIC server reactor. - [flare_mlake API: flare.quic.state](https://magmalake.dev/s/flare_mlake/api/quic/state.md): flare.quic.state, in flare_mlake's API: QUIC connection + stream state machines (RFC 9000 §3 + §13). - [flare_mlake API: flare.quic.timers](https://magmalake.dev/s/flare_mlake/api/quic/timers.md): flare.quic.timers, in flare_mlake's API: ``flare.quic.timers`` -- per-connection timer kinds + token encoding for the QUIC reactor. - [flare_mlake API: flare.quic.transport_params](https://magmalake.dev/s/flare_mlake/api/quic/transport_params.md): flare.quic.transport_params, in flare_mlake's API: QUIC transport-parameter codec (RFC 9000 §18 + §19.1.1). - [flare_mlake API: flare.quic.varint](https://magmalake.dev/s/flare_mlake/api/quic/varint.md): flare.quic.varint, in flare_mlake's API: Variable-length integer codec for QUIC (RFC 9000 §16). - [flare_mlake API: flare.runtime](https://magmalake.dev/s/flare_mlake/api/runtime.md): flare.runtime, in flare_mlake's API: ``flare.runtime`` — event-loop primitives for the Stage 1 reactor. - [flare_mlake API: flare.runtime.blocking](https://magmalake.dev/s/flare_mlake/api/runtime/blocking.md): flare.runtime.blocking, in flare_mlake's API: Blocking-escape hatch: ``block_in_pool``. - [flare_mlake API: flare.runtime.buffer_pool](https://magmalake.dev/s/flare_mlake/api/runtime/buffer_pool.md): flare.runtime.buffer_pool, in flare_mlake's API: Per-worker, size-class-bucketed buffer pool. - [flare_mlake API: flare.runtime.date_cache](https://magmalake.dev/s/flare_mlake/api/runtime/date_cache.md): flare.runtime.date_cache, in flare_mlake's API: Per-worker monotonic Date-header cache. - [flare_mlake API: flare.runtime.event](https://magmalake.dev/s/flare_mlake/api/runtime/event.md): flare.runtime.event, in flare_mlake's API: Event primitives for the flare reactor. - [flare_mlake API: flare.runtime.frontend](https://magmalake.dev/s/flare_mlake/api/runtime/frontend.md): flare.runtime.frontend, in flare_mlake's API: Worker-target trait for the multicore :class:`Scheduler`. - [flare_mlake API: flare.runtime.handoff](https://magmalake.dev/s/flare_mlake/api/runtime/handoff.md): flare.runtime.handoff, in flare_mlake's API: Cross-worker connection handoff. - [flare_mlake API: flare.runtime.io_uring](https://magmalake.dev/s/flare_mlake/api/runtime/io_uring.md): flare.runtime.io_uring, in flare_mlake's API: ``io_uring`` backend substrate. - [flare_mlake API: flare.runtime.io_uring_abi](https://magmalake.dev/s/flare_mlake/api/runtime/io_uring_abi.md): flare.runtime.io_uring_abi, in flare_mlake's API: ``flare.runtime.io_uring_abi`` -- io_uring ABI constants + byte codec. - [flare_mlake API: flare.runtime.io_uring_driver](https://magmalake.dev/s/flare_mlake/api/runtime/io_uring_driver.md): flare.runtime.io_uring_driver, in flare_mlake's API: ``io_uring`` SQ/CQ ring driver. - [flare_mlake API: flare.runtime.io_uring_sqe](https://magmalake.dev/s/flare_mlake/api/runtime/io_uring_sqe.md): flare.runtime.io_uring_sqe, in flare_mlake's API: ``io_uring`` SQE encoder + CQE decoder primitives. - [flare_mlake API: flare.runtime.iovec](https://magmalake.dev/s/flare_mlake/api/runtime/iovec.md): flare.runtime.iovec, in flare_mlake's API: ``writev(2)`` vectored-I/O primitive. - [flare_mlake API: flare.runtime.pool](https://magmalake.dev/s/flare_mlake/api/runtime/pool.md): flare.runtime.pool, in flare_mlake's API: Typed heap-allocator wrapper. - [flare_mlake API: flare.runtime.reactor](https://magmalake.dev/s/flare_mlake/api/runtime/reactor.md): flare.runtime.reactor, in flare_mlake's API: Reactor: the event-loop core powering flare's single-threaded HTTP server. - [flare_mlake API: flare.runtime.reuseport](https://magmalake.dev/s/flare_mlake/api/runtime/reuseport.md): flare.runtime.reuseport, in flare_mlake's API: ``SO_REUSEPORT`` helpers for thread-per-core listeners. - [flare_mlake API: flare.runtime.scheduler](https://magmalake.dev/s/flare_mlake/api/runtime/scheduler.md): flare.runtime.scheduler, in flare_mlake's API: Multicore scheduler: 1 shared listener, N reactors, N workers. - [flare_mlake API: flare.runtime.scheduler_stats](https://magmalake.dev/s/flare_mlake/api/runtime/scheduler_stats.md): flare.runtime.scheduler_stats, in flare_mlake's API: Cross-thread stop flag and per-worker stats cell. - [flare_mlake API: flare.runtime.timer_wheel](https://magmalake.dev/s/flare_mlake/api/runtime/timer_wheel.md): flare.runtime.timer_wheel, in flare_mlake's API: Hashed timing wheel for the flare reactor. - [flare_mlake API: flare.runtime.uring_reactor](https://magmalake.dev/s/flare_mlake/api/runtime/uring_reactor.md): flare.runtime.uring_reactor, in flare_mlake's API: ``UringReactor``: io_uring-native event-loop wrapper. - [flare_mlake API: flare.runtime.watchdog](https://magmalake.dev/s/flare_mlake/api/runtime/watchdog.md): flare.runtime.watchdog, in flare_mlake's API: Deadline watchdog: a background thread that flips Cancel cells on expiry. - [flare_mlake API: flare.tcp](https://magmalake.dev/s/flare_mlake/api/tcp.md): flare.tcp, in flare_mlake's API: Blocking TCP streams and listeners. - [flare_mlake API: flare.tcp.listener](https://magmalake.dev/s/flare_mlake/api/tcp/listener.md): flare.tcp.listener, in flare_mlake's API: TCP listener: a socket bound and listening for incoming connections. - [flare_mlake API: flare.tcp.stream](https://magmalake.dev/s/flare_mlake/api/tcp/stream.md): flare.tcp.stream, in flare_mlake's API: TCP stream: a connected, bidirectional byte stream. - [flare_mlake API: flare.testing](https://magmalake.dev/s/flare_mlake/api/testing.md): flare.testing, in flare_mlake's API: ``flare.testing`` — handler + middleware testing helpers. - [flare_mlake API: flare.testing.client](https://magmalake.dev/s/flare_mlake/api/testing/client.md): flare.testing.client, in flare_mlake's API: In-process test client for ``Handler`` implementations. - [flare_mlake API: flare.testing.fork_server](https://magmalake.dev/s/flare_mlake/api/testing/fork_server.md): flare.testing.fork_server, in flare_mlake's API: Fork-and-serve helpers for cookbook examples and integration tests. - [flare_mlake API: flare.tls](https://magmalake.dev/s/flare_mlake/api/tls.md): flare.tls, in flare_mlake's API: TLS/SSL layer — wraps `TcpStream` with OpenSSL encryption. - [flare_mlake API: flare.tls.acceptor](https://magmalake.dev/s/flare_mlake/api/tls/acceptor.md): flare.tls.acceptor, in flare_mlake's API: Server-side TLS acceptor. - [flare_mlake API: flare.tls.config](https://magmalake.dev/s/flare_mlake/api/tls/config.md): flare.tls.config, in flare_mlake's API: TLS configuration: certificates, keys, and verification policy. - [flare_mlake API: flare.tls.error](https://magmalake.dev/s/flare_mlake/api/tls/error.md): flare.tls.error, in flare_mlake's API: TLS-specific error types for ``flare.tls``. - [flare_mlake API: flare.tls.rustls_quic](https://magmalake.dev/s/flare_mlake/api/tls/rustls_quic.md): flare.tls.rustls_quic, in flare_mlake's API: `flare.tls.rustls_quic` -- rustls QUIC binding surface. - [flare_mlake API: flare.tls.stream](https://magmalake.dev/s/flare_mlake/api/tls/stream.md): flare.tls.stream, in flare_mlake's API: TLS stream: encrypts a TcpStream via OpenSSL FFI. - [flare_mlake API: flare.udp](https://magmalake.dev/s/flare_mlake/api/udp.md): flare.udp, in flare_mlake's API: UDP datagram sockets. - [flare_mlake API: flare.udp.batch](https://magmalake.dev/s/flare_mlake/api/udp/batch.md): flare.udp.batch, in flare_mlake's API: Batched UDP I/O: ``recvmmsg`` / ``sendmmsg`` + GSO segmentation. - [flare_mlake API: flare.udp.socket](https://magmalake.dev/s/flare_mlake/api/udp/socket.md): flare.udp.socket, in flare_mlake's API: UDP socket: connectionless datagrams. - [flare_mlake API: flare.uds](https://magmalake.dev/s/flare_mlake/api/uds.md): flare.uds, in flare_mlake's API: ``flare.uds`` — Unix domain socket primitives. - [flare_mlake API: flare.uds.frame_mux](https://magmalake.dev/s/flare_mlake/api/uds/frame_mux.md): flare.uds.frame_mux, in flare_mlake's API: Multiplexed duplex framed transport over one connection. - [flare_mlake API: flare.uds.listener](https://magmalake.dev/s/flare_mlake/api/uds/listener.md): flare.uds.listener, in flare_mlake's API: AF_UNIX listener — bound + listening Unix domain socket. - [flare_mlake API: flare.uds.stream](https://magmalake.dev/s/flare_mlake/api/uds/stream.md): flare.uds.stream, in flare_mlake's API: Connected AF_UNIX byte stream. - [flare_mlake API: flare.utils](https://magmalake.dev/s/flare_mlake/api/utils.md): flare.utils, in flare_mlake's API: Cross-cutting utility helpers that don't fit any other layer. - [flare_mlake API: flare.utils.dylib](https://magmalake.dev/s/flare_mlake/api/utils/dylib.md): flare.utils.dylib, in flare_mlake's API: Canonical FFI dylib path resolver shared across :mod:`flare`. - [flare_mlake API: flare.utils.posix_proc](https://magmalake.dev/s/flare_mlake/api/utils/posix_proc.md): flare.utils.posix_proc, in flare_mlake's API: POSIX process-control helpers thin-wrapped over ``external_call``. - [flare_mlake API: flare.ws](https://magmalake.dev/s/flare_mlake/api/ws.md): flare.ws, in flare_mlake's API: WebSocket client and server (RFC 6455). - [flare_mlake API: flare.ws.auto_client](https://magmalake.dev/s/flare_mlake/api/ws/auto_client.md): flare.ws.auto_client, in flare_mlake's API: `flare.ws.auto_client` -- ALPN-driven WebSocket client dispatcher. - [flare_mlake API: flare.ws.client](https://magmalake.dev/s/flare_mlake/api/ws/client.md): flare.ws.client, in flare_mlake's API: WebSocket client (RFC 6455). - [flare_mlake API: flare.ws.client_h2](https://magmalake.dev/s/flare_mlake/api/ws/client_h2.md): flare.ws.client_h2, in flare_mlake's API: WebSocket-over-HTTP/2 stream <-> frame adapter (RFC 8441). - [flare_mlake API: flare.ws.client_h3](https://magmalake.dev/s/flare_mlake/api/ws/client_h3.md): flare.ws.client_h3, in flare_mlake's API: Client side of WebSocket over HTTP/3 (RFC 9220). - [flare_mlake API: flare.ws.extensions](https://magmalake.dev/s/flare_mlake/api/ws/extensions.md): flare.ws.extensions, in flare_mlake's API: ``Sec-WebSocket-Extensions`` header parser + emitter (RFC 6455 §9 + RFC 7692 §7). - [flare_mlake API: flare.ws.frame](https://magmalake.dev/s/flare_mlake/api/ws/frame.md): flare.ws.frame, in flare_mlake's API: WebSocket frame codec (RFC 6455 §5). - [flare_mlake API: flare.ws.permessage_deflate](https://magmalake.dev/s/flare_mlake/api/ws/permessage_deflate.md): flare.ws.permessage_deflate, in flare_mlake's API: WebSocket permessage-deflate extension (RFC 7692). - [flare_mlake API: flare.ws.protocol](https://magmalake.dev/s/flare_mlake/api/ws/protocol.md): flare.ws.protocol, in flare_mlake's API: Sans-I/O WebSocket server protocol core (RFC 6455). - [flare_mlake API: flare.ws.server](https://magmalake.dev/s/flare_mlake/api/ws/server.md): flare.ws.server, in flare_mlake's API: WebSocket server: upgrades HTTP connections to WebSocket (RFC 6455). - [flare_mlake API: flare.ws.server_h2](https://magmalake.dev/s/flare_mlake/api/ws/server_h2.md): flare.ws.server_h2, in flare_mlake's API: Server-side WebSocket-over-HTTP/2 carrier (RFC 8441). - [flare_mlake API: flare.ws.server_h3](https://magmalake.dev/s/flare_mlake/api/ws/server_h3.md): flare.ws.server_h3, in flare_mlake's API: Server-side WebSocket over HTTP/3 (RFC 9220). - [flare_mlake API: flare.ws.server_reactor](https://magmalake.dev/s/flare_mlake/api/ws/server_reactor.md): flare.ws.server_reactor, in flare_mlake's API: Event-driven WebSocket handlers for HTTP/1.1 upgrades on the reactor. - [hashes API](https://magmalake.dev/s/hashes/api.md): The API of hashes: the hashes package's modules, structs, traits and functions, with their signatures and docstrings. - [hashes API: hashes.crc32](https://magmalake.dev/s/hashes/api/crc32.md): hashes.crc32, in hashes's API: CRC-32 (IEEE 802.3 / zlib / gzip / PNG) — reflected polynomial 0xEDB88320, init/xorout 0xFFFFFFFF. Table-driven with a slice-by-8 fast path. - [hashes API: hashes.murmur3](https://magmalake.dev/s/hashes/api/murmur3.md): hashes.murmur3, in hashes's API: MurmurHash3_x86_32, plus the Iceberg Appendix-B pre-hash wrappers. - [hashes API: hashes.xxh64](https://magmalake.dev/s/hashes/api/xxh64.md): hashes.xxh64, in hashes's API: XXH64 per https://github.com/Cyan4973/xxHash/blob/dev/doc/xxhash_spec.md. - [iceberg-rs API](https://magmalake.dev/s/iceberg-rs/api.md): The API of iceberg-rs: the iceberg_rs package's modules, structs, traits and functions, with their signatures and docstrings. - [iceberg API](https://magmalake.dev/s/iceberg/api.md): The API of iceberg: the iceberg package's modules, structs, traits and functions, with their signatures and docstrings. - [iceberg API: iceberg.append](https://magmalake.dev/s/iceberg/api/append.md): iceberg.append, in iceberg's API: Fast append: new data files, a new manifest, a new snapshot. - [iceberg API: iceberg.batch](https://magmalake.dev/s/iceberg/api/batch.md): iceberg.batch, in iceberg's API: Building an Arrow `RecordBatch` from Mojo values. - [iceberg API: iceberg.catalog](https://magmalake.dev/s/iceberg/api/catalog.md): iceberg.catalog, in iceberg's API: Catalogs: how a table name becomes a `TableMetadata`. - [iceberg API: iceberg.catalog.filesystem](https://magmalake.dev/s/iceberg/api/catalog/filesystem.md): iceberg.catalog.filesystem, in iceberg's API: Filesystem tables: a table is a directory, no catalog service involved. - [iceberg API: iceberg.catalog.rest](https://magmalake.dev/s/iceberg/api/catalog/rest.md): iceberg.catalog.rest, in iceberg's API: Iceberg REST catalog — URLs, headers, responses, and the socket. - [iceberg API: iceberg.catalog.sql](https://magmalake.dev/s/iceberg/api/catalog/sql.md): iceberg.catalog.sql, in iceberg's API: A JDBC-style SQL catalog, over sqlite.mojo or postgres.mojo — the schema and semantics PyIceberg's `SqlCatalog` uses. - [iceberg API: iceberg.commit](https://magmalake.dev/s/iceberg/api/commit.md): iceberg.commit, in iceberg's API: A snapshot that adds *and* removes files, with the manifest maintenance that implies. - [iceberg API: iceberg.delete](https://magmalake.dev/s/iceberg/api/delete.md): iceberg.delete, in iceberg's API: Row-level delete and overwrite: which rows go, and how they are recorded. - [iceberg API: iceberg.expressions](https://magmalake.dev/s/iceberg/api/expressions.md): iceberg.expressions, in iceberg's API: Row filters: unbound and bound predicates, binding, projection, evaluators. - [iceberg API: iceberg.io](https://magmalake.dev/s/iceberg/api/io.md): iceberg.io, in iceberg's API: File access: locations in, bytes out — over local files, S3, GCS, Azure or plain HTTP. - [iceberg API: iceberg.json](https://magmalake.dev/s/iceberg/api/json.md): iceberg.json, in iceberg's API: A small, dependency-free JSON reader/writer for Iceberg metadata. - [iceberg API: iceberg.kernels](https://magmalake.dev/s/iceberg/api/kernels.md): iceberg.kernels, in iceberg's API: Columnar kernels: the Arrow arrays a scan produces, without a `Datum` in sight. - [iceberg API: iceberg.maintain](https://magmalake.dev/s/iceberg/api/maintain.md): iceberg.maintain, in iceberg's API: Expiring snapshots, and deleting the files that nothing points at any more. - [iceberg API: iceberg.manifest](https://magmalake.dev/s/iceberg/api/manifest.md): iceberg.manifest, in iceberg's API: Manifest lists and manifests, read through avro.mojo. - [iceberg API: iceberg.manifest_write](https://magmalake.dev/s/iceberg/api/manifest_write.md): iceberg.manifest_write, in iceberg's API: Writing manifests and manifest lists. - [iceberg API: iceberg.metadata](https://magmalake.dev/s/iceberg/api/metadata.md): iceberg.metadata, in iceberg's API: `TableMetadata` — the whole of an Iceberg `*.metadata.json`, v1 through v3. - [iceberg API: iceberg.nested](https://magmalake.dev/s/iceberg/api/nested.md): iceberg.nested, in iceberg's API: Nested columns — struct, list and map — as Arrow trees. - [iceberg API: iceberg.puffin](https://magmalake.dev/s/iceberg/api/puffin.md): iceberg.puffin, in iceberg's API: Puffin files: the sidecar format Iceberg keeps deletion vectors and sketches in. - [iceberg API: iceberg.read](https://magmalake.dev/s/iceberg/api/read.md): iceberg.read, in iceberg's API: Reading rows: `TableScan.to_table()` and `to_batches()`. - [iceberg API: iceberg.scan](https://magmalake.dev/s/iceberg/api/scan.md): iceberg.scan, in iceberg's API: Scan planning: which data files a query must read, and which deletes apply. - [iceberg API: iceberg.schema](https://magmalake.dev/s/iceberg/api/schema.md): iceberg.schema, in iceberg's API: `Schema` — an Iceberg struct type with a schema id and identifier fields. - [iceberg API: iceberg.transforms](https://magmalake.dev/s/iceberg/api/transforms.md): iceberg.transforms, in iceberg's API: Partition transforms and partition specs. - [iceberg API: iceberg.types](https://magmalake.dev/s/iceberg/api/types.md): iceberg.types, in iceberg's API: Iceberg data types — primitives, nested types, and their JSON forms. - [iceberg API: iceberg.update_schema](https://magmalake.dev/s/iceberg/api/update_schema.md): iceberg.update_schema, in iceberg's API: Schema evolution: add columns, rename them, make them optional, widen them. - [iceberg API: iceberg.util](https://magmalake.dev/s/iceberg/api/util.md): iceberg.util, in iceberg's API: The three things a writer needs from outside itself: the wall clock, a random 64-bit number, and a UUID. - [iceberg API: iceberg.values](https://magmalake.dev/s/iceberg/api/values.md): iceberg.values, in iceberg's API: Typed single values (`Datum`) and Iceberg's two single-value encodings. - [iceberg API: iceberg.write](https://magmalake.dev/s/iceberg/api/write.md): iceberg.write, in iceberg's API: Writing data files: Arrow in, Parquet out, a `DataFile` record back. - [json_mlake API](https://magmalake.dev/s/json_mlake/api.md): The API of json_mlake: the json package's modules, structs, traits and functions, with their signatures and docstrings. - [json_mlake API: json.config](https://magmalake.dev/s/json_mlake/api/config.md): json.config, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu](https://magmalake.dev/s/json_mlake/api/cpu.md): json.cpu, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.number_parse](https://magmalake.dev/s/json_mlake/api/cpu/number_parse.md): json.cpu.number_parse, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.simd_clmul](https://magmalake.dev/s/json_mlake/api/cpu/simd_clmul.md): json.cpu.simd_clmul, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.simdjson_ffi](https://magmalake.dev/s/json_mlake/api/cpu/simdjson_ffi.md): json.cpu.simdjson_ffi, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.stage1](https://magmalake.dev/s/json_mlake/api/cpu/stage1.md): json.cpu.stage1, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.stage1_scalar](https://magmalake.dev/s/json_mlake/api/cpu/stage1_scalar.md): json.cpu.stage1_scalar, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.stage2](https://magmalake.dev/s/json_mlake/api/cpu/stage2.md): json.cpu.stage2, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.types](https://magmalake.dev/s/json_mlake/api/cpu/types.md): json.cpu.types, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.cpu.validate](https://magmalake.dev/s/json_mlake/api/cpu/validate.md): json.cpu.validate, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.deserialize](https://magmalake.dev/s/json_mlake/api/deserialize.md): json.deserialize, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.document](https://magmalake.dev/s/json_mlake/api/document.md): json.document, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.dtoa](https://magmalake.dev/s/json_mlake/api/dtoa.md): json.dtoa, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.errors](https://magmalake.dev/s/json_mlake/api/errors.md): json.errors, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.ijson](https://magmalake.dev/s/json_mlake/api/ijson.md): json.ijson, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.iterator](https://magmalake.dev/s/json_mlake/api/iterator.md): json.iterator, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.jsonpath](https://magmalake.dev/s/json_mlake/api/jsonpath.md): json.jsonpath, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.lazy](https://magmalake.dev/s/json_mlake/api/lazy.md): json.lazy, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.ndjson](https://magmalake.dev/s/json_mlake/api/ndjson.md): json.ndjson, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.parser](https://magmalake.dev/s/json_mlake/api/parser.md): json.parser, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.patch](https://magmalake.dev/s/json_mlake/api/patch.md): json.patch, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.pointer](https://magmalake.dev/s/json_mlake/api/pointer.md): json.pointer, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.prelude](https://magmalake.dev/s/json_mlake/api/prelude.md): json.prelude, in json_mlake's API: Curated re-export of the names everyday json code reaches for. - [json_mlake API: json.reader](https://magmalake.dev/s/json_mlake/api/reader.md): json.reader, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.reflection](https://magmalake.dev/s/json_mlake/api/reflection.md): json.reflection, in json_mlake's API: Reflection-based JSON serialization and deserialization. - [json_mlake API: json.regex](https://magmalake.dev/s/json_mlake/api/regex.md): json.regex, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.schema](https://magmalake.dev/s/json_mlake/api/schema.md): json.schema, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.serialize](https://magmalake.dev/s/json_mlake/api/serialize.md): json.serialize, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.streaming](https://magmalake.dev/s/json_mlake/api/streaming.md): json.streaming, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.types](https://magmalake.dev/s/json_mlake/api/types.md): json.types, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.unicode](https://magmalake.dev/s/json_mlake/api/unicode.md): json.unicode, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.value](https://magmalake.dev/s/json_mlake/api/value.md): json.value, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.value.node](https://magmalake.dev/s/json_mlake/api/value/node.md): json.value.node, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.value.owned](https://magmalake.dev/s/json_mlake/api/value/owned.md): json.value.owned, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.value.raw_ops](https://magmalake.dev/s/json_mlake/api/value/raw_ops.md): json.value.raw_ops, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.value.value](https://magmalake.dev/s/json_mlake/api/value/value.md): json.value.value, in json_mlake's API: its structs, traits and functions. - [json_mlake API: json.writer](https://magmalake.dev/s/json_mlake/api/writer.md): json.writer, in json_mlake's API: its structs, traits and functions. - [k8s API](https://magmalake.dev/s/k8s/api.md): The API of k8s: the k8s package's modules, structs, traits and functions, with their signatures and docstrings. - [k8s API: k8s.client](https://magmalake.dev/s/k8s/api/client.md): k8s.client, in k8s's API: The calls: create, get, delete, list and watch, for Pods, Services and Jobs in a namespace, and a pod's log. - [k8s API: k8s.config](https://magmalake.dev/s/k8s/api/config.md): k8s.config, in k8s's API: Where the API server is and how to authenticate to it. - [k8s API: k8s.yaml](https://magmalake.dev/s/k8s/api/yaml.md): k8s.yaml, in k8s's API: Just enough YAML to read a kubeconfig: block mappings and sequences of scalars, read into a flat map from paths to strings. - [lint API](https://magmalake.dev/s/lint/api.md): The API of lint: the mojolint package's modules, structs, traits and functions, with their signatures and docstrings. - [lint API: mojolint.facts](https://magmalake.dev/s/lint/api/facts.md): mojolint.facts, in lint's API: What the compiler knows and the text does not, fetched in one LSP batch. - [lint API: mojolint.json](https://magmalake.dev/s/lint/api/json.md): mojolint.json, in lint's API: A small JSON reader and writer — enough for JSON-RPC. - [lint API: mojolint.lsp](https://magmalake.dev/s/lint/api/lsp.md): mojolint.lsp, in lint's API: A batch client for `mojo-lsp-server`. - [lint API: mojolint.rules](https://magmalake.dev/s/lint/api/rules.md): mojolint.rules, in lint's API: The rules. Each is one function over a file's logical lines and its recovered structure, returning `Finding`s. `RULES` is the table the CLI and the corpus harness read; add an entry and a branch in `run_rule` for L004. - [lint API: mojolint.structure](https://magmalake.dev/s/lint/api/structure.md): mojolint.structure, in lint's API: Functions, parameters, structs and fields, recovered from logical lines by indentation alone. - [lint API: mojolint.tokenize](https://magmalake.dev/s/lint/api/tokenize.md): mojolint.tokenize, in lint's API: Logical lines: Mojo source with comments removed, string contents blanked, and bracketed continuations joined. - [lz4 API](https://magmalake.dev/s/lz4/api.md): The API of lz4: the lz4 package's modules, structs, traits and functions, with their signatures and docstrings. - [memory-region API](https://magmalake.dev/s/memory-region/api.md): The API of memory-region: the memory_region package's modules, structs, traits and functions, with their signatures and docstrings. - [memory-region API: memory_region.bump](https://magmalake.dev/s/memory-region/api/bump.md): memory_region.bump, in memory-region's API: A cursor that only moves forward. - [memory-region API: memory_region.ffi](https://magmalake.dev/s/memory-region/api/ffi.md): memory_region.ffi, in memory-region's API: POSIX, for the two backings that need it. - [memory-region API: memory_region.region](https://magmalake.dev/s/memory-region/api/region.md): memory_region.region, in memory-region's API: Where a region's bytes come from, and what giving them back means. - [mozz_mlake API](https://magmalake.dev/s/mozz_mlake/api.md): The API of mozz_mlake: the mozz package's modules, structs, traits and functions, with their signatures and docstrings. - [mozz_mlake API: mozz.arbitrary](https://magmalake.dev/s/mozz_mlake/api/arbitrary.md): mozz.arbitrary, in mozz_mlake's API: Typed random value generation for property-based testing. - [mozz_mlake API: mozz.corpus](https://magmalake.dev/s/mozz_mlake/api/corpus.md): mozz.corpus, in mozz_mlake's API: Corpus management for fuzzing. - [mozz_mlake API: mozz.minimize](https://magmalake.dev/s/mozz_mlake/api/minimize.md): mozz.minimize, in mozz_mlake's API: Delta-debugging input minimizer (Andreas Zeller's ddmin algorithm). - [mozz_mlake API: mozz.mutator](https://magmalake.dev/s/mozz_mlake/api/mutator.md): mozz.mutator, in mozz_mlake's API: Byte-level mutation operators for fuzzing. - [mozz_mlake API: mozz.property](https://magmalake.dev/s/mozz_mlake/api/property.md): mozz.property, in mozz_mlake's API: Property-based testing frontend. - [mozz_mlake API: mozz.rng](https://magmalake.dev/s/mozz_mlake/api/rng.md): mozz.rng, in mozz_mlake's API: Xoshiro256++ — fast, seedable, non-cryptographic PRNG. - [mozz_mlake API: mozz.runner](https://magmalake.dev/s/mozz_mlake/api/runner.md): mozz.runner, in mozz_mlake's API: Main fuzzing loop, configuration, and crash handling. - [objectstore API](https://magmalake.dev/s/objectstore/api.md): The API of objectstore: the objectstore package's modules, structs, traits and functions, with their signatures and docstrings. - [objectstore API: objectstore.azure](https://magmalake.dev/s/objectstore/api/azure.md): objectstore.azure, in objectstore's API: `objectstore.azure` — Azure Blob Storage through SAS-token URLs. - [objectstore API: objectstore.crypto](https://magmalake.dev/s/objectstore/api/crypto.md): objectstore.crypto, in objectstore's API: `objectstore.crypto` — SHA-256, HMAC-SHA256 and hex, in pure Mojo. - [objectstore API: objectstore.fileio](https://magmalake.dev/s/objectstore/api/fileio.md): objectstore.fileio, in objectstore's API: `objectstore.fileio` — the `InputFile` / `OutputFile` / `FileIO` traits and the scheme resolver. - [objectstore API: objectstore.gcs](https://magmalake.dev/s/objectstore/api/gcs.md): objectstore.gcs, in objectstore's API: `objectstore.gcs` — Google Cloud Storage over the S3-compatible XML endpoint. - [objectstore API: objectstore.http](https://magmalake.dev/s/objectstore/api/http.md): objectstore.http, in objectstore's API: `objectstore.http` — an HTTP/HTTPS client over libcurl. - [objectstore API: objectstore.httpio](https://magmalake.dev/s/objectstore/api/httpio.md): objectstore.httpio, in objectstore's API: `objectstore.httpio` — a read-only `InputFile` over `http(s)://`. - [objectstore API: objectstore.local](https://magmalake.dev/s/objectstore/api/local.md): objectstore.local, in objectstore's API: `objectstore.local` — the filesystem backend. - [objectstore API: objectstore.path](https://magmalake.dev/s/objectstore/api/path.md): objectstore.path, in objectstore's API: `objectstore.path` — URI parsing and location handling. - [objectstore API: objectstore.ranges](https://magmalake.dev/s/objectstore/api/ranges.md): objectstore.ranges, in objectstore's API: `objectstore.ranges` — byte ranges, and the plan that turns many into few. - [objectstore API: objectstore.s3](https://magmalake.dev/s/objectstore/api/s3.md): objectstore.s3, in objectstore's API: `objectstore.s3` — an S3 client over `HttpClient`, signed with SigV4. - [objectstore API: objectstore.sigv4](https://magmalake.dev/s/objectstore/api/sigv4.md): objectstore.sigv4, in objectstore's API: `objectstore.sigv4` — AWS Signature Version 4, header and query flavours. - [Orca API](https://magmalake.dev/s/orca/api.md): The API of Orca: the orca package's modules, structs, traits and functions, with their signatures and docstrings. - [Orca API: orca.actions](https://magmalake.dev/s/orca/api/actions.md): orca.actions, in Orca's API: What `orca ui` does to runs: each action is rows in Postgres that the scheduler, or the run's own process, acts on. - [Orca API: orca.auth](https://magmalake.dev/s/orca/api/auth.md): orca.auth, in Orca's API: Who may act in `orca ui`: users with passwords, their sessions, and a record of what each did. - [Orca API: orca.aws](https://magmalake.dev/s/orca/api/aws.md): orca.aws, in Orca's API: `orca aws`: a project's orca on AWS, with the `aws` and `docker` commands its user already has (`aws login`, or `AWS_PROFILE` for a named profile). - [Orca API: orca.aws_assets](https://magmalake.dev/s/orca/api/aws_assets.md): orca.aws_assets, in Orca's API: The stack template and the project Dockerfile `orca aws` writes out: deploy/aws/orca.yaml and deploy/project.Dockerfile, embedded by scripts/embed-aws.py. Edit those, then run it; `pixi run test-aws-assets` fails while this is out of date. - [Orca API: orca.awsec2](https://magmalake.dev/s/orca/api/awsec2.md): orca.awsec2, in Orca's API: The few EC2 calls the `ec2` runner makes (`orca.ec2`), over objectstore's SigV4 signing and HTTP. - [Orca API: orca.chart](https://magmalake.dev/s/orca/api/chart.md): orca.chart, in Orca's API: Runs per day, drawn as SVG on the server for the home page: one bar a day, stacked by how the runs ended. - [Orca API: orca.civil](https://magmalake.dev/s/orca/api/civil.md): orca.civil, in Orca's API: Calendar arithmetic: dates to days since 1970-01-01 and back. - [Orca API: orca.cli](https://magmalake.dev/s/orca/api/cli.md): orca.cli, in Orca's API: `orca_main`: the command line every pipeline binary gets. - [Orca API: orca.command](https://magmalake.dev/s/orca/api/command.md): orca.command, in Orca's API: The `orca` command: the scheduler, the UI and registration, in a binary that links no pipeline. A project builds its own from two lines: - [Orca API: orca.cron](https://magmalake.dev/s/orca/api/cron.md): orca.cron, in Orca's API: Cron expressions, and when they next fire in a time zone. - [Orca API: orca.ctx](https://magmalake.dev/s/orca/api/ctx.md): orca.ctx, in Orca's API: `Ctx`: what a step gets besides its input. - [Orca API: orca.dag](https://magmalake.dev/s/orca/api/dag.md): orca.dag, in Orca's API: A pipeline's DAG drawn as SVG, on the server. - [Orca API: orca.day](https://magmalake.dev/s/orca/api/day.md): orca.day, in Orca's API: `Day`: the partition key of a daily pipeline. - [Orca API: orca.ec2](https://magmalake.dev/s/orca/api/ec2.md): orca.ec2, in Orca's API: Runs on EC2: a head instance and worker instances per run, started and ended by the scheduler (DESIGN.md, phase 5, PR 5). - [Orca API: orca.graph](https://magmalake.dev/s/orca/api/graph.md): orca.graph, in Orca's API: A directed graph drawn as SVG, on the server: the pipelines and datasets that feed each other, and a snapshot's lineage. - [Orca API: orca.heartbeat](https://magmalake.dev/s/orca/api/heartbeat.md): orca.heartbeat, in Orca's API: A run's heartbeat, kept fresh from a thread while the run's steps work. - [Orca API: orca.html](https://magmalake.dev/s/orca/api/html.md): orca.html, in Orca's API: Writing HTML: every value escaped, markup only where it's said to be. - [Orca API: orca.json](https://magmalake.dev/s/orca/api/json.md): orca.json, in Orca's API: The little JSON orca writes: quoted strings. - [Orca API: orca.key](https://magmalake.dev/s/orca/api/key.md): orca.key, in Orca's API: `Key`: what a partition key is, whatever it counts. - [Orca API: orca.keyed](https://magmalake.dev/s/orca/api/keyed.md): orca.keyed, in Orca's API: Keyed partitions: keys that are names, read from a column of a dataset. - [Orca API: orca.kube](https://magmalake.dev/s/orca/api/kube.md): orca.kube, in Orca's API: Runs on Kubernetes: a dista cluster per run, made and removed by the scheduler (K8S.md). - [Orca API: orca.lineage](https://magmalake.dev/s/orca/api/lineage.md): orca.lineage, in Orca's API: Lineage: which snapshots a dataset's snapshot was made from, and what was made from it, from the reads and commits every attempt records. - [Orca API: orca.locate](https://magmalake.dev/s/orca/api/locate.md): orca.locate, in Orca's API: Where a pipeline's step functions and dista tasks are defined in its source, so `orca ui` can link each one to its line at the commit a run ran. - [Orca API: orca.logs](https://magmalake.dev/s/orca/api/logs.md): orca.logs, in Orca's API: Where attempts' logs, drivers' logs and runs' timelines go. - [Orca API: orca.month](https://magmalake.dev/s/orca/api/month.md): orca.month, in Orca's API: `Month`: the partition key of a monthly pipeline. - [Orca API: orca.name](https://magmalake.dev/s/orca/api/name.md): orca.name, in Orca's API: `Name`: the partition key of a keyed pipeline (`orca.keyed`). - [Orca API: orca.partitions](https://magmalake.dev/s/orca/api/partitions.md): orca.partitions, in Orca's API: Partition sets: which keys a pipeline is partitioned by, from when. - [Orca API: orca.pipeline](https://magmalake.dev/s/orca/api/pipeline.md): orca.pipeline, in Orca's API: Pipelines: a named list of steps, checked and run in order. - [Orca API: orca.proc](https://magmalake.dev/s/orca/api/proc.md): orca.proc, in Orca's API: Starting processes: what the scheduler needs to run pipeline binaries. - [Orca API: orca.schedule](https://magmalake.dev/s/orca/api/schedule.md): orca.schedule, in Orca's API: Schedules: when a pipeline runs by itself, and which partition it fills. - [Orca API: orca.scheduler](https://magmalake.dev/s/orca/api/scheduler.md): orca.scheduler, in Orca's API: The scheduler: fires schedules, senses datasets, queues backfills and rebuilds, and starts runs. - [Orca API: orca.secrets](https://magmalake.dev/s/orca/api/secrets.md): orca.secrets, in Orca's API: Secrets a pipeline's runs get: `orca register --secret NAME=ID`. - [Orca API: orca.sensors](https://magmalake.dev/s/orca/api/sensors.md): orca.sensors, in Orca's API: Runs started by datasets: sensors, and rebuilds downstream of a dataset. - [Orca API: orca.source](https://magmalake.dev/s/orca/api/source.md): orca.source, in Orca's API: Where a pipeline binary's code came from: its git repository and commit, given at build time. - [Orca API: orca.state](https://magmalake.dev/s/orca/api/state.md): orca.state, in Orca's API: orca's state in Postgres: pipelines, runs, steps and attempts. - [Orca API: orca.step](https://magmalake.dev/s/orca/api/step.md): orca.step, in Orca's API: Steps: the functions a pipeline runs, and the edges between them. - [Orca API: orca.store](https://magmalake.dev/s/orca/api/store.md): orca.store, in Orca's API: Where the executor records what it does. - [Orca API: orca.tables](https://magmalake.dev/s/orca/api/tables.md): orca.tables, in Orca's API: Iceberg tables from steps: pinned reads, and commits a retry recognises. - [Orca API: orca.tasks](https://magmalake.dev/s/orca/api/tasks.md): orca.tasks, in Orca's API: The dista tasks a pipeline's steps call, and the runtime a run gets. - [Orca API: orca.timeline](https://magmalake.dev/s/orca/api/timeline.md): orca.timeline, in Orca's API: A run's Dista timeline and its workers over time, drawn as SVG on the server for the run's page. - [Orca API: orca.tz](https://magmalake.dev/s/orca/api/tz.md): orca.tz, in Orca's API: Time zones, from the system's TZif files (RFC 8536). - [Orca API: orca.ui](https://magmalake.dev/s/orca/api/ui.md): orca.ui, in Orca's API: `orca ui`: pipelines and runs as web pages, and the same as JSON. - [Orca API: orca.ui_style](https://magmalake.dev/s/orca/api/ui_style.md): orca.ui_style, in Orca's API: The stylesheet `orca ui` serves at `/static/orca.css`: magmalake.dev's colours and type, light and dark, and system fonts (nothing is fetched). - [Orca API: orca.warehouse](https://magmalake.dev/s/orca/api/warehouse.md): orca.warehouse, in Orca's API: A dataset's current snapshot, read from its table's metadata file without iceberg, for ` sense`. - [parquet-full API](https://magmalake.dev/s/parquet-full/api.md): The API of parquet-full: the parquet_full package's modules, structs, traits and functions, with their signatures and docstrings. - [parquet API](https://magmalake.dev/s/parquet/api.md): The API of parquet: the parquet package's modules, structs, traits and functions, with their signatures and docstrings. - [parquet API: parquet.alp](https://magmalake.dev/s/parquet/api/alp.md): parquet.alp, in parquet's API: ALP — Adaptive Lossless floating-Point, Parquet encoding 10. - [parquet API: parquet.arrow](https://magmalake.dev/s/parquet/api/arrow.md): parquet.arrow, in parquet's API: Compatibility re-export. The Arrow layer lives in `arrow-mlake.mojo` now. - [parquet API: parquet.assemble](https://magmalake.dev/s/parquet/api/assemble.md): parquet.assemble, in parquet's API: Dremel record assembly: definition and repetition levels back into Arrow. - [parquet API: parquet.bitio](https://magmalake.dev/s/parquet/api/bitio.md): parquet.bitio, in parquet's API: Bit-level readers: little-endian bit packing and the RLE/bit-packed hybrid. - [parquet API: parquet.bloom](https://magmalake.dev/s/parquet/api/bloom.md): parquet.bloom, in parquet's API: Split-block bloom filters — `might_contain` for equality predicates. - [parquet API: parquet.carrow](https://magmalake.dev/s/parquet/api/carrow.md): parquet.carrow, in parquet's API: Compatibility re-export. The C Data Interface export lives in `arrow-mlake.mojo` now — see `parquet.arrow` for why. - [parquet API: parquet.carrow_import](https://magmalake.dev/s/parquet/api/carrow_import.md): parquet.carrow_import, in parquet's API: Compatibility re-export. The C Data Interface import lives in `arrow-mlake.mojo` now — see `parquet.arrow` for why. - [parquet API: parquet.codec](https://magmalake.dev/s/parquet/api/codec.md): parquet.codec, in parquet's API: Page compression codecs. - [parquet API: parquet.convert](https://magmalake.dev/s/parquet/api/convert.md): parquet.convert, in parquet's API: Physical Parquet values to Arrow buffers. - [parquet API: parquet.display](https://magmalake.dev/s/parquet/api/display.md): parquet.display, in parquet's API: Human- and JSON-readable rendering of decoded Arrow arrays, for the CLI. - [parquet API: parquet.encoding](https://magmalake.dev/s/parquet/api/encoding.md): parquet.encoding, in parquet's API: Value encodings: PLAIN, dictionaries, the DELTA family, BYTE_STREAM_SPLIT. - [parquet API: parquet.page](https://magmalake.dev/s/parquet/api/page.md): parquet.page, in parquet's API: Page decoding: headers, compression, levels, and the values inside. - [parquet API: parquet.reader](https://magmalake.dev/s/parquet/api/reader.md): parquet.reader, in parquet's API: `ParquetReader` — open a file, pick columns and row groups, read batches. - [parquet API: parquet.rle_encode](https://magmalake.dev/s/parquet/api/rle_encode.md): parquet.rle_encode, in parquet's API: Encoders for the two bit-level formats a Parquet writer needs. - [parquet API: parquet.schema](https://magmalake.dev/s/parquet/api/schema.md): parquet.schema, in parquet's API: The Parquet schema tree, its leaf columns, and the Arrow schema it means. - [parquet API: parquet.stats](https://magmalake.dev/s/parquet/api/stats.md): parquet.stats, in parquet's API: Column statistics, decoded from their raw bytes to typed values. - [parquet API: parquet.writer](https://magmalake.dev/s/parquet/api/writer.md): parquet.writer, in parquet's API: `ParquetWriter` — write Arrow arrays back out as a Parquet file. - [postgres API](https://magmalake.dev/s/postgres/api.md): The API of postgres: the postgres package's modules, structs, traits and functions, with their signatures and docstrings. - [postgres API: postgres.config](https://magmalake.dev/s/postgres/api/config.md): postgres.config, in postgres's API: Typed connection configuration. - [postgres API: postgres.connection](https://magmalake.dev/s/postgres/api/connection.md): postgres.connection, in postgres's API: `postgres.connection` — the connection, its statements and its transactions. - [postgres API: postgres.copy](https://magmalake.dev/s/postgres/api/copy.md): postgres.copy, in postgres's API: `postgres.copy` — bulk transfer with ``COPY``, in both directions. - [postgres API: postgres.copyfmt](https://magmalake.dev/s/postgres/api/copyfmt.md): postgres.copyfmt, in postgres's API: `postgres.copyfmt` — encode and parse rows for PostgreSQL's COPY text and CSV sub-formats. - [postgres API: postgres.params](https://magmalake.dev/s/postgres/api/params.md): postgres.params, in postgres's API: `postgres.params` — the `Params` builder for `PQexecParams` / `PQexecPrepared`. - [postgres API: postgres.pool](https://magmalake.dev/s/postgres/api/pool.md): postgres.pool, in postgres's API: `postgres.pool` — connections shared safely between threads. - [postgres API: postgres.result](https://magmalake.dev/s/postgres/api/result.md): postgres.result, in postgres's API: `postgres.result` — the rows a query returned, and the typed accessors. - [postgres API: postgres.sqlstate](https://magmalake.dev/s/postgres/api/sqlstate.md): postgres.sqlstate, in postgres's API: SQLSTATE handling: structured errors, and the codes libpq reports. - [postgres API: postgres.text](https://magmalake.dev/s/postgres/api/text.md): postgres.text, in postgres's API: `postgres.text` — the PostgreSQL text-format codec. - [restate API](https://magmalake.dev/s/restate/api.md): The API of restate: the restate package's modules, structs, traits and functions, with their signatures and docstrings. - [roaring API](https://magmalake.dev/s/roaring/api.md): The API of roaring: the roaring package's modules, structs, traits and functions, with their signatures and docstrings. - [roaring API: roaring.bitmap32](https://magmalake.dev/s/roaring/api/bitmap32.md): roaring.bitmap32, in roaring's API: `Bitmap32` — a Roaring bitmap over `UInt32` values: a sorted set of 16-bit-keyed `Container`s, one per distinct high-16-bits key present. - [roaring API: roaring.bitmap64](https://magmalake.dev/s/roaring/api/bitmap64.md): roaring.bitmap64, in roaring's API: `Bitmap64` — a Roaring bitmap over `UInt64` values, per the "extension for 64-bit implementations": a sorted map from a 32-bit high key to a full `Bitmap32` over the low 32 bits. This is the shape Apache Iceberg uses for deletion vectors (row positions are `UInt64`). - [roaring API: roaring.container](https://magmalake.dev/s/roaring/api/container.md): roaring.container, in roaring's API: A single Roaring container, keyed externally by a 16-bit high key and holding up to 65536 low-16-bit values in one of three representations. - [roaring API: roaring.crc32](https://magmalake.dev/s/roaring/api/crc32.md): roaring.crc32, in roaring's API: A plain, from-scratch CRC-32 (the IEEE 802.3 / zlib / gzip variant: poly 0xEDB88320 reflected, init 0xFFFFFFFF, final XOR 0xFFFFFFFF) — no dependencies, used to checksum Iceberg deletion-vector blobs. - [roaring API: roaring.iceberg_dv](https://magmalake.dev/s/roaring/api/iceberg_dv.md): roaring.iceberg_dv, in roaring's API: Apache Iceberg "deletion vector v1" blob framing (https://iceberg.apache.org/puffin-spec/#deletion-vector-v1-blob-type). - [roaring API: roaring.portable](https://magmalake.dev/s/roaring/api/portable.md): roaring.portable, in roaring's API: Shared constants and little-endian byte helpers for the Roaring "portable" serialization format (RoaringFormatSpec) — used by both the 32-bit container layer and the `Bitmap32`/`Bitmap64` assemblers. - [snappy API](https://magmalake.dev/s/snappy/api.md): The API of snappy: the snappy package's modules, structs, traits and functions, with their signatures and docstrings. - [snappy API: snappy.crc32c](https://magmalake.dev/s/snappy/api/crc32c.md): snappy.crc32c, in snappy's API: CRC-32C (Castagnoli, polynomial 0x1EDC6F41 / reflected 0x82F63B78), init/xorout 0xFFFFFFFF. Table-driven with a slice-by-8 fast path. - [snappy API: snappy.framing](https://magmalake.dev/s/snappy/api/framing.md): snappy.framing, in snappy's API: Snappy **framing format**: a `sNaPpY` stream identifier chunk followed by a sequence of length-prefixed chunks, each either compressed or uncompressed raw-format data guarded by a masked CRC-32C. See https://github.com/google/snappy/blob/main/framing_format.txt. - [snappy API: snappy.raw](https://magmalake.dev/s/snappy/api/raw.md): snappy.raw, in snappy's API: Snappy **raw block format**: a leading varint giving the uncompressed length, followed by a stream of literal / copy elements. See https://github.com/google/snappy/blob/main/format_description.txt. - [sqlite API](https://magmalake.dev/s/sqlite/api.md): The API of sqlite: the sqlite package's modules, structs, traits and functions, with their signatures and docstrings. - [sqlite API: sqlite.db](https://magmalake.dev/s/sqlite/api/db.md): sqlite.db, in sqlite's API: Safe Mojo API for SQLite -- Layer 2. - [sqlite API: sqlite.ffi](https://magmalake.dev/s/sqlite/api/ffi.md): sqlite.ffi, in sqlite's API: Low-level FFI wrappers for the SQLite C library. - [threads API](https://magmalake.dev/s/threads/api.md): The API of threads: the threads package's modules, structs, traits and functions, with their signatures and docstrings. - [threads API: threads.atomic](https://magmalake.dev/s/threads/api/atomic.md): threads.atomic, in threads's API: Atomics that compile on Mojo 1.2.0 *and* on current nightly. - [threads API: threads.ffi](https://magmalake.dev/s/threads/api/ffi.md): threads.ffi, in threads's API: Shared FFI vocabulary: the opaque pointer type every `threads` entry point speaks, and the C NULL convention. - [threads API: threads.mutex](https://magmalake.dev/s/threads/api/mutex.md): threads.mutex, in threads's API: A `pthread_mutex_t` (and `pthread_cond_t`) you can share between threads. - [threads API: threads.parallel](https://magmalake.dev/s/threads/api/parallel.md): threads.parallel, in threads's API: `parallel_for` — the reason this tin exists — plus the `spawn_n` / `join_all` layer underneath it. - [threads API: threads.pool](https://magmalake.dev/s/threads/api/pool.md): threads.pool, in threads's API: `WorkerPool` — N long-lived threads that run until you tell them to stop. - [threads API: threads.thread](https://magmalake.dev/s/threads/api/thread.md): threads.thread, in threads's API: OS threads: `ThreadHandle`, `num_cpus`, `current_thread_id`, CPU pinning. - [thrift API](https://magmalake.dev/s/thrift/api.md): The API of thrift: the thrift package's modules, structs, traits and functions, with their signatures and docstrings. - [thrift API: thrift.parquet_footer](https://magmalake.dev/s/thrift/api/parquet_footer.md): thrift.parquet_footer, in thrift's API: Locating and decoding the Parquet footer and page headers. - [thrift API: thrift.parquet_types](https://magmalake.dev/s/thrift/api/parquet_types.md): thrift.parquet_types, in thrift's API: The Apache Parquet metadata schema as Mojo structs. - [thrift API: thrift.protocol](https://magmalake.dev/s/thrift/api/protocol.md): thrift.protocol, in thrift's API: Apache Thrift wire protocols in pure Mojo — serialization only, no RPC. - [xml API](https://magmalake.dev/s/xml/api.md): The API of xml: the xml package's modules, structs, traits and functions, with their signatures and docstrings. - [xml API: xml.document](https://magmalake.dev/s/xml/api/document.md): xml.document, in xml's API: `xml.document` — a small read-only tree built from `XmlReader` events. - [xml API: xml.reader](https://magmalake.dev/s/xml/api/reader.md): xml.reader, in xml's API: `xml.reader` — a pull parser over an in-memory XML document. - [zstd API](https://magmalake.dev/s/zstd/api.md): The API of zstd: the zstd package's modules, structs, traits and functions, with their signatures and docstrings.