Crate tiders_ingest 

tiders-ingest

Streams blockchain data from multiple provider backends as Apache Arrow RecordBatches.

Supports both EVM (Ethereum) and SVM (Solana) chains through a unified Query enum. Data is fetched from one of three provider backends:

• SQD (ProviderKind::Sqd) — SQD Network portal for historical data.
• HyperSync (ProviderKind::Hypersync) — Envio HyperSync for fast historical data.
• RPC (ProviderKind::Rpc) — Direct JSON-RPC node connection.

Use start_stream to create an async stream of BTreeMap<String, RecordBatch> where keys are table names (e.g. “blocks”, “transactions”, “logs”).

Modules

evm

EVM query types and field selection for the ingest layer.

svm

SVM (Solana) query types and field selection for the ingest layer.

Structs

ProviderConfig

Configuration for a data provider, including connection details and retry settings.

Enums

ProviderKind

The type of data provider backend.

Query

Top-level query type: either an EVM or SVM blockchain data query.

RpcTraceMethod

Selects which RPC method to use for fetching EVM execution traces.

Functions

start_stream

Creates an async stream of Arrow RecordBatches from the configured provider.