How it works
Three planes. Keep them separate or you couple storage to a machine again.
Control / data / compute
┌────────────┐ ┌─────────┐ ┌──────────────┐
│ Client │────▶│ rubberduck │────▶│ D1 control │
└────────────┘ │ API │ └──────────────┘
│ │
│ │ service binding
│ ▼
│ ┌──────────────┐ ┌─────────────┐
└───▶│ pdo-duckdb │────▶│ R2 Parquet │
│ DuckDB-WASM │ │ org_*/… │
└──────────────┘ └─────────────┘Control plane (D1)
Orgs, ducklings, placement, query metrics. Tiny rows. This is where D1 belongs.
An org is the tenancy and placement boundary. A duckling is a compute unit that can scale to zero (Durable Object for lifecycle; SQL runs elsewhere).
Data plane (R2)
org_acme/
events/part-000.parquet
customers/part-000.parquetTable name = first directory under the org prefix. Catalog today is a directory listing, not Iceberg.
Durable bytes live here. Kill every Worker. Data remains.
Compute plane (DuckDB)
pdo-duckdb is a minified Worker running @ducklings/workers (DuckDB-WASM with Asyncify httpfs). Stock @duckdb/duckdb-wasm wants eval / dynamic compile. Workers refuse that. Ducklings ships a precompiled module.
On query:
- Auth + SQL policy on rubberduck
- Resolve org prefix from D1
- Service-bind to
pdo-duckdb - Engine ensures an R2 secret, builds
VIEWs overread_parquet('r2://…')for tables named in the SQL - Run query, return JSON
Why two Workers: the WASM is ~41MB / ~10 MiB gzip. Stuffing it into the UI app exceeds Cloudflare's paid script limit. Split the engine (pdo-duckdb in the current deploy).
Query path, short
bash
curl -s -X POST https://pdo.b-christopher-3rd.workers.dev/v1/orgs/org_tpch/query \
-H 'authorization: Bearer demo-token' \
-H 'content-type: application/json' \
-d '{"sql":"SELECT count(*) FROM lineitem"}'
# 600572Warm groupbys on the sample orgs land around 150–300ms of engine wall time. Client latency runs higher — isolates and the service hop are part of the envelope. See Limits.
Outgrowing the Worker? See Scaling — same R2 prefix, bigger duckling.
Security (P0 → P1)
P0 uses a shared demo bearer. SQL policy blocks ATTACH/COPY/INSTALL and URI escapes. Views are scoped by org prefix. Per-org keys and scoped R2 credentials land in P1 for production multi-tenant use.