Data engineeringData-Pipeline

Data-Pipeline

A private-judge environment for diagnosing and repairing procedural, multi-fault analytics incidents across SQL, restricted Python, contracts, orchestration, warehouse state, lineage, logs, and dashboards. Agents must gather evidence, patch durable artifacts, run targeted recovery, and submit one structured diagnosis that survives hidden rebuild, idempotency, partition-isolation, and future-replay checks.

Data systemsPrivate verifierRL environment
Version2.0.0
Environments1
RewardScalar · 0–1
DeliveryPrivate ZIP
01 Task contract

A real, versioned RL environment.

A private-judge environment for diagnosing and repairing procedural, multi-fault analytics incidents across SQL, restricted Python, contracts, orchestration, warehouse state, lineage, logs, and dashboards. Agents must gather evidence, patch durable artifacts, run targeted recovery, and submit one structured diagnosis that survives hidden rebuild, idempotency, partition-isolation, and future-replay checks.

Agent objective

  • Interact with the supplied stateful environment.
  • Produce verifier-checkable actions or artifacts.
  • Maximise scalar reward under the package contract.

Evaluation

  • Private verifier.
  • Reported reward range 0–1.
  • Package-specific public and private checks.

Delivery boundary

  • Private object stored in Cloudflare R2.
  • Authenticated entitlement required.
  • Short-lived signed URL per download.
02 What you will work on

Distinct environments, one demanding research contract.

Enough detail to understand the intellectual terrain; generated instances, hidden mechanisms, and solution paths remain inside the private package.

EnvironmentMathematical or technical frontierAdaptive research problem
Schema and contract driftMixed producer versions and metadataRepair SQL, restricted Python, YAML contracts, and semantic definitions so fixes survive new schemas and future replay.
Incremental correctnessWatermarks, deduplication, tombstonesRecover late arrivals, authoritative versions, retries, and deletions without corrupting unaffected partitions.
Business-time semanticsSCD joins, FX, refunds, settlement datesPreserve effective-dated dimensions, daily conversion, partial reversals, and dashboard date meaning.
Operational recoveryLineage, asynchronous jobs, cache and publicationQueue minimal dependency-ordered repairs, validate canaries, refresh stale views, and avoid an over-budget full rebuild.
Incident diagnosisThree to five interacting faultsSeparate true causes from decoys and submit exact assets, ranges, evidence, verification, and residual risk.
03 Why it is interesting

What the supplied evaluation reveals.

A frozen task-aware policy developed on seeds 20–39 scored 100/100 on all 50 disjoint held-out incidents, covering 45 distinct fault combinations, while using about 58% of compute budget. This establishes broad procedural solvability, not average model performance. The package passed 14/14 tests. A separate HTTP stress test found six sessions with SQLite thread-affinity failures, so the core direct judge is strong but the HTTP deployment still needs concurrency hardening.

We publish aggregate behavior and task structure, while withholding generated instances, hidden labels, exact successful probes, private checks, and solution trajectories.

04 Supplied evaluation

Observed evaluation result.

Shown with its provenance and limitations; it is not a performance guarantee.

i
Methodology matters

Frozen after development seeds 20–39, then evaluated on 50 disjoint held-out seeds with 50/50 successes.

Evaluated system / policyGPT-5.6 Pro-assisted frozen policy

As identified by the supplied artifact.

Mean reward0.9248

50 reported runs.

Result artifactIncluded

data_pipeline_lab_v2_score_summary.json

Public result record

Machine-readable provenance and the exact displayed metric are available in results.json.

Open result JSON
05 Private delivery

The package stays off the public website.

The paid ZIP will live in a private R2 bucket. Vercel authorizes the buyer and issues a 2–5 minute object URL; R2 serves the bytes directly.

Included with purchase

  • Exact package version 2.0.0
  • Environment and task contracts
  • Verifier or scoring interface
  • Supplied reference/evaluation artifacts
  • Purchase record and licence v1.1
delivery flow
Authenticated buyer + entitlement check
+ private R2 object + 2–5 minute signed URL
= direct, auditable download

Package SHA-256
0ae856b31d79a59cbaaa254087b8118a34177521c263ca0407e493d438c54508
06 Licence v1.1

Commercial use, without exclusivity.

One purchase licenses this identified item to one legal organisation for worldwide, perpetual commercial model training, evaluation, research and development. Redistribution and resale of the package are not permitted.

Read the full licenceYotta Content LTD · business customers only
Data-Pipeline

Ready to add this environment?

Back to marketplace
Stripe checkout

Business purchase confirmation

Sign in or create an account, then complete secure Stripe Checkout. Access is granted only by the verified payment webhook.