RLTasksby ulam.ai
Sign inAll tasks
Data engineeringDATA-0188

DATA-0188

A time-boxed PostgreSQL optimization environment where agents rewrite one analytical cohort query and select up to three constrained indexes. Hidden evaluation requires exact business semantics before scoring p95 speedup across shifted data regimes alongside worst-case latency, index footprint, build cost, and write overhead—rewarding robust query-and-index co-design rather than narrow benchmark speed.

Data systemsPrivate verifierRL environment
Version2.0.0
Environments1
RewardScalar · 0–1
DeliveryPrivate ZIP
01 Task contract

A real, versioned RL environment.

A time-boxed PostgreSQL optimization environment where agents rewrite one analytical cohort query and select up to three constrained indexes. Hidden evaluation requires exact business semantics before scoring p95 speedup across shifted data regimes alongside worst-case latency, index footprint, build cost, and write overhead—rewarding robust query-and-index co-design rather than narrow benchmark speed.

Agent objective

  • Interact with the supplied stateful environment.
  • Produce verifier-checkable actions or artifacts.
  • Maximise scalar reward under the package contract.

Evaluation

  • Private verifier.
  • Reported reward range 0–1.
  • Package-specific public and private checks.

Delivery boundary

  • Private object stored in Cloudflare R2.
  • Authenticated entitlement required.
  • Short-lived signed URL per download.
02 What you will work on

Distinct environments, one demanding research contract.

Enough detail to understand the intellectual terrain; generated instances, hidden mechanisms, and solution paths remain inside the private package.

EnvironmentMathematical or technical frontierAdaptive research problem
Cohort semanticsActivation, retention, purchasing, revenuePreserve exact windows, distinct-user logic, nulls, negative amounts, UTC grouping, output types, and ordering.
Workload diversityBroad, narrow, filtered, and empty cohortsGeneralize across whale tenants, recent windows, country/channel selectivity, joint filters, and empty ranges.
Query rewritingPostgreSQL analytical planningReplace correlated subqueries with a parameterized read-only SELECT while retaining the full nine-column contract.
Index co-designB-tree/BRIN selection under budgetsChoose at most three declarative indexes within size and build-time limits rather than emitting arbitrary DDL.
Operational robustnessTail latency and write amplificationImprove p95 performance without material worst-case regression, excessive bytes, build cost, or write-path overhead.
03 Why it is interesting

What the supplied evaluation reveals.

Two independently restarted candidates both preserved exact results across three hidden profiles and six workloads each. In the available SQLite proxy, the stronger reached 0.3623 reward and 2.08× geometric-mean speedup, yet still regressed slightly on one workload and earned zero tail/write components. That makes the task an honest optimization tradeoff. Crucially, these are proxy results—not official PostgreSQL scores—because planner and physical-index behavior may differ.

We publish aggregate behavior and task structure, while withholding generated instances, hidden labels, exact successful probes, private checks, and solution trajectories.

04 Supplied evaluation

Observed evaluation result.

Shown with its provenance and limitations; it is not a performance guarantee.

i
Methodology matters

Two independently restarted agents were correct. This is a deterministic SQLite proxy result, explicitly not the official PostgreSQL score.

Evaluated system / policyGPT-5.6 Pro agents

As identified by the supplied artifact.

Best proxy reward0.3623

2 reported runs.

Result artifactIncluded

DATA-SQLDATA-0188-v2-local-report.md

Public result record

Machine-readable provenance and the exact displayed metric are available in results.json.

Open result JSON
05 Private delivery

The package stays off the public website.

The paid ZIP will live in a private R2 bucket. Vercel authorizes the buyer and issues a 2–5 minute object URL; R2 serves the bytes directly.

Included with purchase

  • Exact package version 2.0.0
  • Environment and task contracts
  • Verifier or scoring interface
  • Supplied reference/evaluation artifacts
  • Purchase record and licence v1.1
delivery flow
Authenticated buyer + entitlement check
+ private R2 object + 2–5 minute signed URL
= direct, auditable download

Package SHA-256
6f53f94e13134b46adfd725fe1786e1a7ae451c8f7c5fe00b524af9f713e82ee
06 Licence v1.1

Commercial use, without exclusivity.

One purchase licenses this identified item to one legal organisation for worldwide, perpetual commercial model training, evaluation, research and development. Redistribution and resale of the package are not permitted.

Read the full licenceYotta Content LTD · business customers only
DATA-0188

Ready to add this environment?

Back to marketplace
Stripe checkout

Business purchase confirmation

Sign in or create an account, then complete secure Stripe Checkout. Access is granted only by the verified payment webhook.