RLTasksby ulam.ai
Sign inAll tasks
Software engineeringN2-Ocaml

N2-Ocaml

A cumulative twelve-stage OCaml compiler-engineering environment that grows from an interpreter into a durable development system. Agents repair lexer, parser, evaluator, type inference, bytecode, diagnostics, caching, optimization, dependency planning, snapshots, and replay while preserving every earlier frontier across focused learning, regression recovery, cold-start reconstruction, and seeded-fault diagnosis.

Coding agentPrivate verifierRL environment
Version4.0.0
Environments12
RewardScalar · 0–1
DeliveryPrivate ZIP
01 Task contract

A real, versioned RL environment.

A cumulative twelve-stage OCaml compiler-engineering environment that grows from an interpreter into a durable development system. Agents repair lexer, parser, evaluator, type inference, bytecode, diagnostics, caching, optimization, dependency planning, snapshots, and replay while preserving every earlier frontier across focused learning, regression recovery, cold-start reconstruction, and seeded-fault diagnosis.

Agent objective

  • Interact with the supplied stateful environment.
  • Produce verifier-checkable actions or artifacts.
  • Maximise scalar reward under the package contract.

Evaluation

  • 12 verifier-backed environments.
  • Reported reward range 0–1.
  • Package-specific public and private checks.

Delivery boundary

  • Private object stored in Cloudflare R2.
  • Authenticated entitlement required.
  • Short-lived signed URL per download.
02 What you will work on

Distinct environments, one demanding research contract.

Enough detail to understand the intellectual terrain; generated instances, hidden mechanisms, and solution paths remain inside the private package.

EnvironmentMathematical or technical frontierAdaptive research problem
Levels 0–4Interpreter, types, lists, stable APIBuild lexical, parsing, closure, Hindley–Milner, pattern, and compatibility semantics with deterministic errors.
Levels 5–6Bytecode and diagnosticsCompile to a checked bounded stack machine and produce phase-specific Unicode-aware source diagnostics.
Levels 7–9Cache, optimizer, dependency graphPreserve migrations, invalidation, corruption recovery, strict errors, and deterministic planning through cycles and missing edges.
Level 10Durable snapshotsImplement immutable generations, publication locks, cleanup, fsync, atomic rename, and atomic-current updates.
Level 11Deterministic session replayReplay build, status, write, and delete histories while preserving dependency validity across standard through research profiles.
03 Why it is interesting

What the supplied evaluation reveals.

In a no-network single session, Claude Opus 5 completed every focused level, four cold-start Level-11 profiles, four regression runs, and a mutation run at 1.000 accepted. The final level initially missed one replay case, then recovered after diagnosing a dependency-deletion contract. The run covers 39 judged executions, while references pass all 36 level/track combinations and the corrected mutation matrix kills 15/15. Important caveats include unsandboxed execution and open commercial-certification gates.

We publish aggregate behavior and task structure, while withholding generated instances, hidden labels, exact successful probes, private checks, and solution trajectories.

04 Supplied evaluation

Observed evaluation result.

Shown with its provenance and limitations; it is not a performance guarantee.

i
Methodology matters

Single-session evaluation with no external network. All focused, gauntlet, regression, and mutation runs were accepted; each scored 1.000.

Evaluated system / policyClaude Opus 5

As identified by the supplied artifact.

Accepted runs39/39

39 reported runs.

Result artifactIncluded

n2_v4_run_notes.md

Public result record

Machine-readable provenance and the exact displayed metric are available in results.json.

Open result JSON
05 Private delivery

The package stays off the public website.

The paid ZIP will live in a private R2 bucket. Vercel authorizes the buyer and issues a 2–5 minute object URL; R2 serves the bytes directly.

Included with purchase

  • Exact package version 4.0.0
  • Environment and task contracts
  • Verifier or scoring interface
  • Supplied reference/evaluation artifacts
  • Purchase record and licence v1.1
delivery flow
Authenticated buyer + entitlement check
+ private R2 object + 2–5 minute signed URL
= direct, auditable download

Package SHA-256
5e299bdd59936aa52ddd6b49888d8dfa103b31583d1095987633780236dc8e5e
06 Licence v1.1

Commercial use, without exclusivity.

One purchase licenses this identified item to one legal organisation for worldwide, perpetual commercial model training, evaluation, research and development. Redistribution and resale of the package are not permitted.

Read the full licenceYotta Content LTD · business customers only
N2-Ocaml

Ready to add this environment?

Back to marketplace
Stripe checkout

Business purchase confirmation

Sign in or create an account, then complete secure Stripe Checkout. Access is granted only by the verified payment webhook.