Datuva by Zovda · Training data

Repository tasks that run and are graded automatically.

Each package pairs one repository issue with a runnable environment, a reference patch, a test patch, and a grading script — so a task can be attempted, checked, and scored without manual setup.

  • One issue per package
  • Sandbox included
  • Automatic grading
Collection contents

What ships in this collection.

One issue per package

Task and repository state together

The task statement and the repository state it applies to, kept together.

Sandbox image

Runs as delivered

An OCI layout under docker/ that starts without extra setup.

Reference patch

One accepted resolution

One accepted resolution, kept as a diff against the packaged state.

Tests and grading

Checks and a score, automatically

Checks are added by the test patch; grade.sh scores an attempt against them.

Record structure

What each record holds.

PathContents
task.jsonTask statement, repository reference, and runtime settings.
code.patchReference resolution as a diff.
test.patchTest additions applied before scoring.
grade.shScoring script whose output decides pass or fail.
docker/OCI image layout for the sandbox.
Training stage

Recommended use by stage.

StageHow it is used
SFTIssue-to-patch trajectories with a reference answer.
RLSandboxed attempts with automatic scores.
EvaluationEnd-to-end resolution checks on fixed packages.
Delivery

One structure per collection.

LayerContents
manifest.jsonEvery file with name, size, date, and collection ID.
UTF-8 JSONLOne record per line for text and annotations.
DocumentsData card, field schema, and a PDF spec for each collection.
Packaged tasksdocker/ (OCI layout) and json/ (task, patches, grading script).
Request access

Request the code catalog.

Tell us the language mix, task count, and evaluation setup. We reply within one business day. Sample packs, data cards, and field schemas are shared after your request is reviewed.

Access is activated after scope confirmation.

FAQ

Before you request a collection.

Does a package run without network access?

Each package ships an OCI image with its runtime settings. Network and resource requirements are confirmed per collection.

Can we add our own tests?

Yes. The test patch is separate, so additional checks can be layered on.

How is an attempt scored?

grade.sh runs the tests and returns the score used for pass or fail.