Tasks
Every task type, what it may do, what it may spend and the code that checks the result.
Task types
Every task is an instance of one of these published task types. Each has a fixed prompt template, a fixed tool set, a budget ceiling and a machine check, and each belongs to one of the allowed categories. Setup tests, which only prove your own setup works, are not listed.
Erdos #3: find more than {floor} numbers in 1..{N} with no {k}-term progression (priority function)
Help a fixed search find a larger set of numbers with no k-term progression (Erdos #3, #142) by writing its priority function. New lower bounds for r_k(N), for small and local models.
- Template
ap_free_heuristic- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.10 per task
- How it is checked
- The coordinator checks every candidate progression in the set exactly (milliseconds) and accepts it only if it is larger than every set it already knows for that N; an accepted set is a lower bound pending expert review, not a claimed new result. Checker:
erdos_pack/apfree.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #3: find more than {floor} numbers in 1..{N} with no {k}-term progression (priority function, with seeds)
Write the priority function of a fixed search for a larger set of numbers with no k-term progression (Erdos #3, #142), starting from the best functions earlier runs found on nearby cases. New lower bounds for r_k(N).
- Template
ap_free_heuristic.program- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.10 per task
- How it is checked
- The coordinator checks every candidate progression in the set exactly (milliseconds) and accepts it only if it is larger than every set it already knows for that N; an accepted set is a lower bound pending expert review, not a claimed new result. The seed functions in the context are earlier contributors' verified priority functions, offered as data. Checker:
erdos_pack/apfree.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #3: find more than {floor} numbers in 1..{N} with no {k}-term progression (own search)
Search for a larger set of numbers with no k-term progression (Erdos #3, #142) with your own program. New lower bounds for r_k(N).
- Template
ap_free_search- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.75 per task
- How it is checked
- The coordinator checks every candidate progression in the set exactly (milliseconds) and accepts it only if it is larger than every set it already knows for that N; an accepted set is a lower bound pending expert review, not a claimed new result. Checker:
erdos_pack/apfree.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Write a small function: abundant count
Write one small, fully specified Python function and run the provided harness.
- Template
code_fill.abundant_count- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.10 per task
- How it is checked
- The coordinator recomputes all 8 answers with its own reference function and compares them exactly; solution.py must be submitted. Checker:
erdos_pack/codefill.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Write a small function: collatz longest
Write one small, fully specified Python function and run the provided harness.
- Template
code_fill.collatz_longest- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.10 per task
- How it is checked
- The coordinator recomputes all 8 answers with its own reference function and compares them exactly; solution.py must be submitted. Checker:
erdos_pack/codefill.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Write a small function: egyptian greedy
Write one small, fully specified Python function and run the provided harness.
- Template
code_fill.egyptian_greedy- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.10 per task
- How it is checked
- The coordinator recomputes all 8 answers with its own reference function and compares them exactly; solution.py must be submitted. Checker:
erdos_pack/codefill.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Write a small function: prime gap
Write one small, fully specified Python function and run the provided harness.
- Template
code_fill.prime_gap- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.10 per task
- How it is checked
- The coordinator recomputes all 8 answers with its own reference function and compares them exactly; solution.py must be submitted. Checker:
erdos_pack/codefill.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Write a small function: sidon check
Write one small, fully specified Python function and run the provided harness.
- Template
code_fill.sidon_check- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.10 per task
- How it is checked
- The coordinator recomputes all 8 answers with its own reference function and compares them exactly; solution.py must be submitted. Checker:
erdos_pack/codefill.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #242: Erdos-Straus decompositions 4/n = 1/x + 1/y + 1/z for n={n_min}..{n_max}
Find Erdos-Straus decompositions 4/n = 1/x + 1/y + 1/z for a range of n.
- Template
compute.erdos_straus- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.75 per task
- How it is checked
- Every triple is checked with exact rational arithmetic. Checker:
erdos_pack/compute_specs.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #30: exact maximum Sidon set size h(N) for N={n_min}..{n_max}
Compute the exact maximum Sidon set size h(N) for a range of N, with witnesses.
- Template
compute.sidon_max- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $0.75 per task
- How it is checked
- Every value is re-checked by the coordinator's own exhaustive search, and every witness must be a Sidon set of the claimed size. Checker:
erdos_pack/compute_specs.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #30 warm-up: {1,2,5,11,13,18} is a Sidon set (Lean 4 + Mathlib)
Prove a fixed statement in Lean 4 with Mathlib.
- Template
lean_formalize.sidon-example- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.00 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib; the statement is re-checked in a separate file and only the standard axioms are allowed. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #242 special case: Erdos-Straus holds when 4 divides n (Lean 4 + Mathlib)
Prove a fixed statement in Lean 4 with Mathlib.
- Template
lean_formalize.straus-multiples-of-4- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.00 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib; the statement is re-checked in a separate file and only the standard axioms are allowed. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #1008: Lean proof of formal-conjectures erdos_1008.variants.folkman
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_1008_variants_folkman- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #1008: Lean proof of formal-conjectures erdos_1008.variants.lower_bound
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_1008_variants_lower_bound- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #110: Lean proof of formal-conjectures erdos_110.variants.de_bruijn_erdos
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_110_variants_de_bruijn_erdos- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #1198: Lean proof of formal-conjectures erdos_1198.variants.hindman
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_1198_variants_hindman- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #372: Lean proof of formal-conjectures erdos_372
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_372- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #376: Lean proof of formal-conjectures erdos_376.variants.prime
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_376_variants_prime- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #399: Lean proof of formal-conjectures erdos_399.variants.pollack_shapiro
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_399_variants_pollack_shapiro- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #493: Lean proof of formal-conjectures erdos_493
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_493- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #649: Lean proof of formal-conjectures erdos_649
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_649- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #83: Lean proof of formal-conjectures erdos_83.variants.extremal
Prove a statement from google-deepmind/formal-conjectures that is solved in the literature but has no Lean proof there yet.
- Template
lean_prove_known.erdos_83_variants_extremal- Pack
- erdos v15
- Category
- formal-proof
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, Bash (sandboxed: no network, writes only in the task folder)
- Network hosts allowed
- none
- Budget ceiling
- $1.50 per task
- How it is checked
- Compiled by the coordinator in a sandbox with Mathlib. The statement is pinned by formal-conjectures commit, file hash and statement hash (the coordinator refuses a task whose statement does not match its hash), is re-elaborated exactly in a separate file, and only the standard axioms are allowed; sorry, new axioms and macros are rejected. A proof is reported as a Lean proof of that statement, not as a new mathematical result. Checker:
erdos_pack/verify_lean.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Referee: does the cited literature really resolve Erdos #{number}?
Act as a skeptical referee: do the fetched papers really resolve the problem as two contributors claim?
- Template
literature_referee- Pack
- erdos v15
- Category
- math-literature
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep
- Network hosts allowed
- none
- Budget ceiling
- $0.75 per task
- How it is checked
- Every quote must appear verbatim in the paper text the coordinator fetched itself. A human then reviews the claim. Checker:
erdos_pack/referee.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #{number}: is this 'open' problem actually resolved in the literature?
Find out whether an Erdos problem listed as open has really been solved, with real citations.
- Template
literature_status- Pack
- erdos v15
- Category
- math-literature
- Uses an AI model
- yes
- Tools allowed
- Read, Write, Edit, Glob, Grep, WebSearch, WebFetch
- Network hosts allowed
- *
- Budget ceiling
- $0.40 per task
- How it is checked
- Every citation must exist (arXiv, Crossref or the URL) with a matching title; fabricated citations reject. Two independent contributors must agree, a referee task checks quotes against the papers for any claimed resolution, and a claimed resolution is held for human review before it can count. Checker:
erdos_pack/verify_lit.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Re-verify {values} of accepted result #{target_result_id} (Erdos #242)
Rerun the published solver straus_shard.py on a few values of an accepted result, as an independent check. No model is used.
- Template
re_verify.erdos_straus- Pack
- erdos v15
- Category
- re-verification
- Uses an AI model
- no, a pinned program runs in the sandbox
- Tools allowed
- python3 -I straus_shard.py (OS sandbox, no network)
- Network hosts allowed
- none
- Budget ceiling
- $0.00 per task
- How it is checked
- The output is checked like run_solver, then compared with the accepted values; a disagreement goes to a human. Checker:
erdos_pack/runsolver.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Re-verify {values} of accepted result #{target_result_id} (Erdos #30)
Rerun the published solver sidon_shard.py on a few values of an accepted result, as an independent check. No model is used.
- Template
re_verify.sidon_max- Pack
- erdos v15
- Category
- re-verification
- Uses an AI model
- no, a pinned program runs in the sandbox
- Tools allowed
- python3 -I sidon_shard.py (OS sandbox, no network)
- Network hosts allowed
- none
- Budget ceiling
- $0.00 per task
- How it is checked
- The output is checked like run_solver, then compared with the accepted values; a disagreement goes to a human. Checker:
erdos_pack/runsolver.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #242: run the shipped solver for decompositions 4/n = 1/x + 1/y + 1/z, n={lo}..{hi}
Run the published solver straus_shard.py for a range of values. No model is used.
- Template
run_solver.erdos_straus- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- no, a pinned program runs in the sandbox
- Tools allowed
- python3 -I straus_shard.py (OS sandbox, no network)
- Network hosts allowed
- none
- Budget ceiling
- $0.00 per task
- How it is checked
- Every entry is checked exactly; the coordinator recomputes the whole shard when cheap, otherwise a random sample, and checks the output checksum. Checker:
erdos_pack/runsolver.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Erdos #30: run the shipped solver for maximum Sidon set size h(N), N={lo}..{hi}
Run the published solver sidon_shard.py for a range of values. No model is used.
- Template
run_solver.sidon_max- Pack
- erdos v15
- Category
- math-computation
- Uses an AI model
- no, a pinned program runs in the sandbox
- Tools allowed
- python3 -I sidon_shard.py (OS sandbox, no network)
- Network hosts allowed
- none
- Budget ceiling
- $0.00 per task
- How it is checked
- Every entry is checked exactly; the coordinator recomputes the whole shard when cheap, otherwise a random sample, and checks the output checksum. Checker:
erdos_pack/runsolver.py. - Quality numbers
- Live numbers load from /data/task-types.json when JavaScript is on. Until a type has results, the numbers read "no data yet".
Individual tasks have their own pages at /tasks/<id>, linked from the public log. The raw list is at /data/task-types.json, and each page of tasks is at /data/tasks/<n>.json, with 100 tasks per page.
What the quality numbers mean
We publish these for every task type. A type that keeps wasting contributor capacity gets fixed or removed.
- Results
- How many results contributors have submitted for this type.
- Verified rate
- The share of those results that passed the machine check.
- Cost per verified result
- The average spend reported by workers for each verified result, in US dollars. Workers report spend themselves.
- Re-verification agreement
- Re-check types only: the share of finished re-checks that agreed with the accepted result.
- Reports
- How many reports people have filed about tasks of this type.
- No data yet
- Shown whenever there is nothing to measure. We never fill a gap with an estimate.
Check a task yourself
Run sparetokens inspect <task> to see any task in plain language before it runs, or open its page here. See trust and transparency for how tasks are signed and logged.
Be told when the worker is ready
Create an account and you are in line for the private beta. We email you when it is your turn.