Can I change the number of trials?
Yes, in 39 of the 54 tests. Their settings include the number of trials, blocks, items or span lengths, each within a set range. Pick a test in the settings explorer on this page to see its ranges.
Test settings and custom tests
Adjust our tests or have one built for your study
Change trial counts, timing and test parts yourself, within the limits each test allows. If your study needs a test we do not have, or a version of one of ours, we build it for you.
Change the settings yourself
Trial counts, timing and test parts, within each test's limits, on yearly plans. Preview the exact test before participants see it.
Have a test built for your study
Tell us what you study and what participants should do. We reply with an estimate of the cost and the time to build it.
Have a test built for your study
If your study needs a test we do not have, or a version of one of ours, we build it for you. Most custom tests are quick and low-cost, because they run on the engine behind our 54 tests: timing, scoring, data export and quality checks already work.
Step 1
Tell us what you study
Describe what participants should see and do, and what you need to measure. Name the paper if you are replicating one.
Step 2
Get an estimate
We reply by email with an estimate of the cost and the time to build it.
Step 3
Preview and refine
When you approve the estimate, we build the test. You try it as a participant and ask for changes.
Step 4
Run it in your studies
It runs like any other test, in the same study flow and the same data export.
For example
Your categories and word lists in the Implicit Association Test, for the attitudes your field studies.
Your own pictures in a memory test
Faces, objects or scenes from your lab in place of the standard images.
A task from a paper you want to replicate
A published paradigm we do not offer yet, built to the paper's timing and scoring.
See what you can change in each test
Pick a test to see its settings, the standard value and the allowed range. Try a value to see how the session would be labeled.
47 tests with settings
Task Switching Test
Standard configurationPercentiles against a published norm, on paid plans and pay-as-you-go studies.
| Setting | Standard | Allowed range |
|---|---|---|
| Practice trials | 16 | 8 to 40 |
| Single-task trials | 32 | 16 to 120 |
| Mixed-task trials | 72 | 32 to 200 |
| Switch probability | 0.5 | 0.25 to 0.75 |
Try a value
Standard value: 16
Standard value: 32
Standard value: 72
Standard value: 0.5
The values you try here are not carried over. Set them in the study builder on a paid plan.
7 tests have no settings and always run as designed: Trail Making Test A, Trail Making Test B, Paired Associate Learning, Dot-Probe Task, Emotional Stroop Task, Implicit Association Test (IAT) and Operation Span.
What changes when you change a setting
The test is scored the same way.
The session is marked modified, and no percentile is shown for it.
The settings each session ran with are saved and appear in the score and trial exports.
You can preview the exact test with your settings before you launch.
The settings columns in your exports
| Column | What it holds |
|---|---|
| test_version | The version of the test the session ran. |
| config_version | The test version its settings were checked against. |
| scoring_version | The scoring version used for the session. |
| customization_status | standard, or scored_modified when any setting was changed. |
| configuration_normative_eligible | true when the session could show a percentile. |
| configuration_json | Every setting the session ran with, as JSON. |
Every column and file: research data export. How percentiles work: test norms.
Length, timing, rates and parts
94 settings across 47 tests, grouped by what they change.
| Kind | What it changes | Settings | Tests | Example |
|---|---|---|---|---|
| Length | Trials, blocks, items and spans | 54 | 39 | Navon Global-Local Task: Trials per block, 24 to 96 |
| Timing | Display times, delays, response windows, time limits and lapse thresholds | 23 | 18 | Stop-Signal Task: Initial stop-signal delay (ms), 100 to 600 |
| Rates | How often targets or switches come up | 5 | 5 | Task Switching Test: Switch probability, 0.25 to 0.75 |
| Parts | Parts of a test to include or leave out | 7 | 6 | Digit Span Test: Include backward span, on or off |
| Choices | A version of the test | 5 | 3 | Semantic Priming Task: Prime-to-target interval, 200 ms (standard) or 1,200 ms |
Design the order participants follow
Group tests into sections, randomize or counterbalance their order, assign participants to study groups, and add instruction screens and breaks.
Text version of the diagram
- Consent: Participant agrees to take part.
- Balanced assignment to Group A, Group B.
- Group A: Practice (1 test, fixed order); Attention (3 tests, Latin square); Speed (1 test, fixed order).
- Group B: Practice (1 test, fixed order); Attention (3 tests, Latin square); Memory and speed (2 tests, random order).
- Group A: Attention, Speed rotate across participants in a Latin square with 2 orders.
- Group B: Attention, Memory and speed rotate across participants in a Latin square with 2 orders.
- End: completion page.
Set what participants see
Write your own consent text, choose English or Italian for participant pages, use larger text for older adults, and choose whether to ask demographic questions.
Italian participant pages and setting changes come with paid plans.
Connect your recruitment service
Use presets for Prolific, Sona Systems, CloudResearch Connect and Qualtrics, save up to 10 extra link parameters with each participant, and send people back with a completion code. Recruitment setup guides
Start from a template, or save your own
- Reaction Time Study
- Pilot Screening Battery
- Executive Control Battery
- Working Memory and Learning Battery
- Language-Minimized Screening Battery
- Older Adult Executive Speed Battery
Save your own protocol as a template on paid plans. The tests in each template
What stays fixed
Each test's stimuli, instructions, keys, scoring and device rules are fixed for its version, so results stay comparable across studies and over time.
Need different stimuli, instructions or a new task? We build custom versions.
Questions about settings and custom tests
Can I change stimulus timing?
In 18 tests: Psychomotor Vigilance Task, Rapid Visual Information Processing, Continuous Performance Test, Stop-Signal Task, Recognition Memory Test, Delayed Recall Module, Visual Search Test, Affective Go/No-Go, Spatial Working Memory, Intra/Extra Dimensional Set Shift, Symbol Coding, Delayed Match-to-Sample, One-Touch Tower Planning, Short Story Recall, Verbal Learning, Verbal Fluency, Category Fluency and Clock Drawing Task. Their settings include display times, delays, response windows or time limits. The other tests keep their standard timing.
Can I use my own words, pictures or categories?
Not by yourself yet: each test's stimuli are fixed for its version. We can build a version with your words, pictures or categories. Tell us what you need, and we reply with an estimate of the cost and the time.
How much does a custom test cost, and how long does it take?
It depends on what the test needs. Most custom tests run on the engine behind our 54 tests, so they are quick and low-cost to build. Tell us what you need, and we reply with an estimate of the cost and the time before any work starts.
Do changed settings affect percentiles?
Yes. A session with any changed setting is scored as usual and marked modified, and it shows no percentile, because published norms apply to the standard settings. A session with standard settings shows a percentile when the test has a published norm, on paid plans and pay-as-you-go studies.
Can I change the test language?
Participant pages are in English on every plan, and in Italian on paid plans. 45 of the 54 tests also have their own instructions and screens in Italian; each test's page lists its languages.
Can I randomize the order of tests?
Yes, on every plan. Put tests in sections, and give each section one order rule: Fixed order, Random order or Latin square. Whole sections can be counterbalanced too.
Which plans can change settings?
Every yearly plan: Academic Research, Academic Department, Academic Institution, Commercial Research, Commercial Team and Enterprise / CRO. Studies on the free plan, including pay-as-you-go studies, run the standard settings.
Will my settings appear in the data?
Yes. Every session saves the settings it ran with, and the score and trial exports add 6 columns for them: test_version, config_version, scoring_version, customization_status, configuration_normative_eligible and configuration_json.
Plans and prices: pricing.
Fit the tests to your study
Preview every test free, change settings on a paid plan, or have a test built for your study.