Calls and runs at a time: how your plan's slots work
Your plan runs a number of operation calls at the same time, and as many batch scrapers: 1 on Free, 2 on Starter, 10 on Pro, 50 on Team. Nothing waits in a queue.
Your plan has a number of slots: 1 on Free, 2 on Starter, 10 on Pro, 50 on Team. It sets how many operation calls run at the same time, and, separately, how many scrapers your batches run at the same time. A call or a batch at rest uses none.
When every slot is busy, a new call or a new run is refused at once and nothing is queued: you decide what runs.
Operations: calls at a time
Each call to an operation takes one slot from the moment it starts until its answer comes back, a few seconds later. On Pro, 10 calls can be in progress at once; an eleventh is refused right away, without charge. Retry it when one of the 10 has answered.
From code, the refusal is a 429 with concurrency_limit and a retry_after in seconds: see Limits.
Batches: scrapers at a time
A batch's run takes the batch's slots setting (how many scrapers work on it in parallel) from the moment it starts until its scrapers finish. Once done, paused or exporting, its slots are free again.
On Pro (10 slots), with 3 runs in progress:
| Run in progress | Slots |
|---|---|
| Batch A | 1 |
| Batch B | 4 |
| Batch C | 1 |
| In use | 6 of 10 |
Batches D, E and F, created but not running, use nothing.
To change a batch's slots: open the batch's settings, open Advanced settings at the bottom of the Settings section, set Slots, then click Save. More slots make its runs faster, and take more of your plan's slots while it runs.
Three caps on a batch's slots
- Your plan's slots: a batch can't use more than your plan has.
- The scraper's own cap: each scraper runs a number of slots at most, 20 unless it says fewer.
- Your connected accounts: a batch that needs an account (Sales Navigator, Leboncoin, X, Facebook) uses one account per scraper. With 5 accounts picked for the batch, 5 scrapers work and the other slots wait. Pick more accounts in its settings, or connect more to go further.
How many batches you can create
Up to 100 per slot: 100 on Free, 200 on Starter, 1,000 on Pro, 5,000 on Team.
When every slot is busy
Launching a batch while your runs use every slot is refused. Wait for a run to finish, stop one (its results so far are kept), or upgrade.
A schedule follows the same rule. If it fires while every slot is in use, that run stops with slots_limit_exceeded. Spread your schedules so they don't overlap.
More slots
Above Team, custom plans have more slots: talk to us.