datawebotExtraction guide
Handle source limits and failed retrieval
Keep a blocked or incomplete result understandable.
01 / INPUTScoped URL + bounded request
02 / YOUR WORKFLOWInspect status → read outcome → adjust
03 / OUTPUTA recorded retrieval outcome
Keep the right fields.
Workflow field map| Field / step | Input | Rule |
|---|---|---|
| Budget | maxPages + maxCredits | Stop before exceeding either ceiling. |
| Recovery | Saved request and retry hints | Do not create duplicate requests blindly. |
| Failure | Page journal + warnings | Failed visits count; inspect before reauthorizing. |
Before you use the output
Use the supported source path and documented limits. The current product does not offer CAPTCHA solving, browser fingerprint controls or guaranteed access to blocked sources.
Check one record first.
Start with the smallest useful scope. Compare the returned record with its source, confirm variant identity and inspect missing fields before applying the mapping to a larger dataset.
Keep extraction warnings and the retrieval timestamp with downstream output. When a required field is missing, leave it unresolved or return to the source; do not fill it from an assumption.