How to export data?
Learn how to download and export your scraped data from CoreClaw.
Download via Console
Section titled “Download via Console”Step 1: Access Run Results
Section titled “Step 1: Access Run Results”- Go to Runs in the console
- Click on the Run ID
- Wait for status to show “SUCCEEDED”
Step 2: View Results
Section titled “Step 2: View Results”On the run details page, you can see:
- Execution status
- Number of items scraped
- Execution duration
- Log records
Step 3: Select Export Format
Section titled “Step 3: Select Export Format”Choose your preferred format:
| Format | Extension | Best For |
|---|---|---|
| JSON | .json | Developers, API integration |
| CSV | .csv | Spreadsheets, analysis |
Step 4: Download
Section titled “Step 4: Download”Click the format button to download your data.
Export via API
Section titled “Export via API”For automated data retrieval, use the API:
Get Run Results
Section titled “Get Run Results”GET /api/v2/worker-runs/{runId}/result?offset=0&limit=20Export Run Result
Section titled “Export Run Result”GET /api/v2/worker-runs/{runId}/result/export?format=csv&filter_keys=title%2Cprice%2CurlSupported formats: csv, json
Use the runId returned as data.run_slug when you start or rerun a Worker. See Export API for full documentation.
Data Size Considerations
Section titled “Data Size Considerations”| Size | Recommended Method |
|---|---|
| < 10MB | Console download |
| 10MB - 100MB | API streaming |
| > 100MB | Contact support |
Troubleshooting
Section titled “Troubleshooting”Why is the download button disabled?
Section titled “Why is the download button disabled?”Possible reasons:
- Run has not completed yet
- No data was scraped
- Insufficient account balance
- Limited permissions
Solution: Refresh the page or check run status.
What if data is empty?
Section titled “What if data is empty?”Check the following:
- Input parameters are correct
- Target website is accessible
- Anti-scraping measures are not blocking
Review the logs for detailed error messages.
Best Practices
Section titled “Best Practices”Related Topics
Section titled “Related Topics”- Input and Output - Understand data structure
- API Reference - Export API documentation