When data fails to ingest into Sift, the error is logged in the Dead Letter Queue (DLQ) and surfaced in the Data Processing page of the Manage workspace. From here you can review DLQ entries, download the data along with the reasons why it failed, resolve the issue, and reingest the data.Documentation Index
Fetch the complete documentation index at: https://docs.siftstack.com/llms.txt
Use this file to discover all available pages before exploring further.
Before you begin
- You are familiar with how Sift organizes data into Assets, Channels, and Runs.
How Data Processing works
Data processing errors are logged in the Dead Letter Queue (DLQ) when ingestion fails due to invalid values or parameters. These errors can be reviewed by navigating to the Manage section and selecting Data Processing in the Sift interface. The following table describes the most common error types: The following table describes how long error data is retained in Sift:Review and download DLQ data
- Click your profile icon.
- Select Manage.
- In the Manage navigation menu, click Data Processing.
- In the Data Processing table, locate the error record you want to investigate.
- Click Export to download the data and the reasons why it was sent to the DLQ.
- Review the downloaded data to understand the issue.
- Resolve the issue independently or work with Sift to resolve it, then reingest the data.
Next steps
- To monitor DLQ metrics as time-series data, see Monitor ingestion health.