Recommendation: Break data into discrete batches instead of streaming continuously. If a failure occurs, only the latest batch needs to be retried, which improves reliability and reduces the impact of errors on overall data flow.
Bytes value size limit
A singlebytes (binary) Channel value is limited to 2 MB (2,097,152 bytes). Sift rejects any larger value during ingestion with an error such as bytes value is too large: received <N> bytes, limit is 2097152. This limit applies to each individual data point and is independent of the overall ingestion message size.
For binary payloads larger than 2 MB, store the data as a file attachment rather than streaming it as a bytes Channel value.