Ingestion Overview
Prerequisites
It is recommended to review the Sift Data Model before proceeding with this section.
Sift provides multiple mechanisms for data ingestion. All methods require:
- An API token
- The appropriate Sift URL for your environment
Refer to the Authentication Section for instructions on retrieving your API token and URL.
Ingestion Mechanisms:
- Ingestion-config-based Streaming: Define the schema of your data and stream compact structured messages to Sift over gRPC.
- Protobuf Ingestion: Stream arbitrary protocol buffers to Sift over gRPC.
- Schemaless Ingestion: Send JSON to Sift over REST without pre-registering an ingestion config.
- Data import: Import data from files or URLs and upload them directly to Sift.
- Influx Line Protocol: Stream data to Sift using any Influx client.
Note: Current Sift client libraries utilize ingestion-config based streaming. For detailed documentation on each mechanism, refer to the respective links provided.