Learn how to configure Cribl LogStream to forward logs to Axiom using both HTTP and Syslog destinations.
Cribl is a data processing framework often used with machine data. It allows you to parse, reduce, transform, and route data to and from various systems in your infrastructure.
You can send logs from Cribl LogStream to Axiom using HTTP or Syslog destination.
Below are the steps to set up and send logs from Cribl to Axiom using the HTTP destination:
Open Cribl’s UI and navigate to Destinations > HTTP. Click on +
Add New to create a new destination.
Cribl LogStream
Name: Choose a name for the destination.
Endpoint URL: The URL of your Axiom log ingest endpoint https://AXIOM_DOMAIN/v1/datasets/DATASET_NAME/ingest
.
Replace AXIOM_DOMAIN
with api.axiom.co
if your organization uses the US region, and with api.eu.axiom.co
if your organization uses the EU region. For more information, see Regions.
Replace DATASET_NAME
with the name of the Axiom dataset where you want to send data.
Method: Choose POST
.
Event Breaker: Set this to One Event Per Request or CRLF (Carriage Return Line Feed), depending on how you want to separate events.
Cribl LogStream destination
You may need to add some headers. Here is a common example:
Content-Type: Set this to application/json
.
Authorization: Set this to Bearer API_TOKEN
.
Replace API_TOKEN
with the Axiom API token you have generated. For added security, store the API token in an environment variable.
Cribl LogStream destination headers
In the Body Template, input {{_raw}}
. This forwards the raw log event to Axiom.
After you’ve finished configuring the destination, save your changes and make sure the destination is enabled.
Open Cribl’s UI and navigate to Destinations > Syslog. Click on +
Add New to create a new destination.
Name: Choose a name and output ID for the destination.
Protocol: Choose the protocol for the Syslog messages. Select the TCP protocol.
Destination Address: Input the address of the Axiom endpoint to which you want to send logs. This address is generated from your Syslog endpoint in Axiom and follows this format: tcp+tls://qsfgsfhjsfkbx9.syslog.axiom.co:6514
.
Destination Port: Enter the port number on which the Axiom endpoint is listening for Syslog messages which is 6514
Format: Choose the Syslog message format. RFC3164
is a common format and is generally recommended.
Facility: Choose the facility code to use in the Syslog messages. The facility code represents the type of process that’s generating the Syslog messages.
Severity: Choose the severity level to use in the Syslog messages. The severity level represents the importance of the Syslog messages.
Cribl LogStream destination configuration
Timestamp Format: Choose the timestamp format to use in the Syslog messages.
Application Name Field: Enter the name of the field to use as the app name in the Syslog messages.
Message Field: Enter the name of the field to use as the message in the Syslog messages. Typically, this would be _raw
.
Throttling: Enter the throttling value. Throttling is a mechanism to control the data flow rate from the source (Cribl) to the destination (in this case, an Axiom Syslog Endpoint).
Configure the Syslog message
After you’ve finished configuring the destination, save your changes and make sure the destination is enabled.