Log ingestion warnings

If your ingested logs don’t look as expected, you can check if a particular log record contains warnings regarding issues that occurred for that log in the log ingest and processing pipeline. Look for a dt.ingest.warnings attribute in Notebooks. It lists warnings about issues that affected a particular log record.

Examples of possible warnings:

Warning

Description

content_trimmed

The content was trimmed after being received bythe API because it exceeded the event content maximum byte size limit.

content_trimmed_pipe

The content was trimmed after processing rules were applied because it exceeded the event content maximum byte size limit.

attr_count_trimmed

The number of attributes was trimmed after being received by the API because it exceeded the maximum number of attributes in a single event.

attr_count_trimmed_pipe

The number of attributes was trimmed after processing rules were applied because it exceeded the maximum number of attributes in a single event.

attr_val_count_trimmed

At least one multi-value attribute had the number of values trimmed, after being received by the API, because it exceeded the maximum number of attributes in a single event.

attr_val_count_trimmed_pipe

After applying processing rules, at least one multi-value attribute had its value number trimmed because it exceeded the maximum number of attributes.

attr_val_size_trimmed

At least one attribute value size was trimmed after being received by the API because it exceeded the value maximum byte size limit.

attr_val_size_trimmed_pipe

At least one attribute value size was trimmed after processing rules were applied because it exceeded the value maximum byte size limit.

timestamp_corrected

The timestamp was too far in the future and was corrected to the current time.

common_attr_corrected

At least one of the following attributes was corrected: status, loglevel, or event.type.

processing_batch_timeout

Batch timeout occurred while executing log processing rules.

processing_transformer_timeout

Execution timeout occurred in one of the processing transformers while executing log processing rules.

processing_transformer_error

Execution error occurred in one of the processing transformers while executing log processing rules.

processing_transformer_throttled

Execution throttled in one of the processing transformers while executing log processing rules.

processing_output_record_conversion_error

Output conversion error occurred for some records while executing log processing rules.

processing_prepare_input_error

“Prepare input error” occurred in one of the enabled log processing rules.