devops

MEZMO TELEMETRY PIPELINE

Mezmo helps you take control of your telemetry data. We use an Understand, Optimize, and Respond workflow. We profile event patterns, suggest pre-configured Recipes to dramatically cut costs, and offer Responsive Pipelines to accelerate incident response times.

Control Data

Control data volume and costs by identifying unstructured telemetry data, removing low-value and repetitive data, and using sampling to reduce chatter. Employ intelligent routing rules to send certain data types to low-cost storage.

• Filter: Use the Filter Processor to drop events that may not be meaningful or to reduce the total amount of data forwarded to a subsequent processor or destination.
• Reduce: Take multiple log input events and combine them into a single event based on specified criteria. Use Reduce to combine many events into one over a specified window of time.
• Sample: Send only the events required to understand the data.
• Dedupe: Reduce “chatter” in logs. The overlap of data across fields is the key to having the Dedup Processor work effectively. This processor will emit the first matching record of the set of records that are being compared.
• Route: Intelligently route data to any observability, analytics, or visualization platform.

Transform Data

Increase your data value and optimize data flows by transforming and enriching data. Modify data as needed for compatibility with various end destinations. Enrich and augment data for better context. Scrub sensitive data, or encrypt it to maintain compliance standards.

• Event to Metric: Create a new metric within the pipeline from existing events and log messages.
• Parse: Various parsing options available to create multiple operations such as convert string to integers or parse timestamps.
• Aggregate metrics: Metric data can have more data points than needed to understand the behavior of a system. Remove excess metrics to reduce storage without sacrificing value.
• Encrypt: Use the Encrypt Processor when sending sensitive log data to storage, for example, when retaining log data containing account names and passwords.

Deliver Insights

With Mezmo you can extract insights before the data reaches high-cost destinations. You can monitor the health of your data pipeline and run various tests before you deploy your solution.

• Use simulation to test your pipelines before you deploy
• Monitor the health of pipelines with OOB dashboards.
• Derive metric data from Logs by parsing the log data to extract specific information.
• Count specific events within the log data and use that count to create a metric.