Datadog, the cloud monitoring, and security platform, announced the release of Datadog Observability Pipelines, a new product that allows organizations to gain greater control of their data and reliably scale their observability practices. Vector, an open-source and high-performance framework for building telemetry pipelines, powers Datadog Observability Pipelines.

Andreas Kasprzok, Observability Tech Lead at Blockfi said, “We want to empower our teams to use all of our systems and tools while staying within budget. Observability Pipelines give us flexibility over how our data is processed and where it ends up, so our teams are taking action on the right information as we continue to scale.

Datadog Observability Pipelines assist IT and security teams in meeting their goals of managing and scaling observability while maintaining complete flexibility and control over how logs, metrics, and traces are collected, transformed, and routed. These benefits organizations by:

Cost-cutting measures: Aggregate, filter, and route all observability data by use case without sacrificing visibility.

Reduce lock-in by orchestrating and monitoring data processing from any source to any destination in a single unified view.

Protect Sensitive Data: To better meet compliance requirements, filter, redact, and monitor sensitive data before it leaves your network.

Enforce Data Quality: To improve observability across teams, standardize the format of logs, metrics, and traces.

Scale with Confidence: Scale with confidence with a product powered by Vector, a vendor-agnostic, open-source project and engaged community with millions of monthly downloads that is deployed in production by enterprises processing petabytes of data each month.

Data Collection and Routing Made Simple: Observability Pipelines include over 80 out-of-the-box integrations, allowing organizations to collect and route data to any of the tools their teams already use without disrupting existing workflows.

“As the amount of telemetry continues to grow at an organization, teams are often completely overwhelmed—if they’re not blind to—the runaway costs, reliability, and compliance risks that come from a lack of visibility into infrastructure and application data,” said Zach Sherman, Senior Product Manager at Datadog. “We built Datadog Observability Pipelines to give organizations a powerful way to take back control of their data, without compromising visibility for engineering, security, and SRE teams.”