Data Integrity: The Last Mile Problem of Data Observability

Data Integrity

Data quality issues have been a long-standing challenge for data-driven organizations. Even with significant investments, the trustworthiness of data in most organizations is questionable at best. Gartner reports that companies lose an average of $14 million per year due to poor data quality.  Data observability has been all the rage in data management circles for a…

Read More

Autonomous Cloud Data Pipeline Control: Tools and Metrics

data pipeline monitoring tools and metrics

Errors that get seeded in the data as it flows through the data pipeline, propagate throughout the organization and are responsible for 80% of all errors impacting the business users. High-quality data is essential to the success of any business or organization. It’s important to monitor your data pipeline to guard against missing, incorrect, old/not-fresh,…

Read More

Why the Fortune 500 is Dumping Hadoop

A blue wall of glowing hexagons

Saw this very informative article on the ongoing demise of Hadoop. Our customers are experiencing the same conditions the author Nicole Hemsoth is referencing. Here is a summary of the longer article. Summary Why did it grow initially? 2010-2015: Hadoop was touted for its incredible analytics performance and cost savings compared to the then dominant…

Read More