engineering.linkedin.com

An inside look at LinkedIn’s data pipeline monitoring system

Monitoring big data pipelines often equates to waiting for a long-running batch job to complete and observing the status of the execution. The status can result in “Failed” or “Successful” or even “Incomplete.”