Lessons from Industrial Manufacturing
Failure Mode and Effects Analysis (FMEA), is a technique to identify and address potential points of failure within a process and their resulting effects on a system, prior to failures occurring. It is an industry-standard technique in manufacturing and product design. FMEA is based on a framework first developed in the United States Military. The technique gained wide usage at NASA beginning in the early 1960s, then became a common practice in manufacturing. This talk focuses on applying Process Failure Mode and Effects Analysis (PFMEA) to data pipelines to improve pipeline reliability. As businesses continue to ingest and utilize more and more data, the reliability of their data pipelines becomes paramount for success. Delays and errors in gathering, transforming, and accessing data have ripple effects across business processes and expose customers and end-users to a variety of consequences. Applying PFMEA to data pipelines is a unique application of the tool which allows companies from various disparate industries to leverage proven techniques for reliability improvement. This talk will review PFMEA methodology, then provide an example of how to apply it to a simple data pipeline. Finally, we will touch on the challenges and benefits of utilizing the technique.
Presenter: Elizabeth Martens, Two Sigma