  One of the most common modes of representing engineering schematics are
Piping and Instrumentation diagrams (P&IDs) that describe the layout of an
engineering process flow along with the interconnected process equipment. Over
the years, P&ID diagrams have been manually generated, scanned and stored as
image files. These files need to be digitized for purposes of inventory
management and updation, and easy reference to different components of the
schematics. There are several challenging vision problems associated with
digitizing real world P&ID diagrams. Real world P&IDs come in several different
resolutions, and often contain noisy textual information. Extraction of
instrumentation information from these diagrams involves accurate detection of
symbols that frequently have minute visual differences between them.
Identification of pipelines that may converge and diverge at different points
in the image is a further cause for concern. Due to these reasons, to the best
of our knowledge, no system has been proposed for end-to-end data extraction
from P&ID diagrams. However, with the advent of deep learning and the
spectacular successes it has achieved in vision, we hypothesized that it is now
possible to re-examine this problem armed with the latest deep learning models.
To that end, we present a novel pipeline for information extraction from P&ID
sheets via a combination of traditional vision techniques and state-of-the-art
deep learning models to identify and isolate pipeline codes, pipelines, inlets
and outlets, and for detecting symbols. This is followed by association of the
detected components with the appropriate pipeline. The extracted pipeline
information is used to populate a tree-like data-structure for capturing the
structure of the piping schematics. We evaluated proposed method on a real
world dataset of P&ID sheets obtained from an oil firm and have obtained
promising results.
