Sink

Learn to build custom sink connectors for OpenMetadata using Python SDK. Step-by-step guide with code examples to integrate and stream metadata efficiently.

Sink

The Sink will get the event emitted by the source, one at a time. It can use this record to make external service calls to store or index etc.For OpenMetadata we have MetadataRestTablesSink.

API

class Sink(ReturnStep, ABC):
    """All Sinks must inherit this base class."""

    # From the parent - Just to showcase
    @abstractmethod
    def _run(self, record: Entity) -> Either:
        """
        Main entrypoint to execute the step
        """

_run this method is called for each record coming down in the workflow chain and can be used to store the record in external services etc.

Example

Example implementation