Skip to main content

piveau-consus latest Latest release

Published on: 06/08/2024

Consus is an extract, transform and load (ETL) like framework.

When you need to fetch data or metadata from a source, Consus provides you a high performant and high scalable solution based on microservices and container technology.

Concept

The basic concept of Consus is that of a Pipe.

Technically speaking, a pipe is the orchestration of several modules, each module represents a step of processing data. An example Pipe is that of a harvester where data processing modules orchestrate to a chain, usually an importer, a transformer, and an exporter.

Documentation