graph LR
Input_Buffer_Queue["Input Buffer/Queue"]
I_O_Factory_Registry["I/O Factory Registry"]
I_O_Factory_Registry -- "provides components interacting with" --> Input_Buffer_Queue
Input_Buffer_Queue -- "is utilized by components from" --> I_O_Factory_Registry
This subsystem is responsible for the efficient transfer and buffering of data between connected nodes within the ETL graph, acting as the internal plumbing for smooth data movement and providing a registry for I/O factories.
Acts as the core data conduit between processing nodes. It manages the flow of data by providing mechanisms for inserting data (put), retrieving data (get), and handling graceful termination (shutdown). It is also responsible for flow control and maintaining the buffer's state, ensuring smooth and controlled data movement within the ETL pipeline. This component is fundamental for managing the transient state of data as it moves between discrete processing steps.
Related Classes/Methods:
bonobo.structs.inputs.Input:46-118bonobo.structs.inputs.Input.putbonobo.structs.inputs.Input.getbonobo.structs.inputs.Input.shutdownbonobo.structs.inputs.Input._decrement_runlevelbonobo.structs.inputs.Input.alive
Serves as a central hub for managing and providing access to factories that create data readers and writers. It enables the dynamic retrieval and instantiation of specific I/O components, promoting modularity and extensibility for connecting to various data sources and destinations within the ETL framework. This component is crucial for abstracting data source/sink specifics and allowing the data flow to be configured with different I/O mechanisms.
Related Classes/Methods: