graph LR
SessionManager["SessionManager"]
APIFunctions["APIFunctions"]
CodeGenerator["CodeGenerator"]
RemoteExecutionManager["RemoteExecutionManager"]
SessionManager -- "dispatches requests to" --> APIFunctions
APIFunctions -- "requests code from" --> CodeGenerator
APIFunctions -- "initiates remote execution via" --> RemoteExecutionManager
CodeGenerator -- "provides generated code to" --> APIFunctions
RemoteExecutionManager -- "receives execution requests from" --> APIFunctions
The Remote Execution & Server subsystem encompasses the server-side components responsible for handling client requests, orchestrating Optimus operations, dynamically generating code, and managing remote execution.
Acts as the primary entry point for client requests, managing the lifecycle of user sessions and orchestrating the initial dispatch of requests to the appropriate functional components. This component is crucial for establishing and maintaining the server's connection with external applications.
Related Classes/Methods:
Exposes the core Optimus functionalities as server-side operations. It acts as an orchestrator, translating incoming requests into specific Optimus operations, leveraging code generation for dynamic execution, and initiating remote execution when necessary.
Related Classes/Methods:
Dynamically generates Python code snippets for various Optimus operations, including dataframe transformations, masking, clustering, engine-specific operations, and connection management. This enables flexible and on-the-fly execution of complex data processing logic.
Related Classes/Methods:
Facilitates the execution of Optimus operations on a remote instance. It manages the lifecycle of variables and the submission of tasks to the remote environment, abstracting the complexities of distributed execution.
Related Classes/Methods: