Skip to content

Latest commit

 

History

History
116 lines (65 loc) · 5.45 KB

File metadata and controls

116 lines (65 loc) · 5.45 KB
graph LR
    streamparse_cli_sparse["streamparse.cli.sparse"]
    streamparse_cli_submit["streamparse.cli.submit"]
    streamparse_cli_kill["streamparse.cli.kill"]
    streamparse_cli_list["streamparse.cli.list"]
    streamparse_cli_stats["streamparse.cli.stats"]
    streamparse_cli_visualize["streamparse.cli.visualize"]
    streamparse_bootstrap["streamparse.bootstrap"]
    streamparse_cli_common["streamparse.cli.common"]
    streamparse_util["streamparse.util"]
    streamparse_cli_sparse -- "orchestrates" --> streamparse_cli_submit
    streamparse_cli_sparse -- "orchestrates" --> streamparse_cli_kill
    streamparse_cli_sparse -- "orchestrates" --> streamparse_cli_list
    streamparse_cli_sparse -- "orchestrates" --> streamparse_cli_stats
    streamparse_cli_sparse -- "orchestrates" --> streamparse_cli_visualize
    streamparse_cli_sparse -- "orchestrates" --> streamparse_bootstrap
    streamparse_cli_submit -- "depends on" --> streamparse_cli_common
    streamparse_cli_kill -- "depends on" --> streamparse_cli_common
    streamparse_cli_list -- "depends on" --> streamparse_cli_common
    streamparse_cli_stats -- "depends on" --> streamparse_cli_common
    streamparse_cli_visualize -- "depends on" --> streamparse_cli_common
    streamparse_cli_list -- "uses" --> streamparse_util
    streamparse_cli_stats -- "uses" --> streamparse_util
Loading

CodeBoardingDemoContact

Details

The CLI Management Interface subsystem serves as the primary user-facing component of streamparse, responsible for parsing command-line inputs and orchestrating various operations related to managing topologies on an Apache Storm cluster. It acts as the central control point for users to interact with the streamparse framework.

streamparse.cli.sparse

The core command-line interface component, responsible for parsing top-level commands and dispatching control to specific subcommand handlers. It acts as the central orchestrator for all streamparse CLI operations.

Related Classes/Methods:

streamparse.cli.submit

Manages the complete lifecycle of submitting a streamparse topology to an Apache Storm cluster, including pre-submission validation, JAR packaging and upload, and post-submission actions.

Related Classes/Methods:

streamparse.cli.kill

Handles the graceful termination of a running streamparse topology on the Storm cluster, ensuring proper shutdown procedures.

Related Classes/Methods:

streamparse.cli.list

Retrieves and displays a summary of all active streamparse topologies currently deployed on the Storm cluster, providing an overview of running jobs.

Related Classes/Methods:

streamparse.cli.stats

Fetches and presents detailed runtime statistics for deployed topologies, including cluster-wide, topology-specific, and component-level metrics (spouts and bolts), crucial for monitoring.

Related Classes/Methods:

streamparse.cli.visualize

Generates visual representations (e.g., Graphviz diagrams) of streamparse topologies, aiding developers in understanding the data flow and structure of their stream processing pipelines.

Related Classes/Methods:

streamparse.bootstrap

Facilitates the quick creation of new streamparse projects by generating the necessary directory structure and boilerplate files, streamlining the initial setup process for users.

Related Classes/Methods:

streamparse.cli.common

Provides shared argument parsing and utility functions for various CLI commands.

Related Classes/Methods:

streamparse.util

Provides general utility functions used across the streamparse project.

Related Classes/Methods: