Project Directory¶

The msServiceprofiler project directory is described as follows:

```ColdFusion 3rdparty/ ├── CMakeLists.txt ├── ascend/ │ ├── CMakeLists.txt │ ├── include/ │ │ ├── acl/ │ │ ├── mspti/ │ │ └── mstx/ │ └── src/ └── opentelemetry/ ├── include/ └── proto/ ├── collector/ │ └── trace/ ├── common/ ├── resource/ └── trace/ ├── CMakeLists.txt ├── README.md └── cpp/ ├── CMakeLists.txt ├── include/ │ └── msServiceProfiler/ │ ├── Config.h │ ├── DBExecutor/ │ ├── Profiler.h │ ├── │ ├── ServiceTracer.h │ ├── Tracer.h │ └── msServiceProfiler.h └── src/ docs/ └── zh/ ├── cpp_api/ │ ├── serving_tuning/ │ │ ├── ${api_name}.md │ │ ├── │ │ ├── │ │ └── serving_tuning.md │ └── trace_data_monitoring/ │ ├── ${api_name}.md │ ├── │ └── sample_code.md ├── python_api/ │ ├── README.md │ └── context/ │ ├── ${api_name}.md │ ├── └── figures/ ms_service_profiler/ ├── config/ ├── data_source/ │ └── ${name}source.py └── exporters/ │ └── exporter${name}.py └── ms_service_profiler_ext/ ├── analyze.py ├── compare.py ├── split.py ├── common/ ├── compare_tools/ ├── exporters/ └── split_processor/ ├── mstx.py ├── parse.py ├── profiler.py ├── trace.py ├── parse_helper/ ├── pipeline/ ││ └── pipeline_${name}.py ├── plugins/ │ ├── plugin_${name}.py │ └── sort_plugins.py ├── processor/ │ └── processor_${name}.py ├── task/ ├── tracer/ ├── utils/ │ ├── check/ │ ├── secur/ │ │ ├── constraints/ │ │ └── utils/ │ └── trace_to_db.py └── patcher/ ├── config/ ├── custom_handler_example.py │ ├── hooks_example.yaml ├── vllm/ │ ├── config/ │ ├── handlers/ | | ├── v0/ | | └── v1/ | └── service_profiler.py ├── sglang/ │ ├── config/ │ ├── handlers/ | └── service_patcher.py msservice_advisor/ ├── msservice_advisor/ │ └── profiling_analyze └── advisor.py ms_serviceparam_optimizer/ ├──ms_serviceparam_optimizer/ ├──pyproject.toml ├── pyproject.toml └── test/ ├── CMakeLists.txt ├── run_st.py ├── run_st.sh ├── run_ut.sh ├── fuzz/ │ ├── CMakeLists.txt │ ├── FuzzMain.cpp │ ├── run_fuzz.sh │ └── manager/ │ └── ${name}fuzz.cpp ├── st/ │ ├── cpp/ │ │ └── test.cpp │ └── python/ │ ├── conftest.py │ ├── analyze/ │ ├── checker/ │ ├── collect/ │ ├── executor/ │ ├── multi_analyze/ │ ├── profiler/ │ └── split/ └── ut/ ├── cpp/ │ ├── include/ │ ├── test${name}.cpp └── python/ ├── data_source/ ├── eplb_observe/ ├── task/ ├── trace/ ├── ├── test_msguard/ ├── test_vllm_profiler/ └── test${name}.py # Directory for third-party dependencies # Root CMakeLists configuration file for third-party dependencies # Dependencies for the Ascend AI computing platform # CMakeLists configuration file for Ascend dependencies # Directory for header files # Header files for the Ascend computing library, providing APIs to access its various features. # Header files for the Ascend platform tooling interfaces # Header files for Ascend tooling extensions # Source code directory for third-party dependencies # OpenTelemetry observability framework # Directory for OpenTelemetry header files # Protocol Buffer definition files # Data collector definitions # Trace data collection # Common definitions # Resource definitions # Trace-related definitions # Root CMakeLists configuration file for the project # Project description document # Main C++ source directory for core profiling functionality # CMakeLists configuration file for C++ profiling module # Directory for public profiling interfaces # Profiling header files # Header files for parsing the profiling configuration file # Header files for the data persistence module # Header files for profiling APIs ServiceProfilerInterface.h # Header files for public profiling APIs # Header files for service trace # Header files for trace monitoring APIs # Main entry header file # Source code directory for core profiling implementation # Document directory # English document directory # C++ API documents # Serving tuning API # API description, where ${api_name} indicates the API name. macro_definitions.md # Macro definitions public_sys-resources/ # Public system resources # C++ API documents # Trace monitoring API # API description, where ${api_name} indicates the API name. public_sys-resources/ # Public system resources # Sample code # Python API documents # Python API description # Context-related APIs # API description, where ${api_name} indicates the API name. public_sys-resources/ # Public system resources # Charts and schematics # Directory of core functionalities (such as parsing and data comparison) # Directory of configuration files # Directory for the data source import module # ${name} data source import module, where name indicates the data source name. # Directory for the data exporter module # ${name} data exporter, where name indicates the data name. # Profiling extension package for serving performance # Analysis extension main module # Main module for data comparison # Main module for data breakdown # Common tool modules # Data comparison module # Extension module for the data exporter # Processor module for data breakdown # Python profiling module # Main module for data parsing # Python profiling API # Main trace module # Auxiliary parsing module # Data processing pipeline modules # ${name} data processing pipeline, where name indicates the data name. # System plugins # ${name} data processing plugin, where name indicates the data name. # Plugin sorter # Data processor modules # ${name} data processor, where name indicates the data name. # Task management module # Trace module # Tool modules # Check tool # Security module # Security constraints # Security constant # Module for converting trace data from JSON format to DB format # Hook-based profiling module # Configuration examples # Custom handler example # Hook configuration example # vLLM data collection module # Directory for vLLM profiling configuration files # vLLM function hooks for data collection # vLLM v0 version function hook # vLLM v1 version function hook # vLLM data collection entry # SGLang data collection module # Directory for SGLang profiling configuration files # SGLang data collection function # SGLang data collection entry # Directory for Service Profiling Advisor # Main directory for Service Profiling Advisor # Analyzer modules for Service Profiling Advisor # Main analyzer module for Service Profiling Advisor # Directory for Serviceparam Optimizer # Main directory for Serviceparam Optimizer # Project configuration file for Serviceparam Optimizer # Python project configuration file # Test directory # C++ test build configuration # System test script (Python) # System test running script (Shell) # Unit test script # Fuzzing test directory # Build configuration for fuzz testing # Main program for fuzzing # Fuzzy test script # Management module fuzz testing # Fuzz tests for the ${name} module # System test # C++ System Test # C++ test # Python System Test # Pytest Configuration # Test the analysis function. # Data check module # Data collection test # ST Executor Module # Multi-service performance analysis test # Performance analyzer test # Data splitting test # Unit test # C++ unit test # Directory for storing unit test auxiliary header files # ${name} module. ${name} indicates the module name. # Python unit test # Data source test # EPLB observation test # Test the task management function. # Test the trace monitoring module. test_ms_service_profiler_ext/ # Service profiling extension tests # Test the security module. # vLLM profiling tests # ${name} module test. ${name} indicates the module name.