Add eval_kit evaluation suite with WebRTC visualization
- eval_kit/core: 零框架依赖的指标内核(Trace/metrics/aggregation/terrain_spec/report/naming) - eval_kit/isaaclab: 适配层(env_cfg 改造、rollout 采集、checkpoint 加载) - eval_kit/profiles.py / protocols.py: 机器人形态描述与评估口径预设 - eval_kit/tests: 24 项内核自检 + 21 项命令行自检(都不需要仿真) - eval_suite.py: 编排入口,每个(阶段, 种子)一个子进程;与 eval.py 指标口径一致 - WebRTC 可视化:--livestream 透传、视口相机跟随/自由(--view-env / --free-camera)、 连接前停顿(--pause-s)、自动放开客户端改画幅、打印连接地址 - 诊断与替代路径:rollout 进度打印、--record-frames 抓帧
This commit is contained in:
@@ -0,0 +1,35 @@
|
||||
# Copyright (c) 2025 Deep Robotics
|
||||
# SPDX-License-Identifier: BSD 3-Clause
|
||||
|
||||
"""可搬运的机器人性能评价套件。
|
||||
|
||||
分层:
|
||||
|
||||
- :mod:`eval_kit.core` —— 零框架依赖(只用 numpy + 标准库),可整体拷到别的项目
|
||||
- :mod:`eval_kit.isaaclab` —— IsaacLab 适配层,唯一接触仿真环境内部的地方
|
||||
- :mod:`eval_kit.profiles` —— 机器人形态描述(加机器人 = 加一条记录)
|
||||
- :mod:`eval_kit.protocols` —— 评估协议预设
|
||||
|
||||
命令行入口:``scripts/reinforcement_learning/rsl_rl/eval_suite.py``。
|
||||
"""
|
||||
|
||||
from eval_kit.core.aggregation import aggregate_runs, build_upper_limit_matrix
|
||||
from eval_kit.core.metrics import compute_metrics
|
||||
from eval_kit.core.schema import EvalProtocol, RobotProfile, Trace
|
||||
from eval_kit.core.terrain_spec import get_terrain_spec
|
||||
from eval_kit.profiles import PROFILES, get_profile
|
||||
from eval_kit.protocols import PROTOCOLS, get_protocol
|
||||
|
||||
__all__ = [
|
||||
"EvalProtocol",
|
||||
"PROFILES",
|
||||
"PROTOCOLS",
|
||||
"RobotProfile",
|
||||
"Trace",
|
||||
"aggregate_runs",
|
||||
"build_upper_limit_matrix",
|
||||
"compute_metrics",
|
||||
"get_profile",
|
||||
"get_protocol",
|
||||
"get_terrain_spec",
|
||||
]
|
||||
Reference in New Issue
Block a user