Skip to content
Snippets Groups Projects
Commit cc7acfcc authored by Eli Henry Dykhne's avatar Eli Henry Dykhne
Browse files

made it so that the new metric only runs with open loop boxes

parent 941fd5e0
No related branches found
No related tags found
2 merge requests!21Major changes. convert nuplan devkit to handle occlusions for project,!5Relavant agents occluded metrics
...@@ -3,5 +3,4 @@ defaults: ...@@ -3,5 +3,4 @@ defaults:
- ego_mean_speed_statistics - ego_mean_speed_statistics
- ego_expert_l2_error_statistics - ego_expert_l2_error_statistics
- ego_expert_l2_error_with_yaw_statistics - ego_expert_l2_error_with_yaw_statistics
- is_relavant_agent_occluded_statistics - is_relavant_agent_occluded_statistics
- can_scenario_be_made_dangerous_statistics \ No newline at end of file
...@@ -2,6 +2,8 @@ defaults: ...@@ -2,6 +2,8 @@ defaults:
- common_metrics # Uncomment this for common information about the scenario as specified in the config - common_metrics # Uncomment this for common information about the scenario as specified in the config
- low_level: # Low level metrics - low_level: # Low level metrics
- planner_expert_average_l2_error_within_bound_statistics - planner_expert_average_l2_error_within_bound_statistics
- can_scenario_be_made_dangerous_statistics
- high_level: # High level metrics that depend on low level metrics, they can also rely on the previously called high level metrics - high_level: # High level metrics that depend on low level metrics, they can also rely on the previously called high level metrics
- planner_expert_final_l2_error_within_bound_statistics - planner_expert_final_l2_error_within_bound_statistics
- planner_miss_rate_within_bound_statistics - planner_miss_rate_within_bound_statistics
......
...@@ -5,7 +5,6 @@ closed_loop_reactive_agents_weighted_average: ...@@ -5,7 +5,6 @@ closed_loop_reactive_agents_weighted_average:
# if not specified, the weight is set as default. # if not specified, the weight is set as default.
# metric name : metric weight in the weighted average function # metric name : metric weight in the weighted average function
is_relavant_agent_occluded: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights is_relavant_agent_occluded: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights
can_scenario_be_made_dangerous: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights
ego_progress_along_expert_route: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can take a value in [0,1] depending on the ratio of ego to expert progress ego_progress_along_expert_route: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can take a value in [0,1] depending on the ratio of ego to expert progress
time_to_collision_within_bound: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can be 0 or 1 depending on the minimum time to collision threshold time_to_collision_within_bound: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can be 0 or 1 depending on the minimum time to collision threshold
speed_limit_compliance: 4.0 # This metric has a weight equal to 4.0 in the weighted average function, its base score can take a value in [0,1] depending on the amount and duration of over-speeding speed_limit_compliance: 4.0 # This metric has a weight equal to 4.0 in the weighted average function, its base score can take a value in [0,1] depending on the amount and duration of over-speeding
......
...@@ -5,7 +5,6 @@ closed_loop_nonreactive_agents_weighted_average: ...@@ -5,7 +5,6 @@ closed_loop_nonreactive_agents_weighted_average:
# if not specified, the weight is set as default. # if not specified, the weight is set as default.
# metric name : metric weight in the weighted average function # metric name : metric weight in the weighted average function
is_relavant_agent_occluded: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights is_relavant_agent_occluded: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights
can_scenario_be_made_dangerous: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights
ego_progress_along_expert_route: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can take a value in [0,1] depending on the ratio of ego to expert progress ego_progress_along_expert_route: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can take a value in [0,1] depending on the ratio of ego to expert progress
time_to_collision_within_bound: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can be 0 or 1 depending on the minimum time to collision threshold time_to_collision_within_bound: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can be 0 or 1 depending on the minimum time to collision threshold
speed_limit_compliance: 4.0 # This metric has a weight equal to 4.0 in the weighted average function, its base score can take a value in [0,1] depending on the amount and duration of over-speeding speed_limit_compliance: 4.0 # This metric has a weight equal to 4.0 in the weighted average function, its base score can take a value in [0,1] depending on the amount and duration of over-speeding
......
...@@ -5,7 +5,6 @@ closed_loop_reactive_agents_weighted_average: ...@@ -5,7 +5,6 @@ closed_loop_reactive_agents_weighted_average:
# if not specified, the weight is set as default. # if not specified, the weight is set as default.
# metric name : metric weight in the weighted average function # metric name : metric weight in the weighted average function
is_relavant_agent_occluded: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights is_relavant_agent_occluded: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights
can_scenario_be_made_dangerous: 0.0 # this metric is only for our occlusion stuff so it should not affect the other weights
ego_progress_along_expert_route: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can take a value in [0,1] depending on the ratio of ego to expert progress ego_progress_along_expert_route: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can take a value in [0,1] depending on the ratio of ego to expert progress
time_to_collision_within_bound: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can be 0 or 1 depending on the minimum time to collision threshold time_to_collision_within_bound: 5.0 # This metric has the highest weight equal to 5.0 in the weighted average function, its base score can be 0 or 1 depending on the minimum time to collision threshold
speed_limit_compliance: 4.0 # This metric has a weight equal to 4.0 in the weighted average function, its base score can take a value in [0,1] depending on the amount and duration of over-speeding speed_limit_compliance: 4.0 # This metric has a weight equal to 4.0 in the weighted average function, its base score can take a value in [0,1] depending on the amount and duration of over-speeding
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment