Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_Trojan_MOOB', 'baseline_v3_2_10yrs_ObsArc_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'baseline_v3_2_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'baseline_v3_2_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'filter', 'visitExposureTime', 'seeingFwhmEff', 'observationStartMJD', 'fiveSigmaDepth', 'rotSkyPos', 'observationId', 'solarElong', 'fieldDec', 'night', 'seeingFwhmGeom']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_2_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_2_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_Trojan_MOOB', 'baseline_v3_3_10yrs_ObsArc_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'baseline_v3_3_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'baseline_v3_3_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'seeingFwhmGeom', 'observationId', 'visitExposureTime', 'observationStartMJD', 'fieldDec', 'night', 'solarElong', 'seeingFwhmEff', 'filter', 'fiveSigmaDepth', 'rotSkyPos']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_3_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_3_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_Trojan_MOOB', 'baseline_v3_4_10yrs_ObsArc_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'baseline_v3_4_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'baseline_v3_4_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'night', 'visitExposureTime', 'solarElong', 'observationStartMJD', 'observationId', 'fieldDec', 'filter', 'rotSkyPos', 'fiveSigmaDepth', 'seeingFwhmGeom', 'seeingFwhmEff']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_4_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_4_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_TNO_MOOB', 'baseline_v3_2_10yrs_ObsArc_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'baseline_v3_2_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'fieldRA', 'observationId', 'observationStartMJD', 'fieldDec', 'seeingFwhmGeom', 'fiveSigmaDepth', 'filter', 'visitExposureTime', 'solarElong', 'seeingFwhmEff', 'night']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_2_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_2_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_TNO_MOOB', 'baseline_v3_3_10yrs_ObsArc_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'baseline_v3_3_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['filter', 'rotSkyPos', 'observationId', 'fiveSigmaDepth', 'fieldDec', 'night', 'seeingFwhmGeom', 'solarElong', 'fieldRA', 'observationStartMJD', 'visitExposureTime', 'seeingFwhmEff']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_3_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_3_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_TNO_MOOB', 'baseline_v3_4_10yrs_ObsArc_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'baseline_v3_4_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'observationStartMJD', 'fieldRA', 'seeingFwhmEff', 'night', 'visitExposureTime', 'filter', 'solarElong', 'observationId', 'seeingFwhmGeom', 'fiveSigmaDepth', 'fieldDec']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_4_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_4_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'retro_baseline_v2_0_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldDec', 'seeingFwhmGeom', 'seeingFwhmEff', 'observationStartMJD', 'filter', 'visitExposureTime', 'rotSkyPos', 'fiveSigmaDepth', 'observationId', 'night', 'solarElong', 'fieldRA']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_Trojan_MOOB', 'baseline_v2_0_10yrs_ObsArc_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'baseline_v2_0_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'baseline_v2_0_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'rotSkyPos', 'seeingFwhmEff', 'fieldDec', 'fieldRA', 'visitExposureTime', 'night', 'solarElong', 'filter', 'seeingFwhmGeom', 'fiveSigmaDepth', 'observationId']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_Trojan_MOOB', 'baseline_v2_1_10yrs_ObsArc_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'baseline_v2_1_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'baseline_v2_1_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmGeom', 'fieldRA', 'fiveSigmaDepth', 'fieldDec', 'observationId', 'night', 'observationStartMJD', 'seeingFwhmEff', 'filter', 'rotSkyPos', 'solarElong', 'visitExposureTime']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_1_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_1_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_Trojan_MOOB', 'baseline_v2_2_10yrs_ObsArc_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'baseline_v2_2_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'baseline_v2_2_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'night', 'rotSkyPos', 'visitExposureTime', 'solarElong', 'fieldDec', 'seeingFwhmEff', 'observationId', 'seeingFwhmGeom', 'fieldRA', 'filter', 'fiveSigmaDepth']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_2_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_2_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_Trojan_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_Trojan_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_Trojan_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_Trojan_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Trojan_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_Trojan_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_Trojan_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_Trojan_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_Trojan_MOOB', 'baseline_v3_0_10yrs_ObsArc_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_Trojan_MOOB', 'baseline_v3_0_10yrs_LightcurveInversionAsteroid_Trojan_MOOB', 'baseline_v3_0_10yrs_ColorAsteroid_Trojan_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmGeom', 'solarElong', 'night', 'fieldRA', 'observationStartMJD', 'fieldDec', 'rotSkyPos', 'visitExposureTime', 'filter', 'observationId', 'fiveSigmaDepth', 'seeingFwhmEff']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_0_10yrs_HighVelocityNights_Trojan_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_TNO_MOOB', 'baseline_v2_1_10yrs_ObsArc_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'baseline_v2_1_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmEff', 'night', 'rotSkyPos', 'observationId', 'filter', 'fieldDec', 'observationStartMJD', 'seeingFwhmGeom', 'solarElong', 'fieldRA', 'visitExposureTime', 'fiveSigmaDepth']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_1_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_1_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_MBA_MOOB', 'baseline_v3_2_10yrs_ObsArc_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'baseline_v3_2_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'baseline_v3_2_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldDec', 'night', 'seeingFwhmGeom', 'rotSkyPos', 'solarElong', 'visitExposureTime', 'filter', 'fiveSigmaDepth', 'fieldRA', 'observationStartMJD', 'seeingFwhmEff', 'observationId']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_2_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_2_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_MBA_MOOB', 'baseline_v3_3_10yrs_ObsArc_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'baseline_v3_3_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'baseline_v3_3_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'seeingFwhmGeom', 'solarElong', 'observationId', 'seeingFwhmEff', 'fieldRA', 'fieldDec', 'observationStartMJD', 'visitExposureTime', 'night', 'fiveSigmaDepth', 'filter']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_3_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_3_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_MBA_MOOB', 'baseline_v3_4_10yrs_ObsArc_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'baseline_v3_4_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'baseline_v3_4_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['filter', 'rotSkyPos', 'solarElong', 'night', 'observationStartMJD', 'fiveSigmaDepth', 'seeingFwhmGeom', 'fieldDec', 'fieldRA', 'observationId', 'visitExposureTime', 'seeingFwhmEff']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_4_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_4_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_TNO_MOOB', 'baseline_v3_0_10yrs_ObsArc_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'baseline_v3_0_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'seeingFwhmEff', 'visitExposureTime', 'solarElong', 'seeingFwhmGeom', 'observationId', 'fiveSigmaDepth', 'filter', 'fieldDec', 'observationStartMJD', 'night', 'rotSkyPos']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_TNO_MOOB', 'baseline_v2_0_10yrs_ObsArc_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'baseline_v2_0_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'solarElong', 'observationId', 'visitExposureTime', 'fieldDec', 'night', 'fiveSigmaDepth', 'seeingFwhmEff', 'observationStartMJD', 'filter', 'seeingFwhmGeom', 'fieldRA']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_MBA_MOOB', 'baseline_v2_1_10yrs_ObsArc_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'baseline_v2_1_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'baseline_v2_1_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'fieldRA', 'observationId', 'seeingFwhmEff', 'solarElong', 'visitExposureTime', 'rotSkyPos', 'fieldDec', 'night', 'fiveSigmaDepth', 'seeingFwhmGeom', 'filter']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_1_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_1_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_MBA_MOOB', 'baseline_v3_0_10yrs_ObsArc_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'baseline_v3_0_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'baseline_v3_0_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['solarElong', 'filter', 'visitExposureTime', 'seeingFwhmEff', 'rotSkyPos', 'fiveSigmaDepth', 'observationStartMJD', 'fieldDec', 'seeingFwhmGeom', 'fieldRA', 'observationId', 'night']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_NEO_MOOB', 'baseline_v3_2_10yrs_ObsArc_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'baseline_v3_2_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'baseline_v3_2_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fiveSigmaDepth', 'night', 'observationId', 'rotSkyPos', 'solarElong', 'seeingFwhmEff', 'filter', 'fieldRA', 'fieldDec', 'seeingFwhmGeom', 'visitExposureTime', 'observationStartMJD']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_TNO_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'observationId', 'fiveSigmaDepth', 'night', 'seeingFwhmEff', 'seeingFwhmGeom', 'solarElong', 'rotSkyPos', 'fieldDec', 'observationStartMJD', 'filter', 'visitExposureTime']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_NEO_MOOB', 'baseline_v2_1_10yrs_ObsArc_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'baseline_v2_1_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'baseline_v2_1_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['filter', 'fieldRA', 'fiveSigmaDepth', 'observationId', 'seeingFwhmGeom', 'solarElong', 'observationStartMJD', 'night', 'seeingFwhmEff', 'rotSkyPos', 'visitExposureTime', 'fieldDec']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_NEO_MOOB', 'baseline_v3_4_10yrs_ObsArc_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'baseline_v3_4_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'baseline_v3_4_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['visitExposureTime', 'fiveSigmaDepth', 'observationStartMJD', 'seeingFwhmGeom', 'fieldDec', 'night', 'rotSkyPos', 'solarElong', 'filter', 'observationId', 'seeingFwhmEff', 'fieldRA']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_NEO_MOOB', 'baseline_v3_3_10yrs_ObsArc_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'baseline_v3_3_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'baseline_v3_3_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fiveSigmaDepth', 'fieldRA', 'night', 'seeingFwhmGeom', 'filter', 'rotSkyPos', 'fieldDec', 'observationStartMJD', 'seeingFwhmEff', 'solarElong', 'visitExposureTime', 'observationId']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_TNO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_TNO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_TNO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_TNO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_TNO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_TNO_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_TNO_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_TNO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_TNO_MOOB', 'baseline_v2_2_10yrs_ObsArc_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_TNO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_TNO_MOOB', 'baseline_v2_2_10yrs_LightcurveColorOuter_TNO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['night', 'fiveSigmaDepth', 'rotSkyPos', 'observationId', 'seeingFwhmEff', 'fieldRA', 'visitExposureTime', 'fieldDec', 'solarElong', 'filter', 'observationStartMJD', 'seeingFwhmGeom']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_2_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_2_10yrs_HighVelocityNights_TNO_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_MBA_MOOB', 'baseline_v2_0_10yrs_ObsArc_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'baseline_v2_0_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'baseline_v2_0_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['solarElong', 'seeingFwhmGeom', 'night', 'rotSkyPos', 'seeingFwhmEff', 'fieldRA', 'observationId', 'filter', 'visitExposureTime', 'fieldDec', 'fiveSigmaDepth', 'observationStartMJD']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_MBA_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'retro_baseline_v2_0_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'visitExposureTime', 'filter', 'night', 'seeingFwhmEff', 'solarElong', 'fieldRA', 'observationStartMJD', 'fiveSigmaDepth', 'seeingFwhmGeom', 'observationId', 'fieldDec']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_MBA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_MBA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_MBA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_MBA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_MBA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_MBA_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_MBA_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_MBA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_MBA_MOOB', 'baseline_v2_2_10yrs_ObsArc_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_MBA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_MBA_MOOB', 'baseline_v2_2_10yrs_LightcurveInversionAsteroid_MBA_MOOB', 'baseline_v2_2_10yrs_ColorAsteroid_MBA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationId', 'rotSkyPos', 'fieldRA', 'fieldDec', 'visitExposureTime', 'seeingFwhmEff', 'seeingFwhmGeom', 'solarElong', 'night', 'filter', 'observationStartMJD', 'fiveSigmaDepth']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_2_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_2_10yrs_HighVelocityNights_MBA_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_PHA_MOOB', 'baseline_v3_2_10yrs_ObsArc_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'baseline_v3_2_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'baseline_v3_2_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['visitExposureTime', 'fiveSigmaDepth', 'fieldRA', 'seeingFwhmGeom', 'night', 'filter', 'seeingFwhmEff', 'observationId', 'fieldDec', 'solarElong', 'rotSkyPos', 'observationStartMJD']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_PHA_MOOB', 'baseline_v3_3_10yrs_ObsArc_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'baseline_v3_3_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'baseline_v3_3_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'fieldDec', 'observationId', 'seeingFwhmGeom', 'fieldRA', 'visitExposureTime', 'night', 'fiveSigmaDepth', 'solarElong', 'rotSkyPos', 'filter', 'seeingFwhmEff']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_PHA_MOOB', 'baseline_v3_4_10yrs_ObsArc_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'baseline_v3_4_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'baseline_v3_4_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationId', 'observationStartMJD', 'rotSkyPos', 'filter', 'fieldRA', 'seeingFwhmGeom', 'visitExposureTime', 'seeingFwhmEff', 'fieldDec', 'night', 'solarElong', 'fiveSigmaDepth']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_NEO_MOOB', 'baseline_v3_0_10yrs_ObsArc_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'baseline_v3_0_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'baseline_v3_0_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmGeom', 'solarElong', 'fieldRA', 'seeingFwhmEff', 'observationId', 'rotSkyPos', 'fieldDec', 'visitExposureTime', 'filter', 'fiveSigmaDepth', 'observationStartMJD', 'night']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_NEO_MOOB', 'baseline_v2_0_10yrs_ObsArc_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'baseline_v2_0_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'baseline_v2_0_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['filter', 'fiveSigmaDepth', 'rotSkyPos', 'observationId', 'visitExposureTime', 'solarElong', 'seeingFwhmEff', 'fieldDec', 'seeingFwhmGeom', 'fieldRA', 'observationStartMJD', 'night']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_NEO_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'retro_baseline_v2_0_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fiveSigmaDepth', 'solarElong', 'night', 'visitExposureTime', 'observationStartMJD', 'filter', 'fieldDec', 'seeingFwhmEff', 'observationId', 'fieldRA', 'seeingFwhmGeom', 'rotSkyPos']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_NEO_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_NEO_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_NEO_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_NEO_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_NEO_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_NEO_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_NEO_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_NEO_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_NEO_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_NEO_MOOB', 'baseline_v2_2_10yrs_ObsArc_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_NEO_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_NEO_MOOB', 'baseline_v2_2_10yrs_LightcurveInversionAsteroid_NEO_MOOB', 'baseline_v2_2_10yrs_ColorAsteroid_NEO_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['visitExposureTime', 'night', 'rotSkyPos', 'seeingFwhmGeom', 'observationStartMJD', 'solarElong', 'fiveSigmaDepth', 'filter', 'observationId', 'fieldDec', 'seeingFwhmEff', 'fieldRA']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_PHA_MOOB', 'baseline_v2_1_10yrs_ObsArc_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'baseline_v2_1_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'baseline_v2_1_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fiveSigmaDepth', 'fieldRA', 'visitExposureTime', 'night', 'solarElong', 'rotSkyPos', 'observationStartMJD', 'observationId', 'fieldDec', 'seeingFwhmGeom', 'seeingFwhmEff', 'filter']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_PHA_MOOB', 'baseline_v3_0_10yrs_ObsArc_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'baseline_v3_0_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'baseline_v3_0_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmGeom', 'fiveSigmaDepth', 'fieldRA', 'solarElong', 'filter', 'seeingFwhmEff', 'observationStartMJD', 'rotSkyPos', 'observationId', 'fieldDec', 'visitExposureTime', 'night']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_PHA_MOOB', 'baseline_v2_0_10yrs_ObsArc_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'baseline_v2_0_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'baseline_v2_0_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmGeom', 'fieldDec', 'solarElong', 'filter', 'rotSkyPos', 'fiveSigmaDepth', 'observationId', 'seeingFwhmEff', 'observationStartMJD', 'visitExposureTime', 'fieldRA', 'night']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_Vatira_MOOB', 'baseline_v3_2_10yrs_ObsArc_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'baseline_v3_2_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'baseline_v3_2_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'solarElong', 'observationStartMJD', 'rotSkyPos', 'fieldDec', 'seeingFwhmEff', 'visitExposureTime', 'filter', 'observationId', 'night', 'fiveSigmaDepth', 'seeingFwhmGeom']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_Vatira_MOOB', 'baseline_v3_4_10yrs_ObsArc_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'baseline_v3_4_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'baseline_v3_4_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['night', 'fieldDec', 'filter', 'fiveSigmaDepth', 'observationId', 'visitExposureTime', 'seeingFwhmEff', 'rotSkyPos', 'seeingFwhmGeom', 'observationStartMJD', 'fieldRA', 'solarElong']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v3_4_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v3_4_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_PHA_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'retro_baseline_v2_0_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['filter', 'fieldRA', 'seeingFwhmGeom', 'solarElong', 'observationId', 'rotSkyPos', 'fieldDec', 'visitExposureTime', 'fiveSigmaDepth', 'seeingFwhmEff', 'night', 'observationStartMJD']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_PHA_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_PHA_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_PHA_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_PHA_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_PHA_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_PHA_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_PHA_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_PHA_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_PHA_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_PHA_MOOB', 'baseline_v2_2_10yrs_ObsArc_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_PHA_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_PHA_MOOB', 'baseline_v2_2_10yrs_LightcurveInversionAsteroid_PHA_MOOB', 'baseline_v2_2_10yrs_ColorAsteroid_PHA_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fiveSigmaDepth', 'filter', 'observationStartMJD', 'rotSkyPos', 'night', 'visitExposureTime', 'observationId', 'seeingFwhmGeom', 'fieldDec', 'seeingFwhmEff', 'solarElong', 'fieldRA']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_Vatira_MOOB', 'baseline_v3_3_10yrs_ObsArc_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'baseline_v3_3_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'baseline_v3_3_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationId', 'fieldDec', 'night', 'filter', 'fieldRA', 'solarElong', 'observationStartMJD', 'seeingFwhmGeom', 'rotSkyPos', 'seeingFwhmEff', 'fiveSigmaDepth', 'visitExposureTime']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_Vatira_MOOB', 'baseline_v2_1_10yrs_ObsArc_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'baseline_v2_1_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'baseline_v2_1_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['night', 'filter', 'fieldRA', 'fieldDec', 'fiveSigmaDepth', 'seeingFwhmGeom', 'observationId', 'rotSkyPos', 'seeingFwhmEff', 'observationStartMJD', 'solarElong', 'visitExposureTime']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_Vatira_MOOB', 'baseline_v3_0_10yrs_ObsArc_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'baseline_v3_0_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'baseline_v3_0_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationId', 'solarElong', 'night', 'seeingFwhmEff', 'fieldDec', 'fiveSigmaDepth', 'seeingFwhmGeom', 'observationStartMJD', 'rotSkyPos', 'fieldRA', 'visitExposureTime', 'filter']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_Vatira_MOOB', 'baseline_v2_0_10yrs_ObsArc_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'baseline_v2_0_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'baseline_v2_0_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmGeom', 'fieldDec', 'seeingFwhmEff', 'fieldRA', 'observationId', 'fiveSigmaDepth', 'observationStartMJD', 'visitExposureTime', 'rotSkyPos', 'night', 'solarElong', 'filter']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'retro_baseline_v2_0_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'fieldDec', 'visitExposureTime', 'rotSkyPos', 'observationId', 'fiveSigmaDepth', 'observationStartMJD', 'seeingFwhmEff', 'seeingFwhmGeom', 'night', 'filter', 'solarElong']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_NObs_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_NObs_Vatira_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_ObsArc_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_ObsArc_Vatira_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_DiscoveryNChances_Vatira_3_pairs_in_15_nights_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_DiscoveryNChances_Vatira_3_pairs_in_15_nights_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2_0_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2.0_10yrs_Vatira_activityDays_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to retro_baseline_v2.0_10yrs_Vatira_activityDeg_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_Vatira_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_Vatira_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_Vatira_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_Vatira_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_Vatira_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_Vatira_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_Vatira_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_Vatira_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_Vatira_MOOB', 'baseline_v2_2_10yrs_ObsArc_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_Vatira_MOOB', 'baseline_v2_2_10yrs_LightcurveInversionAsteroid_Vatira_MOOB', 'baseline_v2_2_10yrs_ColorAsteroid_Vatira_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'fiveSigmaDepth', 'fieldRA', 'filter', 'seeingFwhmEff', 'observationId', 'night', 'visitExposureTime', 'seeingFwhmGeom', 'solarElong', 'fieldDec', 'rotSkyPos']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_2_10yrs_DiscoveryNChances_Vatira_3_pairs_in_15_nights_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_2_10yrs_DiscoveryNChances_Vatira_3_pairs_in_15_nights_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:688: UserWarning: MetricBundle (baseline_v2_2_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB) has no unmasked metric_values, skipping plots.
  warnings.warn(msg)
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:704: UserWarning: No artists with labels found to put in legend.  Note that artists whose label start with an underscore are ignored when legend() is called with no argument.
  plt.legend(loc=legend_loc, fancybox=True, fontsize="smaller")
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/maf/plots/plot_handler.py:739: UserWarning: Trying to save figure to baseline_v2_2_10yrs_HighVelocityNights_Vatira_High_velocity_pair_detection_loss_MOOB_ComboMetricVsH.pdf butfigure is None. Skipping.
  warnings.warn(f"Trying to save figure to {plot_file} but" "figure is None. Skipping.")
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_OCC_r5_MOOB', 'baseline_v3_2_10yrs_ObsArc_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'baseline_v3_2_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'filter', 'seeingFwhmGeom', 'solarElong', 'rotSkyPos', 'observationId', 'seeingFwhmEff', 'fieldDec', 'observationStartMJD', 'visitExposureTime', 'fiveSigmaDepth', 'night']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_OCC_r5_MOOB', 'baseline_v3_4_10yrs_ObsArc_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'baseline_v3_4_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['solarElong', 'fieldDec', 'night', 'filter', 'observationStartMJD', 'fieldRA', 'seeingFwhmGeom', 'seeingFwhmEff', 'rotSkyPos', 'fiveSigmaDepth', 'visitExposureTime', 'observationId']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_OCC_r5_MOOB', 'baseline_v3_3_10yrs_ObsArc_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'baseline_v3_3_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['night', 'fieldDec', 'seeingFwhmGeom', 'observationId', 'visitExposureTime', 'solarElong', 'fieldRA', 'rotSkyPos', 'observationStartMJD', 'fiveSigmaDepth', 'seeingFwhmEff', 'filter']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_OCC_r5_MOOB', 'baseline_v2_1_10yrs_ObsArc_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'baseline_v2_1_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'night', 'fiveSigmaDepth', 'fieldDec', 'observationId', 'visitExposureTime', 'seeingFwhmEff', 'filter', 'rotSkyPos', 'solarElong', 'seeingFwhmGeom', 'fieldRA']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_OCC_r5_MOOB', 'baseline_v3_0_10yrs_ObsArc_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'baseline_v3_0_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmEff', 'fiveSigmaDepth', 'fieldRA', 'observationStartMJD', 'seeingFwhmGeom', 'solarElong', 'rotSkyPos', 'filter', 'visitExposureTime', 'night', 'observationId', 'fieldDec']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'baseline_v3_2_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_2_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_2_10yrs_NObs_OCC_r20_MOOB', 'baseline_v3_2_10yrs_ObsArc_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'baseline_v3_2_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['seeingFwhmGeom', 'fieldDec', 'night', 'visitExposureTime', 'observationStartMJD', 'fieldRA', 'rotSkyPos', 'solarElong', 'observationId', 'seeingFwhmEff', 'filter', 'fiveSigmaDepth']
INFO:root:Queried data from opsim baseline_v3.2_10yrs.db, fetched 2125578 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_OCC_r5_MOOB', 'baseline_v2_0_10yrs_ObsArc_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'baseline_v2_0_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldRA', 'solarElong', 'night', 'filter', 'fieldDec', 'fiveSigmaDepth', 'seeingFwhmGeom', 'rotSkyPos', 'observationId', 'seeingFwhmEff', 'observationStartMJD', 'visitExposureTime']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'baseline_v3_4_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_4_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_4_10yrs_NObs_OCC_r20_MOOB', 'baseline_v3_4_10yrs_ObsArc_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'baseline_v3_4_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldDec', 'fiveSigmaDepth', 'night', 'rotSkyPos', 'observationId', 'fieldRA', 'observationStartMJD', 'visitExposureTime', 'seeingFwhmGeom', 'solarElong', 'filter', 'seeingFwhmEff']
INFO:root:Queried data from opsim baseline_v3.4_10yrs.db, fetched 2146797 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'baseline_v3_3_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_3_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_3_10yrs_NObs_OCC_r20_MOOB', 'baseline_v3_3_10yrs_ObsArc_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'baseline_v3_3_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'seeingFwhmGeom', 'visitExposureTime', 'fiveSigmaDepth', 'filter', 'night', 'observationId', 'fieldDec', 'fieldRA', 'seeingFwhmEff', 'solarElong', 'rotSkyPos']
INFO:root:Queried data from opsim baseline_v3.3_10yrs.db, fetched 2131089 visits.
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'seeingFwhmGeom', 'fiveSigmaDepth', 'filter', 'seeingFwhmEff', 'fieldRA', 'observationStartMJD', 'solarElong', 'observationId', 'night', 'visitExposureTime', 'fieldDec']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_OCC_r5_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_OCC_r5_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_OCC_r5_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_OCC_r5_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r5_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_OCC_r5_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_OCC_r5_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_OCC_r5_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_OCC_r5_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_OCC_r5_MOOB', 'baseline_v2_2_10yrs_ObsArc_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r5_MOOB', 'baseline_v2_2_10yrs_LightcurveColorOuter_OCC_r5_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'seeingFwhmEff', 'fiveSigmaDepth', 'seeingFwhmGeom', 'observationStartMJD', 'night', 'fieldDec', 'observationId', 'visitExposureTime', 'fieldRA', 'solarElong', 'filter']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'baseline_v2_1_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_1_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_1_10yrs_NObs_OCC_r20_MOOB', 'baseline_v2_1_10yrs_ObsArc_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'baseline_v2_1_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['filter', 'fieldDec', 'fiveSigmaDepth', 'observationStartMJD', 'rotSkyPos', 'visitExposureTime', 'observationId', 'fieldRA', 'seeingFwhmEff', 'night', 'solarElong', 'seeingFwhmGeom']
INFO:root:Queried data from opsim baseline_v2.1_10yrs.db, fetched 2081749 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'baseline_v3_0_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'baseline_v3_0_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v3_0_10yrs_NObs_OCC_r20_MOOB', 'baseline_v3_0_10yrs_ObsArc_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'baseline_v3_0_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['observationStartMJD', 'fieldRA', 'filter', 'visitExposureTime', 'seeingFwhmEff', 'observationId', 'fieldDec', 'night', 'rotSkyPos', 'seeingFwhmGeom', 'fiveSigmaDepth', 'solarElong']
INFO:root:Queried data from opsim baseline_v3.0_10yrs.db, fetched 2086079 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'baseline_v2_0_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_0_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_0_10yrs_NObs_OCC_r20_MOOB', 'baseline_v2_0_10yrs_ObsArc_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'baseline_v2_0_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['fieldDec', 'rotSkyPos', 'seeingFwhmGeom', 'fieldRA', 'night', 'visitExposureTime', 'observationId', 'seeingFwhmEff', 'fiveSigmaDepth', 'solarElong', 'observationStartMJD', 'filter']
INFO:root:Queried data from opsim baseline_v2.0_10yrs.db, fetched 2086980 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'baseline_v2_2_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'baseline_v2_2_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['baseline_v2_2_10yrs_NObs_OCC_r20_MOOB', 'baseline_v2_2_10yrs_ObsArc_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'baseline_v2_2_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['rotSkyPos', 'fieldDec', 'seeingFwhmEff', 'visitExposureTime', 'filter', 'night', 'fiveSigmaDepth', 'observationStartMJD', 'fieldRA', 'seeingFwhmGeom', 'observationId', 'solarElong']
INFO:root:Queried data from opsim baseline_v2.2_10yrs.db, fetched 2074975 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 60218-63870.
  warnings.warn(
Calculating quick discovery metrics with simple trailing losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_trailing_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_trailing_loss_MOOB']
Calculated and saved all metrics.
Calculating full discovery metrics with detection losses.
Running metrics ['retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in30_OCC_r20_3_pairs_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x4in20_OCC_r20_4_pairs_in_20_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_3x3in30_OCC_r20_3_triplets_in_30_nights_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_4x1in2_OCC_r20_1_quad_in_1_night_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq5_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq4_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq3_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x3in15_OCC_r20_3_pairs_in_15_nights_SNReq0_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_1x1in5_OCC_r20_Single_detection_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_Discovery_2x1in5_OCC_r20_Single_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_HighVelocityNights_OCC_r20_High_velocity_pair_detection_loss_MOOB', 'retro_baseline_v2_0_10yrs_MagicDiscovery_OCC_r20_6_detections_in_60_nights_detection_loss_MOOB']
Calculated and saved all metrics.
Calculating characterization metrics.
Running metrics ['retro_baseline_v2_0_10yrs_NObs_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_ObsArc_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_10_days_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_40_days_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_70_days_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_100_days_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_130_days_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_160_days_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_lasting_190_days_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_5_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_25_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_45_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_65_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_85_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_105_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_125_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_145_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_Chances_of_detecting_activity_covering_165_deg_OCC_r20_MOOB', 'retro_baseline_v2_0_10yrs_LightcurveColorOuter_OCC_r20_MOOB']
Calculated and saved all metrics.
INFO:root:Querying for columns:
 ['solarElong', 'observationId', 'seeingFwhmGeom', 'seeingFwhmEff', 'fieldRA', 'fieldDec', 'night', 'fiveSigmaDepth', 'observationStartMJD', 'visitExposureTime', 'rotSkyPos', 'filter']
INFO:root:Queried data from opsim retro_baseline_v2.0_10yrs.db, fetched 2048566 visits.
/sdf/home/y/yoachim/git_repos/rubin_sim/rubin_sim/moving_objects/direct_obs.py:192: UserWarning: Pre-computed position times do not cover MJD range of 59853-63506.
  warnings.warn(