# Run comparison updates (v2.0/v2.1)

**URL:** <https://www.rubin.community/t/run-comparison-updates-v2-0-v2-1/6582>\
**Category:** Survey Strategy\
**Created:** [May 20, 2022, 5:07pm UTC](https://www.rubin.community/t/run-comparison-updates-v2-0-v2-1/6582 "2022-05-20T17:07:29Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![ljones](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ljones/32/1804_2.png) [@ljones](https://www.rubin.community/u/ljones)\
**Post date:** [May 20, 2022, 5:07pm UTC](https://www.rubin.community/t/run-comparison-updates-v2-0-v2-1/6582/1 "2022-05-20T17:07:29Z")

</div>

Metric summaries and comparisons between runs are a hot topic of discussion with the SCOC, in science collaboration or task force meetings, as well as on the LSSTC slack.  
I thought I’d add some of these resources that can help support that conversation here, too.

The metrics under consideration themselves are a work in progress, and the survey strategy team and the SCOC is very interested in understanding the community’s viewpoint.

These first links are particular-science-goal-oriented notebooks, looking at how the metrics change across simulation families: (a work in progress)  
[Microlensing](https://github.com/lsst-pst/survey_strategy/blob/main/fbs_2.0/Demo_Microlensing.ipynb)  
[AGN](https://github.com/lsst-pst/survey_strategy/blob/main/fbs_2.0/Demo_AGNmetrics.ipynb)  
[SSO](https://github.com/lsst-pst/survey_strategy/blob/main/fbs_2.0/Demo_SSOmetrics.ipynb)  
[DESC WFD](https://github.com/lsst-pst/survey_strategy/blob/main/fbs_2.0/Demo_DESCmetrics.ipynb)

A slightly different approach is to look at a particular simulation family and then look for metrics which might be relevant to this change:  
[Rolling Cadence](https://github.com/lsst-pst/survey_strategy/blob/main/fbs_2.0/Rolling%20Cadence.ipynb)

An introductory tutorial for the archive and summary\_plots modules:  
[04\_Getting\_Data](https://github.com/lsst/rubin_sim_notebooks/blob/main/maf/tutorial/04_Getting_Data.ipynb)  
And a notebook demonstrating how I would extend the metric\_sets dataframe:  
[Identifying metrics](https://github.com/lsst-pst/survey_strategy/blob/main/fbs_2.0/Identify%20metrics.ipynb)

For further information on a particular metric (how it was configured when we ran it, for example), please look into the configuration files we use – most of the metrics we’re talking about are from the “ScienceRadarBatch”:  
[ScienceRadarBatch v0.9.0](https://github.com/lsst/rubin_sim/blob/0.9.0/rubin_sim/maf/batches/scienceRadarBatch.py)