# Verification Datasets Meeting 2016-04-27 Minutes

**URL:** <https://www.rubin.community/t/verification-datasets-meeting-2016-04-27-minutes/726>\
**Category:** Data Management\
**Tags:** verificationdataset\
**Created:** [April 27, 2016, 5:50pm UTC](https://www.rubin.community/t/verification-datasets-meeting-2016-04-27-minutes/726 "2016-04-27T17:50:42Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![nidever](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/nidever/32/29_2.png) [@nidever](https://www.rubin.community/u/nidever)\
**Post date:** [April 27, 2016, 5:50pm UTC](https://www.rubin.community/t/verification-datasets-meeting-2016-04-27-minutes/726/1 "2016-04-27T17:50:42Z")

</div>

Verification Datasets telecon  
Attendees: MWV, Simon, Angelo, Hsin-Fang, Colin, David, Frossie, Robert

**Colin:**

Not much to report

**Simon:**

- twinkles, fixed the astrometric registration problem

- can make pretty pictures

- can make good deep-detection catalogs

- better forced photometry, people looking at light-curves

- problem was a miscommunication of the workflow, and the  
WCSs were different

- MWV suggested to add a check step to verify that the coaddTempExp  
WCS and skymap have the same WCS

- make camera package for monoCam, Dave Monet

- MWV would like to learn how to make the camera geom

- Colin suggests having an obs package for a single chip that could also  
be used with processFile, similar to source extractor

- a discussion of processFile  
[https://github.com/lsst-dm/processFile](https://github.com/lsst-dm/processFile)

**Hsin-Fang:**

- Working on middleware
- single frame driver script works on decam, from pipe\_drivers repo ported over from HSC

**Angelo:**

- Working on SQUASH dashboard prototype
- [http://sqr-009.lsst.io/en/latest/#architecture](http://sqr-009.lsst.io/en/latest/#architecture)

**Frossie:**

- Paul was here last week, ran validate\_drp on a bunch of HSC data
- will make it more generally available and runable on a harness
- RHL mentioned all the HSC data goes public in Feb 2017, raw data and catalogs

**MWV:**

- Zeljko metioned that the SRD has all of the photometric KPM values
- Michael fit the coefficients in validate\_drp  
[http://dmtn-008.lsst.io/](http://dmtn-008.lsst.io/)
- repeatability RMS vs. reported errors don’t correlate well
- RHL suggested plotting chi histogram, sqrt(residual/error)

**David:**

- working on photometric jointCal for the COSMOS data, trying to improve the  
relative calibation, and get to the bottom the higher-than-expected repeatability RMS
- also working on document for CoDR on measuring KPMs

**Robert:**

- Merlin visiting this week, figuring out difference between CP and stack assumptions
- woking on obs\_monocam as well

---

<div class="post-metadata">

**Author:** ![afausti](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/afausti/32/934_2.png) [@afausti](https://www.rubin.community/u/afausti)\
**Post date:** [April 27, 2016, 6:34pm UTC](https://www.rubin.community/t/verification-datasets-meeting-2016-04-27-minutes/726/2 "2016-04-27T18:34:58Z")

</div>

@mwv , @frossie do you think it would be useful to have the plots generated by the validate drp in the dashboard at this point? I thought initially it would make more sense for level 2 QA where we evaluate the quality of the data instead of the quality of the code in the CI system, however these plots are complementary to the metrics and can tell us about code changes by comparing the outputs from different builds, even visually… (perhaps not feasible with static plots but it becomes more interesting with interactive plots where we can select build 1 against build 2) It seems to me that there is value in keeping this history in the long term. Also, the plots produced by a specific build of the stack could be used as a reference when we run level 2 QA on different datasets with the same build, everything linked from the level 2 QA dashboard to the level0 QA dashboard… just dreaming…

---

<div class="post-metadata">

**Author:** ![price](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/price/32/488_2.png) [@price](https://www.rubin.community/u/price)\
**Post date:** [April 27, 2016, 7:38pm UTC](https://www.rubin.community/t/verification-datasets-meeting-2016-04-27-minutes/726/3 "2016-04-27T19:38:31Z")

</div>

> [@nidever](#):
>
> RHL mentioned all the HSC data goes public in Feb 2017, raw data and catalogs

To be more specific, it is the HSC _Strategic Survey Program_ data that goes public in Feb 2017. There is a bunch of HSC data publicly available now, both from [commissioning](http://smoka.nao.ac.jp/ENG/index.jsp) and [open-use](http://smoka.nao.ac.jp/objectList.jsp?subaru=Hyper+Suprime-Cam&sb=Go).
