# Running latest pipeline tutorial with "current w\_2022\_16 w\_latest setup"

**URL:** <https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487>\
**Category:** Data Management\
**Created:** [April 16, 2022, 1:37pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487 "2022-04-16T13:37:22Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![fsklich](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/fsklich/32/1589_2.png) [@fsklich](https://www.rubin.community/u/fsklich)\
**Post date:** [April 16, 2022, 1:37pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/1 "2022-04-16T13:37:23Z")

</div>

I upgraded my Mac OS to Monterey 12.3.  
I scuttled the prior pipeline software.  
I installed the newest stack.  
I successfully installed the latest distribution with: eups distrib install -t w\_latest lsst\_distrib  
I downloaded the latest RC2 SUBSET (even though there is a middle directory named /gen2/ )  
So far, so good.  
I got to Part 2 of the tutorial and received this output from the butler query  
butler query-data-ids SMALL\_HSC --collections HSC/RC2/defaults --datasets ‘raw’  
WARNING: version mismatch between CFITSIO header (v4.000999999999999) and linked library (v4.01).  
WARNING: version mismatch between CFITSIO header (v4.000999999999999) and linked library (v4.01).  
WARNING: version mismatch between CFITSIO header (v4.000999999999999) and linked library (v4.01).  
No results. Try --help for more information.

---

<div class="post-metadata">

**Author:** ![fsklich](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/fsklich/32/1589_2.png) [@fsklich](https://www.rubin.community/u/fsklich)\
**Post date:** [April 17, 2022, 4:20pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/2 "2022-04-17T16:20:51Z")

</div>

As an add-on, these other butler queries work just fine in the tutorial, part 2:

- butler query-collections SMALL\_HSC
- butler query-dataset-types SMALL\_HSC
- butler query-dimension-records SMALL\_HSC/ instrument  
yet, both of the “ **butler query-data-ids** ” respond with “ **No results…** ”

---

<div class="post-metadata">

**Author:** ![fsklich](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/fsklich/32/1589_2.png) [@fsklich](https://www.rubin.community/u/fsklich)\
**Post date:** [April 17, 2022, 4:23pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/3 "2022-04-17T16:23:38Z")

</div>

## If I compose the equivalent query from Jupyter, it seems to WORK!!! **for ref in registry.queryDatasets(‘raw’, collections=‘HSC/RC2/defaults’, instrument=‘HSC’):** \*\* **print(ref.dataId.full)**\*\*

{band: ‘y’, instrument: ‘HSC’, detector: 41, physical\_filter: ‘HSC-Y’, exposure: 322}  
{band: ‘y’, instrument: ‘HSC’, detector: 41, physical\_filter: ‘HSC-Y’, exposure: 346}  
{band: ‘y’, instrument: ‘HSC’, detector: 41, physical\_filter: ‘HSC-Y’, exposure: 358}  
{band: ‘z’, instrument: ‘HSC’, detector: 41, physical\_filter: ‘HSC-Z’, exposure: 1178}  
{band: ‘z’, instrument: ‘HSC’, detector: 41, physical\_filter: ‘HSC-Z’, exposure: 1184}

---

<div class="post-metadata">

**Author:** ![timj](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/timj/32/10_2.png) [@timj](https://www.rubin.community/u/timj)\
**Post date:** [April 17, 2022, 4:44pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/4 "2022-04-17T16:44:07Z")

</div>

> [@fsklich](#):
>
> butler query-data-ids

Apologies. The tutorial needs to be updated to use `butler query-datasets` (as you use later on when you report it working). There was a bug in `query-data-ids` that we fixed recently. The bottom line is that if you want to know what datasets are available you should be using `query-datasets` – we will try to fix the tutorial soon.

---

<div class="post-metadata">

**Author:** ![fsklich](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/fsklich/32/1589_2.png) [@fsklich](https://www.rubin.community/u/fsklich)\
**Post date:** [April 18, 2022, 12:19pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/5 "2022-04-18T12:19:26Z")

</div>

okay, thanks, great. I’ve refabricated the butler command as:  
**butler query-datasets SMALL\_HSC --collections HSC/RC2/defaults raw**  
Onward…

---

<div class="post-metadata">

**Author:** ![fsklich](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/fsklich/32/1589_2.png) [@fsklich](https://www.rubin.community/u/fsklich)\
**Post date:** [April 18, 2022, 1:40pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/6 "2022-04-18T13:40:49Z")

</div>

My fresh install included: **eups distrib install -t w\_latest lsst\_distrib**  
This yielded : **gb444b43468+bf97d9bd2a current w\_2022\_16 w\_latest setup**  
With a CONDA env : **LSST\_CONDA\_ENV\_NAME=lsst-scipipe-3.0.0**  
Located at : **lsst\_stack/conda/miniconda3-py38\_4.9.2/envs/lsst-scipipe-3.0.0**

With this software stack, I receive these messages with most/many commands:  
**WARNING: version mismatch between CFITSIO header (v4.000999999999999) and linked library (v4.01)**.

Might there be an off the shelf solution to sync the lib with the cfitsio header? , so I can continue with 3.0.0?

or, should I just ignore the warnings and continue forward.

---

<div class="post-metadata">

**Author:** ![timj](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/timj/32/10_2.png) [@timj](https://www.rubin.community/u/timj)\
**Post date:** [April 18, 2022, 2:59pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/7 "2022-04-18T14:59:07Z")

</div>

> [@fsklich](#):
>
> sync the lib with the cfitsio header?

The versions are synced. The warning message is a bug coming from, we think, the `healpy` package because in v4 cfitsio changed the way it defined floating point versions. You can ignore it.

---

<div class="post-metadata">

**Author:** ![fsklich](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/fsklich/32/1589_2.png) [@fsklich](https://www.rubin.community/u/fsklich)\
**Post date:** [April 24, 2022, 4:23pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/8 "2022-04-24T16:23:57Z")

</div>

I’m working to graph/plot/visualize a **region** , using the **region** column value in the **visit** table. After I decode it using sphgeom.Region.decode(), I get a ConvexPolygon with a long list of UnitVector3d values:  
**ConvexPolygon([UnitVector3d(-0.8637107211893635, 0.5034290256812234, 0.023727751773054258)**, etc…  
With these values is there a convenient means to portray a 3d visualization,perhaps in terms of RA and DEC.  
Just looking for some guidance. **Matplotlib** or **sphgeom.ConvexPolygon** methods?

---

<div class="post-metadata">

**Author:** ![ktl](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ktl/32/1373_2.png) [@ktl](https://www.rubin.community/u/ktl)\
**Post date:** [April 24, 2022, 8:54pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/9 "2022-04-24T20:54:10Z")

</div>

At a low level, you can convert the `UnitVector3d` values from `poly.getVertices()` to RA (longitude) and dec (latitude) using `sphgeom.LonLat.latitudeOf(v).asDegrees()` and `sphgeom.LonLat.longitudeOf(v).asDegrees()` or by constructing `sphgeom.LonLat(v)` and then using `getLongitude().asDegrees()`and `getLatitude().asDegrees()`.

See [LSST Applications: lsst::sphgeom Namespace Reference](http://doxygen.lsst.codes/stack/doxygen/x_mainDoxyDoc/namespacelsst_1_1sphgeom.html) for the C++ documentation that is generally straightforwardly translated into Python.

---

<div class="post-metadata">

**Author:** ![fsklich](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/fsklich/32/1589_2.png) [@fsklich](https://www.rubin.community/u/fsklich)\
**Post date:** [April 25, 2022, 1:57pm UTC](https://www.rubin.community/t/running-latest-pipeline-tutorial-with-current-w-2022-16-w-latest-setup/6487/10 "2022-04-25T13:57:52Z")

</div>

ktl:  
okay, once I convert lat and long to degrees, what method would I use to satisfy my original question…about **graph/plot/visualize**. Or, might you have an example?  
many thanks
