# New advanced command-line tutorial: custom coadd

**URL:** <https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660>\
**Category:** Support\
**Tags:** coadd, announcements, pipetask, dp0\
**Created:** [May 22, 2023, 8:39pm UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660 "2023-05-22T20:39:02Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![ameisner](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ameisner/32/2392_2.png) [@ameisner](https://www.rubin.community/u/ameisner)\
**Post date:** [May 22, 2023, 8:39pm UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/1 "2023-05-22T20:39:02Z")

</div>

We have now added a new command-line tutorial to the DP0.2 website:

[02. Custom Coadds from the Command Line (advanced)](https://dp0-2.lsst.io/tutorials-examples/cmdline-custom-coadd.html)

This new command-line tutorial shows one way of using Rubin/LSST command-line tools (particularly `pipetask`) within the RSP terminal to build the same custom coadd described in [tutorial notebook 9a](https://github.com/rubin-dp0/tutorial-notebooks/blob/main/DP02_09_Custom_Coadds/DP02_09a_Custom_Coadd.ipynb).

Please let me know of any suggestions/questions/feedback. Thanks!

---

<div class="post-metadata">

**Author:** ![ameisner](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ameisner/32/2392_2.png) [@ameisner](https://www.rubin.community/u/ameisner)\
**Post date:** [June 3, 2023, 12:36am UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/2 "2023-06-03T00:36:57Z")

</div>

In case it’s of interest, I’ve also recast this command line tutorial’s custom coadd processing as a single shell script that can be executed from the RSP terminal:

```bash
# make sure that you're in the directory from which you wish to run/launch your
# custom coadd processing

# set up the LSST pipelines environment
setup lsst_distrib

# make the custom coadd QuantumGraph visualization
pipetask build \
-p $DRP_PIPE_DIR/pipelines/LSSTCam-imSim/DRP-test-med-1.yaml#makeWarp,assembleCoadd \
--pipeline-dot pipeline.dot; \
dot pipeline.dot -Tpdf > makeWarpAssembleCoadd.pdf

# remove temporary file
rm pipeline.dot 

# specify the directory for output log files
LOGDIR=logs

# make the directory for output log files
mkdir $LOGDIR

# run the custom coadd processing
LOGFILE=$LOGDIR/makeWarpAssembleCoadd-logfile.log; \
date | tee $LOGFILE; \
pipetask --long-log --log-file $LOGFILE run --register-dataset-types \
-b dp02 \
-i 2.2i/runs/DP0.2 \
-o u/$USER/custom_coadd_window1_cl00 \
-p $DRP_PIPE_DIR/pipelines/LSSTCam-imSim/DRP-test-med-1.yaml#makeWarp,assembleCoadd \
-c makeWarp:doApplyFinalizedPsf=False \
-c makeWarp:connections.visitSummary="visitSummary" \
-d "tract = 4431 AND patch = 17 AND visit in (919515,924057,924085,924086,929477,930353) AND skymap = 'DC2'"; \
date | tee -a $LOGFILE

```

---

<div class="post-metadata">

**Author:** ![ameisner](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ameisner/32/2392_2.png) [@ameisner](https://www.rubin.community/u/ameisner)\
**Post date:** [August 18, 2023, 8:25am UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/3 "2023-08-18T08:25:19Z")

</div>

An updated version of this command line tutorial which avoids POSIX-style interaction with the pipeline YAML definition is now available at the same DP0.2 website URL:

[02. Custom Coadds from the Command Line (advanced)](https://dp0-2.lsst.io/tutorials-examples/cmdline-custom-coadd.html)

---

<div class="post-metadata">

**Author:** ![ameisner](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ameisner/32/2392_2.png) [@ameisner](https://www.rubin.community/u/ameisner)\
**Post date:** [August 30, 2023, 7:03am UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/4 "2023-08-30T07:03:22Z")

</div>

In the GitHub repository for DP0.2 delegate contributions, I have now posted “solutions” to the command line optional exercises from this DP0.2 command line tutorial:

> <https://github.com/rubin-dp0/delegate-contributions-dp02/blob/main/cmdline_custom_coadd/cmdline_solutions.md>

---

<div class="post-metadata">

**Author:** ![ameisner](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ameisner/32/2392_2.png) [@ameisner](https://www.rubin.community/u/ameisner)\
**Post date:** [November 20, 2023, 9:53pm UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/5 "2023-11-20T21:53:28Z")

</div>

Just a quick note to say that we’ve made substantive updates to [DP0.2 tutorial notebook 09b](https://github.com/rubin-dp0/tutorial-notebooks/tree/main/DP02_09_Custom_Coadds), so that it now uses `PipelineTasks`. We also updated [DP0.2 command line tutorial 02](https://dp0-2.lsst.io/tutorials-examples/cmdline-custom-coadd.html) so that it now includes instructions to run source detection on the custom coadd from the command line using` pipetask`. Thanks…

---

<div class="post-metadata">

**Author:** ![alxogm](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/alxogm/32/1751_2.png) [@alxogm](https://www.rubin.community/u/alxogm)\
**Post date:** [March 20, 2025, 5:29pm UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/6 "2025-03-20T17:29:24Z")

</div>

¡Hi! I wonder if there is information regarding when it would be possible to make custom coadd with the current/latest pipeline version instead of using w\_2022\_40? will that pipeline version be usable only with DP1 or will be usable with DP0?

thanks

---

<div class="post-metadata">

**Author:** ![MelissaGraham](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/melissagraham/32/2549_2.png) [@MelissaGraham](https://www.rubin.community/u/MelissaGraham)\
**Post date:** [March 20, 2025, 7:23pm UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/7 "2025-03-20T19:23:29Z")

</div>

Hi @alxogm, thanks for this question.

Due to great evolution and progress in Rubin’s data pipelines and services, the DP0.2-era tutorial notebook on custom coadds (09a/b) is no longer a useful learning tool (version Weekly 2022\_40 will not work with DP1). We’re going to deprecate it (remove it from the set of DP0.2 notebooks). Better, up-to-date examples of image (re)-processing will be released as part of the DP1 tutorial set later this year.

---

<div class="post-metadata">

**Author:** ![alxogm](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/alxogm/32/1751_2.png) [@alxogm](https://www.rubin.community/u/alxogm)\
**Post date:** [March 21, 2025, 3:36pm UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/8 "2025-03-21T15:36:20Z")

</div>

Thanks Melissa! I think part of my question was the other way around, would the new pipeline for re-processing images will work with DP0? If that is the case, is there a way to start using a preliminar version, even if it is under development? I ask about it, because there is some work I’m doing that would benefit to move on the new version if possible.

---

<div class="post-metadata">

**Author:** ![MelissaGraham](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/melissagraham/32/2549_2.png) [@MelissaGraham](https://www.rubin.community/u/MelissaGraham)\
**Post date:** [March 21, 2025, 5:48pm UTC](https://www.rubin.community/t/new-advanced-command-line-tutorial-custom-coadd/7660/9 "2025-03-21T17:48:33Z")

</div>

Thank you for clarifying your question. No, the newest versions of the pipelines will not work for creating custom coadds out of the DP0 processed visit images, which are from older versions of the pipelines. If it was possible we would have updated the DP0 custom coadd tutorial notebooks.
