# \#hsc

**URL:** https://www.rubin.community/tag/hsc/61.md

[Latest](https://www.rubin.community/latest.md) · [Categories](https://www.rubin.community/categories.md) · [Tags](https://www.rubin.community/tags.md)

---

## [Setting up REPO for HSC with master calibrations, HSC sky subtraction](https://www.rubin.community/t/setting-up-repo-for-hsc-with-master-calibrations-hsc-sky-subtraction/9909)

<div class="topic-metadata">

**Author:** [@gdb](https://www.rubin.community/u/gdb)\
**Replies:** 4\
**Last updated:** [March 18, 2025, 10:50pm UTC](https://www.rubin.community/t/setting-up-repo-for-hsc-with-master-calibrations-hsc-sky-subtraction/9909 "2025-03-18T22:50:51Z")

</div>

Hello, Is there a detailed tutorial for how to set up and populate a Butler repository for HSC data? I’ve installed v28.0.1 and successfully run the introductory tutorial using the rc2\_subset of HSC data. What I’d lik…

---

## [Issues at BIAS and DARK subtractions with hscPipe 6.7, on private cluster and SMOKA Shot data](https://www.rubin.community/t/issues-at-bias-and-dark-subtractions-with-hscpipe-6-7-on-private-cluster-and-smoka-shot-data/8279)

<div class="topic-metadata">

**Author:** [@luis-suelves](https://www.rubin.community/u/luis-suelves)\
**Replies:** 5\
**Last updated:** [February 15, 2024, 5:47pm UTC](https://www.rubin.community/t/issues-at-bias-and-dark-subtractions-with-hscpipe-6-7-on-private-cluster-and-smoka-shot-data/8279 "2024-02-15T17:47:26Z")

</div>

Hi everyone! This is my first time posting here, and I am on a fairly specific project using old hscPipe 6.7, so I will give a bit of context, then indicate the errors I am getting, and explain what I do not understand…

---

## [PCW 2023 session: Rubin tools applied to DECam (and other precursor data sets)](https://www.rubin.community/t/pcw-2023-session-rubin-tools-applied-to-decam-and-other-precursor-data-sets/7832)

<div class="topic-metadata">

**Author:** [@ameisner](https://www.rubin.community/u/ameisner)\
**Replies:** 1\
**Last updated:** [August 11, 2023, 5:13am UTC](https://www.rubin.community/t/pcw-2023-session-rubin-tools-applied-to-decam-and-other-precursor-data-sets/7832 "2023-08-11T05:13:12Z")

</div>

Hi all, Just wanted to advertise what I think will be a very interesting session during the PCW next week, “Rubin tools applied to DECam (and other precursor data sets)”: This session is scheduled for Thursday 8/10 fro…

---

## [Suggested Breakout Session: Rubin tools applied to DECam and other precursor data sets](https://www.rubin.community/t/suggested-breakout-session-rubin-tools-applied-to-decam-and-other-precursor-data-sets/7650)

<div class="topic-metadata">

**Author:** [@ameisner](https://www.rubin.community/u/ameisner)\
**Replies:** 0\
**Last updated:** [May 19, 2023, 11:27pm UTC](https://www.rubin.community/t/suggested-breakout-session-rubin-tools-applied-to-decam-and-other-precursor-data-sets/7650 "2023-05-19T23:27:56Z")

</div>

Sharing a PCW 2023 breakout session proposal submitted by/with Yuanyuan Zhang (also with @sfu and Tom Matheson): The goal of the proposed session is to discuss the application of Rubin data tools, including the DM pipel…

---

## [Problems flat-fielding short exposures (HSC)](https://www.rubin.community/t/problems-flat-fielding-short-exposures-hsc/7188)

<div class="topic-metadata">

**Author:** [@gdb](https://www.rubin.community/u/gdb)\
**Replies:** 0\
**Last updated:** [November 4, 2022, 5:03pm UTC](https://www.rubin.community/t/problems-flat-fielding-short-exposures-hsc/7188 "2022-11-04T17:03:56Z")

</div>

This is a general question about flat-fielding that I’ve run into while processing HSC data. It may also be relevant to Rubin or other large-format imaging platforms. I’m trying to understand why I get different result…

---

## [Problem Chi2 minimization failure using jointcal.py](https://www.rubin.community/t/problem-chi2-minimization-failure-using-jointcal-py/6085)

<div class="topic-metadata">

**Author:** [@Yuanyu](https://www.rubin.community/u/Yuanyu)\
**Replies:** 3\
**Last updated:** [November 23, 2021, 10:32pm UTC](https://www.rubin.community/t/problem-chi2-minimization-failure-using-jointcal-py/6085 "2021-11-23T22:32:35Z")

</div>

I’m dealing with the data of m31 using the HSC pipeline 8.5.3,when I process jointcal,using the command: jointcal.py /data/HSC/ --calib /data/HSC/CALIB --rerun m31 --id visit=184620..184632:2 ccd=0..8^10..103 erros h…

---

## [Problem using skyCorrection.py and buliding meas\_mosaic](https://www.rubin.community/t/problem-using-skycorrection-py-and-buliding-meas-mosaic/6057)

<div class="topic-metadata">

**Author:** [@Yuanyu](https://www.rubin.community/u/Yuanyu)\
**Replies:** 4\
**Last updated:** [November 9, 2021, 5:20pm UTC](https://www.rubin.community/t/problem-using-skycorrection-py-and-buliding-meas-mosaic/6057 "2021-11-09T17:20:47Z")

</div>

Hi,all. I’m processing hsc data using the hscpipe8.5.3 in centos 7.9,and i have some questions, first,when I processed skyCorrection.py,warning like: raise RuntimeError("Failed to format %r with data %r: %s" % (templ…

---

## [Image difference with different filters (HSC-R and R2)](https://www.rubin.community/t/image-difference-with-different-filters-hsc-r-and-r2/4354)

<div class="topic-metadata">

**Author:** [@racine](https://www.rubin.community/u/racine)\
**Replies:** 7\
**Last updated:** [November 16, 2020, 4:12pm UTC](https://www.rubin.community/t/image-difference-with-different-filters-hsc-r-and-r2/4354 "2020-11-16T16:12:23Z")

</div>

Hi all, We are having an issue to perform difference imaging with HSC R and R2 bands. We are trying to look at transients in the 2016-2017 period, and we ideally want to form a template with good seeing pre-dating thes…

---

## [How to use ImageDifference.py](https://www.rubin.community/t/how-to-use-imagedifference-py/4103)

<div class="topic-metadata">

**Author:** [@Vincenzo](https://www.rubin.community/u/Vincenzo)\
**Replies:** 8\
**Last updated:** [June 12, 2020, 3:36pm UTC](https://www.rubin.community/t/how-to-use-imagedifference-py/4103 "2020-06-12T15:36:51Z")

</div>

Hi, I’m trying to learn how to use the lsst.ip.diffim module for astronomical image differencing. In particular, I’m interested in the difference between calibrated exposures. To test the package, I used the sample of th…

---

## [HSC images ingestion for image differencing](https://www.rubin.community/t/hsc-images-ingestion-for-image-differencing/4187)

<div class="topic-metadata">

**Author:** [@Vincenzo](https://www.rubin.community/u/Vincenzo)\
**Replies:** 5\
**Last updated:** [June 10, 2020, 8:38pm UTC](https://www.rubin.community/t/hsc-images-ingestion-for-image-differencing/4187 "2020-06-10T20:38:43Z")

</div>

Hi community, I was trying to run the image differencing on two downloaded HSC images of the same field, but I have a problem with the ingestion. I put the files into a test directory, with the images into a img folder…

---

## [Error in task constructBias.py with HSC pipeline version 7.9.1](https://www.rubin.community/t/error-in-task-constructbias-py-with-hsc-pipeline-version-7-9-1/4068)

<div class="topic-metadata">

**Author:** [@astroswag](https://www.rubin.community/u/astroswag)\
**Replies:** 2\
**Last updated:** [March 18, 2020, 3:28pm UTC](https://www.rubin.community/t/error-in-task-constructbias-py-with-hsc-pipeline-version-7-9-1/4068 "2020-03-18T15:28:36Z")

</div>

I have installed the HSC pipeline version 7.9.1 following the download and installation page (https://hsc.mtk.nao.ac.jp/pipedoc/pipedoc\_7\_e/install\_env\_e/install.html#install). Installation is fine and then I run the bas…

---

## [Astrometry near the galactic plane](https://www.rubin.community/t/astrometry-near-the-galactic-plane/3753)

<div class="topic-metadata">

**Author:** [@surhudm](https://www.rubin.community/u/surhudm)\
**Replies:** 1\
**Last updated:** [July 5, 2019, 5:13am UTC](https://www.rubin.community/t/astrometry-near-the-galactic-plane/3753 "2019-07-05T05:13:45Z")

</div>

I am trying to reduce a field taken with Subaru HSC which is near the galactic plane with hscPipe 6.7. When running processCcd, the astrometric solution found by the calibrate task is off, which then creates further prob…

---

## [Making detrending data for HSC](https://www.rubin.community/t/making-detrending-data-for-hsc/3740)

<div class="topic-metadata">

**Author:** [@surhudm](https://www.rubin.community/u/surhudm)\
**Replies:** 9\
**Last updated:** [June 19, 2019, 3:18am UTC](https://www.rubin.community/t/making-detrending-data-for-hsc/3740 "2019-06-19T03:18:19Z")

</div>

Is there a tutorial which I can access to make detrending data for HSC. The ci\_hsc package directly has all the calibration files already created and the “Getting started” page directly links those calibrations instead o…

---

## [HSC defaults now require sky correction](https://www.rubin.community/t/hsc-defaults-now-require-sky-correction/2631)

<div class="topic-metadata">

**Author:** [@price](https://www.rubin.community/u/price)\
**Replies:** 0\
**Last updated:** [January 30, 2018, 4:05pm UTC](https://www.rubin.community/t/hsc-defaults-now-require-sky-correction/2631 "2018-01-30T16:05:03Z")

</div>

Following the merge of DM-13388, the visit-level sky subtraction introduced in DM-9147 is now required by default for warping HSC data. This means that if you are processing HSC with an LSST-DM stack version after w\_2018…

---

## [Mosaic.py ValueError: math domain error / ZeroDivisionError: float division by zero](https://www.rubin.community/t/mosaic-py-valueerror-math-domain-error-zerodivisionerror-float-division-by-zero/2768)

<div class="topic-metadata">

**Author:** [@desprezg](https://www.rubin.community/u/desprezg)\
**Replies:** 5\
**Last updated:** [March 16, 2018, 3:06pm UTC](https://www.rubin.community/t/mosaic-py-valueerror-math-domain-error-zerodivisionerror-float-division-by-zero/2768 "2018-03-16T15:06:18Z")

</div>

Hello, I am running the hscPipe6.0 on HSC data. While mosaicking the data, I have come across these errors : $ mosaic.py . --rerun mosaic --id filter=HSC-I tract=9813 Mosaic INFO: Write Fcr ... Traceback (most recent …

---

## [PSFex fails in singleFrameDriver.py for some CCDs](https://www.rubin.community/t/psfex-fails-in-singleframedriver-py-for-some-ccds/2691)

<div class="topic-metadata">

**Author:** [@mmontes](https://www.rubin.community/u/mmontes)\
**Replies:** 20\
**Last updated:** [March 8, 2018, 9:54pm UTC](https://www.rubin.community/t/psfex-fails-in-singleframedriver-py-for-some-ccds/2691 "2018-03-08T21:54:22Z")

</div>

Hi, When I run singleFrameDriver.py there are some of the CCDs that are not processed. This is the error that it gives me: 9583 FATAL 2018-02-19T12:15:37.795+1100 singleFrameDriver: Failed on dataId={'taiObs': '2014-09…

---

## [constructBias.py raise NoResults error](https://www.rubin.community/t/constructbias-py-raise-noresults-error/2735)

<div class="topic-metadata">

**Author:** [@desprezg](https://www.rubin.community/u/desprezg)\
**Replies:** 6\
**Last updated:** [March 7, 2018, 6:09pm UTC](https://www.rubin.community/t/constructbias-py-raise-noresults-error/2735 "2018-03-07T18:09:10Z")

</div>

Hello, I am running the detrending on HSC data following the HSC pipeline tutorial (http://hsc.mtk.nao.ac.jp/pipedoc\_5\_e/tutorial\_e/index.html#) and I get stuck in the processing of the bias. I am running : constructBi…

---

## [TypeError: runDetection() missing 1 required positional argument: 'expId'](https://www.rubin.community/t/typeerror-rundetection-missing-1-required-positional-argument-expid/2736)

<div class="topic-metadata">

**Author:** [@rkotulla](https://www.rubin.community/u/rkotulla)\
**Replies:** 7\
**Last updated:** [March 6, 2018, 8:07pm UTC](https://www.rubin.community/t/typeerror-rundetection-missing-1-required-positional-argument-expid/2736 "2018-03-06T20:07:59Z")

</div>

Hi, I’m trying to stack some HSC data using the LSST stack, and while running coaddDriver get lots of repeated errors like this: 142540 INFO 2018-03-05T18:29:41.167-0600 coaddDriver: trantor:142540: Start detection on…

---

## [TransmissionCurves for HSC](https://www.rubin.community/t/transmissioncurves-for-hsc/2632)

<div class="topic-metadata">

**Author:** [@jbosch](https://www.rubin.community/u/jbosch)\
**Replies:** 3\
**Last updated:** [January 31, 2018, 12:16am UTC](https://www.rubin.community/t/transmissioncurves-for-hsc/2632 "2018-01-31T00:16:03Z")

</div>

With the merge of DM-13389, HSC’s ISR will by default load various transmission curve datasets from the input data repository, combine them, and attach them to the postISRCCD (and subsequently calexp, etc). For this to …

---

## [Turn off sky substraction in HSC pipeline](https://www.rubin.community/t/turn-off-sky-substraction-in-hsc-pipeline/2542)

<div class="topic-metadata">

**Author:** [@mmontes](https://www.rubin.community/u/mmontes)\
**Replies:** 5\
**Last updated:** [January 8, 2018, 1:33am UTC](https://www.rubin.community/t/turn-off-sky-substraction-in-hsc-pipeline/2542 "2018-01-08T01:33:24Z")

</div>

Hi, I am re-reducing some archive images from HSC (using pipeline v5.4). Because of the kind of science I am doing, I need to do a different kind of image processing. For that, I need to deactivate the background correc…

---

## [Y-band stray light correction for HSC](https://www.rubin.community/t/y-band-stray-light-correction-for-hsc/2517)

<div class="topic-metadata">

**Author:** [@price](https://www.rubin.community/u/price)\
**Replies:** 0\
**Last updated:** [December 19, 2017, 3:55am UTC](https://www.rubin.community/t/y-band-stray-light-correction-for-hsc/2517 "2017-12-19T03:55:16Z")

</div>

HSC has had some features known as “The Eye of Y” in the y-band images due to LEDs used in the instrument encoders. DM-12979 introduces some code to remove these features. Open-shutter darks were taken one cloudy night, …

---

## ["No mapper" error when re-running coaddDriver](https://www.rubin.community/t/no-mapper-error-when-re-running-coadddriver/2216)

<div class="topic-metadata">

**Author:** [@gdb](https://www.rubin.community/u/gdb)\
**Replies:** 5\
**Last updated:** [August 31, 2017, 8:44pm UTC](https://www.rubin.community/t/no-mapper-error-when-re-running-coadddriver/2216 "2017-08-31T20:44:04Z")

</div>

I am working on mutli-band HSC data and attempting to re-run coaddDriver after a crash due to a lack of disk space. I've defined the mapper following the processing tutorial (https://dmtn-023.lsst.io/), but I'm getting …

---

## [Running the stack on HSC data for a DESC PSF project](https://www.rubin.community/t/running-the-stack-on-hsc-data-for-a-desc-psf-project/964)

<div class="topic-metadata">

**Author:** [@joezuntz](https://www.rubin.community/u/joezuntz)\
**Replies:** 46\
**Last updated:** [August 3, 2017, 12:55am UTC](https://www.rubin.community/t/running-the-stack-on-hsc-data-for-a-desc-psf-project/964 "2017-08-03T00:55:12Z")

</div>

Hi all, For a DESC project on PSF requirements we have obtained some HSC data of a star field and will be measuring PSF fields on it. Ideally we'd like to do this using (parts of) the DM stack. This topic is to docu…

---

## [ConstructDark.py raises AttributeError](https://www.rubin.community/t/constructdark-py-raises-attributeerror/2074)

<div class="topic-metadata">

**Author:** [@Vera](https://www.rubin.community/u/Vera)\
**Replies:** 3\
**Last updated:** [July 12, 2017, 9:27pm UTC](https://www.rubin.community/t/constructdark-py-raises-attributeerror/2074 "2017-07-12T21:27:42Z")

</div>

Hello, I am quite new here in this community and please forgive my ignorance. I am running the processing on HSC data. As I tried to construct the calibration file just as what show here: http://www.rubin.community/…

---

## [hscPipe 5.0 plans](https://www.rubin.community/t/hscpipe-5-0-plans/1738)

<div class="topic-metadata">

**Author:** [@price](https://www.rubin.community/u/price)\
**Replies:** 0\
**Last updated:** [March 22, 2017, 5:06pm UTC](https://www.rubin.community/t/hscpipe-5-0-plans/1738 "2017-03-22T17:06:19Z")

</div>

hscPipe is a version of the LSST pipeline tailored for supporting the Hyper Suprime-Cam Strategic Survey Program (HSC SSP). We are currently planning for the next major release, hscPipe 5.0, which we're hoping to have d…

---

## [HSC Survey public data release 1](https://www.rubin.community/t/hsc-survey-public-data-release-1/1682)

<div class="topic-metadata">

**Author:** [@price](https://www.rubin.community/u/price)\
**Replies:** 1\
**Last updated:** [March 1, 2017, 2:33am UTC](https://www.rubin.community/t/hsc-survey-public-data-release-1/1682 "2017-03-01T02:33:46Z")

</div>

Masayuki Tanaka (NAOJ) writes: The first public data release of HSC-SSP occurred today! The data release site is now fully functional and people started to access the website. This is a major milestone of the surve…

---

## [New argument parser behavior (rerun flag introduction) discussion](https://www.rubin.community/t/new-argument-parser-behavior-rerun-flag-introduction-discussion/345)

<div class="topic-metadata">

**Author:** [@natelust](https://www.rubin.community/u/natelust)\
**Replies:** 4\
**Last updated:** [March 11, 2016, 6:33pm UTC](https://www.rubin.community/t/new-argument-parser-behavior-rerun-flag-introduction-discussion/345 "2016-03-11T18:33:51Z")

</div>

All, I am in the process of porting the rerun argument parser flag from HSC. (See RFC-95 and DM-3371) and just noticed some behavior that I don't feel was clearly addressed in the RFC. Currently in LSST if you specify an…
