# Is the pipeline Dockerfile available?

**URL:** <https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723>\
**Category:** Support\
**Created:** [July 26, 2021, 7:27pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723 "2021-07-26T19:27:22Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![dstn](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/dstn/32/1695_2.png) [@dstn](https://www.rubin.community/u/dstn)\
**Post date:** [July 26, 2021, 7:27pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/1 "2021-07-26T19:27:23Z")

</div>

Hi,

I’m looking at the Docker images available here,  
[lsstsqre/centos - Docker Image](https://hub.docker.com/r/lsstsqre/centos)

but since I want to use LSST software along with other software, I want to add LSST to my existing Docker image, not start from scratch.

I tried building from a Debian-based Docker image, and the newinstall.sh script reports an error:

> prefix: /opt/conda/envs/lsst-scipipe-0.6.0  
> ./newinstall.sh: line 265: /etc/redhat-release: No such file or directory  
> Configured EUPS\_PKGROOT: [Index of stack/src/](https://eups.lsst.codes/stack/src)  
> Creating startup scripts (bash) … done.

It does seem to finish installing, but at the end it prints:

> and feel free to ask any questions via the LSST Community forum:  
> [Support - Rubin Observatory LSST Community forum](http://www.rubin.community/c/support)  
> Thanks!  
> – The LSST Software Teams

and just stalls – that step of my Docker build never completes.

I’m just doing

```auto
RUN curl -OL https://raw.githubusercontent.com/lsst/lsst/master/scripts/newinstall.sh
RUN chmod 755 newinstall.sh
RUN ./newinstall.sh -b -t -P /opt/conda

```

Any tips would be welcome!  
thanks,  
–dustin

---

<div class="post-metadata">

**Author:** ![ktl](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ktl/32/1373_2.png) [@ktl](https://www.rubin.community/u/ktl)\
**Post date:** [July 26, 2021, 7:50pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/2 "2021-07-26T19:50:03Z")

</div>

Sounds like you are looking for a combination of [docker-scipipe/Dockerfile at master · lsst-dm/docker-scipipe · GitHub](https://github.com/lsst-dm/docker-scipipe/blob/master/base-7/Dockerfile), [docker-newinstall/Dockerfile at master · lsst-sqre/docker-newinstall · GitHub](https://github.com/lsst-sqre/docker-newinstall/blob/master/Dockerfile) (with `BASE_IMAGE` overridden to refer to the output of the previous), and [docker-tarballs/Dockerfile at master · lsst-sqre/docker-tarballs · GitHub](https://github.com/lsst-sqre/docker-tarballs/blob/master/Dockerfile).

The error about `redhat-release` should not matter. I will remove that in the future.

I’m not sure why your last `RUN` step is not terminating. The newinstall.sh script should just exit (fall off the end) after printing the welcome message.

---

<div class="post-metadata">

**Author:** ![dstn](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/dstn/32/1695_2.png) [@dstn](https://www.rubin.community/u/dstn)\
**Post date:** [July 26, 2021, 8:20pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/3 "2021-07-26T20:20:49Z")

</div>

Thanks, K-T!

Weirdly, when I went to “docker build” again, it acted as though it _did_ finish – it said “using cache” and continued to the next line of my Dockerfile. So I don’t know what was going on there; maybe operator error!

---

<div class="post-metadata">

**Author:** ![dstn](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/dstn/32/1695_2.png) [@dstn](https://www.rubin.community/u/dstn)\
**Post date:** [July 26, 2021, 8:22pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/4 "2021-07-26T20:22:48Z")

</div>

All the subdirectories in [Index of /stack/src](https://eups.lsst.codes/stack/src) are 404 !

---

<div class="post-metadata">

**Author:** ![dstn](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/dstn/32/1695_2.png) [@dstn](https://www.rubin.community/u/dstn)\
**Post date:** [July 26, 2021, 8:32pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/5 "2021-07-26T20:32:53Z")

</div>

Also, is it possible to install a smaller subset of packages, like say I only need to be able to read afwImage.Exposure(‘filename.fits’), is there a way I can get just afw and its dependencies? eg something smaller than “lsst\_distrib” in  
eups distrib install -t v22\_0\_0 lsst\_distrib  
?

---

<div class="post-metadata">

**Author:** ![ktl](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ktl/32/1373_2.png) [@ktl](https://www.rubin.community/u/ktl)\
**Post date:** [July 26, 2021, 8:54pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/6 "2021-07-26T20:54:39Z")

</div>

> [@dstn](#):
>
> All the subdirectories in [Index of /stack/src](https://eups.lsst.codes/stack/src) are 404 !

This is because the bucket-to-Web-site translator is very picky about trailing slashes. I think you will find it all works if you go to [https://eups.lsst.codes/stack/src/](https://eups.lsst.codes/stack/src) instead.

---

<div class="post-metadata">

**Author:** ![ktl](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ktl/32/1373_2.png) [@ktl](https://www.rubin.community/u/ktl)\
**Post date:** [July 26, 2021, 8:56pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/7 "2021-07-26T20:56:09Z")

</div>

> [@dstn](#):
>
> something smaller than “lsst\_distrib” in  
> eups distrib install -t v22\_0\_0 lsst\_distrib

You can definitely do `eups distrib install -t v22_0_1 afw`. (Note that v22.0.1 is slightly preferred; it has fixes for macOS but should be identical to v22.0.0 for Linux, as you’re using.)

---

<div class="post-metadata">

**Author:** ![price](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/price/32/488_2.png) [@price](https://www.rubin.community/u/price)\
**Post date:** [July 26, 2021, 9:07pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/8 "2021-07-26T21:07:04Z")

</div>

[Here](https://github.com/Subaru-PFS/pfs_pipe2d/blob/master/docker/Dockerfile.lsst) is a `Dockerfile` that builds LSST 18.1.0 (actually, just up to pipe\_drivers) using a [script](https://github.com/Subaru-PFS/pfs_pipe2d/blob/master/bin/install_lsst.sh). LSST 18 is rather old these days (22.0.1 was just recently released), but I mention it since you might be able to upgrade it quickly.

---

<div class="post-metadata">

**Author:** ![dstn](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/dstn/32/1695_2.png) [@dstn](https://www.rubin.community/u/dstn)\
**Post date:** [July 27, 2021, 10:34am UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/9 "2021-07-27T10:34:34Z")

</div>

That makes exploring it in the browser very tedious!

---

<div class="post-metadata">

**Author:** ![dstn](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/dstn/32/1695_2.png) [@dstn](https://www.rubin.community/u/dstn)\
**Post date:** [July 27, 2021, 10:36am UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/10 "2021-07-27T10:36:03Z")

</div>

Thank you very much, Paul & K-T!

---

<div class="post-metadata">

**Author:** ![dstn](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/dstn/32/1695_2.png) [@dstn](https://www.rubin.community/u/dstn)\
**Post date:** [July 27, 2021, 12:31pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/11 "2021-07-27T12:31:17Z")

</div>

> [@ktl](#):
>
> v22\_0\_1

Is there an easy way to find out which products & tags exist?

---

<div class="post-metadata">

**Author:** ![ktl](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ktl/32/1373_2.png) [@ktl](https://www.rubin.community/u/ktl)\
**Post date:** [July 27, 2021, 1:42pm UTC](https://www.rubin.community/t/is-the-pipeline-dockerfile-available/5723/12 "2021-07-27T13:42:27Z")

</div>

> [@dstn](#):
>
> Is there an easy way to find out which products & tags exist?

Tags: [https://eups.lsst.codes/stack/src/tags/](https://eups.lsst.codes/stack/src/tags/) (with trailing slash) or [Tags · lsst/lsst\_distrib · GitHub](https://github.com/lsst/lsst_distrib/tags) with “`.`” (for git) translated to “`_`” (for eups).  
Products: first column of the desired tag file at the first link above.
