# FY17 Decommissioning Activities **URL:** \ **Category:** DM Notifications\ **Tags:** dm-infrastructure\ **Created:** [September 9, 2016, 3:21pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141 "2016-09-09T15:21:12Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![jalt](https://avatars.discourse-cdn.com/v4/letter/j/bbce88/32.png) [@jalt](https://www.rubin.community/u/jalt)\ **Post date:** [September 9, 2016, 3:21pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/1 "2016-09-09T15:21:12Z")
During the month of Sept, I am focusing on the planning for procurement activities for the following fiscal year. Those details are unfolding here: [https://confluence.lsstcorp.org/display/DM/DM+FY17+Procurement+Planning](https://confluence.lsstcorp.org/display/DM/DM+FY17+Procurement+Planning). What is probably of particular interest to this audience are the services that are being decommissioned pending any input from the project. The necessity of these services is not clear; they appear to be legacy cruft. NCSA is capable and willing to extend operations of any of these services as necessary given that the need is identified. The most up-to-date version of the list is on the page mentioned above but an initial list is provided below for convenience. Please review and notify me of any concerns. Note that any data sets distributed by discontinued services below may be available via the new /datasets file system. That plan is forthcoming. **Decommissioning Activities** The following hardware is being replaced - lsst10/lsstdb - lsst-dbdev[1-6] The following hardware is being retired - lsst-suidev[1-2] - lsst-stor14[1-4], lsst[13,20] (NFS systems) The following services are being retired - Calypso Data Access - CatSim Documentation Webpages - Database Account Signup (web based) - Database Schema Browser - Google Data Service - Image Retrieval Service ([http://lsst-web.ncsa.illinois.edu/lsstdata](http://lsst-web.ncsa.illinois.edu/lsstdata)) - Referenced from: [http://dev.lsstcorp.org/trac/wiki/W2013WebDataAccess](http://dev.lsstcorp.org/trac/wiki/W2013WebDataAccess) (for the Winter 2013 DC Data Release) - Referenced from [http://dev.lsstcorp.org/trac/wiki/S2012WebDataAccess](http://dev.lsstcorp.org/trac/wiki/S2012WebDataAccess) (for the Summer 2012 DC Data Release) - Panstarrs Data Access - Software Distribution Service [http://sw.lsstcorp.org/pkgshttp://sw.lsstcorp.org/pkgs/std/w12http://sw.lsstcorp.org/eupspkg](http://sw.lsstcorp.org/pkgshttp://sw.lsstcorp.org/pkgs/std/w12http://sw.lsstcorp.org/eupspkg) - web sharing from user home directories - Sim Software Data from [http://lsst-web.ncsa.illinois.edu/sim-data](http://lsst-web.ncsa.illinois.edu/sim-data) - Build Bot Proxy [http://lsst-web.ncsa.illinois.edu/build/http://lsst-web.ncsa.illinois.edu/buildlogs/](http://lsst-web.ncsa.illinois.edu/build/http://lsst-web.ncsa.illinois.edu/buildlogs/) - Pipe QA [http://lsst-web.ncsa.illinois.edu/pipeQAhttp://lsst-web.ncsa.illinois.edu/pipeQA/proto/](http://lsst-web.ncsa.illinois.edu/pipeQAhttp://lsst-web.ncsa.illinois.edu/pipeQA/proto/) - doxygen (Buildbot) [http://lsst-web.ncsa.illinois.edu/doxygen](http://lsst-web.ncsa.illinois.edu/doxygen) - igprof [http://lsst-web.ncsa.illinois.edu/cgi-bin/igprof](http://lsst-web.ncsa.illinois.edu/cgi-bin/igprof) - bandwidthd-kf [http://lsst-web.ncsa.illinois.edu/bandwidthd-kf](http://lsst-web.ncsa.illinois.edu/bandwidthd-kf) ---
**Author:** ![jbosch](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/jbosch/32/12_2.png) [@jbosch](https://www.rubin.community/u/jbosch)\ **Post date:** [September 9, 2016, 4:15pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/2 "2016-09-09T16:15:55Z")
I believe the Software Distribution Service at [http://sw.lsstcorp.org/eupspkg](http://sw.lsstcorp.org/eupspkg) may still be in use. Someone from SQuaRE should confirm or deny this; it’s possible I need to update to a new URL. I’m also not yet aware of a replacement for the Doxygen builds at [http://lsst-web.ncsa.illinois.edu/doxygen](http://lsst-web.ncsa.illinois.edu/doxygen), though I know one is planned and I may have missed an interim update to a new URL here as well. ---
**Author:** ![swinbank](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/swinbank/32/24_2.png) [@swinbank](https://www.rubin.community/u/swinbank)\ **Post date:** [September 9, 2016, 4:36pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/3 "2016-09-09T16:36:03Z")
Confirming that [http://sw.lsstcorp.org/eupspkg](http://sw.lsstcorp.org/eupspkg) is definitely still in active use. ---
**Author:** ![jsick](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/jsick/32/672_2.png) [@jsick](https://www.rubin.community/u/jsick)\ **Post date:** [September 9, 2016, 4:39pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/4 "2016-09-09T16:39:22Z")
> [@jbosch](#): > > I’m also not yet aware of a replacement for the Doxygen builds at [http://lsst-web.ncsa.illinois.edu/doxygen](http://lsst-web.ncsa.illinois.edu/doxygen), though I know one is planned and I may have missed an interim update to a new URL here as well. @jalt what’s your timeline on the retirement of [http://lsst-web.ncsa.illinois.edu/doxygen](http://lsst-web.ncsa.illinois.edu/doxygen) ? The replacement for that service _will_ be [https://pipelines.lsst.io](https://pipelines.lsst.io); I’m just working on the integration of Sphinx into the build process right now. If that doesn’t happen in time, I could work with @josh on modifying our build pipeline to upload the current doxygen builds to LSST the Docs rather than copying files onto lsst-web.ncsa.illinois.edu as we currently do. ---
**Author:** ![ktl](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ktl/32/1373_2.png) [@ktl](https://www.rubin.community/u/ktl)\ **Post date:** [September 9, 2016, 4:41pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/5 "2016-09-09T16:41:28Z")
These absolutely need to be retained: - Database Schema Browser on [http://lsst-web.ncsa.illinois.edu/schema/](http://lsst-web.ncsa.illinois.edu/schema/) - Software Distribution Service on [http://sw.lsstcorp.org/eupspkg](http://sw.lsstcorp.org/eupspkg) - doxygen (Buildbot) on [http://lsst-web.ncsa.illinois.edu/doxygen](http://lsst-web.ncsa.illinois.edu/doxygen) These would be desirable to keep: - web sharing from user home directories - Pipe QA [http://lsst-web.ncsa.illinois.edu/pipeQA](http://lsst-web.ncsa.illinois.edu/pipeQA) [http://lsst-web.ncsa.illinois.edu/pipeQA/proto/](http://lsst-web.ncsa.illinois.edu/pipeQA/proto/) You need to notify the Sims group (not DM) for these: - Sim Software Data from [http://lsst-web.ncsa.illinois.edu/sim-data](http://lsst-web.ncsa.illinois.edu/sim-data) - CatSim Documentation Webpages You need to notify the Calibration and/or Systems Engineering groups (not DM) for this one: - Calypso Data Access ---
**Author:** ![josh](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/josh/32/72_2.png) [@josh](https://www.rubin.community/u/josh)\ **Post date:** [September 9, 2016, 4:45pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/6 "2016-09-09T16:45:32Z")
[http://sw.lsstcorp.org/eupspkg](http://sw.lsstcorp.org/eupspkg) is a critical service. There are rough plans to migrate this to a new canonical URL/backend but this activity is completely unscheduled at this point. ---
**Author:** ![ctslater](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ctslater/32/28_2.png) [@ctslater](https://www.rubin.community/u/ctslater)\ **Post date:** [September 9, 2016, 5:04pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/7 "2016-09-09T17:04:39Z")
It would be unfortunate to lose the webpages served off of user home directories. I use that frequently both for distributing large files and for creating different visualization pages. ---
**Author:** ![KSK](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ksk/32/393_2.png) [@KSK](https://www.rubin.community/u/KSK)\ **Post date:** [September 9, 2016, 5:20pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/8 "2016-09-09T17:20:50Z")
> [@ktl](#): > > These would be desirable to keep: > > web sharing from user home directories > Pipe QA [http://lsst-web.ncsa.illinois.edu/pipeQA](http://lsst-web.ncsa.illinois.edu/pipeQA) [http://lsst-web.ncsa.illinois.edu/pipeQA/proto/](http://lsst-web.ncsa.illinois.edu/pipeQA/proto/) I agree with both @ktl and @ctslater that these would both be very nice to keep. @connolly and @danielsf may have more to say about the sim services. ---
**Author:** ![timj](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/timj/32/10_2.png) [@timj](https://www.rubin.community/u/timj)\ **Post date:** [September 9, 2016, 5:34pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/9 "2016-09-09T17:34:26Z")
> [@jalt](#): > > lsst10/lsstdb Replaced as in the current database on `lsst-db` will still be available on a machine that is still called `lsst-db`? I recently moved all `lsst10` usage in the test suite to `lsst-db`. ---
**Author:** ![danielsf](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/danielsf/32/440_2.png) [@danielsf](https://www.rubin.community/u/danielsf)\ **Post date:** [September 9, 2016, 6:38pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/10 "2016-09-09T18:38:46Z")
Sim Data needs to be kept. That is where we host the data (SED libraries, dust maps) that get installed with the simulations software stack. ---
**Author:** ![danielsf](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/danielsf/32/440_2.png) [@danielsf](https://www.rubin.community/u/danielsf)\ **Post date:** [September 9, 2016, 6:41pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/11 "2016-09-09T18:41:01Z")
If by “CatSim Documentation pages” you mean these confluence pages [https://confluence.lsstcorp.org/display/SIM/Catalog+Simulations+Documentation](https://confluence.lsstcorp.org/display/SIM/Catalog+Simulations+Documentation) I would appreciate keeping them for one more year, until we can replace them with LSST-the-Docs pages containing the same information. Thanks. ---
**Author:** ![timj](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/timj/32/10_2.png) [@timj](https://www.rubin.community/u/timj)\ **Post date:** [September 9, 2016, 6:56pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/12 "2016-09-09T18:56:53Z")
> [@danielsf](#): > > confluence pages This discussion is not about confluence. This is entirely an NCSA activity. ---
**Author:** ![ktl](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/ktl/32/1373_2.png) [@ktl](https://www.rubin.community/u/ktl)\ **Post date:** [September 9, 2016, 7:58pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/13 "2016-09-09T19:58:28Z")
Please note that we should **not** agree to retire a service at NCSA with the expectation that it will be re-hosted at the same (or worse) support level at another institution. If the service provides a function, leaving it at NCSA should be the default. ---
**Author:** ![jalt](https://avatars.discourse-cdn.com/v4/letter/j/bbce88/32.png) [@jalt](https://www.rubin.community/u/jalt)\ **Post date:** [September 10, 2016, 2:28pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/14 "2016-09-10T14:28:44Z")
> [@timj](#): > > Replaced as in the current database on lsst-db will still be available on a machine that is still called lsst-db? I recently moved all lsst10 usage in the test suite to lsst-db. Exactly. There will be new hardware that will be ‘swapped’ in during a maintenance period. Actually it will be far more interesting than a swap because we are changing spindles. So this is an excellent time to speak up if there are new use cases for that node. Currently I am just planning for more cores, ram, spindles. ---
**Author:** ![jalt](https://avatars.discourse-cdn.com/v4/letter/j/bbce88/32.png) [@jalt](https://www.rubin.community/u/jalt)\ **Post date:** [September 12, 2016, 1:43pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/15 "2016-09-12T13:43:21Z")
> [@danielsf](#): > > If by “CatSim Documentation pages” you mean these confluence pages > > [https://confluence.lsstcorp.org/display/SIM/Catalog+Simulations+Documentation](https://confluence.lsstcorp.org/display/SIM/Catalog+Simulations+Documentation) I’m referring to: [http://lsst-web.ncsa.illinois.edu/catsim](http://lsst-web.ncsa.illinois.edu/catsim) which, I believe, points down into /nfs/lsst/public\_html/catsim. ---
**Author:** ![jalt](https://avatars.discourse-cdn.com/v4/letter/j/bbce88/32.png) [@jalt](https://www.rubin.community/u/jalt)\ **Post date:** [September 12, 2016, 1:47pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/16 "2016-09-12T13:47:04Z")
> [@josh](#): > > [http://sw.lsstcorp.org/eupspkg](http://sw.lsstcorp.org/eupspkg) is a critical service. There are rough plans to migrate this to a new canonical URL/backend but this activity is completely unscheduled at this point. Done. What about the other two links: [http://sw.lsstcorp.org/pkgs](http://sw.lsstcorp.org/pkgs) [http://sw.lsstcorp.org/pkgs/std/w12](http://sw.lsstcorp.org/pkgs/std/w12) ---
**Author:** ![mjuric](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/mjuric/32/31_2.png) [@mjuric](https://www.rubin.community/u/mjuric)\ **Post date:** [September 12, 2016, 2:50pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/17 "2016-09-12T14:50:24Z")
Hi Jason, Thanks for tackling this – I wouldn’t be surprised to find things running that were set up in the past decade 🙂 Below are my annotations. I also took a stab at an initial definition of which project role should be the contact point for questions on retirement, changes, or continued maintenance of each service. Hope this helps you with change control going forward. - Database Account Signup (web based) - Is this for accessing the Stripe 82 reprocessed catalog? If so, it will be needed until superseded by the catalog in PDAC. [contact: DMPS] - Database Schema Browser - Needed (critical documentation service) [contact: DB Manager; TCT sign-off needed (critical docs)] - Google Data Service - Not sure what this is? - Image Retrieval Service ([http://lsst-web.ncsa.illinois.edu/lsstdata](http://lsst-web.ncsa.illinois.edu/lsstdata)) - Needed until superseded by the PDAC [contact: DMPS] - Panstarrs Data Access - Not sure what this is? Would ping @price, if it’s about PS1 calibration catalogs. Software Distribution Service - [http://sw.lsstcorp.org/pkgs](http://sw.lsstcorp.org/pkgs) (probably fine to retire) [contact: SQuaRE Manager] - [http://sw.lsstcorp.org/pkgs/std/w12](http://sw.lsstcorp.org/pkgs/std/w12) (probably fine to retire) [contact: SQuaRE Manager] - [http://sw.lsstcorp.org/eupspkg](http://sw.lsstcorp.org/eupspkg) (primary build-from-source distribution service) [contact: SQuaRE Manager; TCT sign-off needed (critical distribution service)] - web sharing from user home directories - Please retain until an equivalent service is offered and/or a transition plan developed (this capability is heavily used by everyone) - Sim Software Data from [http://lsst-web.ncsa.illinois.edu/sim-data](http://lsst-web.ncsa.illinois.edu/sim-data) - Contact sims team (I notice @danielsf has already replied) [contact: Sims Manager] - Build Bot Proxy - [http://lsst-web.ncsa.illinois.edu/build/](http://lsst-web.ncsa.illinois.edu/build/) (don’t know) [contact: SQuaRE Manager] - [http://lsst-web.ncsa.illinois.edu/buildlogs/1](http://lsst-web.ncsa.illinois.edu/buildlogs/1) (don’t know) [contact: SQuaRE Manager] - Pipe QA [http://lsst-web.ncsa.illinois.edu/pipeQA](http://lsst-web.ncsa.illinois.edu/pipeQA) - Retain until superseded by next-gen QA tool [contact: DMPS] - Pipe QA [http://lsst-web.ncsa.illinois.edu/pipeQA/proto/](http://lsst-web.ncsa.illinois.edu/pipeQA/proto/) - Retain until superseded by next-gen QA tool [contact: DMPS] - doxygen (Buildbot) [http://lsst-web.ncsa.illinois.edu/doxygen](http://lsst-web.ncsa.illinois.edu/doxygen) - Retain until superseded by future doc system (critical documentation service) [contact: SQuaRE Manager; TCT sign-off needed (critical docs)] - igprof [http://lsst-web.ncsa.illinois.edu/cgi-bin/igprof](http://lsst-web.ncsa.illinois.edu/cgi-bin/igprof) - Not sure (contact @RHL) - bandwidthd-kf [http://lsst-web.ncsa.illinois.edu/bandwidthd-kf](http://lsst-web.ncsa.illinois.edu/bandwidthd-kf) - Not sure what this is. Current change control process: once you cull the above list based on all comments, issue RFCs for retirement of individual services. The contact points above should sign-off on changes. Full TCT may need to weigh in on some (I tried to annotate those I thought fall into that category). In particular, \*\*\*don’t decommission a service w/o an RFC (our current equivalent of a CAB procedure)\*\*\*. Omnibus RFCs are fine for dealing with multiple services at once. Again, thanks for tackling this! 👍 Hope this helps! ---
**Author:** ![price](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/price/32/488_2.png) [@price](https://www.rubin.community/u/price)\ **Post date:** [September 12, 2016, 3:43pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/18 "2016-09-12T15:43:13Z")
> [@mjuric](#): > > - Panstarrs Data Access > - Not sure what this is? I was thinking it was PS1 images for testing image subtraction. The decision about what to do with it is above my pay grade, but I would suggest that we have better data to test with. ---
**Author:** ![jalt](https://avatars.discourse-cdn.com/v4/letter/j/bbce88/32.png) [@jalt](https://www.rubin.community/u/jalt)\ **Post date:** [September 12, 2016, 3:47pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/19 "2016-09-12T15:47:01Z")
Panstarrs links: [http://lsst-web.ncsa.illinois.edu/panstarrs](http://lsst-web.ncsa.illinois.edu/panstarrs) (/lsst6/panstarrs) I’m compiling an updated list. See the confluence link above for the latest version. Still lots of work to do on this list. I’ll post an update soon. ---
**Author:** ![danielsf](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/danielsf/32/440_2.png) [@danielsf](https://www.rubin.community/u/danielsf)\ **Post date:** [September 12, 2016, 4:27pm UTC](https://www.rubin.community/t/fy17-decommissioning-activities/1141/20 "2016-09-12T16:27:19Z")
Okay. Those are all quite ancient and bound to be out of date. They can go away. [Next page](https://www.rubin.community/t/fy17-decommissioning-activities/1141.md?page=2)