# How should we store 100 GB + data sets? Is git-lfs still the answer?

**URL:** <https://www.rubin.community/t/how-should-we-store-100-gb-data-sets-is-git-lfs-still-the-answer/724>\
**Category:** Data Management\
**Created:** [April 27, 2016, 2:12pm UTC](https://www.rubin.community/t/how-should-we-store-100-gb-data-sets-is-git-lfs-still-the-answer/724 "2016-04-27T14:12:18Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![benepo](https://sea2.discourse-cdn.com/flex002/user_avatar/www.rubin.community/benepo/32/248_2.png) [@benepo](https://www.rubin.community/u/benepo)\
**Post date:** [April 28, 2016, 1:03am UTC](https://www.rubin.community/t/how-should-we-store-100-gb-data-sets-is-git-lfs-still-the-answer/724/2 "2016-04-28T01:03:05Z")

</div>

This may not be applicable in this context, but [https://google.github.io/flatbuffers/](https://google.github.io/flatbuffers/) looks interesting from an efficient data storage and access standpoint.

---

_[View the full topic](https://www.rubin.community/t/how-should-we-store-100-gb-data-sets-is-git-lfs-still-the-answer/724)._