BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//wp-events-plugin.com//7.4.3//EN
TZID:America/Chicago
X-WR-TIMEZONE:America/Chicago
BEGIN:VEVENT
UID:18@hpc-ai-society.org
DTSTART;TZID=America/Chicago:20220224T120000
DTEND;TZID=America/Chicago:20220224T130000
DTSTAMP:20231101T202835Z
URL:https://hpc-ai-society.org/Events/shpcp-february-lunch-learn-2/
SUMMARY:SHPCP February Lunch & Learn
DESCRIPTION:\n\nThe Society of HPC Professionals lunch and learn event\n&nb
 sp\;\n\n\n\n\n\nLunch &amp\; Learn – February 2022\nServing and Managing
  Reproducible HPC Environments via Conda-Store\nChris Ostrouchov\, Quansig
 ht\n24 February 2022 | Live stream\nDownload presentations and/or watch v
 ideos\n[membership level="1\,2" show_noaccess="true"]\n\n  Watch video\n
   Download presentation\n[/membership]\n\n&nbsp\;\n\n\n\nAbout the Event\
 nWhen working within teams and organizations managing and keeping track of
  the software packages used in a workflow or project can be very important
 . In HPC environments this used to be relatively straightforward\, the adm
 inistrators packaged a set of available software packages and compilers an
 d provided a mechanism (i.e. module load etc) for end users to load those 
 packages in a convenient manner. Unfortunately\, with the rise of the mode
 rn scientific software ecosystem the sheer variety of packages available a
 nd the speed at which those packages get updated makes it impractical for 
 a centralized administration paradigm to keep up. On the flip side\, often
  end users install packages in an ad-hoc manner making reproducibility and
  collaboration near impossible.\n\nConda-Store provides a way for end user
 s to quickly create and modify environments while at the same time capturi
 ng those environments in a reproducible manner that can be shared within t
 eams and managed by IT. We will walk through the architecture of Conda-Sto
 re and show how it balances the three corners of the IT  / User / Reprodu
 cibility triangle. Conda-Store packages a given environment in many format
 s including filesystem\, lockfiles\, tarballs\, and docker images. This wo
 uld enable nodes within a compute cluster to download tarballs of the envi
 ronment to avoid a common issue in HPC distributed file systems being over
 loaded by small file accesses. In the future there are plans for Conda-Sto
 re to additionally serve singularity containers of environments. We will a
 lso briefly demonstrate Conda-Store via QHub-HPC\, a lightweight way to de
 ploy a small slurm based HPC cluster in the cloud or on bare-metal with Ju
 pyterHub\, Dask\, Dashboard sharing\, monitoring\, flexible authentication
 \, and many other features integrated. Related to QHub-HPC we would like t
 o show how using jupyterhub and jupyterhub-ssh can remove the need for a u
 ser login node and ensure that all users are launched inside of dedicated 
 Slurm allocations.\n\n[1] https://conda-store.readthedocs.io/en/latest/\n[
 2] https://github.com/Quansight/qhub-hpc\n\nAbout the Speaker\nChristopher
  Ostrouchov\, Ph.D.\nSenior Software Architect at Quansight\n\n\nChris is 
 a scientific software architect at Quansight and the technical lead on QHu
 b and Conda-Store.  He is passionate about numerical computing\, reproduc
 ibility\, and making open source sustainable. He is a contributor to open 
 source software in the pydata ecosystem mainly around JupyterHub\, Dask\, 
 and NixOS.\n\nChris earned his Ph.D. in Computational Material Science and
  Engineering from the University of Tennessee\, Knoxville\, including a Ch
 ancellor's Fellowship scholarship\, and a BS in Computational and Applied 
 Mathematics from Clemson University. In his spare time he enjoys running a
 nd contributing to reproducible software via nixpkgs and nixos..\n\n\n\n\n
 \nA reminder email with Zoom join info will be sent the day prior to the m
 eeting to all registrants.\nNote: please check your spam folder if you don
 't see it and consider adding the domain hpc-ai-society.org to your approv
 ed list.\nMembers: remember to login to see your free ticket option.\nNote
 : if you see a message to renew\, we have seen a glitch on some browsers. 
 Click the renew link\, which will take you to your account page\, where yo
 u will see if you are current. If you are\, simply navigate again to the e
 vent page and you should see your free ticket option.\n&nbsp\;
END:VEVENT
BEGIN:VTIMEZONE
TZID:America/Chicago
X-LIC-LOCATION:America/Chicago
BEGIN:STANDARD
DTSTART:20211107T010000
TZOFFSETFROM:-0500
TZOFFSETTO:-0600
TZNAME:CST
END:STANDARD
END:VTIMEZONE
END:VCALENDAR