Satori Quick Start Info

Welcome to the Getting Started guide for satori.mit.edu. Satori is an IBM Power9 cluster designed for combined simulation and machine learning intensive research work.

• Satori Basics
  • What is Satori?
  • How can I get an account?
  • Getting help?
• Satori Login
  • Web Portal Login
  • SSH Login
• Satori Portal
  • [1] Accessing the Portal
  • [2] Using the Portal
  • [3] Using Jupyter Notebooks
  • [4] Viewing and Accessing Notebooks
• Starting up on Satori
  • Getting Your Account
  • Shared HPC Clusters
  • Logging in to Satori
  • The Satori Portal
  • Setting up Your Environment
  • Transferring Files
  • Types of Jobs
  • Project Groups
• Using Anaconda on Satori
  • [1] Using Anaconda
  • [2] Creating and activating conda environments
  • [3] Setting up conda channels
  • [4] Searching for and installing conda packages
  • [5] Listing the contents of your conda environment
  • [6] Leaving your conda environment
• Training for faster onboarding in the system HW and SW architecture
• Running your AI training jobs on Satori using Slurm
  • A Note on Exclusivity
  • Interactive Jobs
  • Batch Scripts
• Troubleshooting
• IBM Watson Machine Learning Community Edition (WML-CE) and Open Cognitive Environment (Open-CE)
  • [1] Install Anaconda
  • [2] WML-CE and Open-CE: Setting up the software repository
  • [3] WML-CE and Open-CE: Creating and activate conda environments (recommended)
  • [4] WML-CE: Installing all frameworks at the same time
  • [5] WML-CE: Testing ML/DL frameworks (Pytorch, TensorFlow etc) installation
  • The WML CE Supplementary channel is available at: https://anaconda.org/powerai/.
  • The WML-CE Early Access channel is available at: https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access/.
• Distributed Deep Learning
• IBM Large Model Support (LMS)
• Julia on Satori
  • Getting started
  • Getting help?
  • A simple batch script example
  • Recipe for running single GPU, single threaded interactive session with CUDA aware MPI
  • Running a multi-process julia program somewhat interactively
  • An example of installing https://github.com/clima/climatemachine.jl on Satori
• R on Satori
  • Getting Started with R
  • Installing Packages
  • A Simple Batch Script Example
  • R and Python
  • Running R in a container
• Using MPI and CUDA on Satori
  • Getting started
  • Compiling
  • Submiting a batch script
  • A complete example SLURM batch script
  • Using alternate MPI builds
• Satori Public Datasets
• Example machine learning LSF jobs
  • A single node, 4 GPU Keras example
  • A single node, 4 GPU Caffe example
  • A multi-node, pytorch example
  • A multi-node, pytorch example with the horovod conda environment
• Satori Howto Video Sessions
  • Installing WMCLE on Satori
  • Pytorch with DDL on Satori
  • Tensorflow with DDL on Satori
  • Jupyterlab with SSH Tunnel on Satori
• Satori Public Datasets
• Singularity for Satorians
  • Fast start
  • Other notes
  • Interactive Allocation:
  • Non interactive / batch mode
• Relion Cryoem for Satorians
  • Prerequisites
  • Quick start
  • Other notes
• Copying larger files and large file sets
• Using mrsync
• Using Aspera for remote file transfer to Satori cluster
• FAQ
  • Tips, tricks and questions
• Green Up Hackathon IAP 2020
  • Tutorial Examples
  • Measuring Resource Use
• Getting help on Satori
  • Email help
  • Slack
  • Slack or orcd-help-satori@mit.edu
  • Tips and Tricks
• Acceptable Use and Code of Conduct
  • Acceptable Use Guidelines
  • Code of Conduct

You don’t find what you where looking for?

have a look to conda cheet sheet and WMLCE extended documentation here or ask for help at orcd-help-satori@mit.edu.