NCAR HPC Documentation

Common causes of job failures

Initializing search

NCAR HPC Documentation

Home
Getting Started
Getting Started
- User Responsibilities
- Accounts
  Accounts
  - CIT Passwords
  - Duo Two-Factor Authentication
    
    Duo Two-Factor Authentication
    
    Enrolling with Duo
  - SAM
- Allocations
  Allocations
  - Managing Your Allocation
  - NCAR Allocations
    
    NCAR Allocations
    
    NCAR Strategic Capability (NSC) projects
  - University Allocations
    
    University Allocations
    
    University Large Allocation Request Preparation Instructions
  - Determining computational resource needs
  - CISL HPC Allocations Panel
    
    CISL HPC Allocations Panel
    
    Allocation Review Criteria
    
    Conflict of Interest Policy
- VPN access
- System Usage Policies
- Data Retention Policies
- Best Practices for Supercomputer Users
- Acknowledging NCAR and CISL
Storage Systems and Data Transfer
Storage Systems and Data Transfer
- GLADE (POSIX File Systems)
  GLADE (POSIX File Systems)
- Quasar (Tape Storgae)
  Quasar (Tape Storgae)
  - Quasar system specifications
- Stratus (Object Storage)
- Data Access Nodes
- Transferring Data
  Transferring Data
  - Globus
    
    Globus
    
    Sharing data and making unattended transfers
  - SCP, SFTP and other tools
- CMIP Analysis Platform
User Environment and HPC Software
User Environment and HPC Software
- User Environment
  User Environment
  - Modules
  - Conda
  - Containers
    
    Containers
    
    Working with Containers
    
    Example Workflows
  - Utilities
  - Customizing User Environment
  - Spack
- HPC Software
  HPC Software
  - Community Models
  - Data Analysis and Visualization
  - NCL
  - MATLAB Parallel Computing Toolbox
  - Numerical Libraries
  - Machine Learning and Deep Learning
  - NCAR Classic Libraries for Geophysics
  - Profiling & Debuggers
    Profiling & Debuggers
    
    Debugging and Profiling with Forge Tools
    
    Intel Parallel Studio XE
  - Benchmarks
    
    Benchmarks
    
    NCAR Benchmarking applications - 2015 release
    
    NCAR Benchmarking applications - 2019-2020 release
Compute Systems and Services
Compute Systems and Services
- Derecho
  Derecho
  - Derecho Use Policies
  - Compiling Code on Derecho
  - Starting Derecho Jobs
    
    Starting Derecho Jobs
    
    Derecho Job Script Examples
    Derecho Job Script Examples
    
    Derecho batch job script examples
    
    Process Binding
  - Derecho Software
  - Moving to Derecho from Cheyenne
- Casper
  Casper
  - Casper Use Policies
  - Compiling Code on Casper
  - Starting Casper Jobs
    
    Starting Casper Jobs
    
    Casper job Script Examples
  - Using Remote Desktops
  - Casper Software
- JupyterHub
  JupyterHub
  - Jupyter and IPython
- Additional Resources
  Additional Resources
  - Cron services
  - Thunder test system
Running Jobs (PBS)
Running Jobs (PBS)
- Job Scripts
  Job Scripts
- Queues and Charging
- Using Preemption
- Common Causes of Job Failures
  Common Causes of Job Failures
  - Checking Memory Use
    
    Checking Memory Use
- Storing temporary files
Tutorials
Tutorials
User Support
User Support
- Troubleshooting Tips
  Troubleshooting Tips
NCAR User Group (NHUG)
NCAR User Group (NHUG)
Contributing to the Documentation

Common causes of job failures

2024-02-23 2024-02-23

Killed processes on login nodes

Batch jobs crashing

© 2023-2024 UCAR, Licensed under the Creative Commons CC-BY-SA 4.0.

Made with Material for MkDocs

National Science Foundation

This material is based upon work supported by the National Center for Atmospheric Research, a major facility sponsored by National Science Foundation and managed by the University Corporation for Atmospheric Research. Any opinions, findings and conclusions or recommendations expressed in this material do not necessarily reflect the views of the National Science Foundation.