AWS-Logo_White-Color
  • Preparation ⁃ Before starting
    • Prerequisites
    • a. Access AWS
    • b. Create VPC
    • c. Deploy ParallelCluster UI
    • d. Connect to ParallelCluster UI
    • e. Add IAM Permissions
    • f. Summary
  • Part I ⁃ Create a AMI
    • a. Deep Learning AMI
    • b. Custom AMI with Packer (Optional)
  • Part II ⁃ Create a Training Cluster
    • a. Create a Cluster
    • b. Capacity Reservation
    • b. Create Cluster
    • d. Connect to the Cluster
    • e. Get to know your Cluster
  • Part III ⁃ EFA NCCL Tests
    • a. EFA NCCL Test
  • Part IV ⁃ Megatron-LM
    • a. Nvidia Container Registry (NGC)
    • b. Fetch Dataset
    • b. Data Preprocessing
    • a. Docker Image
    • c. Submit Training Job
    • d. Monitor Job Status
  • Part VI ⁃ Cleanup
    • a. Stop Cluster
    • b. Delete Cluster
    • c. Delete ParallelCluster UI
    • d. Jupyter Hub

More

  • Github
  • AWS - HPC
  • External Worshops
  • Conferences Worshops
  • Authors
  • Feedback / Questions?
  • Tags
  • Clear History
Star Fork
Privacy | Site Terms | © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Edit this page
AWS HPC Workshops >