2022-11-23T01:38:56.2108387Z Requested labels: self-hosted, linux.large
2022-11-23T01:38:56.2108473Z Job defined at: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/master
2022-11-23T01:38:56.2108495Z Waiting for a runner to pick up this job...
2022-11-23T01:38:56.3626774Z Job is about to start running on the runner: i-0b7f22c938e9e1aa5 (organization)
2022-11-23T01:38:59.7992435Z Current runner version: '2.299.1'
2022-11-23T01:38:59.7998281Z Runner name: 'i-0b7f22c938e9e1aa5'
2022-11-23T01:38:59.7998989Z Runner group name: 'Default'
2022-11-23T01:38:59.7999590Z Machine name: 'ip-10-0-11-242'
2022-11-23T01:38:59.8001783Z ##[group]GITHUB_TOKEN Permissions
2022-11-23T01:38:59.8002451Z Actions: write
2022-11-23T01:38:59.8002776Z Checks: write
2022-11-23T01:38:59.8003075Z Contents: write
2022-11-23T01:38:59.8003452Z Deployments: write
2022-11-23T01:38:59.8003885Z Discussions: write
2022-11-23T01:38:59.8004183Z Issues: write
2022-11-23T01:38:59.8004553Z Metadata: read
2022-11-23T01:38:59.8005009Z Packages: write
2022-11-23T01:38:59.8005342Z Pages: write
2022-11-23T01:38:59.8005604Z PullRequests: write
2022-11-23T01:38:59.8005967Z RepositoryProjects: write
2022-11-23T01:38:59.8006461Z SecurityEvents: write
2022-11-23T01:38:59.8006729Z Statuses: write
2022-11-23T01:38:59.8007050Z ##[endgroup]
2022-11-23T01:38:59.8010044Z Secret source: Actions
2022-11-23T01:38:59.8010929Z Prepare workflow directory
2022-11-23T01:39:00.1623182Z Prepare all required actions
2022-11-23T01:39:00.1794872Z Getting action download info
2022-11-23T01:39:00.4591913Z Download action repository 'pytorch/pytorch@master' (SHA:1cfd3858ac54fe3883534309081631a0a892ba3f)
2022-11-23T01:39:04.0009986Z Getting action download info
2022-11-23T01:39:04.1781190Z Download action repository 'malfet/checkout@silent-checkout' (SHA:c7b8fef48edfe1bca0044a44b1f7f7c4318a3076)
2022-11-23T01:39:04.3431375Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml
2022-11-23T01:39:04.3432986Z ##[group] Inputs
2022-11-23T01:39:04.3433271Z   build-environment: linux-bionic-cuda11.6-py3.9-gcc7
2022-11-23T01:39:04.3433630Z   test-matrix: { include: [
  { config: "multigpu", shard: 1, num_shards: 1, runner: "linux.16xlarge.nvidia.gpu" },
]}

2022-11-23T01:39:04.3434108Z   docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:072aae4a77ed7d3a69ad5683420509c41301b940
2022-11-23T01:39:04.3434481Z   sync-tag: 
2022-11-23T01:39:04.3435144Z   timeout-minutes: 240
2022-11-23T01:39:04.3435347Z ##[endgroup]
2022-11-23T01:39:04.3435764Z Complete job name: linux-bionic-cuda11.6-py3.9-gcc7 / filter
2022-11-23T01:39:04.4065487Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@master
2022-11-23T01:39:04.4065782Z with:
2022-11-23T01:39:04.4065958Z   fetch-depth: 1
2022-11-23T01:39:04.4066135Z   submodules: false
2022-11-23T01:39:04.4066318Z env:
2022-11-23T01:39:04.4066490Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:04.4066665Z ##[endgroup]
2022-11-23T01:39:04.4277454Z ##[group]Run retry () {
2022-11-23T01:39:04.4277706Z retry () {
2022-11-23T01:39:04.4277939Z   $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*)
2022-11-23T01:39:04.4278156Z }
2022-11-23T01:39:04.4278341Z echo "${GITHUB_WORKSPACE}"
2022-11-23T01:39:04.4278649Z if [ -z "${NO_SUDO}" ]; then
2022-11-23T01:39:04.4278882Z   retry sudo rm -rf "${GITHUB_WORKSPACE}"
2022-11-23T01:39:04.4279083Z else
2022-11-23T01:39:04.4279278Z   retry rm -rf "${GITHUB_WORKSPACE}"
2022-11-23T01:39:04.4279469Z fi
2022-11-23T01:39:04.4279679Z mkdir "${GITHUB_WORKSPACE}"
2022-11-23T01:39:04.4295498Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2022-11-23T01:39:04.4295882Z env:
2022-11-23T01:39:04.4296068Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:04.4296251Z   NO_SUDO: 
2022-11-23T01:39:04.4296406Z ##[endgroup]
2022-11-23T01:39:04.4473662Z /home/ec2-user/actions-runner/_work/pytorch/pytorch
2022-11-23T01:39:04.7299760Z ##[group]Run malfet/checkout@silent-checkout
2022-11-23T01:39:04.7299993Z with:
2022-11-23T01:39:04.7300191Z   ref: 1cfd3858ac54fe3883534309081631a0a892ba3f
2022-11-23T01:39:04.7300383Z   fetch-depth: 1
2022-11-23T01:39:04.7300560Z   submodules: false
2022-11-23T01:39:04.7300741Z   quiet-checkout: true
2022-11-23T01:39:04.7300927Z   repository: pytorch/pytorch
2022-11-23T01:39:04.7301280Z   token: ***
2022-11-23T01:39:04.7301577Z   ssh-strict: true
2022-11-23T01:39:04.7301776Z   persist-credentials: true
2022-11-23T01:39:04.7301954Z   clean: true
2022-11-23T01:39:04.7302121Z   lfs: false
2022-11-23T01:39:04.7302310Z   set-safe-directory: true
2022-11-23T01:39:04.7302475Z env:
2022-11-23T01:39:04.7302642Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:04.7302825Z ##[endgroup]
2022-11-23T01:39:04.8677067Z Syncing repository: pytorch/pytorch
2022-11-23T01:39:04.8679156Z ##[group]Getting Git version info
2022-11-23T01:39:04.8679850Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2022-11-23T01:39:04.8680625Z [command]/usr/bin/git version
2022-11-23T01:39:04.8695191Z git version 2.37.1
2022-11-23T01:39:04.8721278Z ##[endgroup]
2022-11-23T01:39:04.8744490Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/50388ee6-a62d-4fab-9bbd-c74676dc7ca0' before making global git config changes
2022-11-23T01:39:04.8745192Z Adding repository directory to the temporary git global config as a safe directory
2022-11-23T01:39:04.8745964Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2022-11-23T01:39:04.8777625Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch'
2022-11-23T01:39:04.8784122Z ##[group]Initializing the repository
2022-11-23T01:39:04.8787683Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch
2022-11-23T01:39:04.8814943Z hint: Using 'master' as the name for the initial branch. This default branch name
2022-11-23T01:39:04.8815917Z hint: is subject to change. To configure the initial branch name to use in all
2022-11-23T01:39:04.8816772Z hint: of your new repositories, which will suppress this warning, call:
2022-11-23T01:39:04.8817459Z hint: 
2022-11-23T01:39:04.8818246Z hint: 	git config --global init.defaultBranch <name>
2022-11-23T01:39:04.8859499Z hint: 
2022-11-23T01:39:04.8860069Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2022-11-23T01:39:04.8861070Z hint: 'development'. The just-created branch can be renamed via this command:
2022-11-23T01:39:04.8861486Z hint: 
2022-11-23T01:39:04.8862010Z hint: 	git branch -m <name>
2022-11-23T01:39:04.8862686Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/
2022-11-23T01:39:04.8863320Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch
2022-11-23T01:39:04.8887100Z ##[endgroup]
2022-11-23T01:39:04.8887748Z ##[group]Disabling automatic garbage collection
2022-11-23T01:39:04.8897046Z [command]/usr/bin/git config --local gc.auto 0
2022-11-23T01:39:04.8916763Z ##[endgroup]
2022-11-23T01:39:04.8918374Z ##[group]Setting up auth
2022-11-23T01:39:04.8926402Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-11-23T01:39:04.8954474Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2022-11-23T01:39:04.9196499Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2022-11-23T01:39:04.9223126Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2022-11-23T01:39:04.9449907Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2022-11-23T01:39:04.9488836Z ##[endgroup]
2022-11-23T01:39:04.9490020Z ##[group]Fetching the repository
2022-11-23T01:39:04.9496433Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --quiet --no-recurse-submodules --depth=1 origin 1cfd3858ac54fe3883534309081631a0a892ba3f
2022-11-23T01:39:12.7263674Z ##[endgroup]
2022-11-23T01:39:12.7265127Z ##[group]Determining the checkout info
2022-11-23T01:39:12.7265956Z ##[endgroup]
2022-11-23T01:39:12.7315066Z ##[group]Checking out the ref
2022-11-23T01:39:12.7316065Z [command]/usr/bin/git checkout --quiet --force 1cfd3858ac54fe3883534309081631a0a892ba3f
2022-11-23T01:39:13.8837956Z ##[endgroup]
2022-11-23T01:39:13.8877933Z [command]/usr/bin/git log -1 --format='%H'
2022-11-23T01:39:13.8904117Z '1cfd3858ac54fe3883534309081631a0a892ba3f'
2022-11-23T01:39:13.9049741Z Prepare all required actions
2022-11-23T01:39:13.9049995Z Getting action download info
2022-11-23T01:39:14.0458245Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482)
2022-11-23T01:39:14.1656238Z ##[group]Run ./.github/actions/filter-test-configs
2022-11-23T01:39:14.1656444Z with:
2022-11-23T01:39:14.1657006Z   github-token: ***
2022-11-23T01:39:14.1657564Z   test-matrix: { include: [
  { config: "multigpu", shard: 1, num_shards: 1, runner: "linux.16xlarge.nvidia.gpu" },
]}

2022-11-23T01:39:14.1657834Z env:
2022-11-23T01:39:14.1657996Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:14.1658181Z ##[endgroup]
2022-11-23T01:39:14.1683720Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482
2022-11-23T01:39:14.1683954Z with:
2022-11-23T01:39:14.1684101Z   shell: bash
2022-11-23T01:39:14.1684277Z   timeout_minutes: 10
2022-11-23T01:39:14.1684456Z   max_attempts: 5
2022-11-23T01:39:14.1684660Z   retry_wait_seconds: 30
2022-11-23T01:39:14.1684905Z   command: set -eux
python3 -m pip install requests==2.26.0 pyyaml==6.0

2022-11-23T01:39:14.1685142Z   polling_interval_seconds: 1
2022-11-23T01:39:14.1685334Z   warning_on_retry: true
2022-11-23T01:39:14.1685518Z   continue_on_error: false
2022-11-23T01:39:14.1685676Z env:
2022-11-23T01:39:14.1685843Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:14.1686206Z   GITHUB_TOKEN: ***
2022-11-23T01:39:14.1686365Z ##[endgroup]
2022-11-23T01:39:14.2177645Z + python3 -m pip install requests==2.26.0 pyyaml==6.0
2022-11-23T01:39:14.4225691Z Defaulting to user installation because normal site-packages is not writeable
2022-11-23T01:39:14.4385737Z Requirement already satisfied: requests==2.26.0 in /home/ec2-user/.local/lib/python3.7/site-packages (2.26.0)
2022-11-23T01:39:14.4512376Z Requirement already satisfied: pyyaml==6.0 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0)
2022-11-23T01:39:14.4521034Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (3.4)
2022-11-23T01:39:14.4535111Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (1.26.12)
2022-11-23T01:39:14.4686100Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2022.9.24)
2022-11-23T01:39:14.4696710Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2.0.12)
2022-11-23T01:39:15.2157619Z Command completed after 1 attempt(s).
2022-11-23T01:39:15.2199767Z ##[group]Run .github/scripts/parse_ref.py
2022-11-23T01:39:15.2200012Z .github/scripts/parse_ref.py
2022-11-23T01:39:15.2211488Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2022-11-23T01:39:15.2211695Z env:
2022-11-23T01:39:15.2211867Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:15.2212060Z ##[endgroup]
2022-11-23T01:39:15.2515857Z ##[group]Run .github/scripts/filter_test_configs.py \
2022-11-23T01:39:15.2516122Z .github/scripts/filter_test_configs.py \
2022-11-23T01:39:15.2516353Z   --test-matrix "{ include: [
2022-11-23T01:39:15.2516635Z   { config: "multigpu", shard: 1, num_shards: 1, runner: "linux.16xlarge.nvidia.gpu" },
2022-11-23T01:39:15.2516882Z ]}
2022-11-23T01:39:15.2517028Z " \
2022-11-23T01:39:15.2517195Z   --pr-number "" \
2022-11-23T01:39:15.2517366Z   --tag "" \
2022-11-23T01:39:15.2517542Z   --event-name "schedule"
2022-11-23T01:39:15.2528075Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2022-11-23T01:39:15.2528378Z env:
2022-11-23T01:39:15.2528535Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:15.2528925Z   GITHUB_TOKEN: ***
2022-11-23T01:39:15.2529090Z ##[endgroup]
2022-11-23T01:39:15.3723881Z ##[group]Run echo "{"include": [{"config": "multigpu", "shard": 1, "num_shards": 1, "runner": "linux.16xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "multigpu", "shard": 1, "num_shards": 1, "runner": "linux.16xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}]}"
2022-11-23T01:39:15.3724559Z echo "{"include": [{"config": "multigpu", "shard": 1, "num_shards": 1, "runner": "linux.16xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "multigpu", "shard": 1, "num_shards": 1, "runner": "linux.16xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}]}"
2022-11-23T01:39:15.3735497Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
2022-11-23T01:39:15.3735712Z env:
2022-11-23T01:39:15.3735899Z   GIT_DEFAULT_BRANCH: master
2022-11-23T01:39:15.3736074Z ##[endgroup]
2022-11-23T01:39:15.3761815Z {include: [{config: multigpu, shard: 1, num_shards: 1, runner: linux.16xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: multigpu, shard: 1, num_shards: 1, runner: linux.16xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}]}
2022-11-23T01:39:15.3856496Z Post job cleanup.
2022-11-23T01:39:15.3884471Z Post job cleanup.
2022-11-23T01:39:15.4948122Z [command]/usr/bin/git version
2022-11-23T01:39:15.4989214Z git version 2.37.1
2022-11-23T01:39:15.5030149Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/d7c1497d-88dc-4cfe-b6e7-70e30c390585' before making global git config changes
2022-11-23T01:39:15.5031342Z Adding repository directory to the temporary git global config as a safe directory
2022-11-23T01:39:15.5036449Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch
2022-11-23T01:39:15.5069851Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-11-23T01:39:15.5099599Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2022-11-23T01:39:15.5424557Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2022-11-23T01:39:15.5456795Z http.https://github.com/.extraheader
2022-11-23T01:39:15.5472056Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2022-11-23T01:39:15.5524184Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2022-11-23T01:39:15.6026769Z Evaluate and set job outputs
2022-11-23T01:39:15.6037806Z Set output 'test-matrix'
2022-11-23T01:39:15.6038632Z Set output 'is-test-matrix-empty'
2022-11-23T01:39:15.6039289Z Cleaning up orphan processes