2022-11-23T01:33:03.6811018Z Requested labels: self-hosted, linux.large 2022-11-23T01:33:03.6811095Z Job defined at: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/master 2022-11-23T01:33:03.6811117Z Waiting for a runner to pick up this job... 2022-11-23T01:33:03.9303472Z Job is about to start running on the runner: i-0b7f22c938e9e1aa5 (organization) 2022-11-23T01:33:07.4602062Z Current runner version: '2.299.1' 2022-11-23T01:33:07.4607261Z Runner name: 'i-0b7f22c938e9e1aa5' 2022-11-23T01:33:07.4607737Z Runner group name: 'Default' 2022-11-23T01:33:07.4608309Z Machine name: 'ip-10-0-11-242' 2022-11-23T01:33:07.4610163Z ##[group]GITHUB_TOKEN Permissions 2022-11-23T01:33:07.4610788Z Actions: write 2022-11-23T01:33:07.4611080Z Checks: write 2022-11-23T01:33:07.4611323Z Contents: write 2022-11-23T01:33:07.4611650Z Deployments: write 2022-11-23T01:33:07.4611951Z Discussions: write 2022-11-23T01:33:07.4612239Z Issues: write 2022-11-23T01:33:07.4612478Z Metadata: read 2022-11-23T01:33:07.4612770Z Packages: write 2022-11-23T01:33:07.4613080Z Pages: write 2022-11-23T01:33:07.4613364Z PullRequests: write 2022-11-23T01:33:07.4613696Z RepositoryProjects: write 2022-11-23T01:33:07.4614031Z SecurityEvents: write 2022-11-23T01:33:07.4614287Z Statuses: write 2022-11-23T01:33:07.4614591Z ##[endgroup] 2022-11-23T01:33:07.4617819Z Secret source: Actions 2022-11-23T01:33:07.4618464Z Prepare workflow directory 2022-11-23T01:33:07.8479110Z Prepare all required actions 2022-11-23T01:33:07.8680038Z Getting action download info 2022-11-23T01:33:08.0512280Z Download action repository 'pytorch/pytorch@master' (SHA:1cfd3858ac54fe3883534309081631a0a892ba3f) 2022-11-23T01:33:11.3430831Z Getting action download info 2022-11-23T01:33:11.4831206Z Download action repository 'malfet/checkout@silent-checkout' (SHA:c7b8fef48edfe1bca0044a44b1f7f7c4318a3076) 2022-11-23T01:33:11.6618955Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml 2022-11-23T01:33:11.6620445Z ##[group] Inputs 2022-11-23T01:33:11.6620740Z build-environment: linux-bionic-cuda11.7-py3.7-gcc7-debug 2022-11-23T01:33:11.6621364Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 3, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 4, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, ]} 2022-11-23T01:33:11.6622057Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.7-cudnn8-py3-gcc7:072aae4a77ed7d3a69ad5683420509c41301b940 2022-11-23T01:33:11.6622416Z sync-tag: 2022-11-23T01:33:11.6623047Z timeout-minutes: 240 2022-11-23T01:33:11.6623231Z ##[endgroup] 2022-11-23T01:33:11.6623661Z Complete job name: linux-bionic-cuda11.7-py3.7-gcc7-debug / filter 2022-11-23T01:33:11.7233928Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@master 2022-11-23T01:33:11.7234210Z with: 2022-11-23T01:33:11.7234373Z fetch-depth: 1 2022-11-23T01:33:11.7234565Z submodules: false 2022-11-23T01:33:11.7234745Z env: 2022-11-23T01:33:11.7234907Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:11.7235098Z ##[endgroup] 2022-11-23T01:33:11.7444308Z ##[group]Run retry () { 2022-11-23T01:33:11.7444558Z retry () { 2022-11-23T01:33:11.7444793Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2022-11-23T01:33:11.7445009Z } 2022-11-23T01:33:11.7445198Z echo "${GITHUB_WORKSPACE}" 2022-11-23T01:33:11.7445416Z if [ -z "${NO_SUDO}" ]; then 2022-11-23T01:33:11.7445628Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2022-11-23T01:33:11.7445829Z else 2022-11-23T01:33:11.7446026Z  retry rm -rf "${GITHUB_WORKSPACE}" 2022-11-23T01:33:11.7446206Z fi 2022-11-23T01:33:11.7446423Z mkdir "${GITHUB_WORKSPACE}" 2022-11-23T01:33:11.7461552Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:11.7461814Z env: 2022-11-23T01:33:11.7461996Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:11.7462182Z NO_SUDO: 2022-11-23T01:33:11.7462340Z ##[endgroup] 2022-11-23T01:33:11.7643638Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:12.0584713Z ##[group]Run malfet/checkout@silent-checkout 2022-11-23T01:33:12.0584935Z with: 2022-11-23T01:33:12.0585126Z ref: 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:12.0585414Z fetch-depth: 1 2022-11-23T01:33:12.0585590Z submodules: false 2022-11-23T01:33:12.0585770Z quiet-checkout: true 2022-11-23T01:33:12.0585955Z repository: pytorch/pytorch 2022-11-23T01:33:12.0586317Z token: *** 2022-11-23T01:33:12.0586485Z ssh-strict: true 2022-11-23T01:33:12.0586681Z persist-credentials: true 2022-11-23T01:33:12.0586857Z clean: true 2022-11-23T01:33:12.0587019Z lfs: false 2022-11-23T01:33:12.0587203Z set-safe-directory: true 2022-11-23T01:33:12.0587371Z env: 2022-11-23T01:33:12.0587545Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:12.0587729Z ##[endgroup] 2022-11-23T01:33:12.1895956Z Syncing repository: pytorch/pytorch 2022-11-23T01:33:12.1897868Z ##[group]Getting Git version info 2022-11-23T01:33:12.1898711Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2022-11-23T01:33:12.1899500Z [command]/usr/bin/git version 2022-11-23T01:33:12.1899832Z git version 2.37.1 2022-11-23T01:33:12.1900756Z ##[endgroup] 2022-11-23T01:33:12.1916504Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/637ecaa6-99bc-4f50-ba2f-23c0bbed0b79' before making global git config changes 2022-11-23T01:33:12.1917291Z Adding repository directory to the temporary git global config as a safe directory 2022-11-23T01:33:12.1918072Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:12.1935027Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2022-11-23T01:33:12.1940454Z ##[group]Initializing the repository 2022-11-23T01:33:12.1944080Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:12.1970790Z hint: Using 'master' as the name for the initial branch. This default branch name 2022-11-23T01:33:12.1971761Z hint: is subject to change. To configure the initial branch name to use in all 2022-11-23T01:33:12.1972599Z hint: of your new repositories, which will suppress this warning, call: 2022-11-23T01:33:12.2003041Z hint: 2022-11-23T01:33:12.2003607Z hint: git config --global init.defaultBranch 2022-11-23T01:33:12.2004173Z hint: 2022-11-23T01:33:12.2004727Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2022-11-23T01:33:12.2005398Z hint: 'development'. The just-created branch can be renamed via this command: 2022-11-23T01:33:12.2005832Z hint: 2022-11-23T01:33:12.2006360Z hint: git branch -m 2022-11-23T01:33:12.2007011Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2022-11-23T01:33:12.2007668Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2022-11-23T01:33:12.2030012Z ##[endgroup] 2022-11-23T01:33:12.2031157Z ##[group]Disabling automatic garbage collection 2022-11-23T01:33:12.2040243Z [command]/usr/bin/git config --local gc.auto 0 2022-11-23T01:33:12.2060934Z ##[endgroup] 2022-11-23T01:33:12.2063140Z ##[group]Setting up auth 2022-11-23T01:33:12.2068614Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2022-11-23T01:33:12.2097752Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2022-11-23T01:33:12.2328631Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2022-11-23T01:33:12.2354032Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2022-11-23T01:33:12.2575161Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2022-11-23T01:33:12.2612340Z ##[endgroup] 2022-11-23T01:33:12.2613276Z ##[group]Fetching the repository 2022-11-23T01:33:12.2621049Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --quiet --no-recurse-submodules --depth=1 origin 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:20.1907784Z ##[endgroup] 2022-11-23T01:33:20.1909108Z ##[group]Determining the checkout info 2022-11-23T01:33:20.1909906Z ##[endgroup] 2022-11-23T01:33:20.1956601Z ##[group]Checking out the ref 2022-11-23T01:33:20.1957513Z [command]/usr/bin/git checkout --quiet --force 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:21.3376556Z ##[endgroup] 2022-11-23T01:33:21.3416847Z [command]/usr/bin/git log -1 --format='%H' 2022-11-23T01:33:21.3441354Z '1cfd3858ac54fe3883534309081631a0a892ba3f' 2022-11-23T01:33:21.3595609Z Prepare all required actions 2022-11-23T01:33:21.3595920Z Getting action download info 2022-11-23T01:33:21.5222986Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2022-11-23T01:33:21.6375323Z ##[group]Run ./.github/actions/filter-test-configs 2022-11-23T01:33:21.6375536Z with: 2022-11-23T01:33:21.6376004Z github-token: *** 2022-11-23T01:33:21.6376510Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 3, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 4, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, ]} 2022-11-23T01:33:21.6377182Z env: 2022-11-23T01:33:21.6377352Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:21.6377535Z ##[endgroup] 2022-11-23T01:33:21.6402148Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2022-11-23T01:33:21.6402370Z with: 2022-11-23T01:33:21.6402529Z shell: bash 2022-11-23T01:33:21.6402707Z timeout_minutes: 10 2022-11-23T01:33:21.6402873Z max_attempts: 5 2022-11-23T01:33:21.6403054Z retry_wait_seconds: 30 2022-11-23T01:33:21.6403304Z command: set -eux python3 -m pip install requests==2.26.0 pyyaml==6.0 2022-11-23T01:33:21.6403554Z polling_interval_seconds: 1 2022-11-23T01:33:21.6403739Z warning_on_retry: true 2022-11-23T01:33:21.6403926Z continue_on_error: false 2022-11-23T01:33:21.6404096Z env: 2022-11-23T01:33:21.6404250Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:21.6404609Z GITHUB_TOKEN: *** 2022-11-23T01:33:21.6404786Z ##[endgroup] 2022-11-23T01:33:21.6895539Z + python3 -m pip install requests==2.26.0 pyyaml==6.0 2022-11-23T01:33:21.8915290Z Defaulting to user installation because normal site-packages is not writeable 2022-11-23T01:33:21.9068696Z Requirement already satisfied: requests==2.26.0 in /home/ec2-user/.local/lib/python3.7/site-packages (2.26.0) 2022-11-23T01:33:21.9196624Z Requirement already satisfied: pyyaml==6.0 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0) 2022-11-23T01:33:21.9205773Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (1.26.12) 2022-11-23T01:33:21.9358411Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (3.4) 2022-11-23T01:33:21.9370647Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2.0.12) 2022-11-23T01:33:21.9390784Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2022.9.24) 2022-11-23T01:33:22.6878600Z Command completed after 1 attempt(s). 2022-11-23T01:33:22.6913920Z ##[group]Run .github/scripts/parse_ref.py 2022-11-23T01:33:22.6914170Z .github/scripts/parse_ref.py 2022-11-23T01:33:22.6929891Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:22.6930259Z env: 2022-11-23T01:33:22.6930545Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:22.6930850Z ##[endgroup] 2022-11-23T01:33:22.7235238Z ##[group]Run .github/scripts/filter_test_configs.py \ 2022-11-23T01:33:22.7235518Z .github/scripts/filter_test_configs.py \ 2022-11-23T01:33:22.7235840Z  --test-matrix "{ include: [ 2022-11-23T01:33:22.7236124Z  { config: "default", shard: 1, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:22.7236465Z  { config: "default", shard: 2, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:22.7236781Z  { config: "default", shard: 3, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:22.7237237Z  { config: "default", shard: 4, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:22.7237468Z ]} 2022-11-23T01:33:22.7237627Z " \ 2022-11-23T01:33:22.7237789Z  --pr-number "" \ 2022-11-23T01:33:22.7237975Z  --tag "" \ 2022-11-23T01:33:22.7238170Z  --event-name "schedule" 2022-11-23T01:33:22.7248314Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:22.7248528Z env: 2022-11-23T01:33:22.7248704Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:22.7249094Z GITHUB_TOKEN: *** 2022-11-23T01:33:22.7249275Z ##[endgroup] 2022-11-23T01:33:22.8480882Z ##[group]Run echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}]}" 2022-11-23T01:33:22.8482946Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}]}" 2022-11-23T01:33:22.8495059Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:22.8495442Z env: 2022-11-23T01:33:22.8495759Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:22.8496000Z ##[endgroup] 2022-11-23T01:33:22.8526322Z {include: [{config: default, shard: 1, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 1, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 2, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 2, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 3, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 3, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 4, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 4, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}]} 2022-11-23T01:33:22.8620091Z Post job cleanup. 2022-11-23T01:33:22.8647401Z Post job cleanup. 2022-11-23T01:33:22.9732004Z [command]/usr/bin/git version 2022-11-23T01:33:22.9776252Z git version 2.37.1 2022-11-23T01:33:22.9817621Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/5476d9f4-ed45-4975-8016-7816570a4c95' before making global git config changes 2022-11-23T01:33:22.9818952Z Adding repository directory to the temporary git global config as a safe directory 2022-11-23T01:33:22.9824765Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:22.9859225Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2022-11-23T01:33:22.9887947Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2022-11-23T01:33:23.0291559Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2022-11-23T01:33:23.0320556Z http.https://github.com/.extraheader 2022-11-23T01:33:23.0339622Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2022-11-23T01:33:23.0385826Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2022-11-23T01:33:23.0863860Z Evaluate and set job outputs 2022-11-23T01:33:23.0875169Z Set output 'test-matrix' 2022-11-23T01:33:23.0875937Z Set output 'is-test-matrix-empty' 2022-11-23T01:33:23.0876552Z Cleaning up orphan processes