2022-11-23T01:33:12.9305839Z Requested labels: self-hosted, linux.large 2022-11-23T01:33:12.9305940Z Job defined at: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/master 2022-11-23T01:33:12.9305963Z Waiting for a runner to pick up this job... 2022-11-23T01:33:13.0845039Z Job is about to start running on the runner: i-0bfb4b84e673035cb (organization) 2022-11-23T01:33:17.7679094Z Current runner version: '2.299.1' 2022-11-23T01:33:17.7684877Z Runner name: 'i-0bfb4b84e673035cb' 2022-11-23T01:33:17.7685442Z Runner group name: 'Default' 2022-11-23T01:33:17.7686034Z Machine name: 'ip-10-0-2-12' 2022-11-23T01:33:17.7687993Z ##[group]GITHUB_TOKEN Permissions 2022-11-23T01:33:17.7688735Z Actions: write 2022-11-23T01:33:17.7689009Z Checks: write 2022-11-23T01:33:17.7689337Z Contents: write 2022-11-23T01:33:17.7689655Z Deployments: write 2022-11-23T01:33:17.7689964Z Discussions: write 2022-11-23T01:33:17.7690270Z Issues: write 2022-11-23T01:33:17.7690564Z Metadata: read 2022-11-23T01:33:17.7690831Z Packages: write 2022-11-23T01:33:17.7691150Z Pages: write 2022-11-23T01:33:17.7691480Z PullRequests: write 2022-11-23T01:33:17.7691787Z RepositoryProjects: write 2022-11-23T01:33:17.7692132Z SecurityEvents: write 2022-11-23T01:33:17.7692482Z Statuses: write 2022-11-23T01:33:17.7692741Z ##[endgroup] 2022-11-23T01:33:17.7695902Z Secret source: Actions 2022-11-23T01:33:17.7696507Z Prepare workflow directory 2022-11-23T01:33:18.1197663Z Prepare all required actions 2022-11-23T01:33:18.1380934Z Getting action download info 2022-11-23T01:33:18.3498905Z Download action repository 'pytorch/pytorch@master' (SHA:1cfd3858ac54fe3883534309081631a0a892ba3f) 2022-11-23T01:33:21.8380705Z Getting action download info 2022-11-23T01:33:22.3857824Z Download action repository 'malfet/checkout@silent-checkout' (SHA:c7b8fef48edfe1bca0044a44b1f7f7c4318a3076) 2022-11-23T01:33:22.5599595Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml 2022-11-23T01:33:22.5601110Z ##[group] Inputs 2022-11-23T01:33:22.5601435Z build-environment: linux-bionic-cuda11.6-py3.7-gcc7-debug 2022-11-23T01:33:22.5602106Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 3, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 4, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, ]} 2022-11-23T01:33:22.5602842Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:072aae4a77ed7d3a69ad5683420509c41301b940 2022-11-23T01:33:22.5603223Z sync-tag: 2022-11-23T01:33:22.5604133Z timeout-minutes: 240 2022-11-23T01:33:22.5604349Z ##[endgroup] 2022-11-23T01:33:22.5604854Z Complete job name: linux-bionic-cuda11.6-py3.7-gcc7-debug / filter 2022-11-23T01:33:22.6247093Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@master 2022-11-23T01:33:22.6247402Z with: 2022-11-23T01:33:22.6247589Z fetch-depth: 1 2022-11-23T01:33:22.6247782Z submodules: false 2022-11-23T01:33:22.6247976Z env: 2022-11-23T01:33:22.6248171Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:22.6248362Z ##[endgroup] 2022-11-23T01:33:22.6472968Z ##[group]Run retry () { 2022-11-23T01:33:22.6473244Z retry () { 2022-11-23T01:33:22.6473496Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2022-11-23T01:33:22.6473728Z } 2022-11-23T01:33:22.6473932Z echo "${GITHUB_WORKSPACE}" 2022-11-23T01:33:22.6474162Z if [ -z "${NO_SUDO}" ]; then 2022-11-23T01:33:22.6474389Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2022-11-23T01:33:22.6474601Z else 2022-11-23T01:33:22.6474809Z  retry rm -rf "${GITHUB_WORKSPACE}" 2022-11-23T01:33:22.6475005Z fi 2022-11-23T01:33:22.6475242Z mkdir "${GITHUB_WORKSPACE}" 2022-11-23T01:33:22.6491118Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:22.6491411Z env: 2022-11-23T01:33:22.6491599Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:22.6491793Z NO_SUDO: 2022-11-23T01:33:22.6491963Z ##[endgroup] 2022-11-23T01:33:22.6686763Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:22.9562588Z ##[group]Run malfet/checkout@silent-checkout 2022-11-23T01:33:22.9562822Z with: 2022-11-23T01:33:22.9563026Z ref: 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:22.9563334Z fetch-depth: 1 2022-11-23T01:33:22.9563528Z submodules: false 2022-11-23T01:33:22.9563724Z quiet-checkout: true 2022-11-23T01:33:22.9564220Z repository: pytorch/pytorch 2022-11-23T01:33:22.9564590Z token: *** 2022-11-23T01:33:22.9564774Z ssh-strict: true 2022-11-23T01:33:22.9564982Z persist-credentials: true 2022-11-23T01:33:22.9565168Z clean: true 2022-11-23T01:33:22.9565342Z lfs: false 2022-11-23T01:33:22.9565546Z set-safe-directory: true 2022-11-23T01:33:22.9565723Z env: 2022-11-23T01:33:22.9565903Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:22.9566096Z ##[endgroup] 2022-11-23T01:33:23.0937652Z Syncing repository: pytorch/pytorch 2022-11-23T01:33:23.0940035Z ##[group]Getting Git version info 2022-11-23T01:33:23.0940756Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2022-11-23T01:33:23.0941521Z [command]/usr/bin/git version 2022-11-23T01:33:23.0941877Z git version 2.37.1 2022-11-23T01:33:23.0948599Z ##[endgroup] 2022-11-23T01:33:23.0970870Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/887925db-2668-4d09-bb1c-63de14ae44d6' before making global git config changes 2022-11-23T01:33:23.0971869Z Adding repository directory to the temporary git global config as a safe directory 2022-11-23T01:33:23.0978495Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:23.1016367Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2022-11-23T01:33:23.1022292Z ##[group]Initializing the repository 2022-11-23T01:33:23.1026153Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:23.1054796Z hint: Using 'master' as the name for the initial branch. This default branch name 2022-11-23T01:33:23.1055367Z hint: is subject to change. To configure the initial branch name to use in all 2022-11-23T01:33:23.1055892Z hint: of your new repositories, which will suppress this warning, call: 2022-11-23T01:33:23.1056320Z hint: 2022-11-23T01:33:23.1056807Z hint: git config --global init.defaultBranch 2022-11-23T01:33:23.1057160Z hint: 2022-11-23T01:33:23.1057673Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2022-11-23T01:33:23.1058338Z hint: 'development'. The just-created branch can be renamed via this command: 2022-11-23T01:33:23.1058967Z hint: 2022-11-23T01:33:23.1059837Z hint: git branch -m 2022-11-23T01:33:23.1065211Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2022-11-23T01:33:23.1071965Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2022-11-23T01:33:23.1117997Z ##[endgroup] 2022-11-23T01:33:23.1122524Z ##[group]Disabling automatic garbage collection 2022-11-23T01:33:23.1127819Z [command]/usr/bin/git config --local gc.auto 0 2022-11-23T01:33:23.1152150Z ##[endgroup] 2022-11-23T01:33:23.1154586Z ##[group]Setting up auth 2022-11-23T01:33:23.1163372Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2022-11-23T01:33:23.1193072Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2022-11-23T01:33:23.1525078Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2022-11-23T01:33:23.1553866Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2022-11-23T01:33:23.1801313Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2022-11-23T01:33:23.1837230Z ##[endgroup] 2022-11-23T01:33:23.1838279Z ##[group]Fetching the repository 2022-11-23T01:33:23.1845557Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --quiet --no-recurse-submodules --depth=1 origin 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:25.9760386Z ##[endgroup] 2022-11-23T01:33:25.9761578Z ##[group]Determining the checkout info 2022-11-23T01:33:25.9769423Z ##[endgroup] 2022-11-23T01:33:25.9770168Z ##[group]Checking out the ref 2022-11-23T01:33:25.9771008Z [command]/usr/bin/git checkout --quiet --force 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:27.1776247Z ##[endgroup] 2022-11-23T01:33:27.1819830Z [command]/usr/bin/git log -1 --format='%H' 2022-11-23T01:33:27.1849911Z '1cfd3858ac54fe3883534309081631a0a892ba3f' 2022-11-23T01:33:27.2020322Z Prepare all required actions 2022-11-23T01:33:27.2020605Z Getting action download info 2022-11-23T01:33:27.7593866Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2022-11-23T01:33:27.8952075Z ##[group]Run ./.github/actions/filter-test-configs 2022-11-23T01:33:27.8952427Z with: 2022-11-23T01:33:27.8953144Z github-token: *** 2022-11-23T01:33:27.8954104Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 3, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 4, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, ]} 2022-11-23T01:33:27.8954990Z env: 2022-11-23T01:33:27.8955306Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:27.8955606Z ##[endgroup] 2022-11-23T01:33:27.9039353Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2022-11-23T01:33:27.9039726Z with: 2022-11-23T01:33:27.9039972Z shell: bash 2022-11-23T01:33:27.9040269Z timeout_minutes: 10 2022-11-23T01:33:27.9040600Z max_attempts: 5 2022-11-23T01:33:27.9040924Z retry_wait_seconds: 30 2022-11-23T01:33:27.9041384Z command: set -eux python3 -m pip install requests==2.26.0 pyyaml==6.0 2022-11-23T01:33:27.9041853Z polling_interval_seconds: 1 2022-11-23T01:33:27.9042214Z warning_on_retry: true 2022-11-23T01:33:27.9042570Z continue_on_error: false 2022-11-23T01:33:27.9042889Z env: 2022-11-23T01:33:27.9043199Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:27.9044015Z GITHUB_TOKEN: *** 2022-11-23T01:33:27.9044328Z ##[endgroup] 2022-11-23T01:33:27.9595937Z + python3 -m pip install requests==2.26.0 pyyaml==6.0 2022-11-23T01:33:28.1986968Z Defaulting to user installation because normal site-packages is not writeable 2022-11-23T01:33:28.2151929Z Requirement already satisfied: requests==2.26.0 in /home/ec2-user/.local/lib/python3.7/site-packages (2.26.0) 2022-11-23T01:33:28.2293684Z Requirement already satisfied: pyyaml==6.0 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0) 2022-11-23T01:33:28.2302805Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (1.26.12) 2022-11-23T01:33:28.2464084Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2022.9.24) 2022-11-23T01:33:28.2473850Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2.0.12) 2022-11-23T01:33:28.2495132Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (3.4) 2022-11-23T01:33:28.9569080Z Command completed after 1 attempt(s). 2022-11-23T01:33:28.9609053Z ##[group]Run .github/scripts/parse_ref.py 2022-11-23T01:33:28.9609325Z .github/scripts/parse_ref.py 2022-11-23T01:33:28.9620286Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:28.9620505Z env: 2022-11-23T01:33:28.9620689Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:28.9620887Z ##[endgroup] 2022-11-23T01:33:28.9899320Z ##[group]Run .github/scripts/filter_test_configs.py \ 2022-11-23T01:33:28.9899631Z .github/scripts/filter_test_configs.py \ 2022-11-23T01:33:28.9899961Z  --test-matrix "{ include: [ 2022-11-23T01:33:28.9900264Z  { config: "default", shard: 1, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:28.9900625Z  { config: "default", shard: 2, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:28.9900966Z  { config: "default", shard: 3, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:28.9901373Z  { config: "default", shard: 4, num_shards: 4, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:28.9901629Z ]} 2022-11-23T01:33:28.9901800Z " \ 2022-11-23T01:33:28.9901973Z  --pr-number "" \ 2022-11-23T01:33:28.9902167Z  --tag "" \ 2022-11-23T01:33:28.9902367Z  --event-name "schedule" 2022-11-23T01:33:28.9913208Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:28.9913445Z env: 2022-11-23T01:33:28.9913629Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:28.9914057Z GITHUB_TOKEN: *** 2022-11-23T01:33:28.9914242Z ##[endgroup] 2022-11-23T01:33:29.1189335Z ##[group]Run echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}]}" 2022-11-23T01:33:29.1191498Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}]}" 2022-11-23T01:33:29.1203617Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:29.1204138Z env: 2022-11-23T01:33:29.1204325Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:29.1204510Z ##[endgroup] 2022-11-23T01:33:29.1234380Z {include: [{config: default, shard: 1, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 1, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 2, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 2, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 3, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 3, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 4, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 4, num_shards: 4, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}]} 2022-11-23T01:33:29.1330607Z Post job cleanup. 2022-11-23T01:33:29.1362572Z Post job cleanup. 2022-11-23T01:33:29.2470620Z [command]/usr/bin/git version 2022-11-23T01:33:29.2519136Z git version 2.37.1 2022-11-23T01:33:29.2561921Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/4b7cca2b-083a-4bec-9ca8-33f16762d1ae' before making global git config changes 2022-11-23T01:33:29.2563167Z Adding repository directory to the temporary git global config as a safe directory 2022-11-23T01:33:29.2568735Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:29.2604827Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2022-11-23T01:33:29.2657619Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2022-11-23T01:33:29.3045566Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2022-11-23T01:33:29.3085523Z http.https://github.com/.extraheader 2022-11-23T01:33:29.3107549Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2022-11-23T01:33:29.3130248Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2022-11-23T01:33:29.3615824Z Evaluate and set job outputs 2022-11-23T01:33:29.3627033Z Set output 'test-matrix' 2022-11-23T01:33:29.3627863Z Set output 'is-test-matrix-empty' 2022-11-23T01:33:29.3628621Z Cleaning up orphan processes