2022-11-23T01:33:33.6196008Z Requested labels: self-hosted, linux.large 2022-11-23T01:33:33.6196087Z Job defined at: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/master 2022-11-23T01:33:33.6196111Z Waiting for a runner to pick up this job... 2022-11-23T01:33:33.7784611Z Job is about to start running on the runner: i-0b7f22c938e9e1aa5 (organization) 2022-11-23T01:33:38.1528967Z Current runner version: '2.299.1' 2022-11-23T01:33:38.1533967Z Runner name: 'i-0b7f22c938e9e1aa5' 2022-11-23T01:33:38.1534362Z Runner group name: 'Default' 2022-11-23T01:33:38.1534802Z Machine name: 'ip-10-0-11-242' 2022-11-23T01:33:38.1536340Z ##[group]GITHUB_TOKEN Permissions 2022-11-23T01:33:38.1536787Z Actions: write 2022-11-23T01:33:38.1537053Z Checks: write 2022-11-23T01:33:38.1537314Z Contents: write 2022-11-23T01:33:38.1537516Z Deployments: write 2022-11-23T01:33:38.1537764Z Discussions: write 2022-11-23T01:33:38.1537995Z Issues: write 2022-11-23T01:33:38.1538183Z Metadata: read 2022-11-23T01:33:38.1538439Z Packages: write 2022-11-23T01:33:38.1538930Z Pages: write 2022-11-23T01:33:38.1539140Z PullRequests: write 2022-11-23T01:33:38.1539408Z RepositoryProjects: write 2022-11-23T01:33:38.1539692Z SecurityEvents: write 2022-11-23T01:33:38.1539920Z Statuses: write 2022-11-23T01:33:38.1540168Z ##[endgroup] 2022-11-23T01:33:38.1543017Z Secret source: Actions 2022-11-23T01:33:38.1543581Z Prepare workflow directory 2022-11-23T01:33:38.4994386Z Prepare all required actions 2022-11-23T01:33:38.5177125Z Getting action download info 2022-11-23T01:33:39.1281236Z Download action repository 'pytorch/pytorch@master' (SHA:1cfd3858ac54fe3883534309081631a0a892ba3f) 2022-11-23T01:33:42.1935661Z Getting action download info 2022-11-23T01:33:42.8214187Z Download action repository 'malfet/checkout@silent-checkout' (SHA:c7b8fef48edfe1bca0044a44b1f7f7c4318a3076) 2022-11-23T01:33:42.9723611Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml 2022-11-23T01:33:42.9725115Z ##[group] Inputs 2022-11-23T01:33:42.9725444Z build-environment: linux-bionic-cuda11.6-py3-gcc7-slow-gradcheck 2022-11-23T01:33:42.9725915Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 2, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 2, runner: "linux.4xlarge.nvidia.gpu" }, ]} 2022-11-23T01:33:42.9726485Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:072aae4a77ed7d3a69ad5683420509c41301b940 2022-11-23T01:33:42.9726864Z sync-tag: 2022-11-23T01:33:42.9727475Z timeout-minutes: 300 2022-11-23T01:33:42.9727687Z ##[endgroup] 2022-11-23T01:33:42.9728146Z Complete job name: linux-bionic-cuda11.6-py3-gcc7-slow-gradcheck / filter 2022-11-23T01:33:43.0347086Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@master 2022-11-23T01:33:43.0347388Z with: 2022-11-23T01:33:43.0347599Z fetch-depth: 1 2022-11-23T01:33:43.0347788Z submodules: false 2022-11-23T01:33:43.0347983Z env: 2022-11-23T01:33:43.0348177Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:43.0348373Z ##[endgroup] 2022-11-23T01:33:43.0559184Z ##[group]Run retry () { 2022-11-23T01:33:43.0559448Z retry () { 2022-11-23T01:33:43.0559680Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2022-11-23T01:33:43.0559920Z } 2022-11-23T01:33:43.0560125Z echo "${GITHUB_WORKSPACE}" 2022-11-23T01:33:43.0560355Z if [ -z "${NO_SUDO}" ]; then 2022-11-23T01:33:43.0560596Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2022-11-23T01:33:43.0560818Z else 2022-11-23T01:33:43.0561028Z  retry rm -rf "${GITHUB_WORKSPACE}" 2022-11-23T01:33:43.0561222Z fi 2022-11-23T01:33:43.0561471Z mkdir "${GITHUB_WORKSPACE}" 2022-11-23T01:33:43.0576862Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:43.0577358Z env: 2022-11-23T01:33:43.0577557Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:43.0577757Z NO_SUDO: 2022-11-23T01:33:43.0577930Z ##[endgroup] 2022-11-23T01:33:43.0762002Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:43.3496590Z ##[group]Run malfet/checkout@silent-checkout 2022-11-23T01:33:43.3496839Z with: 2022-11-23T01:33:43.3497047Z ref: 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:43.3497257Z fetch-depth: 1 2022-11-23T01:33:43.3497454Z submodules: false 2022-11-23T01:33:43.3497659Z quiet-checkout: true 2022-11-23T01:33:43.3497969Z repository: pytorch/pytorch 2022-11-23T01:33:43.3498348Z token: *** 2022-11-23T01:33:43.3498535Z ssh-strict: true 2022-11-23T01:33:43.3498944Z persist-credentials: true 2022-11-23T01:33:43.3499138Z clean: true 2022-11-23T01:33:43.3499322Z lfs: false 2022-11-23T01:33:43.3499533Z set-safe-directory: true 2022-11-23T01:33:43.3499713Z env: 2022-11-23T01:33:43.3499896Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:43.3500098Z ##[endgroup] 2022-11-23T01:33:43.4842161Z Syncing repository: pytorch/pytorch 2022-11-23T01:33:43.4844203Z ##[group]Getting Git version info 2022-11-23T01:33:43.4848656Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2022-11-23T01:33:43.4851740Z [command]/usr/bin/git version 2022-11-23T01:33:43.4852087Z git version 2.37.1 2022-11-23T01:33:43.4853121Z ##[endgroup] 2022-11-23T01:33:43.4876870Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/73c9aad4-fabd-44ae-9099-6a5339209584' before making global git config changes 2022-11-23T01:33:43.4877655Z Adding repository directory to the temporary git global config as a safe directory 2022-11-23T01:33:43.4878383Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:43.4908613Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2022-11-23T01:33:43.4914890Z ##[group]Initializing the repository 2022-11-23T01:33:43.4918574Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:43.4946881Z hint: Using 'master' as the name for the initial branch. This default branch name 2022-11-23T01:33:43.4947910Z hint: is subject to change. To configure the initial branch name to use in all 2022-11-23T01:33:43.4948646Z hint: of your new repositories, which will suppress this warning, call: 2022-11-23T01:33:43.4949014Z hint: 2022-11-23T01:33:43.4949485Z hint: git config --global init.defaultBranch 2022-11-23T01:33:43.4949831Z hint: 2022-11-23T01:33:43.4950331Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2022-11-23T01:33:43.4950981Z hint: 'development'. The just-created branch can be renamed via this command: 2022-11-23T01:33:43.4951355Z hint: 2022-11-23T01:33:43.4952040Z hint: git branch -m 2022-11-23T01:33:43.4957931Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2022-11-23T01:33:43.4967909Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2022-11-23T01:33:43.5016227Z ##[endgroup] 2022-11-23T01:33:43.5016886Z ##[group]Disabling automatic garbage collection 2022-11-23T01:33:43.5020569Z [command]/usr/bin/git config --local gc.auto 0 2022-11-23T01:33:43.5043757Z ##[endgroup] 2022-11-23T01:33:43.5046044Z ##[group]Setting up auth 2022-11-23T01:33:43.5053310Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2022-11-23T01:33:43.5082115Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2022-11-23T01:33:43.5307358Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2022-11-23T01:33:43.5333231Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2022-11-23T01:33:43.5567676Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2022-11-23T01:33:43.5600181Z ##[endgroup] 2022-11-23T01:33:43.5601217Z ##[group]Fetching the repository 2022-11-23T01:33:43.5607975Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --quiet --no-recurse-submodules --depth=1 origin 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:51.6476904Z ##[endgroup] 2022-11-23T01:33:51.6493623Z ##[group]Determining the checkout info 2022-11-23T01:33:51.6494910Z ##[endgroup] 2022-11-23T01:33:51.6495502Z ##[group]Checking out the ref 2022-11-23T01:33:51.6496126Z [command]/usr/bin/git checkout --quiet --force 1cfd3858ac54fe3883534309081631a0a892ba3f 2022-11-23T01:33:52.7910175Z ##[endgroup] 2022-11-23T01:33:52.7949989Z [command]/usr/bin/git log -1 --format='%H' 2022-11-23T01:33:52.7974259Z '1cfd3858ac54fe3883534309081631a0a892ba3f' 2022-11-23T01:33:52.8132336Z Prepare all required actions 2022-11-23T01:33:52.8132620Z Getting action download info 2022-11-23T01:33:53.4929320Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2022-11-23T01:33:53.6070371Z ##[group]Run ./.github/actions/filter-test-configs 2022-11-23T01:33:53.6070715Z with: 2022-11-23T01:33:53.6071320Z github-token: *** 2022-11-23T01:33:53.6071705Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 2, runner: "linux.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 2, runner: "linux.4xlarge.nvidia.gpu" }, ]} 2022-11-23T01:33:53.6072063Z env: 2022-11-23T01:33:53.6072242Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:53.6072443Z ##[endgroup] 2022-11-23T01:33:53.6098473Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2022-11-23T01:33:53.6098982Z with: 2022-11-23T01:33:53.6099146Z shell: bash 2022-11-23T01:33:53.6099369Z timeout_minutes: 10 2022-11-23T01:33:53.6099552Z max_attempts: 5 2022-11-23T01:33:53.6099744Z retry_wait_seconds: 30 2022-11-23T01:33:53.6100005Z command: set -eux python3 -m pip install requests==2.26.0 pyyaml==6.0 2022-11-23T01:33:53.6100270Z polling_interval_seconds: 1 2022-11-23T01:33:53.6100464Z warning_on_retry: true 2022-11-23T01:33:53.6100663Z continue_on_error: false 2022-11-23T01:33:53.6100856Z env: 2022-11-23T01:33:53.6101028Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:53.6101525Z GITHUB_TOKEN: *** 2022-11-23T01:33:53.6101716Z ##[endgroup] 2022-11-23T01:33:53.6591035Z + python3 -m pip install requests==2.26.0 pyyaml==6.0 2022-11-23T01:33:53.8928324Z Defaulting to user installation because normal site-packages is not writeable 2022-11-23T01:33:53.9085527Z Requirement already satisfied: requests==2.26.0 in /home/ec2-user/.local/lib/python3.7/site-packages (2.26.0) 2022-11-23T01:33:53.9221917Z Requirement already satisfied: pyyaml==6.0 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0) 2022-11-23T01:33:53.9230961Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (1.26.12) 2022-11-23T01:33:53.9387372Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (3.4) 2022-11-23T01:33:53.9399173Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2022.9.24) 2022-11-23T01:33:53.9409740Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2.0.12) 2022-11-23T01:33:54.6566905Z Command completed after 1 attempt(s). 2022-11-23T01:33:54.6605207Z ##[group]Run .github/scripts/parse_ref.py 2022-11-23T01:33:54.6605475Z .github/scripts/parse_ref.py 2022-11-23T01:33:54.6616729Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:54.6616961Z env: 2022-11-23T01:33:54.6617154Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:54.6617359Z ##[endgroup] 2022-11-23T01:33:54.6923258Z ##[group]Run .github/scripts/filter_test_configs.py \ 2022-11-23T01:33:54.6923558Z .github/scripts/filter_test_configs.py \ 2022-11-23T01:33:54.6923808Z  --test-matrix "{ include: [ 2022-11-23T01:33:54.6924112Z  { config: "default", shard: 1, num_shards: 2, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:54.6924450Z  { config: "default", shard: 2, num_shards: 2, runner: "linux.4xlarge.nvidia.gpu" }, 2022-11-23T01:33:54.6924784Z ]} 2022-11-23T01:33:54.6924947Z " \ 2022-11-23T01:33:54.6925120Z  --pr-number "" \ 2022-11-23T01:33:54.6925320Z  --tag "" \ 2022-11-23T01:33:54.6925535Z  --event-name "schedule" 2022-11-23T01:33:54.6935816Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:54.6936046Z env: 2022-11-23T01:33:54.6936310Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:54.6936654Z GITHUB_TOKEN: *** 2022-11-23T01:33:54.6936835Z ##[endgroup] 2022-11-23T01:33:54.8143543Z ##[group]Run echo "{"include": [{"config": "default", "shard": 1, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 1, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}]}" 2022-11-23T01:33:54.8144879Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 1, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 2, "runner": "linux.4xlarge.nvidia.gpu", "mem_leak_check": "mem_leak_check"}]}" 2022-11-23T01:33:54.8156150Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2022-11-23T01:33:54.8156382Z env: 2022-11-23T01:33:54.8156554Z GIT_DEFAULT_BRANCH: master 2022-11-23T01:33:54.8156752Z ##[endgroup] 2022-11-23T01:33:54.8183179Z {include: [{config: default, shard: 1, num_shards: 2, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 1, num_shards: 2, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}, {config: default, shard: 2, num_shards: 2, runner: linux.4xlarge.nvidia.gpu, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 2, num_shards: 2, runner: linux.4xlarge.nvidia.gpu, mem_leak_check: mem_leak_check}]} 2022-11-23T01:33:54.8273554Z Post job cleanup. 2022-11-23T01:33:54.8301912Z Post job cleanup. 2022-11-23T01:33:54.9333272Z [command]/usr/bin/git version 2022-11-23T01:33:54.9378469Z git version 2.37.1 2022-11-23T01:33:54.9423125Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/3c6163d5-85d7-48ba-9307-5b01db1ff203' before making global git config changes 2022-11-23T01:33:54.9426117Z Adding repository directory to the temporary git global config as a safe directory 2022-11-23T01:33:54.9432710Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2022-11-23T01:33:54.9470314Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2022-11-23T01:33:54.9501898Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2022-11-23T01:33:54.9880500Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2022-11-23T01:33:54.9923041Z http.https://github.com/.extraheader 2022-11-23T01:33:54.9934990Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2022-11-23T01:33:54.9973101Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2022-11-23T01:33:55.0475541Z Evaluate and set job outputs 2022-11-23T01:33:55.0486552Z Set output 'test-matrix' 2022-11-23T01:33:55.0487333Z Set output 'is-test-matrix-empty' 2022-11-23T01:33:55.0488158Z Cleaning up orphan processes