2023-01-11T21:13:54.0507503Z Requested labels: self-hosted, linux.large 2023-01-11T21:13:54.0507611Z Job defined at: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/trunk/91627 2023-01-11T21:13:54.0507778Z Reusable workflow chain: 2023-01-11T21:13:54.0507829Z pytorch/pytorch/.github/workflows/trunk.yml@refs/tags/ciflow/trunk/91627 (8419ddda87c8a47eacc63b54bc7ec98c1f27c26e) 2023-01-11T21:13:54.0507865Z -> pytorch/pytorch/.github/workflows/_linux-test.yml@refs/tags/ciflow/trunk/91627 (8419ddda87c8a47eacc63b54bc7ec98c1f27c26e) 2023-01-11T21:13:54.0507889Z Waiting for a runner to pick up this job... 2023-01-11T21:13:54.1962445Z Job is about to start running on the runner: i-0e315ab51cdb8a9d6 (organization) 2023-01-11T21:13:57.5153788Z Current runner version: '2.300.2' 2023-01-11T21:13:57.5159216Z Runner name: 'i-0e315ab51cdb8a9d6' 2023-01-11T21:13:57.5159655Z Runner group name: 'Default' 2023-01-11T21:13:57.5160309Z Machine name: 'ip-10-0-0-155' 2023-01-11T21:13:57.5162171Z ##[group]GITHUB_TOKEN Permissions 2023-01-11T21:13:57.5162854Z Actions: write 2023-01-11T21:13:57.5163243Z Checks: write 2023-01-11T21:13:57.5163535Z Contents: write 2023-01-11T21:13:57.5163788Z Deployments: write 2023-01-11T21:13:57.5164085Z Discussions: write 2023-01-11T21:13:57.5164406Z Issues: write 2023-01-11T21:13:57.5164643Z Metadata: read 2023-01-11T21:13:57.5164933Z Packages: write 2023-01-11T21:13:57.5165240Z Pages: write 2023-01-11T21:13:57.5165494Z PullRequests: write 2023-01-11T21:13:57.5165849Z RepositoryProjects: write 2023-01-11T21:13:57.5166184Z SecurityEvents: write 2023-01-11T21:13:57.5166441Z Statuses: write 2023-01-11T21:13:57.5166726Z ##[endgroup] 2023-01-11T21:13:57.5170147Z Secret source: Actions 2023-01-11T21:13:57.5170783Z Prepare workflow directory 2023-01-11T21:13:57.8818694Z Prepare all required actions 2023-01-11T21:13:57.8980060Z Getting action download info 2023-01-11T21:13:58.1028415Z Download action repository 'pytorch/pytorch@master' (SHA:c5836153f5332ca83d5cacde38f2829a4d54793e) 2023-01-11T21:14:01.4632215Z Getting action download info 2023-01-11T21:14:01.6625287Z Download action repository 'malfet/checkout@silent-checkout' (SHA:c7b8fef48edfe1bca0044a44b1f7f7c4318a3076) 2023-01-11T21:14:01.9177972Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml 2023-01-11T21:14:01.9179702Z ##[group] Inputs 2023-01-11T21:14:01.9180110Z build-environment: linux-bionic-cuda11.6-py3.10-gcc7-sm86 2023-01-11T21:14:01.9181268Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "default", shard: 3, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "default", shard: 4, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "slow", shard: 1, num_shards: 2, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "slow", shard: 2, num_shards: 2, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "functorch", shard: 1, num_shards: 1, runner: "linux.g5.4xlarge.nvidia.gpu" }, ]} 2023-01-11T21:14:01.9182510Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-bionic-cuda11.6-cudnn8-py3-gcc7:fd224c2e6c79d7fdec6408da598bf52bc5b201dd 2023-01-11T21:14:01.9182999Z sync-tag: 2023-01-11T21:14:01.9183925Z timeout-minutes: 240 2023-01-11T21:14:01.9184161Z use-gha: 2023-01-11T21:14:01.9184419Z ##[endgroup] 2023-01-11T21:14:01.9184982Z Complete job name: cuda11.6-py3.10-gcc7-sm86 / filter 2023-01-11T21:14:01.9846742Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@master 2023-01-11T21:14:01.9847041Z with: 2023-01-11T21:14:01.9847206Z fetch-depth: 1 2023-01-11T21:14:01.9847389Z submodules: false 2023-01-11T21:14:01.9847561Z env: 2023-01-11T21:14:01.9847738Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:01.9847925Z ##[endgroup] 2023-01-11T21:14:02.0066805Z ##[group]Run retry () { 2023-01-11T21:14:02.0067066Z retry () { 2023-01-11T21:14:02.0067283Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2023-01-11T21:14:02.0067494Z } 2023-01-11T21:14:02.0067678Z echo "${GITHUB_WORKSPACE}" 2023-01-11T21:14:02.0067899Z if [ -z "${NO_SUDO}" ]; then 2023-01-11T21:14:02.0068112Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2023-01-11T21:14:02.0068325Z else 2023-01-11T21:14:02.0068562Z  retry rm -rf "${GITHUB_WORKSPACE}" 2023-01-11T21:14:02.0068743Z fi 2023-01-11T21:14:02.0068974Z mkdir "${GITHUB_WORKSPACE}" 2023-01-11T21:14:02.0084286Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:02.0084513Z env: 2023-01-11T21:14:02.0084696Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:02.0085010Z NO_SUDO: 2023-01-11T21:14:02.0085171Z ##[endgroup] 2023-01-11T21:14:02.0272233Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:14:02.3144767Z ##[group]Run malfet/checkout@silent-checkout 2023-01-11T21:14:02.3144985Z with: 2023-01-11T21:14:02.3145193Z ref: 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:14:02.3145410Z fetch-depth: 1 2023-01-11T21:14:02.3145581Z submodules: false 2023-01-11T21:14:02.3145767Z quiet-checkout: true 2023-01-11T21:14:02.3145968Z repository: pytorch/pytorch 2023-01-11T21:14:02.3146316Z token: *** 2023-01-11T21:14:02.3146493Z ssh-strict: true 2023-01-11T21:14:02.3146691Z persist-credentials: true 2023-01-11T21:14:02.3146871Z clean: true 2023-01-11T21:14:02.3147035Z lfs: false 2023-01-11T21:14:02.3147227Z set-safe-directory: true 2023-01-11T21:14:02.3147399Z env: 2023-01-11T21:14:02.3147569Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:02.3147755Z ##[endgroup] 2023-01-11T21:14:02.4500933Z Syncing repository: pytorch/pytorch 2023-01-11T21:14:02.4503008Z ##[group]Getting Git version info 2023-01-11T21:14:02.4503660Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2023-01-11T21:14:02.4504447Z [command]/usr/bin/git version 2023-01-11T21:14:02.4504777Z git version 2.38.1 2023-01-11T21:14:02.4528301Z ##[endgroup] 2023-01-11T21:14:02.4551970Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/1aa6a118-3f34-469c-8b87-37cea09fdea7' before making global git config changes 2023-01-11T21:14:02.4552653Z Adding repository directory to the temporary git global config as a safe directory 2023-01-11T21:14:02.4553402Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:14:02.4585907Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2023-01-11T21:14:02.4592293Z ##[group]Initializing the repository 2023-01-11T21:14:02.4596648Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:14:02.4627727Z hint: Using 'master' as the name for the initial branch. This default branch name 2023-01-11T21:14:02.4628694Z hint: is subject to change. To configure the initial branch name to use in all 2023-01-11T21:14:02.4629547Z hint: of your new repositories, which will suppress this warning, call: 2023-01-11T21:14:02.4630254Z hint: 2023-01-11T21:14:02.4631058Z hint: git config --global init.defaultBranch 2023-01-11T21:14:02.4634169Z hint: 2023-01-11T21:14:02.4635113Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-01-11T21:14:02.4640043Z hint: 'development'. The just-created branch can be renamed via this command: 2023-01-11T21:14:02.4640288Z hint: 2023-01-11T21:14:02.4640639Z hint: git branch -m 2023-01-11T21:14:02.4646293Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2023-01-11T21:14:02.4654077Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2023-01-11T21:14:02.4683855Z ##[endgroup] 2023-01-11T21:14:02.4684955Z ##[group]Disabling automatic garbage collection 2023-01-11T21:14:02.4688140Z [command]/usr/bin/git config --local gc.auto 0 2023-01-11T21:14:02.4714947Z ##[endgroup] 2023-01-11T21:14:02.4718008Z ##[group]Setting up auth 2023-01-11T21:14:02.4726213Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-01-11T21:14:02.4756137Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2023-01-11T21:14:02.4991545Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-01-11T21:14:02.5013631Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2023-01-11T21:14:02.5242477Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2023-01-11T21:14:02.5287596Z ##[endgroup] 2023-01-11T21:14:02.5290124Z ##[group]Fetching the repository 2023-01-11T21:14:02.5298634Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --quiet --no-recurse-submodules --depth=1 origin 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:14:11.1874034Z ##[endgroup] 2023-01-11T21:14:11.1875343Z ##[group]Determining the checkout info 2023-01-11T21:14:11.1881144Z ##[endgroup] 2023-01-11T21:14:11.1882610Z ##[group]Checking out the ref 2023-01-11T21:14:11.1886542Z [command]/usr/bin/git checkout --quiet --force 8419ddda87c8a47eacc63b54bc7ec98c1f27c26e 2023-01-11T21:14:12.3511038Z ##[endgroup] 2023-01-11T21:14:12.3552762Z [command]/usr/bin/git log -1 --format='%H' 2023-01-11T21:14:12.3578911Z '8419ddda87c8a47eacc63b54bc7ec98c1f27c26e' 2023-01-11T21:14:12.3745724Z Prepare all required actions 2023-01-11T21:14:12.3746006Z Getting action download info 2023-01-11T21:14:12.5871104Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2023-01-11T21:14:12.7334004Z ##[group]Run ./.github/actions/filter-test-configs 2023-01-11T21:14:12.7334218Z with: 2023-01-11T21:14:12.7334708Z github-token: *** 2023-01-11T21:14:12.7335474Z test-matrix: { include: [ { config: "default", shard: 1, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "default", shard: 2, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "default", shard: 3, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "default", shard: 4, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "slow", shard: 1, num_shards: 2, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "slow", shard: 2, num_shards: 2, runner: "linux.g5.4xlarge.nvidia.gpu" }, { config: "functorch", shard: 1, num_shards: 1, runner: "linux.g5.4xlarge.nvidia.gpu" }, ]} 2023-01-11T21:14:12.7336167Z env: 2023-01-11T21:14:12.7336466Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:12.7336680Z ##[endgroup] 2023-01-11T21:14:12.7362065Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2023-01-11T21:14:12.7362286Z with: 2023-01-11T21:14:12.7362445Z shell: bash 2023-01-11T21:14:12.7362620Z timeout_minutes: 10 2023-01-11T21:14:12.7362786Z max_attempts: 5 2023-01-11T21:14:12.7362963Z retry_wait_seconds: 30 2023-01-11T21:14:12.7363209Z command: set -eux python3 -m pip install requests==2.26.0 pyyaml==6.0 2023-01-11T21:14:12.7363461Z polling_interval_seconds: 1 2023-01-11T21:14:12.7363642Z warning_on_retry: true 2023-01-11T21:14:12.7363829Z continue_on_error: false 2023-01-11T21:14:12.7364005Z env: 2023-01-11T21:14:12.7364163Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:12.7364526Z GITHUB_TOKEN: *** 2023-01-11T21:14:12.7364702Z ##[endgroup] 2023-01-11T21:14:12.7857820Z + python3 -m pip install requests==2.26.0 pyyaml==6.0 2023-01-11T21:14:13.0283549Z Defaulting to user installation because normal site-packages is not writeable 2023-01-11T21:14:13.0442321Z Requirement already satisfied: requests==2.26.0 in /home/ec2-user/.local/lib/python3.7/site-packages (2.26.0) 2023-01-11T21:14:13.0582311Z Requirement already satisfied: pyyaml==6.0 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0) 2023-01-11T21:14:13.0590986Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2022.12.7) 2023-01-11T21:14:13.0602035Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (3.4) 2023-01-11T21:14:13.0614891Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (2.0.12) 2023-01-11T21:14:13.0635637Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.26.0) (1.26.14) 2023-01-11T21:14:13.7835756Z Command completed after 1 attempt(s). 2023-01-11T21:14:13.7871233Z ##[group]Run .github/scripts/parse_ref.py 2023-01-11T21:14:13.7871483Z .github/scripts/parse_ref.py 2023-01-11T21:14:13.7882863Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:13.7883088Z env: 2023-01-11T21:14:13.7883267Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:13.7883453Z ##[endgroup] 2023-01-11T21:14:13.8152261Z ##[group]Run .github/scripts/filter_test_configs.py \ 2023-01-11T21:14:13.8152560Z .github/scripts/filter_test_configs.py \ 2023-01-11T21:14:13.8152804Z  --test-matrix "{ include: [ 2023-01-11T21:14:13.8153086Z  { config: "default", shard: 1, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, 2023-01-11T21:14:13.8153505Z  { config: "default", shard: 2, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, 2023-01-11T21:14:13.8153852Z  { config: "default", shard: 3, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, 2023-01-11T21:14:13.8154183Z  { config: "default", shard: 4, num_shards: 4, runner: "linux.g5.4xlarge.nvidia.gpu" }, 2023-01-11T21:14:13.8154520Z  { config: "slow", shard: 1, num_shards: 2, runner: "linux.g5.4xlarge.nvidia.gpu" }, 2023-01-11T21:14:13.8154852Z  { config: "slow", shard: 2, num_shards: 2, runner: "linux.g5.4xlarge.nvidia.gpu" }, 2023-01-11T21:14:13.8155189Z  { config: "functorch", shard: 1, num_shards: 1, runner: "linux.g5.4xlarge.nvidia.gpu" }, 2023-01-11T21:14:13.8155427Z ]} 2023-01-11T21:14:13.8155593Z " \ 2023-01-11T21:14:13.8155777Z  --pr-number "" \ 2023-01-11T21:14:13.8155974Z  --tag "ciflow/trunk/91627" \ 2023-01-11T21:14:13.8156186Z  --event-name "push" \ 2023-01-11T21:14:13.8156387Z  --schedule "" 2023-01-11T21:14:13.8167309Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:13.8167536Z env: 2023-01-11T21:14:13.8167717Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:13.8168130Z GITHUB_TOKEN: *** 2023-01-11T21:14:13.8168436Z ##[endgroup] 2023-01-11T21:14:14.1432294Z ##[group]Run echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "slow", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "slow", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "functorch", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2023-01-11T21:14:14.1433569Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "slow", "shard": 1, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "slow", "shard": 2, "num_shards": 2, "runner": "linux.g5.4xlarge.nvidia.gpu"}, {"config": "functorch", "shard": 1, "num_shards": 1, "runner": "linux.g5.4xlarge.nvidia.gpu"}]}" 2023-01-11T21:14:14.1445053Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2023-01-11T21:14:14.1445262Z env: 2023-01-11T21:14:14.1445441Z GIT_DEFAULT_BRANCH: master 2023-01-11T21:14:14.1445631Z ##[endgroup] 2023-01-11T21:14:14.1475967Z {include: [{config: default, shard: 1, num_shards: 4, runner: linux.g5.4xlarge.nvidia.gpu}, {config: default, shard: 2, num_shards: 4, runner: linux.g5.4xlarge.nvidia.gpu}, {config: default, shard: 3, num_shards: 4, runner: linux.g5.4xlarge.nvidia.gpu}, {config: default, shard: 4, num_shards: 4, runner: linux.g5.4xlarge.nvidia.gpu}, {config: slow, shard: 1, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: slow, shard: 2, num_shards: 2, runner: linux.g5.4xlarge.nvidia.gpu}, {config: functorch, shard: 1, num_shards: 1, runner: linux.g5.4xlarge.nvidia.gpu}]} 2023-01-11T21:14:14.1566311Z Post job cleanup. 2023-01-11T21:14:14.1595104Z Post job cleanup. 2023-01-11T21:14:14.2640988Z [command]/usr/bin/git version 2023-01-11T21:14:14.2703018Z git version 2.38.1 2023-01-11T21:14:14.2752902Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/4a8b9020-684a-41cd-855c-f0ed7d03ac27' before making global git config changes 2023-01-11T21:14:14.2756854Z Adding repository directory to the temporary git global config as a safe directory 2023-01-11T21:14:14.2762874Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2023-01-11T21:14:14.2800584Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-01-11T21:14:14.2832574Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || : 2023-01-11T21:14:14.3111461Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-01-11T21:14:14.3127913Z http.https://github.com/.extraheader 2023-01-11T21:14:14.3143860Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2023-01-11T21:14:14.3164937Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || : 2023-01-11T21:14:14.3587958Z Evaluate and set job outputs 2023-01-11T21:14:14.3598496Z Set output 'test-matrix' 2023-01-11T21:14:14.3599319Z Set output 'is-test-matrix-empty' 2023-01-11T21:14:14.3599645Z Set output 'keep-going' 2023-01-11T21:14:14.3600241Z Cleaning up orphan processes