2024-06-26T04:56:11.4687037Z Current runner version: '2.317.0' 2024-06-26T04:56:11.4693758Z Runner name: 'i-045f62e1b5b74b837' 2024-06-26T04:56:11.4694532Z Runner group name: 'Default' 2024-06-26T04:56:11.4695441Z Machine name: 'ip-10-0-78-115' 2024-06-26T04:56:11.4699937Z ##[group]GITHUB_TOKEN Permissions 2024-06-26T04:56:11.4702064Z Actions: read 2024-06-26T04:56:11.4702577Z Attestations: read 2024-06-26T04:56:11.4703140Z Checks: read 2024-06-26T04:56:11.4703598Z Contents: read 2024-06-26T04:56:11.4704086Z Deployments: read 2024-06-26T04:56:11.4704608Z Discussions: read 2024-06-26T04:56:11.4705068Z Issues: read 2024-06-26T04:56:11.4705534Z Metadata: read 2024-06-26T04:56:11.4706031Z Packages: read 2024-06-26T04:56:11.4706491Z Pages: read 2024-06-26T04:56:11.4706972Z PullRequests: read 2024-06-26T04:56:11.4707518Z RepositoryProjects: read 2024-06-26T04:56:11.4708047Z SecurityEvents: read 2024-06-26T04:56:11.4708559Z Statuses: read 2024-06-26T04:56:11.4709075Z ##[endgroup] 2024-06-26T04:56:11.4713024Z Secret source: Actions 2024-06-26T04:56:11.4713851Z Prepare workflow directory 2024-06-26T04:56:11.8367608Z Prepare all required actions 2024-06-26T04:56:11.8542485Z Getting action download info 2024-06-26T04:56:12.0265742Z Download action repository 'pytorch/test-infra@main' (SHA:43a2ce341cc31288e9a38b65ce600a7f43021bd5) 2024-06-26T04:56:12.3925068Z Download action repository 'pytorch/pytorch@main' (SHA:6181e65cd81725efc6bc5d64ef3be607b0aa3ca1) 2024-06-26T04:56:15.2750590Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-06-26T04:56:15.4252054Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-06-26T04:56:15.7376200Z Getting action download info 2024-06-26T04:56:15.8285698Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-06-26T04:56:16.0491341Z Getting action download info 2024-06-26T04:56:16.1474855Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-06-26T04:56:16.2981107Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/pull/129470/merge (4b51b1a62a63a1add1b3a0f7882f5c7dc66b8f8d) 2024-06-26T04:56:16.2983753Z ##[group] Inputs 2024-06-26T04:56:16.2984167Z build-environment: linux-jammy-py3.8-gcc11 2024-06-26T04:56:16.2987370Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]} 2024-06-26T04:56:16.2990978Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:56:16.2992231Z sync-tag: 2024-06-26T04:56:16.2993169Z timeout-minutes: 240 2024-06-26T04:56:16.2993496Z use-gha: 2024-06-26T04:56:16.2993758Z dashboard-tag: 2024-06-26T04:56:16.2994071Z s3-bucket: gha-artifacts 2024-06-26T04:56:16.2994415Z aws-role-to-assume: 2024-06-26T04:56:16.2994724Z ##[endgroup] 2024-06-26T04:56:16.2995491Z Complete job name: linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T04:56:16.3550215Z A job started hook has been configured by the self-hosted runner administrator 2024-06-26T04:56:16.3699784Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T04:56:16.3711149Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:56:16.3711854Z ##[endgroup] 2024-06-26T04:56:16.9976308Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-06-26T04:56:16.9977106Z with: 2024-06-26T04:56:16.9977902Z github-secret: *** 2024-06-26T04:56:16.9978928Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-06-26T04:56:16.9980031Z activate-with-label: false 2024-06-26T04:56:16.9980419Z label: with-ssh 2024-06-26T04:56:16.9980790Z remove-existing-keys: true 2024-06-26T04:56:16.9981219Z fail-silently: true 2024-06-26T04:56:16.9981552Z env: 2024-06-26T04:56:16.9981866Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:56:16.9982252Z ##[endgroup] 2024-06-26T04:56:17.0886635Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-06-26T04:56:17.3663810Z Grabbing public ssh keys from https://github.com/leslie-fang-intel.keys 2024-06-26T04:56:17.4335775Z No SSH keys found for user leslie-fang-intel 2024-06-26T04:56:17.4336730Z Grabbing public ssh keys from https://github.com/leslie-fang-intel.keys 2024-06-26T04:56:17.5077098Z No SSH keys found for user leslie-fang-intel 2024-06-26T04:56:17.5192081Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-06-26T04:56:17.5192628Z with: 2024-06-26T04:56:17.5192892Z submodules: recursive 2024-06-26T04:56:17.5193214Z fetch-depth: 0 2024-06-26T04:56:17.5193475Z env: 2024-06-26T04:56:17.5193733Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:56:17.5194062Z ##[endgroup] 2024-06-26T04:56:17.5393265Z ##[group]Run retry () { 2024-06-26T04:56:17.5393669Z retry () { 2024-06-26T04:56:17.5394163Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-06-26T04:56:17.5394734Z } 2024-06-26T04:56:17.5395019Z echo "${GITHUB_WORKSPACE}" 2024-06-26T04:56:17.5395427Z if [ -z "${NO_SUDO}" ]; then 2024-06-26T04:56:17.5395896Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T04:56:17.5396330Z else 2024-06-26T04:56:17.5396668Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-06-26T04:56:17.5397087Z fi 2024-06-26T04:56:17.5397425Z mkdir "${GITHUB_WORKSPACE}" 2024-06-26T04:56:17.5405533Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:56:17.5406047Z env: 2024-06-26T04:56:17.5406319Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:56:17.5406641Z NO_SUDO: 2024-06-26T04:56:17.5406904Z ##[endgroup] 2024-06-26T04:56:17.5430824Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T04:56:19.6723306Z ##[group]Run malfet/checkout@silent-checkout 2024-06-26T04:56:19.6723743Z with: 2024-06-26T04:56:19.6724052Z ref: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T04:56:19.6724473Z fetch-depth: 0 2024-06-26T04:56:19.6724871Z submodules: recursive 2024-06-26T04:56:19.6725202Z quiet-checkout: true 2024-06-26T04:56:19.6725525Z repository: pytorch/pytorch 2024-06-26T04:56:19.6726011Z token: *** 2024-06-26T04:56:19.6726281Z ssh-strict: true 2024-06-26T04:56:19.6726608Z persist-credentials: true 2024-06-26T04:56:19.6726936Z clean: true 2024-06-26T04:56:19.6727254Z sparse-checkout-cone-mode: true 2024-06-26T04:56:19.6727631Z lfs: false 2024-06-26T04:56:19.6727900Z set-safe-directory: true 2024-06-26T04:56:19.6728221Z env: 2024-06-26T04:56:19.6728477Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:56:19.6728789Z ##[endgroup] 2024-06-26T04:56:19.7693830Z Syncing repository: pytorch/pytorch 2024-06-26T04:56:19.7695565Z ##[group]Getting Git version info 2024-06-26T04:56:19.7696359Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T04:56:19.7697391Z [command]/usr/bin/git version 2024-06-26T04:56:19.7697736Z git version 2.40.1 2024-06-26T04:56:19.7699108Z ##[endgroup] 2024-06-26T04:56:19.7711243Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/153afe4f-28a9-475f-83c6-20d4de3e1f36' before making global git config changes 2024-06-26T04:56:19.7712789Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T04:56:19.7714145Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T04:56:19.7748790Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-06-26T04:56:19.7753041Z ##[group]Initializing the repository 2024-06-26T04:56:19.7756101Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T04:56:19.7868393Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-06-26T04:56:19.7869508Z hint: is subject to change. To configure the initial branch name to use in all 2024-06-26T04:56:19.7870557Z hint: of your new repositories, which will suppress this warning, call: 2024-06-26T04:56:19.7871420Z hint: 2024-06-26T04:56:19.7872120Z hint: git config --global init.defaultBranch 2024-06-26T04:56:19.7872585Z hint: 2024-06-26T04:56:19.7873094Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-06-26T04:56:19.7873955Z hint: 'development'. The just-created branch can be renamed via this command: 2024-06-26T04:56:19.7874823Z hint: 2024-06-26T04:56:19.7875237Z hint: git branch -m 2024-06-26T04:56:19.7876716Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-06-26T04:56:19.7883717Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-06-26T04:56:19.7916521Z ##[endgroup] 2024-06-26T04:56:19.7917105Z ##[group]Disabling automatic garbage collection 2024-06-26T04:56:19.7920236Z [command]/usr/bin/git config --local gc.auto 0 2024-06-26T04:56:19.7949049Z ##[endgroup] 2024-06-26T04:56:19.7949547Z ##[group]Setting up auth 2024-06-26T04:56:19.7955381Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T04:56:19.7983905Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T04:56:19.8219581Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T04:56:19.8250287Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T04:56:19.8486696Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T04:56:19.8529203Z ##[endgroup] 2024-06-26T04:56:19.8529859Z ##[group]Fetching the repository 2024-06-26T04:56:19.8535699Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-06-26T04:56:21.9857253Z remote: Enumerating objects: 987778 2024-06-26T04:56:21.9857811Z remote: Enumerating objects: 989963, done. 2024-06-26T04:56:21.9858744Z remote: Counting objects: 0% (1/2185) 2024-06-26T04:56:21.9859606Z remote: Counting objects: 1% (22/2185) 2024-06-26T04:56:21.9860116Z remote: Counting objects: 2% (44/2185) 2024-06-26T04:56:21.9860625Z remote: Counting objects: 3% (66/2185) 2024-06-26T04:56:21.9861240Z remote: Counting objects: 4% (88/2185) 2024-06-26T04:56:21.9861855Z remote: Counting objects: 5% (110/2185) 2024-06-26T04:56:21.9862423Z remote: Counting objects: 6% (132/2185) 2024-06-26T04:56:21.9862924Z remote: Counting objects: 7% (153/2185) 2024-06-26T04:56:21.9863431Z remote: Counting objects: 8% (175/2185) 2024-06-26T04:56:21.9864355Z remote: Counting objects: 9% (197/2185) 2024-06-26T04:56:21.9864872Z remote: Counting objects: 10% (219/2185) 2024-06-26T04:56:21.9865708Z remote: Counting objects: 11% (241/2185) 2024-06-26T04:56:21.9866236Z remote: Counting objects: 12% (263/2185) 2024-06-26T04:56:21.9867155Z remote: Counting objects: 13% (285/2185) 2024-06-26T04:56:21.9867650Z remote: Counting objects: 14% (306/2185) 2024-06-26T04:56:21.9868164Z remote: Counting objects: 15% (328/2185) 2024-06-26T04:56:21.9868840Z remote: Counting objects: 16% (350/2185) 2024-06-26T04:56:21.9869463Z remote: Counting objects: 17% (372/2185) 2024-06-26T04:56:21.9869962Z remote: Counting objects: 18% (394/2185) 2024-06-26T04:56:21.9870536Z remote: Counting objects: 19% (416/2185) 2024-06-26T04:56:21.9871401Z remote: Counting objects: 20% (437/2185) 2024-06-26T04:56:21.9873005Z remote: Counting objects: 21% (459/2185) 2024-06-26T04:56:21.9873543Z remote: Counting objects: 22% (481/2185) 2024-06-26T04:56:21.9874136Z remote: Counting objects: 23% (503/2185) 2024-06-26T04:56:21.9874635Z remote: Counting objects: 24% (525/2185) 2024-06-26T04:56:21.9875264Z remote: Counting objects: 25% (547/2185) 2024-06-26T04:56:21.9875797Z remote: Counting objects: 26% (569/2185) 2024-06-26T04:56:21.9876331Z remote: Counting objects: 27% (590/2185) 2024-06-26T04:56:21.9877069Z remote: Counting objects: 28% (612/2185) 2024-06-26T04:56:21.9877671Z remote: Counting objects: 29% (634/2185) 2024-06-26T04:56:21.9878233Z remote: Counting objects: 30% (656/2185) 2024-06-26T04:56:21.9878874Z remote: Counting objects: 31% (678/2185) 2024-06-26T04:56:21.9879369Z remote: Counting objects: 32% (700/2185) 2024-06-26T04:56:21.9879991Z remote: Counting objects: 33% (722/2185) 2024-06-26T04:56:21.9880490Z remote: Counting objects: 34% (743/2185) 2024-06-26T04:56:21.9881015Z remote: Counting objects: 35% (765/2185) 2024-06-26T04:56:21.9881644Z remote: Counting objects: 36% (787/2185) 2024-06-26T04:56:21.9882175Z remote: Counting objects: 37% (809/2185) 2024-06-26T04:56:21.9882767Z remote: Counting objects: 38% (831/2185) 2024-06-26T04:56:21.9883255Z remote: Counting objects: 39% (853/2185) 2024-06-26T04:56:21.9884453Z remote: Counting objects: 40% (874/2185) 2024-06-26T04:56:21.9885034Z remote: Counting objects: 41% (896/2185) 2024-06-26T04:56:21.9885698Z remote: Counting objects: 42% (918/2185) 2024-06-26T04:56:21.9886196Z remote: Counting objects: 43% (940/2185) 2024-06-26T04:56:21.9886757Z remote: Counting objects: 44% (962/2185) 2024-06-26T04:56:21.9887319Z remote: Counting objects: 45% (984/2185) 2024-06-26T04:56:21.9890508Z remote: Counting objects: 46% (1006/2185) 2024-06-26T04:56:21.9891032Z remote: Counting objects: 47% (1027/2185) 2024-06-26T04:56:21.9895502Z remote: Counting objects: 48% (1049/2185) 2024-06-26T04:56:21.9896015Z remote: Counting objects: 49% (1071/2185) 2024-06-26T04:56:21.9896541Z remote: Counting objects: 50% (1093/2185) 2024-06-26T04:56:21.9897970Z remote: Counting objects: 51% (1115/2185) 2024-06-26T04:56:21.9898580Z remote: Counting objects: 52% (1137/2185) 2024-06-26T04:56:21.9899175Z remote: Counting objects: 53% (1159/2185) 2024-06-26T04:56:21.9899688Z remote: Counting objects: 54% (1180/2185) 2024-06-26T04:56:21.9900210Z remote: Counting objects: 55% (1202/2185) 2024-06-26T04:56:21.9900713Z remote: Counting objects: 56% (1224/2185) 2024-06-26T04:56:21.9901225Z remote: Counting objects: 57% (1246/2185) 2024-06-26T04:56:21.9901738Z remote: Counting objects: 58% (1268/2185) 2024-06-26T04:56:21.9902243Z remote: Counting objects: 59% (1290/2185) 2024-06-26T04:56:21.9902756Z remote: Counting objects: 60% (1311/2185) 2024-06-26T04:56:21.9903677Z remote: Counting objects: 61% (1333/2185) 2024-06-26T04:56:21.9904401Z remote: Counting objects: 62% (1355/2185) 2024-06-26T04:56:21.9905246Z remote: Counting objects: 63% (1377/2185) 2024-06-26T04:56:21.9905963Z remote: Counting objects: 64% (1399/2185) 2024-06-26T04:56:21.9906789Z remote: Counting objects: 65% (1421/2185) 2024-06-26T04:56:21.9907556Z remote: Counting objects: 66% (1443/2185) 2024-06-26T04:56:21.9908493Z remote: Counting objects: 67% (1464/2185) 2024-06-26T04:56:21.9909297Z remote: Counting objects: 68% (1486/2185) 2024-06-26T04:56:21.9909989Z remote: Counting objects: 69% (1508/2185) 2024-06-26T04:56:21.9910717Z remote: Counting objects: 70% (1530/2185) 2024-06-26T04:56:21.9911237Z remote: Counting objects: 71% (1552/2185) 2024-06-26T04:56:21.9912204Z remote: Counting objects: 72% (1574/2185) 2024-06-26T04:56:21.9913132Z remote: Counting objects: 73% (1596/2185) 2024-06-26T04:56:21.9913656Z remote: Counting objects: 74% (1617/2185) 2024-06-26T04:56:21.9914177Z remote: Counting objects: 75% (1639/2185) 2024-06-26T04:56:21.9914678Z remote: Counting objects: 76% (1661/2185) 2024-06-26T04:56:21.9915248Z remote: Counting objects: 77% (1683/2185) 2024-06-26T04:56:21.9915778Z remote: Counting objects: 78% (1705/2185) 2024-06-26T04:56:21.9916445Z remote: Counting objects: 79% (1727/2185) 2024-06-26T04:56:21.9916967Z remote: Counting objects: 80% (1748/2185) 2024-06-26T04:56:21.9917486Z remote: Counting objects: 81% (1770/2185) 2024-06-26T04:56:21.9918008Z remote: Counting objects: 82% (1792/2185) 2024-06-26T04:56:21.9918522Z remote: Counting objects: 83% (1814/2185) 2024-06-26T04:56:21.9919043Z remote: Counting objects: 84% (1836/2185) 2024-06-26T04:56:21.9919544Z remote: Counting objects: 85% (1858/2185) 2024-06-26T04:56:21.9920062Z remote: Counting objects: 86% (1880/2185) 2024-06-26T04:56:21.9920579Z remote: Counting objects: 87% (1901/2185) 2024-06-26T04:56:21.9921087Z remote: Counting objects: 88% (1923/2185) 2024-06-26T04:56:21.9921593Z remote: Counting objects: 89% (1945/2185) 2024-06-26T04:56:21.9922100Z remote: Counting objects: 90% (1967/2185) 2024-06-26T04:56:21.9922624Z remote: Counting objects: 91% (1989/2185) 2024-06-26T04:56:21.9923142Z remote: Counting objects: 92% (2011/2185) 2024-06-26T04:56:21.9923651Z remote: Counting objects: 93% (2033/2185) 2024-06-26T04:56:21.9924157Z remote: Counting objects: 94% (2054/2185) 2024-06-26T04:56:21.9924654Z remote: Counting objects: 95% (2076/2185) 2024-06-26T04:56:21.9925433Z remote: Counting objects: 96% (2098/2185) 2024-06-26T04:56:21.9925951Z remote: Counting objects: 97% (2120/2185) 2024-06-26T04:56:21.9926447Z remote: Counting objects: 98% (2142/2185) 2024-06-26T04:56:21.9926959Z remote: Counting objects: 99% (2164/2185) 2024-06-26T04:56:21.9927476Z remote: Counting objects: 100% (2185/2185) 2024-06-26T04:56:21.9928011Z remote: Counting objects: 100% (2185/2185), done. 2024-06-26T04:56:22.0010635Z remote: Compressing objects: 0% (1/895) 2024-06-26T04:56:22.0285535Z remote: Compressing objects: 1% (9/895) 2024-06-26T04:56:22.0597551Z remote: Compressing objects: 2% (18/895) 2024-06-26T04:56:22.0905161Z remote: Compressing objects: 3% (27/895) 2024-06-26T04:56:22.1198789Z remote: Compressing objects: 4% (36/895) 2024-06-26T04:56:22.1323592Z remote: Compressing objects: 5% (45/895) 2024-06-26T04:56:22.1447233Z remote: Compressing objects: 6% (54/895) 2024-06-26T04:56:22.1602219Z remote: Compressing objects: 7% (63/895) 2024-06-26T04:56:22.1736870Z remote: Compressing objects: 8% (72/895) 2024-06-26T04:56:22.2039470Z remote: Compressing objects: 9% (81/895) 2024-06-26T04:56:22.2708894Z remote: Compressing objects: 10% (90/895) 2024-06-26T04:56:22.3242202Z remote: Compressing objects: 11% (99/895) 2024-06-26T04:56:22.3947470Z remote: Compressing objects: 12% (108/895) 2024-06-26T04:56:22.4150068Z remote: Compressing objects: 13% (117/895) 2024-06-26T04:56:22.4270427Z remote: Compressing objects: 14% (126/895) 2024-06-26T04:56:22.4366621Z remote: Compressing objects: 15% (135/895) 2024-06-26T04:56:22.4458589Z remote: Compressing objects: 16% (144/895) 2024-06-26T04:56:22.4505268Z remote: Compressing objects: 17% (153/895) 2024-06-26T04:56:22.4510401Z remote: Compressing objects: 18% (162/895) 2024-06-26T04:56:22.4515220Z remote: Compressing objects: 19% (171/895) 2024-06-26T04:56:22.4537544Z remote: Compressing objects: 20% (179/895) 2024-06-26T04:56:22.4548513Z remote: Compressing objects: 21% (188/895) 2024-06-26T04:56:22.4562903Z remote: Compressing objects: 22% (197/895) 2024-06-26T04:56:22.4574440Z remote: Compressing objects: 23% (206/895) 2024-06-26T04:56:22.4590088Z remote: Compressing objects: 24% (215/895) 2024-06-26T04:56:22.4605794Z remote: Compressing objects: 25% (224/895) 2024-06-26T04:56:22.4616342Z remote: Compressing objects: 26% (233/895) 2024-06-26T04:56:22.4626854Z remote: Compressing objects: 27% (242/895) 2024-06-26T04:56:22.4629677Z remote: Compressing objects: 28% (251/895) 2024-06-26T04:56:22.4630218Z remote: Compressing objects: 29% (260/895) 2024-06-26T04:56:22.4630759Z remote: Compressing objects: 30% (269/895) 2024-06-26T04:56:22.4633379Z remote: Compressing objects: 31% (278/895) 2024-06-26T04:56:22.4640320Z remote: Compressing objects: 32% (287/895) 2024-06-26T04:56:22.4646455Z remote: Compressing objects: 33% (296/895) 2024-06-26T04:56:22.4649642Z remote: Compressing objects: 34% (305/895) 2024-06-26T04:56:22.4654904Z remote: Compressing objects: 35% (314/895) 2024-06-26T04:56:22.4660431Z remote: Compressing objects: 36% (323/895) 2024-06-26T04:56:22.4664891Z remote: Compressing objects: 37% (332/895) 2024-06-26T04:56:22.4676022Z remote: Compressing objects: 38% (341/895) 2024-06-26T04:56:22.4682958Z remote: Compressing objects: 39% (350/895) 2024-06-26T04:56:22.4695683Z remote: Compressing objects: 40% (358/895) 2024-06-26T04:56:22.4705866Z remote: Compressing objects: 41% (367/895) 2024-06-26T04:56:22.4718185Z remote: Compressing objects: 42% (376/895) 2024-06-26T04:56:22.4732304Z remote: Compressing objects: 43% (385/895) 2024-06-26T04:56:22.4745276Z remote: Compressing objects: 44% (394/895) 2024-06-26T04:56:22.4755034Z remote: Compressing objects: 45% (403/895) 2024-06-26T04:56:22.4769057Z remote: Compressing objects: 46% (412/895) 2024-06-26T04:56:22.4783825Z remote: Compressing objects: 47% (421/895) 2024-06-26T04:56:22.4794359Z remote: Compressing objects: 48% (430/895) 2024-06-26T04:56:22.4806787Z remote: Compressing objects: 49% (439/895) 2024-06-26T04:56:22.4815586Z remote: Compressing objects: 50% (448/895) 2024-06-26T04:56:22.4818440Z remote: Compressing objects: 51% (457/895) 2024-06-26T04:56:22.4823421Z remote: Compressing objects: 52% (466/895) 2024-06-26T04:56:22.4826557Z remote: Compressing objects: 53% (475/895) 2024-06-26T04:56:22.4845054Z remote: Compressing objects: 54% (484/895) 2024-06-26T04:56:22.4852815Z remote: Compressing objects: 55% (493/895) 2024-06-26T04:56:22.4862139Z remote: Compressing objects: 56% (502/895) 2024-06-26T04:56:22.4869425Z remote: Compressing objects: 57% (511/895) 2024-06-26T04:56:22.4878448Z remote: Compressing objects: 58% (520/895) 2024-06-26T04:56:22.4890893Z remote: Compressing objects: 59% (529/895) 2024-06-26T04:56:22.4903674Z remote: Compressing objects: 60% (537/895) 2024-06-26T04:56:22.4913103Z remote: Compressing objects: 61% (546/895) 2024-06-26T04:56:22.4920368Z remote: Compressing objects: 62% (555/895) 2024-06-26T04:56:22.4930132Z remote: Compressing objects: 63% (564/895) 2024-06-26T04:56:22.4939779Z remote: Compressing objects: 64% (573/895) 2024-06-26T04:56:22.4953570Z remote: Compressing objects: 65% (582/895) 2024-06-26T04:56:22.4960129Z remote: Compressing objects: 66% (591/895) 2024-06-26T04:56:22.4966796Z remote: Compressing objects: 67% (600/895) 2024-06-26T04:56:22.4978616Z remote: Compressing objects: 68% (609/895) 2024-06-26T04:56:22.4982343Z remote: Compressing objects: 69% (618/895) 2024-06-26T04:56:22.4987873Z remote: Compressing objects: 70% (627/895) 2024-06-26T04:56:22.4995316Z remote: Compressing objects: 71% (636/895) 2024-06-26T04:56:22.5004707Z remote: Compressing objects: 72% (645/895) 2024-06-26T04:56:22.5013674Z remote: Compressing objects: 73% (654/895) 2024-06-26T04:56:22.5019529Z remote: Compressing objects: 74% (663/895) 2024-06-26T04:56:22.5023479Z remote: Compressing objects: 75% (672/895) 2024-06-26T04:56:22.5026178Z remote: Compressing objects: 76% (681/895) 2024-06-26T04:56:22.5029482Z remote: Compressing objects: 77% (690/895) 2024-06-26T04:56:22.5030434Z remote: Compressing objects: 78% (699/895) 2024-06-26T04:56:22.5031263Z remote: Compressing objects: 79% (708/895) 2024-06-26T04:56:22.5031996Z remote: Compressing objects: 80% (716/895) 2024-06-26T04:56:22.5034260Z remote: Compressing objects: 81% (725/895) 2024-06-26T04:56:22.5035036Z remote: Compressing objects: 82% (734/895) 2024-06-26T04:56:22.5040335Z remote: Compressing objects: 83% (743/895) 2024-06-26T04:56:22.5047530Z remote: Compressing objects: 84% (752/895) 2024-06-26T04:56:22.5048045Z remote: Compressing objects: 85% (761/895) 2024-06-26T04:56:22.5051687Z remote: Compressing objects: 86% (770/895) 2024-06-26T04:56:22.5053927Z remote: Compressing objects: 87% (779/895) 2024-06-26T04:56:22.5054473Z remote: Compressing objects: 88% (788/895) 2024-06-26T04:56:22.5055001Z remote: Compressing objects: 89% (797/895) 2024-06-26T04:56:22.5056703Z remote: Compressing objects: 90% (806/895) 2024-06-26T04:56:22.5057238Z remote: Compressing objects: 91% (815/895) 2024-06-26T04:56:22.5057995Z remote: Compressing objects: 92% (824/895) 2024-06-26T04:56:22.5058627Z remote: Compressing objects: 93% (833/895) 2024-06-26T04:56:22.5059166Z remote: Compressing objects: 94% (842/895) 2024-06-26T04:56:22.5059923Z remote: Compressing objects: 95% (851/895) 2024-06-26T04:56:22.5060528Z remote: Compressing objects: 96% (860/895) 2024-06-26T04:56:22.5061099Z remote: Compressing objects: 97% (869/895) 2024-06-26T04:56:22.5061635Z remote: Compressing objects: 98% (878/895) 2024-06-26T04:56:22.5062322Z remote: Compressing objects: 99% (887/895) 2024-06-26T04:56:22.5062850Z remote: Compressing objects: 100% (895/895) 2024-06-26T04:56:22.5063421Z remote: Compressing objects: 100% (895/895), done. 2024-06-26T04:56:42.3074694Z remote: Total 989963 (delta 1765), reused 1554 (delta 1289), pack-reused 987778 2024-06-26T04:57:08.9161287Z [command]/usr/bin/git rev-parse --verify --quiet b8c4c54d347aa776934c60784e35936878ef18dc^{object} 2024-06-26T04:57:08.9185557Z b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T04:57:08.9189581Z ##[endgroup] 2024-06-26T04:57:08.9190111Z ##[group]Determining the checkout info 2024-06-26T04:57:08.9192613Z ##[endgroup] 2024-06-26T04:57:08.9193326Z ##[group]Checking out the ref 2024-06-26T04:57:08.9195261Z [command]/usr/bin/git checkout --quiet --force b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T04:57:10.2483206Z ##[endgroup] 2024-06-26T04:57:10.2484200Z ##[group]Setting up auth for fetching submodules 2024-06-26T04:57:10.2488540Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-06-26T04:57:10.2533952Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-06-26T04:57:10.2562054Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-06-26T04:57:10.2589492Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-06-26T04:57:10.2613988Z ##[endgroup] 2024-06-26T04:57:10.2614918Z ##[group]Fetching submodules 2024-06-26T04:57:10.2618037Z [command]/usr/bin/git submodule sync --recursive 2024-06-26T04:57:10.2880377Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-06-26T04:57:10.3139779Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-06-26T04:57:10.3141301Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-06-26T04:57:10.3142773Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-06-26T04:57:10.3144201Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-06-26T04:57:10.3146604Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-06-26T04:57:10.3148328Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-06-26T04:57:10.3150811Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-06-26T04:57:10.3154276Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-06-26T04:57:10.3156347Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-06-26T04:57:10.3159341Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-06-26T04:57:10.3162005Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-06-26T04:57:10.3164928Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-06-26T04:57:10.3167975Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-06-26T04:57:10.3171145Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-06-26T04:57:10.3174266Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-06-26T04:57:10.3177565Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2024-06-26T04:57:10.3181147Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-06-26T04:57:10.3184426Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-06-26T04:57:10.3188097Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-06-26T04:57:10.3191555Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-06-26T04:57:10.3195783Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-06-26T04:57:10.3199741Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-06-26T04:57:10.3203894Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-06-26T04:57:10.3208193Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-06-26T04:57:10.3212439Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-06-26T04:57:10.3216634Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-06-26T04:57:10.3221389Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-06-26T04:57:10.3225607Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-06-26T04:57:10.3230263Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-06-26T04:57:10.3235132Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-06-26T04:57:10.3240147Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-06-26T04:57:10.3244980Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-06-26T04:57:10.3250041Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-06-26T04:57:10.3254913Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-06-26T04:57:10.3260249Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-06-26T04:57:10.3289324Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-06-26T04:57:10.5925444Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-06-26T04:57:10.7441244Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-06-26T04:57:11.4768353Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-06-26T04:57:11.7486210Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-06-26T04:57:14.0553516Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-06-26T04:57:26.0839720Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-06-26T04:57:26.4519204Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-06-26T04:57:27.0043030Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-06-26T04:57:27.5623177Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-06-26T04:57:28.7063109Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-06-26T04:57:30.4468962Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-06-26T04:57:35.9077144Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-06-26T04:57:37.3206577Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-06-26T04:57:38.9791121Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-06-26T04:57:40.3457557Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2024-06-26T04:57:40.5070298Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-06-26T04:57:40.9112609Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-06-26T04:57:41.2255004Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-06-26T04:57:42.4295678Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-06-26T04:57:42.7678500Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-06-26T04:57:43.0023088Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-06-26T04:57:44.4864956Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-06-26T04:57:45.2715207Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-06-26T04:57:46.0025406Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-06-26T04:57:52.2730544Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-06-26T04:57:54.8383054Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-06-26T04:58:02.0746895Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-06-26T04:58:02.2706359Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-06-26T04:58:11.4561533Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-06-26T04:58:11.6279363Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-06-26T04:58:11.8110667Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-06-26T04:58:12.8294090Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-06-26T04:58:13.0961968Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-06-26T04:58:13.7463622Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-06-26T04:58:14.1504158Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-06-26T04:58:14.1605183Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-06-26T04:58:14.1680414Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-06-26T04:58:14.1888293Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-06-26T04:58:14.2235495Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-06-26T04:58:15.0751309Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-06-26T04:58:15.0958034Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-06-26T04:58:15.1320622Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-06-26T04:58:15.2225132Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-06-26T04:58:15.2529240Z Submodule path 'third_party/cudnn_frontend': checked out 'aa3abd4bc689d6412979c7f55f9cd132848c9c6a' 2024-06-26T04:58:15.7230363Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-06-26T04:58:15.9540033Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-06-26T04:58:16.0242005Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-06-26T04:58:16.0257270Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-06-26T04:58:16.0259115Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T04:58:16.0261378Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-06-26T04:58:16.0263687Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-06-26T04:58:16.0266360Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T04:58:16.0289565Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-06-26T04:58:17.0701107Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-06-26T04:58:17.6329480Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-06-26T04:58:19.4366739Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-06-26T04:58:20.4918837Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-06-26T04:58:20.8086823Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-06-26T04:58:20.8981693Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-06-26T04:58:21.2737065Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-06-26T04:58:21.3321321Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-06-26T04:58:21.3434042Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-06-26T04:58:21.4466142Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-06-26T04:58:21.4782582Z Submodule path 'third_party/fmt': checked out 'e69e5f977d458f2650bb346dadf2ad30c5320281' 2024-06-26T04:58:21.4866612Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2024-06-26T04:58:21.5240425Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-06-26T04:58:21.5464154Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-06-26T04:58:21.5883816Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T04:58:21.5999069Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-06-26T04:58:21.6011168Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-06-26T04:58:21.6032029Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-06-26T04:58:34.8714823Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-06-26T04:58:34.8875314Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-06-26T04:58:34.9738978Z Submodule path 'third_party/kineto': checked out '8681ff11e1fa54da39023076c5c43eddd87b7a8a' 2024-06-26T04:58:34.9753772Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T04:58:34.9757229Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T04:58:34.9760256Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T04:58:34.9781460Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-06-26T04:58:35.5480524Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-06-26T04:58:36.8500830Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-06-26T04:58:38.0036097Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-06-26T04:58:38.0049488Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T04:58:38.0051367Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T04:58:38.0053383Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T04:58:38.0055683Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T04:58:38.0057854Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T04:58:38.0060294Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T04:58:38.0062881Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T04:58:38.0065519Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T04:58:38.0090479Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-06-26T04:58:38.9979379Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-06-26T04:58:39.3513277Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-06-26T04:58:40.6693550Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-06-26T04:58:40.9478375Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-06-26T04:58:41.4561274Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-06-26T04:58:42.5535542Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-06-26T04:58:49.9850467Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-06-26T04:58:50.3885982Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-06-26T04:58:50.4047666Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-06-26T04:58:50.4390835Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-06-26T04:58:50.4508296Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-06-26T04:58:50.4521929Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T04:58:50.4543500Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-06-26T04:58:50.7983073Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-06-26T04:58:50.8147691Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-06-26T04:58:50.8519345Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-06-26T04:58:50.9479610Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-06-26T04:58:50.9624077Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-06-26T04:58:50.9953797Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out 'a33701196adfad74917046096bf5a2aa0ab0bb50' 2024-06-26T04:58:51.0499492Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-06-26T04:58:51.0844175Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-06-26T04:58:51.1069029Z Submodule path 'third_party/nccl/nccl': checked out '48bb7fec7953112ff37499a272317f6663f8f600' 2024-06-26T04:58:51.2050514Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-06-26T04:58:51.5113414Z Submodule path 'third_party/onnx': checked out '990217f043af7222348ca8f0301e17fa7b841781' 2024-06-26T04:58:51.5144390Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-06-26T04:58:51.5146448Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-06-26T04:58:51.5170610Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-06-26T04:58:51.9904990Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-06-26T04:58:53.0757584Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-06-26T04:58:53.1060531Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-06-26T04:58:53.1647842Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-06-26T04:58:53.1664841Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T04:58:53.1666591Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T04:58:53.1668396Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T04:58:53.1670715Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T04:58:53.1673759Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T04:58:53.1676040Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T04:58:53.1678527Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T04:58:53.1681065Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T04:58:53.1704618Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-06-26T04:58:53.5432811Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-06-26T04:58:54.6770557Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-06-26T04:58:54.9879676Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-06-26T04:59:01.2080257Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-06-26T04:59:01.4841507Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-06-26T04:59:01.6917004Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-06-26T04:59:01.9728933Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-06-26T04:59:09.5585478Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-06-26T04:59:09.5950361Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-06-26T04:59:09.6092095Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-06-26T04:59:09.7013623Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-06-26T04:59:09.7125257Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-06-26T04:59:09.7249893Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-06-26T04:59:09.7379678Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-06-26T04:59:09.7394178Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T04:59:09.7396883Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T04:59:09.7417260Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-06-26T04:59:11.8260349Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-06-26T04:59:13.2037657Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-06-26T04:59:13.2458471Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-06-26T04:59:13.6398271Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-06-26T04:59:13.6500444Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-06-26T04:59:13.8952747Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-06-26T04:59:13.8971408Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-06-26T04:59:13.8973455Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-06-26T04:59:13.8997375Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-06-26T04:59:14.3100449Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-06-26T04:59:15.3949686Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-06-26T04:59:15.4623120Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-06-26T04:59:15.4700146Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-06-26T04:59:15.4808920Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-06-26T04:59:15.5115277Z Submodule path 'third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2024-06-26T04:59:15.5376248Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-06-26T04:59:15.5757938Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-06-26T04:59:15.5989409Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-06-26T04:59:15.6005477Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-06-26T04:59:15.6007185Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-06-26T04:59:15.6008711Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-06-26T04:59:15.6010643Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T04:59:15.6033589Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-06-26T04:59:16.7164935Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-06-26T04:59:16.9128416Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-06-26T04:59:17.9747999Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-06-26T04:59:19.0505770Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-06-26T04:59:19.0640357Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-06-26T04:59:19.1277886Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-06-26T04:59:19.1536368Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-06-26T04:59:19.1550217Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T04:59:19.1572920Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-06-26T04:59:19.3330936Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-06-26T04:59:19.3381197Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-06-26T04:59:19.3617671Z Entering 'android/libs/fbjni' 2024-06-26T04:59:19.3652527Z Entering 'third_party/FP16' 2024-06-26T04:59:19.3687524Z Entering 'third_party/FXdiv' 2024-06-26T04:59:19.3720561Z Entering 'third_party/NNPACK' 2024-06-26T04:59:19.3754998Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T04:59:19.3788178Z Entering 'third_party/XNNPACK' 2024-06-26T04:59:19.3839420Z Entering 'third_party/benchmark' 2024-06-26T04:59:19.3873716Z Entering 'third_party/cpp-httplib' 2024-06-26T04:59:19.3906878Z Entering 'third_party/cpuinfo' 2024-06-26T04:59:19.3941555Z Entering 'third_party/cudnn_frontend' 2024-06-26T04:59:19.3975796Z Entering 'third_party/cutlass' 2024-06-26T04:59:19.4016358Z Entering 'third_party/eigen' 2024-06-26T04:59:19.4052589Z Entering 'third_party/fbgemm' 2024-06-26T04:59:19.4085465Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T04:59:19.4119777Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T04:59:19.4152381Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T04:59:19.4191147Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T04:59:19.4223965Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T04:59:19.4257301Z Entering 'third_party/flatbuffers' 2024-06-26T04:59:19.4294606Z Entering 'third_party/fmt' 2024-06-26T04:59:19.4328497Z Entering 'third_party/foxi' 2024-06-26T04:59:19.4362136Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T04:59:19.4395016Z Entering 'third_party/gloo' 2024-06-26T04:59:19.4428474Z Entering 'third_party/googletest' 2024-06-26T04:59:19.4462916Z Entering 'third_party/ideep' 2024-06-26T04:59:19.4496564Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T04:59:19.4537621Z Entering 'third_party/ittapi' 2024-06-26T04:59:19.4570846Z Entering 'third_party/kineto' 2024-06-26T04:59:19.4604450Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T04:59:19.4637818Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T04:59:19.4671821Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T04:59:19.4703964Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T04:59:19.4736925Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T04:59:19.4769173Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T04:59:19.4802747Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T04:59:19.4835761Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T04:59:19.4869799Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T04:59:19.4903078Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T04:59:19.4936773Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T04:59:19.4969971Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T04:59:19.5004077Z Entering 'third_party/mimalloc' 2024-06-26T04:59:19.5038575Z Entering 'third_party/nccl/nccl' 2024-06-26T04:59:19.5071537Z Entering 'third_party/nlohmann' 2024-06-26T04:59:19.5105582Z Entering 'third_party/onnx' 2024-06-26T04:59:19.5154319Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T04:59:19.5187660Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T04:59:19.5222606Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T04:59:19.5258652Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T04:59:19.5290844Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T04:59:19.5322767Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T04:59:19.5354796Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T04:59:19.5387501Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T04:59:19.5420963Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T04:59:19.5452936Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T04:59:19.5485390Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T04:59:19.5520464Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T04:59:19.5553147Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T04:59:19.5605999Z Entering 'third_party/pocketfft' 2024-06-26T04:59:19.5639703Z Entering 'third_party/protobuf' 2024-06-26T04:59:19.5676339Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T04:59:19.5708628Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T04:59:19.5743287Z Entering 'third_party/psimd' 2024-06-26T04:59:19.5778829Z Entering 'third_party/pthreadpool' 2024-06-26T04:59:19.5813082Z Entering 'third_party/pybind11' 2024-06-26T04:59:19.5847735Z Entering 'third_party/python-peachpy' 2024-06-26T04:59:19.5882417Z Entering 'third_party/sleef' 2024-06-26T04:59:19.5915986Z Entering 'third_party/tensorpipe' 2024-06-26T04:59:19.5951080Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T04:59:19.5984172Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T04:59:19.6016577Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T04:59:19.6049827Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T04:59:19.6083046Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T04:59:19.6129734Z ##[endgroup] 2024-06-26T04:59:19.6130464Z ##[group]Persisting credentials for submodules 2024-06-26T04:59:19.6136637Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-06-26T04:59:19.6397707Z Entering 'android/libs/fbjni' 2024-06-26T04:59:19.6440954Z Entering 'third_party/FP16' 2024-06-26T04:59:19.6482834Z Entering 'third_party/FXdiv' 2024-06-26T04:59:19.6524953Z Entering 'third_party/NNPACK' 2024-06-26T04:59:19.6567518Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T04:59:19.6609843Z Entering 'third_party/XNNPACK' 2024-06-26T04:59:19.6668126Z Entering 'third_party/benchmark' 2024-06-26T04:59:19.6710227Z Entering 'third_party/cpp-httplib' 2024-06-26T04:59:19.6752265Z Entering 'third_party/cpuinfo' 2024-06-26T04:59:19.6794926Z Entering 'third_party/cudnn_frontend' 2024-06-26T04:59:19.6836381Z Entering 'third_party/cutlass' 2024-06-26T04:59:19.6885438Z Entering 'third_party/eigen' 2024-06-26T04:59:19.6929395Z Entering 'third_party/fbgemm' 2024-06-26T04:59:19.6971414Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T04:59:19.7012594Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T04:59:19.7054931Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T04:59:19.7102467Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T04:59:19.7143955Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T04:59:19.7186037Z Entering 'third_party/flatbuffers' 2024-06-26T04:59:19.7232345Z Entering 'third_party/fmt' 2024-06-26T04:59:19.7274440Z Entering 'third_party/foxi' 2024-06-26T04:59:19.7315695Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T04:59:19.7358530Z Entering 'third_party/gloo' 2024-06-26T04:59:19.7401394Z Entering 'third_party/googletest' 2024-06-26T04:59:19.7443949Z Entering 'third_party/ideep' 2024-06-26T04:59:19.7484432Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T04:59:19.7533441Z Entering 'third_party/ittapi' 2024-06-26T04:59:19.7578820Z Entering 'third_party/kineto' 2024-06-26T04:59:19.7621149Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T04:59:19.7663824Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T04:59:19.7708960Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T04:59:19.7751208Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T04:59:19.7792907Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T04:59:19.7835200Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T04:59:19.7877657Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T04:59:19.7918998Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T04:59:19.7960696Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T04:59:19.8005071Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T04:59:19.8046877Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T04:59:19.8088617Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T04:59:19.8131906Z Entering 'third_party/mimalloc' 2024-06-26T04:59:19.8173713Z Entering 'third_party/nccl/nccl' 2024-06-26T04:59:19.8216865Z Entering 'third_party/nlohmann' 2024-06-26T04:59:19.8260364Z Entering 'third_party/onnx' 2024-06-26T04:59:19.8318356Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T04:59:19.8360862Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T04:59:19.8406060Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T04:59:19.8450950Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T04:59:19.8492292Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T04:59:19.8533146Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T04:59:19.8573834Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T04:59:19.8616188Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T04:59:19.8657528Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T04:59:19.8698287Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T04:59:19.8737582Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T04:59:19.8780378Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T04:59:19.8823747Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T04:59:19.8886841Z Entering 'third_party/pocketfft' 2024-06-26T04:59:19.8929124Z Entering 'third_party/protobuf' 2024-06-26T04:59:19.8973874Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T04:59:19.9015927Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T04:59:19.9059892Z Entering 'third_party/psimd' 2024-06-26T04:59:19.9101822Z Entering 'third_party/pthreadpool' 2024-06-26T04:59:19.9145983Z Entering 'third_party/pybind11' 2024-06-26T04:59:19.9187888Z Entering 'third_party/python-peachpy' 2024-06-26T04:59:19.9230943Z Entering 'third_party/sleef' 2024-06-26T04:59:19.9274505Z Entering 'third_party/tensorpipe' 2024-06-26T04:59:19.9316135Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T04:59:19.9356900Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T04:59:19.9397749Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T04:59:19.9439264Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T04:59:19.9478966Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T04:59:19.9535445Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-06-26T04:59:19.9798192Z Entering 'android/libs/fbjni' 2024-06-26T04:59:19.9838497Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-06-26T04:59:19.9853554Z Entering 'third_party/FP16' 2024-06-26T04:59:19.9894460Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-06-26T04:59:19.9909698Z Entering 'third_party/FXdiv' 2024-06-26T04:59:19.9950456Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-06-26T04:59:19.9964936Z Entering 'third_party/NNPACK' 2024-06-26T04:59:20.0006247Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-06-26T04:59:20.0020981Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T04:59:20.0060599Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-06-26T04:59:20.0076852Z Entering 'third_party/XNNPACK' 2024-06-26T04:59:20.0115400Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-06-26T04:59:20.0147334Z Entering 'third_party/benchmark' 2024-06-26T04:59:20.0186715Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-06-26T04:59:20.0202680Z Entering 'third_party/cpp-httplib' 2024-06-26T04:59:20.0243115Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-06-26T04:59:20.0257935Z Entering 'third_party/cpuinfo' 2024-06-26T04:59:20.0298710Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T04:59:20.0314793Z Entering 'third_party/cudnn_frontend' 2024-06-26T04:59:20.0355388Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-06-26T04:59:20.0370374Z Entering 'third_party/cutlass' 2024-06-26T04:59:20.0410651Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-06-26T04:59:20.0434812Z Entering 'third_party/eigen' 2024-06-26T04:59:20.0475711Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-06-26T04:59:20.0492442Z Entering 'third_party/fbgemm' 2024-06-26T04:59:20.0532383Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-06-26T04:59:20.0547815Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T04:59:20.0587782Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-06-26T04:59:20.0602608Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T04:59:20.0641839Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-06-26T04:59:20.0656394Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T04:59:20.0697032Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-06-26T04:59:20.0719163Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T04:59:20.0760122Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-06-26T04:59:20.0774540Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T04:59:20.0814583Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-06-26T04:59:20.0829917Z Entering 'third_party/flatbuffers' 2024-06-26T04:59:20.0871178Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-06-26T04:59:20.0889109Z Entering 'third_party/fmt' 2024-06-26T04:59:20.0929618Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-06-26T04:59:20.0944493Z Entering 'third_party/foxi' 2024-06-26T04:59:20.0984587Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2024-06-26T04:59:20.0999937Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T04:59:20.1039318Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-06-26T04:59:20.1054582Z Entering 'third_party/gloo' 2024-06-26T04:59:20.1095128Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-06-26T04:59:20.1109312Z Entering 'third_party/googletest' 2024-06-26T04:59:20.1149549Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-06-26T04:59:20.1164849Z Entering 'third_party/ideep' 2024-06-26T04:59:20.1204623Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-06-26T04:59:20.1218499Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T04:59:20.1258371Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-06-26T04:59:20.1279778Z Entering 'third_party/ittapi' 2024-06-26T04:59:20.1319393Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-06-26T04:59:20.1334791Z Entering 'third_party/kineto' 2024-06-26T04:59:20.1375215Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-06-26T04:59:20.1390310Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T04:59:20.1430476Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-06-26T04:59:20.1444614Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T04:59:20.1483557Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-06-26T04:59:20.1500004Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T04:59:20.1539937Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-06-26T04:59:20.1554594Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T04:59:20.1594412Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-06-26T04:59:20.1608905Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T04:59:20.1648722Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-06-26T04:59:20.1661649Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T04:59:20.1702194Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-06-26T04:59:20.1718750Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T04:59:20.1758400Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-06-26T04:59:20.1772700Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T04:59:20.1812122Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-06-26T04:59:20.1826279Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T04:59:20.1865547Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-06-26T04:59:20.1882179Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T04:59:20.1922498Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-06-26T04:59:20.1937758Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T04:59:20.1976071Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-06-26T04:59:20.1990170Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T04:59:20.2029336Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-06-26T04:59:20.2045264Z Entering 'third_party/mimalloc' 2024-06-26T04:59:20.2086343Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-06-26T04:59:20.2101674Z Entering 'third_party/nccl/nccl' 2024-06-26T04:59:20.2140797Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-06-26T04:59:20.2155901Z Entering 'third_party/nlohmann' 2024-06-26T04:59:20.2194949Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-06-26T04:59:20.2210492Z Entering 'third_party/onnx' 2024-06-26T04:59:20.2250035Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-06-26T04:59:20.2279569Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T04:59:20.2319088Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-06-26T04:59:20.2333941Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T04:59:20.2373200Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-06-26T04:59:20.2389950Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T04:59:20.2429545Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-06-26T04:59:20.2446237Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T04:59:20.2485545Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-06-26T04:59:20.2500270Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T04:59:20.2539603Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-06-26T04:59:20.2554507Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T04:59:20.2593770Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-06-26T04:59:20.2609289Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T04:59:20.2647137Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-06-26T04:59:20.2663267Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T04:59:20.2701481Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-06-26T04:59:20.2715910Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T04:59:20.2755673Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-06-26T04:59:20.2769264Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T04:59:20.2809031Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-06-26T04:59:20.2822729Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T04:59:20.2863232Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-06-26T04:59:20.2879237Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T04:59:20.2920156Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-06-26T04:59:20.2937236Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T04:59:20.2977148Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-06-26T04:59:20.3012027Z Entering 'third_party/pocketfft' 2024-06-26T04:59:20.3053213Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-06-26T04:59:20.3067366Z Entering 'third_party/protobuf' 2024-06-26T04:59:20.3107278Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-06-26T04:59:20.3124561Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T04:59:20.3165080Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-06-26T04:59:20.3179738Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T04:59:20.3218763Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-06-26T04:59:20.3234627Z Entering 'third_party/psimd' 2024-06-26T04:59:20.3275695Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-06-26T04:59:20.3290184Z Entering 'third_party/pthreadpool' 2024-06-26T04:59:20.3329457Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-06-26T04:59:20.3343951Z Entering 'third_party/pybind11' 2024-06-26T04:59:20.3382518Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-06-26T04:59:20.3397374Z Entering 'third_party/python-peachpy' 2024-06-26T04:59:20.3436101Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-06-26T04:59:20.3450425Z Entering 'third_party/sleef' 2024-06-26T04:59:20.3489063Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-06-26T04:59:20.3503185Z Entering 'third_party/tensorpipe' 2024-06-26T04:59:20.3541812Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-06-26T04:59:20.3556667Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T04:59:20.3594650Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-06-26T04:59:20.3608801Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T04:59:20.3648047Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-06-26T04:59:20.3662466Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T04:59:20.3700328Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-06-26T04:59:20.3715682Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T04:59:20.3754014Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-06-26T04:59:20.3767569Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T04:59:20.3807927Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-06-26T04:59:20.4398883Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-06-26T04:59:20.4660312Z Entering 'android/libs/fbjni' 2024-06-26T04:59:20.4695261Z Entering 'third_party/FP16' 2024-06-26T04:59:20.4730122Z Entering 'third_party/FXdiv' 2024-06-26T04:59:20.4764333Z Entering 'third_party/NNPACK' 2024-06-26T04:59:20.4798897Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T04:59:20.4832804Z Entering 'third_party/XNNPACK' 2024-06-26T04:59:20.4883094Z Entering 'third_party/benchmark' 2024-06-26T04:59:20.4918379Z Entering 'third_party/cpp-httplib' 2024-06-26T04:59:20.4951320Z Entering 'third_party/cpuinfo' 2024-06-26T04:59:20.4984942Z Entering 'third_party/cudnn_frontend' 2024-06-26T04:59:20.5018656Z Entering 'third_party/cutlass' 2024-06-26T04:59:20.5059618Z Entering 'third_party/eigen' 2024-06-26T04:59:20.5096299Z Entering 'third_party/fbgemm' 2024-06-26T04:59:20.5130937Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T04:59:20.5162645Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T04:59:20.5195109Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T04:59:20.5233200Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T04:59:20.5264747Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T04:59:20.5297891Z Entering 'third_party/flatbuffers' 2024-06-26T04:59:20.5334596Z Entering 'third_party/fmt' 2024-06-26T04:59:20.5368071Z Entering 'third_party/foxi' 2024-06-26T04:59:20.5401333Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T04:59:20.5436439Z Entering 'third_party/gloo' 2024-06-26T04:59:20.5469194Z Entering 'third_party/googletest' 2024-06-26T04:59:20.5503159Z Entering 'third_party/ideep' 2024-06-26T04:59:20.5535536Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T04:59:20.5577213Z Entering 'third_party/ittapi' 2024-06-26T04:59:20.5612070Z Entering 'third_party/kineto' 2024-06-26T04:59:20.5645028Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T04:59:20.5679651Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T04:59:20.5714564Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T04:59:20.5747466Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T04:59:20.5780980Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T04:59:20.5814165Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T04:59:20.5849348Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T04:59:20.5881524Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T04:59:20.5929109Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T04:59:20.5963684Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T04:59:20.5997787Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T04:59:20.6031127Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T04:59:20.6066388Z Entering 'third_party/mimalloc' 2024-06-26T04:59:20.6100796Z Entering 'third_party/nccl/nccl' 2024-06-26T04:59:20.6134544Z Entering 'third_party/nlohmann' 2024-06-26T04:59:20.6170327Z Entering 'third_party/onnx' 2024-06-26T04:59:20.6220031Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T04:59:20.6253879Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T04:59:20.6289944Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T04:59:20.6324615Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T04:59:20.6357605Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T04:59:20.6390691Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T04:59:20.6423570Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T04:59:20.6457529Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T04:59:20.6490360Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T04:59:20.6523333Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T04:59:20.6556933Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T04:59:20.6591756Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T04:59:20.6626399Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T04:59:20.6680933Z Entering 'third_party/pocketfft' 2024-06-26T04:59:20.6715530Z Entering 'third_party/protobuf' 2024-06-26T04:59:20.6752887Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T04:59:20.6786173Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T04:59:20.6820984Z Entering 'third_party/psimd' 2024-06-26T04:59:20.6854938Z Entering 'third_party/pthreadpool' 2024-06-26T04:59:20.6888305Z Entering 'third_party/pybind11' 2024-06-26T04:59:20.6921326Z Entering 'third_party/python-peachpy' 2024-06-26T04:59:20.6955494Z Entering 'third_party/sleef' 2024-06-26T04:59:20.6988689Z Entering 'third_party/tensorpipe' 2024-06-26T04:59:20.7021408Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T04:59:20.7054684Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T04:59:20.7088463Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T04:59:20.7121573Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T04:59:20.7154641Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T04:59:20.7203424Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-06-26T04:59:20.7464913Z Entering 'android/libs/fbjni' 2024-06-26T04:59:20.7499894Z Entering 'third_party/FP16' 2024-06-26T04:59:20.7535582Z Entering 'third_party/FXdiv' 2024-06-26T04:59:20.7570041Z Entering 'third_party/NNPACK' 2024-06-26T04:59:20.7605090Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T04:59:20.7638747Z Entering 'third_party/XNNPACK' 2024-06-26T04:59:20.7689475Z Entering 'third_party/benchmark' 2024-06-26T04:59:20.7722650Z Entering 'third_party/cpp-httplib' 2024-06-26T04:59:20.7755837Z Entering 'third_party/cpuinfo' 2024-06-26T04:59:20.7789344Z Entering 'third_party/cudnn_frontend' 2024-06-26T04:59:20.7822925Z Entering 'third_party/cutlass' 2024-06-26T04:59:20.7863948Z Entering 'third_party/eigen' 2024-06-26T04:59:20.7899865Z Entering 'third_party/fbgemm' 2024-06-26T04:59:20.7934472Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T04:59:20.7967904Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T04:59:20.8002461Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T04:59:20.8041485Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T04:59:20.8074394Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T04:59:20.8107378Z Entering 'third_party/flatbuffers' 2024-06-26T04:59:20.8144579Z Entering 'third_party/fmt' 2024-06-26T04:59:20.8178387Z Entering 'third_party/foxi' 2024-06-26T04:59:20.8212323Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T04:59:20.8246439Z Entering 'third_party/gloo' 2024-06-26T04:59:20.8281306Z Entering 'third_party/googletest' 2024-06-26T04:59:20.8315543Z Entering 'third_party/ideep' 2024-06-26T04:59:20.8348206Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T04:59:20.8390309Z Entering 'third_party/ittapi' 2024-06-26T04:59:20.8424247Z Entering 'third_party/kineto' 2024-06-26T04:59:20.8457829Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T04:59:20.8493169Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T04:59:20.8529319Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T04:59:20.8565103Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T04:59:20.8599832Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T04:59:20.8633390Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T04:59:20.8668230Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T04:59:20.8701980Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T04:59:20.8734790Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T04:59:20.8768920Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T04:59:20.8803821Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T04:59:20.8837212Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T04:59:20.8871376Z Entering 'third_party/mimalloc' 2024-06-26T04:59:20.8907431Z Entering 'third_party/nccl/nccl' 2024-06-26T04:59:20.8942125Z Entering 'third_party/nlohmann' 2024-06-26T04:59:20.8978820Z Entering 'third_party/onnx' 2024-06-26T04:59:20.9029659Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T04:59:20.9065139Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T04:59:20.9100230Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T04:59:20.9136694Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T04:59:20.9169939Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T04:59:20.9202516Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T04:59:20.9235966Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T04:59:20.9269521Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T04:59:20.9302497Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T04:59:20.9335026Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T04:59:20.9367332Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T04:59:20.9402309Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T04:59:20.9437153Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T04:59:20.9490997Z Entering 'third_party/pocketfft' 2024-06-26T04:59:20.9526431Z Entering 'third_party/protobuf' 2024-06-26T04:59:20.9564713Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T04:59:20.9600108Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T04:59:20.9636932Z Entering 'third_party/psimd' 2024-06-26T04:59:20.9672465Z Entering 'third_party/pthreadpool' 2024-06-26T04:59:20.9707336Z Entering 'third_party/pybind11' 2024-06-26T04:59:20.9741248Z Entering 'third_party/python-peachpy' 2024-06-26T04:59:20.9775902Z Entering 'third_party/sleef' 2024-06-26T04:59:20.9809089Z Entering 'third_party/tensorpipe' 2024-06-26T04:59:20.9845173Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T04:59:20.9878413Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T04:59:20.9910726Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T04:59:20.9944736Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T04:59:20.9977378Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T04:59:21.0022591Z ##[endgroup] 2024-06-26T04:59:21.0059924Z [command]/usr/bin/git log -1 --format='%H' 2024-06-26T04:59:21.0085168Z 'b8c4c54d347aa776934c60784e35936878ef18dc' 2024-06-26T04:59:21.0270215Z Prepare all required actions 2024-06-26T04:59:21.0270747Z Getting action download info 2024-06-26T04:59:21.1686839Z ##[group]Run ./.github/actions/setup-linux 2024-06-26T04:59:21.1687255Z env: 2024-06-26T04:59:21.1687515Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:21.1687832Z ##[endgroup] 2024-06-26T04:59:21.1750808Z ##[group]Run set -euo pipefail 2024-06-26T04:59:21.1751374Z set -euo pipefail 2024-06-26T04:59:21.1751901Z function get_ec2_metadata() { 2024-06-26T04:59:21.1752432Z  # Pulled from instance metadata endpoint for EC2 2024-06-26T04:59:21.1753348Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-06-26T04:59:21.1754121Z  category=$1 2024-06-26T04:59:21.1754636Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-06-26T04:59:21.1755274Z  runner_name_str=i-045f62e1b5b74b837 2024-06-26T04:59:21.1755771Z  if [[ -f /.inarc ]]; then 2024-06-26T04:59:21.1756251Z  echo "ARC Runner, no info on ec2 metadata" 2024-06-26T04:59:21.1756796Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-06-26T04:59:21.1757490Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-06-26T04:59:21.1758102Z  else 2024-06-26T04:59:21.1758565Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-06-26T04:59:21.1759137Z  fi 2024-06-26T04:59:21.1759404Z } 2024-06-26T04:59:21.1759726Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-06-26T04:59:21.1760300Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-06-26T04:59:21.1760957Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-06-26T04:59:21.1761507Z echo "system info $(uname -a)" 2024-06-26T04:59:21.1769312Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:21.1769807Z env: 2024-06-26T04:59:21.1770061Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:21.1770390Z ##[endgroup] 2024-06-26T04:59:21.1849653Z ami-id: ami-0ce0c36d7a00b20e2 2024-06-26T04:59:21.1901450Z instance-id: i-045f62e1b5b74b837 2024-06-26T04:59:21.1953190Z instance-type: c5.2xlarge 2024-06-26T04:59:21.1960117Z system info Linux ip-10-0-78-115.ec2.internal 4.14.336-257.562.amzn2.x86_64 #1 SMP Sat Feb 24 09:50:35 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-06-26T04:59:21.1982741Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T04:59:21.1983687Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-06-26T04:59:21.1991210Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:21.1991912Z env: 2024-06-26T04:59:21.1992161Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:21.1992500Z ##[endgroup] 2024-06-26T04:59:21.2094603Z ##[group]Run if systemctl is-active --quiet docker; then 2024-06-26T04:59:21.2095196Z if systemctl is-active --quiet docker; then 2024-06-26T04:59:21.2095731Z  echo "Docker daemon is running..."; 2024-06-26T04:59:21.2096166Z else 2024-06-26T04:59:21.2096633Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-06-26T04:59:21.2097215Z fi 2024-06-26T04:59:21.2104148Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:21.2104659Z env: 2024-06-26T04:59:21.2104924Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:21.2105242Z ##[endgroup] 2024-06-26T04:59:21.2143184Z Docker daemon is running... 2024-06-26T04:59:21.2189853Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T04:59:21.2190420Z with: 2024-06-26T04:59:21.2190669Z shell: bash 2024-06-26T04:59:21.2190932Z timeout_minutes: 5 2024-06-26T04:59:21.2191232Z max_attempts: 3 2024-06-26T04:59:21.2191522Z retry_wait_seconds: 30 2024-06-26T04:59:21.2193665Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-06-26T04:59:21.2195178Z polling_interval_seconds: 1 2024-06-26T04:59:21.2195540Z warning_on_retry: true 2024-06-26T04:59:21.2195878Z continue_on_error: false 2024-06-26T04:59:21.2196182Z env: 2024-06-26T04:59:21.2196538Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:21.2196879Z AWS_RETRY_MODE: standard 2024-06-26T04:59:21.2197194Z AWS_MAX_ATTEMPTS: 5 2024-06-26T04:59:21.2197521Z AWS_DEFAULT_REGION: us-east-1 2024-06-26T04:59:21.2197875Z ##[endgroup] 2024-06-26T04:59:22.3559073Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T04:59:22.3560396Z Configure a credential helper to remove this warning. See 2024-06-26T04:59:22.3561262Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T04:59:22.3561836Z 2024-06-26T04:59:22.3561961Z Login Succeeded 2024-06-26T04:59:23.2730180Z Command completed after 1 attempt(s). 2024-06-26T04:59:23.2776072Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T04:59:23.2776804Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T04:59:23.2777477Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-06-26T04:59:23.2784978Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:23.2785489Z env: 2024-06-26T04:59:23.2785754Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:23.2786083Z ##[endgroup] 2024-06-26T04:59:23.2853700Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T04:59:23.2854505Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T04:59:23.2855103Z # shellcheck disable=SC2046 2024-06-26T04:59:23.2855554Z docker stop $(docker ps -q) || true 2024-06-26T04:59:23.2856028Z # Prune all of the docker images 2024-06-26T04:59:23.2856512Z docker system prune -af 2024-06-26T04:59:23.2863980Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:23.2864464Z env: 2024-06-26T04:59:23.2864728Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:23.2865063Z ##[endgroup] 2024-06-26T04:59:23.3116173Z "docker stop" requires at least 1 argument. 2024-06-26T04:59:23.3116831Z See 'docker stop --help'. 2024-06-26T04:59:23.3117107Z 2024-06-26T04:59:23.3117333Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-06-26T04:59:23.3117707Z 2024-06-26T04:59:23.3117862Z Stop one or more running containers 2024-06-26T04:59:23.3256637Z Total reclaimed space: 0B 2024-06-26T04:59:23.3288515Z ##[group]Run set +e 2024-06-26T04:59:23.3288865Z set +e 2024-06-26T04:59:23.3289134Z set -x 2024-06-26T04:59:23.3289413Z  2024-06-26T04:59:23.3289721Z PT_DOMAIN=download.pytorch.org 2024-06-26T04:59:23.3290518Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-06-26T04:59:23.3291636Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-06-26T04:59:23.3292410Z # one is returned at random 2024-06-26T04:59:23.3292926Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-06-26T04:59:23.3293429Z  2024-06-26T04:59:23.3293777Z if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T04:59:23.3294381Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-06-26T04:59:23.3295180Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-06-26T04:59:23.3295729Z  2024-06-26T04:59:23.3296037Z  if [ -z "${RESOLVED_IP}" ]; then 2024-06-26T04:59:23.3296557Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-06-26T04:59:23.3297061Z  exit 1 2024-06-26T04:59:23.3297354Z  fi 2024-06-26T04:59:23.3297614Z fi 2024-06-26T04:59:23.3298006Z  2024-06-26T04:59:23.3298353Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-06-26T04:59:23.3298847Z  # Clean up any old records first 2024-06-26T04:59:23.3299346Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-06-26T04:59:23.3299786Z fi 2024-06-26T04:59:23.3300031Z  2024-06-26T04:59:23.3300454Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-06-26T04:59:23.3301098Z cat /etc/hosts 2024-06-26T04:59:23.3308541Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:23.3309039Z env: 2024-06-26T04:59:23.3309302Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:23.3309625Z ##[endgroup] 2024-06-26T04:59:23.3331217Z + PT_DOMAIN=download.pytorch.org 2024-06-26T04:59:23.3336495Z ++ dig -4 +short download.pytorch.org 2024-06-26T04:59:23.3337145Z ++ tail -n1 2024-06-26T04:59:23.4036408Z + RESOLVED_IP=18.160.10.36 2024-06-26T04:59:23.4037093Z + '[' -z 18.160.10.36 ']' 2024-06-26T04:59:23.4037544Z + grep -r download.pytorch.org /etc/hosts 2024-06-26T04:59:23.4043847Z 18.160.10.22 download.pytorch.org 2024-06-26T04:59:23.4044858Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-06-26T04:59:23.4140988Z + echo '18.160.10.36 download.pytorch.org' 2024-06-26T04:59:23.4141603Z + sudo tee -a /etc/hosts 2024-06-26T04:59:23.4231406Z 18.160.10.36 download.pytorch.org 2024-06-26T04:59:23.4244150Z + cat /etc/hosts 2024-06-26T04:59:23.4250633Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-06-26T04:59:23.4262700Z ::1 localhost6 localhost6.localdomain6 2024-06-26T04:59:23.4263266Z 18.160.10.36 download.pytorch.org 2024-06-26T04:59:23.4433152Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-06-26T04:59:23.4433819Z with: 2024-06-26T04:59:23.4434749Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4435841Z docker-build-dir: .ci/docker 2024-06-26T04:59:23.4436255Z working-directory: . 2024-06-26T04:59:23.4436750Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:23.4437327Z force-push: false 2024-06-26T04:59:23.4437660Z env: 2024-06-26T04:59:23.4437948Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:23.4438321Z ##[endgroup] 2024-06-26T04:59:23.4460162Z ##[group]Run set -ex 2024-06-26T04:59:23.4460565Z set -ex 2024-06-26T04:59:23.4460892Z  2024-06-26T04:59:23.4461480Z # If the docker build directory or the build script doesn't exist, the action will 2024-06-26T04:59:23.4462556Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-06-26T04:59:23.4463412Z # job could then download the pre-built image as usual 2024-06-26T04:59:23.4464208Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-06-26T04:59:23.4464937Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4465618Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4466210Z  2024-06-26T04:59:23.4466766Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-06-26T04:59:23.4467444Z  exit 0 2024-06-26T04:59:23.4467764Z else 2024-06-26T04:59:23.4468171Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4468661Z fi 2024-06-26T04:59:23.4468953Z  2024-06-26T04:59:23.4469459Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-06-26T04:59:23.4470384Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-06-26T04:59:23.4471214Z  # use it as it is, but first let's extract the tag 2024-06-26T04:59:23.4472147Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-06-26T04:59:23.4472928Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4473680Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4474273Z else 2024-06-26T04:59:23.4474741Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-06-26T04:59:23.4475456Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4476534Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4477351Z fi 2024-06-26T04:59:23.4484985Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:23.4485514Z env: 2024-06-26T04:59:23.4485825Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:23.4486217Z REPO_NAME: pytorch 2024-06-26T04:59:23.4487183Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4488255Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T04:59:23.4488792Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:23.4489354Z ##[endgroup] 2024-06-26T04:59:23.4511958Z + [[ ! -d .ci/docker ]] 2024-06-26T04:59:23.4512720Z + [[ ! -f .ci/docker/build.sh ]] 2024-06-26T04:59:23.4513414Z + echo skip=false 2024-06-26T04:59:23.4515287Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-06-26T04:59:23.4518847Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4519893Z ++ awk -F '[:,]' '{print $2}' 2024-06-26T04:59:23.4526569Z + DOCKER_TAG=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4527756Z + echo docker-tag=91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4529123Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4559071Z ##[group]Run set +e 2024-06-26T04:59:23.4559472Z set +e 2024-06-26T04:59:23.4559800Z set -x 2024-06-26T04:59:23.4560105Z  2024-06-26T04:59:23.4560408Z login() { 2024-06-26T04:59:23.4561123Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T04:59:23.4561898Z } 2024-06-26T04:59:23.4562184Z  2024-06-26T04:59:23.4562488Z retry () { 2024-06-26T04:59:23.4562898Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T04:59:23.4563378Z } 2024-06-26T04:59:23.4563680Z  2024-06-26T04:59:23.4564008Z retry login "${DOCKER_REGISTRY}" 2024-06-26T04:59:23.4564457Z  2024-06-26T04:59:23.4565045Z # Check if image already exists, if it does then skip building it 2024-06-26T04:59:23.4565803Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-06-26T04:59:23.4566338Z  exit 0 2024-06-26T04:59:23.4566666Z fi 2024-06-26T04:59:23.4566973Z  2024-06-26T04:59:23.4567496Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-06-26T04:59:23.4568386Z # be empty. The default action would be to continue rebuild the image 2024-06-26T04:59:23.4569181Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-06-26T04:59:23.4569885Z  # if we're on the base branch then use the parent commit 2024-06-26T04:59:23.4570523Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-06-26T04:59:23.4570988Z else 2024-06-26T04:59:23.4571479Z  # otherwise we're on a PR, so use the most recent base commit 2024-06-26T04:59:23.4572213Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-06-26T04:59:23.4572758Z fi 2024-06-26T04:59:23.4573049Z  2024-06-26T04:59:23.4573391Z if [[ -z "${MERGE_BASE}" ]]; then 2024-06-26T04:59:23.4573931Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4574421Z  2024-06-26T04:59:23.4592242Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-06-26T04:59:23.4593278Z  exit 0 2024-06-26T04:59:23.4593616Z fi 2024-06-26T04:59:23.4593914Z  2024-06-26T04:59:23.4594387Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-06-26T04:59:23.4595447Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-06-26T04:59:23.4596318Z  exit 1 2024-06-26T04:59:23.4596636Z fi 2024-06-26T04:59:23.4596946Z  2024-06-26T04:59:23.4597477Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-06-26T04:59:23.4598486Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-06-26T04:59:23.4599431Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-06-26T04:59:23.4600474Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-06-26T04:59:23.4601661Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-06-26T04:59:23.4602352Z fi 2024-06-26T04:59:23.4602664Z  2024-06-26T04:59:23.4603051Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-06-26T04:59:23.4610829Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:23.4611374Z env: 2024-06-26T04:59:23.4611687Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:23.4612075Z DOCKER_BUILD_DIR: .ci/docker 2024-06-26T04:59:23.4612584Z BASE_REVISION: 4b9c9a9cc9c9283380a011310ba180c105c3dcb9 2024-06-26T04:59:23.4613715Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4614805Z DOCKER_TAG: 91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:23.4615452Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:23.4616020Z ##[endgroup] 2024-06-26T04:59:23.4638538Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:23.4639255Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:23.4640080Z + aws ecr get-login-password --region us-east-1 2024-06-26T04:59:23.4641359Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:23.8610583Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T04:59:23.8611546Z Configure a credential helper to remove this warning. See 2024-06-26T04:59:23.8612406Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T04:59:23.8612949Z 2024-06-26T04:59:23.8613068Z Login Succeeded 2024-06-26T04:59:23.8623463Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.0907191Z { 2024-06-26T04:59:24.0907510Z "schemaVersion": 2, 2024-06-26T04:59:24.0908084Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-06-26T04:59:24.0908669Z "config": { 2024-06-26T04:59:24.0909106Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-06-26T04:59:24.0909665Z "size": 44015, 2024-06-26T04:59:24.0911144Z "digest": "sha256:14402cfc353dbfa2ba1fa30f87c7ccf0e77a56d529c503e4a803c15ef3448962" 2024-06-26T04:59:24.0912271Z }, 2024-06-26T04:59:24.0912511Z "layers": [ 2024-06-26T04:59:24.0912777Z { 2024-06-26T04:59:24.0913378Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0914103Z "size": 30439283, 2024-06-26T04:59:24.0914735Z "digest": "sha256:2ec76a50fe7c8d5db9ec25590b9217e14e3920513c6e7b5be55db72a16b55f7c" 2024-06-26T04:59:24.0915380Z }, 2024-06-26T04:59:24.0915605Z { 2024-06-26T04:59:24.0916044Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0916615Z "size": 1823, 2024-06-26T04:59:24.0917150Z "digest": "sha256:94cf876dd15336a1bb9c68efe3c199eb689974408d8d00307e6ee7c39375add8" 2024-06-26T04:59:24.0918196Z }, 2024-06-26T04:59:24.0918530Z { 2024-06-26T04:59:24.0919163Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0920100Z "size": 313225743, 2024-06-26T04:59:24.0920612Z + exit 0 2024-06-26T04:59:24.0921510Z "digest": "sha256:844eff13770e3d7fcbb311cc117c4644a656c61edacc026aa3a4167da5c78eac" 2024-06-26T04:59:24.0922460Z }, 2024-06-26T04:59:24.0922823Z { 2024-06-26T04:59:24.0923442Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0924309Z "size": 804, 2024-06-26T04:59:24.0925300Z "digest": "sha256:0ebe1846f17bf25dd364aeebc97768509fda90340864aaaf66f18435862b5d00" 2024-06-26T04:59:24.0926391Z }, 2024-06-26T04:59:24.0926750Z { 2024-06-26T04:59:24.0927474Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0928475Z "size": 106, 2024-06-26T04:59:24.0929399Z "digest": "sha256:aab1810da80ffabe097875b02464bde8a4a3db91be2d3bbbe39ccdec81a36b2d" 2024-06-26T04:59:24.0930614Z }, 2024-06-26T04:59:24.0930991Z { 2024-06-26T04:59:24.0931699Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0932668Z "size": 545, 2024-06-26T04:59:24.0933947Z "digest": "sha256:f7a111ade856ed3b73afaea5a82f7717419e8215a08d5289c3bca760c5369c95" 2024-06-26T04:59:24.0935041Z }, 2024-06-26T04:59:24.0935475Z { 2024-06-26T04:59:24.0936319Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0937227Z "size": 1239, 2024-06-26T04:59:24.0938131Z "digest": "sha256:4521770e6b41adbbb2db5cff2e8b83a06b08caed66486df8ee6884ffa2625bf4" 2024-06-26T04:59:24.0938780Z }, 2024-06-26T04:59:24.0938999Z { 2024-06-26T04:59:24.0939525Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0940504Z "size": 484, 2024-06-26T04:59:24.0941424Z "digest": "sha256:deb25f4e99d07c3a82d02a1c780af7d3298b55434c9998f9fffd83dc97dc1077" 2024-06-26T04:59:24.0942535Z }, 2024-06-26T04:59:24.0942886Z { 2024-06-26T04:59:24.0943571Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0944600Z "size": 110320620, 2024-06-26T04:59:24.0945659Z "digest": "sha256:77b895c04768539cb607a2e35c08521bc97388f138643c1a2ff93365693ab2df" 2024-06-26T04:59:24.0946521Z }, 2024-06-26T04:59:24.0946745Z { 2024-06-26T04:59:24.0947167Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0947886Z "size": 3684, 2024-06-26T04:59:24.0948706Z "digest": "sha256:cf312583a2f806332647a141d0517260a0e45439a169dd92274ead5979f81acd" 2024-06-26T04:59:24.0949515Z }, 2024-06-26T04:59:24.0949727Z { 2024-06-26T04:59:24.0950153Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0950708Z "size": 1905, 2024-06-26T04:59:24.0951237Z "digest": "sha256:a180d8bca39de20a44602dd9e54099934988e98b0659cf7770cedfff341da77c" 2024-06-26T04:59:24.0952046Z }, 2024-06-26T04:59:24.0952283Z { 2024-06-26T04:59:24.0952692Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0953255Z "size": 702, 2024-06-26T04:59:24.0953791Z "digest": "sha256:29852573ae91b4bb7572c70c54c36797bb4bf172fa77beafdb68067f29ec5b8d" 2024-06-26T04:59:24.0954409Z }, 2024-06-26T04:59:24.0954636Z { 2024-06-26T04:59:24.0955062Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0955609Z "size": 2627181312, 2024-06-26T04:59:24.0956169Z "digest": "sha256:f32c36ef12b53151147e93ec42d342771bfad4fec642edd6a9b9e5f8326a3e77" 2024-06-26T04:59:24.0956794Z }, 2024-06-26T04:59:24.0957004Z { 2024-06-26T04:59:24.0957431Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0957993Z "size": 32, 2024-06-26T04:59:24.0958522Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.0959161Z }, 2024-06-26T04:59:24.0959385Z { 2024-06-26T04:59:24.0959964Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0960696Z "size": 381, 2024-06-26T04:59:24.0961249Z "digest": "sha256:a29555b55aa4775dfe3656a896ba2b217487eaf2d243c87a539bccf2d37f39c7" 2024-06-26T04:59:24.0961877Z }, 2024-06-26T04:59:24.0962097Z { 2024-06-26T04:59:24.0962519Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0963076Z "size": 220641, 2024-06-26T04:59:24.0963606Z "digest": "sha256:45d450910c56999dfec09dcf8bfbfd86105905281c6a3857b7031faf255f04b2" 2024-06-26T04:59:24.0964240Z }, 2024-06-26T04:59:24.0964473Z { 2024-06-26T04:59:24.0964992Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0965555Z "size": 232, 2024-06-26T04:59:24.0966093Z "digest": "sha256:b2dd7129275db5ceb6d3257a7e3f75711661020063a2d19616eb48365c88c9c0" 2024-06-26T04:59:24.0966709Z }, 2024-06-26T04:59:24.0966949Z { 2024-06-26T04:59:24.0967378Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0967931Z "size": 2840574, 2024-06-26T04:59:24.0968490Z "digest": "sha256:efd2aa485229a0666afce3f0965ec82713c94d4a3dba5008856716f4559c7e39" 2024-06-26T04:59:24.0969121Z }, 2024-06-26T04:59:24.0969342Z { 2024-06-26T04:59:24.0969919Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0970481Z "size": 1990, 2024-06-26T04:59:24.0971008Z "digest": "sha256:0661ae1bd510185c6176c43a2090f7fd4ad6a625ec04c827eb6149a37ae08030" 2024-06-26T04:59:24.0971636Z }, 2024-06-26T04:59:24.0971864Z { 2024-06-26T04:59:24.0972278Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0972839Z "size": 105, 2024-06-26T04:59:24.0973383Z "digest": "sha256:8e2059e3bfeba4fb9459ce01583b11644de40185026ff7c0fb758190b3dfabe1" 2024-06-26T04:59:24.0973994Z }, 2024-06-26T04:59:24.0974217Z { 2024-06-26T04:59:24.0974637Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0975183Z "size": 566, 2024-06-26T04:59:24.0975721Z "digest": "sha256:6542c0ef474e272d1a5f15b04ffd0ec7f1f536ba784ff139c58399b1c4248149" 2024-06-26T04:59:24.0976341Z }, 2024-06-26T04:59:24.0976553Z { 2024-06-26T04:59:24.0976980Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0977531Z "size": 32, 2024-06-26T04:59:24.0978059Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.0978691Z }, 2024-06-26T04:59:24.0978915Z { 2024-06-26T04:59:24.0979322Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0979870Z "size": 104, 2024-06-26T04:59:24.0980414Z "digest": "sha256:861b401f0ab5d6012e70dbd6ef8e5a9d5bce4689c87a635433ae7b7175ee0e16" 2024-06-26T04:59:24.0981034Z }, 2024-06-26T04:59:24.0981260Z { 2024-06-26T04:59:24.0981678Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0982220Z "size": 504, 2024-06-26T04:59:24.0982748Z "digest": "sha256:4ca9a23a73e71088cb9f0177151c841288f42938b799bf25c96e290463ba3a6c" 2024-06-26T04:59:24.0983368Z }, 2024-06-26T04:59:24.0983582Z { 2024-06-26T04:59:24.0984003Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0984561Z "size": 101109809, 2024-06-26T04:59:24.0985090Z "digest": "sha256:f6485591ba901699c177749168e8607338acdd109d977bfb67202fcf28b55842" 2024-06-26T04:59:24.0985692Z }, 2024-06-26T04:59:24.0985917Z { 2024-06-26T04:59:24.0986326Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0986876Z "size": 109, 2024-06-26T04:59:24.0987408Z "digest": "sha256:142b23cc83b8eba936d2663f8572979cd09d4d8963c1366cb87349132bbd83f3" 2024-06-26T04:59:24.0988013Z }, 2024-06-26T04:59:24.0988238Z { 2024-06-26T04:59:24.0988658Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0989199Z "size": 490, 2024-06-26T04:59:24.0989740Z "digest": "sha256:9f65d81b1aabd595f2419d33e6306b8474c43b28decbd11ca44ed37279010ff9" 2024-06-26T04:59:24.0990461Z }, 2024-06-26T04:59:24.0990675Z { 2024-06-26T04:59:24.0991099Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0991789Z "size": 336, 2024-06-26T04:59:24.0992365Z "digest": "sha256:260c90c40e762e888fcdd2a02024508f9af42ce14d46dec48e0ff34ab2cb0894" 2024-06-26T04:59:24.0992996Z }, 2024-06-26T04:59:24.0993224Z { 2024-06-26T04:59:24.0993634Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0994193Z "size": 103, 2024-06-26T04:59:24.0994717Z "digest": "sha256:b667c8726b8f413f7960e0813c9dbc93930426059a6ad0342a358d386e9c233a" 2024-06-26T04:59:24.0995314Z }, 2024-06-26T04:59:24.0995586Z { 2024-06-26T04:59:24.0996004Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0996547Z "size": 1474, 2024-06-26T04:59:24.0997082Z "digest": "sha256:9e75cc8302f3c403885811054b10f69b21cc2a4fafafac214b2b659cc9036959" 2024-06-26T04:59:24.0997712Z }, 2024-06-26T04:59:24.0997925Z { 2024-06-26T04:59:24.0998347Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.0998905Z "size": 465317655, 2024-06-26T04:59:24.0999558Z "digest": "sha256:30ff689874b32b30ec30d1f7081d1f14a4e7bf0f5ed8108647f192c7ac6e7188" 2024-06-26T04:59:24.1000187Z }, 2024-06-26T04:59:24.1000414Z { 2024-06-26T04:59:24.1000821Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1001376Z "size": 160, 2024-06-26T04:59:24.1001923Z "digest": "sha256:e75ff799212e700eddfd97d957cf9000a5cb79001cdd2d1d258016fc76b38b04" 2024-06-26T04:59:24.1002538Z }, 2024-06-26T04:59:24.1002763Z { 2024-06-26T04:59:24.1003182Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1003722Z "size": 2211, 2024-06-26T04:59:24.1004260Z "digest": "sha256:319065f88688c9273cff5b495dba47e4a017feda1bf861b6b6ff997cc11ce29f" 2024-06-26T04:59:24.1004965Z }, 2024-06-26T04:59:24.1005180Z { 2024-06-26T04:59:24.1005616Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1006173Z "size": 152, 2024-06-26T04:59:24.1006716Z "digest": "sha256:a26ad32bbc0fe830ffb52ed978b971cb4c492c489ac4d80c97f472952eb6c529" 2024-06-26T04:59:24.1007357Z }, 2024-06-26T04:59:24.1007583Z { 2024-06-26T04:59:24.1007993Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1008544Z "size": 648, 2024-06-26T04:59:24.1009073Z "digest": "sha256:1347adb36d32b24469eee98e2d1e94305ea395ab49d7616021705edc304c9524" 2024-06-26T04:59:24.1009682Z }, 2024-06-26T04:59:24.1009908Z { 2024-06-26T04:59:24.1010328Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1010866Z "size": 32, 2024-06-26T04:59:24.1011410Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1012043Z }, 2024-06-26T04:59:24.1012266Z { 2024-06-26T04:59:24.1012691Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1013253Z "size": 162, 2024-06-26T04:59:24.1013795Z "digest": "sha256:8b2e5004bcbab0b9c3b20aaec3aa2f3f482f8cbdc8e488d1e92a24646aebe851" 2024-06-26T04:59:24.1014444Z }, 2024-06-26T04:59:24.1014674Z { 2024-06-26T04:59:24.1015091Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1015652Z "size": 109, 2024-06-26T04:59:24.1016208Z "digest": "sha256:3ad8bad3700657dbadc73b57a9f435ab604b52af2dbb2960fec90101703c2c7c" 2024-06-26T04:59:24.1016830Z }, 2024-06-26T04:59:24.1017064Z { 2024-06-26T04:59:24.1017486Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1018025Z "size": 102, 2024-06-26T04:59:24.1018573Z "digest": "sha256:d335836e780559f38cf4cacaf5fa72a7fd7d9c4cfc1286978413360de54cd94d" 2024-06-26T04:59:24.1019202Z }, 2024-06-26T04:59:24.1019420Z { 2024-06-26T04:59:24.1019845Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1020530Z "size": 422, 2024-06-26T04:59:24.1021060Z "digest": "sha256:03e3083ae7df397a9661184e7bc0ca6bbc2e1f6854833a31fcaadd40bfeec4b2" 2024-06-26T04:59:24.1021690Z }, 2024-06-26T04:59:24.1021920Z { 2024-06-26T04:59:24.1022335Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1022887Z "size": 32, 2024-06-26T04:59:24.1023427Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1024046Z }, 2024-06-26T04:59:24.1024269Z { 2024-06-26T04:59:24.1024694Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1025232Z "size": 111, 2024-06-26T04:59:24.1025779Z "digest": "sha256:97cc85cb7c4e8e1a4f40eff1a6443c10d929b413dbc2a2a69bbf4b04005e17c2" 2024-06-26T04:59:24.1026414Z }, 2024-06-26T04:59:24.1026625Z { 2024-06-26T04:59:24.1027048Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1027606Z "size": 475, 2024-06-26T04:59:24.1028131Z "digest": "sha256:d490220e4f6bc3cd20e5a46b873043c8f47ffaa718f81ef42a8e45704fc2e96c" 2024-06-26T04:59:24.1028751Z }, 2024-06-26T04:59:24.1028976Z { 2024-06-26T04:59:24.1029447Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1030001Z "size": 32, 2024-06-26T04:59:24.1030545Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1031164Z }, 2024-06-26T04:59:24.1031391Z { 2024-06-26T04:59:24.1031975Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1032518Z "size": 112, 2024-06-26T04:59:24.1033035Z "digest": "sha256:04d0190bc97a111068f095e0631193a6ef218093d621a406151a284e12049861" 2024-06-26T04:59:24.1033639Z }, 2024-06-26T04:59:24.1033857Z { 2024-06-26T04:59:24.1034285Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1034834Z "size": 563, 2024-06-26T04:59:24.1035358Z "digest": "sha256:04d47328c7bd2d0987f8357de16bdf9224a7629db9fc046318942fbcee32c568" 2024-06-26T04:59:24.1035976Z }, 2024-06-26T04:59:24.1036199Z { 2024-06-26T04:59:24.1036606Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1037168Z "size": 43163951, 2024-06-26T04:59:24.1037732Z "digest": "sha256:69a3d4e29db0e7d7bd5833503abd51a03f51e2ee4dc4c5317f572a7e9ab4edda" 2024-06-26T04:59:24.1038351Z }, 2024-06-26T04:59:24.1038577Z { 2024-06-26T04:59:24.1038999Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1039540Z "size": 106, 2024-06-26T04:59:24.1040085Z "digest": "sha256:0231c909d672d2e40b9deccf81dc97dddfdd0530b2b072782fe8d2b29957aa54" 2024-06-26T04:59:24.1040720Z }, 2024-06-26T04:59:24.1040958Z { 2024-06-26T04:59:24.1041378Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1041929Z "size": 295, 2024-06-26T04:59:24.1042467Z "digest": "sha256:7af7703fd0c99d4c22c6c420c3ca9ace4646234bce2dbbc8e4a685276bd96a6b" 2024-06-26T04:59:24.1043109Z }, 2024-06-26T04:59:24.1043333Z { 2024-06-26T04:59:24.1043744Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1044323Z "size": 32, 2024-06-26T04:59:24.1044942Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1045565Z }, 2024-06-26T04:59:24.1045791Z { 2024-06-26T04:59:24.1046216Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1046756Z "size": 106, 2024-06-26T04:59:24.1047285Z "digest": "sha256:027ac6996c62a5c9772f3885939b2ca1508d6342a46be3344c2eb474c0032903" 2024-06-26T04:59:24.1047915Z }, 2024-06-26T04:59:24.1048127Z { 2024-06-26T04:59:24.1048552Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1049105Z "size": 425, 2024-06-26T04:59:24.1049625Z "digest": "sha256:74a68590fdfcf793ff1148af97440cab24ff53112786632dfd31af3861d7d695" 2024-06-26T04:59:24.1050388Z }, 2024-06-26T04:59:24.1050613Z { 2024-06-26T04:59:24.1051028Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1051589Z "size": 19308854, 2024-06-26T04:59:24.1052152Z "digest": "sha256:2e867e2465c63943a6f568b03f82de03caa582dbcfb66bb8364ca6af33bf687e" 2024-06-26T04:59:24.1052774Z }, 2024-06-26T04:59:24.1052989Z { 2024-06-26T04:59:24.1053409Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1053949Z "size": 108, 2024-06-26T04:59:24.1054486Z "digest": "sha256:f51a2243c1bf3305a28ce63dcb4e55761f73abf2dc0172c25921e352761dc92e" 2024-06-26T04:59:24.1055108Z }, 2024-06-26T04:59:24.1055322Z { 2024-06-26T04:59:24.1055746Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1056304Z "size": 441, 2024-06-26T04:59:24.1056953Z "digest": "sha256:dccc1e11707a46b3ff2271ca32b160514fed1bc6a7e80dd316aba8fe7ef834dd" 2024-06-26T04:59:24.1057603Z }, 2024-06-26T04:59:24.1057837Z { 2024-06-26T04:59:24.1058250Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1058814Z "size": 702, 2024-06-26T04:59:24.1059448Z "digest": "sha256:29852573ae91b4bb7572c70c54c36797bb4bf172fa77beafdb68067f29ec5b8d" 2024-06-26T04:59:24.1060071Z }, 2024-06-26T04:59:24.1060288Z { 2024-06-26T04:59:24.1060714Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1061273Z "size": 142, 2024-06-26T04:59:24.1061810Z "digest": "sha256:fa84b128b2d8bd6d79b5e2f01e4cf834d1b1d9439d42893cd7a3f2c0f9ecd923" 2024-06-26T04:59:24.1062453Z }, 2024-06-26T04:59:24.1062684Z { 2024-06-26T04:59:24.1063121Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1063721Z "size": 135, 2024-06-26T04:59:24.1064260Z "digest": "sha256:79c5c1b4789a8061392ed80f7df55a0cf8b3f578f569025973dafc832d7bbb1b" 2024-06-26T04:59:24.1064876Z }, 2024-06-26T04:59:24.1065110Z { 2024-06-26T04:59:24.1065531Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1066075Z "size": 32, 2024-06-26T04:59:24.1066618Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1067251Z }, 2024-06-26T04:59:24.1067511Z { 2024-06-26T04:59:24.1068093Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1068648Z "size": 191, 2024-06-26T04:59:24.1069165Z "digest": "sha256:585d93983ffa398cf27a97f4939a0120bc1a733f4d8b1de24126a3a1a8cca278" 2024-06-26T04:59:24.1069786Z }, 2024-06-26T04:59:24.1070009Z { 2024-06-26T04:59:24.1070417Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1070972Z "size": 1212, 2024-06-26T04:59:24.1071501Z "digest": "sha256:0e2757b3e947531b56521a63a38f869487bdaf8d434517834db7ac70c3fb4453" 2024-06-26T04:59:24.1072275Z }, 2024-06-26T04:59:24.1072507Z { 2024-06-26T04:59:24.1072939Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1073481Z "size": 702, 2024-06-26T04:59:24.1074016Z "digest": "sha256:29852573ae91b4bb7572c70c54c36797bb4bf172fa77beafdb68067f29ec5b8d" 2024-06-26T04:59:24.1074635Z }, 2024-06-26T04:59:24.1074854Z { 2024-06-26T04:59:24.1075273Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1075829Z "size": 138, 2024-06-26T04:59:24.1076388Z "digest": "sha256:017702dc3bb9e5484c17f9128a44348f83a3b8f07e0b1562e0b715ba365dcded" 2024-06-26T04:59:24.1076998Z }, 2024-06-26T04:59:24.1077226Z { 2024-06-26T04:59:24.1077635Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1078189Z "size": 1838061418, 2024-06-26T04:59:24.1078755Z "digest": "sha256:26b6032d8e72bb67615c5d0a83ba3e01d208fc78c20cace534c5bff7bbe41a59" 2024-06-26T04:59:24.1079370Z }, 2024-06-26T04:59:24.1079596Z { 2024-06-26T04:59:24.1080016Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1080735Z "size": 152, 2024-06-26T04:59:24.1081293Z "digest": "sha256:7eaba9afcf96af27f87045a1f17dbbbc83d88c47208139b136a80edf27b5b1f8" 2024-06-26T04:59:24.1081938Z }, 2024-06-26T04:59:24.1082153Z { 2024-06-26T04:59:24.1082582Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1083140Z "size": 849, 2024-06-26T04:59:24.1083663Z "digest": "sha256:4e1273fff111ab63c6def740c9fe3f405168e73ca96505750ec9560e571f877f" 2024-06-26T04:59:24.1084296Z }, 2024-06-26T04:59:24.1084525Z { 2024-06-26T04:59:24.1085014Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1085574Z "size": 702, 2024-06-26T04:59:24.1086107Z "digest": "sha256:29852573ae91b4bb7572c70c54c36797bb4bf172fa77beafdb68067f29ec5b8d" 2024-06-26T04:59:24.1086712Z }, 2024-06-26T04:59:24.1086948Z { 2024-06-26T04:59:24.1087373Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1087923Z "size": 139, 2024-06-26T04:59:24.1088458Z "digest": "sha256:095aaa194ad58bed818d7624f54a8462d2368b1d7a9177dbf1d622d158e3def8" 2024-06-26T04:59:24.1089083Z }, 2024-06-26T04:59:24.1089296Z { 2024-06-26T04:59:24.1089817Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1090373Z "size": 32, 2024-06-26T04:59:24.1090897Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1091540Z }, 2024-06-26T04:59:24.1091768Z { 2024-06-26T04:59:24.1092180Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1092741Z "size": 158, 2024-06-26T04:59:24.1093279Z "digest": "sha256:e69bf94e94cb18ac9d20e45d50582f15473ce61f6365e247b604cbcd61f4ddcc" 2024-06-26T04:59:24.1093891Z }, 2024-06-26T04:59:24.1094143Z { 2024-06-26T04:59:24.1094566Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1095105Z "size": 909, 2024-06-26T04:59:24.1095650Z "digest": "sha256:5b282fb06022aaeb8cb00baf6758ebd1fc50213fa08837e6ebd8367648f0cc03" 2024-06-26T04:59:24.1096281Z }, 2024-06-26T04:59:24.1096492Z { 2024-06-26T04:59:24.1096910Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1097465Z "size": 702, 2024-06-26T04:59:24.1097983Z "digest": "sha256:29852573ae91b4bb7572c70c54c36797bb4bf172fa77beafdb68067f29ec5b8d" 2024-06-26T04:59:24.1098604Z }, 2024-06-26T04:59:24.1098827Z { 2024-06-26T04:59:24.1099238Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1099788Z "size": 135, 2024-06-26T04:59:24.1100304Z "digest": "sha256:26170244c99466a119be20c01e62387ea3245e38bca465127b3e1b5ca8683314" 2024-06-26T04:59:24.1100899Z }, 2024-06-26T04:59:24.1101122Z { 2024-06-26T04:59:24.1101544Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1102085Z "size": 32, 2024-06-26T04:59:24.1102630Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1103271Z }, 2024-06-26T04:59:24.1103536Z { 2024-06-26T04:59:24.1103990Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1104549Z "size": 156, 2024-06-26T04:59:24.1105086Z "digest": "sha256:45c7879febc5552f1bb9b59969d326cc799eeb1d3e31f7d425d1d02259551a4e" 2024-06-26T04:59:24.1105720Z }, 2024-06-26T04:59:24.1105953Z { 2024-06-26T04:59:24.1106365Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1106923Z "size": 1578, 2024-06-26T04:59:24.1107481Z "digest": "sha256:f5dd85f916a3414b09232ecaddf806dfe81f2d7fba5ed61373edd807df99a262" 2024-06-26T04:59:24.1108109Z }, 2024-06-26T04:59:24.1108339Z { 2024-06-26T04:59:24.1108771Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1109314Z "size": 32, 2024-06-26T04:59:24.1109858Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1110582Z }, 2024-06-26T04:59:24.1110799Z { 2024-06-26T04:59:24.1111221Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1111964Z "size": 128, 2024-06-26T04:59:24.1112548Z "digest": "sha256:00cfe467539eb476bd66ff9c6bf2bea8601f073a4ca45ecb476c3e37ed2b2d85" 2024-06-26T04:59:24.1113183Z }, 2024-06-26T04:59:24.1113409Z { 2024-06-26T04:59:24.1113822Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1114374Z "size": 379, 2024-06-26T04:59:24.1114891Z "digest": "sha256:761b58c4a7323f0fa29d02368b839830353760466f08d0a73f0d5e505d8aa44c" 2024-06-26T04:59:24.1115484Z }, 2024-06-26T04:59:24.1115713Z { 2024-06-26T04:59:24.1116132Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1116669Z "size": 32, 2024-06-26T04:59:24.1117219Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1117841Z }, 2024-06-26T04:59:24.1118056Z { 2024-06-26T04:59:24.1118472Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1119024Z "size": 104, 2024-06-26T04:59:24.1119540Z "digest": "sha256:ce57725e9a4c3eadb62246f231e0f27e0535973a6f881557be320048c4552f2e" 2024-06-26T04:59:24.1120272Z }, 2024-06-26T04:59:24.1120502Z { 2024-06-26T04:59:24.1120912Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1121466Z "size": 1841, 2024-06-26T04:59:24.1122021Z "digest": "sha256:ecdd20263166bfcc5e8e25f125b05534fe8c754c82c8ea6aa5a60d733cbbf694" 2024-06-26T04:59:24.1122644Z }, 2024-06-26T04:59:24.1122871Z { 2024-06-26T04:59:24.1123296Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1123842Z "size": 7529630, 2024-06-26T04:59:24.1124402Z "digest": "sha256:f6b630e16b35df33b7f2ff25c6a3213d58d8203e1dd6c5dcfc41e96ecf26f646" 2024-06-26T04:59:24.1125105Z }, 2024-06-26T04:59:24.1125316Z { 2024-06-26T04:59:24.1125750Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1126309Z "size": 106, 2024-06-26T04:59:24.1126828Z "digest": "sha256:05462c0bf1655f0b876d0358a0831b29d5b2eaa9f4e99f9aa6be8f1a338b5d00" 2024-06-26T04:59:24.1127450Z }, 2024-06-26T04:59:24.1127680Z { 2024-06-26T04:59:24.1128092Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1128645Z "size": 165, 2024-06-26T04:59:24.1129184Z "digest": "sha256:2861e30c4419c8e6e8cbf7f943a4d0a897ecdc504f4b1383a30de43a569798bb" 2024-06-26T04:59:24.1129794Z }, 2024-06-26T04:59:24.1130018Z { 2024-06-26T04:59:24.1130442Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1130982Z "size": 7944, 2024-06-26T04:59:24.1131523Z "digest": "sha256:ec250a1df2c075bc9fcf2595945b010296b0b32813ed9a7d93c6769f3ffe6543" 2024-06-26T04:59:24.1132155Z }, 2024-06-26T04:59:24.1132364Z { 2024-06-26T04:59:24.1132785Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1133339Z "size": 8064, 2024-06-26T04:59:24.1133868Z "digest": "sha256:994a842bbc8796fcf2e4d295f0ba513718cc7c33f63ef0648913e1ec011fbe23" 2024-06-26T04:59:24.1134490Z }, 2024-06-26T04:59:24.1134715Z { 2024-06-26T04:59:24.1135122Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1135674Z "size": 303, 2024-06-26T04:59:24.1136202Z "digest": "sha256:851f80854d0a39831957ee6397e18c35b8d4fff54dccfe373a2f10ec410a4460" 2024-06-26T04:59:24.1136804Z }, 2024-06-26T04:59:24.1137028Z { 2024-06-26T04:59:24.1137449Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1137991Z "size": 32, 2024-06-26T04:59:24.1138527Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1139156Z }, 2024-06-26T04:59:24.1139367Z { 2024-06-26T04:59:24.1139785Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1140468Z "size": 108, 2024-06-26T04:59:24.1141010Z "digest": "sha256:3d9bae1abce26e7cd0093200b96c41cdb09be5472c60ebaeca918e78cb6fe6b5" 2024-06-26T04:59:24.1141652Z }, 2024-06-26T04:59:24.1141876Z { 2024-06-26T04:59:24.1142322Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1142878Z "size": 54145774, 2024-06-26T04:59:24.1143453Z "digest": "sha256:a80b78a9c4343fe6bbfc10a01ea35ad79aee2ce2ba85a79bbad4b88dca8f9a98" 2024-06-26T04:59:24.1144088Z }, 2024-06-26T04:59:24.1144313Z { 2024-06-26T04:59:24.1144730Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-06-26T04:59:24.1145271Z "size": 32, 2024-06-26T04:59:24.1145809Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-06-26T04:59:24.1146436Z } 2024-06-26T04:59:24.1146646Z ] 2024-06-26T04:59:24.1146867Z } 2024-06-26T04:59:24.1263871Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T04:59:24.1264625Z tag=${ECR_DOCKER_IMAGE##*/} 2024-06-26T04:59:24.1265186Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-06-26T04:59:24.1273618Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:24.1274121Z env: 2024-06-26T04:59:24.1274382Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:24.1275337Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.1276333Z ##[endgroup] 2024-06-26T04:59:24.1300521Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3.8-gcc11-91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.1354592Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-06-26T04:59:24.1355164Z with: 2024-06-26T04:59:24.1356036Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.1357183Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:24.1357702Z env: 2024-06-26T04:59:24.1357961Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:24.1358290Z ##[endgroup] 2024-06-26T04:59:24.1376345Z ##[group]Run set -x 2024-06-26T04:59:24.1376671Z set -x 2024-06-26T04:59:24.1376953Z set +e 2024-06-26T04:59:24.1377230Z  2024-06-26T04:59:24.1377482Z login() { 2024-06-26T04:59:24.1378145Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-06-26T04:59:24.1378873Z } 2024-06-26T04:59:24.1379114Z  2024-06-26T04:59:24.1379419Z retry () { 2024-06-26T04:59:24.1379777Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-06-26T04:59:24.1380213Z } 2024-06-26T04:59:24.1380463Z  2024-06-26T04:59:24.1380744Z retry login "${DOCKER_REGISTRY}" 2024-06-26T04:59:24.1381155Z  2024-06-26T04:59:24.1381410Z set -e 2024-06-26T04:59:24.1381859Z # ignore output since only exit code is used for conditional 2024-06-26T04:59:24.1382573Z # only pull docker image if it's not available locally 2024-06-26T04:59:24.1383348Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-06-26T04:59:24.1384069Z  retry docker pull "${DOCKER_IMAGE}" 2024-06-26T04:59:24.1384483Z fi 2024-06-26T04:59:24.1391600Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T04:59:24.1392286Z env: 2024-06-26T04:59:24.1392539Z GIT_DEFAULT_BRANCH: main 2024-06-26T04:59:24.1393494Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.1394623Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:24.1395130Z ##[endgroup] 2024-06-26T04:59:24.1415988Z + set +e 2024-06-26T04:59:24.1416705Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:24.1417488Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:24.1419782Z + aws ecr get-login-password --region us-east-1 2024-06-26T04:59:24.1421278Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-06-26T04:59:24.5517451Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-06-26T04:59:24.5518505Z Configure a credential helper to remove this warning. See 2024-06-26T04:59:24.5519347Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-06-26T04:59:24.5519894Z 2024-06-26T04:59:24.5520010Z Login Succeeded 2024-06-26T04:59:24.5527956Z + set -e 2024-06-26T04:59:24.5529070Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.5654486Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.5656270Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T04:59:24.7665558Z 91382da70d5719cd7007b6b80b71d2f48398f6b7: Pulling from pytorch/pytorch-linux-jammy-py3.8-gcc11 2024-06-26T04:59:24.7672838Z 2ec76a50fe7c: Pulling fs layer 2024-06-26T04:59:24.7673586Z 94cf876dd153: Pulling fs layer 2024-06-26T04:59:24.7674183Z 844eff13770e: Pulling fs layer 2024-06-26T04:59:24.7674814Z 0ebe1846f17b: Pulling fs layer 2024-06-26T04:59:24.7675267Z aab1810da80f: Pulling fs layer 2024-06-26T04:59:24.7675896Z f7a111ade856: Pulling fs layer 2024-06-26T04:59:24.7676385Z 4521770e6b41: Pulling fs layer 2024-06-26T04:59:24.7677005Z deb25f4e99d0: Pulling fs layer 2024-06-26T04:59:24.7677571Z 77b895c04768: Pulling fs layer 2024-06-26T04:59:24.7678669Z cf312583a2f8: Pulling fs layer 2024-06-26T04:59:24.7679308Z a180d8bca39d: Pulling fs layer 2024-06-26T04:59:24.7680011Z 29852573ae91: Pulling fs layer 2024-06-26T04:59:24.7680567Z f32c36ef12b5: Pulling fs layer 2024-06-26T04:59:24.7681045Z 4f4fb700ef54: Pulling fs layer 2024-06-26T04:59:24.7681596Z a29555b55aa4: Pulling fs layer 2024-06-26T04:59:24.7682012Z aab1810da80f: Waiting 2024-06-26T04:59:24.7682450Z 45d450910c56: Pulling fs layer 2024-06-26T04:59:24.7682785Z f7a111ade856: Waiting 2024-06-26T04:59:24.7683221Z b2dd7129275d: Pulling fs layer 2024-06-26T04:59:24.7683643Z 4521770e6b41: Waiting 2024-06-26T04:59:24.7684007Z efd2aa485229: Pulling fs layer 2024-06-26T04:59:24.7684524Z 0661ae1bd510: Pulling fs layer 2024-06-26T04:59:24.7685024Z deb25f4e99d0: Waiting 2024-06-26T04:59:24.7685403Z cf312583a2f8: Waiting 2024-06-26T04:59:24.7685767Z 8e2059e3bfeb: Pulling fs layer 2024-06-26T04:59:24.7686114Z 77b895c04768: Waiting 2024-06-26T04:59:24.7686530Z 29852573ae91: Waiting 2024-06-26T04:59:24.7686846Z 6542c0ef474e: Pulling fs layer 2024-06-26T04:59:24.7687257Z f32c36ef12b5: Waiting 2024-06-26T04:59:24.7687547Z 4f4fb700ef54: Waiting 2024-06-26T04:59:24.7687859Z a29555b55aa4: Waiting 2024-06-26T04:59:24.7688299Z 861b401f0ab5: Pulling fs layer 2024-06-26T04:59:24.7688706Z a180d8bca39d: Waiting 2024-06-26T04:59:24.7689128Z 45d450910c56: Waiting 2024-06-26T04:59:24.7689529Z b2dd7129275d: Waiting 2024-06-26T04:59:24.7689834Z 4ca9a23a73e7: Pulling fs layer 2024-06-26T04:59:24.7690301Z efd2aa485229: Waiting 2024-06-26T04:59:24.7690617Z f6485591ba90: Pulling fs layer 2024-06-26T04:59:24.7691161Z 142b23cc83b8: Pulling fs layer 2024-06-26T04:59:24.7691535Z 0661ae1bd510: Waiting 2024-06-26T04:59:24.7691962Z 9f65d81b1aab: Pulling fs layer 2024-06-26T04:59:24.7692335Z 260c90c40e76: Pulling fs layer 2024-06-26T04:59:24.7692783Z 8e2059e3bfeb: Waiting 2024-06-26T04:59:24.7693102Z b667c8726b8f: Pulling fs layer 2024-06-26T04:59:24.7693592Z 6542c0ef474e: Waiting 2024-06-26T04:59:24.7693954Z 9e75cc8302f3: Pulling fs layer 2024-06-26T04:59:24.7694302Z 0ebe1846f17b: Waiting 2024-06-26T04:59:24.7694619Z 30ff689874b3: Pulling fs layer 2024-06-26T04:59:24.7695011Z 861b401f0ab5: Waiting 2024-06-26T04:59:24.7695516Z e75ff799212e: Pulling fs layer 2024-06-26T04:59:24.7695912Z 4ca9a23a73e7: Waiting 2024-06-26T04:59:24.7696210Z 142b23cc83b8: Waiting 2024-06-26T04:59:24.7696610Z f6485591ba90: Waiting 2024-06-26T04:59:24.7696909Z 9f65d81b1aab: Waiting 2024-06-26T04:59:24.7697263Z 319065f88688: Pulling fs layer 2024-06-26T04:59:24.7697613Z 9e75cc8302f3: Waiting 2024-06-26T04:59:24.7697914Z 260c90c40e76: Waiting 2024-06-26T04:59:24.7698271Z b667c8726b8f: Waiting 2024-06-26T04:59:24.7698603Z a26ad32bbc0f: Pulling fs layer 2024-06-26T04:59:24.7699137Z 30ff689874b3: Waiting 2024-06-26T04:59:24.7699476Z 1347adb36d32: Pulling fs layer 2024-06-26T04:59:24.7699907Z 319065f88688: Waiting 2024-06-26T04:59:24.7700196Z a26ad32bbc0f: Waiting 2024-06-26T04:59:24.7700495Z e75ff799212e: Waiting 2024-06-26T04:59:24.7700858Z 1347adb36d32: Waiting 2024-06-26T04:59:24.7701165Z 8b2e5004bcba: Pulling fs layer 2024-06-26T04:59:24.7701657Z 3ad8bad37006: Pulling fs layer 2024-06-26T04:59:24.7702042Z d335836e7805: Pulling fs layer 2024-06-26T04:59:24.7702494Z 03e3083ae7df: Pulling fs layer 2024-06-26T04:59:24.7702964Z 97cc85cb7c4e: Pulling fs layer 2024-06-26T04:59:24.7703333Z d490220e4f6b: Pulling fs layer 2024-06-26T04:59:24.7703712Z 03e3083ae7df: Waiting 2024-06-26T04:59:24.7704046Z 04d0190bc97a: Pulling fs layer 2024-06-26T04:59:24.7704407Z 8b2e5004bcba: Waiting 2024-06-26T04:59:24.7704788Z 97cc85cb7c4e: Waiting 2024-06-26T04:59:24.7705138Z 04d47328c7bd: Pulling fs layer 2024-06-26T04:59:24.7705552Z 3ad8bad37006: Waiting 2024-06-26T04:59:24.7705916Z d490220e4f6b: Waiting 2024-06-26T04:59:24.7706299Z 69a3d4e29db0: Pulling fs layer 2024-06-26T04:59:24.7706791Z 04d0190bc97a: Waiting 2024-06-26T04:59:24.7707188Z 04d47328c7bd: Waiting 2024-06-26T04:59:24.7707528Z 0231c909d672: Pulling fs layer 2024-06-26T04:59:24.7707877Z d335836e7805: Waiting 2024-06-26T04:59:24.7708259Z 69a3d4e29db0: Waiting 2024-06-26T04:59:24.7708604Z 7af7703fd0c9: Pulling fs layer 2024-06-26T04:59:24.7709004Z 027ac6996c62: Pulling fs layer 2024-06-26T04:59:24.7709358Z 74a68590fdfc: Pulling fs layer 2024-06-26T04:59:24.7709706Z 0231c909d672: Waiting 2024-06-26T04:59:24.7710075Z 2e867e2465c6: Pulling fs layer 2024-06-26T04:59:24.7710465Z 7af7703fd0c9: Waiting 2024-06-26T04:59:24.7710812Z f51a2243c1bf: Pulling fs layer 2024-06-26T04:59:24.7711157Z 027ac6996c62: Waiting 2024-06-26T04:59:24.7711458Z dccc1e11707a: Pulling fs layer 2024-06-26T04:59:24.7712106Z 2e867e2465c6: Waiting 2024-06-26T04:59:24.7712464Z 74a68590fdfc: Waiting 2024-06-26T04:59:24.7712797Z fa84b128b2d8: Pulling fs layer 2024-06-26T04:59:24.7713164Z 79c5c1b4789a: Pulling fs layer 2024-06-26T04:59:24.7713522Z dccc1e11707a: Waiting 2024-06-26T04:59:24.7713826Z 585d93983ffa: Pulling fs layer 2024-06-26T04:59:24.7714189Z 0e2757b3e947: Pulling fs layer 2024-06-26T04:59:24.7714584Z fa84b128b2d8: Waiting 2024-06-26T04:59:24.7714917Z 79c5c1b4789a: Waiting 2024-06-26T04:59:24.7715220Z 585d93983ffa: Waiting 2024-06-26T04:59:24.7715533Z 017702dc3bb9: Pulling fs layer 2024-06-26T04:59:24.7715957Z 26b6032d8e72: Pulling fs layer 2024-06-26T04:59:24.7716444Z 7eaba9afcf96: Pulling fs layer 2024-06-26T04:59:24.7716795Z 017702dc3bb9: Waiting 2024-06-26T04:59:24.7717094Z 4e1273fff111: Pulling fs layer 2024-06-26T04:59:24.7717441Z 26b6032d8e72: Waiting 2024-06-26T04:59:24.7717791Z 095aaa194ad5: Pulling fs layer 2024-06-26T04:59:24.7718183Z 4e1273fff111: Waiting 2024-06-26T04:59:24.7718484Z 7eaba9afcf96: Waiting 2024-06-26T04:59:24.7718804Z e69bf94e94cb: Pulling fs layer 2024-06-26T04:59:24.7719140Z 095aaa194ad5: Waiting 2024-06-26T04:59:24.7719458Z 5b282fb06022: Pulling fs layer 2024-06-26T04:59:24.7719807Z e69bf94e94cb: Waiting 2024-06-26T04:59:24.7720115Z 26170244c994: Pulling fs layer 2024-06-26T04:59:24.7720452Z 5b282fb06022: Waiting 2024-06-26T04:59:24.7720764Z 45c7879febc5: Pulling fs layer 2024-06-26T04:59:24.7721117Z f5dd85f916a3: Pulling fs layer 2024-06-26T04:59:24.7721461Z 26170244c994: Waiting 2024-06-26T04:59:24.7721759Z 00cfe467539e: Pulling fs layer 2024-06-26T04:59:24.7722318Z f5dd85f916a3: Waiting 2024-06-26T04:59:24.7723058Z 761b58c4a732: Pulling fs layer 2024-06-26T04:59:24.7723628Z 45c7879febc5: Waiting 2024-06-26T04:59:24.7724157Z ce57725e9a4c: Pulling fs layer 2024-06-26T04:59:24.7724741Z 761b58c4a732: Waiting 2024-06-26T04:59:24.7725378Z 00cfe467539e: Waiting 2024-06-26T04:59:24.7725962Z ecdd20263166: Pulling fs layer 2024-06-26T04:59:24.7726650Z f6b630e16b35: Pulling fs layer 2024-06-26T04:59:24.7727299Z 05462c0bf165: Pulling fs layer 2024-06-26T04:59:24.7727883Z ecdd20263166: Waiting 2024-06-26T04:59:24.7728449Z 2861e30c4419: Pulling fs layer 2024-06-26T04:59:24.7729013Z f6b630e16b35: Waiting 2024-06-26T04:59:24.7729572Z ec250a1df2c0: Pulling fs layer 2024-06-26T04:59:24.7730244Z 994a842bbc87: Pulling fs layer 2024-06-26T04:59:24.7730851Z 2861e30c4419: Waiting 2024-06-26T04:59:24.7731411Z 851f80854d0a: Pulling fs layer 2024-06-26T04:59:24.7732030Z 994a842bbc87: Waiting 2024-06-26T04:59:24.7732547Z 3d9bae1abce2: Pulling fs layer 2024-06-26T04:59:24.7733143Z ec250a1df2c0: Waiting 2024-06-26T04:59:24.7733677Z a80b78a9c434: Pulling fs layer 2024-06-26T04:59:24.7734292Z 851f80854d0a: Waiting 2024-06-26T04:59:24.7734832Z 3d9bae1abce2: Waiting 2024-06-26T04:59:24.7735374Z a80b78a9c434: Waiting 2024-06-26T04:59:24.8289946Z 94cf876dd153: Verifying Checksum 2024-06-26T04:59:24.8290546Z 94cf876dd153: Download complete 2024-06-26T04:59:24.9097832Z 0ebe1846f17b: Download complete 2024-06-26T04:59:25.0218577Z aab1810da80f: Verifying Checksum 2024-06-26T04:59:25.0219145Z aab1810da80f: Download complete 2024-06-26T04:59:25.0987789Z f7a111ade856: Verifying Checksum 2024-06-26T04:59:25.0988267Z f7a111ade856: Download complete 2024-06-26T04:59:25.1361029Z 2ec76a50fe7c: Verifying Checksum 2024-06-26T04:59:25.1361547Z 2ec76a50fe7c: Download complete 2024-06-26T04:59:25.2017341Z deb25f4e99d0: Download complete 2024-06-26T04:59:25.2692375Z cf312583a2f8: Verifying Checksum 2024-06-26T04:59:25.2693134Z cf312583a2f8: Download complete 2024-06-26T04:59:25.3622110Z a180d8bca39d: Download complete 2024-06-26T04:59:25.4296872Z 29852573ae91: Download complete 2024-06-26T04:59:26.1241532Z 2ec76a50fe7c: Pull complete 2024-06-26T04:59:26.1657525Z 94cf876dd153: Pull complete 2024-06-26T04:59:26.3255980Z 77b895c04768: Verifying Checksum 2024-06-26T04:59:26.3256464Z 77b895c04768: Download complete 2024-06-26T04:59:26.3367466Z 4f4fb700ef54: Verifying Checksum 2024-06-26T04:59:26.3368094Z 4f4fb700ef54: Download complete 2024-06-26T04:59:26.4236603Z a29555b55aa4: Download complete 2024-06-26T04:59:26.4906626Z 45d450910c56: Verifying Checksum 2024-06-26T04:59:26.5570990Z 45d450910c56: Download complete 2024-06-26T04:59:26.5571736Z b2dd7129275d: Verifying Checksum 2024-06-26T04:59:26.6588305Z efd2aa485229: Verifying Checksum 2024-06-26T04:59:26.6588957Z efd2aa485229: Download complete 2024-06-26T04:59:26.7435492Z 0661ae1bd510: Download complete 2024-06-26T04:59:26.8165136Z 8e2059e3bfeb: Verifying Checksum 2024-06-26T04:59:26.8165690Z 8e2059e3bfeb: Download complete 2024-06-26T04:59:26.8873126Z 6542c0ef474e: Verifying Checksum 2024-06-26T04:59:26.8874024Z 6542c0ef474e: Download complete 2024-06-26T04:59:26.9574182Z 861b401f0ab5: Download complete 2024-06-26T04:59:27.0269643Z 4ca9a23a73e7: Verifying Checksum 2024-06-26T04:59:27.0270459Z 4ca9a23a73e7: Download complete 2024-06-26T04:59:27.9599113Z 844eff13770e: Verifying Checksum 2024-06-26T04:59:27.9599791Z 844eff13770e: Download complete 2024-06-26T04:59:28.0251759Z 142b23cc83b8: Download complete 2024-06-26T04:59:28.0945919Z f6485591ba90: Verifying Checksum 2024-06-26T04:59:28.0946454Z f6485591ba90: Download complete 2024-06-26T04:59:28.0959062Z 9f65d81b1aab: Verifying Checksum 2024-06-26T04:59:28.0959512Z 9f65d81b1aab: Download complete 2024-06-26T04:59:28.1593703Z b667c8726b8f: Verifying Checksum 2024-06-26T04:59:28.1594408Z b667c8726b8f: Download complete 2024-06-26T04:59:28.1806899Z 260c90c40e76: Verifying Checksum 2024-06-26T04:59:28.1807678Z 260c90c40e76: Download complete 2024-06-26T04:59:28.2401480Z 9e75cc8302f3: Download complete 2024-06-26T04:59:28.3138115Z e75ff799212e: Download complete 2024-06-26T04:59:28.3896279Z 319065f88688: Download complete 2024-06-26T04:59:28.4728950Z a26ad32bbc0f: Verifying Checksum 2024-06-26T04:59:28.4729513Z a26ad32bbc0f: Download complete 2024-06-26T04:59:28.5510373Z 1347adb36d32: Verifying Checksum 2024-06-26T04:59:28.5511210Z 1347adb36d32: Download complete 2024-06-26T04:59:28.6249501Z 8b2e5004bcba: Verifying Checksum 2024-06-26T04:59:28.6250005Z 8b2e5004bcba: Download complete 2024-06-26T04:59:28.6996284Z 3ad8bad37006: Verifying Checksum 2024-06-26T04:59:28.6997052Z 3ad8bad37006: Download complete 2024-06-26T04:59:28.7718174Z d335836e7805: Verifying Checksum 2024-06-26T04:59:28.7719164Z d335836e7805: Download complete 2024-06-26T04:59:28.8455708Z 03e3083ae7df: Download complete 2024-06-26T04:59:28.9182177Z 97cc85cb7c4e: Verifying Checksum 2024-06-26T04:59:28.9182897Z 97cc85cb7c4e: Download complete 2024-06-26T04:59:28.9919199Z d490220e4f6b: Download complete 2024-06-26T04:59:29.0785359Z 04d0190bc97a: Download complete 2024-06-26T04:59:29.1536081Z 04d47328c7bd: Verifying Checksum 2024-06-26T04:59:29.1536681Z 04d47328c7bd: Download complete 2024-06-26T04:59:29.6401495Z 69a3d4e29db0: Verifying Checksum 2024-06-26T04:59:29.6402242Z 69a3d4e29db0: Download complete 2024-06-26T04:59:29.7170202Z 0231c909d672: Download complete 2024-06-26T04:59:29.7996715Z 7af7703fd0c9: Download complete 2024-06-26T04:59:29.8891355Z 027ac6996c62: Download complete 2024-06-26T04:59:29.9621290Z 74a68590fdfc: Verifying Checksum 2024-06-26T04:59:29.9622119Z 74a68590fdfc: Download complete 2024-06-26T04:59:30.2127520Z 2e867e2465c6: Verifying Checksum 2024-06-26T04:59:30.2128159Z 2e867e2465c6: Download complete 2024-06-26T04:59:30.2980422Z f51a2243c1bf: Download complete 2024-06-26T04:59:30.3852184Z dccc1e11707a: Download complete 2024-06-26T04:59:30.4504878Z fa84b128b2d8: Verifying Checksum 2024-06-26T04:59:30.4505526Z fa84b128b2d8: Download complete 2024-06-26T04:59:30.5369834Z 79c5c1b4789a: Verifying Checksum 2024-06-26T04:59:30.5370812Z 79c5c1b4789a: Download complete 2024-06-26T04:59:30.6208472Z 585d93983ffa: Verifying Checksum 2024-06-26T04:59:30.6208994Z 585d93983ffa: Download complete 2024-06-26T04:59:30.6912953Z 0e2757b3e947: Verifying Checksum 2024-06-26T04:59:30.6913823Z 0e2757b3e947: Download complete 2024-06-26T04:59:30.7873756Z 017702dc3bb9: Verifying Checksum 2024-06-26T04:59:30.7874714Z 017702dc3bb9: Download complete 2024-06-26T04:59:32.8928253Z 30ff689874b3: Verifying Checksum 2024-06-26T04:59:32.8929181Z 30ff689874b3: Download complete 2024-06-26T04:59:32.9696297Z 7eaba9afcf96: Download complete 2024-06-26T04:59:33.0521921Z 4e1273fff111: Verifying Checksum 2024-06-26T04:59:33.0522477Z 4e1273fff111: Download complete 2024-06-26T04:59:33.1295469Z 095aaa194ad5: Verifying Checksum 2024-06-26T04:59:33.1296272Z 095aaa194ad5: Download complete 2024-06-26T04:59:33.2089161Z e69bf94e94cb: Verifying Checksum 2024-06-26T04:59:33.2090384Z e69bf94e94cb: Download complete 2024-06-26T04:59:33.2711014Z 5b282fb06022: Download complete 2024-06-26T04:59:33.3469648Z 26170244c994: Verifying Checksum 2024-06-26T04:59:33.3470446Z 26170244c994: Download complete 2024-06-26T04:59:33.4209789Z 45c7879febc5: Verifying Checksum 2024-06-26T04:59:33.4210501Z 45c7879febc5: Download complete 2024-06-26T04:59:33.4963278Z f5dd85f916a3: Verifying Checksum 2024-06-26T04:59:33.4964019Z f5dd85f916a3: Download complete 2024-06-26T04:59:33.5678178Z 00cfe467539e: Verifying Checksum 2024-06-26T04:59:33.5678923Z 00cfe467539e: Download complete 2024-06-26T04:59:33.6394780Z 761b58c4a732: Verifying Checksum 2024-06-26T04:59:33.6395401Z 761b58c4a732: Download complete 2024-06-26T04:59:33.7166989Z ce57725e9a4c: Verifying Checksum 2024-06-26T04:59:33.7167583Z ce57725e9a4c: Download complete 2024-06-26T04:59:33.7921685Z ecdd20263166: Verifying Checksum 2024-06-26T04:59:33.7922244Z ecdd20263166: Download complete 2024-06-26T04:59:33.9164592Z f6b630e16b35: Verifying Checksum 2024-06-26T04:59:33.9165369Z f6b630e16b35: Download complete 2024-06-26T04:59:33.9904165Z 05462c0bf165: Download complete 2024-06-26T04:59:34.0597226Z 2861e30c4419: Verifying Checksum 2024-06-26T04:59:34.0598218Z 2861e30c4419: Download complete 2024-06-26T04:59:34.1402582Z ec250a1df2c0: Download complete 2024-06-26T04:59:34.2225529Z 994a842bbc87: Verifying Checksum 2024-06-26T04:59:34.2226103Z 994a842bbc87: Download complete 2024-06-26T04:59:34.2974282Z 851f80854d0a: Verifying Checksum 2024-06-26T04:59:34.3739825Z 851f80854d0a: Download complete 2024-06-26T04:59:34.3740579Z 3d9bae1abce2: Verifying Checksum 2024-06-26T04:59:34.3740982Z 3d9bae1abce2: Download complete 2024-06-26T04:59:34.9682834Z a80b78a9c434: Verifying Checksum 2024-06-26T04:59:34.9683386Z a80b78a9c434: Download complete 2024-06-26T04:59:37.8787634Z 844eff13770e: Pull complete 2024-06-26T04:59:38.4265166Z 0ebe1846f17b: Pull complete 2024-06-26T04:59:38.8305799Z aab1810da80f: Pull complete 2024-06-26T04:59:39.3512423Z f7a111ade856: Pull complete 2024-06-26T04:59:39.9498287Z 4521770e6b41: Pull complete 2024-06-26T04:59:40.4338480Z deb25f4e99d0: Pull complete 2024-06-26T04:59:59.5016114Z 26b6032d8e72: Verifying Checksum 2024-06-26T04:59:59.5016612Z 26b6032d8e72: Download complete 2024-06-26T05:00:02.2035249Z f32c36ef12b5: Verifying Checksum 2024-06-26T05:00:02.2035771Z f32c36ef12b5: Download complete 2024-06-26T05:00:02.7745032Z 77b895c04768: Pull complete 2024-06-26T05:00:03.2783669Z cf312583a2f8: Pull complete 2024-06-26T05:00:03.6049412Z a180d8bca39d: Pull complete 2024-06-26T05:00:03.8291906Z 29852573ae91: Pull complete 2024-06-26T05:00:51.9040954Z f32c36ef12b5: Pull complete 2024-06-26T05:00:52.0957923Z 4f4fb700ef54: Pull complete 2024-06-26T05:00:52.3082209Z a29555b55aa4: Pull complete 2024-06-26T05:00:52.4564643Z 45d450910c56: Pull complete 2024-06-26T05:00:52.4936796Z b2dd7129275d: Pull complete 2024-06-26T05:00:52.5685967Z efd2aa485229: Pull complete 2024-06-26T05:00:52.5984803Z 0661ae1bd510: Pull complete 2024-06-26T05:00:52.6303881Z 8e2059e3bfeb: Pull complete 2024-06-26T05:00:52.6705748Z 6542c0ef474e: Pull complete 2024-06-26T05:00:52.7949591Z 861b401f0ab5: Pull complete 2024-06-26T05:00:52.8221730Z 4ca9a23a73e7: Pull complete 2024-06-26T05:00:55.0012000Z f6485591ba90: Pull complete 2024-06-26T05:00:55.1818194Z 142b23cc83b8: Pull complete 2024-06-26T05:00:55.3798532Z 9f65d81b1aab: Pull complete 2024-06-26T05:00:55.5233057Z 260c90c40e76: Pull complete 2024-06-26T05:00:55.6557704Z b667c8726b8f: Pull complete 2024-06-26T05:00:55.8518432Z 9e75cc8302f3: Pull complete 2024-06-26T05:01:03.4261759Z 30ff689874b3: Pull complete 2024-06-26T05:01:03.6506911Z e75ff799212e: Pull complete 2024-06-26T05:01:03.8829644Z 319065f88688: Pull complete 2024-06-26T05:01:04.1073345Z a26ad32bbc0f: Pull complete 2024-06-26T05:01:04.3318765Z 1347adb36d32: Pull complete 2024-06-26T05:01:04.8087406Z 8b2e5004bcba: Pull complete 2024-06-26T05:01:05.0262769Z 3ad8bad37006: Pull complete 2024-06-26T05:01:05.1513678Z d335836e7805: Pull complete 2024-06-26T05:01:05.3482654Z 03e3083ae7df: Pull complete 2024-06-26T05:01:05.7564543Z 97cc85cb7c4e: Pull complete 2024-06-26T05:01:05.9807690Z d490220e4f6b: Pull complete 2024-06-26T05:01:06.4614866Z 04d0190bc97a: Pull complete 2024-06-26T05:01:06.6841844Z 04d47328c7bd: Pull complete 2024-06-26T05:01:08.4571866Z 69a3d4e29db0: Pull complete 2024-06-26T05:01:08.6657938Z 0231c909d672: Pull complete 2024-06-26T05:01:08.8896693Z 7af7703fd0c9: Pull complete 2024-06-26T05:01:09.3112551Z 027ac6996c62: Pull complete 2024-06-26T05:01:09.5456593Z 74a68590fdfc: Pull complete 2024-06-26T05:01:10.0019597Z 2e867e2465c6: Pull complete 2024-06-26T05:01:10.2284625Z f51a2243c1bf: Pull complete 2024-06-26T05:01:10.4551859Z dccc1e11707a: Pull complete 2024-06-26T05:01:10.8013851Z fa84b128b2d8: Pull complete 2024-06-26T05:01:11.0297837Z 79c5c1b4789a: Pull complete 2024-06-26T05:01:11.5193499Z 585d93983ffa: Pull complete 2024-06-26T05:01:11.6297893Z 0e2757b3e947: Pull complete 2024-06-26T05:01:11.7424971Z 017702dc3bb9: Pull complete 2024-06-26T05:01:43.1171928Z 26b6032d8e72: Pull complete 2024-06-26T05:01:43.6447113Z 7eaba9afcf96: Pull complete 2024-06-26T05:01:43.8126569Z 4e1273fff111: Pull complete 2024-06-26T05:01:44.1664058Z 095aaa194ad5: Pull complete 2024-06-26T05:01:44.5248365Z e69bf94e94cb: Pull complete 2024-06-26T05:01:44.7659580Z 5b282fb06022: Pull complete 2024-06-26T05:01:45.2232026Z 26170244c994: Pull complete 2024-06-26T05:01:45.6779839Z 45c7879febc5: Pull complete 2024-06-26T05:01:45.9016091Z f5dd85f916a3: Pull complete 2024-06-26T05:01:46.3927732Z 00cfe467539e: Pull complete 2024-06-26T05:01:46.6270492Z 761b58c4a732: Pull complete 2024-06-26T05:01:47.0938121Z ce57725e9a4c: Pull complete 2024-06-26T05:01:47.3163656Z ecdd20263166: Pull complete 2024-06-26T05:01:47.6684193Z f6b630e16b35: Pull complete 2024-06-26T05:01:47.8926830Z 05462c0bf165: Pull complete 2024-06-26T05:01:48.1171059Z 2861e30c4419: Pull complete 2024-06-26T05:01:48.3533019Z ec250a1df2c0: Pull complete 2024-06-26T05:01:48.5897994Z 994a842bbc87: Pull complete 2024-06-26T05:01:48.8143358Z 851f80854d0a: Pull complete 2024-06-26T05:01:49.2737270Z 3d9bae1abce2: Pull complete 2024-06-26T05:01:51.0702211Z a80b78a9c434: Pull complete 2024-06-26T05:01:51.4016567Z Digest: sha256:1862f87fe60cbac0efa4720f6f6fe873270a315ff02a9510d48d1480259bc4e9 2024-06-26T05:01:51.4410707Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T05:01:51.4633022Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T05:01:51.4677914Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T05:01:51.4678863Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-06-26T05:01:51.4688696Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:01:51.4689198Z env: 2024-06-26T05:01:51.4689464Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:01:51.4689787Z ##[endgroup] 2024-06-26T05:01:51.4809949Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T05:01:51.4810747Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-06-26T05:01:51.4811441Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-06-26T05:01:51.4812098Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-06-26T05:01:51.4820070Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:01:51.4820828Z env: 2024-06-26T05:01:51.4821231Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:01:51.4821727Z ##[endgroup] 2024-06-26T05:01:53.6675273Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T05:01:53.6907359Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.7/site-packages (5.9.1) 2024-06-26T05:01:53.7022684Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.7/site-packages (11.525.84) 2024-06-26T05:01:53.8112422Z Prepare all required actions 2024-06-26T05:01:53.8112942Z Getting action download info 2024-06-26T05:01:53.9278228Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-06-26T05:01:54.1435501Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-06-26T05:01:54.2662378Z ##[group]Run ./.github/actions/download-build-artifacts 2024-06-26T05:01:54.2662881Z with: 2024-06-26T05:01:54.2663164Z name: linux-jammy-py3.8-gcc11 2024-06-26T05:01:54.2663537Z s3-bucket: gha-artifacts 2024-06-26T05:01:54.2663863Z env: 2024-06-26T05:01:54.2664124Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:01:54.2664440Z ##[endgroup] 2024-06-26T05:01:54.2699223Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T05:01:54.2699667Z with: 2024-06-26T05:01:54.2699951Z name: linux-jammy-py3.8-gcc11 2024-06-26T05:01:54.2700334Z s3-bucket: gha-artifacts 2024-06-26T05:01:54.2700700Z region: us-east-1 2024-06-26T05:01:54.2700984Z env: 2024-06-26T05:01:54.2701246Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:01:54.2701570Z ##[endgroup] 2024-06-26T05:01:54.7499162Z (node:28814) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T05:01:54.7499896Z 2024-06-26T05:01:54.7500152Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T05:01:54.7500901Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T05:01:54.7502251Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T05:01:54.8369613Z Found 1 objects with prefix pytorch/pytorch/9673645538/linux-jammy-py3.8-gcc11/ 2024-06-26T05:01:54.8370652Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T05:01:58.5440335Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-06-26T05:01:58.5446567Z Artifact download has finished successfully 2024-06-26T05:01:58.5615937Z ##[group]Run unzip -o artifacts.zip 2024-06-26T05:01:58.5616351Z unzip -o artifacts.zip 2024-06-26T05:01:58.5623778Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:01:58.5624278Z env: 2024-06-26T05:01:58.5624531Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:01:58.5624868Z ##[endgroup] 2024-06-26T05:01:58.5952861Z Archive: artifacts.zip 2024-06-26T05:01:58.5953637Z creating: dist/ 2024-06-26T05:01:59.5165861Z inflating: dist/torch-2.5.0a0+gitb8c4c54-cp38-cp38-linux_x86_64.whl 2024-06-26T05:01:59.5166644Z creating: build/custom_test_artifacts/ 2024-06-26T05:01:59.5167224Z creating: build/custom_test_artifacts/custom-op-build/ 2024-06-26T05:01:59.5168010Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-06-26T05:01:59.5169350Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-06-26T05:01:59.5170876Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T05:01:59.5171904Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-06-26T05:01:59.5173461Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T05:01:59.5174923Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T05:01:59.5176177Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T05:01:59.5177975Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T05:01:59.5179790Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T05:01:59.5181367Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T05:01:59.5183297Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T05:01:59.5185982Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T05:01:59.5187583Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T05:01:59.5188808Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T05:01:59.5190005Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T05:01:59.5191237Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T05:01:59.5192863Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T05:01:59.5193886Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-06-26T05:01:59.5194852Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-06-26T05:01:59.5195821Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-06-26T05:01:59.5197042Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-06-26T05:01:59.5198430Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-06-26T05:01:59.5199603Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-06-26T05:01:59.5200703Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-06-26T05:01:59.5201819Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-06-26T05:01:59.5202956Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-06-26T05:01:59.5204092Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-06-26T05:01:59.5205511Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-06-26T05:01:59.5207025Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-06-26T05:01:59.5208209Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-06-26T05:01:59.5329178Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-06-26T05:01:59.5330213Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-06-26T05:01:59.5331364Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-06-26T05:01:59.5332653Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-06-26T05:01:59.5333893Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-06-26T05:01:59.5335057Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-06-26T05:01:59.5336241Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-06-26T05:01:59.5337445Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-06-26T05:01:59.5338641Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-06-26T05:01:59.5339820Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-06-26T05:01:59.5341004Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-06-26T05:01:59.5353868Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-06-26T05:01:59.5431063Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-06-26T05:01:59.5432610Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T05:01:59.5433760Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-06-26T05:01:59.5434779Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-06-26T05:01:59.5435727Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-06-26T05:01:59.5436656Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-06-26T05:01:59.5437548Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-06-26T05:01:59.5438348Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-06-26T05:01:59.5439173Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-06-26T05:01:59.5545669Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-06-26T05:01:59.5606349Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-06-26T05:01:59.5607344Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-06-26T05:01:59.5608048Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-06-26T05:01:59.5608886Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-06-26T05:01:59.5610287Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T05:01:59.5611245Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-06-26T05:01:59.5612209Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T05:01:59.5613340Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T05:01:59.5614338Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T05:01:59.5615474Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T05:01:59.5616629Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T05:01:59.5617665Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T05:01:59.5618678Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T05:01:59.5619880Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T05:01:59.5621095Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T05:01:59.5622412Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T05:01:59.5623590Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T05:01:59.5624896Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T05:01:59.5626124Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T05:01:59.5627147Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-06-26T05:01:59.5628090Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-06-26T05:01:59.5629075Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-06-26T05:01:59.5630186Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-06-26T05:01:59.5631437Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-06-26T05:01:59.5632942Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-06-26T05:01:59.5634225Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-06-26T05:01:59.5635398Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-06-26T05:01:59.5636563Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-06-26T05:01:59.5637740Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-06-26T05:01:59.5638903Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-06-26T05:01:59.5640053Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-06-26T05:01:59.5652413Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-06-26T05:01:59.5713196Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-06-26T05:01:59.5714454Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T05:01:59.5715787Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-06-26T05:01:59.5716778Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-06-26T05:01:59.5717717Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-06-26T05:01:59.5718637Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-06-26T05:01:59.5719518Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-06-26T05:01:59.5720314Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-06-26T05:01:59.5721134Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-06-26T05:01:59.5769241Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-06-26T05:01:59.5770085Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-06-26T05:01:59.5770865Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-06-26T05:01:59.5771791Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-06-26T05:01:59.5773044Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-06-26T05:01:59.5774087Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-06-26T05:01:59.5775146Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-06-26T05:01:59.5776392Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-06-26T05:01:59.5777460Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-06-26T05:01:59.5778688Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-06-26T05:01:59.5779924Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-06-26T05:01:59.5781043Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-06-26T05:01:59.5782143Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-06-26T05:01:59.5783425Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-06-26T05:01:59.5784720Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-06-26T05:01:59.5785967Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-06-26T05:01:59.5787243Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-06-26T05:01:59.5788765Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-06-26T05:01:59.5790083Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-06-26T05:01:59.5791174Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-06-26T05:01:59.5792571Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-06-26T05:01:59.5793645Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-06-26T05:01:59.5794851Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-06-26T05:01:59.5796190Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-06-26T05:01:59.5797485Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-06-26T05:01:59.5798707Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-06-26T05:01:59.5799940Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-06-26T05:01:59.5801361Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-06-26T05:01:59.5803474Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-06-26T05:01:59.5805178Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-06-26T05:01:59.5806418Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-06-26T05:01:59.5807751Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-06-26T05:01:59.5912929Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-06-26T05:01:59.5914284Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-06-26T05:01:59.5915597Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-06-26T05:01:59.5916991Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-06-26T05:01:59.5918350Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-06-26T05:01:59.5919633Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-06-26T05:01:59.5920952Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-06-26T05:01:59.5922272Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-06-26T05:01:59.5923709Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-06-26T05:01:59.5925046Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-06-26T05:01:59.5926438Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-06-26T05:01:59.5936378Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-06-26T05:01:59.5987967Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-06-26T05:01:59.5989608Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T05:01:59.5990985Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-06-26T05:01:59.5992736Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-06-26T05:01:59.5993788Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-06-26T05:01:59.5994800Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-06-26T05:01:59.5995756Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-06-26T05:01:59.5996633Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-06-26T05:01:59.5997520Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-06-26T05:01:59.6094375Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-06-26T05:01:59.6135878Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-06-26T05:01:59.6136548Z creating: build/lib/ 2024-06-26T05:01:59.6136909Z inflating: build/lib/libclog.a 2024-06-26T05:01:59.6145774Z inflating: build/lib/libpthreadpool.a 2024-06-26T05:01:59.6153503Z inflating: build/lib/libcpuinfo_internals.a 2024-06-26T05:01:59.6161379Z inflating: build/lib/libcpuinfo.a 2024-06-26T05:01:59.6225848Z inflating: build/lib/libgtest.a 2024-06-26T05:01:59.6307131Z inflating: build/lib/libprotobuf-lite.a 2024-06-26T05:01:59.6313980Z inflating: build/lib/libittnotify.a 2024-06-26T05:01:59.6385397Z inflating: build/lib/libbenchmark.a 2024-06-26T05:01:59.6411936Z inflating: build/lib/libtensorpipe_uv.a 2024-06-26T05:01:59.6474261Z inflating: build/lib/libasmjit.a 2024-06-26T05:01:59.6906470Z inflating: build/lib/libprotobuf.a 2024-06-26T05:01:59.7016653Z inflating: build/lib/libgloo.a 2024-06-26T05:01:59.7037416Z inflating: build/lib/libfmt.a 2024-06-26T05:01:59.7037868Z inflating: build/lib/libfoxi_loader.a 2024-06-26T05:01:59.7039450Z inflating: build/lib/libtorch_global_deps.so 2024-06-26T05:01:59.7130201Z inflating: build/lib/libc10.so 2024-06-26T05:01:59.7148759Z inflating: build/lib/libpytorch_qnnpack.a 2024-06-26T05:01:59.7150689Z inflating: build/lib/libnnpack_reference_layers.a 2024-06-26T05:01:59.7636057Z inflating: build/lib/libprotoc.a 2024-06-26T05:01:59.7652600Z inflating: build/lib/libgmock.a 2024-06-26T05:01:59.7653076Z inflating: build/lib/libgtest_main.a 2024-06-26T05:01:59.7653698Z inflating: build/lib/libbenchmark_main.a 2024-06-26T05:01:59.7671171Z inflating: build/lib/libnnpack.a 2024-06-26T05:02:00.7014988Z inflating: build/lib/libdnnl.a 2024-06-26T05:02:00.7549409Z inflating: build/lib/libtensorpipe.a 2024-06-26T05:02:00.8557817Z inflating: build/lib/libfbgemm.a 2024-06-26T05:02:00.8558334Z inflating: build/lib/libgmock_main.a 2024-06-26T05:02:00.8839341Z inflating: build/lib/libkineto.a 2024-06-26T05:02:00.8878419Z inflating: build/lib/libonnx_proto.a 2024-06-26T05:02:00.9057411Z inflating: build/lib/libXNNPACK.a 2024-06-26T05:02:00.9726990Z inflating: build/lib/libonnx.a 2024-06-26T05:02:03.2417325Z inflating: build/lib/libtorch_cpu.so 2024-06-26T05:02:03.2417929Z inflating: build/lib/libtorch.so 2024-06-26T05:02:03.2422359Z inflating: build/lib/libunbox_lib.a 2024-06-26T05:02:03.2426026Z inflating: build/lib/libshm.so 2024-06-26T05:02:03.2445335Z inflating: build/lib/libjitbackend_test.so 2024-06-26T05:02:03.2512070Z inflating: build/lib/libtorchbind_test.so 2024-06-26T05:02:03.2536390Z inflating: build/lib/libbackend_with_compiler.so 2024-06-26T05:02:03.4367991Z inflating: build/lib/libtorch_python.so 2024-06-26T05:02:03.4401797Z inflating: build/lib/libnnapi_backend.so 2024-06-26T05:02:03.4402255Z creating: build/bin/ 2024-06-26T05:02:03.4402604Z creating: build/bin/CMakeFiles/ 2024-06-26T05:02:03.4403187Z inflating: build/bin/CMakeFiles/CMakeDirectoryInformation.cmake 2024-06-26T05:02:03.4403871Z extracting: build/bin/CMakeFiles/progress.marks 2024-06-26T05:02:03.4455673Z inflating: build/bin/reduce_ops_test 2024-06-26T05:02:03.4456137Z inflating: build/bin/Makefile 2024-06-26T05:02:03.4509461Z inflating: build/bin/reportMemoryUsage_test 2024-06-26T05:02:03.4509994Z inflating: build/bin/cmake_install.cmake 2024-06-26T05:02:03.4569063Z inflating: build/bin/quantized_test 2024-06-26T05:02:03.4569546Z inflating: build/bin/CTestTestfile.cmake 2024-06-26T05:02:03.4621174Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-06-26T05:02:03.4674758Z inflating: build/bin/c10_DeviceGuard_test 2024-06-26T05:02:03.4726475Z inflating: build/bin/c10_Device_test 2024-06-26T05:02:03.4776664Z inflating: build/bin/c10_StreamGuard_test 2024-06-26T05:02:03.4837575Z inflating: build/bin/c10_DispatchKeySet_test 2024-06-26T05:02:03.4892812Z inflating: build/bin/c10_Scalar_test 2024-06-26T05:02:03.4945423Z inflating: build/bin/c10_SymInt_test 2024-06-26T05:02:03.5001594Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-06-26T05:02:03.5058829Z inflating: build/bin/c10_InlineStreamGuard_test 2024-06-26T05:02:03.5115938Z inflating: build/bin/c10_SizesAndStrides_test 2024-06-26T05:02:03.5188143Z inflating: build/bin/c10_cow_test 2024-06-26T05:02:03.5238753Z inflating: build/bin/c10_ConstexprCrc_test 2024-06-26T05:02:03.5293499Z inflating: build/bin/c10_Bitset_test 2024-06-26T05:02:03.5344722Z inflating: build/bin/c10_DeadlockDetection_test 2024-06-26T05:02:03.5397044Z inflating: build/bin/c10_Half_test 2024-06-26T05:02:03.5454422Z inflating: build/bin/c10_LeftRight_test 2024-06-26T05:02:03.5511395Z inflating: build/bin/c10_Metaprogramming_test 2024-06-26T05:02:03.5562888Z inflating: build/bin/c10_Synchronized_test 2024-06-26T05:02:03.5619715Z inflating: build/bin/c10_ThreadLocal_test 2024-06-26T05:02:03.5673362Z inflating: build/bin/c10_TypeIndex_test 2024-06-26T05:02:03.5726092Z inflating: build/bin/c10_TypeList_test 2024-06-26T05:02:03.5776373Z inflating: build/bin/c10_TypeTraits_test 2024-06-26T05:02:03.5829887Z inflating: build/bin/c10_accumulate_test 2024-06-26T05:02:03.5886983Z inflating: build/bin/c10_bfloat16_test 2024-06-26T05:02:03.5941501Z inflating: build/bin/c10_exception_test 2024-06-26T05:02:03.5993490Z inflating: build/bin/c10_bit_cast_test 2024-06-26T05:02:03.6050184Z inflating: build/bin/c10_complex_test 2024-06-26T05:02:03.6108123Z inflating: build/bin/c10_complex_math_test 2024-06-26T05:02:03.6160087Z inflating: build/bin/c10_flags_test 2024-06-26T05:02:03.6211884Z inflating: build/bin/c10_generic_math_test 2024-06-26T05:02:03.6374925Z inflating: build/bin/c10_intrusive_ptr_test 2024-06-26T05:02:03.6427730Z inflating: build/bin/c10_irange_test 2024-06-26T05:02:03.6482875Z inflating: build/bin/c10_lazy_test 2024-06-26T05:02:03.6542845Z inflating: build/bin/c10_logging_test 2024-06-26T05:02:03.6602629Z inflating: build/bin/c10_registry_test 2024-06-26T05:02:03.6687005Z inflating: build/bin/c10_optional_test 2024-06-26T05:02:03.6758347Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-06-26T05:02:03.6920181Z inflating: build/bin/c10_small_vector_test 2024-06-26T05:02:03.6974141Z inflating: build/bin/c10_ssize_test 2024-06-26T05:02:03.7028667Z inflating: build/bin/c10_string_util_test 2024-06-26T05:02:03.7082194Z inflating: build/bin/c10_tempfile_test 2024-06-26T05:02:03.7143698Z inflating: build/bin/c10_string_view_test 2024-06-26T05:02:03.7201955Z inflating: build/bin/c10_typeid_test 2024-06-26T05:02:03.7250385Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-06-26T05:02:03.7720456Z inflating: build/bin/protoc-3.13.0.0 2024-06-26T05:02:03.8172997Z inflating: build/bin/protoc 2024-06-26T05:02:03.8503640Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-06-26T05:02:03.8851029Z inflating: build/bin/vec_test_all_types_AVX512 2024-06-26T05:02:03.9211508Z inflating: build/bin/vec_test_all_types_AVX2 2024-06-26T05:02:03.9266329Z inflating: build/bin/HashStoreTest 2024-06-26T05:02:03.9324423Z inflating: build/bin/TCPStoreTest 2024-06-26T05:02:03.9380940Z inflating: build/bin/FileStoreTest 2024-06-26T05:02:03.9449231Z inflating: build/bin/ProcessGroupGlooTest 2024-06-26T05:02:03.9451712Z inflating: build/bin/example_allreduce 2024-06-26T05:02:03.9512324Z inflating: build/bin/test_dist_autograd 2024-06-26T05:02:03.9514437Z inflating: build/bin/parallel_benchmark 2024-06-26T05:02:03.9587669Z inflating: build/bin/test_cpp_rpc 2024-06-26T05:02:03.9596602Z inflating: build/bin/aot_model_compiler_test 2024-06-26T05:02:03.9666006Z inflating: build/bin/test_mobile_nnc 2024-06-26T05:02:03.9726435Z inflating: build/bin/static_runtime_bench 2024-06-26T05:02:04.0066634Z inflating: build/bin/test_lazy 2024-06-26T05:02:04.0141359Z inflating: build/bin/Dict_test 2024-06-26T05:02:04.0195736Z inflating: build/bin/Dimname_test 2024-06-26T05:02:04.0446668Z inflating: build/bin/static_runtime_test 2024-06-26T05:02:04.0512488Z inflating: build/bin/MaybeOwned_test 2024-06-26T05:02:04.0571132Z inflating: build/bin/NamedTensor_test 2024-06-26T05:02:04.0631921Z inflating: build/bin/apply_utils_test 2024-06-26T05:02:04.0691878Z inflating: build/bin/atest 2024-06-26T05:02:04.0756733Z inflating: build/bin/basic 2024-06-26T05:02:04.0813137Z inflating: build/bin/broadcast_test 2024-06-26T05:02:04.0865661Z inflating: build/bin/cpu_allocator_test 2024-06-26T05:02:04.0925776Z inflating: build/bin/cpu_generator_test 2024-06-26T05:02:04.0979676Z inflating: build/bin/cpu_profiling_allocator_test 2024-06-26T05:02:04.1073588Z inflating: build/bin/cpu_rng_test 2024-06-26T05:02:04.1125390Z inflating: build/bin/dispatch_key_set_test 2024-06-26T05:02:04.1177122Z inflating: build/bin/dlconvertor_test 2024-06-26T05:02:04.1236407Z inflating: build/bin/extension_backend_test 2024-06-26T05:02:04.1293286Z inflating: build/bin/half_test 2024-06-26T05:02:04.2416358Z inflating: build/bin/test_api 2024-06-26T05:02:04.2513560Z inflating: build/bin/ivalue_test 2024-06-26T05:02:04.2564943Z inflating: build/bin/lazy_tensor_test 2024-06-26T05:02:04.2619692Z inflating: build/bin/math_kernel_test 2024-06-26T05:02:04.2675093Z inflating: build/bin/memory_format_test 2024-06-26T05:02:04.2728072Z inflating: build/bin/operator_name_test 2024-06-26T05:02:04.2782513Z inflating: build/bin/memory_overlapping_test 2024-06-26T05:02:04.2839668Z inflating: build/bin/native_test 2024-06-26T05:02:04.2894592Z inflating: build/bin/mobile_memory_cleanup 2024-06-26T05:02:04.2947264Z inflating: build/bin/operators_test 2024-06-26T05:02:04.3000925Z inflating: build/bin/packedtensoraccessor_test 2024-06-26T05:02:04.3069080Z inflating: build/bin/pow_test 2024-06-26T05:02:04.3127989Z inflating: build/bin/scalar_tensor_test 2024-06-26T05:02:04.3187465Z inflating: build/bin/scalar_test 2024-06-26T05:02:04.3240524Z inflating: build/bin/StorageUtils_test 2024-06-26T05:02:04.3294755Z inflating: build/bin/stride_properties_test 2024-06-26T05:02:04.3374542Z inflating: build/bin/tensor_iterator_test 2024-06-26T05:02:04.3431425Z inflating: build/bin/type_ptr_test 2024-06-26T05:02:04.3487214Z inflating: build/bin/test_parallel 2024-06-26T05:02:04.3489432Z inflating: build/bin/thread_init_test 2024-06-26T05:02:04.3550723Z inflating: build/bin/type_test 2024-06-26T05:02:04.3552139Z inflating: build/bin/verify_api_visibility 2024-06-26T05:02:04.3606075Z inflating: build/bin/undefined_tensor_test 2024-06-26T05:02:04.3677041Z inflating: build/bin/legacy_vmap_test 2024-06-26T05:02:04.3729925Z inflating: build/bin/weakref_test 2024-06-26T05:02:04.3782829Z inflating: build/bin/wrapdim_test 2024-06-26T05:02:04.3843627Z inflating: build/bin/IListRef_test 2024-06-26T05:02:04.3950437Z inflating: build/bin/List_test 2024-06-26T05:02:04.4003920Z inflating: build/bin/xla_tensor_test 2024-06-26T05:02:04.4072130Z inflating: build/bin/KernelFunction_test 2024-06-26T05:02:04.4194119Z inflating: build/bin/kernel_function_legacy_test 2024-06-26T05:02:04.4291147Z inflating: build/bin/kernel_function_test 2024-06-26T05:02:04.4418008Z inflating: build/bin/kernel_lambda_legacy_test 2024-06-26T05:02:04.4520412Z inflating: build/bin/kernel_lambda_test 2024-06-26T05:02:04.4582697Z inflating: build/bin/kernel_stackbased_test 2024-06-26T05:02:04.4678856Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-06-26T05:02:04.4731672Z inflating: build/bin/CppSignature_test 2024-06-26T05:02:04.4781972Z inflating: build/bin/op_allowlist_test 2024-06-26T05:02:04.5090480Z inflating: build/bin/op_registration_test 2024-06-26T05:02:04.5147268Z inflating: build/bin/backend_fallback_test 2024-06-26T05:02:04.5212823Z inflating: build/bin/inline_container_test 2024-06-26T05:02:04.5267799Z inflating: build/bin/test_edge_op_registration 2024-06-26T05:02:04.5271487Z inflating: build/bin/torch_shm_manager 2024-06-26T05:02:04.5284583Z inflating: build/bin/tutorial_tensorexpr 2024-06-26T05:02:04.6073895Z inflating: build/bin/test_tensorexpr 2024-06-26T05:02:04.6648387Z inflating: build/bin/test_jit 2024-06-26T05:02:04.6648877Z creating: .additional_ci_files/ 2024-06-26T05:02:04.6702235Z inflating: .additional_ci_files/test-times.json 2024-06-26T05:02:04.6918061Z inflating: .additional_ci_files/test-class-times.json 2024-06-26T05:02:04.6948108Z ##[group]Run rm artifacts.zip 2024-06-26T05:02:04.6976018Z rm artifacts.zip 2024-06-26T05:02:04.6984211Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:04.6984705Z env: 2024-06-26T05:02:04.6984957Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:04.6985296Z ##[endgroup] 2024-06-26T05:02:04.7461046Z ##[group]Run df -H 2024-06-26T05:02:04.7461345Z df -H 2024-06-26T05:02:04.7468911Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:04.7469406Z env: 2024-06-26T05:02:04.7469679Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:04.7470015Z ##[endgroup] 2024-06-26T05:02:04.7515007Z Filesystem Size Used Avail Use% Mounted on 2024-06-26T05:02:04.7515834Z devtmpfs 8.2G 0 8.2G 0% /dev 2024-06-26T05:02:04.7516478Z tmpfs 8.2G 2.0M 8.2G 1% /dev/shm 2024-06-26T05:02:04.7516969Z tmpfs 8.2G 467k 8.2G 1% /run 2024-06-26T05:02:04.7517416Z tmpfs 8.2G 0 8.2G 0% /sys/fs/cgroup 2024-06-26T05:02:04.7517880Z /dev/nvme0n1p1 162G 25G 138G 15% / 2024-06-26T05:02:04.7518329Z tmpfs 1.7G 0 1.7G 0% /run/user/0 2024-06-26T05:02:04.7564155Z Prepare all required actions 2024-06-26T05:02:04.7564590Z Getting action download info 2024-06-26T05:02:04.8732744Z ##[group]Run ./.github/actions/download-td-artifacts 2024-06-26T05:02:04.8733202Z with: 2024-06-26T05:02:04.8733442Z env: 2024-06-26T05:02:04.8733743Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:04.8734062Z ##[endgroup] 2024-06-26T05:02:04.8768774Z ##[group]Run seemethere/download-artifact-s3@v4 2024-06-26T05:02:04.8769222Z with: 2024-06-26T05:02:04.8769457Z name: td_results 2024-06-26T05:02:04.8769757Z s3-bucket: gha-artifacts 2024-06-26T05:02:04.8770100Z region: us-east-1 2024-06-26T05:02:04.8770359Z env: 2024-06-26T05:02:04.8770609Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:04.8770933Z ##[endgroup] 2024-06-26T05:02:05.3547005Z (node:28833) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-06-26T05:02:05.3547937Z 2024-06-26T05:02:05.3548276Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-06-26T05:02:05.3549136Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-06-26T05:02:05.3550187Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-06-26T05:02:05.4329746Z Found 1 objects with prefix pytorch/pytorch/9673645538/td_results/ 2024-06-26T05:02:05.4330811Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-06-26T05:02:05.4951357Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-06-26T05:02:05.4958231Z Artifact download has finished successfully 2024-06-26T05:02:05.5124873Z ##[group]Run mkdir -p .additional_ci_files 2024-06-26T05:02:05.5125846Z mkdir -p .additional_ci_files 2024-06-26T05:02:05.5126805Z mv td_results.json .additional_ci_files/td_results.json 2024-06-26T05:02:05.5137447Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:05.5138290Z env: 2024-06-26T05:02:05.5138789Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:05.5139380Z ##[endgroup] 2024-06-26T05:02:05.5289605Z ##[group]Run .github/scripts/parse_ref.py 2024-06-26T05:02:05.5290351Z .github/scripts/parse_ref.py 2024-06-26T05:02:05.5297858Z shell: /usr/bin/bash -e {0} 2024-06-26T05:02:05.5298194Z env: 2024-06-26T05:02:05.5298458Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:05.5298776Z ##[endgroup] 2024-06-26T05:02:05.5558822Z Prepare all required actions 2024-06-26T05:02:05.5601023Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-06-26T05:02:05.5601480Z with: 2024-06-26T05:02:05.5602212Z github-token: *** 2024-06-26T05:02:05.5602486Z env: 2024-06-26T05:02:05.5602744Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:05.5603072Z ##[endgroup] 2024-06-26T05:02:05.5621436Z ##[group]Run set -eux 2024-06-26T05:02:05.5621761Z set -eux 2024-06-26T05:02:05.5622351Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-06-26T05:02:05.5629935Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:05.5630429Z env: 2024-06-26T05:02:05.5630691Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:05.5631198Z GITHUB_TOKEN: *** 2024-06-26T05:02:05.5631491Z ##[endgroup] 2024-06-26T05:02:05.5654812Z + python3 .github/scripts/get_workflow_job_id.py 9673645538 i-045f62e1b5b74b837 2024-06-26T05:02:07.6032686Z setting job-id=26688305465 2024-06-26T05:02:07.6034060Z setting job-name=linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T05:02:07.6272119Z Prepare all required actions 2024-06-26T05:02:07.6272794Z Getting action download info 2024-06-26T05:02:07.7936237Z ##[group]Run ./.github/actions/filter-test-configs 2024-06-26T05:02:07.7936707Z with: 2024-06-26T05:02:07.7937166Z github-token: *** 2024-06-26T05:02:07.7940089Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]} 2024-06-26T05:02:07.7943341Z job-name: linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T05:02:07.7943955Z env: 2024-06-26T05:02:07.7944217Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:07.7944532Z ##[endgroup] 2024-06-26T05:02:07.7989078Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-06-26T05:02:07.7989630Z with: 2024-06-26T05:02:07.7989877Z shell: bash 2024-06-26T05:02:07.7990158Z timeout_minutes: 10 2024-06-26T05:02:07.7990451Z max_attempts: 5 2024-06-26T05:02:07.7990746Z retry_wait_seconds: 30 2024-06-26T05:02:07.7992052Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T05:02:07.7993276Z polling_interval_seconds: 1 2024-06-26T05:02:07.7993660Z warning_on_retry: true 2024-06-26T05:02:07.7993995Z continue_on_error: false 2024-06-26T05:02:07.7994313Z env: 2024-06-26T05:02:07.7994555Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:07.7995075Z GITHUB_TOKEN: *** 2024-06-26T05:02:07.7995368Z ##[endgroup] 2024-06-26T05:02:07.8537981Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-06-26T05:02:08.0759402Z Defaulting to user installation because normal site-packages is not writeable 2024-06-26T05:02:08.0929701Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.7/site-packages (2.27.1) 2024-06-26T05:02:08.1066184Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.7/site-packages (6.0.1) 2024-06-26T05:02:08.1074702Z Requirement already satisfied: idna<4,>=2.5; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (3.7) 2024-06-26T05:02:08.1087195Z Requirement already satisfied: charset-normalizer~=2.0.0; python_version >= "3" in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2.0.12) 2024-06-26T05:02:08.1106370Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (2024.6.2) 2024-06-26T05:02:08.1114308Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /home/ec2-user/.local/lib/python3.7/site-packages (from requests==2.27.1) (1.26.19) 2024-06-26T05:02:08.8540810Z Command completed after 1 attempt(s). 2024-06-26T05:02:08.8593133Z ##[group]Run set -x 2024-06-26T05:02:08.8593464Z set -x 2024-06-26T05:02:08.8593747Z  2024-06-26T05:02:08.8594295Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T05:02:08.8595082Z # in runner workspace 2024-06-26T05:02:08.8595608Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-06-26T05:02:08.8603424Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:08.8603911Z env: 2024-06-26T05:02:08.8604173Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:08.8604508Z ##[endgroup] 2024-06-26T05:02:08.8627126Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-06-26T05:02:08.8851006Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T05:02:08.8851545Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-06-26T05:02:08.8852004Z echo "Job name: ${JOB_NAME}" 2024-06-26T05:02:08.8852393Z  2024-06-26T05:02:08.8852922Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-06-26T05:02:08.8853616Z # in runner workspace 2024-06-26T05:02:08.8854195Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-06-26T05:02:08.8854832Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-06-26T05:02:08.8855278Z  --job-name "${JOB_NAME}" \ 2024-06-26T05:02:08.8858363Z  --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}" \ 2024-06-26T05:02:08.8861471Z  --selected-test-configs "" \ 2024-06-26T05:02:08.8861921Z  --pr-number "${PR_NUMBER}" \ 2024-06-26T05:02:08.8862319Z  --tag "${TAG}" \ 2024-06-26T05:02:08.8862702Z  --event-name "${EVENT_NAME}" \ 2024-06-26T05:02:08.8863138Z  --schedule "${SCHEDULE}" \ 2024-06-26T05:02:08.8863556Z  --branch "${HEAD_BRANCH}" 2024-06-26T05:02:08.8870979Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:08.8871478Z env: 2024-06-26T05:02:08.8871914Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:08.8872450Z GITHUB_TOKEN: *** 2024-06-26T05:02:08.8872987Z JOB_NAME: linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T05:02:08.8873600Z PR_NUMBER: 129470 2024-06-26T05:02:08.8873877Z TAG: 2024-06-26T05:02:08.8874193Z EVENT_NAME: pull_request 2024-06-26T05:02:08.8874527Z SCHEDULE: 2024-06-26T05:02:08.8874784Z HEAD_BRANCH: 2024-06-26T05:02:08.8875061Z ##[endgroup] 2024-06-26T05:02:08.8896937Z Workflow: pull 2024-06-26T05:02:08.8898187Z Job name: linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T05:02:09.1189178Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-06-26T05:02:09.6749621Z ##[group]Run echo "Filtered matrix:" 2024-06-26T05:02:09.6750065Z echo "Filtered matrix:" 2024-06-26T05:02:09.6753389Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 3, "runner": "linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "linux.2xlarge"}]}" 2024-06-26T05:02:09.6756528Z  2024-06-26T05:02:09.6756791Z echo 2024-06-26T05:02:09.6757143Z echo "Is the current job unstable? False" 2024-06-26T05:02:09.6757600Z  2024-06-26T05:02:09.6757856Z echo 2024-06-26T05:02:09.6758185Z echo "Is keep-going label set? False" 2024-06-26T05:02:09.6758617Z  2024-06-26T05:02:09.6758874Z echo 2024-06-26T05:02:09.6759261Z echo "Renabled issues? " 2024-06-26T05:02:09.6766727Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:09.6767221Z env: 2024-06-26T05:02:09.6767485Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:09.6767820Z ##[endgroup] 2024-06-26T05:02:09.6788512Z Filtered matrix: 2024-06-26T05:02:09.6792348Z {include: [{config: default, shard: 1, num_shards: 3, runner: linux.2xlarge}, {config: default, shard: 2, num_shards: 3, runner: linux.2xlarge}, {config: default, shard: 3, num_shards: 3, runner: linux.2xlarge}, {config: docs_test, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: jit_legacy, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: backwards_compat, shard: 1, num_shards: 1, runner: linux.2xlarge}, {config: distributed, shard: 1, num_shards: 2, runner: linux.2xlarge}, {config: distributed, shard: 2, num_shards: 2, runner: linux.2xlarge}]} 2024-06-26T05:02:09.6795093Z 2024-06-26T05:02:09.6795253Z Is the current job unstable? False 2024-06-26T05:02:09.6795526Z 2024-06-26T05:02:09.6795799Z Is keep-going label set? False 2024-06-26T05:02:09.6796062Z 2024-06-26T05:02:09.6796180Z Renabled issues? 2024-06-26T05:02:09.6849264Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T05:02:09.6850127Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-06-26T05:02:09.6857315Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T05:02:09.6857794Z env: 2024-06-26T05:02:09.6858062Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:09.6858396Z JOB_TIMEOUT: 240 2024-06-26T05:02:09.6858672Z ##[endgroup] 2024-06-26T05:02:09.6932276Z ##[group]Run set -x 2024-06-26T05:02:09.6932658Z set -x 2024-06-26T05:02:09.6932921Z  2024-06-26T05:02:09.6933253Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-06-26T05:02:09.6933797Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-06-26T05:02:09.6934344Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-06-26T05:02:09.6934847Z  TEST_COMMAND=.ci/onnx/test.sh 2024-06-26T05:02:09.6935258Z else 2024-06-26T05:02:09.6935582Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T05:02:09.6935994Z fi 2024-06-26T05:02:09.6936249Z  2024-06-26T05:02:09.6936691Z # detached container should get cleaned up by teardown_ec2_linux 2024-06-26T05:02:09.6937466Z # TODO: Stop building test binaries as part of the build phase 2024-06-26T05:02:09.6938148Z # Used for GPU_FLAG since that doesn't play nice 2024-06-26T05:02:09.6938729Z # shellcheck disable=SC2086,SC2090 2024-06-26T05:02:09.6939173Z container_name=$(docker run \ 2024-06-26T05:02:09.6939580Z  ${GPU_FLAG:-} \ 2024-06-26T05:02:09.6939942Z  -e BUILD_ENVIRONMENT \ 2024-06-26T05:02:09.6940320Z  -e PR_NUMBER \ 2024-06-26T05:02:09.6940674Z  -e GITHUB_ACTIONS \ 2024-06-26T05:02:09.6941065Z  -e GITHUB_REPOSITORY \ 2024-06-26T05:02:09.6941445Z  -e GITHUB_WORKFLOW \ 2024-06-26T05:02:09.6941815Z  -e GITHUB_JOB \ 2024-06-26T05:02:09.6942296Z  -e GITHUB_RUN_ID \ 2024-06-26T05:02:09.6942654Z  -e GITHUB_RUN_NUMBER \ 2024-06-26T05:02:09.6943050Z  -e GITHUB_RUN_ATTEMPT \ 2024-06-26T05:02:09.6943434Z  -e JOB_ID \ 2024-06-26T05:02:09.6943743Z  -e JOB_NAME \ 2024-06-26T05:02:09.6944074Z  -e BASE_SHA \ 2024-06-26T05:02:09.6944401Z  -e BRANCH \ 2024-06-26T05:02:09.6944703Z  -e SHA1 \ 2024-06-26T05:02:09.6945032Z  -e AWS_DEFAULT_REGION \ 2024-06-26T05:02:09.6945426Z  -e IN_WHEEL_TEST \ 2024-06-26T05:02:09.6945777Z  -e SHARD_NUMBER \ 2024-06-26T05:02:09.6946136Z  -e TEST_CONFIG \ 2024-06-26T05:02:09.6946494Z  -e NUM_TEST_SHARDS \ 2024-06-26T05:02:09.6946860Z  -e REENABLED_ISSUES \ 2024-06-26T05:02:09.6947262Z  -e CONTINUE_THROUGH_ERROR \ 2024-06-26T05:02:09.6947677Z  -e VERBOSE_TEST_LOGS \ 2024-06-26T05:02:09.6948070Z  -e NO_TEST_TIMEOUT \ 2024-06-26T05:02:09.6948421Z  -e NO_TD \ 2024-06-26T05:02:09.6948751Z  -e TD_DISTRIBUTED \ 2024-06-26T05:02:09.6949121Z  -e PR_LABELS \ 2024-06-26T05:02:09.6949499Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-06-26T05:02:09.6949947Z  -e SCCACHE_BUCKET \ 2024-06-26T05:02:09.6950335Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-06-26T05:02:09.6950722Z  -e XLA_CUDA \ 2024-06-26T05:02:09.6951112Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-06-26T05:02:09.6951613Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-06-26T05:02:09.6952303Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-06-26T05:02:09.6952816Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-06-26T05:02:09.6953281Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-06-26T05:02:09.6953678Z  -e DASHBOARD_TAG \ 2024-06-26T05:02:09.6954149Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-06-26T05:02:09.6954702Z  --security-opt seccomp=unconfined \ 2024-06-26T05:02:09.6955156Z  --cap-add=SYS_PTRACE \ 2024-06-26T05:02:09.6955533Z  --ipc=host \ 2024-06-26T05:02:09.6955878Z  --shm-size="${SHM_SIZE}" \ 2024-06-26T05:02:09.6956252Z  --tty \ 2024-06-26T05:02:09.6956547Z  --detach \ 2024-06-26T05:02:09.6956893Z  --name="${container_name}" \ 2024-06-26T05:02:09.6957288Z  --user jenkins \ 2024-06-26T05:02:09.6957903Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-06-26T05:02:09.6958466Z  -w /var/lib/jenkins/workspace \ 2024-06-26T05:02:09.6958881Z  "${DOCKER_IMAGE}" 2024-06-26T05:02:09.6959221Z ) 2024-06-26T05:02:09.6959615Z # Propagate download.pytorch.org IP to container 2024-06-26T05:02:09.6960563Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-06-26T05:02:09.6961551Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-06-26T05:02:09.6962502Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-06-26T05:02:09.6969993Z shell: /usr/bin/bash -e {0} 2024-06-26T05:02:09.6970320Z env: 2024-06-26T05:02:09.6970580Z GIT_DEFAULT_BRANCH: main 2024-06-26T05:02:09.6970983Z BUILD_ENVIRONMENT: linux-jammy-py3.8-gcc11 2024-06-26T05:02:09.6971411Z PR_NUMBER: 129470 2024-06-26T05:02:09.6971748Z GITHUB_REPOSITORY: pytorch/pytorch 2024-06-26T05:02:09.6972153Z GITHUB_WORKFLOW: pull 2024-06-26T05:02:09.6972461Z GITHUB_JOB: test 2024-06-26T05:02:09.6972758Z GITHUB_RUN_ID: 9673645538 2024-06-26T05:02:09.6973107Z GITHUB_RUN_NUMBER: 219936 2024-06-26T05:02:09.6973434Z GITHUB_RUN_ATTEMPT: 1 2024-06-26T05:02:09.6973747Z JOB_ID: 26688305465 2024-06-26T05:02:09.6974276Z JOB_NAME: linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T05:02:09.6974873Z BRANCH: pull/129470 2024-06-26T05:02:09.6975363Z SHA1: b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T05:02:09.6975876Z BASE_SHA: 4b9c9a9cc9c9283380a011310ba180c105c3dcb9 2024-06-26T05:02:09.6976326Z TEST_CONFIG: distributed 2024-06-26T05:02:09.6976661Z SHARD_NUMBER: 2 2024-06-26T05:02:09.6976952Z NUM_TEST_SHARDS: 2 2024-06-26T05:02:09.6977244Z REENABLED_ISSUES: 2024-06-26T05:02:09.6977567Z CONTINUE_THROUGH_ERROR: False 2024-06-26T05:02:09.6977941Z VERBOSE_TEST_LOGS: False 2024-06-26T05:02:09.6978273Z NO_TEST_TIMEOUT: False 2024-06-26T05:02:09.6978591Z NO_TD: False 2024-06-26T05:02:09.6978874Z TD_DISTRIBUTED: False 2024-06-26T05:02:09.6979265Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-06-26T05:02:09.6979753Z SCCACHE_S3_KEY_PREFIX: pull 2024-06-26T05:02:09.6980101Z SHM_SIZE: 1g 2024-06-26T05:02:09.6980985Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T05:02:09.6981943Z XLA_CUDA: 2024-06-26T05:02:09.6982423Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-06-26T05:02:09.6983043Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-06-26T05:02:09.6983456Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-06-26T05:02:09.6983851Z DASHBOARD_TAG: 2024-06-26T05:02:09.6984154Z HUGGING_FACE_HUB_TOKEN: 2024-06-26T05:02:09.6984468Z ##[endgroup] 2024-06-26T05:02:09.7005144Z + [[ distributed == \m\u\l\t\i\g\p\u ]] 2024-06-26T05:02:09.7006089Z + [[ linux-jammy-py3.8-gcc11 == *onnx* ]] 2024-06-26T05:02:09.7006530Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-06-26T05:02:09.7013043Z +++ nproc --ignore=2 2024-06-26T05:02:09.7036360Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=6 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_9673645538 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T05:02:17.1185160Z + container_name=40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T05:02:17.1187856Z + grep download.pytorch.org /etc/hosts 2024-06-26T05:02:17.1189609Z + docker exec -i 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df sudo bash -c '/bin/cat >> /etc/hosts' 2024-06-26T05:02:17.2182341Z + echo DOCKER_CONTAINER_ID=40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T05:02:17.2187240Z ++ echo dist/torch-2.5.0a0+gitb8c4c54-cp38-cp38-linux_x86_64.whl 2024-06-26T05:02:17.2189279Z + docker exec -t 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df sh -c 'pip install dist/torch-2.5.0a0+gitb8c4c54-cp38-cp38-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-06-26T05:02:17.7948533Z Processing ./dist/torch-2.5.0a0+gitb8c4c54-cp38-cp38-linux_x86_64.whl (from torch==2.5.0a0+gitb8c4c54) 2024-06-26T05:02:18.2384798Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.13.1) 2024-06-26T05:02:18.2392665Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (4.12.2) 2024-06-26T05:02:18.2396946Z Requirement already satisfied: sympy in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.12.1) 2024-06-26T05:02:18.2401605Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.8.8) 2024-06-26T05:02:18.2406018Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.1.4) 2024-06-26T05:02:18.2409689Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2024.2.0) 2024-06-26T05:02:18.2436752Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (3.3.0) 2024-06-26T05:02:18.2498361Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.21.2) 2024-06-26T05:02:18.2930492Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from jinja2->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (2.1.5) 2024-06-26T05:02:18.3098661Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from sympy->torch==2.5.0a0+gitb8c4c54->torch==2.5.0a0+gitb8c4c54) (1.3.0) 2024-06-26T05:02:19.5649333Z Installing collected packages: torch 2024-06-26T05:02:27.2077214Z Successfully installed torch-2.5.0a0+gitb8c4c54 2024-06-26T05:02:27.3071509Z ++ dirname .ci/pytorch/test.sh 2024-06-26T05:02:27.3090927Z + source .ci/pytorch/common.sh 2024-06-26T05:02:27.3096856Z +++ dirname .ci/pytorch/common.sh 2024-06-26T05:02:27.3102133Z ++ source .ci/pytorch/common_utils.sh 2024-06-26T05:02:27.3107959Z +++ declare -f -t trap_add 2024-06-26T05:02:27.3112883Z ++ set -ex 2024-06-26T05:02:27.3113557Z ++ [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-06-26T05:02:27.3114365Z ++ BUILD_TEST_LIBTORCH=0 2024-06-26T05:02:27.3115074Z + [[ linux-jammy-py3.8-gcc11 != *rocm* ]] 2024-06-26T05:02:27.3116565Z ++ stat -c %u /var/lib/jenkins/workspace 2024-06-26T05:02:27.3141147Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-06-26T05:02:27.3141845Z + trap_add cleanup_workspace EXIT 2024-06-26T05:02:27.3142242Z + trap_add_cmd=cleanup_workspace 2024-06-26T05:02:27.3142620Z + shift 2024-06-26T05:02:27.3143122Z + for trap_add_name in "$@" 2024-06-26T05:02:27.3147670Z +++ trap -p EXIT 2024-06-26T05:02:27.3150479Z ++ eval 'extract_trap_cmd ' 2024-06-26T05:02:27.3150897Z +++ extract_trap_cmd 2024-06-26T05:02:27.3151231Z +++ printf '%s\n' '' 2024-06-26T05:02:27.3151910Z ++ printf '%s\n' cleanup_workspace 2024-06-26T05:02:27.3152607Z + trap -- ' 2024-06-26T05:02:27.3152975Z cleanup_workspace' EXIT 2024-06-26T05:02:27.3153487Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-06-26T05:02:27.9549967Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-06-26T05:02:27.9752014Z + echo 'Environment variables:' 2024-06-26T05:02:27.9752775Z Environment variables: 2024-06-26T05:02:27.9753085Z + env 2024-06-26T05:02:27.9767019Z INSTALLED_DB=yes 2024-06-26T05:02:27.9767864Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T05:02:27.9768564Z CONTINUE_THROUGH_ERROR=False 2024-06-26T05:02:27.9769150Z BUILD_ENVIRONMENT=linux-jammy-py3.8-gcc11 2024-06-26T05:02:27.9769602Z HOSTNAME=40a66d840031 2024-06-26T05:02:27.9770535Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:27.9771487Z GITHUB_ACTION=__self 2024-06-26T05:02:27.9771812Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T05:02:27.9772258Z GITHUB_RUN_NUMBER=219936 2024-06-26T05:02:27.9772594Z TEST_CONFIG=distributed 2024-06-26T05:02:27.9773047Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T05:02:27.9773576Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T05:02:27.9774383Z GITHUB_TRIGGERING_ACTOR=leslie-fang-intel 2024-06-26T05:02:27.9774793Z GITHUB_REF_TYPE=branch 2024-06-26T05:02:27.9775125Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T05:02:27.9775538Z BASE_SHA=4b9c9a9cc9c9283380a011310ba180c105c3dcb9 2024-06-26T05:02:27.9775962Z XLA_CUDA= 2024-06-26T05:02:27.9776230Z HUGGING_FACE_HUB_TOKEN= 2024-06-26T05:02:27.9777949Z *** 2024-06-26T05:02:27.9778208Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T05:02:27.9778579Z GITHUB_ACTIONS=true 2024-06-26T05:02:27.9778926Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T05:02:27.9779419Z GITHUB_SHA=4b51b1a62a63a1add1b3a0f7882f5c7dc66b8f8d 2024-06-26T05:02:27.9780146Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/129470/merge 2024-06-26T05:02:27.9780789Z UCC_HOME=/usr 2024-06-26T05:02:27.9781058Z VERBOSE_TEST_LOGS=False 2024-06-26T05:02:27.9781398Z GITHUB_REF=refs/pull/129470/merge 2024-06-26T05:02:27.9781762Z SHARD_NUMBER=2 2024-06-26T05:02:27.9782043Z GITHUB_REF_PROTECTED=false 2024-06-26T05:02:27.9782388Z HOME=/var/lib/jenkins 2024-06-26T05:02:27.9782739Z GITHUB_API_URL=https://api.github.com 2024-06-26T05:02:27.9783157Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T05:02:27.9783537Z UCX_COMMIT= 2024-06-26T05:02:27.9783815Z SCCACHE_S3_KEY_PREFIX=pull 2024-06-26T05:02:27.9784136Z NUM_TEST_SHARDS=2 2024-06-26T05:02:27.9784417Z UCX_HOME=/usr 2024-06-26T05:02:27.9785306Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:27.9786431Z JOB_NAME=linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T05:02:27.9787573Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:27.9788745Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T05:02:27.9789411Z GITHUB_EVENT_NAME=pull_request 2024-06-26T05:02:27.9789769Z DASHBOARD_TAG= 2024-06-26T05:02:27.9790060Z GITHUB_RUN_ID=9673645538 2024-06-26T05:02:27.9790997Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:27.9792159Z GITHUB_ACTOR=leslie-fang-intel 2024-06-26T05:02:27.9792553Z PR_NUMBER=129470 2024-06-26T05:02:27.9792836Z DESIRED_CUDA= 2024-06-26T05:02:27.9793100Z GITHUB_RUN_ATTEMPT=1 2024-06-26T05:02:27.9793423Z ANACONDA_PYTHON_VERSION=3.8 2024-06-26T05:02:27.9794031Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T05:02:27.9794478Z TERM=xterm 2024-06-26T05:02:27.9794745Z INSTALLED_VISION=yes 2024-06-26T05:02:27.9795054Z BRANCH=pull/129470 2024-06-26T05:02:27.9795349Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T05:02:27.9795709Z CUDA_PATH=/usr/local/cuda 2024-06-26T05:02:27.9796474Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T05:02:27.9797238Z GITHUB_SERVER_URL=https://github.com 2024-06-26T05:02:27.9797623Z UCC_COMMIT= 2024-06-26T05:02:27.9797896Z REENABLED_ISSUES= 2024-06-26T05:02:27.9798160Z DOCS=yes 2024-06-26T05:02:27.9798417Z INSTALLED_ANDROID= 2024-06-26T05:02:27.9798698Z SHLVL=1 2024-06-26T05:02:27.9798925Z MAX_JOBS=6 2024-06-26T05:02:27.9799191Z GITHUB_ACTOR_ID=53841472 2024-06-26T05:02:27.9799645Z GITHUB_WORKFLOW_SHA=4b51b1a62a63a1add1b3a0f7882f5c7dc66b8f8d 2024-06-26T05:02:27.9800150Z GITHUB_REF_NAME=129470/merge 2024-06-26T05:02:27.9800752Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T05:02:27.9801335Z GITHUB_JOB=test 2024-06-26T05:02:27.9801607Z NO_TEST_TIMEOUT=False 2024-06-26T05:02:27.9801917Z TD_DISTRIBUTED=False 2024-06-26T05:02:27.9802247Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T05:02:27.9802618Z GITHUB_RETENTION_DAYS=90 2024-06-26T05:02:27.9802952Z OPENSSL_DIR=/opt/openssl 2024-06-26T05:02:27.9803288Z GITHUB_ACTION_REPOSITORY= 2024-06-26T05:02:27.9804348Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T05:02:27.9805774Z GITHUB_BASE_REF=gh/leslie-fang-intel/126/base 2024-06-26T05:02:27.9806210Z INSTALLED_ACL= 2024-06-26T05:02:27.9806468Z CI=true 2024-06-26T05:02:27.9806745Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T05:02:27.9807111Z JOB_ID=26688305465 2024-06-26T05:02:27.9807393Z INSTALLED_PROTOBUF=yes 2024-06-26T05:02:27.9807812Z GITHUB_HEAD_REF=gh/leslie-fang-intel/126/head 2024-06-26T05:02:27.9808243Z GITHUB_ACTION_REF= 2024-06-26T05:02:27.9808654Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T05:02:27.9809115Z GITHUB_WORKFLOW=pull 2024-06-26T05:02:27.9809446Z DEBIAN_FRONTEND=noninteractive 2024-06-26T05:02:27.9810367Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:27.9811215Z NO_TD=False 2024-06-26T05:02:27.9811498Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T05:02:27.9811835Z _=/usr/bin/env 2024-06-26T05:02:27.9812299Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-06-26T05:02:27.9951402Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch 2024-06-26T05:02:27.9952749Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/bin 2024-06-26T05:02:27.9953639Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib 2024-06-26T05:02:27.9954900Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/test 2024-06-26T05:02:27.9955940Z + BUILD_DIR=build 2024-06-26T05:02:27.9956251Z + BUILD_RENAMED_DIR=build_renamed 2024-06-26T05:02:27.9956972Z + BUILD_BIN_DIR=build/bin 2024-06-26T05:02:27.9957311Z + SHARD_NUMBER=2 2024-06-26T05:02:27.9957600Z + NUM_TEST_SHARDS=2 2024-06-26T05:02:27.9957903Z + export VALGRIND=ON 2024-06-26T05:02:27.9958213Z + VALGRIND=ON 2024-06-26T05:02:27.9958582Z + [[ linux-jammy-py3.8-gcc11 == *clang9* ]] 2024-06-26T05:02:27.9958999Z + [[ 0 == \1 ]] 2024-06-26T05:02:27.9959267Z + [[ False == \1 ]] 2024-06-26T05:02:27.9959650Z + [[ linux-jammy-py3.8-gcc11 != *bazel* ]] 2024-06-26T05:02:27.9960103Z ++ realpath build/custom_test_artifacts 2024-06-26T05:02:27.9974642Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-06-26T05:02:27.9975554Z + [[ -n '' ]] 2024-06-26T05:02:27.9975888Z + echo 'Environment variables' 2024-06-26T05:02:27.9976264Z Environment variables 2024-06-26T05:02:27.9976549Z + env 2024-06-26T05:02:27.9981891Z INSTALLED_DB=yes 2024-06-26T05:02:27.9983158Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T05:02:27.9984125Z CONTINUE_THROUGH_ERROR=False 2024-06-26T05:02:27.9984956Z BUILD_ENVIRONMENT=linux-jammy-py3.8-gcc11 2024-06-26T05:02:27.9985747Z HOSTNAME=40a66d840031 2024-06-26T05:02:27.9987278Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:27.9988127Z GITHUB_ACTION=__self 2024-06-26T05:02:27.9988475Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-06-26T05:02:27.9988861Z GITHUB_RUN_NUMBER=219936 2024-06-26T05:02:27.9989191Z TEST_CONFIG=distributed 2024-06-26T05:02:27.9989535Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-06-26T05:02:27.9989985Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-06-26T05:02:27.9990487Z GITHUB_TRIGGERING_ACTOR=leslie-fang-intel 2024-06-26T05:02:27.9990907Z GITHUB_REF_TYPE=branch 2024-06-26T05:02:27.9991218Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-06-26T05:02:27.9991859Z BASE_SHA=4b9c9a9cc9c9283380a011310ba180c105c3dcb9 2024-06-26T05:02:27.9992449Z XLA_CUDA= 2024-06-26T05:02:27.9992711Z HUGGING_FACE_HUB_TOKEN= 2024-06-26T05:02:27.9993134Z *** 2024-06-26T05:02:27.9993396Z GITHUB_REPOSITORY_ID=65600975 2024-06-26T05:02:27.9993752Z GITHUB_ACTIONS=true 2024-06-26T05:02:27.9994092Z SHA1=b8c4c54d347aa776934c60784e35936878ef18dc 2024-06-26T05:02:27.9994612Z GITHUB_SHA=4b51b1a62a63a1add1b3a0f7882f5c7dc66b8f8d 2024-06-26T05:02:27.9995953Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/129470/merge 2024-06-26T05:02:27.9997244Z UCC_HOME=/usr 2024-06-26T05:02:27.9997857Z VERBOSE_TEST_LOGS=False 2024-06-26T05:02:27.9998203Z GITHUB_REF=refs/pull/129470/merge 2024-06-26T05:02:27.9998570Z SHARD_NUMBER=2 2024-06-26T05:02:27.9998850Z GITHUB_REF_PROTECTED=false 2024-06-26T05:02:27.9999185Z HOME=/var/lib/jenkins 2024-06-26T05:02:27.9999537Z GITHUB_API_URL=https://api.github.com 2024-06-26T05:02:28.0000186Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-06-26T05:02:28.0000576Z UCX_COMMIT= 2024-06-26T05:02:28.0000926Z SCCACHE_S3_KEY_PREFIX=pull 2024-06-26T05:02:28.0001329Z NUM_TEST_SHARDS=2 2024-06-26T05:02:28.0001609Z UCX_HOME=/usr 2024-06-26T05:02:28.0002663Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:28.0003958Z JOB_NAME=linux-jammy-py3.8-gcc11 / test (distributed, 2, 2, linux.2xlarge) 2024-06-26T05:02:28.0005207Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:28.0006386Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-06-26T05:02:28.0007234Z GITHUB_EVENT_NAME=pull_request 2024-06-26T05:02:28.0007579Z DASHBOARD_TAG= 2024-06-26T05:02:28.0007862Z GITHUB_RUN_ID=9673645538 2024-06-26T05:02:28.0008816Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:28.0009756Z GITHUB_ACTOR=leslie-fang-intel 2024-06-26T05:02:28.0010174Z PR_NUMBER=129470 2024-06-26T05:02:28.0010646Z DESIRED_CUDA= 2024-06-26T05:02:28.0010917Z GITHUB_RUN_ATTEMPT=1 2024-06-26T05:02:28.0011214Z VALGRIND=ON 2024-06-26T05:02:28.0014587Z ANACONDA_PYTHON_VERSION=3.8 2024-06-26T05:02:28.0015454Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-06-26T05:02:28.0016190Z TERM=xterm 2024-06-26T05:02:28.0016460Z INSTALLED_VISION=yes 2024-06-26T05:02:28.0016770Z BRANCH=pull/129470 2024-06-26T05:02:28.0017068Z OPENSSL_ROOT_DIR=/opt/openssl 2024-06-26T05:02:28.0017428Z CUDA_PATH=/usr/local/cuda 2024-06-26T05:02:28.0018550Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-06-26T05:02:28.0019887Z GITHUB_SERVER_URL=https://github.com 2024-06-26T05:02:28.0020567Z UCC_COMMIT= 2024-06-26T05:02:28.0020915Z REENABLED_ISSUES= 2024-06-26T05:02:28.0021326Z DOCS=yes 2024-06-26T05:02:28.0021827Z INSTALLED_ANDROID= 2024-06-26T05:02:28.0022334Z SHLVL=1 2024-06-26T05:02:28.0022781Z MAX_JOBS=6 2024-06-26T05:02:28.0023271Z GITHUB_ACTOR_ID=53841472 2024-06-26T05:02:28.0023731Z GITHUB_WORKFLOW_SHA=4b51b1a62a63a1add1b3a0f7882f5c7dc66b8f8d 2024-06-26T05:02:28.0024237Z GITHUB_REF_NAME=129470/merge 2024-06-26T05:02:28.0024865Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-06-26T05:02:28.0025446Z GITHUB_JOB=test 2024-06-26T05:02:28.0025724Z NO_TEST_TIMEOUT=False 2024-06-26T05:02:28.0026039Z TD_DISTRIBUTED=False 2024-06-26T05:02:28.0026375Z GITHUB_REPOSITORY=pytorch/pytorch 2024-06-26T05:02:28.0026744Z GITHUB_RETENTION_DAYS=90 2024-06-26T05:02:28.0027092Z OPENSSL_DIR=/opt/openssl 2024-06-26T05:02:28.0027425Z GITHUB_ACTION_REPOSITORY= 2024-06-26T05:02:28.0028504Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T05:02:28.0029991Z GITHUB_BASE_REF=gh/leslie-fang-intel/126/base 2024-06-26T05:02:28.0030598Z INSTALLED_ACL= 2024-06-26T05:02:28.0031053Z CI=true 2024-06-26T05:02:28.0031568Z GITHUB_REPOSITORY_OWNER=pytorch 2024-06-26T05:02:28.0032349Z JOB_ID=26688305465 2024-06-26T05:02:28.0032914Z INSTALLED_PROTOBUF=yes 2024-06-26T05:02:28.0033712Z GITHUB_HEAD_REF=gh/leslie-fang-intel/126/head 2024-06-26T05:02:28.0034147Z GITHUB_ACTION_REF= 2024-06-26T05:02:28.0072375Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-06-26T05:02:28.0072875Z GITHUB_WORKFLOW=pull 2024-06-26T05:02:28.0073207Z DEBIAN_FRONTEND=noninteractive 2024-06-26T05:02:28.0074145Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_fe6d1eae-7386-4141-b10e-b7e7bb8aa994 2024-06-26T05:02:28.0075213Z NO_TD=False 2024-06-26T05:02:28.0075497Z SKIP_SCCACHE_INITIALIZATION=1 2024-06-26T05:02:28.0075851Z _=/usr/bin/env 2024-06-26T05:02:28.0076159Z + echo 'Testing pytorch' 2024-06-26T05:02:28.0076490Z Testing pytorch 2024-06-26T05:02:28.0076778Z + export LANG=C.UTF-8 2024-06-26T05:02:28.0077091Z + LANG=C.UTF-8 2024-06-26T05:02:28.0077391Z + PR_NUMBER=129470 2024-06-26T05:02:28.0077722Z + [[ distributed == \d\e\f\a\u\l\t ]] 2024-06-26T05:02:28.0078164Z + [[ distributed == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-06-26T05:02:28.0078671Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-06-26T05:02:28.0079099Z + [[ distributed == \s\l\o\w ]] 2024-06-26T05:02:28.0079575Z + [[ linux-jammy-py3.8-gcc11 == *slow-gradcheck* ]] 2024-06-26T05:02:28.0080115Z + [[ linux-jammy-py3.8-gcc11 == *cuda* ]] 2024-06-26T05:02:28.0080601Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-06-26T05:02:28.0081071Z + [[ linux-jammy-py3.8-gcc11 == *xpu* ]] 2024-06-26T05:02:28.0081507Z + [[ distributed == *crossref* ]] 2024-06-26T05:02:28.0081953Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-06-26T05:02:28.0082426Z + [[ linux-jammy-py3.8-gcc11 == *xpu* ]] 2024-06-26T05:02:28.0082926Z + [[ linux-jammy-py3.8-gcc11 != *-bazel-* ]] 2024-06-26T05:02:28.0083412Z + pip_install --user ninja==1.10.2 2024-06-26T05:02:28.0083926Z + pip install --progress-bar off --user ninja==1.10.2 2024-06-26T05:02:28.4257173Z Collecting ninja==1.10.2 2024-06-26T05:02:28.4449007Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-06-26T05:02:28.4613958Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-06-26T05:02:29.6313895Z Installing collected packages: ninja 2024-06-26T05:02:29.6401785Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-06-26T05:02:29.6403118Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-06-26T05:02:29.6449150Z Successfully installed ninja-1.10.2 2024-06-26T05:02:29.7495779Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T05:02:29.7498322Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T05:02:29.7499769Z + [[ linux-jammy-py3.8-gcc11 == *aarch64* ]] 2024-06-26T05:02:29.7500222Z + install_tlparse 2024-06-26T05:02:29.7500586Z + pip_install --user tlparse==0.3.7 2024-06-26T05:02:29.7501127Z + pip install --progress-bar off --user tlparse==0.3.7 2024-06-26T05:02:30.1625042Z Collecting tlparse==0.3.7 2024-06-26T05:02:30.1819462Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (346 bytes) 2024-06-26T05:02:30.1932602Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-06-26T05:02:31.3961478Z Installing collected packages: tlparse 2024-06-26T05:02:31.4367169Z Successfully installed tlparse-0.3.7 2024-06-26T05:02:31.5456261Z ++ python -m site --user-base 2024-06-26T05:02:31.5676538Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-06-26T05:02:31.5679403Z + [[ linux-jammy-py3.8-gcc11 == *asan* ]] 2024-06-26T05:02:31.5680204Z + [[ linux-jammy-py3.8-gcc11 == *-debug* ]] 2024-06-26T05:02:31.5681089Z + [[ linux-jammy-py3.8-gcc11 != *-bazel-* ]] 2024-06-26T05:02:31.5681929Z + echo 'We are not in debug mode: linux-jammy-py3.8-gcc11. Expect the assertion to pass' 2024-06-26T05:02:31.5682907Z We are not in debug mode: linux-jammy-py3.8-gcc11. Expect the assertion to pass 2024-06-26T05:02:31.5683826Z + cd test 2024-06-26T05:02:31.5684353Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-06-26T05:02:33.0224048Z + [[ distributed == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-06-26T05:02:33.0224670Z + [[ distributed == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-06-26T05:02:33.0225337Z + [[ linux-jammy-py3.8-gcc11 != *-bazel-* ]] 2024-06-26T05:02:33.0225797Z + pushd test 2024-06-26T05:02:33.0226202Z ~/workspace/test ~/workspace 2024-06-26T05:02:33.0227464Z ++ python -c 'import torch; print(torch.version.cuda)' 2024-06-26T05:02:34.4283462Z + CUDA_VERSION=None 2024-06-26T05:02:34.4284084Z + '[' None == 12.4 ']' 2024-06-26T05:02:34.4284410Z + ISCUDA124= 2024-06-26T05:02:34.4284677Z + popd 2024-06-26T05:02:34.4284928Z ~/workspace 2024-06-26T05:02:34.4286838Z + DYNAMO_BENCHMARK_FLAGS=() 2024-06-26T05:02:34.4287934Z + [[ distributed == *dynamo_eager* ]] 2024-06-26T05:02:34.4288794Z + [[ distributed == *aot_eager* ]] 2024-06-26T05:02:34.4289555Z + [[ distributed == *aot_inductor* ]] 2024-06-26T05:02:34.4290330Z + [[ distributed == *inductor* ]] 2024-06-26T05:02:34.4291046Z + [[ distributed == *dynamic* ]] 2024-06-26T05:02:34.4291799Z + [[ distributed == *cpu_inductor* ]] 2024-06-26T05:02:34.4292726Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-06-26T05:02:34.4309623Z + [[ linux-jammy-py3.8-gcc11 == *libtorch* ]] 2024-06-26T05:02:34.4310622Z + [[ linux-jammy-py3.8-gcc11 == *-bazel-* ]] 2024-06-26T05:02:34.4312177Z + cd test 2024-06-26T05:02:34.4313627Z + python -c 'import torch; print(torch.__config__.show())' 2024-06-26T05:02:35.6062391Z PyTorch built with: 2024-06-26T05:02:35.6063146Z - GCC 11.4 2024-06-26T05:02:35.6063482Z - C++ Version: 201703 2024-06-26T05:02:35.6064367Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T05:02:35.6065466Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T05:02:35.6066127Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T05:02:35.6066658Z - LAPACK is enabled (usually provided by MKL) 2024-06-26T05:02:35.6067135Z - NNPACK is enabled 2024-06-26T05:02:35.6067493Z - CPU capability usage: AVX512 2024-06-26T05:02:35.6076031Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-06-26T05:02:35.6083303Z 2024-06-26T05:02:35.8491377Z + cd test 2024-06-26T05:02:35.8492139Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-06-26T05:02:37.0864029Z ATen/Parallel: 2024-06-26T05:02:37.0864613Z at::get_num_threads() : 4 2024-06-26T05:02:37.0865350Z at::get_num_interop_threads() : 4 2024-06-26T05:02:37.0865801Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-06-26T05:02:37.0866178Z omp_get_max_threads() : 4 2024-06-26T05:02:37.0867158Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-06-26T05:02:37.0868327Z mkl_get_max_threads() : 4 2024-06-26T05:02:37.0868935Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-06-26T05:02:37.0869564Z std::thread::hardware_concurrency() : 8 2024-06-26T05:02:37.0869981Z Environment variables: 2024-06-26T05:02:37.0870301Z OMP_NUM_THREADS : [not set] 2024-06-26T05:02:37.0870661Z MKL_NUM_THREADS : [not set] 2024-06-26T05:02:37.0871025Z ATen parallel backend: OpenMP 2024-06-26T05:02:37.0871281Z 2024-06-26T05:02:37.3377004Z + [[ linux-jammy-py3.8-gcc11 == *aarch64* ]] 2024-06-26T05:02:37.3377861Z + [[ distributed == *backward* ]] 2024-06-26T05:02:37.3378447Z + [[ distributed == *xla* ]] 2024-06-26T05:02:37.3379045Z + [[ distributed == *executorch* ]] 2024-06-26T05:02:37.3379739Z + [[ distributed == \j\i\t\_\l\e\g\a\c\y ]] 2024-06-26T05:02:37.3380748Z + [[ linux-jammy-py3.8-gcc11 == *libtorch* ]] 2024-06-26T05:02:37.3381511Z + [[ distributed == distributed ]] 2024-06-26T05:02:37.3382233Z + test_distributed 2024-06-26T05:02:37.3382938Z + echo 'Testing distributed python tests' 2024-06-26T05:02:37.3383751Z Testing distributed python tests 2024-06-26T05:02:37.3384827Z + python test/run_test.py --distributed-tests --shard 2 2 --verbose 2024-06-26T05:02:37.4408928Z test/run_test.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-06-26T05:02:37.4410837Z import pkg_resources 2024-06-26T05:02:41.0072910Z Downloading https://ossci-metrics.s3.amazonaws.com/slow-tests.json to /var/lib/jenkins/workspace/test/.pytorch-slow-tests.json 2024-06-26T05:02:41.0616550Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-06-26T05:02:41.1121556Z Ignoring disabled issues: [''] 2024-06-26T05:02:41.1224395Z Found test times from artifacts 2024-06-26T05:02:41.1617767Z Found test times from artifacts 2024-06-26T05:02:41.1634463Z Running all tests 2024-06-26T05:02:41.1762898Z Running parallel tests on 3 processes 2024-06-26T05:02:41.1768291Z Name: tests to run (est. time: 54.53min) 2024-06-26T05:02:41.1769080Z Serial tests (91): 2024-06-26T05:02:41.1769774Z distributed/pipelining/test_transformer 1/1 2024-06-26T05:02:41.1770790Z distributed/_tensor/debug/test_op_coverage 1/1 2024-06-26T05:02:41.1771696Z distributed/_tools/test_mod_tracker 1/1 2024-06-26T05:02:41.1772553Z distributed/_tensor/test_api 1/1 2024-06-26T05:02:41.1773669Z distributed/_tensor/test_attention 1/1 2024-06-26T05:02:41.1774331Z distributed/_composable/test_contract 1/1 2024-06-26T05:02:41.1775059Z distributed/_tensor/test_dtensor 1/1 2024-06-26T05:02:41.1775861Z distributed/_spmd/test_data_parallel 1/1 2024-06-26T05:02:41.1776734Z distributed/checkpoint/test_dedup_tensors 1/1 2024-06-26T05:02:41.1777412Z distributed/_tools/test_mem_tracker 1/1 2024-06-26T05:02:41.1777894Z distributed/checkpoint/e2e/test_fsdp_ep 1/1 2024-06-26T05:02:41.1778449Z distributed/_composable/fsdp/test_fully_shard_state 1/1 2024-06-26T05:02:41.1778989Z distributed/_tensor/test_tensor_ops 1/1 2024-06-26T05:02:41.1779485Z distributed/pipelining/test_composability 1/1 2024-06-26T05:02:41.1780008Z distributed/_tools/test_fsdp2_mem_tracker 1/1 2024-06-26T05:02:41.1780536Z distributed/tensor/parallel/test_tp_random_state 1/1 2024-06-26T05:02:41.1781082Z distributed/_tensor/test_experimental_ops 1/1 2024-06-26T05:02:41.1781578Z distributed/_tensor/test_math_ops 1/1 2024-06-26T05:02:41.1782093Z distributed/_composable/fsdp/test_fully_shard_overlap 1/1 2024-06-26T05:02:41.1782656Z distributed/_tensor/test_redistribute 1/1 2024-06-26T05:02:41.1783189Z distributed/tensor/parallel/test_ddp_2d_parallel 1/1 2024-06-26T05:02:41.1783715Z distributed/test_compute_comm_reordering 1/1 2024-06-26T05:02:41.1784286Z distributed/_composable/fsdp/test_fully_shard_autograd 1/1 2024-06-26T05:02:41.1784863Z distributed/_tensor/test_xla_integration 1/1 2024-06-26T05:02:41.1785561Z distributed/_composable/fsdp/test_fully_shard_init 1/1 2024-06-26T05:02:41.1786119Z distributed/_composable/test_checkpoint 1/1 2024-06-26T05:02:41.1786681Z distributed/_composable/fsdp/test_fully_shard_memory 1/1 2024-06-26T05:02:41.1787214Z distributed/_tensor/test_matrix_ops 1/1 2024-06-26T05:02:41.1787706Z distributed/tensor/parallel/test_tp_style 1/1 2024-06-26T05:02:41.1788252Z distributed/checkpoint/test_dtensor_resharding 1/1 2024-06-26T05:02:41.1788788Z distributed/optim/test_named_optimizer 1/1 2024-06-26T05:02:41.1789284Z distributed/_tensor/test_pointwise_ops 1/1 2024-06-26T05:02:41.1789809Z distributed/tensor/parallel/test_tp_examples 1/1 2024-06-26T05:02:41.1790314Z distributed/checkpoint/test_planner 1/1 2024-06-26T05:02:41.1790778Z distributed/fsdp/test_shard_utils 1/1 2024-06-26T05:02:41.1791263Z distributed/_tensor/debug/test_comm_mode 1/1 2024-06-26T05:02:41.1792018Z distributed/pipelining/test_stage 1/1 2024-06-26T05:02:41.1792475Z distributed/checkpoint/test_fsspec 1/1 2024-06-26T05:02:41.1792978Z distributed/checkpoint/e2e/test_fine_tuning 1/1 2024-06-26T05:02:41.1793534Z distributed/checkpoint/test_dtensor_checkpoint 1/1 2024-06-26T05:02:41.1794070Z distributed/checkpoint/e2e/test_pipeline 1/1 2024-06-26T05:02:41.1794551Z distributed/test_functional_api 1/1 2024-06-26T05:02:41.1794999Z distributed/test_collective_utils 1/1 2024-06-26T05:02:41.1795564Z distributed/_composable/fully_shard/test_fully_shard_compile 1/1 2024-06-26T05:02:41.1796206Z distributed/checkpoint/test_fsdp_model_state 1/1 2024-06-26T05:02:41.1796821Z distributed/tensor/parallel/test_parallelize_api 1/1 2024-06-26T05:02:41.1797771Z distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 2024-06-26T05:02:41.1798362Z distributed/test_distributed_spawn 1/3 2024-06-26T05:02:41.1798830Z distributed/test_distributed_spawn 3/3 2024-06-26T05:02:41.1799266Z distributed/test_c10d_logger 1/1 2024-06-26T05:02:41.1799733Z distributed/checkpoint/test_checkpoint 1/1 2024-06-26T05:02:41.1800296Z distributed/checkpoint/test_file_system_checkpoint 1/1 2024-06-26T05:02:41.1800893Z distributed/optim/test_apply_optimizer_in_backward 1/1 2024-06-26T05:02:41.1801525Z distributed/algorithms/ddp_comm_hooks/test_ddp_hooks 1/1 2024-06-26T05:02:41.1802154Z distributed/test_control_collectives 1/1 2024-06-26T05:02:41.1802915Z distributed/algorithms/quantization/test_quantization 1/1 2024-06-26T05:02:41.1803462Z distributed/test_c10d_pypg 1/1 2024-06-26T05:02:41.1803885Z distributed/fsdp/test_fsdp_grad_acc 1/1 2024-06-26T05:02:41.1804372Z distributed/fsdp/test_fsdp_clip_grad_norm 1/1 2024-06-26T05:02:41.1804863Z distributed/fsdp/test_fsdp_exec_order 1/1 2024-06-26T05:02:41.1805439Z distributed/test_multi_threaded_pg 1/1 2024-06-26T05:02:41.1805897Z distributed/fsdp/test_fsdp_core 1/1 2024-06-26T05:02:41.1806320Z distributed/test_data_parallel 1/1 2024-06-26T05:02:41.1806822Z distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 2024-06-26T05:02:41.1807418Z distributed/_shard/sharding_plan/test_sharding_plan 1/1 2024-06-26T05:02:41.1807933Z distributed/fsdp/test_fsdp_misc 1/1 2024-06-26T05:02:41.1808403Z distributed/fsdp/test_fsdp_hybrid_shard 1/1 2024-06-26T05:02:41.1808863Z distributed/fsdp/test_utils 1/1 2024-06-26T05:02:41.1809289Z distributed/rpc/test_tensorpipe_agent 1/3 2024-06-26T05:02:41.1809786Z distributed/rpc/test_tensorpipe_agent 3/3 2024-06-26T05:02:41.1810306Z distributed/_shard/sharded_tensor/ops/test_init 1/1 2024-06-26T05:02:41.1810840Z distributed/fsdp/test_fsdp_mixed_precision 1/1 2024-06-26T05:02:41.1811373Z distributed/fsdp/test_fsdp_use_orig_params 1/1 2024-06-26T05:02:41.1811862Z distributed/test_c10d_spawn_gloo 1/1 2024-06-26T05:02:41.1812377Z distributed/_shard/sharded_tensor/test_sharded_tensor 1/1 2024-06-26T05:02:41.1812912Z distributed/test_c10d_spawn_ucc 1/1 2024-06-26T05:02:41.1813333Z distributed/test_c10d_common 1/1 2024-06-26T05:02:41.1813847Z distributed/test_c10d_spawn_nccl 1/1 2024-06-26T05:02:41.1814276Z distributed/test_store 1/1 2024-06-26T05:02:41.1814654Z distributed/test_launcher 1/1 2024-06-26T05:02:41.1815038Z distributed/test_c10d_nccl 1/1 2024-06-26T05:02:41.1815459Z distributed/elastic/events/lib_test 1/1 2024-06-26T05:02:41.1815941Z distributed/elastic/metrics/api_test 1/1 2024-06-26T05:02:41.1816455Z distributed/elastic/multiprocessing/api_test 1/1 2024-06-26T05:02:41.1816968Z distributed/elastic/timer/api_test 1/1 2024-06-26T05:02:41.1817486Z distributed/elastic/timer/local_timer_example 1/1 2024-06-26T05:02:41.1818020Z distributed/elastic/timer/local_timer_test 1/1 2024-06-26T05:02:41.1818540Z distributed/elastic/utils/distributed_test 1/1 2024-06-26T05:02:41.1819059Z distributed/elastic/utils/logging_test 1/1 2024-06-26T05:02:41.1819533Z distributed/elastic/utils/util_test 1/1 2024-06-26T05:02:41.1819961Z distributed/test_cuda_p2p 1/1 2024-06-26T05:02:41.1820342Z Parallel tests (0): 2024-06-26T05:02:41.1820677Z Name: excluded (est. time: 0.0min) 2024-06-26T05:02:41.1821053Z Serial tests (0): 2024-06-26T05:02:41.1821353Z Parallel tests (0): 2024-06-26T05:02:41.1822026Z Starting test batch 'tests to run' 0.0 seconds after initiating testing 2024-06-26T05:02:41.1955817Z Running distributed/pipelining/test_transformer 1/1 ... [2024-06-26 05:02:41.195001] 2024-06-26T05:02:41.1962547Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/pipelining/test_transformer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:02:41.195732] 2024-06-26T05:02:45.4230644Z 2024-06-26T05:02:45.4232594Z distributed/pipelining/test_transformer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_transformer_1.1_2a729b098b96d9b7_.log 2024-06-26T05:02:45.4234516Z Running 1 items in this shard: test/distributed/pipelining/test_transformer.py::TransformerTests::test_ir 2024-06-26T05:02:45.4235202Z 2024-06-26T05:02:45.4239997Z Running distributed/_tensor/debug/test_op_coverage 1/1 ... [2024-06-26 05:02:45.423789] 2024-06-26T05:02:45.4244923Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/debug/test_op_coverage.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:02:45.424171] 2024-06-26T05:02:48.5479839Z 2024-06-26T05:02:48.5481672Z distributed/_tensor/debug/test_op_coverage 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_op_coverage_1.1_0867a780c1352b40_.log 2024-06-26T05:02:48.5483518Z Running 1 items in this shard: test/distributed/_tensor/debug/test_op_coverage.py::TestOpCoverage::test_trace_with_inductor_decomp 2024-06-26T05:02:48.5484342Z 2024-06-26T05:02:48.5486561Z Running distributed/_tools/test_mod_tracker 1/1 ... [2024-06-26 05:02:48.548414] 2024-06-26T05:02:48.5491880Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tools/test_mod_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:02:48.548855] 2024-06-26T05:02:51.4725951Z 2024-06-26T05:02:51.4727923Z distributed/_tools/test_mod_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mod_tracker_1.1_4218d5b8d21f83aa_.log 2024-06-26T05:02:51.4730405Z Running 3 items in this shard: test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_bw_detection, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_module_hierarchy, test/distributed/_tools/test_mod_tracker.py::TestModTracker::test_user_hooks 2024-06-26T05:02:51.4732294Z 2024-06-26T05:02:51.4733408Z Running distributed/_tensor/test_api 1/1 ... [2024-06-26 05:02:51.473060] 2024-06-26T05:02:51.4754739Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:02:51.475083] 2024-06-26T05:03:17.0653165Z 2024-06-26T05:03:17.0655186Z distributed/_tensor/test_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_api_1.1_dc62ce3daf826d03_.log 2024-06-26T05:03:17.0660024Z Running 8 items in this shard: test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_casting, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn_warning, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_meta, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_errors, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_uneven_sharding 2024-06-26T05:03:17.0664688Z 2024-06-26T05:03:17.0665117Z Running distributed/_tensor/test_attention 1/1 ... [2024-06-26 05:03:17.066180] 2024-06-26T05:03:17.0670999Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_attention.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:03:17.066749] 2024-06-26T05:03:22.9463027Z 2024-06-26T05:03:22.9464947Z distributed/_tensor/test_attention 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_attention_1.1_fc0ad535c541ceef_.log 2024-06-26T05:03:22.9470919Z Running 8 items in this shard: test/distributed/_tensor/test_attention.py::RingAttentionTest::test_is_causal_behavior, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_compile_attention_fn0, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_compile_attention_fn1, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_custom_transformer, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_native_transformer_is_causal_False, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_native_transformer_is_causal_True, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_sdpa_is_causal_False, test/distributed/_tensor/test_attention.py::RingAttentionTest::test_ring_attention_sdpa_is_causal_True 2024-06-26T05:03:22.9476058Z 2024-06-26T05:03:22.9476525Z Running distributed/_composable/test_contract 1/1 ... [2024-06-26 05:03:22.946776] 2024-06-26T05:03:22.9478522Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/test_contract.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:03:22.947202] 2024-06-26T05:03:25.8709217Z 2024-06-26T05:03:25.8711085Z distributed/_composable/test_contract 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_contract_1.1_ca971da6659cd2a3_.log 2024-06-26T05:03:25.8714237Z Running 4 items in this shard: test/distributed/_composable/test_contract.py::TestContract::test_add_hooks, test/distributed/_composable/test_contract.py::TestContract::test_modify_fqn, test/distributed/_composable/test_contract.py::TestContract::test_registry, test/distributed/_composable/test_contract.py::TestContract::test_state 2024-06-26T05:03:25.8716541Z 2024-06-26T05:03:25.8716944Z Running distributed/_tensor/test_dtensor 1/1 ... [2024-06-26 05:03:25.871334] 2024-06-26T05:03:25.8720587Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_dtensor.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:03:25.871756] 2024-06-26T05:05:07.9702658Z 2024-06-26T05:05:07.9704473Z distributed/_tensor/test_dtensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_1.1_215f8b787a866b55_.log 2024-06-26T05:05:07.9720141Z Running 30 items in this shard: test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_async_output, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_constructor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_new_empty_strided, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_properties, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_save_load, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_spec_hash, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_spec_read_only_after_set, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_dtensor_stride, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_negative_dim, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_then_to_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_uneven_sharding, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_from_local_uneven_sharding_raise_error, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_full_tensor_grad_hint, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_full_tensor_sync, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_meta_dtensor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_modules_w_meta_dtensor, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_to_local, test/distributed/_tensor/test_dtensor.py::DTensorTest::test_to_local_grad_hint, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_auto_implicit_replication, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_default_value_sub_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_device_mesh_nd, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_2d_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_api_device_mesh_context_manager, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_device_mesh_device_conversion, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_dtensor_spec_local_shard_offset, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_from_local_sub_mesh, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_implicit_replication, test/distributed/_tensor/test_dtensor.py::DTensorMeshTest::test_redistribute_sub_mesh, test/distributed/_tensor/test_dtensor.py::TestDTensorPlacementTypes::test_split_tensor_1D 2024-06-26T05:05:07.9733907Z 2024-06-26T05:05:07.9734372Z Running distributed/_spmd/test_data_parallel 1/1 ... [2024-06-26 05:05:07.970897] 2024-06-26T05:05:07.9736359Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_spmd/test_data_parallel.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:05:07.971365] 2024-06-26T05:05:10.4862092Z 2024-06-26T05:05:10.4863785Z distributed/_spmd/test_data_parallel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._spmd.test_data_parallel_1.1_9d3cc76db8295f40_.log 2024-06-26T05:05:10.4864987Z 2024-06-26T05:05:10.4868176Z Running distributed/checkpoint/test_dedup_tensors 1/1 ... [2024-06-26 05:05:10.486620] 2024-06-26T05:05:10.4873770Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_dedup_tensors.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:05:10.487040] 2024-06-26T05:05:13.4127543Z 2024-06-26T05:05:13.4129998Z distributed/checkpoint/test_dedup_tensors 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dedup_tensors_1.1_f9a2bf548ba23498_.log 2024-06-26T05:05:13.4131876Z Running 1 items in this shard: test/distributed/checkpoint/test_dedup_tensors.py::TestDedupTensor::test_dedup_shards 2024-06-26T05:05:13.4132790Z 2024-06-26T05:05:13.4133419Z Running distributed/_tools/test_mem_tracker 1/1 ... [2024-06-26 05:05:13.413127] 2024-06-26T05:05:13.4138075Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tools/test_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:05:13.413507] 2024-06-26T05:05:16.5879016Z 2024-06-26T05:05:16.5880810Z distributed/_tools/test_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mem_tracker_1.1_540da0d226c9229d_.log 2024-06-26T05:05:16.5884480Z Running 3 items in this shard: test/distributed/_tools/test_mem_tracker.py::TestMemTrackerCPU::test_cuda_tracker_peak_equvivalence_bsz_2048_n_layers_10_dim_2048_bfloat16_cpu_bfloat16, test/distributed/_tools/test_mem_tracker.py::TestMemTrackerCPU::test_tracker_attribution_bsz_512_n_layers_3_dim_1024_float32_cpu_float32, test/distributed/_tools/test_mem_tracker.py::TestMemTrackerCPU::test_tracker_with_activation_checkpointing_bsz_128_n_layers_4_dim_1024_bfloat16_cpu_bfloat16 2024-06-26T05:05:16.5887117Z 2024-06-26T05:05:16.5887644Z Running distributed/checkpoint/e2e/test_fsdp_ep 1/1 ... [2024-06-26 05:05:16.588277] 2024-06-26T05:05:16.5889962Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/e2e/test_fsdp_ep.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:05:16.588701] 2024-06-26T05:05:19.5128959Z 2024-06-26T05:05:19.5131091Z distributed/checkpoint/e2e/test_fsdp_ep 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_0118fcdb0f59219e_.log 2024-06-26T05:05:19.5132836Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_fsdp_ep.py::TestFSDPWithEP::test_e2e 2024-06-26T05:05:19.5133507Z 2024-06-26T05:05:19.5135843Z Running distributed/_composable/fsdp/test_fully_shard_state 1/1 ... [2024-06-26 05:05:19.513317] 2024-06-26T05:05:19.5140509Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:05:19.513722] 2024-06-26T05:05:22.4375778Z 2024-06-26T05:05:22.4377920Z distributed/_composable/fsdp/test_fully_shard_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_state_1.1_bd02caf6120ddfa8_.log 2024-06-26T05:05:22.4383072Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_cls, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_deepcopy, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_reapply, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_state, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_unsupported_module_cls 2024-06-26T05:05:22.4387251Z 2024-06-26T05:05:22.4387699Z Running distributed/_tensor/test_tensor_ops 1/1 ... [2024-06-26 05:05:22.438010] 2024-06-26T05:05:22.4389693Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_tensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:05:22.438427] 2024-06-26T05:06:39.3690864Z 2024-06-26T05:06:39.3693117Z distributed/_tensor/test_tensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_tensor_ops_1.1_35e3011167e180a3_.log 2024-06-26T05:06:39.3712663Z Running 24 items in this shard: test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_aten_contiguous, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_clone, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_contiguous, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_detach, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_dtensor_dtype_conversion, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_empty_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_equal, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_fill_inplace, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_fill_inplace_partial_sum, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_full_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_gather, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_index, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_inplace_op, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_new_empty_strided, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_new_full, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_ones_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_ones_like_partial_sum, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_op_out_variant, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_scatter, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_stack, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_where_type_promotion, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zero_inplace, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zeros_like, test/distributed/_tensor/test_tensor_ops.py::DistTensorOpsTest::test_zeros_like_partial_sum 2024-06-26T05:06:39.3723800Z 2024-06-26T05:06:39.3724414Z Running distributed/pipelining/test_composability 1/1 ... [2024-06-26 05:06:39.370171] 2024-06-26T05:06:39.3726575Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/pipelining/test_composability.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:06:39.370593] 2024-06-26T05:06:42.1931866Z 2024-06-26T05:06:42.1934284Z distributed/pipelining/test_composability 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_composability_1.1_5a24f5986d3d97f1_.log 2024-06-26T05:06:42.1935475Z 2024-06-26T05:06:42.1938225Z Running distributed/_tools/test_fsdp2_mem_tracker 1/1 ... [2024-06-26 05:06:42.193593] 2024-06-26T05:06:42.1943469Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tools/test_fsdp2_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:06:42.193995] 2024-06-26T05:06:45.1678636Z 2024-06-26T05:06:45.1680911Z distributed/_tools/test_fsdp2_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_fsdp2_mem_tracker_1.1_848a5d4a3ba875c9_.log 2024-06-26T05:06:45.1684379Z Running 3 items in this shard: test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCore::test_tracker_multi_group_eager, test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCore::test_tracker_non_root_forward_backward, test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCompose::test_tracker_with_activation_checkpointing 2024-06-26T05:06:45.1686947Z 2024-06-26T05:06:45.1687456Z Running distributed/tensor/parallel/test_tp_random_state 1/1 ... [2024-06-26 05:06:45.168293] 2024-06-26T05:06:45.1690863Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_random_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:06:45.168751] 2024-06-26T05:06:50.8486090Z 2024-06-26T05:06:50.8489014Z distributed/tensor/parallel/test_tp_random_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_random_state_1.1_1186c371af57cb9a_.log 2024-06-26T05:06:50.8492674Z Running 1 items in this shard: test/distributed/tensor/parallel/test_tp_random_state.py::TensorParallelRandomStateTests::test_model_init 2024-06-26T05:06:50.8494211Z 2024-06-26T05:06:50.8495041Z Running distributed/_tensor/test_experimental_ops 1/1 ... [2024-06-26 05:06:50.849255] 2024-06-26T05:06:50.8502334Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_experimental_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:06:50.849793] 2024-06-26T05:07:01.7864931Z 2024-06-26T05:07:01.7866772Z distributed/_tensor/test_experimental_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_experimental_ops_1.1_da5320b74ca92f47_.log 2024-06-26T05:07:01.7869674Z Running 3 items in this shard: test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_bernoulli, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_nll, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_slice 2024-06-26T05:07:01.7871347Z 2024-06-26T05:07:01.7871953Z Running distributed/_tensor/test_math_ops 1/1 ... [2024-06-26 05:07:01.786874] 2024-06-26T05:07:01.7876564Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_math_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:07:01.787316] 2024-06-26T05:07:34.9301859Z 2024-06-26T05:07:34.9303341Z distributed/_tensor/test_math_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_math_ops_1.1_7fcd01f8e57e745e_.log 2024-06-26T05:07:34.9309130Z Running 10 items in this shard: test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_linear_op_reductions, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_mean, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_nll_loss_and_cross_entropy, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard0_svd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard_math_ops, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_with_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_topk 2024-06-26T05:07:34.9314525Z 2024-06-26T05:07:34.9315146Z Running distributed/_composable/fsdp/test_fully_shard_overlap 1/1 ... [2024-06-26 05:07:34.930764] 2024-06-26T05:07:34.9317564Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_overlap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:07:34.931226] 2024-06-26T05:07:37.9050585Z 2024-06-26T05:07:37.9053553Z distributed/_composable/fsdp/test_fully_shard_overlap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_overlap_1.1_98663679bcc84a9b_.log 2024-06-26T05:07:37.9058437Z Running 2 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_overlap.py::TestFullyShardOverlap::test_fully_shard_post_optim_event_overlap, test/distributed/_composable/fsdp/test_fully_shard_overlap.py::TestFullyShardOverlap::test_fully_shard_training_overlap 2024-06-26T05:07:37.9061198Z 2024-06-26T05:07:37.9061895Z Running distributed/_tensor/test_redistribute 1/1 ... [2024-06-26 05:07:37.905659] 2024-06-26T05:07:37.9066244Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_redistribute.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:07:37.906206] 2024-06-26T05:08:15.1018056Z 2024-06-26T05:08:15.1019932Z distributed/_tensor/test_redistribute 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_redistribute_1.1_017f6b6fde2ebbfb_.log 2024-06-26T05:08:15.1027556Z Running 11 items in this shard: test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_shard, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_negative_shard_dim, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_shard_dim_change, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_uneven_sharding, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_local_partial_grad, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_partial, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_shard_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_shard_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::MultiDimRedistributeTest::test_multi_dim_mesh 2024-06-26T05:08:15.1034407Z 2024-06-26T05:08:15.1034959Z Running distributed/tensor/parallel/test_ddp_2d_parallel 1/1 ... [2024-06-26 05:08:15.102308] 2024-06-26T05:08:15.1037119Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_ddp_2d_parallel.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:15.102717] 2024-06-26T05:08:20.9826850Z 2024-06-26T05:08:20.9829072Z distributed/tensor/parallel/test_ddp_2d_parallel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_ddp_2d_parallel_1.1_bdd3d7b2af08761d_.log 2024-06-26T05:08:20.9831853Z Running 1 items in this shard: test/distributed/tensor/parallel/test_ddp_2d_parallel.py::Test2dParallelIntegration::test_2d_ddp_integration_functionality 2024-06-26T05:08:20.9832892Z 2024-06-26T05:08:20.9835165Z Running distributed/test_compute_comm_reordering 1/1 ... [2024-06-26 05:08:20.983269] 2024-06-26T05:08:20.9840338Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_compute_comm_reordering.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:20.983696] 2024-06-26T05:08:23.7580271Z 2024-06-26T05:08:23.7582209Z distributed/test_compute_comm_reordering 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_compute_comm_reordering_1.1_db8c8b26ebfbd46f_.log 2024-06-26T05:08:23.7587363Z Running 6 items in this shard: test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_nccl_heuristics, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_raise_comms, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_reorder_compute_for_overlap, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_reorder_compute_for_overlap_custom_runtime_estimation, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_sink_waits, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_sink_waits_raise_comms 2024-06-26T05:08:23.7591806Z 2024-06-26T05:08:23.7592368Z Running distributed/_composable/fsdp/test_fully_shard_autograd 1/1 ... [2024-06-26 05:08:23.758525] 2024-06-26T05:08:23.7594565Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_autograd.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:23.758998] 2024-06-26T05:08:26.8330770Z 2024-06-26T05:08:26.8332965Z distributed/_composable/fsdp/test_fully_shard_autograd 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_autograd_1.1_30c0e88285fd60d3_.log 2024-06-26T05:08:26.8336471Z Running 3 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_nontensor_activations, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_module, test/distributed/_composable/fsdp/test_fully_shard_autograd.py::TestFullyShardAutograd::test_unused_forward_output 2024-06-26T05:08:26.8339068Z 2024-06-26T05:08:26.8339758Z Running distributed/_tensor/test_xla_integration 1/1 ... [2024-06-26 05:08:26.833520] 2024-06-26T05:08:26.8342732Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_xla_integration.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:26.833932] 2024-06-26T05:08:29.7077451Z 2024-06-26T05:08:29.7079615Z distributed/_tensor/test_xla_integration 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_xla_integration_1.1_5dcb8b1320537c5a_.log 2024-06-26T05:08:29.7082779Z Running 3 items in this shard: test/distributed/_tensor/test_xla_integration.py::DTensorXLAIntegrationTest::test_xla_distribute_tensor_1d_replicate, test/distributed/_tensor/test_xla_integration.py::DTensorXLAIntegrationTest::test_xla_distribute_tensor_1d_shard, test/distributed/_tensor/test_xla_integration.py::DTensorXLAIntegrationTest::test_xla_distribute_tensor_2d 2024-06-26T05:08:29.7085384Z 2024-06-26T05:08:29.7086005Z Running distributed/_composable/fsdp/test_fully_shard_init 1/1 ... [2024-06-26 05:08:29.708235] 2024-06-26T05:08:29.7089819Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:29.708672] 2024-06-26T05:08:32.6825694Z 2024-06-26T05:08:32.6827521Z distributed/_composable/fsdp/test_fully_shard_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_init_1.1_7b1b2f59c6c8cded_.log 2024-06-26T05:08:32.6848014Z Running 24 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceTensor::test_move_states_to_device_tensor, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceDTensor::test_move_states_to_device_dtensor_invalid, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardDeviceDTensor::test_move_states_to_device_dtensor_valid, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMeshArg::test_invalid_mesh_ndim, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_duplicate, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_nested, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_nested_fully_shard_and_replicate, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_modules_single, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_nested_fully_shard, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardManagedModulesAndStates::test_managed_states_shared_params_and_buffers, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_duplicates, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardParamModuleInfos::test_get_param_module_infos_shared_params, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterTensor::test_shard_tensor_parameters, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardShardedParameterDTensor::test_shard_dtensor_parameters, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_double_lazy_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_is_root, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardLazyInit::test_fully_shard_module_and_param_fqns, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_invalid_meta_device_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_meta_device_1d_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_meta_device_2d_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardMetaDeviceInit::test_rank0_broadcast_meta_device_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardProcessGroupInit::test_1d_process_group_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardProcessGroupInit::test_2d_process_group_init, test/distributed/_composable/fsdp/test_fully_shard_init.py::TestFullyShardHSDPBroadcast::test_hsdp_broadcast_across_replicas 2024-06-26T05:08:32.6866386Z 2024-06-26T05:08:32.6866896Z Running distributed/_composable/test_checkpoint 1/1 ... [2024-06-26 05:08:32.682968] 2024-06-26T05:08:32.6868923Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/test_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:32.683426] 2024-06-26T05:08:35.6574415Z 2024-06-26T05:08:35.6576234Z distributed/_composable/test_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_checkpoint_1.1_561f7706a32d325b_.log 2024-06-26T05:08:35.6580786Z Running 6 items in this shard: test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_checkpoint_kwargs, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_clears_state_on_error_in_forward, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_multi_args, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_random_cpu, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_tensor_only_cpu, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_tensor_only_gpu 2024-06-26T05:08:35.6583873Z 2024-06-26T05:08:35.6584484Z Running distributed/_composable/fsdp/test_fully_shard_memory 1/1 ... [2024-06-26 05:08:35.657889] 2024-06-26T05:08:35.6586930Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_memory.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:35.658317] 2024-06-26T05:08:38.6842243Z 2024-06-26T05:08:38.6844196Z distributed/_composable/fsdp/test_fully_shard_memory 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_memory_1.1_97082d08f32cda75_.log 2024-06-26T05:08:38.6846515Z Running 1 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_memory.py::TestFullyShardMemory::test_fully_shard_training_memory 2024-06-26T05:08:38.6847566Z 2024-06-26T05:08:38.6848333Z Running distributed/_tensor/test_matrix_ops 1/1 ... [2024-06-26 05:08:38.684650] 2024-06-26T05:08:38.6853602Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_matrix_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:08:38.685054] 2024-06-26T05:09:07.3649299Z 2024-06-26T05:09:07.3651185Z distributed/_tensor/test_matrix_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_matrix_ops_1.1_4573412258df8adc_.log 2024-06-26T05:09:07.3657053Z Running 9 items in this shard: test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_auto_redistribute, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_empty_operand, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_baddbmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_bmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_mm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_scaled_dot_product_attention, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t_partial 2024-06-26T05:09:07.3663010Z 2024-06-26T05:09:07.3663704Z Running distributed/tensor/parallel/test_tp_style 1/1 ... [2024-06-26 05:09:07.365697] 2024-06-26T05:09:07.3665953Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_style.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:09:07.366264] 2024-06-26T05:09:36.1944138Z 2024-06-26T05:09:36.1945842Z distributed/tensor/parallel/test_tp_style 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_style_1.1_747fd1e0722f61cc_.log 2024-06-26T05:09:36.1953690Z Running 9 items in this shard: test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_colwise_parallel_embedding, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_colwise_parallel_style, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_input, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_input_multiple_inputs, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_kwargs_input, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_output, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_rowwise_parallel_embedding, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_rowwise_parallel_style, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_sequence_parallel_style 2024-06-26T05:09:36.1960057Z 2024-06-26T05:09:36.1960650Z Running distributed/checkpoint/test_dtensor_resharding 1/1 ... [2024-06-26 05:09:36.195024] 2024-06-26T05:09:36.1962966Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_dtensor_resharding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:09:36.195512] 2024-06-26T05:09:53.2993429Z 2024-06-26T05:09:53.2995601Z distributed/checkpoint/test_dtensor_resharding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_41d75288162f73f6_.log 2024-06-26T05:09:53.3000759Z Running 5 items in this shard: test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_1d_to_1d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_2d_to_2d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_1d_to_2d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_2d_to_1d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_dtensor_checkpoint_resharding_with_empty_shard 2024-06-26T05:09:53.3004774Z 2024-06-26T05:09:53.3005306Z Running distributed/optim/test_named_optimizer 1/1 ... [2024-06-26 05:09:53.299711] 2024-06-26T05:09:53.3007616Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/optim/test_named_optimizer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:09:53.300119] 2024-06-26T05:09:55.7808516Z 2024-06-26T05:09:55.7810134Z distributed/optim/test_named_optimizer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_named_optimizer_1.1_ef8281dd1f419231_.log 2024-06-26T05:09:55.7811297Z 2024-06-26T05:09:55.7815913Z Running distributed/_tensor/test_pointwise_ops 1/1 ... [2024-06-26 05:09:55.781323] 2024-06-26T05:09:55.7820168Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_pointwise_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:09:55.781737] 2024-06-26T05:09:58.8064234Z 2024-06-26T05:09:58.8066244Z distributed/_tensor/test_pointwise_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_pointwise_ops_1.1_96bccd2620318d0f_.log 2024-06-26T05:09:58.8071162Z Running 7 items in this shard: test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_activations, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_backward, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_errors, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_mul_out, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_add, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_mul 2024-06-26T05:09:58.8075681Z 2024-06-26T05:09:58.8076210Z Running distributed/tensor/parallel/test_tp_examples 1/1 ... [2024-06-26 05:09:58.806865] 2024-06-26T05:09:58.8078331Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_examples.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:09:58.807315] 2024-06-26T05:10:21.9752054Z 2024-06-26T05:10:21.9756728Z distributed/tensor/parallel/test_tp_examples 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_73c2bb37ae91058e_.log 2024-06-26T05:10:21.9763676Z Running 7 items in this shard: test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_loss_parallel, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_inference, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_training_is_seq_parallel_False_recompute_activation_False, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_mlp_training_is_seq_parallel_True_recompute_activation_False, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_False, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_transformer_training_is_seq_parallel_True, test/distributed/tensor/parallel/test_tp_examples.py::DistTensorParallelExampleTest::test_weight_tying 2024-06-26T05:10:21.9769078Z 2024-06-26T05:10:21.9769530Z Running distributed/checkpoint/test_planner 1/1 ... [2024-06-26 05:10:21.975811] 2024-06-26T05:10:21.9771527Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_planner.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:21.976252] 2024-06-26T05:10:24.9499309Z 2024-06-26T05:10:24.9502195Z distributed/checkpoint/test_planner 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_planner_1.1_a0bd0419fac154e5_.log 2024-06-26T05:10:24.9510213Z Running 7 items in this shard: test/distributed/checkpoint/test_planner.py::TestSavePlan::test_global_plan, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_load_with_resharding, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_load_with_world_size_diff_by_one, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_local_load_plan, test/distributed/checkpoint/test_planner.py::TestSavePlan::test_local_plan, test/distributed/checkpoint/test_planner.py::TestPlannerHelpers::test_create_read_item_from_chunks, test/distributed/checkpoint/test_planner.py::TestLoadPlanner::test_strict 2024-06-26T05:10:24.9516413Z 2024-06-26T05:10:24.9517104Z Running distributed/fsdp/test_shard_utils 1/1 ... [2024-06-26 05:10:24.950640] 2024-06-26T05:10:24.9519843Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_shard_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:24.951200] 2024-06-26T05:10:33.2862052Z 2024-06-26T05:10:33.2863948Z distributed/fsdp/test_shard_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_shard_utils_1.1_dd176b6da9156580_.log 2024-06-26T05:10:33.2866311Z Running 2 items in this shard: test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributed::test_create_chunk_sharded_tensor, test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributedDTensor::test_create_chunk_dtensor 2024-06-26T05:10:33.2868186Z 2024-06-26T05:10:33.2869427Z Running distributed/_tensor/debug/test_comm_mode 1/1 ... [2024-06-26 05:10:33.286654] 2024-06-26T05:10:33.2897132Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/debug/test_comm_mode.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:33.287149] 2024-06-26T05:10:36.2138362Z 2024-06-26T05:10:36.2140741Z distributed/_tensor/debug/test_comm_mode 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_comm_mode_1.1_02d095a6051c3089_.log 2024-06-26T05:10:36.2144089Z Running 4 items in this shard: test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_coalesced, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_with_c10d, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_with_dtensor 2024-06-26T05:10:36.2146699Z 2024-06-26T05:10:36.2147142Z Running distributed/pipelining/test_stage 1/1 ... [2024-06-26 05:10:36.214263] 2024-06-26T05:10:36.2150054Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/pipelining/test_stage.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:36.214677] 2024-06-26T05:10:39.0300864Z 2024-06-26T05:10:39.0302686Z distributed/pipelining/test_stage 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_stage_1.1_df3321adafa48f53_.log 2024-06-26T05:10:39.0303811Z 2024-06-26T05:10:39.0307162Z Running distributed/checkpoint/test_fsspec 1/1 ... [2024-06-26 05:10:39.030491] 2024-06-26T05:10:39.0312174Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_fsspec.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:39.030875] 2024-06-26T05:10:42.0061612Z 2024-06-26T05:10:42.0063840Z distributed/checkpoint/test_fsspec 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsspec_1.1_f9327b497561ff9f_.log 2024-06-26T05:10:42.0066723Z Running 3 items in this shard: test/distributed/checkpoint/test_fsspec.py::TestFSSpecNoDist::test_fsspec_no_dist, test/distributed/checkpoint/test_fsspec.py::TestFSSpecWithDist::test_fsspec_with_dist, test/distributed/checkpoint/test_fsspec.py::TestFSSpecWithDist::test_overwrite 2024-06-26T05:10:42.0068623Z 2024-06-26T05:10:42.0069115Z Running distributed/checkpoint/e2e/test_fine_tuning 1/1 ... [2024-06-26 05:10:42.006627] 2024-06-26T05:10:42.0074107Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/e2e/test_fine_tuning.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:42.007061] 2024-06-26T05:10:45.0312297Z 2024-06-26T05:10:45.0314165Z distributed/checkpoint/e2e/test_fine_tuning 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_fine_tuning_1.1_426d4dc618491035_.log 2024-06-26T05:10:45.0315997Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_fine_tuning.py::TestFineTuning::test_fine_tuning 2024-06-26T05:10:45.0316757Z 2024-06-26T05:10:45.0318931Z Running distributed/checkpoint/test_dtensor_checkpoint 1/1 ... [2024-06-26 05:10:45.031657] 2024-06-26T05:10:45.0324054Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_dtensor_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:45.032091] 2024-06-26T05:10:50.7120892Z 2024-06-26T05:10:50.7122969Z distributed/checkpoint/test_dtensor_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dtensor_checkpoint_1.1_3644df267ea835a1_.log 2024-06-26T05:10:50.7125014Z Running 1 items in this shard: test/distributed/checkpoint/test_dtensor_checkpoint.py::DTensorPlanner::test_distributed_tensor_planner 2024-06-26T05:10:50.7125869Z 2024-06-26T05:10:50.7127739Z Running distributed/checkpoint/e2e/test_pipeline 1/1 ... [2024-06-26 05:10:50.712515] 2024-06-26T05:10:50.7132712Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/e2e/test_pipeline.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:50.712934] 2024-06-26T05:10:53.6366242Z 2024-06-26T05:10:53.6368950Z distributed/checkpoint/e2e/test_pipeline 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_pipeline_1.1_6b88b54d53b5bda4_.log 2024-06-26T05:10:53.6372043Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_pipeline.py::TestPipeline::test_pipeline 2024-06-26T05:10:53.6373252Z 2024-06-26T05:10:53.6374051Z Running distributed/test_functional_api 1/1 ... [2024-06-26 05:10:53.637187] 2024-06-26T05:10:53.6381452Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_functional_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:10:53.637716] 2024-06-26T05:11:28.3238636Z 2024-06-26T05:11:28.3240694Z distributed/test_functional_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_functional_api_1.1_8e15c86a5d55ee64_.log 2024-06-26T05:11:28.3283403Z Running 48 items in this shard: test/distributed/test_functional_api.py::TestExpand::test_expand_1d_rank_list, test/distributed/test_functional_api.py::TestExpand::test_expand_2d_rank_list, test/distributed/test_functional_api.py::TestExpand::test_expand_device_mesh, test/distributed/test_functional_api.py::TestExpand::test_expand_device_mesh_tuple, test/distributed/test_functional_api.py::TestExpand::test_expand_process_group, test/distributed/test_functional_api.py::TestPgTag::test_find_or_create_pg, test/distributed/test_functional_api.py::TestPgTag::test_find_root_pg, test/distributed/test_functional_api.py::TestPgTag::test_pg_creation_with_tag, test/distributed/test_functional_api.py::TestPgTag::test_pg_lookup_roundtrip, test/distributed/test_functional_api.py::TestPgTag::test_pg_lookup_with_tag, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_into_tensor_coalesced_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_into_tensor_coalesced_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_tensor_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_tensor_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_coalesced_eager_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_coalesced_eager_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_eager_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_eager_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_broadcast_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_broadcast_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_into_tensor_coalesced_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_into_tensor_coalesced_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_tensor_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_tensor_device_cuda, test/distributed/test_functional_api.py::TestMetaCollectives::test_all_reduce, test/distributed/test_functional_api.py::TestGradCollectives::test_all_reduce, test/distributed/test_functional_api.py::TestMakeFx::test_all_reduce_tracing, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_gather_into_tensor_coalesced, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_to_all_single, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_to_all_single_1d_input, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_to_all_single_split_sizes_none, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_tracing, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_tracing_with_fakepg, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_gather_into_tensor_coalesced, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_to_all_single, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_to_all_single_1d_input, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_to_all_single_split_sizes_none, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_permute_tensor_with_sub_group, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_tracing, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_tracing_with_fakepg, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_gather_tensor_compile_False, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_gather_tensor_compile_True, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_to_all_single_compile_False, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_to_all_single_compile_True, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_to_all_single_inductor, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_reduce_scatter_tensor_compile_False, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_reduce_scatter_tensor_compile_True, test/distributed/test_functional_api.py::TestFunctionalAutogradWithNCCL::test_all_to_all_single 2024-06-26T05:11:28.3311173Z 2024-06-26T05:11:28.3311864Z Running distributed/test_collective_utils 1/1 ... [2024-06-26 05:11:28.324502] 2024-06-26T05:11:28.3313840Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_collective_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:11:28.325059] 2024-06-26T05:11:30.8397291Z 2024-06-26T05:11:30.8399180Z distributed/test_collective_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_collective_utils_1.1_64e51beb2c2a9c72_.log 2024-06-26T05:11:30.8400268Z 2024-06-26T05:11:30.8404087Z Running distributed/_composable/fully_shard/test_fully_shard_compile 1/1 ... [2024-06-26 05:11:30.840146] 2024-06-26T05:11:30.8409080Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:11:30.840571] 2024-06-26T05:11:33.4142008Z 2024-06-26T05:11:33.4144006Z distributed/_composable/fully_shard/test_fully_shard_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_compile_1.1_0038de5848672524_.log 2024-06-26T05:11:33.4146536Z Running 1 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_compile.py::TestCompile::test_compile 2024-06-26T05:11:33.4147387Z 2024-06-26T05:11:33.4149847Z Running distributed/checkpoint/test_fsdp_model_state 1/1 ... [2024-06-26 05:11:33.414748] 2024-06-26T05:11:33.4155266Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_model_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:11:33.415225] 2024-06-26T05:11:41.9512891Z 2024-06-26T05:11:41.9515065Z distributed/checkpoint/test_fsdp_model_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_model_state_1.1_d4603ab10dd54d3f_.log 2024-06-26T05:11:41.9517729Z Running 2 items in this shard: test/distributed/checkpoint/test_fsdp_model_state.py::FsdpModelStateCheckpoint::test_fsdp_model_state_no_resharding, test/distributed/checkpoint/test_fsdp_model_state.py::FsdpModelStateCheckpoint::test_fsdp_model_state_with_resharding 2024-06-26T05:11:41.9519613Z 2024-06-26T05:11:41.9520144Z Running distributed/tensor/parallel/test_parallelize_api 1/1 ... [2024-06-26 05:11:41.951744] 2024-06-26T05:11:41.9525394Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_parallelize_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:11:41.952182] 2024-06-26T05:12:13.3861861Z 2024-06-26T05:12:13.3865611Z distributed/tensor/parallel/test_parallelize_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_parallelize_api_1.1_7534bfc04a9cc5a1_.log 2024-06-26T05:12:13.3874649Z Running 10 items in this shard: test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_linear_col_wise_parallel, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_linear_row_wise_parallel, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_mlp_with_module_api, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_mlp_with_module_api_nested, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_multi_wildcard, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_digit, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_question, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_star, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_prepare_module_input, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_prepare_module_output 2024-06-26T05:12:13.3881631Z 2024-06-26T05:12:13.3882229Z Running distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 ... [2024-06-26 05:12:13.386731] 2024-06-26T05:12:13.3884482Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:12:13.387142] 2024-06-26T05:12:19.0670127Z 2024-06-26T05:12:19.0672636Z distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion_1.1_88fd5620f2eadff6_.log 2024-06-26T05:12:19.0675354Z Running 1 items in this shard: test/distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py::TestFsdpTpCheckpointConversion::test_fsdp_to_tp 2024-06-26T05:12:19.0677810Z 2024-06-26T05:12:19.0678560Z Running distributed/test_distributed_spawn 1/3 ... [2024-06-26 05:12:19.067475] 2024-06-26T05:12:19.0734843Z MPI not available -- MPI backend tests will be skipped 2024-06-26T05:12:19.0736146Z Running distributed tests for the test backend with env init_method 2024-06-26T05:12:19.0744541Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:12:19.074145] 2024-06-26T05:12:21.8666767Z 2024-06-26T05:12:21.8668441Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_4559487257a3af0c_.log 2024-06-26T05:12:21.8669680Z Running 0 items in this shard: 2024-06-26T05:12:21.8669937Z 2024-06-26T05:12:21.8676898Z Running distributed tests for the test backend with file init_method 2024-06-26T05:12:21.8682615Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:12:21.867952] 2024-06-26T05:12:24.6423641Z 2024-06-26T05:12:24.6425565Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_a796cf127c87612e_.log 2024-06-26T05:12:24.6426793Z Running 0 items in this shard: 2024-06-26T05:12:24.6427053Z 2024-06-26T05:12:24.6433086Z Running distributed tests for the gloo backend with env init_method 2024-06-26T05:12:24.6439580Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:12:24.643631] 2024-06-26T05:21:37.3378173Z 2024-06-26T05:21:37.3382053Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_4ec6f73eff7f76ed_.log 2024-06-26T05:21:37.3446296Z Running 102 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-06-26T05:21:37.3509511Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager 2024-06-26T05:21:37.3511266Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager 2024-06-26T05:21:37.3513588Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class 2024-06-26T05:21:37.3516292Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU 2024-06-26T05:21:37.3519381Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input 2024-06-26T05:21:37.3521222Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last 2024-06-26T05:21:37.3523116Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value 2024-06-26T05:21:37.3524991Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine 2024-06-26T05:21:37.3526821Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad 2024-06-26T05:21:37.3528346Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync 2024-06-26T05:21:37.3529894Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook 2024-06-26T05:21:37.3531524Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view 2024-06-26T05:21:37.3532990Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda 2024-06-26T05:21:37.3534395Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda 2024-06-26T05:21:37.3535884Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg 2024-06-26T05:21:37.3537351Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup 2024-06-26T05:21:37.3538840Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max 2024-06-26T05:21:37.3540365Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min 2024-06-26T05:21:37.3542044Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product 2024-06-26T05:21:37.3543598Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum 2024-06-26T05:21:37.3545115Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max 2024-06-26T05:21:37.3546597Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min 2024-06-26T05:21:37.3548061Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max 2024-06-26T05:21:37.3549591Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported 2024-06-26T05:21:37.3551126Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min 2024-06-26T05:21:37.3552699Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max 2024-06-26T05:21:37.3554147Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min 2024-06-26T05:21:37.3555552Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max 2024-06-26T05:21:37.3556911Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max 2024-06-26T05:21:37.3558243Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product 2024-06-26T05:21:37.3559589Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum 2024-06-26T05:21:37.3560945Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async 2024-06-26T05:21:37.3562343Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async 2024-06-26T05:21:37.3563852Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group 2024-06-26T05:21:37.3565346Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda 2024-06-26T05:21:37.3566742Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group 2024-06-26T05:21:37.3568134Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split 2024-06-26T05:21:37.3569692Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex 2024-06-26T05:21:37.3571286Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group 2024-06-26T05:21:37.3572911Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda 2024-06-26T05:21:37.3574531Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group 2024-06-26T05:21:37.3576135Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda 2024-06-26T05:21:37.3577618Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group 2024-06-26T05:21:37.3579000Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier 2024-06-26T05:21:37.3580251Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda 2024-06-26T05:21:37.3581627Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda 2024-06-26T05:21:37.3583036Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group 2024-06-26T05:21:37.3584464Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags 2024-06-26T05:21:37.3585993Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err 2024-06-26T05:21:37.3587509Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err 2024-06-26T05:21:37.3588887Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast 2024-06-26T05:21:37.3590208Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list 2024-06-26T05:21:37.3591588Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager 2024-06-26T05:21:37.3593161Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async 2024-06-26T05:21:37.3594786Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger 2024-06-26T05:21:37.3596471Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping 2024-06-26T05:21:37.3598097Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad 2024-06-26T05:21:37.3599762Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph 2024-06-26T05:21:37.3601161Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph 2024-06-26T05:21:37.3602547Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook 2024-06-26T05:21:37.3603989Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD 2024-06-26T05:21:37.3605481Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg 2024-06-26T05:21:37.3606889Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu 2024-06-26T05:21:37.3608391Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params 2024-06-26T05:21:37.3609923Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace 2024-06-26T05:21:37.3611382Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged 2024-06-26T05:21:37.3612858Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params 2024-06-26T05:21:37.3614320Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states 2024-06-26T05:21:37.3615851Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable 2024-06-26T05:21:37.3617267Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs 2024-06-26T05:21:37.3618740Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn 2024-06-26T05:21:37.3620318Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group 2024-06-26T05:21:37.3621899Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused 2024-06-26T05:21:37.3623520Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group 2024-06-26T05:21:37.3624865Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group 2024-06-26T05:21:37.3626218Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params 2024-06-26T05:21:37.3627570Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future 2024-06-26T05:21:37.3628831Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank 2024-06-26T05:21:37.3630155Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph 2024-06-26T05:21:37.3631451Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv 2024-06-26T05:21:37.3632958Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler 2024-06-26T05:21:37.3634441Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order 2024-06-26T05:21:37.3635899Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo 2024-06-26T05:21:37.3637448Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup 2024-06-26T05:21:37.3638934Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce 2024-06-26T05:21:37.3640320Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort 2024-06-26T05:21:37.3641639Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups 2024-06-26T05:21:37.3643152Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size 2024-06-26T05:21:37.3644789Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module 2024-06-26T05:21:37.3646360Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product 2024-06-26T05:21:37.3647744Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min 2024-06-26T05:21:37.3649063Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product 2024-06-26T05:21:37.3650358Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum 2024-06-26T05:21:37.3651652Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda 2024-06-26T05:21:37.3653033Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda 2024-06-26T05:21:37.3654343Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl 2024-06-26T05:21:37.3655761Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler 2024-06-26T05:21:37.3657260Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler 2024-06-26T05:21:37.3658710Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler 2024-06-26T05:21:37.3660194Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler 2024-06-26T05:21:37.3661671Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu 2024-06-26T05:21:37.3663155Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-06-26T05:21:37.3664027Z 2024-06-26T05:21:37.3664316Z Running distributed tests for the gloo backend with file init_method 2024-06-26T05:21:37.3666431Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:21:37.341538] 2024-06-26T05:30:48.9735492Z 2024-06-26T05:30:48.9737192Z distributed/test_distributed_spawn 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_1.3_9b606ef5c3647e24_.log 2024-06-26T05:30:48.9811572Z Running 102 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-06-26T05:30:48.9876441Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_1_level_hierarchical_model_averager_equivalent_to_periodic_model_averager 2024-06-26T05:30:48.9879649Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_3_level_hierarchical_model_averager 2024-06-26T05:30:48.9881703Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_Backend_enum_class 2024-06-26T05:30:48.9883146Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU 2024-06-26T05:30:48.9884822Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_2D_Input 2024-06-26T05:30:48.9886555Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Channels_Last 2024-06-26T05:30:48.9888367Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_Running_Value 2024-06-26T05:30:48.9890179Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_No_Affine 2024-06-26T05:30:48.9891831Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_requires_grad 2024-06-26T05:30:48.9893380Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync 2024-06-26T05:30:48.9894918Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_hook 2024-06-26T05:30:48.9896724Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_grad_is_view 2024-06-26T05:30:48.9898197Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda 2024-06-26T05:30:48.9899619Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_cat_tensor_cuda 2024-06-26T05:30:48.9901086Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_default_pg 2024-06-26T05:30:48.9902546Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_object_subgroup 2024-06-26T05:30:48.9904047Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_max 2024-06-26T05:30:48.9905633Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_min 2024-06-26T05:30:48.9907187Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_product 2024-06-26T05:30:48.9908728Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_full_group_sum 2024-06-26T05:30:48.9910255Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_max 2024-06-26T05:30:48.9912131Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_min 2024-06-26T05:30:48.9913597Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max 2024-06-26T05:30:48.9915117Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_max_complex_unsupported 2024-06-26T05:30:48.9916658Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_min 2024-06-26T05:30:48.9918088Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_max 2024-06-26T05:30:48.9919516Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_min 2024-06-26T05:30:48.9920911Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_max 2024-06-26T05:30:48.9922264Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_max 2024-06-26T05:30:48.9923607Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_product 2024-06-26T05:30:48.9925015Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum 2024-06-26T05:30:48.9926367Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_async 2024-06-26T05:30:48.9927785Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_async 2024-06-26T05:30:48.9929197Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group 2024-06-26T05:30:48.9930601Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_full_group_cuda 2024-06-26T05:30:48.9931989Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group 2024-06-26T05:30:48.9933524Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split 2024-06-26T05:30:48.9935067Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda_complex 2024-06-26T05:30:48.9936649Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group 2024-06-26T05:30:48.9938260Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_full_group_cuda 2024-06-26T05:30:48.9939889Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group 2024-06-26T05:30:48.9941488Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group_cuda 2024-06-26T05:30:48.9942970Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_full_group 2024-06-26T05:30:48.9944266Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier 2024-06-26T05:30:48.9945538Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_cuda 2024-06-26T05:30:48.9946910Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group_cuda 2024-06-26T05:30:48.9948385Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_group 2024-06-26T05:30:48.9949808Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo_tags 2024-06-26T05:30:48.9951316Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_mixed_backend_err 2024-06-26T05:30:48.9952974Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_list_err 2024-06-26T05:30:48.9954332Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast 2024-06-26T05:30:48.9955664Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_object_list 2024-06-26T05:30:48.9957053Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager 2024-06-26T05:30:48.9958454Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_coalescing_manager_async 2024-06-26T05:30:48.9960048Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_with_logger 2024-06-26T05:30:48.9961728Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping 2024-06-26T05:30:48.9963364Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_build_debug_param_to_name_mapping_requires_grad 2024-06-26T05:30:48.9965016Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_compile_static_graph 2024-06-26T05:30:48.9966394Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_create_graph 2024-06-26T05:30:48.9967786Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_forward_backward_hook 2024-06-26T05:30:48.9969233Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_pickling_powerSGD 2024-06-26T05:30:48.9970736Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_ignore_params_arg 2024-06-26T05:30:48.9972135Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_cpu 2024-06-26T05:30:48.9973626Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_ignored_params 2024-06-26T05:30:48.9975168Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_execution_trace 2024-06-26T05:30:48.9976607Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_python_error_logged 2024-06-26T05:30:48.9978089Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_shared_grad_acc_unused_params 2024-06-26T05:30:48.9979569Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_module_states 2024-06-26T05:30:48.9981016Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_join_disable 2024-06-26T05:30:48.9982419Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs 2024-06-26T05:30:48.9983897Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_inputs_stop_iteration_sync_bn 2024-06-26T05:30:48.9985564Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_default_group 2024-06-26T05:30:48.9987138Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_no_find_unused 2024-06-26T05:30:48.9988590Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_full_group 2024-06-26T05:30:48.9989917Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_group 2024-06-26T05:30:48.9991279Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_data_parallel_params 2024-06-26T05:30:48.9992877Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_future 2024-06-26T05:30:48.9994136Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank 2024-06-26T05:30:48.9995464Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_invalid_static_graph 2024-06-26T05:30:48.9996769Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_irecv 2024-06-26T05:30:48.9998082Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_autograd_profiler 2024-06-26T05:30:48.9999553Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_failure_order 2024-06-26T05:30:49.0001016Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo 2024-06-26T05:30:49.0002483Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_subgroup 2024-06-26T05:30:49.0003962Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allreduce 2024-06-26T05:30:49.0005435Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_init_abort 2024-06-26T05:30:49.0006876Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups 2024-06-26T05:30:49.0008398Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_world_size_not_divisible_by_group_size 2024-06-26T05:30:49.0010018Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_tuple_module 2024-06-26T05:30:49.0011508Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_product 2024-06-26T05:30:49.0012910Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_min 2024-06-26T05:30:49.0014240Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_product 2024-06-26T05:30:49.0015525Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum 2024-06-26T05:30:49.0016839Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda 2024-06-26T05:30:49.0018153Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda 2024-06-26T05:30:49.0019461Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl 2024-06-26T05:30:49.0020855Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_autograd_profiler 2024-06-26T05:30:49.0022440Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_nccl_torch_profiler 2024-06-26T05:30:49.0023892Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_torch_profiler 2024-06-26T05:30:49.0025372Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_autograd_profiler 2024-06-26T05:30:49.0026839Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_api_cpu 2024-06-26T05:30:49.0028325Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_without_logger 2024-06-26T05:30:49.0029194Z 2024-06-26T05:30:49.0029714Z Running distributed/test_distributed_spawn 3/3 ... [2024-06-26 05:30:48.977909] 2024-06-26T05:30:49.0030469Z MPI not available -- MPI backend tests will be skipped 2024-06-26T05:30:49.0031127Z Running distributed tests for the test backend with env init_method 2024-06-26T05:30:49.0033301Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:30:48.984563] 2024-06-26T05:30:51.8781334Z 2024-06-26T05:30:51.8783917Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_429637734c3db2e1_.log 2024-06-26T05:30:51.8786257Z Running 0 items in this shard: 2024-06-26T05:30:51.8792169Z 2024-06-26T05:30:51.8792792Z Running distributed tests for the test backend with file init_method 2024-06-26T05:30:51.8798871Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:30:51.879554] 2024-06-26T05:30:54.6559420Z 2024-06-26T05:30:54.6561347Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_7199a8dbc698a25d_.log 2024-06-26T05:30:54.6562838Z Running 0 items in this shard: 2024-06-26T05:30:54.6563104Z 2024-06-26T05:30:54.6568977Z Running distributed tests for the gloo backend with env init_method 2024-06-26T05:30:54.6574916Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:30:54.657191] 2024-06-26T05:39:38.9594551Z 2024-06-26T05:39:38.9597549Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_2441055c656160a9_.log 2024-06-26T05:39:38.9663187Z Running 91 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger 2024-06-26T05:39:38.9716643Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view 2024-06-26T05:39:38.9718410Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient 2024-06-26T05:39:38.9720183Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream 2024-06-26T05:39:38.9721838Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view 2024-06-26T05:39:38.9723337Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather 2024-06-26T05:39:38.9724717Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex 2024-06-26T05:39:38.9726242Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group 2024-06-26T05:39:38.9727658Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group 2024-06-26T05:39:38.9729038Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group 2024-06-26T05:39:38.9730464Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda 2024-06-26T05:39:38.9732131Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product 2024-06-26T05:39:38.9733654Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum 2024-06-26T05:39:38.9735125Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum 2024-06-26T05:39:38.9736579Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product 2024-06-26T05:39:38.9738024Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product 2024-06-26T05:39:38.9739452Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum 2024-06-26T05:39:38.9740803Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min 2024-06-26T05:39:38.9742191Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex 2024-06-26T05:39:38.9743621Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex 2024-06-26T05:39:38.9745019Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda 2024-06-26T05:39:38.9746489Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group 2024-06-26T05:39:38.9748173Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda 2024-06-26T05:39:38.9749725Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda 2024-06-26T05:39:38.9751199Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters 2024-06-26T05:39:38.9752746Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group 2024-06-26T05:39:38.9754115Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda 2024-06-26T05:39:38.9755508Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group 2024-06-26T05:39:38.9756939Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo 2024-06-26T05:39:38.9758425Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl 2024-06-26T05:39:38.9759974Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl 2024-06-26T05:39:38.9761460Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl 2024-06-26T05:39:38.9762891Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group 2024-06-26T05:39:38.9764496Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger 2024-06-26T05:39:38.9766334Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false 2024-06-26T05:39:38.9767929Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook 2024-06-26T05:39:38.9769509Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce 2024-06-26T05:39:38.9771024Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks 2024-06-26T05:39:38.9772582Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks 2024-06-26T05:39:38.9773970Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device 2024-06-26T05:39:38.9775402Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group 2024-06-26T05:39:38.9776941Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD 2024-06-26T05:39:38.9778387Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu 2024-06-26T05:39:38.9779862Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks 2024-06-26T05:39:38.9781413Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks 2024-06-26T05:39:38.9782956Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error 2024-06-26T05:39:38.9784480Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple 2024-06-26T05:39:38.9786045Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none 2024-06-26T05:39:38.9787883Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none 2024-06-26T05:39:38.9789503Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd 2024-06-26T05:39:38.9790960Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph 2024-06-26T05:39:38.9792549Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks 2024-06-26T05:39:38.9794032Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad 2024-06-26T05:39:38.9795535Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types 2024-06-26T05:39:38.9797061Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined 2024-06-26T05:39:38.9798634Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group 2024-06-26T05:39:38.9800139Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks 2024-06-26T05:39:38.9801489Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather 2024-06-26T05:39:38.9802747Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks 2024-06-26T05:39:38.9804060Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object 2024-06-26T05:39:38.9805514Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group 2024-06-26T05:39:38.9807071Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang 2024-06-26T05:39:38.9808577Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks 2024-06-26T05:39:38.9810054Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather 2024-06-26T05:39:38.9811497Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce 2024-06-26T05:39:38.9812932Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream 2024-06-26T05:39:38.9814473Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank 2024-06-26T05:39:38.9816135Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size 2024-06-26T05:39:38.9817722Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group 2024-06-26T05:39:38.9819243Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity 2024-06-26T05:39:38.9820791Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view 2024-06-26T05:39:38.9822621Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view 2024-06-26T05:39:38.9824242Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min 2024-06-26T05:39:38.9825643Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum 2024-06-26T05:39:38.9826993Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max 2024-06-26T05:39:38.9828292Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min 2024-06-26T05:39:38.9829659Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda 2024-06-26T05:39:38.9831076Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice 2024-06-26T05:39:38.9832528Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter 2024-06-26T05:39:38.9833811Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks 2024-06-26T05:39:38.9835141Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex 2024-06-26T05:39:38.9836481Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex 2024-06-26T05:39:38.9837863Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group 2024-06-26T05:39:38.9839236Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list 2024-06-26T05:39:38.9840563Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv 2024-06-26T05:39:38.9841967Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler 2024-06-26T05:39:38.9843513Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag 2024-06-26T05:39:38.9844963Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler 2024-06-26T05:39:38.9846514Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda 2024-06-26T05:39:38.9847953Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward 2024-06-26T05:39:38.9849479Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters 2024-06-26T05:39:38.9851045Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger 2024-06-26T05:39:38.9851901Z 2024-06-26T05:39:38.9852202Z Running distributed tests for the gloo backend with file init_method 2024-06-26T05:39:38.9854308Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:39:38.963533] 2024-06-26T05:48:20.9883457Z 2024-06-26T05:48:20.9886672Z distributed/test_distributed_spawn 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_3.3_b9b3f3c4575b73e1_.log 2024-06-26T05:48:20.9950259Z Running 91 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger 2024-06-26T05:48:21.0005657Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallelCPU_grad_is_view 2024-06-26T05:48:21.0007425Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Diff_Input_Sizes_gradient 2024-06-26T05:48:21.0009183Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_non_default_stream 2024-06-26T05:48:21.0010913Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_with_amp_and_grad_is_view 2024-06-26T05:48:21.0012411Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather 2024-06-26T05:48:21.0013956Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_complex 2024-06-26T05:48:21.0015431Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_group 2024-06-26T05:48:21.0016860Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_full_group 2024-06-26T05:48:21.0018229Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_group 2024-06-26T05:48:21.0019643Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_into_stack_tensor_cuda 2024-06-26T05:48:21.0021188Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_product 2024-06-26T05:48:21.0022709Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_group_sum 2024-06-26T05:48:21.0024187Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_sum 2024-06-26T05:48:21.0025637Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_product 2024-06-26T05:48:21.0027095Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_product 2024-06-26T05:48:21.0028526Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_sum 2024-06-26T05:48:21.0029971Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_min 2024-06-26T05:48:21.0031361Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda_complex 2024-06-26T05:48:21.0032966Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda_complex 2024-06-26T05:48:21.0034480Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_group_cuda 2024-06-26T05:48:21.0035941Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group 2024-06-26T05:48:21.0037494Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_group_cuda 2024-06-26T05:48:21.0039073Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda 2024-06-26T05:48:21.0040533Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_average_parameters 2024-06-26T05:48:21.0041908Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_full_group 2024-06-26T05:48:21.0043340Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group_cuda 2024-06-26T05:48:21.0044824Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_full_group 2024-06-26T05:48:21.0046262Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_gloo 2024-06-26T05:48:21.0047743Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_no_rank_zero_nccl 2024-06-26T05:48:21.0049296Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_ring_exchange_nccl 2024-06-26T05:48:21.0050797Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_self_nccl 2024-06-26T05:48:21.0052379Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_full_group 2024-06-26T05:48:21.0053974Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_compute_bucket_assignment_by_size_sparse_error_without_logger 2024-06-26T05:48:21.0055761Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_grad_as_bucket_view_false 2024-06-26T05:48:21.0057370Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer_via_hook 2024-06-26T05:48:21.0058823Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce 2024-06-26T05:48:21.0060322Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_different_across_ranks 2024-06-26T05:48:21.0061888Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_control_flow_same_across_ranks 2024-06-26T05:48:21.0063286Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device 2024-06-26T05:48:21.0064724Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce_process_group 2024-06-26T05:48:21.0066256Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_post_localSGD 2024-06-26T05:48:21.0067793Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_logging_data_gpu 2024-06-26T05:48:21.0069280Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_num_params_across_ranks 2024-06-26T05:48:21.0070838Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_model_diff_shape_across_ranks 2024-06-26T05:48:21.0072524Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_error 2024-06-26T05:48:21.0073983Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_namedtuple 2024-06-26T05:48:21.0075557Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_set_grad_to_none 2024-06-26T05:48:21.0077400Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_no_set_grad_none 2024-06-26T05:48:21.0079006Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd 2024-06-26T05:48:21.0080481Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_new_tensor_in_fwd_static_graph 2024-06-26T05:48:21.0081967Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_remove_autograd_hooks 2024-06-26T05:48:21.0083442Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_returns_tensor_with_no_grad 2024-06-26T05:48:21.0085051Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_static_graph_nested_types 2024-06-26T05:48:21.0086603Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_grad_undefined 2024-06-26T05:48:21.0088165Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_update_process_group_new_group 2024-06-26T05:48:21.0089773Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_different_graph_across_ranks 2024-06-26T05:48:21.0091122Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather 2024-06-26T05:48:21.0092443Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_checks 2024-06-26T05:48:21.0093757Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object 2024-06-26T05:48:21.0095104Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_group 2024-06-26T05:48:21.0096539Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang 2024-06-26T05:48:21.0098058Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_wait_all_ranks 2024-06-26T05:48:21.0099546Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_allgather 2024-06-26T05:48:21.0100976Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_reduce 2024-06-26T05:48:21.0102426Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_high_priority_stream 2024-06-26T05:48:21.0104077Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_negative_input_rank 2024-06-26T05:48:21.0105723Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_group_size_exceeds_world_size 2024-06-26T05:48:21.0107302Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager_param_group 2024-06-26T05:48:21.0108827Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity 2024-06-26T05:48:21.0110397Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_grad_is_view 2024-06-26T05:48:21.0112301Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd_grad_is_view 2024-06-26T05:48:21.0113920Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_min 2024-06-26T05:48:21.0115311Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_sum 2024-06-26T05:48:21.0116683Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_max 2024-06-26T05:48:21.0117993Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_min 2024-06-26T05:48:21.0119335Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_tensor_cuda 2024-06-26T05:48:21.0120755Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_cuda_twice 2024-06-26T05:48:21.0122077Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter 2024-06-26T05:48:21.0123362Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_checks 2024-06-26T05:48:21.0124672Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_complex 2024-06-26T05:48:21.0126200Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_cuda_complex 2024-06-26T05:48:21.0127602Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_full_group 2024-06-26T05:48:21.0128968Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_object_list 2024-06-26T05:48:21.0130278Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv 2024-06-26T05:48:21.0131702Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_autograd_profiler 2024-06-26T05:48:21.0133170Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag 2024-06-26T05:48:21.0134593Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_with_tag_torch_profiler 2024-06-26T05:48:21.0136093Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum_cuda 2024-06-26T05:48:21.0137542Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_static_graph_multi_forward 2024-06-26T05:48:21.0139065Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_undefined_grad_parity_unused_parameters 2024-06-26T05:48:21.0140616Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_verify_model_across_rank_with_logger 2024-06-26T05:48:21.0141559Z 2024-06-26T05:48:21.0142032Z Running distributed/test_c10d_logger 1/1 ... [2024-06-26 05:48:20.992552] 2024-06-26T05:48:21.0144016Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_logger.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:20.992925] 2024-06-26T05:48:32.1317293Z 2024-06-26T05:48:32.1319382Z distributed/test_c10d_logger 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_logger_1.1_75ebcdf0ca2605bd_.log 2024-06-26T05:48:32.1322189Z Running 3 items in this shard: test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_exception_logger, test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_get_or_create_logger, test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_time_logger 2024-06-26T05:48:32.1324328Z 2024-06-26T05:48:32.1324879Z Running distributed/checkpoint/test_checkpoint 1/1 ... [2024-06-26 05:48:32.132159] 2024-06-26T05:48:32.1329290Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:32.132577] 2024-06-26T05:48:40.7686382Z 2024-06-26T05:48:40.7688161Z distributed/checkpoint/test_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_checkpoint_1.1_53befa5d1fa2d6e1_.log 2024-06-26T05:48:40.7694933Z Running 8 items in this shard: test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_default_metadata, test/distributed/checkpoint/test_checkpoint.py::TestDistributedCheckpointing::test_tensor_metadata_with_missing_rank_spec, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_reader_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_dummy_writer_works, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_load_error_handling_no_dist, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling, test/distributed/checkpoint/test_checkpoint.py::TestDistributedFailure::test_save_error_handling_no_dist 2024-06-26T05:48:40.7700126Z 2024-06-26T05:48:40.7700661Z Running distributed/checkpoint/test_file_system_checkpoint 1/1 ... [2024-06-26 05:48:40.769101] 2024-06-26T05:48:40.7702843Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_file_system_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:40.769577] 2024-06-26T05:48:43.7434191Z 2024-06-26T05:48:43.7436052Z distributed/checkpoint/test_file_system_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_file_system_checkpoint_1.1_4493f5b2c40e4d17_.log 2024-06-26T05:48:43.7442078Z Running 6 items in this shard: test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedStateDictSaveLoad::test_read_write_only_tensor, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedStateDictSaveLoadWithSharedTensor::test_read_write_shard_tensor, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_load_rowwise_to_colwise, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_load_with_different_shard_plan, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_save_load_bytes, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_switch_between_sharded_tensor_to_tensor 2024-06-26T05:48:43.7447278Z 2024-06-26T05:48:43.7447830Z Running distributed/optim/test_apply_optimizer_in_backward 1/1 ... [2024-06-26 05:48:43.743882] 2024-06-26T05:48:43.7449982Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/optim/test_apply_optimizer_in_backward.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:43.744324] 2024-06-26T05:48:46.3308619Z 2024-06-26T05:48:46.3310679Z distributed/optim/test_apply_optimizer_in_backward 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_apply_optimizer_in_backward_1.1_f20d65f5f128f8ec_.log 2024-06-26T05:48:46.3312160Z 2024-06-26T05:48:46.3315556Z Running distributed/algorithms/ddp_comm_hooks/test_ddp_hooks 1/1 ... [2024-06-26 05:48:46.331311] 2024-06-26T05:48:46.3320918Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:46.331748] 2024-06-26T05:48:48.9552758Z 2024-06-26T05:48:48.9554547Z distributed/algorithms/ddp_comm_hooks/test_ddp_hooks 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks_1.1_31324597c81e5fc8_.log 2024-06-26T05:48:48.9560844Z Running 6 items in this shard: test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_allreduce_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_fp16compress_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_noop_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_quantize_per_channel_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_ddp_comm_hook_quantize_per_tensor_hook, test/distributed/algorithms/ddp_comm_hooks/test_ddp_hooks.py::DistributedDataParallelCommHookTest::test_is_last_hook 2024-06-26T05:48:48.9565898Z 2024-06-26T05:48:48.9566355Z Running distributed/test_control_collectives 1/1 ... [2024-06-26 05:48:48.955708] 2024-06-26T05:48:48.9568340Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_control_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:48.956137] 2024-06-26T05:48:51.9298496Z 2024-06-26T05:48:51.9300452Z distributed/test_control_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_control_collectives_1.1_aeebcc5dc6636cfb_.log 2024-06-26T05:48:51.9308054Z Running 13 items in this shard: test/distributed/test_control_collectives.py::TestCollectives::test_all_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_barrier, test/distributed/test_control_collectives.py::TestCollectives::test_barrier_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_gather, test/distributed/test_control_collectives.py::TestCollectives::test_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_scatter, test/distributed/test_control_collectives.py::TestCollectives::test_scatter_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_simple_user_func, test/distributed/test_control_collectives.py::TestCollectives::test_unique 2024-06-26T05:48:51.9314578Z 2024-06-26T05:48:51.9315160Z Running distributed/algorithms/quantization/test_quantization 1/1 ... [2024-06-26 05:48:51.930243] 2024-06-26T05:48:51.9363242Z MPI not available -- MPI backend tests will be skipped 2024-06-26T05:48:51.9364496Z Running distributed tests for the test backend with env init_method 2024-06-26T05:48:51.9373329Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:51.936948] 2024-06-26T05:48:54.5367173Z 2024-06-26T05:48:54.5369237Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_c9ad47246c1e841f_.log 2024-06-26T05:48:54.5370742Z Running 0 items in this shard: 2024-06-26T05:48:54.5370993Z 2024-06-26T05:48:54.5376316Z Running distributed tests for the test backend with file init_method 2024-06-26T05:48:54.5382754Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:54.537966] 2024-06-26T05:48:57.0907913Z 2024-06-26T05:48:57.0910085Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_832de4a822933bc8_.log 2024-06-26T05:48:57.0911605Z Running 0 items in this shard: 2024-06-26T05:48:57.0912039Z 2024-06-26T05:48:57.0916274Z Running distributed tests for the gloo backend with env init_method 2024-06-26T05:48:57.0922704Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:48:57.091914] 2024-06-26T05:49:21.4422922Z 2024-06-26T05:49:21.4425122Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_c900023f5fc1fc2d_.log 2024-06-26T05:49:21.4437277Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-06-26T05:49:21.4445253Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16 2024-06-26T05:49:21.4447650Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16 2024-06-26T05:49:21.4449913Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16 2024-06-26T05:49:21.4452742Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16 2024-06-26T05:49:21.4455116Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16 2024-06-26T05:49:21.4457482Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-06-26T05:49:21.4458900Z 2024-06-26T05:49:21.4459386Z Running distributed tests for the gloo backend with file init_method 2024-06-26T05:49:21.4462891Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:49:21.443955] 2024-06-26T05:49:45.9790029Z 2024-06-26T05:49:45.9792521Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_678979686cec553d_.log 2024-06-26T05:49:45.9807735Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-06-26T05:49:45.9812830Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16 2024-06-26T05:49:45.9814432Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16 2024-06-26T05:49:45.9816009Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16 2024-06-26T05:49:45.9817823Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16 2024-06-26T05:49:45.9819447Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16 2024-06-26T05:49:45.9821089Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-06-26T05:49:45.9821992Z 2024-06-26T05:49:45.9822440Z Running distributed/test_c10d_pypg 1/1 ... [2024-06-26 05:49:45.980654] 2024-06-26T05:49:45.9824314Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_pypg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:49:45.981039] 2024-06-26T05:51:36.7307818Z 2024-06-26T05:51:36.7311217Z distributed/test_c10d_pypg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_pypg_1.1_c1e1d3e4b0fe5d5c_.log 2024-06-26T05:51:36.7337106Z Running 42 items in this shard: test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_dataclass_output, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_dataclass_output_unused_param, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_invoke_work_object, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_with_pypg, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_ddp_with_pypg_with_grad_views, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_invalid_powerSGD_state, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_sync_batch_norm_empty_input, test/distributed/test_c10d_pypg.py::TestDDPWithWorkSubclass::test_sync_batch_norm_only_empty_input, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_dataclass_output, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_dataclass_output_unused_param, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_invoke_work_object, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_with_pypg, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_ddp_with_pypg_with_grad_views, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_invalid_powerSGD_state, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_sync_batch_norm_empty_input, test/distributed/test_c10d_pypg.py::TestDDPWithWorkWrapper::test_sync_batch_norm_only_empty_input 2024-06-26T05:51:36.7361388Z 2024-06-26T05:51:36.7361869Z Running distributed/fsdp/test_fsdp_grad_acc 1/1 ... [2024-06-26 05:51:36.731420] 2024-06-26T05:51:36.7363868Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_grad_acc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:51:36.731886] 2024-06-26T05:51:55.7305644Z 2024-06-26T05:51:55.7308288Z distributed/fsdp/test_fsdp_grad_acc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_grad_acc_1.1_3def4833bb37c717_.log 2024-06-26T05:51:55.7316426Z Running 6 items in this shard: test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs0_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs0_use_orig_params_True, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs1_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs1_use_orig_params_True, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_cpu_offload_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_cpu_offload_use_orig_params_True 2024-06-26T05:51:55.7322462Z 2024-06-26T05:51:55.7323179Z Running distributed/fsdp/test_fsdp_clip_grad_norm 1/1 ... [2024-06-26 05:51:55.731227] 2024-06-26T05:51:55.7326124Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_clip_grad_norm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:51:55.731809] 2024-06-26T05:52:09.9299882Z 2024-06-26T05:52:09.9301677Z distributed/fsdp/test_fsdp_clip_grad_norm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_clip_grad_norm_1.1_596c0b1ddb8dd58a_.log 2024-06-26T05:52:09.9304976Z Running 4 items in this shard: test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_ddp_parity, test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_low_precision_grads, test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_no_gradients, test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_non_root 2024-06-26T05:52:09.9307336Z 2024-06-26T05:52:09.9308065Z Running distributed/fsdp/test_fsdp_exec_order 1/1 ... [2024-06-26 05:52:09.930418] 2024-06-26T05:52:09.9312112Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_exec_order.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:52:09.930865] 2024-06-26T05:52:35.9605335Z 2024-06-26T05:52:35.9607578Z distributed/fsdp/test_fsdp_exec_order 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_62e5e95b8693cb81_.log 2024-06-26T05:52:35.9614832Z Running 8 items in this shard: test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy1 2024-06-26T05:52:35.9621040Z 2024-06-26T05:52:35.9621483Z Running distributed/test_multi_threaded_pg 1/1 ... [2024-06-26 05:52:35.961018] 2024-06-26T05:52:35.9623464Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_multi_threaded_pg.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:52:35.961487] 2024-06-26T05:52:39.0866331Z 2024-06-26T05:52:39.0868406Z distributed/test_multi_threaded_pg 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_multi_threaded_pg_1.1_d6f380da57b3eb91_.log 2024-06-26T05:52:39.0882861Z Running 22 items in this shard: test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_none, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_all_to_all_single_tensor, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_non_zero_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_collective_error_on_rank_zero, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithWrapper::test_skip, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_coalesced, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_reduce_ops, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_all_to_all, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_allgather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_assert_equal_on_rank, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_broadcast_object_list, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_bwd_sees_fwd_pg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_gather, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_reduce_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_scatter, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_subpg, test/distributed/test_multi_threaded_pg.py::TestCollectivesWithBaseClass::test_using_pg_from_another_thread 2024-06-26T05:52:39.0895268Z 2024-06-26T05:52:39.0895731Z Running distributed/fsdp/test_fsdp_core 1/1 ... [2024-06-26 05:52:39.087094] 2024-06-26T05:52:39.0897690Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_core.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:52:39.087622] 2024-06-26T05:55:31.6399499Z 2024-06-26T05:55:31.6401388Z distributed/fsdp/test_fsdp_core 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_core_1.1_1627dd254a9382db_.log 2024-06-26T05:55:31.6441239Z Running 60 items in this shard: test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParamInit::test_param_change_after_init_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestParamInit::test_param_change_after_init_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_after_state_dict, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_cuda_first_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_cuda_first_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestNoGrad::test_transformer_no_grad_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestNoGrad::test_transformer_no_grad_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestAutograd::test_unshard_params_as_tensors 2024-06-26T05:55:31.6478109Z 2024-06-26T05:55:31.6478723Z Running distributed/test_data_parallel 1/1 ... [2024-06-26 05:55:31.640699] 2024-06-26T05:55:31.6480654Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_data_parallel.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:55:31.641116] 2024-06-26T05:55:34.7652334Z 2024-06-26T05:55:34.7654995Z distributed/test_data_parallel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_data_parallel_1.1_9226ba750bdb418b_.log 2024-06-26T05:55:34.7696287Z Running 46 items in this shard: test/distributed/test_data_parallel.py::TestDataParallel::test_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_buffers_requiring_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_complex, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_device_args, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_function_deletion, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_lazy_linear, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_device, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_model_no_refcycles, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_module_zero_inputs, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_multiple_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_input, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_nested_output, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_no_grad, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_rnn, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_small_back, test/distributed/test_data_parallel.py::TestDataParallel::test_data_parallel_sparse, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_different_len_dicts, test/distributed/test_data_parallel.py::TestDataParallel::test_gather_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_autocast, test/distributed/test_data_parallel.py::TestDataParallel::test_parallel_apply_passes_exception, test/distributed/test_data_parallel.py::TestDataParallel::test_parameter_list_dict_replica, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate, test/distributed/test_data_parallel.py::TestDataParallel::test_replicate_buffers, test/distributed/test_data_parallel.py::TestDataParallel::test_save_replica_module, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_cpu, test/distributed/test_data_parallel.py::TestDataParallel::test_scatter_gpu, test/distributed/test_data_parallel.py::TestDataParallel::test_strided_grad_layout, test/distributed/test_data_parallel.py::TestDataParallel::test_zero_grad, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_dict_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_list_cpu_float64, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float16, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float32, test/distributed/test_data_parallel.py::TestDataParallelDeviceTypeCPU::test_data_parallel_module_kwargs_only_empty_tuple_cpu_float64 2024-06-26T05:55:34.7723651Z 2024-06-26T05:55:34.7724257Z Running distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 ... [2024-06-26 05:55:34.765950] 2024-06-26T05:55:34.7726433Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_hsdp_dtensor_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:55:34.766501] 2024-06-26T05:55:59.9382651Z 2024-06-26T05:55:59.9385688Z distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_hsdp_dtensor_state_dict_1.1_4a59bf002087a1f2_.log 2024-06-26T05:55:59.9394238Z Running 8 items in this shard: test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_False, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_True, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_False, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_True, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_False, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_True, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_hsdp_init_with_device_mesh, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_root_module_is_not_FSDP 2024-06-26T05:55:59.9401005Z 2024-06-26T05:55:59.9401555Z Running distributed/_shard/sharding_plan/test_sharding_plan 1/1 ... [2024-06-26 05:55:59.938772] 2024-06-26T05:55:59.9403714Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/sharding_plan/test_sharding_plan.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:55:59.939275] 2024-06-26T05:56:02.5628153Z 2024-06-26T05:56:02.5631831Z distributed/_shard/sharding_plan/test_sharding_plan 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharding_plan.test_sharding_plan_1.1_26f04bafb36fe8ba_.log 2024-06-26T05:56:02.5635379Z Running 3 items in this shard: test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_custom_sharding_planner, test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_shard_module_sub_process_group, test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_sharding_plan_errors 2024-06-26T05:56:02.5637396Z 2024-06-26T05:56:02.5637900Z Running distributed/fsdp/test_fsdp_misc 1/1 ... [2024-06-26 05:56:02.563273] 2024-06-26T05:56:02.5640424Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_misc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:56:02.563722] 2024-06-26T05:56:44.3044030Z 2024-06-26T05:56:44.3046305Z distributed/fsdp/test_fsdp_misc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_misc_1.1_d9d5868748d8e9d0_.log 2024-06-26T05:56:44.3069784Z Running 28 items in this shard: test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_cpu_init_with_sync_module_states, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_cpu_init_stays_on_cpu, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_cpu_training, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_device_id_use_index_False, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_device_id_use_index_True, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_False_sharding_strategy0, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_False_sharding_strategy1, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_True_sharding_strategy0, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_module_no_compute_grad_use_second_layer_True_sharding_strategy1, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_not_all_outputs_used_in_loss, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_optim_overlap_no_use_orig_params_error, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_optimizer_overlap, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiProcess::test_fsdp_zero2_eval_with_prefetch, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_cpu_gpu_module, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_device_id_auto_wrap, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_device_id_cpu_offload, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_device_id_no_move_ignored_params_and_bufs, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_ignored_module_meta, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_namedtuple, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_same_model_across_ranks, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_fsdp_unsupported_module_cls, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_homogeneous_attributes, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_module_device_mismatches_device_id, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_multigpu_module, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscMultiThread::test_no_params, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_training_device_mismatch_errors, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_unsafe_setattr, test/distributed/fsdp/test_fsdp_misc.py::TestFSDPMiscWorldSize1::test_world_size_1_sharding_strategy_warning 2024-06-26T05:56:44.3086622Z 2024-06-26T05:56:44.3087140Z Running distributed/fsdp/test_fsdp_hybrid_shard 1/1 ... [2024-06-26 05:56:44.304903] 2024-06-26T05:56:44.3089301Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_hybrid_shard.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:56:44.305356] 2024-06-26T05:57:03.4062647Z 2024-06-26T05:57:03.4064846Z distributed/fsdp/test_fsdp_hybrid_shard 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_27868875489104a0_.log 2024-06-26T05:57:03.4069856Z Running 6 items in this shard: test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_basic_setup, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_parity, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_save_load_state_dict, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_sync_module_state, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_invalid_pg_specification_raises, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_raises_manual_wrap_hybrid_shard_when_none_policy 2024-06-26T05:57:03.4073777Z 2024-06-26T05:57:03.4074170Z Running distributed/fsdp/test_utils 1/1 ... [2024-06-26 05:57:03.406697] 2024-06-26T05:57:03.4076065Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:57:03.407204] 2024-06-26T05:57:06.4333288Z 2024-06-26T05:57:06.4335010Z distributed/fsdp/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_utils_1.1_1d7a34f850993ada_.log 2024-06-26T05:57:06.4338204Z Running 5 items in this shard: test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_cpu_cuda, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices0, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices1, test/distributed/fsdp/test_utils.py::TestUtils::test_packed_sequence, test/distributed/fsdp/test_utils.py::TestUtils::test_replace_by_prefix 2024-06-26T05:57:06.4340537Z 2024-06-26T05:57:06.4340983Z Running distributed/rpc/test_tensorpipe_agent 1/3 ... [2024-06-26 05:57:06.433763] 2024-06-26T05:57:06.4345064Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 05:57:06.434206] 2024-06-26T06:14:39.1639299Z 2024-06-26T06:14:39.1641566Z distributed/rpc/test_tensorpipe_agent 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_1.3_ebbbb2f7b58aade8_.log 2024-06-26T06:14:39.1827777Z Running 153 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_with_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_chain, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_in_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_custom_exception_throw_during_reconstruction, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_deadlock, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_nested_callback, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown_with_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_my_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_key_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_constructor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_same_worker, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_partial_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_non_exist, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc_torchscript, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_script_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_body, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wrong_types, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_no_grad_on_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backwards_nested_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_clean_context_during_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_error_in_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_copy_sparse_indices_extra_ref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_backward_accumulate_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_post_hooks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception_on_constructor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_all_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_kwargs_are_neither_passed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_kwargs_not_passed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_more_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_module_rref_in_py_and_use_in_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_some_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_bad_module, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_unsupported_methods, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeReinforcementLearningRpcTest::test_rl_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_mismatched_type_for_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_builtin_remote_ret_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_world_size_one_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_nested_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-06-26T06:14:39.1989275Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add 2024-06-26T06:14:39.1991863Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_with_id 2024-06-26T06:14:39.1994224Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather 2024-06-26T06:14:39.1996574Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout 2024-06-26T06:14:39.1999028Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method 2024-06-26T06:14:39.2001616Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote 2024-06-26T06:14:39.2004146Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy 2024-06-26T06:14:39.2006801Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained 2024-06-26T06:14:39.2009391Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async 2024-06-26T06:14:39.2012320Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote 2024-06-26T06:14:39.2014986Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout 2024-06-26T06:14:39.2018034Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_async 2024-06-26T06:14:39.2020707Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested 2024-06-26T06:14:39.2023326Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote 2024-06-26T06:14:39.2025950Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise 2024-06-26T06:14:39.2028592Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote 2024-06-26T06:14:39.2031230Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_simple 2024-06-26T06:14:39.2034026Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor 2024-06-26T06:14:39.2036823Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type 2024-06-26T06:14:39.2039623Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks 2024-06-26T06:14:39.2042292Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method 2024-06-26T06:14:39.2044745Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self 2024-06-26T06:14:39.2047493Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_chain 2024-06-26T06:14:39.2049838Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_in_rpc 2024-06-26T06:14:39.2052361Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num 2024-06-26T06:14:39.2054813Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options 2024-06-26T06:14:39.2057684Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_custom_exception_throw_during_reconstruction 2024-06-26T06:14:39.2060203Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_deadlock 2024-06-26T06:14:39.2062530Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_debug_info 2024-06-26T06:14:39.2064950Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src 2024-06-26T06:14:39.2067370Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_nested_callback 2024-06-26T06:14:39.2069833Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc 2024-06-26T06:14:39.2072621Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown_with_rpc 2024-06-26T06:14:39.2074137Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner 2024-06-26T06:14:39.2075487Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice 2024-06-26T06:14:39.2076777Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc 2024-06-26T06:14:39.2078062Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_my_parameter_server 2024-06-26T06:14:39.2079348Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc 2024-06-26T06:14:39.2080765Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs 2024-06-26T06:14:39.2082081Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init 2024-06-26T06:14:39.2083427Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_key_names 2024-06-26T06:14:39.2084775Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory 2024-06-26T06:14:39.2086320Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded 2024-06-26T06:14:39.2087944Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin_single_threaded 2024-06-26T06:14:39.2089549Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc_single_threaded 2024-06-26T06:14:39.2091054Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf 2024-06-26T06:14:39.2092532Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded 2024-06-26T06:14:39.2093983Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_constructor 2024-06-26T06:14:39.2095395Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method 2024-06-26T06:14:39.2096714Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception 2024-06-26T06:14:39.2098036Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result 2024-06-26T06:14:39.2099386Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func 2024-06-26T06:14:39.2100804Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str 2024-06-26T06:14:39.2102213Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container 2024-06-26T06:14:39.2103562Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_same_worker 2024-06-26T06:14:39.2104846Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw 2024-06-26T06:14:39.2106145Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception 2024-06-26T06:14:39.2107474Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs 2024-06-26T06:14:39.2108840Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded 2024-06-26T06:14:39.2110245Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_partial_subset 2024-06-26T06:14:39.2111627Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset 2024-06-26T06:14:39.2113176Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function 2024-06-26T06:14:39.2114658Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_non_exist 2024-06-26T06:14:39.2115987Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse 2024-06-26T06:14:39.2117411Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self 2024-06-26T06:14:39.2118800Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported 2024-06-26T06:14:39.2120153Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout 2024-06-26T06:14:39.2121444Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking 2024-06-26T06:14:39.2122761Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_non_blocking 2024-06-26T06:14:39.2124159Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking 2024-06-26T06:14:39.2125693Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_non_blocking 2024-06-26T06:14:39.2127102Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_py_udf_remote 2024-06-26T06:14:39.2128485Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg 2024-06-26T06:14:39.2129860Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc 2024-06-26T06:14:39.2131224Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc_torchscript 2024-06-26T06:14:39.2132675Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc 2024-06-26T06:14:39.2133967Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward 2024-06-26T06:14:39.2135293Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed 2024-06-26T06:14:39.2136674Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed_remote 2024-06-26T06:14:39.2138089Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_builtin 2024-06-26T06:14:39.2139519Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_script_function 2024-06-26T06:14:39.2140952Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call 2024-06-26T06:14:39.2142327Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_body 2024-06-26T06:14:39.2143635Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout 2024-06-26T06:14:39.2144915Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wrong_types 2024-06-26T06:14:39.2146258Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd 2024-06-26T06:14:39.2147727Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_invalid_args 2024-06-26T06:14:39.2149229Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_no_grad_on_tensor 2024-06-26T06:14:39.2150691Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref 2024-06-26T06:14:39.2152197Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple 2024-06-26T06:14:39.2153855Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_python_udf 2024-06-26T06:14:39.2155471Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_context 2024-06-26T06:14:39.2156963Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc 2024-06-26T06:14:39.2158466Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backwards_nested_python_udf 2024-06-26T06:14:39.2160021Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_clean_context_during_backward 2024-06-26T06:14:39.2161474Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info 2024-06-26T06:14:39.2162868Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_error_in_context 2024-06-26T06:14:39.2164394Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_copy_sparse_indices_extra_ref 2024-06-26T06:14:39.2166055Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value 2024-06-26T06:14:39.2167578Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_remote_call 2024-06-26T06:14:39.2169153Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself 2024-06-26T06:14:39.2170790Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward 2024-06-26T06:14:39.2172324Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_backward_accumulate_grads 2024-06-26T06:14:39.2173788Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_post_hooks 2024-06-26T06:14:39.2175157Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim 2024-06-26T06:14:39.2176584Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception 2024-06-26T06:14:39.2178138Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception_on_constructor 2024-06-26T06:14:39.2179865Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_all_kwargs_are_populated_by_defaults 2024-06-26T06:14:39.2181381Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_kwargs_are_neither_passed 2024-06-26T06:14:39.2182832Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_simple 2024-06-26T06:14:39.2184273Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type 2024-06-26T06:14:39.2185707Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw 2024-06-26T06:14:39.2187052Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf 2024-06-26T06:14:39.2188391Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_simple 2024-06-26T06:14:39.2189755Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_with_exception 2024-06-26T06:14:39.2191144Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_kwargs_not_passed 2024-06-26T06:14:39.2192783Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified 2024-06-26T06:14:39.2194328Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_more_than_needed_args_are_specified 2024-06-26T06:14:39.2195851Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults 2024-06-26T06:14:39.2197296Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf 2024-06-26T06:14:39.2198865Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_module_rref_in_py_and_use_in_script 2024-06-26T06:14:39.2200485Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function 2024-06-26T06:14:39.2201873Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner 2024-06-26T06:14:39.2203269Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported 2024-06-26T06:14:39.2204796Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_some_kwargs_are_populated_by_defaults 2024-06-26T06:14:39.2206350Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function 2024-06-26T06:14:39.2207865Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception 2024-06-26T06:14:39.2209308Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed 2024-06-26T06:14:39.2210687Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_bad_module 2024-06-26T06:14:39.2212045Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync 2024-06-26T06:14:39.2213561Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported 2024-06-26T06:14:39.2215115Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_unsupported_methods 2024-06-26T06:14:39.2216647Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside 2024-06-26T06:14:39.2218303Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs 2024-06-26T06:14:39.2219966Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads 2024-06-26T06:14:39.2221507Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeReinforcementLearningRpcTest::test_rl_rpc 2024-06-26T06:14:39.2223225Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda 2024-06-26T06:14:39.2225145Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank 2024-06-26T06:14:39.2226937Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_mismatched_type_for_options 2024-06-26T06:14:39.2228586Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_builtin_remote_ret_sparse 2024-06-26T06:14:39.2230232Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_rpc_sparse 2024-06-26T06:14:39.2231863Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse 2024-06-26T06:14:39.2233455Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse 2024-06-26T06:14:39.2235126Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_non_blocking 2024-06-26T06:14:39.2236769Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse 2024-06-26T06:14:39.2238337Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_world_size_one_sparse 2024-06-26T06:14:39.2239960Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse 2024-06-26T06:14:39.2241701Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_nested_rpc_sparse 2024-06-26T06:14:39.2243539Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse 2024-06-26T06:14:39.2245495Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse 2024-06-26T06:14:39.2247468Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse 2024-06-26T06:14:39.2249372Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote_sparse 2024-06-26T06:14:39.2251236Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-06-26T06:14:39.2252171Z 2024-06-26T06:14:39.2252707Z Running distributed/rpc/test_tensorpipe_agent 3/3 ... [2024-06-26 06:14:39.173675] 2024-06-26T06:14:39.2254785Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:14:39.174243] 2024-06-26T06:34:00.4984099Z 2024-06-26T06:34:00.4985707Z distributed/rpc/test_tensorpipe_agent 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_3.3_4b7ee916f99152ad_.log 2024-06-26T06:34:00.5145454Z Running 167 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_done_callback, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_cbs_jit_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_call_method_on_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_disable_gil_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_ignore_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_then_pg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_rref_no_fork, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_layer_nested_async_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nonzero, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args_user_share, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_register_rpc_backend_and_set_and_start_rpc_backend, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_remote_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_return_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_accumulate_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_autograd_engine_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_dtypes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_roots, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_python_udf_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_verify_hooks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_no_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_mixed_requires_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_thread_local_context_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_rpc_with_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_class_rref_in_py, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_module_rref_in_py, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_python_annotation, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_my_script_module_with_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_class_rref_in_py_and_use_in_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_python_annotation, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_self_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_remote_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_send_to_rank_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_stress_heavy_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_options_throw_on_timedelta_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_twice_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_different_dtypes_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backwards_nested_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_embedding_bag_with_no_grad_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_remote_complex_args_sparse 2024-06-26T06:34:00.5243120Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_done_callback 2024-06-26T06:34:00.5244413Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add 2024-06-26T06:34:00.5245823Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_async 2024-06-26T06:34:00.5247272Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote 2024-06-26T06:34:00.5248710Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained 2024-06-26T06:34:00.5250179Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote 2024-06-26T06:34:00.5251688Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote 2024-06-26T06:34:00.5253216Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async 2024-06-26T06:34:00.5254728Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_cbs_jit_call 2024-06-26T06:34:00.5256166Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy 2024-06-26T06:34:00.5257745Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote 2024-06-26T06:34:00.5259112Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_ret 2024-06-26T06:34:00.5260449Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_call_method_on_rref 2024-06-26T06:34:00.5261766Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_error 2024-06-26T06:34:00.5263088Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_ret 2024-06-26T06:34:00.5264424Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type 2024-06-26T06:34:00.5265779Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used 2024-06-26T06:34:00.5267109Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_disable_gil_profiling 2024-06-26T06:34:00.5268417Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name 2024-06-26T06:34:00.5269840Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload 2024-06-26T06:34:00.5271281Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions 2024-06-26T06:34:00.5272797Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_ignore_rref_leak 2024-06-26T06:34:00.5274105Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_then_pg 2024-06-26T06:34:00.5275390Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names 2024-06-26T06:34:00.5276667Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_rref_no_fork 2024-06-26T06:34:00.5277964Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown 2024-06-26T06:34:00.5279435Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_layer_nested_async_rpc 2024-06-26T06:34:00.5280816Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_py_udf_remote 2024-06-26T06:34:00.5282084Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref 2024-06-26T06:34:00.5283362Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress 2024-06-26T06:34:00.5284670Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors 2024-06-26T06:34:00.5285986Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nonzero 2024-06-26T06:34:00.5287213Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality 2024-06-26T06:34:00.5288488Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future 2024-06-26T06:34:00.5289927Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace 2024-06-26T06:34:00.5291312Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled 2024-06-26T06:34:00.5292852Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled_single_threaded 2024-06-26T06:34:00.5294477Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes 2024-06-26T06:34:00.5295920Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin 2024-06-26T06:34:00.5297350Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf 2024-06-26T06:34:00.5298854Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded 2024-06-26T06:34:00.5300378Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context 2024-06-26T06:34:00.5301821Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin 2024-06-26T06:34:00.5303306Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf_single_threaded 2024-06-26T06:34:00.5304891Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc_single_threaded 2024-06-26T06:34:00.5306427Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc 2024-06-26T06:34:00.5307938Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded 2024-06-26T06:34:00.5309343Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in 2024-06-26T06:34:00.5310650Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_static_method 2024-06-26T06:34:00.5312094Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args 2024-06-26T06:34:00.5313415Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args_user_share 2024-06-26T06:34:00.5314703Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors 2024-06-26T06:34:00.5316143Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call 2024-06-26T06:34:00.5317483Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_udf_remote 2024-06-26T06:34:00.5318752Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined 2024-06-26T06:34:00.5320219Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_register_rpc_backend_and_set_and_start_rpc_backend 2024-06-26T06:34:00.5321680Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future 2024-06-26T06:34:00.5322974Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async 2024-06-26T06:34:00.5324294Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote 2024-06-26T06:34:00.5325674Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all 2024-06-26T06:34:00.5327124Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded 2024-06-26T06:34:00.5328730Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_remote_record_function 2024-06-26T06:34:00.5330226Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_return_rref 2024-06-26T06:34:00.5331501Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts 2024-06-26T06:34:00.5332741Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak 2024-06-26T06:34:00.5334006Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class 2024-06-26T06:34:00.5335309Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self 2024-06-26T06:34:00.5336625Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor 2024-06-26T06:34:00.5337872Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str 2024-06-26T06:34:00.5339166Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking 2024-06-26T06:34:00.5340563Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_blocking 2024-06-26T06:34:00.5342016Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg 2024-06-26T06:34:00.5343491Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg 2024-06-26T06:34:00.5344930Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler 2024-06-26T06:34:00.5346392Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout 2024-06-26T06:34:00.5347761Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors 2024-06-26T06:34:00.5349047Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler 2024-06-26T06:34:00.5350281Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all 2024-06-26T06:34:00.5351818Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python 2024-06-26T06:34:00.5353231Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_exception 2024-06-26T06:34:00.5354608Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout 2024-06-26T06:34:00.5355894Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id 2024-06-26T06:34:00.5357326Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server 2024-06-26T06:34:00.5358912Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_accumulate_grads 2024-06-26T06:34:00.5360454Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_autograd_engine_error 2024-06-26T06:34:00.5361992Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf 2024-06-26T06:34:00.5363518Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_dtypes 2024-06-26T06:34:00.5365131Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors 2024-06-26T06:34:00.5366668Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_roots 2024-06-26T06:34:00.5368288Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure_python_udf 2024-06-26T06:34:00.5369840Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_python_udf_error 2024-06-26T06:34:00.5371332Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi 2024-06-26T06:34:00.5372803Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors 2024-06-26T06:34:00.5374268Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_verify_hooks 2024-06-26T06:34:00.5375764Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_nested_rpc 2024-06-26T06:34:00.5377290Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors 2024-06-26T06:34:00.5378822Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_no_grad 2024-06-26T06:34:00.5380339Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call 2024-06-26T06:34:00.5381856Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call 2024-06-26T06:34:00.5383464Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call_itself 2024-06-26T06:34:00.5385016Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_call 2024-06-26T06:34:00.5386478Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_mixed_requires_grad 2024-06-26T06:34:00.5387975Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors 2024-06-26T06:34:00.5389507Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy 2024-06-26T06:34:00.5390897Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy_sparse 2024-06-26T06:34:00.5392560Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad 2024-06-26T06:34:00.5394240Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote 2024-06-26T06:34:00.5395847Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args 2024-06-26T06:34:00.5397318Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_thread_local_context_id 2024-06-26T06:34:00.5398743Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps 2024-06-26T06:34:00.5400259Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions 2024-06-26T06:34:00.5401770Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded 2024-06-26T06:34:00.5403263Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order 2024-06-26T06:34:00.5405052Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote 2024-06-26T06:34:00.5406705Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported 2024-06-26T06:34:00.5408292Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_rpc_with_profiling 2024-06-26T06:34:00.5409868Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script 2024-06-26T06:34:00.5411501Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_class_rref_in_py 2024-06-26T06:34:00.5413049Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_module_rref_in_py 2024-06-26T06:34:00.5414581Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote 2024-06-26T06:34:00.5416151Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit 2024-06-26T06:34:00.5417640Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_python_annotation 2024-06-26T06:34:00.5419111Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref 2024-06-26T06:34:00.5420604Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_my_script_module_with_rrefs 2024-06-26T06:34:00.5422093Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async 2024-06-26T06:34:00.5423709Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_class_rref_in_py_and_use_in_script 2024-06-26T06:34:00.5425256Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled 2024-06-26T06:34:00.5426697Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate 2024-06-26T06:34:00.5428032Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value 2024-06-26T06:34:00.5429381Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_python_annotation 2024-06-26T06:34:00.5430805Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed_remote 2024-06-26T06:34:00.5432399Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async 2024-06-26T06:34:00.5433840Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async_script 2024-06-26T06:34:00.5435283Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs 2024-06-26T06:34:00.5436716Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref 2024-06-26T06:34:00.5438274Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script 2024-06-26T06:34:00.5439835Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters 2024-06-26T06:34:00.5441236Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison 2024-06-26T06:34:00.5442846Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs 2024-06-26T06:34:00.5444439Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_self_sparse 2024-06-26T06:34:00.5446165Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together 2024-06-26T06:34:00.5447951Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank 2024-06-26T06:34:00.5449844Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_infer_backend_from_options 2024-06-26T06:34:00.5451443Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rpc_sparse 2024-06-26T06:34:00.5452986Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args 2024-06-26T06:34:00.5454565Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container 2024-06-26T06:34:00.5456254Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_remote_arg_sparse 2024-06-26T06:34:00.5457953Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse 2024-06-26T06:34:00.5459655Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_rpc_arg_sparse 2024-06-26T06:34:00.5461276Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_send_to_rank_sparse 2024-06-26T06:34:00.5462839Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_stress_heavy_rpc_sparse 2024-06-26T06:34:00.5464650Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_options_throw_on_timedelta_timeout 2024-06-26T06:34:00.5466383Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout 2024-06-26T06:34:00.5468016Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_twice_sparse 2024-06-26T06:34:00.5469738Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_different_dtypes_sparse 2024-06-26T06:34:00.5471572Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse 2024-06-26T06:34:00.5473524Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse 2024-06-26T06:34:00.5475294Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse 2024-06-26T06:34:00.5477100Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse 2024-06-26T06:34:00.5478917Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backwards_nested_python_udf_sparse 2024-06-26T06:34:00.5480727Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_embedding_bag_with_no_grad_tensors 2024-06-26T06:34:00.5482631Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse 2024-06-26T06:34:00.5484437Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse 2024-06-26T06:34:00.5494894Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse 2024-06-26T06:34:00.5496773Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse 2024-06-26T06:34:00.5498561Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse 2024-06-26T06:34:00.5500304Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_remote_complex_args_sparse 2024-06-26T06:34:00.5501263Z 2024-06-26T06:34:00.5501834Z Running distributed/_shard/sharded_tensor/ops/test_init 1/1 ... [2024-06-26 06:34:00.507669] 2024-06-26T06:34:00.5503957Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:34:00.508102] 2024-06-26T06:34:03.1326596Z 2024-06-26T06:34:03.1328616Z distributed/_shard/sharded_tensor/ops/test_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_init_1.1_ca01c1af3f61b99b_.log 2024-06-26T06:34:03.1331925Z Running 3 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_kaiming_uniform, test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_normal, test/distributed/_shard/sharded_tensor/ops/test_init.py::TestShardedTensorNNInit::test_init_sharded_tensor_with_uniform 2024-06-26T06:34:03.1334881Z 2024-06-26T06:34:03.1335614Z Running distributed/fsdp/test_fsdp_mixed_precision 1/1 ... [2024-06-26 06:34:03.133099] 2024-06-26T06:34:03.1339086Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_mixed_precision.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:34:03.133555] 2024-06-26T06:36:37.2001946Z 2024-06-26T06:36:37.2005411Z distributed/fsdp/test_fsdp_mixed_precision 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_mixed_precision_1.1_166d8e10ba6c2790_.log 2024-06-26T06:36:37.2056262Z Running 57 items in this shard: test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_eval_root_cast_inputs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_full_precision_in_eval, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_full_precision_in_eval_buffers, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_full_precision_in_eval_comm, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_grads_reduced_precision, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_input_grads_with_param_mixed_precision, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_fp16_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_no_mp_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_param_and_buf_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_false_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp32_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp32_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp64_enable_sharded_grad_scaler, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_e2e_full_shard_mp_only_reduce_offload_true_fp64_none, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_no_reshard_after_forward, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mixed_precision_resnet, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_batchnorm_convert_sync_bn_False, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_batchnorm_convert_sync_bn_True, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_default, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_only_params_and_bufs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_params_and_reduce_diff, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionSharded::test_mp_embedding_reduce, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionUnsharded::test_grads_reduced_precision, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionUnsharded::test_mixed_precision_e2e_full_shard, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionUnsharded::test_mixed_precision_no_reshard_after_forward, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPMixedPrecisionIgnoredModules::test_mixed_precision_with_ignored_module, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_float16_on_one_submodule, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_float16_on_one_submodule_skip_inputs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_float16_on_one_submodule_skip_inputs_error, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_submodules_with_different_precisions, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_submodules_with_different_precisions_error, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPDifferentSubmodulePrecision::test_submodules_with_external_inputs, test/distributed/fsdp/test_fsdp_mixed_precision.py::TestFSDPTrainEval::test_train_ema_eval_flow 2024-06-26T06:36:37.2101846Z 2024-06-26T06:36:37.2102356Z Running distributed/fsdp/test_fsdp_use_orig_params 1/1 ... [2024-06-26 06:36:37.200875] 2024-06-26T06:36:37.2104411Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_use_orig_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:36:37.201329] 2024-06-26T06:37:46.1354501Z 2024-06-26T06:37:46.1356125Z distributed/fsdp/test_fsdp_use_orig_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_620443949beff3fa_.log 2024-06-26T06:37:46.1376978Z Running 25 items in this shard: test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_trainability, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_fsdp_compile, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_multiple_optimizers, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsParamAccess::test_access_params_after_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_grad_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_no_reshard_and_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_param_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_between_fwd_and_bwd_for_no_reshard_raises, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_shape_mismatch, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsFQNs::test_named_parameters_in_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_correctness, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsInit::test_non_uniform_requires_grad, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cpu, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cuda 2024-06-26T06:37:46.1395405Z 2024-06-26T06:37:46.1395867Z Running distributed/test_c10d_spawn_gloo 1/1 ... [2024-06-26 06:37:46.135953] 2024-06-26T06:37:46.1397895Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_spawn_gloo.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:37:46.136418] 2024-06-26T06:38:57.2234984Z 2024-06-26T06:38:57.2238355Z distributed/test_c10d_spawn_gloo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_spawn_gloo_1.1_ce99f03f90067b1a_.log 2024-06-26T06:38:57.2248363Z Running 15 items in this shard: test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_allgather_chunk_gloo, test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_allgather_gloo, test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_allreduce_gloo, test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_broadcast_gloo, test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cpu, test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cuda, test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_rnn, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_gather, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all_single, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_allreduce, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_broadcast, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_gather, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_reduce, test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_scatter 2024-06-26T06:38:57.2257859Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_allgather_chunk_gloo 2024-06-26T06:38:57.2259308Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_allgather_gloo 2024-06-26T06:38:57.2260716Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_allreduce_gloo 2024-06-26T06:38:57.2262126Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::ProcessGroupShareTensorTest::test_shared_broadcast_gloo 2024-06-26T06:38:57.2263544Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cpu 2024-06-26T06:38:57.2264959Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_cuda 2024-06-26T06:38:57.2266532Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::DistributedDataParallelSingleProcessTest::test_rnn 2024-06-26T06:38:57.2267911Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_gather 2024-06-26T06:38:57.2269246Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all 2024-06-26T06:38:57.2270622Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_all_to_all_single 2024-06-26T06:38:57.2272250Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_allreduce 2024-06-26T06:38:57.2273566Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_broadcast 2024-06-26T06:38:57.2274916Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_gather 2024-06-26T06:38:57.2276204Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_reduce 2024-06-26T06:38:57.2277483Z Running 1 items in this shard: test/distributed/test_c10d_spawn_gloo.py::TestDistributedNNFunctionsGloo::test_scatter 2024-06-26T06:38:57.2278226Z 2024-06-26T06:38:57.2278824Z Running distributed/_shard/sharded_tensor/test_sharded_tensor 1/1 ... [2024-06-26 06:38:57.224351] 2024-06-26T06:38:57.2281052Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/sharded_tensor/test_sharded_tensor.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:38:57.224791] 2024-06-26T06:39:05.9611683Z 2024-06-26T06:39:05.9613477Z distributed/_shard/sharded_tensor/test_sharded_tensor 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_1.1_960f96052911d96b_.log 2024-06-26T06:39:05.9660877Z Running 69 items in this shard: test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorMetadata::test_serialize_and_deserialize, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestCreateTensorFromParams::test_empty, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardParameter::test_shard_parameter, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardParameter::test_shard_parameter_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardTensor::test_shard_tensor, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardTensor::test_shard_tensor_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardTensor::test_shard_tensor_with_empty_shard, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestModuleHookApi::test_collect_local_shard, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestModuleHookApi::test_reshard_output, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestLocalTensor::test_local_tensor, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestLocalTensor::test_local_tensor_error, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_cleanup, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_complete_world_size, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_like, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_full, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_ones, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_rand, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_create_sharded_tensor_with_zeros, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_gather_even, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_gather_uneven, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_insufficient_sharding_dims, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_invalid_pg_rpc_ranks, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_invalid_sharding, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_load_state_dict_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_multiple_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_partial_world_size, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_sharded_tensor_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_sharded_tensor_sizes, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_sharding_columns, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_state_dict, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_state_dict_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorChunked::test_state_dict_no_sharded_tensors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_create_sharded_tensor_with_ones, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_gather_even, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_gather_uneven, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_grid_sharding, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_multiple_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_partial_world_size, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_device, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_to_cpu, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_to_cuda, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_sharded_tensor_to_test, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_uneven_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorEnumerable::test_with_rpc_names, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalTensor::test_init_from_local_tensor, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalTensor::test_init_from_local_tensor_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_and_global_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_and_global_metadata_invalid_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_pin_memory, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_property_cross_ranks, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_shards_gaps, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_invalid_shards_overlap, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_init_from_local_shards_new_group, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_local_shards, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorFromLocalShards::test_st_base_init_from_local_shards_and_global_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorCustomOps::test_custom_op, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorCustomOps::test_custom_op_errors, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorCustomOps::test_custom_op_override, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardMetadata::test_create_shard_with_no_placement, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardMetadata::test_shard_metadata_init, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorSubGroupInit::test_sub_process_group_placement_validation, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestShardedTensorSubGroupInit::test_sub_process_group_sharded_tensor_init, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestCreateTensorNoProcessGroupMode::test_init_from_local_shards_and_global_metadata, test/distributed/_shard/sharded_tensor/test_sharded_tensor.py::TestCreateTensorNoProcessGroupMode::test_non_contiguous_local_shards 2024-06-26T06:39:05.9706262Z 2024-06-26T06:39:05.9706738Z Running distributed/test_c10d_spawn_ucc 1/1 ... [2024-06-26 06:39:05.961670] 2024-06-26T06:39:05.9708740Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_spawn_ucc.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:39:05.962114] 2024-06-26T06:39:35.1571727Z 2024-06-26T06:39:35.1573870Z distributed/test_c10d_spawn_ucc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_spawn_ucc_1.1_6cf868192d9a1440_.log 2024-06-26T06:39:35.1580259Z Running 9 items in this shard: test/distributed/test_c10d_spawn_ucc.py::ProcessGroupShareTensorTest::test_shared_allgather_ucc, test/distributed/test_c10d_spawn_ucc.py::ProcessGroupShareTensorTest::test_shared_allreduce_ucc, test/distributed/test_c10d_spawn_ucc.py::ProcessGroupShareTensorTest::test_shared_broadcast_ucc, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_gather, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all_single, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_allreduce, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_broadcast, test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_reduce 2024-06-26T06:39:35.1585860Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::ProcessGroupShareTensorTest::test_shared_allgather_ucc 2024-06-26T06:39:35.1587266Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::ProcessGroupShareTensorTest::test_shared_allreduce_ucc 2024-06-26T06:39:35.1588927Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::ProcessGroupShareTensorTest::test_shared_broadcast_ucc 2024-06-26T06:39:35.1590285Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_gather 2024-06-26T06:39:35.1591581Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all 2024-06-26T06:39:35.1593291Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_all_to_all_single 2024-06-26T06:39:35.1597088Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_allreduce 2024-06-26T06:39:35.1598396Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_broadcast 2024-06-26T06:39:35.1599666Z Running 1 items in this shard: test/distributed/test_c10d_spawn_ucc.py::TestDistributedNNFunctionsUcc::test_reduce 2024-06-26T06:39:35.1600390Z 2024-06-26T06:39:35.1600829Z Running distributed/test_c10d_common 1/1 ... [2024-06-26 06:39:35.157977] 2024-06-26T06:39:35.1602792Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_common.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:39:35.158400] 2024-06-26T06:41:57.2292027Z 2024-06-26T06:41:57.2294360Z distributed/test_c10d_common 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_common_1.1_98e1dbc7b6aa7cc0_.log 2024-06-26T06:41:57.2310323Z Running 23 items in this shard: test/distributed/test_c10d_common.py::TimeoutTest::test_store_based_barrier, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_multi_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_single_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_multi_dtype, test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_single_dtype, test/distributed/test_c10d_common.py::CommTest::test_debug_level, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_class_attr, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_config, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_collectives, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_get_backend_name, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_init_process_group_with_multiple_backends, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_is_backend_available, test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_send_recv, test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends, test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend, test/distributed/test_c10d_common.py::ReduceOpTest::test_op_isinstance_of_reduceop, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_copyable, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_equal, test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_pickle, test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRank, test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRankOverridesFallback, test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnv, test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnvWithFallback 2024-06-26T06:41:57.2324400Z Running 1 items in this shard: test/distributed/test_c10d_common.py::TimeoutTest::test_store_based_barrier 2024-06-26T06:41:57.2326134Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_multi_dtype 2024-06-26T06:41:57.2327686Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_multi_limit_single_dtype 2024-06-26T06:41:57.2329157Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_multi_dtype 2024-06-26T06:41:57.2330655Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ComputeBucketAssignmentTest::test_single_limit_single_dtype 2024-06-26T06:41:57.2331899Z Running 1 items in this shard: test/distributed/test_c10d_common.py::CommTest::test_debug_level 2024-06-26T06:41:57.2333180Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_class_attr 2024-06-26T06:41:57.2334584Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_backend_config 2024-06-26T06:41:57.2338485Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_collectives 2024-06-26T06:41:57.2339863Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_get_backend_name 2024-06-26T06:41:57.2341399Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_init_process_group_with_multiple_backends 2024-06-26T06:41:57.2343025Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_is_backend_available 2024-06-26T06:41:57.2344583Z Running 1 items in this shard: test/distributed/test_c10d_common.py::PythonProcessGroupExtensionTest::test_send_recv 2024-06-26T06:41:57.2346131Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends 2024-06-26T06:41:57.2347880Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend 2024-06-26T06:41:57.2349347Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_op_isinstance_of_reduceop 2024-06-26T06:41:57.2350531Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_copyable 2024-06-26T06:41:57.2351840Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_equal 2024-06-26T06:41:57.2352946Z Running 1 items in this shard: test/distributed/test_c10d_common.py::ReduceOpTest::test_reduceop_pickle 2024-06-26T06:41:57.2354074Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRank 2024-06-26T06:41:57.2355292Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testNodeLocalRankOverridesFallback 2024-06-26T06:41:57.2356474Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnv 2024-06-26T06:41:57.2357612Z Running 1 items in this shard: test/distributed/test_c10d_common.py::LocalRankTest::testWithoutEnvWithFallback 2024-06-26T06:41:57.2358314Z 2024-06-26T06:41:57.2358797Z Running distributed/test_c10d_spawn_nccl 1/1 ... [2024-06-26 06:41:57.230297] 2024-06-26T06:41:57.2360823Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_spawn_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:41:57.230732] 2024-06-26T06:42:38.2922578Z 2024-06-26T06:42:38.2924703Z distributed/test_c10d_spawn_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_spawn_nccl_1.1_81c887b9da3cba62_.log 2024-06-26T06:42:38.2934799Z Running 13 items in this shard: test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_allgather_nccl, test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_allreduce_nccl, test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_broadcast_nccl, test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_reduce_nccl, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather_base, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all_single, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_allreduce, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_broadcast, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter, test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter_non_contiguous 2024-06-26T06:42:38.2943433Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_allgather_nccl 2024-06-26T06:42:38.2944863Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_allreduce_nccl 2024-06-26T06:42:38.2946290Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_broadcast_nccl 2024-06-26T06:42:38.2947823Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::ProcessGroupShareTensorTest::test_shared_reduce_nccl 2024-06-26T06:42:38.2949185Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather 2024-06-26T06:42:38.2950556Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_gather_base 2024-06-26T06:42:38.2952333Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all 2024-06-26T06:42:38.2953709Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_all_to_all_single 2024-06-26T06:42:38.2955085Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_allreduce 2024-06-26T06:42:38.2956409Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_broadcast 2024-06-26T06:42:38.2957723Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce 2024-06-26T06:42:38.2959049Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter 2024-06-26T06:42:38.2960512Z Running 1 items in this shard: test/distributed/test_c10d_spawn_nccl.py::TestDistributedNNFunctionsNccl::test_reduce_scatter_non_contiguous 2024-06-26T06:42:38.2961360Z 2024-06-26T06:42:38.2961770Z Running distributed/test_store 1/1 ... [2024-06-26 06:42:38.293154] 2024-06-26T06:42:38.2963684Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_store.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:42:38.293618] 2024-06-26T06:47:25.1970262Z 2024-06-26T06:47:25.1972202Z distributed/test_store 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_store_1.1_07b0649941227c4e_.log 2024-06-26T06:47:25.2009170Z Running 83 items in this shard: test/distributed/test_store.py::FileStoreTest::test_append, test/distributed/test_store.py::FileStoreTest::test_compare_set, test/distributed/test_store.py::FileStoreTest::test_init_pg_and_rpc_with_same_file, test/distributed/test_store.py::FileStoreTest::test_multi_get, test/distributed/test_store.py::FileStoreTest::test_multi_set, test/distributed/test_store.py::FileStoreTest::test_refcount, test/distributed/test_store.py::FileStoreTest::test_set_get_check, test/distributed/test_store.py::FileStoreTest::test_simple_wait, test/distributed/test_store.py::HashStoreTest::test_append, test/distributed/test_store.py::HashStoreTest::test_compare_set, test/distributed/test_store.py::HashStoreTest::test_multi_get, test/distributed/test_store.py::HashStoreTest::test_multi_set, test/distributed/test_store.py::HashStoreTest::test_set_get_check, test/distributed/test_store.py::HashStoreTest::test_simple_wait, test/distributed/test_store.py::PrefixStoreTest::test_get_underlying_store, test/distributed/test_store.py::PrefixFileStoreTest::test_append, test/distributed/test_store.py::PrefixFileStoreTest::test_compare_set, test/distributed/test_store.py::PrefixFileStoreTest::test_multi_get, test/distributed/test_store.py::PrefixFileStoreTest::test_multi_set, test/distributed/test_store.py::PrefixFileStoreTest::test_set_get_check, test/distributed/test_store.py::PrefixFileStoreTest::test_simple_wait, test/distributed/test_store.py::TCPStoreTest::test_address_already_in_use, test/distributed/test_store.py::TCPStoreTest::test_append, test/distributed/test_store.py::TCPStoreTest::test_compare_set, test/distributed/test_store.py::TCPStoreTest::test_init_pg_and_rpc_with_same_socket, test/distributed/test_store.py::TCPStoreTest::test_multi_get, test/distributed/test_store.py::TCPStoreTest::test_multi_set, test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_fixed_world_size, test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_nonfixed_world_size, test/distributed/test_store.py::TCPStoreTest::test_multitenancy, test/distributed/test_store.py::TCPStoreTest::test_numkeys_delkeys, test/distributed/test_store.py::TCPStoreTest::test_set_get_check, test/distributed/test_store.py::TCPStoreTest::test_simple_wait, test/distributed/test_store.py::TCPStoreTest::test_store_timeout_on_missing_clients, test/distributed/test_store.py::TCPStoreTest::test_take_over_listen_socket, test/distributed/test_store.py::LibUvTCPStoreTest::test_address_already_in_use, test/distributed/test_store.py::LibUvTCPStoreTest::test_append, test/distributed/test_store.py::LibUvTCPStoreTest::test_compare_set, test/distributed/test_store.py::LibUvTCPStoreTest::test_init_pg_and_rpc_with_same_socket, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_get, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_set, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_fixed_world_size, test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_nonfixed_world_size, test/distributed/test_store.py::LibUvTCPStoreTest::test_multitenancy, test/distributed/test_store.py::LibUvTCPStoreTest::test_numkeys_delkeys, test/distributed/test_store.py::LibUvTCPStoreTest::test_set_get_check, test/distributed/test_store.py::LibUvTCPStoreTest::test_simple_wait, test/distributed/test_store.py::LibUvTCPStoreTest::test_store_timeout_on_missing_clients, test/distributed/test_store.py::LibUvTCPStoreTest::test_take_over_listen_socket, test/distributed/test_store.py::PrefixTCPStoreTest::test_append, test/distributed/test_store.py::PrefixTCPStoreTest::test_compare_set, test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_get, test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_set, test/distributed/test_store.py::PrefixTCPStoreTest::test_set_get_check, test/distributed/test_store.py::PrefixTCPStoreTest::test_simple_wait, test/distributed/test_store.py::PrefixTCPStoreTest::test_underlying_non_prefix_store, test/distributed/test_store.py::PythonStoreTest::test_set_get, test/distributed/test_store.py::RendezvousTest::test_unknown_handler, test/distributed/test_store.py::RendezvousTest::test_url_with_node_params, test/distributed/test_store.py::RendezvousEnvTest::test_nominal, test/distributed/test_store.py::RendezvousFileTest::test_common_errors, test/distributed/test_store.py::RendezvousFileTest::test_nominal, test/distributed/test_store.py::RendezvousTCPTest::test_common_errors, test/distributed/test_store.py::RendezvousTCPTest::test_dns_timeout, test/distributed/test_store.py::RendezvousTCPTest::test_nominal, test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_doest_break_client, test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_set, test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_url_with_libuv, test/distributed/test_store.py::TestPythonStore::test_append_roundtrip, test/distributed/test_store.py::TestPythonStore::test_extended_methods_fallbacks, test/distributed/test_store.py::TestPythonStore::test_has_extended_api_passthrough, test/distributed/test_store.py::TestPythonStore::test_has_extended_api_roundtrip, test/distributed/test_store.py::TestPythonStore::test_multi_get_roundtrip, test/distributed/test_store.py::TestPythonStore::test_multi_set_roundtrip, test/distributed/test_store.py::TestPythonStore::test_optional_methods_fail, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_file_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_hash_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_prefix_file_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store, test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store_uv, test/distributed/test_store.py::TimeoutTest::test_interrupt_doesnt_break_wait, test/distributed/test_store.py::InitPgWithNonUvStore::test_with_env_var, test/distributed/test_store.py::InitPgWithNonUvStore::test_with_url_param 2024-06-26T06:47:25.2042988Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_append 2024-06-26T06:47:25.2044002Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_compare_set 2024-06-26T06:47:25.2045257Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_init_pg_and_rpc_with_same_file 2024-06-26T06:47:25.2046379Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_multi_get 2024-06-26T06:47:25.2047366Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_multi_set 2024-06-26T06:47:25.2048357Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_refcount 2024-06-26T06:47:25.2049380Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_set_get_check 2024-06-26T06:47:25.2050403Z Running 1 items in this shard: test/distributed/test_store.py::FileStoreTest::test_simple_wait 2024-06-26T06:47:25.2051406Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_append 2024-06-26T06:47:25.2052404Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_compare_set 2024-06-26T06:47:25.2053413Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_multi_get 2024-06-26T06:47:25.2054401Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_multi_set 2024-06-26T06:47:25.2055421Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_set_get_check 2024-06-26T06:47:25.2056456Z Running 1 items in this shard: test/distributed/test_store.py::HashStoreTest::test_simple_wait 2024-06-26T06:47:25.2057530Z Running 1 items in this shard: test/distributed/test_store.py::PrefixStoreTest::test_get_underlying_store 2024-06-26T06:47:25.2058630Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_append 2024-06-26T06:47:25.2059706Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_compare_set 2024-06-26T06:47:25.2060795Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_multi_get 2024-06-26T06:47:25.2061854Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_multi_set 2024-06-26T06:47:25.2063076Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_set_get_check 2024-06-26T06:47:25.2064188Z Running 1 items in this shard: test/distributed/test_store.py::PrefixFileStoreTest::test_simple_wait 2024-06-26T06:47:25.2065291Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_address_already_in_use 2024-06-26T06:47:25.2066327Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_append 2024-06-26T06:47:25.2067317Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_compare_set 2024-06-26T06:47:25.2068452Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_init_pg_and_rpc_with_same_socket 2024-06-26T06:47:25.2069543Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_get 2024-06-26T06:47:25.2070527Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_set 2024-06-26T06:47:25.2071791Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_fixed_world_size 2024-06-26T06:47:25.2073062Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multi_worker_with_nonfixed_world_size 2024-06-26T06:47:25.2074217Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_multitenancy 2024-06-26T06:47:25.2075257Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_numkeys_delkeys 2024-06-26T06:47:25.2076428Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_set_get_check 2024-06-26T06:47:25.2077429Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_simple_wait 2024-06-26T06:47:25.2078551Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_store_timeout_on_missing_clients 2024-06-26T06:47:25.2079745Z Running 1 items in this shard: test/distributed/test_store.py::TCPStoreTest::test_take_over_listen_socket 2024-06-26T06:47:25.2080911Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_address_already_in_use 2024-06-26T06:47:25.2082003Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_append 2024-06-26T06:47:25.2083059Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_compare_set 2024-06-26T06:47:25.2084240Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_init_pg_and_rpc_with_same_socket 2024-06-26T06:47:25.2085455Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_get 2024-06-26T06:47:25.2086502Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_set 2024-06-26T06:47:25.2087682Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_fixed_world_size 2024-06-26T06:47:25.2089009Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multi_worker_with_nonfixed_world_size 2024-06-26T06:47:25.2090209Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_multitenancy 2024-06-26T06:47:25.2091308Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_numkeys_delkeys 2024-06-26T06:47:25.2092416Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_set_get_check 2024-06-26T06:47:25.2093482Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_simple_wait 2024-06-26T06:47:25.2094672Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_store_timeout_on_missing_clients 2024-06-26T06:47:25.2095914Z Running 1 items in this shard: test/distributed/test_store.py::LibUvTCPStoreTest::test_take_over_listen_socket 2024-06-26T06:47:25.2097024Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_append 2024-06-26T06:47:25.2098169Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_compare_set 2024-06-26T06:47:25.2099253Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_get 2024-06-26T06:47:25.2100309Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_multi_set 2024-06-26T06:47:25.2101372Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_set_get_check 2024-06-26T06:47:25.2102572Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_simple_wait 2024-06-26T06:47:25.2103747Z Running 1 items in this shard: test/distributed/test_store.py::PrefixTCPStoreTest::test_underlying_non_prefix_store 2024-06-26T06:47:25.2104877Z Running 1 items in this shard: test/distributed/test_store.py::PythonStoreTest::test_set_get 2024-06-26T06:47:25.2105902Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTest::test_unknown_handler 2024-06-26T06:47:25.2107007Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTest::test_url_with_node_params 2024-06-26T06:47:25.2108093Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousEnvTest::test_nominal 2024-06-26T06:47:25.2109141Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousFileTest::test_common_errors 2024-06-26T06:47:25.2110224Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousFileTest::test_nominal 2024-06-26T06:47:25.2111366Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_common_errors 2024-06-26T06:47:25.2112766Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_dns_timeout 2024-06-26T06:47:25.2113828Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_nominal 2024-06-26T06:47:25.2115032Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_doest_break_client 2024-06-26T06:47:25.2116291Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_timeout_set 2024-06-26T06:47:25.2117472Z Running 1 items in this shard: test/distributed/test_store.py::RendezvousTCPTest::test_tcp_store_url_with_libuv 2024-06-26T06:47:25.2118629Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_append_roundtrip 2024-06-26T06:47:25.2119786Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_extended_methods_fallbacks 2024-06-26T06:47:25.2121007Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_has_extended_api_passthrough 2024-06-26T06:47:25.2122209Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_has_extended_api_roundtrip 2024-06-26T06:47:25.2123370Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_multi_get_roundtrip 2024-06-26T06:47:25.2124513Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_multi_set_roundtrip 2024-06-26T06:47:25.2125718Z Running 1 items in this shard: test/distributed/test_store.py::TestPythonStore::test_optional_methods_fail 2024-06-26T06:47:25.2126868Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_file_store 2024-06-26T06:47:25.2128026Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_hash_store 2024-06-26T06:47:25.2129232Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_prefix_file_store 2024-06-26T06:47:25.2130417Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store 2024-06-26T06:47:25.2131588Z Running 1 items in this shard: test/distributed/test_store.py::TestMultiThreadedWait::test_wait_tcp_store_uv 2024-06-26T06:47:25.2132881Z Running 1 items in this shard: test/distributed/test_store.py::TimeoutTest::test_interrupt_doesnt_break_wait 2024-06-26T06:47:25.2134028Z Running 1 items in this shard: test/distributed/test_store.py::InitPgWithNonUvStore::test_with_env_var 2024-06-26T06:47:25.2135144Z Running 1 items in this shard: test/distributed/test_store.py::InitPgWithNonUvStore::test_with_url_param 2024-06-26T06:47:25.2135812Z 2024-06-26T06:47:25.2136260Z Running distributed/test_launcher 1/1 ... [2024-06-26 06:47:25.198848] 2024-06-26T06:47:25.2138125Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_launcher.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:47:25.199293] 2024-06-26T06:47:29.2249204Z 2024-06-26T06:47:29.2251136Z distributed/test_launcher 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_launcher_1.1_00021a09e4508184_.log 2024-06-26T06:47:29.2252728Z Running 1 items in this shard: test/distributed/test_launcher.py::TestDistributedLaunch::test_launch_user_script 2024-06-26T06:47:29.2253512Z 2024-06-26T06:47:29.2255631Z Running distributed/test_c10d_nccl 1/1 ... [2024-06-26 06:47:29.225304] 2024-06-26T06:47:29.2260710Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:47:29.225730] 2024-06-26T06:47:30.6577506Z 2024-06-26T06:47:30.6579288Z distributed/test_c10d_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_nccl_1.1_9ae5d3f4555bd5af_.log 2024-06-26T06:47:30.6580292Z 2024-06-26T06:47:30.6583605Z Running distributed/elastic/events/lib_test 1/1 ... [2024-06-26 06:47:30.658081] 2024-06-26T06:47:30.6588486Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/events/lib_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:47:30.658523] 2024-06-26T06:47:33.7324642Z 2024-06-26T06:47:33.7326644Z distributed/elastic/events/lib_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.events.lib_test_1.1_bfa502d5ea2f6aaf_.log 2024-06-26T06:47:33.7332105Z Running 8 items in this shard: test/distributed/elastic/events/lib_test.py::EventLibTest::test_event_created, test/distributed/elastic/events/lib_test.py::EventLibTest::test_event_deser, test/distributed/elastic/events/lib_test.py::EventLibTest::test_get_or_create_logger, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_construct_and_record_rdzv_event, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_construct_and_record_rdzv_event_does_not_run_if_invalid_dest, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_rdzv_event_created, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_rdzv_event_deserialize, test/distributed/elastic/events/lib_test.py::RdzvEventLibTest::test_rdzv_event_str 2024-06-26T06:47:33.7336490Z 2024-06-26T06:47:33.7336928Z Running distributed/elastic/metrics/api_test 1/1 ... [2024-06-26 06:47:33.732895] 2024-06-26T06:47:33.7338945Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/metrics/api_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:47:33.733334] 2024-06-26T06:47:36.6569564Z 2024-06-26T06:47:36.6571365Z distributed/elastic/metrics/api_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.metrics.api_test_1.1_b324dbb88c685be9_.log 2024-06-26T06:47:36.6574507Z Running 3 items in this shard: test/distributed/elastic/metrics/api_test.py::MetricsApiTest::test_get_metric_name, test/distributed/elastic/metrics/api_test.py::MetricsApiTest::test_inheritance, test/distributed/elastic/metrics/api_test.py::MetricsApiTest::test_profile 2024-06-26T06:47:36.6576295Z 2024-06-26T06:47:36.6576800Z Running distributed/elastic/multiprocessing/api_test 1/1 ... [2024-06-26 06:47:36.657378] 2024-06-26T06:47:36.6581396Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/multiprocessing/api_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:47:36.657818] 2024-06-26T06:48:08.2815292Z 2024-06-26T06:48:08.2817339Z distributed/elastic/multiprocessing/api_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.multiprocessing.api_test_1.1_e8220087c3df1da5_.log 2024-06-26T06:48:08.2849115Z Running 40 items in this shard: test/distributed/elastic/multiprocessing/api_test.py::RunProcResultsTest::test_get_failures, test/distributed/elastic/multiprocessing/api_test.py::RunProcResultsTest::test_is_failed, test/distributed/elastic/multiprocessing/api_test.py::StdTest::test_from_str_bad_input, test/distributed/elastic/multiprocessing/api_test.py::StdTest::test_from_value, test/distributed/elastic/multiprocessing/api_test.py::StdTest::test_from_value_map, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_args_env_len_mismatch, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_binary_exit, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_binary_incorrect_entrypoint, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_binary_raises, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_function_large_ret_val, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_function_raise, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_function_with_tensor, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_invalid_log_dir, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_multiprocess_context_close, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_multiprocessing_context_poll_raises_exception, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_pcontext_wait, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_subprocess_context_close, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_to_map, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_validate_full_rank, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_void_function, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesTest::test_wait_for_all_child_procs_to_exit, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_args_env_len_mismatch, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_binary, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_binary_exit, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_binary_incorrect_entrypoint, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_binary_raises, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_binary_redirect_and_tee, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_function, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_function_large_ret_val, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_function_raise, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_function_with_tensor, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_invalid_log_dir, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_multiprocess_context_close, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_multiprocessing_context_poll_raises_exception, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_pcontext_wait, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_subprocess_context_close, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_to_map, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_validate_full_rank, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_void_function, test/distributed/elastic/multiprocessing/api_test.py::StartProcessesListTest::test_wait_for_all_child_procs_to_exit 2024-06-26T06:48:08.2873567Z 2024-06-26T06:48:08.2874397Z Running distributed/elastic/timer/api_test 1/1 ... [2024-06-26 06:48:08.282146] 2024-06-26T06:48:08.2876419Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/timer/api_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:48:08.282622] 2024-06-26T06:48:09.7129666Z 2024-06-26T06:48:09.7131298Z distributed/elastic/timer/api_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.timer.api_test_1.1_cff383df82905f1e_.log 2024-06-26T06:48:09.7132713Z 2024-06-26T06:48:09.7135359Z Running distributed/elastic/timer/local_timer_example 1/1 ... [2024-06-26 06:48:09.713318] 2024-06-26T06:48:09.7140738Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/timer/local_timer_example.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:48:09.713762] 2024-06-26T06:48:26.4651697Z 2024-06-26T06:48:26.4654437Z distributed/elastic/timer/local_timer_example 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.timer.local_timer_example_1.1_89481ed730c7702d_.log 2024-06-26T06:48:26.4658932Z Running 2 items in this shard: test/distributed/elastic/timer/local_timer_example.py::LocalTimerExample::test_example_start_method_spawn, test/distributed/elastic/timer/local_timer_example.py::LocalTimerExample::test_torch_mp_example 2024-06-26T06:48:26.4661462Z 2024-06-26T06:48:26.4662271Z Running distributed/elastic/timer/local_timer_test 1/1 ... [2024-06-26 06:48:26.465822] 2024-06-26T06:48:26.4668581Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/timer/local_timer_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:48:26.466409] 2024-06-26T06:48:33.7477379Z 2024-06-26T06:48:33.7479495Z distributed/elastic/timer/local_timer_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.timer.local_timer_test_1.1_17c3605fc07588f9_.log 2024-06-26T06:48:33.7490019Z Running 14 items in this shard: test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_client_interaction, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_exception_propagation, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_get_timer_recursive, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_happy_path, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_no_client, test/distributed/elastic/timer/local_timer_test.py::LocalTimerTest::test_timer, test/distributed/elastic/timer/local_timer_test.py::MultiprocessingRequestQueueTest::test_get, test/distributed/elastic/timer/local_timer_test.py::MultiprocessingRequestQueueTest::test_get_less_than_size, test/distributed/elastic/timer/local_timer_test.py::MultiprocessingRequestQueueTest::test_get_size, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_acquire_release, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_expired_timers, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_valid_timers, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_watchdog_call_count, test/distributed/elastic/timer/local_timer_test.py::LocalTimerServerTest::test_watchdog_empty_queue 2024-06-26T06:48:33.7498290Z 2024-06-26T06:48:33.7498801Z Running distributed/elastic/utils/distributed_test 1/1 ... [2024-06-26 06:48:33.748127] 2024-06-26T06:48:33.7500927Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/utils/distributed_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:48:33.748555] 2024-06-26T06:48:38.8754484Z 2024-06-26T06:48:38.8757017Z distributed/elastic/utils/distributed_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.utils.distributed_test_1.1_7fcef1ddb2b1477f_.log 2024-06-26T06:48:38.8763903Z Running 8 items in this shard: test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_multi, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_no_port_multi, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_single_server, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_timeout_on_server, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_timeout_on_worker, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_create_store_with_libuv_support, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_port_already_in_use_on_server, test/distributed/elastic/utils/distributed_test.py::DistributedUtilTest::test_port_already_in_use_on_worker 2024-06-26T06:48:38.8769907Z 2024-06-26T06:48:38.8770392Z Running distributed/elastic/utils/logging_test 1/1 ... [2024-06-26 06:48:38.875896] 2024-06-26T06:48:38.8772458Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/utils/logging_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:48:38.876334] 2024-06-26T06:48:41.8500292Z 2024-06-26T06:48:41.8502216Z distributed/elastic/utils/logging_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.utils.logging_test_1.1_1e5a6cd1093e4310_.log 2024-06-26T06:48:41.8504479Z Running 2 items in this shard: test/distributed/elastic/utils/logging_test.py::LoggingTest::test_derive_module_name, test/distributed/elastic/utils/logging_test.py::LoggingTest::test_logger_name 2024-06-26T06:48:41.8505852Z 2024-06-26T06:48:41.8506408Z Running distributed/elastic/utils/util_test 1/1 ... [2024-06-26 06:48:41.850445] 2024-06-26T06:48:41.8512323Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/elastic/utils/util_test.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:48:41.850868] 2024-06-26T06:48:44.8246692Z 2024-06-26T06:48:44.8248564Z distributed/elastic/utils/util_test 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.elastic.utils.util_test_1.1_b20a80f0063e7e08_.log 2024-06-26T06:48:44.8255027Z Running 10 items in this shard: test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_barrier, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_barrier_hash_store, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_get_all_rank_0, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_get_all_rank_n, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_synchronize, test/distributed/elastic/utils/util_test.py::StoreUtilTest::test_synchronize_hash_store, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger_custom_name, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger_different, test/distributed/elastic/utils/util_test.py::UtilTest::test_get_logger_none 2024-06-26T06:48:44.8260397Z 2024-06-26T06:48:44.8260783Z Running distributed/test_cuda_p2p 1/1 ... [2024-06-26 06:48:44.825098] 2024-06-26T06:48:44.8262661Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_cuda_p2p.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-06-26 06:48:44.825536] 2024-06-26T06:48:47.4488336Z 2024-06-26T06:48:47.4490130Z distributed/test_cuda_p2p 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_cuda_p2p_1.1_21f27fd055092cfa_.log 2024-06-26T06:48:47.4496708Z Running 9 items in this shard: test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_fused_all_gather_matmul_gather_dim_0, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_fused_all_gather_matmul_gather_dim_1, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_fused_matmul_reduce_scatter_scatter_dim_0, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_fused_matmul_reduce_scatter_scatter_dim_1, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_optimal_layout_dim_0, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_optimal_layout_dim_1, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_optimal_layout_dim_2, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_p2p_apis, test/distributed/test_cuda_p2p.py::ProcessGroupCudaP2PTest::test_p2p_buffer 2024-06-26T06:48:47.4504960Z 2024-06-26T06:48:48.4123000Z 2024-06-26T06:48:48.4123490Z real 106m11.074s 2024-06-26T06:48:48.4123872Z user 209m46.015s 2024-06-26T06:48:48.4124214Z sys 37m0.096s 2024-06-26T06:48:48.4124483Z + assert_git_not_dirty 2024-06-26T06:48:48.4125127Z + [[ linux-jammy-py3.8-gcc11 != *rocm* ]] 2024-06-26T06:48:48.4125720Z + [[ linux-jammy-py3.8-gcc11 != *xla* ]] 2024-06-26T06:48:48.4129742Z ++ grep -v '?? third_party' 2024-06-26T06:48:48.4130376Z ++ git status --porcelain 2024-06-26T06:49:10.2710400Z ++ true 2024-06-26T06:49:10.2711108Z + git_status= 2024-06-26T06:49:10.2711951Z + [[ -n '' ]] 2024-06-26T06:49:10.2713267Z + [[ linux-jammy-py3.8-gcc11 == *cuda* ]] 2024-06-26T06:49:10.2714003Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-06-26T06:49:10.2714592Z + [[ 2 == 1 ]] 2024-06-26T06:49:10.2714928Z + cleanup_workspace 2024-06-26T06:49:10.2715848Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-06-26T06:49:10.2717040Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-06-26T06:49:10.2718059Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-06-26T06:49:10.2718737Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-06-26T06:49:10.2719647Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-06-26T06:49:10.2720618Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-06-26T06:49:10.2721378Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-06-26T06:49:10.8292618Z ##[group]Run cat test/**/*_toprint.log || true 2024-06-26T06:49:10.8293131Z cat test/**/*_toprint.log || true 2024-06-26T06:49:10.8300580Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:10.8301065Z env: 2024-06-26T06:49:10.8301331Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:10.8301932Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:10.8302585Z ##[endgroup] 2024-06-26T06:49:10.8367073Z cat: test/**/*_toprint.log: No such file or directory 2024-06-26T06:49:10.8399061Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-06-26T06:49:10.8399524Z kill "$MONITOR_SCRIPT_PID" 2024-06-26T06:49:10.8406862Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:10.8407384Z env: 2024-06-26T06:49:10.8407657Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:10.8408294Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:10.8408981Z MONITOR_SCRIPT_PID: 28807 2024-06-26T06:49:10.8409310Z ##[endgroup] 2024-06-26T06:49:10.8626148Z Prepare all required actions 2024-06-26T06:49:10.8626606Z Getting action download info 2024-06-26T06:49:11.0044955Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-06-26T06:49:11.1755602Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-06-26T06:49:11.1756064Z with: 2024-06-26T06:49:11.1756468Z file-suffix: test-distributed-2-2-linux.2xlarge_26688305465 2024-06-26T06:49:11.1757015Z s3-bucket: gha-artifacts 2024-06-26T06:49:11.1757327Z env: 2024-06-26T06:49:11.1757585Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:11.1758175Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:11.1758943Z ##[endgroup] 2024-06-26T06:49:11.1786333Z ##[group]Run # Remove any previous test jsons if they exist 2024-06-26T06:49:11.1786961Z # Remove any previous test jsons if they exist 2024-06-26T06:49:11.1787467Z rm -f test-jsons-*.zip 2024-06-26T06:49:11.1788011Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-06-26T06:49:11.1795886Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:11.1796380Z env: 2024-06-26T06:49:11.1796634Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:11.1797229Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:11.1798012Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_26688305465 2024-06-26T06:49:11.1798515Z ##[endgroup] 2024-06-26T06:49:11.2047292Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-06-26T06:49:11.2073923Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-06-26T06:49:11.2074647Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-06-26T06:49:11.2080286Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-06-26T06:49:11.2082354Z adding: test/test-reports/td_exclusions-5de0d4d6d83b8a0ad90a.json (deflated 86%) 2024-06-26T06:49:11.2083158Z adding: test/.pytorch-slow-tests.json (deflated 77%) 2024-06-26T06:49:11.2090326Z adding: test/.pytorch-disabled-tests.json (deflated 84%) 2024-06-26T06:49:11.2124664Z ##[group]Run # Remove any previous test reports if they exist 2024-06-26T06:49:11.2125450Z # Remove any previous test reports if they exist 2024-06-26T06:49:11.2125972Z rm -f test-reports-*.zip 2024-06-26T06:49:11.2126553Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-06-26T06:49:11.2146988Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:11.2147503Z env: 2024-06-26T06:49:11.2147765Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:11.2148345Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:11.2149157Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_26688305465 2024-06-26T06:49:11.2149671Z ##[endgroup] 2024-06-26T06:49:11.2448063Z adding: test/test-reports/python-pytest/distributed.pipelining.test_transformer/distributed.pipelining.test_transformer-63539eb35a9f4129.xml (deflated 39%) 2024-06-26T06:49:11.2450372Z adding: test/test-reports/python-pytest/distributed._tensor.debug.test_op_coverage/distributed._tensor.debug.test_op_coverage-c42af620dc9a631d.xml (deflated 35%) 2024-06-26T06:49:11.2452413Z adding: test/test-reports/python-pytest/distributed._tools.test_mod_tracker/distributed._tools.test_mod_tracker-7d27101cde5a0a3a.xml (deflated 59%) 2024-06-26T06:49:11.2454286Z adding: test/test-reports/python-pytest/distributed._tensor.test_api/distributed._tensor.test_api-4e369aed5f83bfca.xml (deflated 78%) 2024-06-26T06:49:11.2456152Z adding: test/test-reports/python-pytest/distributed._tensor.test_attention/distributed._tensor.test_attention-c9b77b6e63ee5ba8.xml (deflated 85%) 2024-06-26T06:49:11.2458107Z adding: test/test-reports/python-pytest/distributed._composable.test_contract/distributed._composable.test_contract-aaf7177cc952250d.xml (deflated 66%) 2024-06-26T06:49:11.2460164Z adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor/distributed._tensor.test_dtensor-4c32f7668b3d6375.xml (deflated 86%) 2024-06-26T06:49:11.2462317Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_dedup_tensors/distributed.checkpoint.test_dedup_tensors-435c805e7ebbf279.xml (deflated 38%) 2024-06-26T06:49:11.2464340Z adding: test/test-reports/python-pytest/distributed._tools.test_mem_tracker/distributed._tools.test_mem_tracker-240269b9f3d89112.xml (deflated 64%) 2024-06-26T06:49:11.2466321Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_fsdp_ep/distributed.checkpoint.e2e.test_fsdp_ep-77b7561475462276.xml (deflated 34%) 2024-06-26T06:49:11.2468471Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_state/distributed._composable.fsdp.test_fully_shard_state-263e7c1c20f0800c.xml (deflated 81%) 2024-06-26T06:49:11.2470753Z adding: test/test-reports/python-pytest/distributed._tensor.test_tensor_ops/distributed._tensor.test_tensor_ops-2c0612a8aac15881.xml (deflated 84%) 2024-06-26T06:49:11.2472889Z adding: test/test-reports/python-pytest/distributed._tools.test_fsdp2_mem_tracker/distributed._tools.test_fsdp2_mem_tracker-c5b7b80458f32b50.xml (deflated 60%) 2024-06-26T06:49:11.2475075Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_random_state/distributed.tensor.parallel.test_tp_random_state-3cfaa385e2479416.xml (deflated 45%) 2024-06-26T06:49:11.2477202Z adding: test/test-reports/python-pytest/distributed._tensor.test_experimental_ops/distributed._tensor.test_experimental_ops-ffa128c7737fae2f.xml (deflated 60%) 2024-06-26T06:49:11.2479132Z adding: test/test-reports/python-pytest/distributed._tensor.test_math_ops/distributed._tensor.test_math_ops-83107c9e86b35230.xml (deflated 79%) 2024-06-26T06:49:11.2481228Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_overlap/distributed._composable.fsdp.test_fully_shard_overlap-0c056a1a53d8c62e.xml (deflated 55%) 2024-06-26T06:49:11.2483413Z adding: test/test-reports/python-pytest/distributed._tensor.test_redistribute/distributed._tensor.test_redistribute-dbe3681e90ecaf39.xml (deflated 81%) 2024-06-26T06:49:11.2485551Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_ddp_2d_parallel/distributed.tensor.parallel.test_ddp_2d_parallel-0c5b9194acb7b762.xml (deflated 46%) 2024-06-26T06:49:11.2487705Z adding: test/test-reports/python-pytest/distributed.test_compute_comm_reordering/distributed.test_compute_comm_reordering-8f473a1443ff8dde.xml (deflated 84%) 2024-06-26T06:49:11.2489891Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_autograd/distributed._composable.fsdp.test_fully_shard_autograd-9ee1bf819a8197ef.xml (deflated 62%) 2024-06-26T06:49:11.2492146Z adding: test/test-reports/python-pytest/distributed._tensor.test_xla_integration/distributed._tensor.test_xla_integration-a07054981e14207f.xml (deflated 74%) 2024-06-26T06:49:11.2494464Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_init/distributed._composable.fsdp.test_fully_shard_init-2f292c92a822ff13.xml (deflated 91%) 2024-06-26T06:49:11.2496708Z adding: test/test-reports/python-pytest/distributed._composable.test_checkpoint/distributed._composable.test_checkpoint-70d534df46031420.xml (deflated 70%) 2024-06-26T06:49:11.2498986Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_memory/distributed._composable.fsdp.test_fully_shard_memory-69f80054c7477fc0.xml (deflated 38%) 2024-06-26T06:49:11.2501151Z adding: test/test-reports/python-pytest/distributed._tensor.test_matrix_ops/distributed._tensor.test_matrix_ops-fe3039e3b6ff694c.xml (deflated 77%) 2024-06-26T06:49:11.2503290Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_style/distributed.tensor.parallel.test_tp_style-849fd85924588410.xml (deflated 80%) 2024-06-26T06:49:11.2505746Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_dtensor_resharding/distributed.checkpoint.test_dtensor_resharding-ef7a8dcf3997b6d9.xml (deflated 80%) 2024-06-26T06:49:11.2507968Z adding: test/test-reports/python-pytest/distributed._tensor.test_pointwise_ops/distributed._tensor.test_pointwise_ops-9c5dec2d58c51220.xml (deflated 70%) 2024-06-26T06:49:11.2510118Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_examples/distributed.tensor.parallel.test_tp_examples-003983da2f38d12a.xml (deflated 77%) 2024-06-26T06:49:11.2512449Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_planner/distributed.checkpoint.test_planner-a0bafcf93c725054.xml (deflated 63%) 2024-06-26T06:49:11.2514452Z adding: test/test-reports/python-pytest/distributed.fsdp.test_shard_utils/distributed.fsdp.test_shard_utils-79e9ab69c08c6c77.xml (deflated 63%) 2024-06-26T06:49:11.2516660Z adding: test/test-reports/python-pytest/distributed._tensor.debug.test_comm_mode/distributed._tensor.debug.test_comm_mode-b23e6fceea3a5ca0.xml (deflated 65%) 2024-06-26T06:49:11.2518734Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsspec/distributed.checkpoint.test_fsspec-d7ac235791cc9f63.xml (deflated 60%) 2024-06-26T06:49:11.2520923Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_fine_tuning/distributed.checkpoint.e2e.test_fine_tuning-96f5050878565c73.xml (deflated 37%) 2024-06-26T06:49:11.2523229Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_dtensor_checkpoint/distributed.checkpoint.test_dtensor_checkpoint-95290220a5275cf4.xml (deflated 47%) 2024-06-26T06:49:11.2525603Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_pipeline/distributed.checkpoint.e2e.test_pipeline-6943d73ea4e577eb.xml (deflated 39%) 2024-06-26T06:49:11.2527662Z adding: test/test-reports/python-pytest/distributed.test_functional_api/distributed.test_functional_api-ee5b28c753f247fb.xml (deflated 86%) 2024-06-26T06:49:11.2529977Z adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_compile/distributed._composable.fully_shard.test_fully_shard_compile-4db1aafc40a3ea4e.xml (deflated 49%) 2024-06-26T06:49:11.2532436Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_model_state/distributed.checkpoint.test_fsdp_model_state-8321e67f7ffbedec.xml (deflated 65%) 2024-06-26T06:49:11.2534779Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_parallelize_api/distributed.tensor.parallel.test_parallelize_api-caae1f35c9abd119.xml (deflated 81%) 2024-06-26T06:49:11.2537342Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion-f44ac2ea5a164f50.xml (deflated 48%) 2024-06-26T06:49:11.2539538Z adding: test/test-reports/python-pytest/distributed.test_c10d_logger/distributed.test_c10d_logger-f9324a81ef6da89f.xml (deflated 65%) 2024-06-26T06:49:11.2541523Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_checkpoint/distributed.checkpoint.test_checkpoint-c28a81fea63e16c7.xml (deflated 84%) 2024-06-26T06:49:11.2543871Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_file_system_checkpoint/distributed.checkpoint.test_file_system_checkpoint-082cbea78b13d1cd.xml (deflated 73%) 2024-06-26T06:49:11.2546310Z adding: test/test-reports/python-pytest/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks-aa9c9ea4b6e4f043.xml (deflated 85%) 2024-06-26T06:49:11.2548569Z adding: test/test-reports/python-pytest/distributed.test_control_collectives/distributed.test_control_collectives-1f23c40e31f385c3.xml (deflated 84%) 2024-06-26T06:49:11.2550490Z adding: test/test-reports/python-pytest/distributed.test_c10d_pypg/distributed.test_c10d_pypg-a434aed745efbcd7.xml (deflated 94%) 2024-06-26T06:49:11.2552677Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_grad_acc/distributed.fsdp.test_fsdp_grad_acc-c3e12e64a6f55439.xml (deflated 84%) 2024-06-26T06:49:11.2554803Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_clip_grad_norm/distributed.fsdp.test_fsdp_clip_grad_norm-a00241c85950e1dc.xml (deflated 77%) 2024-06-26T06:49:11.2556959Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_exec_order/distributed.fsdp.test_fsdp_exec_order-2ace0ee4adc2e397.xml (deflated 87%) 2024-06-26T06:49:11.2559054Z adding: test/test-reports/python-pytest/distributed.test_multi_threaded_pg/distributed.test_multi_threaded_pg-1fc73c0055ad683a.xml (deflated 81%) 2024-06-26T06:49:11.2561097Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_core/distributed.fsdp.test_fsdp_core-6a67737fff2f0c83.xml (deflated 95%) 2024-06-26T06:49:11.2563238Z adding: test/test-reports/python-pytest/distributed.test_data_parallel/distributed.test_data_parallel-a4aea4f204f236d5.xml (deflated 94%) 2024-06-26T06:49:11.2565340Z adding: test/test-reports/python-pytest/distributed.fsdp.test_hsdp_dtensor_state_dict/distributed.fsdp.test_hsdp_dtensor_state_dict-cd9a40bb28a2b536.xml (deflated 86%) 2024-06-26T06:49:11.2567654Z adding: test/test-reports/python-pytest/distributed._shard.sharding_plan.test_sharding_plan/distributed._shard.sharding_plan.test_sharding_plan-2b9f6e33f3487b0f.xml (deflated 75%) 2024-06-26T06:49:11.2569765Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_misc/distributed.fsdp.test_fsdp_misc-28e6535e6b36c17f.xml (deflated 89%) 2024-06-26T06:49:11.2571793Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_hybrid_shard/distributed.fsdp.test_fsdp_hybrid_shard-29693db467817add.xml (deflated 81%) 2024-06-26T06:49:11.2573862Z adding: test/test-reports/python-pytest/distributed.fsdp.test_utils/distributed.fsdp.test_utils-cea5a31988b4ee39.xml (deflated 71%) 2024-06-26T06:49:11.2575906Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5534fd2b41d76cd7.xml (deflated 35%) 2024-06-26T06:49:11.2578115Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a3ad0f608088561e.xml (deflated 35%) 2024-06-26T06:49:11.2580274Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c3f37f8ee6f3d716.xml (deflated 35%) 2024-06-26T06:49:11.2582456Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bbfb8bda6550644a.xml (deflated 36%) 2024-06-26T06:49:11.2584751Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-740f9054eeada17e.xml (deflated 36%) 2024-06-26T06:49:11.2586923Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a7d867d90884ed0f.xml (deflated 36%) 2024-06-26T06:49:11.2589104Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-62aa43338427bdf0.xml (deflated 36%) 2024-06-26T06:49:11.2591247Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b1cf61ef8251dadd.xml (deflated 35%) 2024-06-26T06:49:11.2593514Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e5b163b7ece94175.xml (deflated 36%) 2024-06-26T06:49:11.2595659Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-82dd4621a2428ca8.xml (deflated 36%) 2024-06-26T06:49:11.2597781Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eaf720420e2060a8.xml (deflated 35%) 2024-06-26T06:49:11.2599933Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14269d3a04acf021.xml (deflated 36%) 2024-06-26T06:49:11.2602214Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0617419ee3ed88de.xml (deflated 35%) 2024-06-26T06:49:11.2604344Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-34ae8582c6d1328b.xml (deflated 36%) 2024-06-26T06:49:11.2606551Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9f95e12d42c55bff.xml (deflated 35%) 2024-06-26T06:49:11.2608726Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-85a2ce71929c19c4.xml (deflated 35%) 2024-06-26T06:49:11.2610887Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ca5bc8a3f114fabc.xml (deflated 35%) 2024-06-26T06:49:11.2613138Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-62a2b482b8c90d1c.xml (deflated 36%) 2024-06-26T06:49:11.2615299Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-827fc736f8969432.xml (deflated 35%) 2024-06-26T06:49:11.2617463Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3e31cdd0cc2ad037.xml (deflated 36%) 2024-06-26T06:49:11.2619616Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-86e87f12f4e3881c.xml (deflated 35%) 2024-06-26T06:49:11.2621764Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-78f2da2e5c4fe6b9.xml (deflated 35%) 2024-06-26T06:49:11.2623716Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ef554f55ca1c612d.xml (deflated 36%) 2024-06-26T06:49:11.2625780Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52447c23c0d3e775.xml (deflated 35%) 2024-06-26T06:49:11.2627879Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-26c8718ea9480ad5.xml (deflated 35%) 2024-06-26T06:49:11.2630024Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-34d185d2481ba549.xml (deflated 35%) 2024-06-26T06:49:11.2632106Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-568d9a0b0995b505.xml (deflated 35%) 2024-06-26T06:49:11.2634071Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ab9f7cb753b637c0.xml (deflated 35%) 2024-06-26T06:49:11.2636164Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4576280129731735.xml (deflated 35%) 2024-06-26T06:49:11.2638281Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7f0575be5f508d05.xml (deflated 36%) 2024-06-26T06:49:11.2640444Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-59db0c8f3cdbe9cf.xml (deflated 35%) 2024-06-26T06:49:11.2642604Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fb4bc93e3d0898b7.xml (deflated 35%) 2024-06-26T06:49:11.2644703Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4745df179c889214.xml (deflated 35%) 2024-06-26T06:49:11.2646867Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-084b86148b3b2ad9.xml (deflated 35%) 2024-06-26T06:49:11.2649131Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-86f7b9697d450cab.xml (deflated 35%) 2024-06-26T06:49:11.2651265Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5a10ce1ee1d2a9f9.xml (deflated 35%) 2024-06-26T06:49:11.2653418Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a5a1462ccb7fc105.xml (deflated 36%) 2024-06-26T06:49:11.2655547Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-73b22b874327ee3f.xml (deflated 36%) 2024-06-26T06:49:11.2657696Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5d4b619b35362f75.xml (deflated 36%) 2024-06-26T06:49:11.2659939Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-afcb42d2cc94dfa3.xml (deflated 36%) 2024-06-26T06:49:11.2662096Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2ea7fd6cd304b1ce.xml (deflated 56%) 2024-06-26T06:49:11.2664242Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bc938caf6b196faa.xml (deflated 35%) 2024-06-26T06:49:11.2666386Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-95c0e90b4a24f309.xml (deflated 35%) 2024-06-26T06:49:11.2668537Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bcbc9a0908f8c401.xml (deflated 35%) 2024-06-26T06:49:11.2670679Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e318ad5791deb708.xml (deflated 36%) 2024-06-26T06:49:11.2672914Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-130885cba4e76992.xml (deflated 36%) 2024-06-26T06:49:11.2675062Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d19a85d38f912c61.xml (deflated 35%) 2024-06-26T06:49:11.2677222Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e6fd750c0c0f2c3e.xml (deflated 36%) 2024-06-26T06:49:11.2679357Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f626822e24e3ad75.xml (deflated 36%) 2024-06-26T06:49:11.2681484Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9c3dbb62bc1440c8.xml (deflated 35%) 2024-06-26T06:49:11.2683540Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d9a5e67b3d25391e.xml (deflated 35%) 2024-06-26T06:49:11.2685720Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-faf8de53610e2279.xml (deflated 35%) 2024-06-26T06:49:11.2687824Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-750101ec8e0a42a0.xml (deflated 36%) 2024-06-26T06:49:11.2689924Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a4a009f65d2cf720.xml (deflated 37%) 2024-06-26T06:49:11.2692023Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cc2585ec787e38fd.xml (deflated 35%) 2024-06-26T06:49:11.2694169Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b8ea2eb4a8e08ee1.xml (deflated 36%) 2024-06-26T06:49:11.2696341Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8ffe011c4519ca20.xml (deflated 35%) 2024-06-26T06:49:11.2698652Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b045e117c985fee8.xml (deflated 36%) 2024-06-26T06:49:11.2700757Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dea3879a1f6baba1.xml (deflated 35%) 2024-06-26T06:49:11.2702852Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9b4a555b8c0b07c4.xml (deflated 36%) 2024-06-26T06:49:11.2704956Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9ef8947c7bb5a4bb.xml (deflated 36%) 2024-06-26T06:49:11.2707162Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1c5628efb6f67aca.xml (deflated 35%) 2024-06-26T06:49:11.2709261Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3274fa27aeb89e9f.xml (deflated 35%) 2024-06-26T06:49:11.2711403Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6926d8a089582323.xml (deflated 35%) 2024-06-26T06:49:11.2713498Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b9f516348acdbf28.xml (deflated 36%) 2024-06-26T06:49:11.2715538Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-878ae2f2d0f1d25e.xml (deflated 36%) 2024-06-26T06:49:11.2717558Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5280331f39673794.xml (deflated 36%) 2024-06-26T06:49:11.2719603Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c1fb8cc12898b35c.xml (deflated 35%) 2024-06-26T06:49:11.2721638Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cc9a730721e60320.xml (deflated 35%) 2024-06-26T06:49:11.2723704Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-644a43cf39732b88.xml (deflated 35%) 2024-06-26T06:49:11.2725803Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e36a5036684a9db5.xml (deflated 35%) 2024-06-26T06:49:11.2727879Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0324dde7bdc5f3ca.xml (deflated 36%) 2024-06-26T06:49:11.2729920Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a09902d58699ae77.xml (deflated 37%) 2024-06-26T06:49:11.2731970Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9261b3e3b76fd947.xml (deflated 35%) 2024-06-26T06:49:11.2733955Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e6391162bef2f4d8.xml (deflated 35%) 2024-06-26T06:49:11.2735996Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-96af372589f43778.xml (deflated 36%) 2024-06-26T06:49:11.2738052Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-48a057b33bf3689d.xml (deflated 36%) 2024-06-26T06:49:11.2757638Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b85dd8c502d9e5de.xml (deflated 36%) 2024-06-26T06:49:11.2760260Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f99cee7f3069ddae.xml (deflated 35%) 2024-06-26T06:49:11.2763467Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-074eeda8345fda13.xml (deflated 35%) 2024-06-26T06:49:11.2766199Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-899c9c1667623f44.xml (deflated 35%) 2024-06-26T06:49:11.2768254Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3bd48971db02f856.xml (deflated 36%) 2024-06-26T06:49:11.2770298Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4b2e7f724d96ada8.xml (deflated 36%) 2024-06-26T06:49:11.2772366Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1f92f2eff0f77514.xml (deflated 35%) 2024-06-26T06:49:11.2774529Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9ca4e7e76411fe92.xml (deflated 35%) 2024-06-26T06:49:11.2776604Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c27a4db40f4ce2e5.xml (deflated 36%) 2024-06-26T06:49:11.2778640Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c5d64651e8a5a38a.xml (deflated 35%) 2024-06-26T06:49:11.2780702Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1533dae33a9b07d6.xml (deflated 35%) 2024-06-26T06:49:11.2782802Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7783676b4fe58859.xml (deflated 34%) 2024-06-26T06:49:11.2784845Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-40fa17e63b6c4476.xml (deflated 34%) 2024-06-26T06:49:11.2786838Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8dcc59b00064d002.xml (deflated 34%) 2024-06-26T06:49:11.2788922Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-72ce4ec70f6bed90.xml (deflated 35%) 2024-06-26T06:49:11.2790978Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0855b7c1b282ee49.xml (deflated 34%) 2024-06-26T06:49:11.2793134Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7ed1cdee91efbb44.xml (deflated 35%) 2024-06-26T06:49:11.2795177Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-58cdf105b587aa62.xml (deflated 34%) 2024-06-26T06:49:11.2797228Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6d24d7d47e427cd9.xml (deflated 34%) 2024-06-26T06:49:11.2799319Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ffb4f65ae07725cd.xml (deflated 35%) 2024-06-26T06:49:11.2801317Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b8261224eed07a4f.xml (deflated 36%) 2024-06-26T06:49:11.2803349Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-47beedd83b2eaa23.xml (deflated 34%) 2024-06-26T06:49:11.2805481Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2cc251c8e626a960.xml (deflated 34%) 2024-06-26T06:49:11.2807535Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-edfa56382c816c00.xml (deflated 35%) 2024-06-26T06:49:11.2809705Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f1de35f1d722debe.xml (deflated 34%) 2024-06-26T06:49:11.2811760Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f3447a59314bd11a.xml (deflated 35%) 2024-06-26T06:49:11.2813817Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9f58234fb79dd96d.xml (deflated 35%) 2024-06-26T06:49:11.2815881Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2c5d47e5afc0db94.xml (deflated 36%) 2024-06-26T06:49:11.2817914Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-94af2b0cf6d88308.xml (deflated 36%) 2024-06-26T06:49:11.2820104Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d08ff831750842fa.xml (deflated 36%) 2024-06-26T06:49:11.2822145Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f4c0642578a3eb93.xml (deflated 35%) 2024-06-26T06:49:11.2824146Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-972b6a563c49f7b8.xml (deflated 35%) 2024-06-26T06:49:11.2826201Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c3549c76c8aad6ec.xml (deflated 35%) 2024-06-26T06:49:11.2828241Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6a9060a221c666c8.xml (deflated 35%) 2024-06-26T06:49:11.2830349Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-799e62b03815ec14.xml (deflated 35%) 2024-06-26T06:49:11.2832570Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f9cd8945a56120d8.xml (deflated 35%) 2024-06-26T06:49:11.2834593Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e128a72c73aaad81.xml (deflated 35%) 2024-06-26T06:49:11.2836636Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-da80cb3a625e091d.xml (deflated 34%) 2024-06-26T06:49:11.2838637Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-23e6fdf9b88e94b4.xml (deflated 35%) 2024-06-26T06:49:11.2840697Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0294dc3ec4318a5f.xml (deflated 35%) 2024-06-26T06:49:11.2842742Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-19f819635c70a355.xml (deflated 35%) 2024-06-26T06:49:11.2844939Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-821f34507def18c4.xml (deflated 35%) 2024-06-26T06:49:11.2847036Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3d0df2cabdc4d45a.xml (deflated 35%) 2024-06-26T06:49:11.2849157Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-85d52db15ed6dc63.xml (deflated 36%) 2024-06-26T06:49:11.2851167Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-af32b55960adba6e.xml (deflated 35%) 2024-06-26T06:49:11.2853300Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5f1f0ea084ac60cb.xml (deflated 35%) 2024-06-26T06:49:11.2855390Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-07da40655da1ea64.xml (deflated 35%) 2024-06-26T06:49:11.2857529Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e1e57459444d820c.xml (deflated 34%) 2024-06-26T06:49:11.2859601Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b801fe2aaf07ff41.xml (deflated 35%) 2024-06-26T06:49:11.2861620Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e05622ebe4e451e0.xml (deflated 35%) 2024-06-26T06:49:11.2863654Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba6f1ae2ccc0bde8.xml (deflated 35%) 2024-06-26T06:49:11.2865824Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f79bcf96d73243f1.xml (deflated 35%) 2024-06-26T06:49:11.2867862Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a54dfd9d12710a9b.xml (deflated 34%) 2024-06-26T06:49:11.2869922Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c1f64ddcf478cb79.xml (deflated 36%) 2024-06-26T06:49:11.2872027Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-96a2f44e54730ec0.xml (deflated 35%) 2024-06-26T06:49:11.2874018Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-df4ea14c9088223d.xml (deflated 55%) 2024-06-26T06:49:11.2876060Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9019477ae76e8011.xml (deflated 55%) 2024-06-26T06:49:11.2878112Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-71089411849a5c59.xml (deflated 36%) 2024-06-26T06:49:11.2880092Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8448b86487607115.xml (deflated 35%) 2024-06-26T06:49:11.2881929Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c6f5ae093d282530.xml (deflated 41%) 2024-06-26T06:49:11.2883777Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0bab5cf06e814d2b.xml (deflated 37%) 2024-06-26T06:49:11.2885689Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ecb8bd87a3080a8a.xml (deflated 37%) 2024-06-26T06:49:11.2887515Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ccae866bada73bc7.xml (deflated 37%) 2024-06-26T06:49:11.2889817Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-719afa2ae33a61d8.xml (deflated 37%) 2024-06-26T06:49:11.2892105Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a1ed07fc2bf6fc21.xml (deflated 37%) 2024-06-26T06:49:11.2893924Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fc326c31058d3b54.xml (deflated 37%) 2024-06-26T06:49:11.2895725Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-55d604f101c43e7c.xml (deflated 36%) 2024-06-26T06:49:11.2897595Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4cfe2e220a55f704.xml (deflated 36%) 2024-06-26T06:49:11.2899426Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b557607c6a852f48.xml (deflated 36%) 2024-06-26T06:49:11.2901362Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-60e34d704f319e18.xml (deflated 36%) 2024-06-26T06:49:11.2903192Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5ccd5635c1f0844a.xml (deflated 37%) 2024-06-26T06:49:11.2905002Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5eb877bdc4e54803.xml (deflated 37%) 2024-06-26T06:49:11.2906829Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-73af51540bc84bf8.xml (deflated 37%) 2024-06-26T06:49:11.2908652Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-be199483ed7c2508.xml (deflated 37%) 2024-06-26T06:49:11.2910578Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-54b1370895a6fbe4.xml (deflated 37%) 2024-06-26T06:49:11.2912490Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c1233524a249a882.xml (deflated 36%) 2024-06-26T06:49:11.2914323Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-73b130828c0bb64c.xml (deflated 35%) 2024-06-26T06:49:11.2916157Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f10f324737ae9f2a.xml (deflated 35%) 2024-06-26T06:49:11.2917985Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5506300c14fa830c.xml (deflated 36%) 2024-06-26T06:49:11.2919797Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-66ebb98f54cc0278.xml (deflated 36%) 2024-06-26T06:49:11.2921621Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4af501e1c74b7dcf.xml (deflated 35%) 2024-06-26T06:49:11.2923442Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-60875402420d65e6.xml (deflated 35%) 2024-06-26T06:49:11.2925301Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-854a729c7ac4ba56.xml (deflated 36%) 2024-06-26T06:49:11.2927121Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2be50e3b2b6d10ae.xml (deflated 36%) 2024-06-26T06:49:11.2928951Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f1afa065ec7aa13d.xml (deflated 35%) 2024-06-26T06:49:11.2930788Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5fd6bb9ad755d570.xml (deflated 35%) 2024-06-26T06:49:11.2932629Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-210b05190f872d89.xml (deflated 35%) 2024-06-26T06:49:11.2934432Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-45d96f2b0e081e7c.xml (deflated 35%) 2024-06-26T06:49:11.2936247Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d11ec3bee669b4ca.xml (deflated 35%) 2024-06-26T06:49:11.2938067Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a4a9db875744c29f.xml (deflated 35%) 2024-06-26T06:49:11.2939937Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1bb95bb894977f4b.xml (deflated 35%) 2024-06-26T06:49:11.2941850Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ea8f4b1adda9bd9a.xml (deflated 35%) 2024-06-26T06:49:11.2943688Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-010f9694bc6a6028.xml (deflated 36%) 2024-06-26T06:49:11.2945513Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-012e3b02f2d7afa1.xml (deflated 36%) 2024-06-26T06:49:11.2947344Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eb37df6df7274576.xml (deflated 36%) 2024-06-26T06:49:11.2949156Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b20a122887133dc1.xml (deflated 35%) 2024-06-26T06:49:11.2951056Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7edc68da69a222a3.xml (deflated 35%) 2024-06-26T06:49:11.2952966Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-286f78792ce66108.xml (deflated 35%) 2024-06-26T06:49:11.2954787Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b3696eb6de147e22.xml (deflated 35%) 2024-06-26T06:49:11.2956594Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-947422d9201571ae.xml (deflated 36%) 2024-06-26T06:49:11.2958402Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14826a4db2bcef4a.xml (deflated 35%) 2024-06-26T06:49:11.2960224Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3881dd3431335b77.xml (deflated 35%) 2024-06-26T06:49:11.2962054Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cb54d93171765782.xml (deflated 37%) 2024-06-26T06:49:11.2963858Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4438b15c923aa3cb.xml (deflated 35%) 2024-06-26T06:49:11.2965770Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8ea59cdd7b4eb568.xml (deflated 35%) 2024-06-26T06:49:11.2967597Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d8f2a7300695e1c2.xml (deflated 36%) 2024-06-26T06:49:11.2969419Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a0422377570d0967.xml (deflated 36%) 2024-06-26T06:49:11.2971231Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-75bbc138929246f5.xml (deflated 36%) 2024-06-26T06:49:11.2973052Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fb7e54a34b67bc95.xml (deflated 35%) 2024-06-26T06:49:11.2974878Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6c12098191a39679.xml (deflated 35%) 2024-06-26T06:49:11.2976697Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7e08ae2d60789092.xml (deflated 35%) 2024-06-26T06:49:11.2978512Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-101b3d29db20a0f3.xml (deflated 36%) 2024-06-26T06:49:11.2980340Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-813c90a23efb6a1e.xml (deflated 36%) 2024-06-26T06:49:11.2982165Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7f4a55a2c9c8ed27.xml (deflated 35%) 2024-06-26T06:49:11.2984097Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4dd15fecd94088ad.xml (deflated 35%) 2024-06-26T06:49:11.2985905Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4b34dd72373dede0.xml (deflated 35%) 2024-06-26T06:49:11.2987728Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c192973cfa54939e.xml (deflated 35%) 2024-06-26T06:49:11.2989548Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-87f89cbb642fe2c2.xml (deflated 35%) 2024-06-26T06:49:11.2991371Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f0113324d74dbccd.xml (deflated 35%) 2024-06-26T06:49:11.2993384Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-75237a19241edbd2.xml (deflated 36%) 2024-06-26T06:49:11.2995197Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-31d53383e40352ab.xml (deflated 35%) 2024-06-26T06:49:11.2997022Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-59a2cf89dd079a0c.xml (deflated 35%) 2024-06-26T06:49:11.2998852Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a08fb61400a502c.xml (deflated 35%) 2024-06-26T06:49:11.3000677Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-454bfa76d9935d78.xml (deflated 35%) 2024-06-26T06:49:11.3002502Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bf51e1aecddbd648.xml (deflated 36%) 2024-06-26T06:49:11.3004346Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c3989479aa40fd68.xml (deflated 36%) 2024-06-26T06:49:11.3006263Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2d8e830f1c99dee0.xml (deflated 36%) 2024-06-26T06:49:11.3008088Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-45361dc35ff69ee8.xml (deflated 36%) 2024-06-26T06:49:11.3009890Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9e49b81d80c92f28.xml (deflated 36%) 2024-06-26T06:49:11.3011719Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8658269a7af3b344.xml (deflated 35%) 2024-06-26T06:49:11.3013547Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-663df7efad05804d.xml (deflated 36%) 2024-06-26T06:49:11.3015375Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bb763fbb89ca2dac.xml (deflated 38%) 2024-06-26T06:49:11.3017228Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5073fb0a94cce89c.xml (deflated 36%) 2024-06-26T06:49:11.3019054Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eba0b032dc28ffd8.xml (deflated 36%) 2024-06-26T06:49:11.3020889Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dd756f08f147d094.xml (deflated 36%) 2024-06-26T06:49:11.3022709Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-77798b11e3226214.xml (deflated 36%) 2024-06-26T06:49:11.3024624Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-20846c07eb13d825.xml (deflated 35%) 2024-06-26T06:49:11.3026826Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-84c35f90738ca83e.xml (deflated 35%) 2024-06-26T06:49:11.3028637Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-39f0dfa05f7a6f40.xml (deflated 36%) 2024-06-26T06:49:11.3030470Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2ca78f8954ad2f0e.xml (deflated 36%) 2024-06-26T06:49:11.3032368Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7d483dc3be15edd9.xml (deflated 36%) 2024-06-26T06:49:11.3034280Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c31325cb5ffcbc50.xml (deflated 36%) 2024-06-26T06:49:11.3036101Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-85d17b63ba5c24f2.xml (deflated 36%) 2024-06-26T06:49:11.3037933Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f3655c5eefa41075.xml (deflated 36%) 2024-06-26T06:49:11.3039735Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5d5c8a898a8b74b9.xml (deflated 36%) 2024-06-26T06:49:11.3041556Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dc298898dabb7eda.xml (deflated 35%) 2024-06-26T06:49:11.3043381Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-621a8dd4729ab583.xml (deflated 36%) 2024-06-26T06:49:11.3045276Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-db539b5729555cc1.xml (deflated 37%) 2024-06-26T06:49:11.3047078Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ab497e8ce91294c5.xml (deflated 36%) 2024-06-26T06:49:11.3048898Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-199881370c03aa42.xml (deflated 36%) 2024-06-26T06:49:11.3050721Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fb0a9b7dc371cd26.xml (deflated 36%) 2024-06-26T06:49:11.3052550Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-352e5d5935c0bec7.xml (deflated 36%) 2024-06-26T06:49:11.3054357Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a987fc9aa77699c8.xml (deflated 36%) 2024-06-26T06:49:11.3056184Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8480fab30e2a407a.xml (deflated 35%) 2024-06-26T06:49:11.3057998Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-151db60ef54c43a5.xml (deflated 36%) 2024-06-26T06:49:11.3059818Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d3aa7e99092c0fce.xml (deflated 35%) 2024-06-26T06:49:11.3061624Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52598ae14a979cd3.xml (deflated 36%) 2024-06-26T06:49:11.3063420Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-11c1860281ddd253.xml (deflated 35%) 2024-06-26T06:49:11.3065245Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1aa848903822b3fe.xml (deflated 37%) 2024-06-26T06:49:11.3067169Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ca3b14995e12cbbc.xml (deflated 35%) 2024-06-26T06:49:11.3069002Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a3618a5dcc8e2ed8.xml (deflated 35%) 2024-06-26T06:49:11.3070815Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-42d631adced67794.xml (deflated 34%) 2024-06-26T06:49:11.3072716Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e2db46698cd84e37.xml (deflated 34%) 2024-06-26T06:49:11.3074618Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-94c9377f8407c648.xml (deflated 35%) 2024-06-26T06:49:11.3076435Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3950f7f6f1107592.xml (deflated 34%) 2024-06-26T06:49:11.3078241Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3db18d726c4ffd09.xml (deflated 35%) 2024-06-26T06:49:11.3080068Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-82069d5b53dba752.xml (deflated 35%) 2024-06-26T06:49:11.3081889Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a95c6ce826349372.xml (deflated 34%) 2024-06-26T06:49:11.3083704Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-11c3eceaa7eecf9d.xml (deflated 35%) 2024-06-26T06:49:11.3085585Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5557f4539d5c0113.xml (deflated 34%) 2024-06-26T06:49:11.3087410Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bff218604a486bd8.xml (deflated 35%) 2024-06-26T06:49:11.3089227Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5cde580b76c62bb4.xml (deflated 35%) 2024-06-26T06:49:11.3091048Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d15051d88b054507.xml (deflated 35%) 2024-06-26T06:49:11.3092847Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9c080734fa633739.xml (deflated 34%) 2024-06-26T06:49:11.3094674Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6b5f9f3b2b650e88.xml (deflated 35%) 2024-06-26T06:49:11.3096502Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c646463019ab24c0.xml (deflated 35%) 2024-06-26T06:49:11.3098323Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-64c2644f249b713f.xml (deflated 35%) 2024-06-26T06:49:11.3100133Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1057cc5570bfdc5f.xml (deflated 35%) 2024-06-26T06:49:11.3101956Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6b0ad0598ec32232.xml (deflated 35%) 2024-06-26T06:49:11.3103785Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0f22adb095f1497f.xml (deflated 35%) 2024-06-26T06:49:11.3105614Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-19aa797b0e6598a3.xml (deflated 35%) 2024-06-26T06:49:11.3107520Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b7f170eab513b55f.xml (deflated 35%) 2024-06-26T06:49:11.3109361Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9b2151eab0aad5d5.xml (deflated 36%) 2024-06-26T06:49:11.3111192Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d30827a8b9a04e10.xml (deflated 34%) 2024-06-26T06:49:11.3113099Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9ad23d757717a72d.xml (deflated 35%) 2024-06-26T06:49:11.3114913Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ae225055177458cd.xml (deflated 35%) 2024-06-26T06:49:11.3116830Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-599ed625ac2f0cc3.xml (deflated 35%) 2024-06-26T06:49:11.3118650Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3831e1acc7a96e87.xml (deflated 35%) 2024-06-26T06:49:11.3120465Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-78e50c809a7fcf48.xml (deflated 35%) 2024-06-26T06:49:11.3122270Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bc6e69acf8bfc4d9.xml (deflated 35%) 2024-06-26T06:49:11.3124092Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cb8aa64ebadbfdb6.xml (deflated 35%) 2024-06-26T06:49:11.3125994Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-20b55d339a5a260d.xml (deflated 35%) 2024-06-26T06:49:11.3127812Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d59337c861dbe4ba.xml (deflated 36%) 2024-06-26T06:49:11.3129620Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c25b2d952c3e645a.xml (deflated 36%) 2024-06-26T06:49:11.3131439Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-62e91f3511214290.xml (deflated 35%) 2024-06-26T06:49:11.3133265Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-35b7cbfa2590d1c2.xml (deflated 35%) 2024-06-26T06:49:11.3135090Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-902ea37bc249c857.xml (deflated 35%) 2024-06-26T06:49:11.3136907Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c6954c6ecd06eaf0.xml (deflated 35%) 2024-06-26T06:49:11.3138736Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f2e72fe406dd61d4.xml (deflated 35%) 2024-06-26T06:49:11.3140553Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-189673d72b870f41.xml (deflated 34%) 2024-06-26T06:49:11.3142385Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9020a547cd2c6fb4.xml (deflated 35%) 2024-06-26T06:49:11.3144187Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3ec083bf6745187d.xml (deflated 36%) 2024-06-26T06:49:11.3146005Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-623c8c833c88656f.xml (deflated 35%) 2024-06-26T06:49:11.3147907Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9c5506ef23537b83.xml (deflated 35%) 2024-06-26T06:49:11.3149742Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f195d923a6fc83e8.xml (deflated 34%) 2024-06-26T06:49:11.3151556Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a6fe112474cd3e10.xml (deflated 35%) 2024-06-26T06:49:11.3153444Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e08a8e4c98245a9e.xml (deflated 35%) 2024-06-26T06:49:11.3155266Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3effc8d39393d5cc.xml (deflated 35%) 2024-06-26T06:49:11.3157175Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3f830a72ca987b9e.xml (deflated 35%) 2024-06-26T06:49:11.3159005Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-286d2c82fc5c0fc6.xml (deflated 35%) 2024-06-26T06:49:11.3160822Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-67ee87f556799b75.xml (deflated 35%) 2024-06-26T06:49:11.3162644Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba2ef520d4855534.xml (deflated 37%) 2024-06-26T06:49:11.3164472Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b01f1756d0b920d4.xml (deflated 37%) 2024-06-26T06:49:11.3166355Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dc7e5c710d788708.xml (deflated 36%) 2024-06-26T06:49:11.3168155Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-829322c3c5a7abf2.xml (deflated 36%) 2024-06-26T06:49:11.3169990Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-86fd74346650858d.xml (deflated 36%) 2024-06-26T06:49:11.3171804Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-40a4320b5a7d512c.xml (deflated 37%) 2024-06-26T06:49:11.3173624Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a70a08be4228f99f.xml (deflated 36%) 2024-06-26T06:49:11.3175438Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b6dcd30f30cee3ff.xml (deflated 36%) 2024-06-26T06:49:11.3177271Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-22e4a709ed821d55.xml (deflated 37%) 2024-06-26T06:49:11.3179088Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ab787c2a1d25efca.xml (deflated 36%) 2024-06-26T06:49:11.3180911Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1d06f26ba7463fad.xml (deflated 37%) 2024-06-26T06:49:11.3182718Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3fa366dea23e1ac1.xml (deflated 38%) 2024-06-26T06:49:11.3184545Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4080f946879fac1a.xml (deflated 37%) 2024-06-26T06:49:11.3186367Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-609452c8c53c0225.xml (deflated 38%) 2024-06-26T06:49:11.3188187Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-82719040561b10c4.xml (deflated 37%) 2024-06-26T06:49:11.3190102Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c912325d7fc78536.xml (deflated 37%) 2024-06-26T06:49:11.3192004Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-18ece98c0cdb6a72.xml (deflated 39%) 2024-06-26T06:49:11.3193833Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-736f9656d5cfe33f.xml (deflated 39%) 2024-06-26T06:49:11.3195650Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-070cb70e4d1fdefd.xml (deflated 37%) 2024-06-26T06:49:11.3197558Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0199e639fcfc284b.xml (deflated 37%) 2024-06-26T06:49:11.3199393Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1f22b2bd7cfbe802.xml (deflated 36%) 2024-06-26T06:49:11.3201219Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-245033a774cf7c52.xml (deflated 36%) 2024-06-26T06:49:11.3203042Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2cb592e387c97de5.xml (deflated 36%) 2024-06-26T06:49:11.3204932Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-806eb5019509e5d1.xml (deflated 37%) 2024-06-26T06:49:11.3206758Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8590521db9fe99ec.xml (deflated 37%) 2024-06-26T06:49:11.3208590Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7caed76156cfd6d9.xml (deflated 37%) 2024-06-26T06:49:11.3210426Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fd2b8aa7f58fd7de.xml (deflated 36%) 2024-06-26T06:49:11.3212239Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2402169ea6273f60.xml (deflated 37%) 2024-06-26T06:49:11.3214047Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-02e29853ec69746f.xml (deflated 37%) 2024-06-26T06:49:11.3215876Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-af5916edbfc834f4.xml (deflated 36%) 2024-06-26T06:49:11.3217706Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b21ed21492357544.xml (deflated 37%) 2024-06-26T06:49:11.3219502Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9977d164424067e0.xml (deflated 36%) 2024-06-26T06:49:11.3221430Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_init/distributed._shard.sharded_tensor.ops.test_init-70d364f0eea46238.xml (deflated 76%) 2024-06-26T06:49:11.3223417Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_mixed_precision/distributed.fsdp.test_fsdp_mixed_precision-186e64ecb8ee7b99.xml (deflated 95%) 2024-06-26T06:49:11.3225360Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_use_orig_params/distributed.fsdp.test_fsdp_use_orig_params-028a1fdd532ed080.xml (deflated 90%) 2024-06-26T06:49:11.3227155Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-28d580c8afb4a09a.xml (deflated 43%) 2024-06-26T06:49:11.3228849Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-f42767a585266a3a.xml (deflated 43%) 2024-06-26T06:49:11.3230628Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-c5ff4ea883a8ee0e.xml (deflated 43%) 2024-06-26T06:49:11.3232405Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-f405020cc565b598.xml (deflated 43%) 2024-06-26T06:49:11.3234068Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-a0199aca49635694.xml (deflated 36%) 2024-06-26T06:49:11.3235754Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-db71d52bc9683be9.xml (deflated 43%) 2024-06-26T06:49:11.3237438Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-241166f759deb94b.xml (deflated 44%) 2024-06-26T06:49:11.3239202Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-c978aad654a35282.xml (deflated 44%) 2024-06-26T06:49:11.3240876Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-2d5be14bc0ed15f0.xml (deflated 44%) 2024-06-26T06:49:11.3242561Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-506ff9d512605235.xml (deflated 44%) 2024-06-26T06:49:11.3244239Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-6e485cdea2aea482.xml (deflated 44%) 2024-06-26T06:49:11.3245994Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-ad1c0ef6c38e78e4.xml (deflated 44%) 2024-06-26T06:49:11.3247657Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-c42947616d316b88.xml (deflated 44%) 2024-06-26T06:49:11.3249327Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-767c3ff1578cd92d.xml (deflated 44%) 2024-06-26T06:49:11.3251004Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_gloo/distributed.test_c10d_spawn_gloo-708898f49e7a5b63.xml (deflated 44%) 2024-06-26T06:49:11.3252942Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.test_sharded_tensor/distributed._shard.sharded_tensor.test_sharded_tensor-4d793afe0fb04e08.xml (deflated 95%) 2024-06-26T06:49:11.3254841Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-59c160cd8d7d0669.xml (deflated 43%) 2024-06-26T06:49:11.3256502Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-c1e8430d6dda37de.xml (deflated 43%) 2024-06-26T06:49:11.3258165Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-39c1086b023ad127.xml (deflated 43%) 2024-06-26T06:49:11.3259828Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-f38221dc5b559f08.xml (deflated 45%) 2024-06-26T06:49:11.3261473Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-b26379468039e811.xml (deflated 45%) 2024-06-26T06:49:11.3263129Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-9eb78a269030f74b.xml (deflated 46%) 2024-06-26T06:49:11.3264781Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-0f165629d81481a1.xml (deflated 46%) 2024-06-26T06:49:11.3266429Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-928c9d4b17783ed1.xml (deflated 46%) 2024-06-26T06:49:11.3268068Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_ucc/distributed.test_c10d_spawn_ucc-5d3d56873817eaae.xml (deflated 46%) 2024-06-26T06:49:11.3269704Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-bcf12ff609d48813.xml (deflated 36%) 2024-06-26T06:49:11.3271389Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-c423f603a9789f9f.xml (deflated 36%) 2024-06-26T06:49:11.3273076Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-d8e06a19ba2f67ae.xml (deflated 35%) 2024-06-26T06:49:11.3274649Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-9213463ec2b24fef.xml (deflated 35%) 2024-06-26T06:49:11.3276238Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-7edadd5cbd4a453e.xml (deflated 37%) 2024-06-26T06:49:11.3277839Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-990e72d28aa0662f.xml (deflated 36%) 2024-06-26T06:49:11.3279527Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-5fd8dc71793a9597.xml (deflated 35%) 2024-06-26T06:49:11.3281109Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-0172c78fed32b405.xml (deflated 34%) 2024-06-26T06:49:11.3282705Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-9dc30d926c772b43.xml (deflated 35%) 2024-06-26T06:49:11.3284310Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-4b5c4d9d8e02a4be.xml (deflated 34%) 2024-06-26T06:49:11.3286006Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-c9fdd2106dd39a75.xml (deflated 35%) 2024-06-26T06:49:11.3287585Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-3aea957074bf620d.xml (deflated 34%) 2024-06-26T06:49:11.3289189Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-9649f217caa9baee.xml (deflated 35%) 2024-06-26T06:49:11.3290786Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-c5452d2dfe368f92.xml (deflated 34%) 2024-06-26T06:49:11.3292387Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-efc3f1e94f6a9dec.xml (deflated 34%) 2024-06-26T06:49:11.3293975Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-c95adcd9b8397769.xml (deflated 36%) 2024-06-26T06:49:11.3295570Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-489b6ea392466f11.xml (deflated 36%) 2024-06-26T06:49:11.3297163Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-146d5bbaf7c10373.xml (deflated 35%) 2024-06-26T06:49:11.3298762Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-d62ed7911ff8fc6e.xml (deflated 43%) 2024-06-26T06:49:11.3300343Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-c3e4792294730fdc.xml (deflated 36%) 2024-06-26T06:49:11.3301937Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-2d0b26c90aa70546.xml (deflated 35%) 2024-06-26T06:49:11.3303536Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-1f2b2c04df997e79.xml (deflated 33%) 2024-06-26T06:49:11.3305123Z adding: test/test-reports/python-pytest/distributed.test_c10d_common/distributed.test_c10d_common-1f555552ee230d06.xml (deflated 33%) 2024-06-26T06:49:11.3306745Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-0a7e215f1c21de69.xml (deflated 44%) 2024-06-26T06:49:11.3308442Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-465453c07dbfb395.xml (deflated 43%) 2024-06-26T06:49:11.3310238Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-bdc771bf40b2cab6.xml (deflated 44%) 2024-06-26T06:49:11.3312011Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-3a88f1d37f4bf5fb.xml (deflated 43%) 2024-06-26T06:49:11.3313696Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-6e5a08f16d921a01.xml (deflated 46%) 2024-06-26T06:49:11.3315387Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-83a5ada650eb3234.xml (deflated 46%) 2024-06-26T06:49:11.3317075Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-5f3605301eb6a1a6.xml (deflated 46%) 2024-06-26T06:49:11.3318816Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-c58bf6afa384d433.xml (deflated 46%) 2024-06-26T06:49:11.3320504Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-a80ff66bf92bd548.xml (deflated 46%) 2024-06-26T06:49:11.3322188Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-0a63dd3ac178b018.xml (deflated 46%) 2024-06-26T06:49:11.3323858Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-ba830516644626d8.xml (deflated 46%) 2024-06-26T06:49:11.3325570Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-70ba200e41375363.xml (deflated 46%) 2024-06-26T06:49:11.3327257Z adding: test/test-reports/python-pytest/distributed.test_c10d_spawn_nccl/distributed.test_c10d_spawn_nccl-11958ee75e4c1c71.xml (deflated 45%) 2024-06-26T06:49:11.3328832Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-95b07e7cd99c2482.xml (deflated 44%) 2024-06-26T06:49:11.3330304Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-20012e416eed544e.xml (deflated 37%) 2024-06-26T06:49:11.3331759Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-2b2fe91b982df38a.xml (deflated 39%) 2024-06-26T06:49:11.3333243Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-3430203b138e3ea8.xml (deflated 44%) 2024-06-26T06:49:11.3334722Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-bf69e2b2bd8acd24.xml (deflated 44%) 2024-06-26T06:49:11.3336199Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-67bfe9acf49b88f6.xml (deflated 36%) 2024-06-26T06:49:11.3337658Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-d6d0d0e78d435b58.xml (deflated 36%) 2024-06-26T06:49:11.3339129Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c27708d8e51f9c3a.xml (deflated 37%) 2024-06-26T06:49:11.3340605Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8cc45dfae6fa2b21.xml (deflated 37%) 2024-06-26T06:49:11.3342083Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-340bf7d9b6e7a113.xml (deflated 37%) 2024-06-26T06:49:11.3343536Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-e087567e19e3a8cd.xml (deflated 37%) 2024-06-26T06:49:11.3345006Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c179395d111cb806.xml (deflated 37%) 2024-06-26T06:49:11.3346474Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ef87f38967ba6e8e.xml (deflated 37%) 2024-06-26T06:49:11.3347936Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8baf159ef3a838f1.xml (deflated 37%) 2024-06-26T06:49:11.3349413Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8da7e642946d427a.xml (deflated 36%) 2024-06-26T06:49:11.3350970Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-65f4c85b59d8d2b6.xml (deflated 43%) 2024-06-26T06:49:11.3352552Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ca7d1ac816ae73fa.xml (deflated 36%) 2024-06-26T06:49:11.3354006Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-72b6ed4eb5684853.xml (deflated 43%) 2024-06-26T06:49:11.3355473Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-697c054a48e1e569.xml (deflated 43%) 2024-06-26T06:49:11.3356938Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-d07888dc843060a1.xml (deflated 36%) 2024-06-26T06:49:11.3358472Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-57c5b540444d9b50.xml (deflated 36%) 2024-06-26T06:49:11.3359915Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-3c59e4a6291370e3.xml (deflated 36%) 2024-06-26T06:49:11.3361375Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-062eb9bf143d3ab8.xml (deflated 36%) 2024-06-26T06:49:11.3362839Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-20c58141d71c2f7b.xml (deflated 37%) 2024-06-26T06:49:11.3364299Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9229870edff0dd90.xml (deflated 38%) 2024-06-26T06:49:11.3365830Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-f601df93e3dfd4d9.xml (deflated 36%) 2024-06-26T06:49:11.3367297Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-152883c2c5b029b9.xml (deflated 36%) 2024-06-26T06:49:11.3368771Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-2c7c24ff2f657b68.xml (deflated 34%) 2024-06-26T06:49:11.3370346Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-a5e75e341cae9a4c.xml (deflated 35%) 2024-06-26T06:49:11.3371817Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-34714ea21367b0a9.xml (deflated 37%) 2024-06-26T06:49:11.3373280Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8265d66f699c52f3.xml (deflated 37%) 2024-06-26T06:49:11.3374742Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ded21924d2a9a617.xml (deflated 36%) 2024-06-26T06:49:11.3376196Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-c6e046afef66d66f.xml (deflated 36%) 2024-06-26T06:49:11.3377667Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-4f82f91b6a3a8f09.xml (deflated 36%) 2024-06-26T06:49:11.3379133Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-eda036ca1e03bee2.xml (deflated 35%) 2024-06-26T06:49:11.3380797Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-53750df3a25edb14.xml (deflated 34%) 2024-06-26T06:49:11.3382330Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-46c1df314185c049.xml (deflated 35%) 2024-06-26T06:49:11.3383790Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-7ba36deea64cbd32.xml (deflated 35%) 2024-06-26T06:49:11.3385262Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-809d3d2b0381c32f.xml (deflated 38%) 2024-06-26T06:49:11.3386723Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8597093274ca9d81.xml (deflated 34%) 2024-06-26T06:49:11.3388176Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-667f62dffcec76fa.xml (deflated 34%) 2024-06-26T06:49:11.3389639Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-1fd5d1a989f2fa1a.xml (deflated 33%) 2024-06-26T06:49:11.3391205Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-1531535ef027c410.xml (deflated 34%) 2024-06-26T06:49:11.3392749Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-b5da3f1ad84c2d12.xml (deflated 35%) 2024-06-26T06:49:11.3394213Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-908aa4d897858837.xml (deflated 36%) 2024-06-26T06:49:11.3395666Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-fed64c9e4328415e.xml (deflated 34%) 2024-06-26T06:49:11.3397132Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-700adb4e83c29209.xml (deflated 35%) 2024-06-26T06:49:11.3398669Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-dd1fb18738562daf.xml (deflated 35%) 2024-06-26T06:49:11.3400137Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-521ff02283c3eeac.xml (deflated 35%) 2024-06-26T06:49:11.3401607Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-3d58796fcab170ac.xml (deflated 36%) 2024-06-26T06:49:11.3403069Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-fa115244fd08e436.xml (deflated 36%) 2024-06-26T06:49:11.3404511Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-57415a316d92783b.xml (deflated 35%) 2024-06-26T06:49:11.3406044Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-f05ee2dfcc0345e2.xml (deflated 35%) 2024-06-26T06:49:11.3407514Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-4aef2854df0d24b3.xml (deflated 35%) 2024-06-26T06:49:11.3408989Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ddd3deb926e3399a.xml (deflated 36%) 2024-06-26T06:49:11.3410438Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-639b1b4f17a56ce2.xml (deflated 36%) 2024-06-26T06:49:11.3411898Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-508a78edda7da5eb.xml (deflated 37%) 2024-06-26T06:49:11.3413366Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-e68d4e819b7db8c8.xml (deflated 35%) 2024-06-26T06:49:11.3414828Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8db1adb32d80e7c5.xml (deflated 35%) 2024-06-26T06:49:11.3416307Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-b5dd12f6d25d49e2.xml (deflated 36%) 2024-06-26T06:49:11.3417782Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-8653d2d5a361f639.xml (deflated 35%) 2024-06-26T06:49:11.3419239Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-018b0e8d17fbafb3.xml (deflated 35%) 2024-06-26T06:49:11.3420696Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-4808a86277c86dae.xml (deflated 35%) 2024-06-26T06:49:11.3422159Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-be29ff96e147aa2e.xml (deflated 35%) 2024-06-26T06:49:11.3423620Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-588fe20be63a6d68.xml (deflated 35%) 2024-06-26T06:49:11.3425077Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-40a6f4976a5b86d9.xml (deflated 35%) 2024-06-26T06:49:11.3426525Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-b14949dd32d86aa4.xml (deflated 35%) 2024-06-26T06:49:11.3427989Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-889906bac6988fc7.xml (deflated 35%) 2024-06-26T06:49:11.3429525Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-0bab528f07a2cd74.xml (deflated 36%) 2024-06-26T06:49:11.3431002Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-0df36ed63ba43ede.xml (deflated 35%) 2024-06-26T06:49:11.3432534Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-19448ba4a715bc10.xml (deflated 35%) 2024-06-26T06:49:11.3433993Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-80416695ab493e36.xml (deflated 36%) 2024-06-26T06:49:11.3435451Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-061aab733be2200f.xml (deflated 35%) 2024-06-26T06:49:11.3436908Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-76fee86339174f7c.xml (deflated 35%) 2024-06-26T06:49:11.3438446Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-4c286bd4e261ab1c.xml (deflated 36%) 2024-06-26T06:49:11.3439913Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ea3711c6e9f645d8.xml (deflated 35%) 2024-06-26T06:49:11.3441370Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-61d99e27ec2b378d.xml (deflated 35%) 2024-06-26T06:49:11.3442820Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-525e99c5d623205a.xml (deflated 35%) 2024-06-26T06:49:11.3444270Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9927c403d7b79a9c.xml (deflated 36%) 2024-06-26T06:49:11.3445804Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-ed8ea98cf42f93d3.xml (deflated 36%) 2024-06-26T06:49:11.3447277Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-32b69ad28329815f.xml (deflated 37%) 2024-06-26T06:49:11.3448724Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9a14e25f18f845bb.xml (deflated 33%) 2024-06-26T06:49:11.3450197Z adding: test/test-reports/python-pytest/distributed.test_store/distributed.test_store-9d853dd70f811093.xml (deflated 33%) 2024-06-26T06:49:11.3451712Z adding: test/test-reports/python-pytest/distributed.test_launcher/distributed.test_launcher-2113cdb4ff3fc8b1.xml (deflated 40%) 2024-06-26T06:49:11.3453410Z adding: test/test-reports/python-pytest/distributed.elastic.events.lib_test/distributed.elastic.events.lib_test-7311f83666e45dad.xml (deflated 76%) 2024-06-26T06:49:11.3455267Z adding: test/test-reports/python-pytest/distributed.elastic.metrics.api_test/distributed.elastic.metrics.api_test-e63be3be812cc096.xml (deflated 60%) 2024-06-26T06:49:11.3457267Z adding: test/test-reports/python-pytest/distributed.elastic.multiprocessing.api_test/distributed.elastic.multiprocessing.api_test-6d63dcfdc50d436a.xml (deflated 88%) 2024-06-26T06:49:11.3459363Z adding: test/test-reports/python-pytest/distributed.elastic.timer.local_timer_example/distributed.elastic.timer.local_timer_example-05efcb5f9ab69c08.xml (deflated 51%) 2024-06-26T06:49:11.3461406Z adding: test/test-reports/python-pytest/distributed.elastic.timer.local_timer_test/distributed.elastic.timer.local_timer_test-9cdd39f2b81ce3a5.xml (deflated 80%) 2024-06-26T06:49:11.3463398Z adding: test/test-reports/python-pytest/distributed.elastic.utils.distributed_test/distributed.elastic.utils.distributed_test-ad0e88293a538712.xml (deflated 78%) 2024-06-26T06:49:11.3465373Z adding: test/test-reports/python-pytest/distributed.elastic.utils.logging_test/distributed.elastic.utils.logging_test-41ba88ee9356d9bb.xml (deflated 51%) 2024-06-26T06:49:11.3467257Z adding: test/test-reports/python-pytest/distributed.elastic.utils.util_test/distributed.elastic.utils.util_test-9f9f3f2518d791b6.xml (deflated 80%) 2024-06-26T06:49:11.3468943Z adding: test/test-reports/python-pytest/distributed.test_cuda_p2p/distributed.test_cuda_p2p-0ba463f5e41e5c23.xml (deflated 88%) 2024-06-26T06:49:11.3470627Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0864ca9d86571f4f.xml (deflated 43%) 2024-06-26T06:49:11.3472403Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f074aa45495b5704.xml (deflated 43%) 2024-06-26T06:49:11.3474096Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aae4b8003f68f64a.xml (deflated 37%) 2024-06-26T06:49:11.3475780Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fe91296380af16e6.xml (deflated 36%) 2024-06-26T06:49:11.3477449Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9a96b2000fc448a.xml (deflated 41%) 2024-06-26T06:49:11.3479225Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e486f7ae5696406b.xml (deflated 41%) 2024-06-26T06:49:11.3480910Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2669690a4cc4e4fc.xml (deflated 41%) 2024-06-26T06:49:11.3482597Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-df38b471b7ce3aae.xml (deflated 41%) 2024-06-26T06:49:11.3484268Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a47edd8c0b39e1a8.xml (deflated 36%) 2024-06-26T06:49:11.3486093Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-51d423b580043f15.xml (deflated 35%) 2024-06-26T06:49:11.3487777Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-515d7e293dbf78ec.xml (deflated 35%) 2024-06-26T06:49:11.3489475Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c121b4667e50bfa3.xml (deflated 35%) 2024-06-26T06:49:11.3491146Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-95d34519e8fd999f.xml (deflated 43%) 2024-06-26T06:49:11.3492830Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-96f4bd4d8f538b4d.xml (deflated 45%) 2024-06-26T06:49:11.3494514Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3b290e1a45dff8bb.xml (deflated 35%) 2024-06-26T06:49:11.3496190Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-156132680dbce963.xml (deflated 35%) 2024-06-26T06:49:11.3497844Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a6460df40e37745.xml (deflated 35%) 2024-06-26T06:49:11.3499531Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-394d0c1e62308a6e.xml (deflated 35%) 2024-06-26T06:49:11.3501219Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7eb6979cf0358db8.xml (deflated 36%) 2024-06-26T06:49:11.3502901Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f8091e1be56c1271.xml (deflated 36%) 2024-06-26T06:49:11.3504557Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-75425dd8131d7695.xml (deflated 35%) 2024-06-26T06:49:11.3506243Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5b0cafbf1d57ae36.xml (deflated 35%) 2024-06-26T06:49:11.3507926Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-67a30f27ecdd9740.xml (deflated 36%) 2024-06-26T06:49:11.3509613Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1eba839e707db282.xml (deflated 36%) 2024-06-26T06:49:11.3511365Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9fb873b6ea71d5a3.xml (deflated 36%) 2024-06-26T06:49:11.3513132Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a488a5a0c0e35894.xml (deflated 35%) 2024-06-26T06:49:11.3514812Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-057f49e57d09e853.xml (deflated 35%) 2024-06-26T06:49:11.3516481Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a59de5ae529dfe5.xml (deflated 35%) 2024-06-26T06:49:11.3518172Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cbcb2439c95b0056.xml (deflated 36%) 2024-06-26T06:49:11.3519927Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f4429627a9e012d.xml (deflated 35%) 2024-06-26T06:49:11.3521607Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f35c19f9c97625e.xml (deflated 36%) 2024-06-26T06:49:11.3523282Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d51d1d0041aeab72.xml (deflated 35%) 2024-06-26T06:49:11.3525030Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7928e2929fbcf0c5.xml (deflated 42%) 2024-06-26T06:49:11.3526724Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5e8f98ca4d128272.xml (deflated 43%) 2024-06-26T06:49:11.3528403Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c3cd433a6ef8efdd.xml (deflated 43%) 2024-06-26T06:49:11.3530081Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0058a25eb68eec5d.xml (deflated 43%) 2024-06-26T06:49:11.3531760Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-df71ec38775d296d.xml (deflated 44%) 2024-06-26T06:49:11.3533436Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-47a406950e335c2f.xml (deflated 44%) 2024-06-26T06:49:11.3535122Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-deec1d87386a84b1.xml (deflated 44%) 2024-06-26T06:49:11.3536800Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b0cfdcca7ffa6ab4.xml (deflated 45%) 2024-06-26T06:49:11.3538490Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dafd45158f98f44c.xml (deflated 44%) 2024-06-26T06:49:11.3540169Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c3577a93681c275.xml (deflated 44%) 2024-06-26T06:49:11.3541847Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e132b1486b03b81d.xml (deflated 43%) 2024-06-26T06:49:11.3543508Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ebce5531f46289e4.xml (deflated 36%) 2024-06-26T06:49:11.3545186Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0dd76a779dcf5012.xml (deflated 57%) 2024-06-26T06:49:11.3546864Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0e27f2af70c0013e.xml (deflated 42%) 2024-06-26T06:49:11.3548556Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5b148b6461afeb0b.xml (deflated 36%) 2024-06-26T06:49:11.3550313Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-77c182830f0ab200.xml (deflated 35%) 2024-06-26T06:49:11.3552089Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bd2405a468e0f7af.xml (deflated 42%) 2024-06-26T06:49:11.3553779Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d87a7f6724db0f1e.xml (deflated 42%) 2024-06-26T06:49:11.3555461Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d248b7109dd0704d.xml (deflated 35%) 2024-06-26T06:49:11.3557110Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e5e7c3844429602e.xml (deflated 47%) 2024-06-26T06:49:11.3558868Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a11321aae3f2eb93.xml (deflated 47%) 2024-06-26T06:49:11.3560558Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b56c8bca9df8948e.xml (deflated 47%) 2024-06-26T06:49:11.3562236Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-10adb2478d428e35.xml (deflated 41%) 2024-06-26T06:49:11.3563894Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-16327efb7b8aae55.xml (deflated 42%) 2024-06-26T06:49:11.3565640Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-39f41ed37617da9f.xml (deflated 42%) 2024-06-26T06:49:11.3567314Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2526ec8b11356d38.xml (deflated 42%) 2024-06-26T06:49:11.3568993Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-957653a2ea4bef02.xml (deflated 36%) 2024-06-26T06:49:11.3570664Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ebaa0a87dc654e36.xml (deflated 42%) 2024-06-26T06:49:11.3572348Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d06fd3af1e05550e.xml (deflated 42%) 2024-06-26T06:49:11.3574039Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fb8f5777f0b79ede.xml (deflated 42%) 2024-06-26T06:49:11.3575718Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-94a1b7714d96e258.xml (deflated 35%) 2024-06-26T06:49:11.3577381Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-01a2b53095e286e6.xml (deflated 42%) 2024-06-26T06:49:11.3579059Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-33ef7c771b228af2.xml (deflated 43%) 2024-06-26T06:49:11.3580739Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-449ba41d8f23f290.xml (deflated 43%) 2024-06-26T06:49:11.3582414Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-435f54deca46a547.xml (deflated 42%) 2024-06-26T06:49:11.3584084Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-57f5918818f2d90a.xml (deflated 42%) 2024-06-26T06:49:11.3585762Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6aa9bf3f30d6b67a.xml (deflated 42%) 2024-06-26T06:49:11.3587439Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-26114118fde38631.xml (deflated 43%) 2024-06-26T06:49:11.3589111Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-37e346082f426177.xml (deflated 42%) 2024-06-26T06:49:11.3590847Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9f37ca0e02076162.xml (deflated 43%) 2024-06-26T06:49:11.3592614Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9d1fec772b886d9e.xml (deflated 43%) 2024-06-26T06:49:11.3594299Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e7a0517469b7a4ff.xml (deflated 35%) 2024-06-26T06:49:11.3595981Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6bb1e7e210f30f86.xml (deflated 35%) 2024-06-26T06:49:11.3597650Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f1968a868f0e47c6.xml (deflated 42%) 2024-06-26T06:49:11.3599415Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3f0df4bbcba4dbb8.xml (deflated 35%) 2024-06-26T06:49:11.3601106Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f3fd4b0a73890d92.xml (deflated 35%) 2024-06-26T06:49:11.3602780Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-544d983989b13b72.xml (deflated 42%) 2024-06-26T06:49:11.3604441Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-913e82998749c51c.xml (deflated 36%) 2024-06-26T06:49:11.3606199Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a96d3913489dbb5a.xml (deflated 36%) 2024-06-26T06:49:11.3607877Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f433a75c0d930720.xml (deflated 36%) 2024-06-26T06:49:11.3609562Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-01854fb353a84fe8.xml (deflated 36%) 2024-06-26T06:49:11.3611237Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9dbae11c2ff19943.xml (deflated 35%) 2024-06-26T06:49:11.3612920Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f9469378f29b57b3.xml (deflated 44%) 2024-06-26T06:49:11.3614591Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c2b509654406dabf.xml (deflated 42%) 2024-06-26T06:49:11.3616257Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-86487184425283b3.xml (deflated 43%) 2024-06-26T06:49:11.3617912Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2bcbba149d914d39.xml (deflated 43%) 2024-06-26T06:49:11.3619600Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8b2a11ffe43a8b08.xml (deflated 42%) 2024-06-26T06:49:11.3621282Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5de801370d9ddffb.xml (deflated 35%) 2024-06-26T06:49:11.3622960Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-94927b50b0f14d0c.xml (deflated 35%) 2024-06-26T06:49:11.3624629Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4c18afea6ee96f11.xml (deflated 36%) 2024-06-26T06:49:11.3626317Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-647de63ccde1cc42.xml (deflated 35%) 2024-06-26T06:49:11.3627992Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8224d60a10920ce4.xml (deflated 43%) 2024-06-26T06:49:11.3629675Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6fd9c838f055be79.xml (deflated 43%) 2024-06-26T06:49:11.3631446Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-db117eb293aeda89.xml (deflated 42%) 2024-06-26T06:49:11.3633218Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de691c35891110b1.xml (deflated 41%) 2024-06-26T06:49:11.3634902Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4dcdeaa085ac3127.xml (deflated 42%) 2024-06-26T06:49:11.3636577Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c8ee3bf12530b9e1.xml (deflated 35%) 2024-06-26T06:49:11.3638244Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6ce2009e643d815a.xml (deflated 35%) 2024-06-26T06:49:11.3640007Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b361fc4aeec41e76.xml (deflated 35%) 2024-06-26T06:49:11.3641702Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ccbb2f72957b198.xml (deflated 43%) 2024-06-26T06:49:11.3643390Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0ad573ae9b569714.xml (deflated 42%) 2024-06-26T06:49:11.3645127Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-13c9b0b426b7b339.xml (deflated 43%) 2024-06-26T06:49:11.3646816Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ddaa485f3a84a2b6.xml (deflated 37%) 2024-06-26T06:49:11.3648500Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5394ee95e00ae46.xml (deflated 37%) 2024-06-26T06:49:11.3650190Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-19429db1a9f9c60e.xml (deflated 41%) 2024-06-26T06:49:11.3651861Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-204df70baa9675aa.xml (deflated 41%) 2024-06-26T06:49:11.3653540Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-df18619517899ba6.xml (deflated 40%) 2024-06-26T06:49:11.3655215Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1bcf9e343566c3af.xml (deflated 41%) 2024-06-26T06:49:11.3656906Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-23ab973f7d27c573.xml (deflated 36%) 2024-06-26T06:49:11.3658572Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8017d35099d6c0cc.xml (deflated 35%) 2024-06-26T06:49:11.3660263Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8ddedf12bbad26db.xml (deflated 35%) 2024-06-26T06:49:11.3661959Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-beca9892dd14c122.xml (deflated 36%) 2024-06-26T06:49:11.3663647Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de102b28fbf12ac0.xml (deflated 43%) 2024-06-26T06:49:11.3665316Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b624c989ee923ce9.xml (deflated 45%) 2024-06-26T06:49:11.3666994Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-58e70973a2d6e7e7.xml (deflated 35%) 2024-06-26T06:49:11.3668670Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f4a10db9617e009f.xml (deflated 35%) 2024-06-26T06:49:11.3670450Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b71e2a5bed9bfb87.xml (deflated 35%) 2024-06-26T06:49:11.3672331Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4aa13e9fc5599889.xml (deflated 35%) 2024-06-26T06:49:11.3674009Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1e2fc881d60249c2.xml (deflated 36%) 2024-06-26T06:49:11.3675687Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4ce00cc17946e6b6.xml (deflated 35%) 2024-06-26T06:49:11.3677347Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-24b3801acbacc3ea.xml (deflated 35%) 2024-06-26T06:49:11.3679105Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b60cb42ea4bec318.xml (deflated 35%) 2024-06-26T06:49:11.3680787Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f8c1c0883f7ca680.xml (deflated 36%) 2024-06-26T06:49:11.3682455Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-58c9ae78fa2e52f3.xml (deflated 35%) 2024-06-26T06:49:11.3684098Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-445b9f47b355f6d6.xml (deflated 35%) 2024-06-26T06:49:11.3685833Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7cf0e6fb698dbc9c.xml (deflated 35%) 2024-06-26T06:49:11.3687510Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9a099bcd73645538.xml (deflated 36%) 2024-06-26T06:49:11.3689183Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5e689005d11e0705.xml (deflated 35%) 2024-06-26T06:49:11.3690844Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5c762baac78a438.xml (deflated 35%) 2024-06-26T06:49:11.3692525Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-14087b898477b211.xml (deflated 35%) 2024-06-26T06:49:11.3694188Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-070d4cfb43b5d5cd.xml (deflated 36%) 2024-06-26T06:49:11.3695866Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fdf83878afe18077.xml (deflated 35%) 2024-06-26T06:49:11.3697530Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3b4d4a810749e3d6.xml (deflated 42%) 2024-06-26T06:49:11.3699203Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b504da40982d7e4e.xml (deflated 43%) 2024-06-26T06:49:11.3700882Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0b108e55a664342a.xml (deflated 43%) 2024-06-26T06:49:11.3702562Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-edff0d3b1bd40d23.xml (deflated 43%) 2024-06-26T06:49:11.3704226Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-caf09a6c24b42d76.xml (deflated 44%) 2024-06-26T06:49:11.3705904Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bbe0f89d024dc3b7.xml (deflated 44%) 2024-06-26T06:49:11.3707588Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8b5020a7b59ffde8.xml (deflated 44%) 2024-06-26T06:49:11.3709277Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d95594109f702c90.xml (deflated 45%) 2024-06-26T06:49:11.3711038Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0e5d4a026c4b4b5a.xml (deflated 44%) 2024-06-26T06:49:11.3712814Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6a7cf2f6d175b2a9.xml (deflated 44%) 2024-06-26T06:49:11.3714497Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0fa047f37c50fb61.xml (deflated 43%) 2024-06-26T06:49:11.3716186Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6ca5170f38483ec7.xml (deflated 36%) 2024-06-26T06:49:11.3717852Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-baea305f2706a06f.xml (deflated 57%) 2024-06-26T06:49:11.3719610Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-db05f27a69eb8d9f.xml (deflated 42%) 2024-06-26T06:49:11.3721288Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-de23af0c7104e227.xml (deflated 35%) 2024-06-26T06:49:11.3722969Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e06a936f34bbf512.xml (deflated 35%) 2024-06-26T06:49:11.3724627Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-da64bf1ce9e91fec.xml (deflated 42%) 2024-06-26T06:49:11.3726369Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5eaf6bdcccb4c8ba.xml (deflated 42%) 2024-06-26T06:49:11.3728054Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1360e64700dfd91d.xml (deflated 35%) 2024-06-26T06:49:11.3729793Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c71f76c92076b2a.xml (deflated 47%) 2024-06-26T06:49:11.3731466Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8ed90d09f4ab6959.xml (deflated 47%) 2024-06-26T06:49:11.3733146Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-df842e3dc3dcde06.xml (deflated 47%) 2024-06-26T06:49:11.3734826Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f21f61090b045b18.xml (deflated 42%) 2024-06-26T06:49:11.3736504Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-10422d4af3bb5f7f.xml (deflated 42%) 2024-06-26T06:49:11.3738160Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4f1fe2265365fd1f.xml (deflated 42%) 2024-06-26T06:49:11.3739835Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f1554a82c596eb99.xml (deflated 42%) 2024-06-26T06:49:11.3741501Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f1598430d3b7f86.xml (deflated 36%) 2024-06-26T06:49:11.3743165Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d498acb3e1782a68.xml (deflated 42%) 2024-06-26T06:49:11.3744802Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-21af0342f6389649.xml (deflated 42%) 2024-06-26T06:49:11.3746463Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5b5b08f81dc41053.xml (deflated 42%) 2024-06-26T06:49:11.3748129Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-367357e3460be47d.xml (deflated 35%) 2024-06-26T06:49:11.3749803Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c70ed90a90fc3a2.xml (deflated 42%) 2024-06-26T06:49:11.3751552Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f3846cb6e46ba58c.xml (deflated 43%) 2024-06-26T06:49:11.3753315Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bd1637c17171602b.xml (deflated 42%) 2024-06-26T06:49:11.3754984Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8b75b330f79b8a67.xml (deflated 42%) 2024-06-26T06:49:11.3756654Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b0d3770b57383691.xml (deflated 42%) 2024-06-26T06:49:11.3758308Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32daaf665c5eaf3b.xml (deflated 42%) 2024-06-26T06:49:11.3760100Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f1a13abb8fae7e6.xml (deflated 42%) 2024-06-26T06:49:11.3761777Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6713a0730bb8e704.xml (deflated 42%) 2024-06-26T06:49:11.3763460Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a6a9523f22cf1a7d.xml (deflated 43%) 2024-06-26T06:49:11.3765181Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a738f5a7261b4d86.xml (deflated 43%) 2024-06-26T06:49:11.3766856Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dc4a9551b42215cb.xml (deflated 35%) 2024-06-26T06:49:11.3768581Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c2ded09c747a3f3e.xml (deflated 35%) 2024-06-26T06:49:11.3770256Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a85672c663837bb0.xml (deflated 42%) 2024-06-26T06:49:11.3771921Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3b4eda5ddec5326c.xml (deflated 35%) 2024-06-26T06:49:11.3773594Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-74157e5f30b36e6a.xml (deflated 36%) 2024-06-26T06:49:11.3775259Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d87dd4726c157d19.xml (deflated 42%) 2024-06-26T06:49:11.3776929Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4bdc86baf5386cbd.xml (deflated 36%) 2024-06-26T06:49:11.3778594Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0a8fe7d7ce6cbe34.xml (deflated 35%) 2024-06-26T06:49:11.3780277Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c7699e44f0d19926.xml (deflated 36%) 2024-06-26T06:49:11.3781954Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e39985f2eaad31b5.xml (deflated 35%) 2024-06-26T06:49:11.3783693Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-53abc51383d9655e.xml (deflated 35%) 2024-06-26T06:49:11.3785349Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6328fe1bafeee865.xml (deflated 45%) 2024-06-26T06:49:11.3787027Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-494b58431d11b985.xml (deflated 43%) 2024-06-26T06:49:11.3788696Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8a588436694f7908.xml (deflated 43%) 2024-06-26T06:49:11.3790378Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-27cecdd38fabfb2e.xml (deflated 43%) 2024-06-26T06:49:11.3792247Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88aec44304dc6ba5.xml (deflated 42%) 2024-06-26T06:49:11.3793929Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43f71bb12ccfb75d.xml (deflated 35%) 2024-06-26T06:49:11.3795666Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6d404b8499a5bdea.xml (deflated 35%) 2024-06-26T06:49:11.3797341Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9efbaecc4fb2a2db.xml (deflated 36%) 2024-06-26T06:49:11.3799086Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c16b22f908d96b0.xml (deflated 36%) 2024-06-26T06:49:11.3800767Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-61e5b2a2ad5d3300.xml (deflated 43%) 2024-06-26T06:49:11.3802441Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ecde0564716dcafe.xml (deflated 42%) 2024-06-26T06:49:11.3804122Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-111bf0846d6074e0.xml (deflated 42%) 2024-06-26T06:49:11.3805860Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cbedd19ae52f05d1.xml (deflated 41%) 2024-06-26T06:49:11.3807544Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2bb9174d0981c294.xml (deflated 42%) 2024-06-26T06:49:11.3809217Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0278536187dce9e4.xml (deflated 35%) 2024-06-26T06:49:11.3810895Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-86e89e934a7463a5.xml (deflated 35%) 2024-06-26T06:49:11.3812539Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fd91300896ce27df.xml (deflated 35%) 2024-06-26T06:49:11.3814214Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-98f134df4a4072dc.xml (deflated 44%) 2024-06-26T06:49:11.3815881Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8525c51762c70213.xml (deflated 36%) 2024-06-26T06:49:11.3817553Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e53d87a24ac8f00d.xml (deflated 41%) 2024-06-26T06:49:11.3819214Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-57799a9e8be49222.xml (deflated 43%) 2024-06-26T06:49:11.3820886Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eab6189a32182b4e.xml (deflated 42%) 2024-06-26T06:49:11.3822563Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c803416296455cea.xml (deflated 35%) 2024-06-26T06:49:11.3824224Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e2c15822d56bf2b2.xml (deflated 36%) 2024-06-26T06:49:11.3825892Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a40df45c622350e3.xml (deflated 35%) 2024-06-26T06:49:11.3827554Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4ed4122f6a52744c.xml (deflated 36%) 2024-06-26T06:49:11.3829212Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1d80b96a199d923.xml (deflated 35%) 2024-06-26T06:49:11.3830953Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c7f81a51619c624e.xml (deflated 45%) 2024-06-26T06:49:11.3832727Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-feda915a8b453c69.xml (deflated 36%) 2024-06-26T06:49:11.3834400Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d4ee37a4eab65d81.xml (deflated 35%) 2024-06-26T06:49:11.3836083Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e24071fabb0b001a.xml (deflated 35%) 2024-06-26T06:49:11.3837759Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee15d306f525ce22.xml (deflated 35%) 2024-06-26T06:49:11.3839509Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e4bb02c060fd4971.xml (deflated 35%) 2024-06-26T06:49:11.3841174Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc4cf2565c8d1488.xml (deflated 35%) 2024-06-26T06:49:11.3842835Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-27c17408797a2fdb.xml (deflated 35%) 2024-06-26T06:49:11.3844504Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c2d040014ff5737.xml (deflated 41%) 2024-06-26T06:49:11.3846242Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-81583cc1cf26509e.xml (deflated 43%) 2024-06-26T06:49:11.3847901Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc8e4c6c42df8299.xml (deflated 44%) 2024-06-26T06:49:11.3849579Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2216fd9aa91e29bb.xml (deflated 44%) 2024-06-26T06:49:11.3851258Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-72eb6cb0033ae0da.xml (deflated 44%) 2024-06-26T06:49:11.3852923Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7e45896e86acc592.xml (deflated 45%) 2024-06-26T06:49:11.3854574Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9e11646a51a0ae88.xml (deflated 42%) 2024-06-26T06:49:11.3856248Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4481f0435c50a77b.xml (deflated 35%) 2024-06-26T06:49:11.3857918Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b3211f0d235f35d2.xml (deflated 42%) 2024-06-26T06:49:11.3859595Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-36c4579be977b140.xml (deflated 35%) 2024-06-26T06:49:11.3861242Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2e8e604d3b600d5b.xml (deflated 35%) 2024-06-26T06:49:11.3862911Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f63924a8304659f.xml (deflated 42%) 2024-06-26T06:49:11.3864577Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ea7a7452f6b02ba.xml (deflated 42%) 2024-06-26T06:49:11.3866254Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a11f34d7bd717fbf.xml (deflated 42%) 2024-06-26T06:49:11.3867917Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-87113180fbb83ff5.xml (deflated 35%) 2024-06-26T06:49:11.3869588Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5382b84a0de52660.xml (deflated 42%) 2024-06-26T06:49:11.3871332Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-75f9c7e09f119095.xml (deflated 42%) 2024-06-26T06:49:11.3873105Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4e47482a15a5bac3.xml (deflated 42%) 2024-06-26T06:49:11.3874763Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-12524a56ab340a69.xml (deflated 42%) 2024-06-26T06:49:11.3876436Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7e73b4da05bf1a75.xml (deflated 42%) 2024-06-26T06:49:11.3878121Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dbc492e3ea7b6c3c.xml (deflated 42%) 2024-06-26T06:49:11.3879896Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f9bd6db53bdcf33e.xml (deflated 43%) 2024-06-26T06:49:11.3881568Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3e55064ced1e3659.xml (deflated 42%) 2024-06-26T06:49:11.3883224Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-294f0d0977d16b07.xml (deflated 41%) 2024-06-26T06:49:11.3884992Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cfb65c0b18771865.xml (deflated 42%) 2024-06-26T06:49:11.3886687Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0ec12fdcb947aef9.xml (deflated 42%) 2024-06-26T06:49:11.3888355Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-712b2f8aee093c8d.xml (deflated 42%) 2024-06-26T06:49:11.3890025Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f40546415d6abf6e.xml (deflated 42%) 2024-06-26T06:49:11.3891700Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f8e3f61267bea11.xml (deflated 42%) 2024-06-26T06:49:11.3893380Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f52bfc63d2764767.xml (deflated 42%) 2024-06-26T06:49:11.3895039Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6eadd1d230d4dd30.xml (deflated 42%) 2024-06-26T06:49:11.3896725Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f1e6ad9d69c478be.xml (deflated 42%) 2024-06-26T06:49:11.3898415Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c7f1780b8de8c0c.xml (deflated 42%) 2024-06-26T06:49:11.3900095Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-db7a45f5389809fe.xml (deflated 42%) 2024-06-26T06:49:11.3901759Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3a263728687c8931.xml (deflated 42%) 2024-06-26T06:49:11.3903422Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ed4848a4ae648122.xml (deflated 42%) 2024-06-26T06:49:11.3905092Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-debfa26f1d6049eb.xml (deflated 43%) 2024-06-26T06:49:11.3906754Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-09f0841b535100cd.xml (deflated 43%) 2024-06-26T06:49:11.3908405Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c5f2d5bd255f739.xml (deflated 42%) 2024-06-26T06:49:11.3910087Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3bb596d01acb1cf4.xml (deflated 36%) 2024-06-26T06:49:11.3911953Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6f77d328ce83ceff.xml (deflated 35%) 2024-06-26T06:49:11.3913630Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-705670c7d7192d26.xml (deflated 35%) 2024-06-26T06:49:11.3915285Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d7dee8f441aceb42.xml (deflated 35%) 2024-06-26T06:49:11.3916973Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d8d41be0ab559cd8.xml (deflated 42%) 2024-06-26T06:49:11.3918724Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8ba4aafcd2187b34.xml (deflated 36%) 2024-06-26T06:49:11.3920408Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ca1cfd29634ccd00.xml (deflated 45%) 2024-06-26T06:49:11.3922064Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d3ac76698185ee76.xml (deflated 45%) 2024-06-26T06:49:11.3923746Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1922aca0e2d000c7.xml (deflated 45%) 2024-06-26T06:49:11.3925487Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-802aee7157a75b9a.xml (deflated 41%) 2024-06-26T06:49:11.3927161Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-04362e885c81e3f1.xml (deflated 41%) 2024-06-26T06:49:11.3928826Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-47c7ba9bc729612c.xml (deflated 42%) 2024-06-26T06:49:11.3930511Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-48c2aa097a20d1a8.xml (deflated 42%) 2024-06-26T06:49:11.3932199Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-be8a2c802adf8667.xml (deflated 41%) 2024-06-26T06:49:11.3933874Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-32238fc4a025dcba.xml (deflated 40%) 2024-06-26T06:49:11.3935524Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-078f5e05cd4fcf67.xml (deflated 35%) 2024-06-26T06:49:11.3937215Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-160b565bbd206d8b.xml (deflated 35%) 2024-06-26T06:49:11.3938892Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f95e52229378e307.xml (deflated 35%) 2024-06-26T06:49:11.3940569Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-376bd15e951e0a6d.xml (deflated 35%) 2024-06-26T06:49:11.3942230Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-97d0a8a23bdd9012.xml (deflated 45%) 2024-06-26T06:49:11.3943906Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a4a773ea4f3568fa.xml (deflated 43%) 2024-06-26T06:49:11.3945575Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-382d9b94522ec4cf.xml (deflated 36%) 2024-06-26T06:49:11.3947246Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-65ff267c15423f13.xml (deflated 36%) 2024-06-26T06:49:11.3948903Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-983a9326a614efac.xml (deflated 35%) 2024-06-26T06:49:11.3950663Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-63e33e990803f6bc.xml (deflated 42%) 2024-06-26T06:49:11.3952429Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f7bd7e2184c21821.xml (deflated 35%) 2024-06-26T06:49:11.3954108Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2279790c2ccf0429.xml (deflated 35%) 2024-06-26T06:49:11.3955770Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6eaee80a9b791ca4.xml (deflated 35%) 2024-06-26T06:49:11.3957439Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5a1348900b94997f.xml (deflated 35%) 2024-06-26T06:49:11.3959191Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fd65a497a7145721.xml (deflated 35%) 2024-06-26T06:49:11.3960857Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-86d605662654c7ed.xml (deflated 35%) 2024-06-26T06:49:11.3962519Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e1047e8f7ee2f35e.xml (deflated 41%) 2024-06-26T06:49:11.3964184Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee250d1802f34628.xml (deflated 42%) 2024-06-26T06:49:11.3965923Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-50a2baacaecba926.xml (deflated 43%) 2024-06-26T06:49:11.3967609Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6cbed0c28091cb7b.xml (deflated 43%) 2024-06-26T06:49:11.3969283Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1ab4ded49520631f.xml (deflated 36%) 2024-06-26T06:49:11.3970963Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c595c7624bd85530.xml (deflated 41%) 2024-06-26T06:49:11.3972640Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7d549eec8f0de590.xml (deflated 43%) 2024-06-26T06:49:11.3974319Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8ad69df7e5eb0272.xml (deflated 42%) 2024-06-26T06:49:11.3975977Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2f45b18f44294e5.xml (deflated 35%) 2024-06-26T06:49:11.3977642Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6d91eb60a3dbdb00.xml (deflated 36%) 2024-06-26T06:49:11.3979319Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a217823e050a499d.xml (deflated 35%) 2024-06-26T06:49:11.3980988Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-953ed7ca97ace3c4.xml (deflated 35%) 2024-06-26T06:49:11.3982649Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-991724cfa00086e9.xml (deflated 36%) 2024-06-26T06:49:11.3984324Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-efaf6ae7c6aafa90.xml (deflated 45%) 2024-06-26T06:49:11.3986004Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2f60be0fc104282a.xml (deflated 36%) 2024-06-26T06:49:11.3987680Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7853cb8be4baa0b9.xml (deflated 35%) 2024-06-26T06:49:11.3989337Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a9cd5c1186489c49.xml (deflated 35%) 2024-06-26T06:49:11.3991085Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-05cd05a20301efd3.xml (deflated 35%) 2024-06-26T06:49:11.3992859Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0d0f04a561f76db7.xml (deflated 36%) 2024-06-26T06:49:11.3994521Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ad603e23de5dcfd6.xml (deflated 35%) 2024-06-26T06:49:11.3996199Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0ab688fe4001f120.xml (deflated 36%) 2024-06-26T06:49:11.3997870Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5b197391db2f7346.xml (deflated 41%) 2024-06-26T06:49:11.3999613Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-979652be7517d696.xml (deflated 43%) 2024-06-26T06:49:11.4001393Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b1d15bf3717bf65.xml (deflated 44%) 2024-06-26T06:49:11.4003225Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4b8bca155d211526.xml (deflated 44%) 2024-06-26T06:49:11.4005510Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-26f19211282f51e6.xml (deflated 44%) 2024-06-26T06:49:11.4007384Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5f7ad2ed625500ad.xml (deflated 45%) 2024-06-26T06:49:11.4009059Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-907362c834b479a8.xml (deflated 42%) 2024-06-26T06:49:11.4010742Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a8768faa2680361c.xml (deflated 35%) 2024-06-26T06:49:11.4012419Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-00994603d84903fd.xml (deflated 42%) 2024-06-26T06:49:11.4014083Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9992977d75a53aa1.xml (deflated 35%) 2024-06-26T06:49:11.4015739Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-59acbb98ceb5bca7.xml (deflated 35%) 2024-06-26T06:49:11.4017444Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-03e71ec77f52e227.xml (deflated 42%) 2024-06-26T06:49:11.4019126Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-73ce6afa92fb80a1.xml (deflated 42%) 2024-06-26T06:49:11.4020813Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-42d1b5b77cac6701.xml (deflated 42%) 2024-06-26T06:49:11.4022483Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-63b5b21b336e03ff.xml (deflated 35%) 2024-06-26T06:49:11.4024172Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-265a7b9d0971a5a8.xml (deflated 42%) 2024-06-26T06:49:11.4025842Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e4e9fb6e39a8569c.xml (deflated 42%) 2024-06-26T06:49:11.4027517Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-438543e749baab87.xml (deflated 42%) 2024-06-26T06:49:11.4029170Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8303e8ed6d891fd4.xml (deflated 42%) 2024-06-26T06:49:11.4030841Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2505330c47a9176e.xml (deflated 42%) 2024-06-26T06:49:11.4032761Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-131188fd7112d779.xml (deflated 42%) 2024-06-26T06:49:11.4034452Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d62fc16e5a99adea.xml (deflated 43%) 2024-06-26T06:49:11.4036121Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8ae7c52fbe321333.xml (deflated 42%) 2024-06-26T06:49:11.4037798Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a1a2f97afd11de48.xml (deflated 41%) 2024-06-26T06:49:11.4039481Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c91c0dd3634f8254.xml (deflated 42%) 2024-06-26T06:49:11.4041267Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1d073bbf845af5b.xml (deflated 42%) 2024-06-26T06:49:11.4042933Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4f976310ae8364a5.xml (deflated 42%) 2024-06-26T06:49:11.4044665Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b9a3327ffd70b8dd.xml (deflated 42%) 2024-06-26T06:49:11.4046400Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43c8c853b32b3383.xml (deflated 42%) 2024-06-26T06:49:11.4048067Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1fd19117466609a.xml (deflated 42%) 2024-06-26T06:49:11.4049733Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1ac4da066e1852ed.xml (deflated 42%) 2024-06-26T06:49:11.4051412Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-043b845ba588443c.xml (deflated 42%) 2024-06-26T06:49:11.4053076Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-085e808a4da69207.xml (deflated 42%) 2024-06-26T06:49:11.4054792Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4c3183e222f1c51a.xml (deflated 42%) 2024-06-26T06:49:11.4056448Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-933cf040108b1909.xml (deflated 42%) 2024-06-26T06:49:11.4058108Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b6a294125728d63e.xml (deflated 42%) 2024-06-26T06:49:11.4059780Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-814ae524b0d633dc.xml (deflated 42%) 2024-06-26T06:49:11.4061461Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-029ac0b2894299e0.xml (deflated 43%) 2024-06-26T06:49:11.4063120Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f01938fb94a63a36.xml (deflated 42%) 2024-06-26T06:49:11.4064794Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-693f4d09e5bdefb3.xml (deflated 35%) 2024-06-26T06:49:11.4066496Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-43e9b1ef844add51.xml (deflated 35%) 2024-06-26T06:49:11.4068168Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-649dbf194cdde194.xml (deflated 36%) 2024-06-26T06:49:11.4069827Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-437beb48d0acf3de.xml (deflated 35%) 2024-06-26T06:49:11.4071562Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f3b1e93cf16c7957.xml (deflated 42%) 2024-06-26T06:49:11.4073334Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3793a920691ff2a5.xml (deflated 35%) 2024-06-26T06:49:11.4075008Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9da2a8ee6afe5bb7.xml (deflated 45%) 2024-06-26T06:49:11.4076678Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-018fe6d93bddd872.xml (deflated 45%) 2024-06-26T06:49:11.4078366Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1c51bd3bf17cbaf4.xml (deflated 45%) 2024-06-26T06:49:11.4080155Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-315e6c676255b5e9.xml (deflated 41%) 2024-06-26T06:49:11.4081837Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5030149d8f182fec.xml (deflated 41%) 2024-06-26T06:49:11.4083501Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8795fcdf515b8b8b.xml (deflated 42%) 2024-06-26T06:49:11.4085247Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-97decab6933de882.xml (deflated 42%) 2024-06-26T06:49:11.4086935Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc97268232a6e5d1.xml (deflated 41%) 2024-06-26T06:49:11.4088615Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7cc141338d3bf768.xml (deflated 41%) 2024-06-26T06:49:11.4090280Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-777392f124771d3b.xml (deflated 35%) 2024-06-26T06:49:11.4091953Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-59e44a7d1d7c2728.xml (deflated 35%) 2024-06-26T06:49:11.4093631Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1ad9c463cc2c6262.xml (deflated 35%) 2024-06-26T06:49:11.4095312Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-38e49044a36fb9c0.xml (deflated 35%) 2024-06-26T06:49:11.4096969Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-57f17b3bec047638.xml (deflated 46%) 2024-06-26T06:49:11.4098683Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a7574864de3527bc.xml (deflated 43%) 2024-06-26T06:49:11.4100363Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c37707153bf79d97.xml (deflated 36%) 2024-06-26T06:49:11.4102046Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-197d01f0d155202e.xml (deflated 36%) 2024-06-26T06:49:11.4103707Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-51c186acd550b814.xml (deflated 35%) 2024-06-26T06:49:11.4105392Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0ea9cddb11f98419.xml (deflated 42%) 2024-06-26T06:49:11.4107056Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-177468a6ed226abe.xml (deflated 35%) 2024-06-26T06:49:11.4108719Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6fb94af625df3734.xml (deflated 35%) 2024-06-26T06:49:11.4110379Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70c6c2281b928922.xml (deflated 35%) 2024-06-26T06:49:11.4112252Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a30914d3c2e0b64b.xml (deflated 35%) 2024-06-26T06:49:11.4113928Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-030a6037fe7d27cc.xml (deflated 35%) 2024-06-26T06:49:11.4115608Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-584d1340cac34a89.xml (deflated 35%) 2024-06-26T06:49:11.4117268Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ec21beb57d1485ac.xml (deflated 41%) 2024-06-26T06:49:11.4118954Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-545ac0eadf6879de.xml (deflated 42%) 2024-06-26T06:49:11.4120699Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3c4f6b8ca919f7d5.xml (deflated 43%) 2024-06-26T06:49:11.4122370Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-10c7120c2e6601e9.xml (deflated 43%) 2024-06-26T06:49:11.4124331Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-681a02474380c54b.xml (deflated 37%) 2024-06-26T06:49:11.4126669Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-90d0a6ee24871ef1.xml (deflated 37%) 2024-06-26T06:49:11.4128919Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-8332c2558d73f070.xml (deflated 48%) 2024-06-26T06:49:11.4131177Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-b0e0c2607099c9fb.xml (deflated 48%) 2024-06-26T06:49:11.4133414Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-7edbac6356c1a8e3.xml (deflated 48%) 2024-06-26T06:49:11.4135669Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-408feb81296258ff.xml (deflated 48%) 2024-06-26T06:49:11.4137915Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-20ca5890a45c1d1f.xml (deflated 37%) 2024-06-26T06:49:11.4140157Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-cb8cc1734b41cd5c.xml (deflated 37%) 2024-06-26T06:49:11.4142410Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-5ad6ab25b9db7dce.xml (deflated 48%) 2024-06-26T06:49:11.4144645Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-90ad27b61aff93ad.xml (deflated 48%) 2024-06-26T06:49:11.4146889Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-b83717beedbd54ef.xml (deflated 48%) 2024-06-26T06:49:11.4149130Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-ce8637ed59bc67e5.xml (deflated 48%) 2024-06-26T06:49:11.4190153Z ##[group]Run # Remove any previous usage logs if they exist 2024-06-26T06:49:11.4190788Z # Remove any previous usage logs if they exist 2024-06-26T06:49:11.4191554Z rm -f logs-*.zip 2024-06-26T06:49:11.4192368Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-06-26T06:49:11.4193319Z # so check to see if the file exists first 2024-06-26T06:49:11.4193800Z if [ -f 'usage_log.txt' ]; then 2024-06-26T06:49:11.4194318Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-06-26T06:49:11.4194793Z fi 2024-06-26T06:49:11.4195119Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-06-26T06:49:11.4195682Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-06-26T06:49:11.4196164Z fi 2024-06-26T06:49:11.4203332Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:11.4203825Z env: 2024-06-26T06:49:11.4204089Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:11.4204667Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:11.4205643Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_26688305465 2024-06-26T06:49:11.4206160Z ##[endgroup] 2024-06-26T06:49:11.4292253Z adding: usage_log.txt (deflated 92%) 2024-06-26T06:49:11.4551506Z adding: test/test-reports/distributed.tensor.parallel.test_tp_style_1.1_747fd1e0722f61cc_.log (deflated 91%) 2024-06-26T06:49:11.4553014Z adding: test/test-reports/distributed.pipelining.test_transformer_1.1_2a729b098b96d9b7_.log (deflated 54%) 2024-06-26T06:49:11.4554305Z adding: test/test-reports/distributed.optim.test_named_optimizer_1.1_ef8281dd1f419231_.log (deflated 34%) 2024-06-26T06:49:11.4555588Z adding: test/test-reports/distributed._tensor.debug.test_op_coverage_1.1_0867a780c1352b40_.log (deflated 55%) 2024-06-26T06:49:11.4556820Z adding: test/test-reports/distributed.test_distributed_spawn_1.3_4559487257a3af0c_.log (deflated 37%) 2024-06-26T06:49:11.4557990Z adding: test/test-reports/distributed._tools.test_mod_tracker_1.1_4218d5b8d21f83aa_.log (deflated 61%) 2024-06-26T06:49:11.4559196Z adding: test/test-reports/distributed.test_distributed_spawn_1.3_a796cf127c87612e_.log (deflated 37%) 2024-06-26T06:49:11.4560342Z adding: test/test-reports/distributed._tensor.test_api_1.1_dc62ce3daf826d03_.log (deflated 89%) 2024-06-26T06:49:11.4561496Z adding: test/test-reports/distributed._tensor.test_attention_1.1_fc0ad535c541ceef_.log (deflated 76%) 2024-06-26T06:49:11.4562703Z adding: test/test-reports/distributed._tensor.test_pointwise_ops_1.1_96bccd2620318d0f_.log (deflated 69%) 2024-06-26T06:49:11.4563925Z adding: test/test-reports/distributed._composable.test_contract_1.1_ca971da6659cd2a3_.log (deflated 64%) 2024-06-26T06:49:11.4575420Z adding: test/test-reports/distributed.test_distributed_spawn_1.3_4ec6f73eff7f76ed_.log (deflated 96%) 2024-06-26T06:49:11.4577523Z adding: test/test-reports/distributed._tensor.test_dtensor_1.1_215f8b787a866b55_.log (deflated 91%) 2024-06-26T06:49:11.4578722Z adding: test/test-reports/distributed.checkpoint.test_planner_1.1_a0bd0419fac154e5_.log (deflated 66%) 2024-06-26T06:49:11.4579933Z adding: test/test-reports/distributed._spmd.test_data_parallel_1.1_9d3cc76db8295f40_.log (stored 0%) 2024-06-26T06:49:11.4581116Z adding: test/test-reports/distributed.fsdp.test_shard_utils_1.1_dd176b6da9156580_.log (deflated 59%) 2024-06-26T06:49:11.4582349Z adding: test/test-reports/distributed.checkpoint.test_dedup_tensors_1.1_f9a2bf548ba23498_.log (deflated 52%) 2024-06-26T06:49:11.4598472Z adding: test/test-reports/distributed.test_distributed_spawn_1.3_9b606ef5c3647e24_.log (deflated 96%) 2024-06-26T06:49:11.4599672Z adding: test/test-reports/distributed._tools.test_mem_tracker_1.1_540da0d226c9229d_.log (deflated 64%) 2024-06-26T06:49:11.4600898Z adding: test/test-reports/distributed._tensor.debug.test_comm_mode_1.1_02d095a6051c3089_.log (deflated 61%) 2024-06-26T06:49:11.4602161Z adding: test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_0118fcdb0f59219e_.log (deflated 54%) 2024-06-26T06:49:11.4603452Z adding: test/test-reports/distributed._tensor.test_xla_integration_1.1_5dcb8b1320537c5a_.log (deflated 66%) 2024-06-26T06:49:11.4604784Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_state_1.1_bd02caf6120ddfa8_.log (deflated 72%) 2024-06-26T06:49:11.4606324Z adding: test/test-reports/distributed.test_distributed_spawn_3.3_429637734c3db2e1_.log (deflated 37%) 2024-06-26T06:49:11.4608998Z adding: test/test-reports/distributed._tensor.test_tensor_ops_1.1_35e3011167e180a3_.log (deflated 95%) 2024-06-26T06:49:11.4610238Z adding: test/test-reports/distributed.pipelining.test_stage_1.1_df3321adafa48f53_.log (deflated 2%) 2024-06-26T06:49:11.4611498Z adding: test/test-reports/distributed.pipelining.test_composability_1.1_5a24f5986d3d97f1_.log (deflated 3%) 2024-06-26T06:49:11.4612746Z adding: test/test-reports/distributed.checkpoint.test_fsspec_1.1_f9327b497561ff9f_.log (deflated 61%) 2024-06-26T06:49:11.4614003Z adding: test/test-reports/distributed._tools.test_fsdp2_mem_tracker_1.1_848a5d4a3ba875c9_.log (deflated 67%) 2024-06-26T06:49:11.4615448Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_init_1.1_7b1b2f59c6c8cded_.log (deflated 86%) 2024-06-26T06:49:11.4616841Z adding: test/test-reports/distributed.tensor.parallel.test_tp_random_state_1.1_1186c371af57cb9a_.log (deflated 55%) 2024-06-26T06:49:11.4618170Z adding: test/test-reports/distributed.checkpoint.e2e.test_pipeline_1.1_6b88b54d53b5bda4_.log (deflated 52%) 2024-06-26T06:49:11.4619454Z adding: test/test-reports/distributed._tensor.test_experimental_ops_1.1_da5320b74ca92f47_.log (deflated 74%) 2024-06-26T06:49:11.4620681Z adding: test/test-reports/distributed.test_distributed_spawn_3.3_7199a8dbc698a25d_.log (deflated 37%) 2024-06-26T06:49:11.4621868Z adding: test/test-reports/distributed._tensor.test_math_ops_1.1_7fcd01f8e57e745e_.log (deflated 89%) 2024-06-26T06:49:11.4623152Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_autograd_1.1_30c0e88285fd60d3_.log (deflated 67%) 2024-06-26T06:49:11.4624571Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_overlap_1.1_98663679bcc84a9b_.log (deflated 63%) 2024-06-26T06:49:11.4625842Z adding: test/test-reports/distributed.test_functional_api_1.1_8e15c86a5d55ee64_.log (deflated 85%) 2024-06-26T06:49:11.4627035Z adding: test/test-reports/distributed._tensor.test_redistribute_1.1_017f6b6fde2ebbfb_.log (deflated 92%) 2024-06-26T06:49:11.4628256Z adding: test/test-reports/distributed._composable.test_checkpoint_1.1_561f7706a32d325b_.log (deflated 69%) 2024-06-26T06:49:11.4629585Z adding: test/test-reports/distributed.tensor.parallel.test_ddp_2d_parallel_1.1_bdd3d7b2af08761d_.log (deflated 56%) 2024-06-26T06:49:11.4630848Z adding: test/test-reports/distributed.test_collective_utils_1.1_64e51beb2c2a9c72_.log (stored 0%) 2024-06-26T06:49:11.4632268Z adding: test/test-reports/distributed.test_compute_comm_reordering_1.1_db8c8b26ebfbd46f_.log (deflated 74%) 2024-06-26T06:49:11.4633616Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_memory_1.1_97082d08f32cda75_.log (deflated 55%) 2024-06-26T06:49:11.4638788Z adding: test/test-reports/distributed.test_distributed_spawn_3.3_2441055c656160a9_.log (deflated 96%) 2024-06-26T06:49:11.4639989Z adding: test/test-reports/distributed._tensor.test_matrix_ops_1.1_4573412258df8adc_.log (deflated 88%) 2024-06-26T06:49:11.4641255Z adding: test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_41d75288162f73f6_.log (deflated 72%) 2024-06-26T06:49:11.4642616Z adding: test/test-reports/distributed.tensor.parallel.test_tp_examples_1.1_73c2bb37ae91058e_.log (deflated 87%) 2024-06-26T06:49:11.4643958Z adding: test/test-reports/distributed.checkpoint.e2e.test_fine_tuning_1.1_426d4dc618491035_.log (deflated 53%) 2024-06-26T06:49:11.4645368Z adding: test/test-reports/distributed.checkpoint.test_dtensor_checkpoint_1.1_3644df267ea835a1_.log (deflated 55%) 2024-06-26T06:49:11.4646625Z adding: test/test-reports/distributed.elastic.timer.api_test_1.1_cff383df82905f1e_.log (stored 0%) 2024-06-26T06:49:11.4647989Z adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_compile_1.1_0038de5848672524_.log (deflated 57%) 2024-06-26T06:49:11.4649529Z adding: test/test-reports/distributed.checkpoint.test_fsdp_model_state_1.1_d4603ab10dd54d3f_.log (deflated 62%) 2024-06-26T06:49:11.4650897Z adding: test/test-reports/distributed.tensor.parallel.test_parallelize_api_1.1_7534bfc04a9cc5a1_.log (deflated 92%) 2024-06-26T06:49:11.4652324Z adding: test/test-reports/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion_1.1_88fd5620f2eadff6_.log (deflated 57%) 2024-06-26T06:49:11.4662230Z adding: test/test-reports/distributed.test_distributed_spawn_3.3_b9b3f3c4575b73e1_.log (deflated 96%) 2024-06-26T06:49:11.4663400Z adding: test/test-reports/distributed.test_c10d_logger_1.1_75ebcdf0ca2605bd_.log (deflated 60%) 2024-06-26T06:49:11.4664617Z adding: test/test-reports/distributed.checkpoint.test_checkpoint_1.1_53befa5d1fa2d6e1_.log (deflated 81%) 2024-06-26T06:49:11.4666047Z adding: test/test-reports/distributed.checkpoint.test_file_system_checkpoint_1.1_4493f5b2c40e4d17_.log (deflated 73%) 2024-06-26T06:49:11.4667472Z adding: test/test-reports/distributed.optim.test_apply_optimizer_in_backward_1.1_f20d65f5f128f8ec_.log (deflated 32%) 2024-06-26T06:49:11.4668881Z adding: test/test-reports/distributed.algorithms.ddp_comm_hooks.test_ddp_hooks_1.1_31324597c81e5fc8_.log (deflated 76%) 2024-06-26T06:49:11.4670197Z adding: test/test-reports/distributed.test_control_collectives_1.1_aeebcc5dc6636cfb_.log (deflated 78%) 2024-06-26T06:49:11.4671520Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_c9ad47246c1e841f_.log (stored 0%) 2024-06-26T06:49:11.4673204Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_832de4a822933bc8_.log (stored 0%) 2024-06-26T06:49:11.4674722Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_c900023f5fc1fc2d_.log (deflated 91%) 2024-06-26T06:49:11.4676184Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_678979686cec553d_.log (deflated 91%) 2024-06-26T06:49:11.4677472Z adding: test/test-reports/distributed.test_c10d_pypg_1.1_c1e1d3e4b0fe5d5c_.log (deflated 90%) 2024-06-26T06:49:11.4678633Z adding: test/test-reports/distributed.fsdp.test_fsdp_grad_acc_1.1_3def4833bb37c717_.log (deflated 74%) 2024-06-26T06:49:11.4679885Z adding: test/test-reports/distributed.fsdp.test_fsdp_clip_grad_norm_1.1_596c0b1ddb8dd58a_.log (deflated 69%) 2024-06-26T06:49:11.4681127Z adding: test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_62e5e95b8693cb81_.log (deflated 80%) 2024-06-26T06:49:11.4682341Z adding: test/test-reports/distributed.test_multi_threaded_pg_1.1_d6f380da57b3eb91_.log (deflated 86%) 2024-06-26T06:49:11.4683536Z adding: test/test-reports/distributed.fsdp.test_fsdp_core_1.1_1627dd254a9382db_.log (deflated 92%) 2024-06-26T06:49:11.4684701Z adding: test/test-reports/distributed.test_data_parallel_1.1_9226ba750bdb418b_.log (deflated 88%) 2024-06-26T06:49:11.4686015Z adding: test/test-reports/distributed.fsdp.test_hsdp_dtensor_state_dict_1.1_4a59bf002087a1f2_.log (deflated 79%) 2024-06-26T06:49:11.4687386Z adding: test/test-reports/distributed._shard.sharding_plan.test_sharding_plan_1.1_26f04bafb36fe8ba_.log (deflated 66%) 2024-06-26T06:49:11.4688665Z adding: test/test-reports/distributed.fsdp.test_fsdp_misc_1.1_d9d5868748d8e9d0_.log (deflated 90%) 2024-06-26T06:49:11.4689848Z adding: test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_27868875489104a0_.log (deflated 73%) 2024-06-26T06:49:11.4691018Z adding: test/test-reports/distributed.fsdp.test_utils_1.1_1d7a34f850993ada_.log (deflated 64%) 2024-06-26T06:49:11.4726212Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_1.3_ebbbb2f7b58aade8_.log (deflated 97%) 2024-06-26T06:49:11.4774631Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_3.3_4b7ee916f99152ad_.log (deflated 97%) 2024-06-26T06:49:11.4775936Z adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_init_1.1_ca01c1af3f61b99b_.log (deflated 67%) 2024-06-26T06:49:11.4777448Z adding: test/test-reports/distributed.fsdp.test_fsdp_mixed_precision_1.1_166d8e10ba6c2790_.log (deflated 92%) 2024-06-26T06:49:11.4778742Z adding: test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_620443949beff3fa_.log (deflated 86%) 2024-06-26T06:49:11.4780065Z adding: test/test-reports/distributed.test_c10d_spawn_gloo_1.1_ce99f03f90067b1a_.log (deflated 94%) 2024-06-26T06:49:11.4782441Z adding: test/test-reports/distributed._shard.sharded_tensor.test_sharded_tensor_1.1_960f96052911d96b_.log (deflated 91%) 2024-06-26T06:49:11.4783710Z adding: test/test-reports/distributed.test_c10d_spawn_ucc_1.1_6cf868192d9a1440_.log (deflated 92%) 2024-06-26T06:49:11.4786359Z adding: test/test-reports/distributed.test_c10d_common_1.1_98e1dbc7b6aa7cc0_.log (deflated 94%) 2024-06-26T06:49:11.4787808Z adding: test/test-reports/distributed.test_c10d_spawn_nccl_1.1_81c887b9da3cba62_.log (deflated 93%) 2024-06-26T06:49:11.4795960Z adding: test/test-reports/distributed.test_store_1.1_07b0649941227c4e_.log (deflated 95%) 2024-06-26T06:49:11.4797025Z adding: test/test-reports/distributed.test_launcher_1.1_00021a09e4508184_.log (deflated 58%) 2024-06-26T06:49:11.4798090Z adding: test/test-reports/distributed.test_c10d_nccl_1.1_9ae5d3f4555bd5af_.log (stored 0%) 2024-06-26T06:49:11.4799247Z adding: test/test-reports/distributed.elastic.events.lib_test_1.1_bfa502d5ea2f6aaf_.log (deflated 72%) 2024-06-26T06:49:11.4800479Z adding: test/test-reports/distributed.elastic.metrics.api_test_1.1_b324dbb88c685be9_.log (deflated 62%) 2024-06-26T06:49:11.4801802Z adding: test/test-reports/distributed.elastic.multiprocessing.api_test_1.1_e8220087c3df1da5_.log (deflated 89%) 2024-06-26T06:49:11.4803140Z adding: test/test-reports/distributed.elastic.timer.local_timer_test_1.1_17c3605fc07588f9_.log (deflated 77%) 2024-06-26T06:49:11.4804478Z adding: test/test-reports/distributed.elastic.timer.local_timer_example_1.1_89481ed730c7702d_.log (deflated 68%) 2024-06-26T06:49:11.4805887Z adding: test/test-reports/distributed.elastic.utils.distributed_test_1.1_7fcef1ddb2b1477f_.log (deflated 73%) 2024-06-26T06:49:11.4807202Z adding: test/test-reports/distributed.elastic.utils.logging_test_1.1_1e5a6cd1093e4310_.log (deflated 58%) 2024-06-26T06:49:11.4808468Z adding: test/test-reports/distributed.elastic.utils.util_test_1.1_b20a80f0063e7e08_.log (deflated 74%) 2024-06-26T06:49:11.4809848Z adding: test/test-reports/distributed.test_cuda_p2p_1.1_21f27fd055092cfa_.log (deflated 77%) 2024-06-26T06:49:11.4836057Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-06-26T06:49:11.4836786Z # Remove any previous debugging artifacts if they exist 2024-06-26T06:49:11.4837339Z rm -f debug-*.zip 2024-06-26T06:49:11.4837705Z if [ -d 'test/debug' ]; then 2024-06-26T06:49:11.4838197Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-06-26T06:49:11.4838662Z fi 2024-06-26T06:49:11.4845995Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:11.4846477Z env: 2024-06-26T06:49:11.4846759Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:11.4847359Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:11.4848138Z FILE_SUFFIX: test-distributed-2-2-linux.2xlarge_26688305465 2024-06-26T06:49:11.4848655Z ##[endgroup] 2024-06-26T06:49:11.4928638Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T06:49:11.4929063Z with: 2024-06-26T06:49:11.4929327Z s3-bucket: gha-artifacts 2024-06-26T06:49:11.4929738Z s3-prefix: pytorch/pytorch/9673645538/1/artifact 2024-06-26T06:49:11.4930185Z retention-days: 14 2024-06-26T06:49:11.4930505Z if-no-files-found: warn 2024-06-26T06:49:11.4930846Z path: test-jsons-*.zip 2024-06-26T06:49:11.4931156Z name: artifact 2024-06-26T06:49:11.4931453Z region: us-east-1 2024-06-26T06:49:11.4931732Z env: 2024-06-26T06:49:11.4931971Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:11.4932561Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:11.4933201Z ##[endgroup] 2024-06-26T06:49:11.8644320Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T06:49:11.8645450Z With the provided path, there will be 1 file uploaded 2024-06-26T06:49:11.8646335Z Uploading to s3 prefix: pytorch/pytorch/9673645538/1/artifact 2024-06-26T06:49:11.9903455Z Starting upload of test-jsons-test-distributed-2-2-linux.2xlarge_26688305465.zip 2024-06-26T06:49:12.1134194Z Finished upload of test-jsons-test-distributed-2-2-linux.2xlarge_26688305465.zip 2024-06-26T06:49:12.1261883Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T06:49:12.1262310Z with: 2024-06-26T06:49:12.1262579Z s3-bucket: gha-artifacts 2024-06-26T06:49:12.1262989Z s3-prefix: pytorch/pytorch/9673645538/1/artifact 2024-06-26T06:49:12.1263586Z retention-days: 14 2024-06-26T06:49:12.1263909Z if-no-files-found: error 2024-06-26T06:49:12.1264258Z path: test-reports-*.zip 2024-06-26T06:49:12.1264573Z name: artifact 2024-06-26T06:49:12.1264851Z region: us-east-1 2024-06-26T06:49:12.1265127Z env: 2024-06-26T06:49:12.1265376Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:12.1265963Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:12.1266602Z ##[endgroup] 2024-06-26T06:49:12.4735275Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T06:49:12.4736595Z With the provided path, there will be 1 file uploaded 2024-06-26T06:49:12.4737635Z Uploading to s3 prefix: pytorch/pytorch/9673645538/1/artifact 2024-06-26T06:49:12.4774611Z Starting upload of test-reports-test-distributed-2-2-linux.2xlarge_26688305465.zip 2024-06-26T06:49:12.6775759Z Finished upload of test-reports-test-distributed-2-2-linux.2xlarge_26688305465.zip 2024-06-26T06:49:12.6900629Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T06:49:12.6901070Z with: 2024-06-26T06:49:12.6901333Z s3-bucket: gha-artifacts 2024-06-26T06:49:12.6901747Z s3-prefix: pytorch/pytorch/9673645538/1/artifact 2024-06-26T06:49:12.6902191Z retention-days: 14 2024-06-26T06:49:12.6902510Z if-no-files-found: ignore 2024-06-26T06:49:12.6902870Z path: logs-*.zip 2024-06-26T06:49:12.6903145Z name: artifact 2024-06-26T06:49:12.6903428Z region: us-east-1 2024-06-26T06:49:12.6903704Z env: 2024-06-26T06:49:12.6903944Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:12.6904535Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:12.6905177Z ##[endgroup] 2024-06-26T06:49:13.0352338Z NOTE: s3-prefix specified, ignoring name parameter 2024-06-26T06:49:13.0353008Z With the provided path, there will be 1 file uploaded 2024-06-26T06:49:13.0353659Z Uploading to s3 prefix: pytorch/pytorch/9673645538/1/artifact 2024-06-26T06:49:13.0388997Z Starting upload of logs-test-distributed-2-2-linux.2xlarge_26688305465.zip 2024-06-26T06:49:13.2118182Z Finished upload of logs-test-distributed-2-2-linux.2xlarge_26688305465.zip 2024-06-26T06:49:13.2243992Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-06-26T06:49:13.2244422Z with: 2024-06-26T06:49:13.2244692Z s3-bucket: gha-artifacts 2024-06-26T06:49:13.2245226Z s3-prefix: pytorch/pytorch/9673645538/1/artifact 2024-06-26T06:49:13.2245676Z retention-days: 14 2024-06-26T06:49:13.2245999Z if-no-files-found: ignore 2024-06-26T06:49:13.2246340Z path: debug-*.zip 2024-06-26T06:49:13.2246621Z name: artifact 2024-06-26T06:49:13.2246905Z region: us-east-1 2024-06-26T06:49:13.2247181Z env: 2024-06-26T06:49:13.2247423Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:13.2248014Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:13.2248698Z ##[endgroup] 2024-06-26T06:49:13.5632322Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-06-26T06:49:13.5792318Z ##[group]Run # shellcheck disable=SC2156 2024-06-26T06:49:13.5792897Z # shellcheck disable=SC2156 2024-06-26T06:49:13.5793715Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-06-26T06:49:13.5801545Z shell: /usr/bin/bash -e {0} 2024-06-26T06:49:13.5801883Z env: 2024-06-26T06:49:13.5802143Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:13.5802722Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:13.5803364Z ##[endgroup] 2024-06-26T06:49:13.8237462Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-06-26T06:49:13.8238007Z with: 2024-06-26T06:49:13.8238239Z env: 2024-06-26T06:49:13.8238490Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:13.8239072Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:13.8239722Z ##[endgroup] 2024-06-26T06:49:13.8260353Z ##[group]Run set -eou pipefail 2024-06-26T06:49:13.8260896Z set -eou pipefail 2024-06-26T06:49:13.8261241Z  2024-06-26T06:49:13.8261744Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-06-26T06:49:13.8262380Z for _ in $(seq 1440); do 2024-06-26T06:49:13.8262842Z  # Break if no ssh session exists anymore 2024-06-26T06:49:13.8263332Z  if [ "$(who)" = "" ]; then 2024-06-26T06:49:13.8263714Z  break 2024-06-26T06:49:13.8264012Z  fi 2024-06-26T06:49:13.8264328Z  echo "." 2024-06-26T06:49:13.8264645Z  sleep 5 2024-06-26T06:49:13.8264941Z done 2024-06-26T06:49:13.8273384Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:13.8273887Z env: 2024-06-26T06:49:13.8274150Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:13.8274739Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:13.8275382Z ##[endgroup] 2024-06-26T06:49:13.8297314Z Holding runner for 2 hours until all ssh sessions have logged out 2024-06-26T06:49:13.8365110Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T06:49:13.8365937Z # ignore expansion of "docker ps -q" since it could be empty 2024-06-26T06:49:13.8366532Z # shellcheck disable=SC2046 2024-06-26T06:49:13.8366982Z docker stop $(docker ps -q) || true 2024-06-26T06:49:13.8367433Z # Prune all of the docker images 2024-06-26T06:49:13.8367871Z docker system prune -af 2024-06-26T06:49:13.8375179Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:13.8375672Z env: 2024-06-26T06:49:13.8375932Z GIT_DEFAULT_BRANCH: main 2024-06-26T06:49:13.8376512Z DOCKER_CONTAINER_ID: 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:13.8377157Z ##[endgroup] 2024-06-26T06:49:24.2037987Z 40a66d840031 2024-06-26T06:49:24.5723731Z Deleted Containers: 2024-06-26T06:49:24.5724469Z 40a66d84003121455964a5b33d2af2f1d6fb267f09508922598748ac12d6d4df 2024-06-26T06:49:24.5725154Z 2024-06-26T06:49:28.0987790Z Deleted Images: 2024-06-26T06:49:28.0989173Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:91382da70d5719cd7007b6b80b71d2f48398f6b7 2024-06-26T06:49:28.0991104Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11@sha256:1862f87fe60cbac0efa4720f6f6fe873270a315ff02a9510d48d1480259bc4e9 2024-06-26T06:49:28.0992781Z deleted: sha256:14402cfc353dbfa2ba1fa30f87c7ccf0e77a56d529c503e4a803c15ef3448962 2024-06-26T06:49:28.0993686Z deleted: sha256:c4b668a1ad3fb3b763ceeb3a66547f5fc09b8bd764f0062a1387f2f4f842e340 2024-06-26T06:49:28.0994599Z deleted: sha256:9e0c9058a83b79b9786d4e5bb0470c0262850b1d6aea22df279b8f3e1c2950c4 2024-06-26T06:49:28.0995629Z deleted: sha256:281571e65d91d16ba049b2833b2dde3aa1c2664a356d6157f6b35c113a3c8649 2024-06-26T06:49:28.0996495Z deleted: sha256:3d66dd8ed8d0784a5d245bb02e6f167a04c6655845cd5644370ba5a62e842272 2024-06-26T06:49:28.0997406Z deleted: sha256:a15ea8fd1fa6e97d11fd359096c95df8bc8a9af9cf8a51a3facf0eb7bad9fe1b 2024-06-26T06:49:28.0998281Z deleted: sha256:295dc0948a636fa3924b05041866db6626f9cc88d6cfa76f3532f61a00480e23 2024-06-26T06:49:28.0999146Z deleted: sha256:38a680ead4b5c015c28132d8223ee60983f1eac2b95b532e36fddb578ce42482 2024-06-26T06:49:28.1000013Z deleted: sha256:e5a82c91f9129d20c07608447221c64bf076d6f3fe2bb07faf516812e410da8f 2024-06-26T06:49:28.1001247Z deleted: sha256:d73f714a077af50db024bc1fd2444f16c27557cc96e93bad30376148147b415f 2024-06-26T06:49:28.1002460Z deleted: sha256:728c6da8b9d60375b1dc81787d3ccdc0d5c307bb373c6c00125cb845d37d5c10 2024-06-26T06:49:28.1003519Z deleted: sha256:0cd9350a208360297b2ce527623c50a3bf68186eb5399c56b69374cd6086cc50 2024-06-26T06:49:28.1004794Z deleted: sha256:5bc9ef03bfcd8d77a0d8af6b5989fcd2b1003e30f6fa659996b66c1d20d21025 2024-06-26T06:49:28.1006029Z deleted: sha256:78a6aa8bae559223884c5032eff98c7cca73d512fe223d614b2dcefdf3371d8b 2024-06-26T06:49:28.1007515Z deleted: sha256:0a2f3f76f96bb9a9b9140cb2711bcebaff2408a668284502d5ecfdfb92da4c50 2024-06-26T06:49:28.1008750Z deleted: sha256:35b68f9a682c7418f4e832da53b6bfd44889bfa5f7631f3d5eaf305a9e7ee312 2024-06-26T06:49:28.1009971Z deleted: sha256:5e5329bf94ea01ef9d0ce70d0e5c4e1d4f2512a430641c87e67d47573ebfcf7b 2024-06-26T06:49:28.1011190Z deleted: sha256:5609ea1cf24c59768b94b369598a390890a4e5f5544dc3b677f2e221e6a5ecb3 2024-06-26T06:49:28.1012523Z deleted: sha256:315afb4287c19fa61b991e8199421be2e242d1a29fbae56598625e66e7a9bc53 2024-06-26T06:49:28.1013693Z deleted: sha256:af642579485beff363b047a6737376cdc544eafa4e1db8c6cf7d8d875cde7a25 2024-06-26T06:49:28.1014863Z deleted: sha256:c835609211bf9fc1da173d4bcacbd0d04d57fdeb2e8036cd5dee8fa707cf9e4d 2024-06-26T06:49:28.1016110Z deleted: sha256:29a2e9fadb40fbf33f0ff1e16123fce6e8dd3090cb5c7bd755e8662936c7e7bb 2024-06-26T06:49:28.1017322Z deleted: sha256:839efd3e816ebb0385fb0b0394d64f44ed16af4626057798c1cfa28122f9bf7d 2024-06-26T06:49:28.1018483Z deleted: sha256:3f2502c497a5baa23c57bc8fc7c10abd8a6a448c0752b3bf29d4a0d82f6efc49 2024-06-26T06:49:28.1019727Z deleted: sha256:6cf9f28692acff1d9a0e46d0e00604b0eb1cca90d61287b7c2d4b2ee6dbc5167 2024-06-26T06:49:28.1020974Z deleted: sha256:eb36b3a0e2e450b56dc06d2655f4b091a56785af6a9e717e81ab54092c5c2100 2024-06-26T06:49:28.1022203Z deleted: sha256:5d435930e444677f1118f27453a281e8dcaaa746eb2eb5e1c74eb284c95e96e0 2024-06-26T06:49:28.1023410Z deleted: sha256:972bf551c6baa2c33f452c367d1ce2b4b56e6648e91a793fd9e9cec4308a0cde 2024-06-26T06:49:28.1024715Z deleted: sha256:c871181017d9cfde42ca3023b0dda86c9b3e33b4d734fd46a9aad894ba1ece49 2024-06-26T06:49:28.1025950Z deleted: sha256:31fcc18e5c72471e6d104fb96490aaf5f86d80b8959abd1649bf6bc37c7ff303 2024-06-26T06:49:28.1027193Z deleted: sha256:bb334a6aba089f108e2cb9937f20597e3c892b0d75b3f9d1bc0573215f64be64 2024-06-26T06:49:28.1028436Z deleted: sha256:b305692cd297d69d10a08bc107ff39cc6c1038a3b533fa5b7d798e90f777ff1a 2024-06-26T06:49:28.1029712Z deleted: sha256:4712c5b4638b608b8ddca9f6b337c58e7d396b872f365141b0772af2b1b63013 2024-06-26T06:49:28.1030961Z deleted: sha256:0b18957705c2ee8e3be564aa8aa57af17955b83616634f2dc2a3933e1bb9dbaf 2024-06-26T06:49:28.1032350Z deleted: sha256:e27827ac7ce7d5848f06b77890bd8c8becc86569eac77781e3c7f2301381f831 2024-06-26T06:49:28.1033606Z deleted: sha256:246ee1ea5f1498d711167f1822133c2e300501f725c64dcc0e973fe22feb4897 2024-06-26T06:49:28.1034858Z deleted: sha256:7620cd23ed588e59112e0f5578e30448c6d9f4de0e875929870da42d3dd060da 2024-06-26T06:49:28.1036110Z deleted: sha256:49e765a674b1865297af41869bdd809828c64b944b65469a14900b74c98943e6 2024-06-26T06:49:28.1037281Z deleted: sha256:53d422d72602186278f9d69dfb36ea243d49d1ef308d5aa6969b5c5ae2b3d5ec 2024-06-26T06:49:28.1038466Z deleted: sha256:b230252ce03a3e8af90d627f05b25a28e766298328ba5741b029cedd06b87eda 2024-06-26T06:49:28.1039769Z deleted: sha256:e02478373f52c109b749357f927fce863a248bbde8fa1b580933dfa336ec42e6 2024-06-26T06:49:28.1041252Z deleted: sha256:d5f1cfecd483d58b4d099db4f5b8d1aa64ac1b63b92e33b279549f55a8c427d7 2024-06-26T06:49:28.1042807Z deleted: sha256:9d7b0f79146aaf690751949446c7898f23d95ddaa419ffe66bbbe600c5e398fd 2024-06-26T06:49:28.1044355Z deleted: sha256:133da26422b32811689cf2cf0957386562d3cb5535adc94b5e57c8df987e043e 2024-06-26T06:49:28.1045732Z deleted: sha256:f2c71578e29cb9026fe9befb3e22645227b75f80f2a23a33d10b2db23ed2ffec 2024-06-26T06:49:28.1046943Z deleted: sha256:1b6f7c8ed5076766bbd0b62cf3828933328dd04dd3ac7f67c893e0ff97fae6a4 2024-06-26T06:49:28.1048170Z deleted: sha256:9597de82a03b18ac50bd0e6cb67679b2a2e7474ab6f2d3e94e0cd791debb59f1 2024-06-26T06:49:28.1049597Z deleted: sha256:3025c8170cf78d17d90b5bd8f433b41bd56c1d36f3e4f61c525189b8a4e63ae9 2024-06-26T06:49:28.1050812Z deleted: sha256:da61c466d61ad41a696250119e7b15ce0affe6f7c05938edd7878134807fdc80 2024-06-26T06:49:28.1052020Z deleted: sha256:f9d649f7c74f30382fe8c4934c19523b530e703abc60dbed49cad3fb17439166 2024-06-26T06:49:28.1053276Z deleted: sha256:ad91cb5ba8ab9a60d6271cec45b17cf019a826de82f473e9f1d1c02be0bc87d7 2024-06-26T06:49:28.1054351Z deleted: sha256:66a3cccbab7f9aa795dd6525c9238f778ae8fd7cfee31ffaa5fa334c6930214e 2024-06-26T06:49:28.1055420Z deleted: sha256:d5b66fb279a5b5596d9677908d317ef8f9c930cd1678f1ed7bfec0bf3d7a2c7f 2024-06-26T06:49:28.1056281Z deleted: sha256:de19e642015fb5277f1c9618adb9e0ae59cb73f3167d6cd1cf85977e430c1c8a 2024-06-26T06:49:28.1057181Z deleted: sha256:23ebfc51638f59d3cf2afcdebe5ad50a1a3325f9a25644c6f44b4ca9cf63cb56 2024-06-26T06:49:28.1058078Z deleted: sha256:c66c35c24cb2016e5bdbd103a7d88d169e0912c20082f6026bf28572302bca2a 2024-06-26T06:49:28.1058977Z deleted: sha256:9df358fe90e28361509b9ccf28e28e988a01f3f012f1b8308b0436e63113e00e 2024-06-26T06:49:28.1059833Z deleted: sha256:77df668148b1ee21bda8c56873f9e699b450760d826ec7ba4ee5a3decffa4c4c 2024-06-26T06:49:28.1060769Z deleted: sha256:20c85858580ea8c74bb79583a0fa268920ab56eb74e2d3f8a16c99d04d993dbd 2024-06-26T06:49:28.1061697Z deleted: sha256:c29b6190a2dc284ffeb328c07d4cc6c08a62aa5bc906a8af2d3f4e9e7d616101 2024-06-26T06:49:28.1062546Z deleted: sha256:354a706e4175a494886b3fc00497a52e61e0b9182e65faafb81ca602fc50b9f8 2024-06-26T06:49:28.1063502Z deleted: sha256:b475fa4d78c647583c017557e0d52b89b02263bd0cbdc4e55513511e0389af5d 2024-06-26T06:49:28.1064385Z deleted: sha256:df429193461053897fd469ddc8575e0d22fd27195147467cd22a8de72b252572 2024-06-26T06:49:28.1065268Z deleted: sha256:546680950a9ec09b3d1fff5bb37f8f5a7be287361564edd1ab44b691a07170c0 2024-06-26T06:49:28.1066165Z deleted: sha256:30e429e6fa1090247d58a8d8fcf7c10ed315d655c2882862d371cb1233f5fbe5 2024-06-26T06:49:28.1067024Z deleted: sha256:879a64e7fbc80c207de24373169c42cd4600fbd269614eb0631b70a56ac31c85 2024-06-26T06:49:28.1067924Z deleted: sha256:1f56afc7e6f4e91762a39d84b1ac902311d44683310fed82cfda29946d3b4f25 2024-06-26T06:49:28.1068750Z deleted: sha256:36c2783a09c6f553169a309d5191749c61296036f773a179e627284eab60f566 2024-06-26T06:49:28.1069629Z deleted: sha256:91ca7f1473e6c57eb999257df6da385e3c8a232d4f80b3e6c41ae986a14f08ea 2024-06-26T06:49:28.1070507Z deleted: sha256:6251f30f7423f7450abe933294854c29f56aeb24bcbdab4c6a06865e26e891ce 2024-06-26T06:49:28.1071401Z deleted: sha256:772d8b14c387cf9f67eb73651e69b3684aea6ac72bbfb8631dc2236831f532d9 2024-06-26T06:49:28.1072439Z deleted: sha256:b8c522eb18282cc42a40578f402f1714ac062f5ce58a3732c5a0b6609e371260 2024-06-26T06:49:28.1073313Z deleted: sha256:88fd863ad524e67157a3707a0e9a59ced4facd9994ccb4989f82b2b0c23fbadd 2024-06-26T06:49:28.1074153Z deleted: sha256:46b008f910d099393c32e0861ef497123fe9e38cc7858e6a78ff14d8ccf2433c 2024-06-26T06:49:28.1074998Z deleted: sha256:a87e255b7d2582715a3500969c08d892a7ff7bc89f8f26ae3264f1d85f8d50e7 2024-06-26T06:49:28.1075866Z deleted: sha256:e05af56d19ba382a9328ae93507d49fb99d75f392ed1b99236cfc53f407cd14e 2024-06-26T06:49:28.1076762Z deleted: sha256:621f607deeddafca7a75985f6fe803edddbd213ab6e757ecb93defd50850b3e0 2024-06-26T06:49:28.1077647Z deleted: sha256:fa4053ca3b4a7c3fc53056830ba5d1a41c6e9a2da86e90677c1de6cd8636699c 2024-06-26T06:49:28.1078517Z deleted: sha256:d955717953fc80b77138de68c47f0f7f417576fd714ce7ebbc2cb917df7f6268 2024-06-26T06:49:28.1079410Z deleted: sha256:f9cf157ccc61ef3b6fdfc8f28e3dffb58f608b21828ec1a75642a0d9badb4d74 2024-06-26T06:49:28.1080279Z deleted: sha256:9261bd664cae980bd33b489dd2229fcd22847263f763b43832c1a015128cde41 2024-06-26T06:49:28.1081171Z deleted: sha256:e8cbc6c23a323bd7a81fbb2abc078c62657cf6e4bbc024ce4f063c77dfa50f58 2024-06-26T06:49:28.1082076Z deleted: sha256:fc8041ead5e87fe711b5f8dcc3fcf3fb4e4378c1418b75cf248ec6ad01741146 2024-06-26T06:49:28.1082963Z deleted: sha256:c329a10c164aabb156ea9b5b7dd8ee139b33adcd80d02bddeb3b3ea0f4616840 2024-06-26T06:49:28.1083990Z deleted: sha256:08d22634590731d16719d71fa2d6119d947039f3a0ddba37975efcc18ddb1507 2024-06-26T06:49:28.1084942Z deleted: sha256:f52ec5d2b34fa58954c6dcfd982e9105eada4bba8d778e92e9a5c9e35974d195 2024-06-26T06:49:28.1085853Z deleted: sha256:7ebf40b5d1e427bdc6bc5ba2f4ba8006c0751f355c0a9c490f30dce5e99eeb84 2024-06-26T06:49:28.1086715Z deleted: sha256:99d7f78132e9c56c11631e93df699c00b711b24dac63bd7647482aa09bbb2499 2024-06-26T06:49:28.1087609Z deleted: sha256:e1c9e2fcf63c9e2d26bcadb74d498117b52d26b81430bb4bd8c96fb10b56ce20 2024-06-26T06:49:28.1088614Z deleted: sha256:afeb82ca9283ee35825ff0076df5b812574ec06cb7be63890358fa5763711749 2024-06-26T06:49:28.1089478Z deleted: sha256:b74cfe809a40a9e9adabaca01482497767195c2918e8987122c5774242e36bed 2024-06-26T06:49:28.1090364Z deleted: sha256:ab9798e1fd9865efbbe7dd0681d45687b38a292b7bdbc1d69c625999508e28fe 2024-06-26T06:49:28.1091256Z deleted: sha256:0b9c994b0484c0bc61f9de7c28a58745a504704254c5e8ed12349ebee3393a66 2024-06-26T06:49:28.1091769Z 2024-06-26T06:49:28.1091935Z Total reclaimed space: 15.04GB 2024-06-26T06:49:28.1168797Z Post job cleanup. 2024-06-26T06:49:28.1227155Z Post job cleanup. 2024-06-26T06:49:28.2112956Z [command]/usr/bin/git version 2024-06-26T06:49:28.2153148Z git version 2.40.1 2024-06-26T06:49:28.2190246Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/d4dc0191-26d3-40ba-8a88-f873624f9ed3' before making global git config changes 2024-06-26T06:49:28.2191551Z Adding repository directory to the temporary git global config as a safe directory 2024-06-26T06:49:28.2195864Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-06-26T06:49:28.2240347Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-06-26T06:49:28.2270335Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-06-26T06:49:28.2599113Z Entering 'android/libs/fbjni' 2024-06-26T06:49:28.2648626Z Entering 'third_party/FP16' 2024-06-26T06:49:28.2696808Z Entering 'third_party/FXdiv' 2024-06-26T06:49:28.2743548Z Entering 'third_party/NNPACK' 2024-06-26T06:49:28.2792838Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T06:49:28.2835219Z Entering 'third_party/XNNPACK' 2024-06-26T06:49:28.2960756Z Entering 'third_party/benchmark' 2024-06-26T06:49:28.3010258Z Entering 'third_party/cpp-httplib' 2024-06-26T06:49:28.3055466Z Entering 'third_party/cpuinfo' 2024-06-26T06:49:28.3107408Z Entering 'third_party/cudnn_frontend' 2024-06-26T06:49:28.3148999Z Entering 'third_party/cutlass' 2024-06-26T06:49:28.3199052Z Entering 'third_party/eigen' 2024-06-26T06:49:28.3257455Z Entering 'third_party/fbgemm' 2024-06-26T06:49:28.3321482Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T06:49:28.3378709Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T06:49:28.3438830Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T06:49:28.3536216Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T06:49:28.3593735Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T06:49:28.3639408Z Entering 'third_party/flatbuffers' 2024-06-26T06:49:28.3683865Z Entering 'third_party/fmt' 2024-06-26T06:49:28.3733760Z Entering 'third_party/foxi' 2024-06-26T06:49:28.3781633Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T06:49:28.3829871Z Entering 'third_party/gloo' 2024-06-26T06:49:28.3880536Z Entering 'third_party/googletest' 2024-06-26T06:49:28.3933736Z Entering 'third_party/ideep' 2024-06-26T06:49:28.3991959Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T06:49:28.4081696Z Entering 'third_party/ittapi' 2024-06-26T06:49:28.4124234Z Entering 'third_party/kineto' 2024-06-26T06:49:28.4165365Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T06:49:28.4206586Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T06:49:28.4248628Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T06:49:28.4290112Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T06:49:28.4330677Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T06:49:28.4369637Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T06:49:28.4412091Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T06:49:28.4452472Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T06:49:28.4493621Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T06:49:28.4534979Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T06:49:28.4576934Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T06:49:28.4617290Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T06:49:28.4658123Z Entering 'third_party/mimalloc' 2024-06-26T06:49:28.4699285Z Entering 'third_party/nccl/nccl' 2024-06-26T06:49:28.4751829Z Entering 'third_party/nlohmann' 2024-06-26T06:49:28.4794884Z Entering 'third_party/onnx' 2024-06-26T06:49:28.4913624Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T06:49:28.4968786Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T06:49:28.5017754Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T06:49:28.5061113Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T06:49:28.5101201Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T06:49:28.5141180Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T06:49:28.5180488Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T06:49:28.5221256Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T06:49:28.5261073Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T06:49:28.5300014Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T06:49:28.5340869Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T06:49:28.5383549Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T06:49:28.5425713Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T06:49:28.5487880Z Entering 'third_party/pocketfft' 2024-06-26T06:49:28.5530526Z Entering 'third_party/protobuf' 2024-06-26T06:49:28.5577140Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T06:49:28.5619341Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T06:49:28.5662317Z Entering 'third_party/psimd' 2024-06-26T06:49:28.5705544Z Entering 'third_party/pthreadpool' 2024-06-26T06:49:28.5747027Z Entering 'third_party/pybind11' 2024-06-26T06:49:28.5788601Z Entering 'third_party/python-peachpy' 2024-06-26T06:49:28.5829384Z Entering 'third_party/sleef' 2024-06-26T06:49:28.5869961Z Entering 'third_party/tensorpipe' 2024-06-26T06:49:28.5910772Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T06:49:28.5951399Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T06:49:28.5993125Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T06:49:28.6035087Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T06:49:28.6075468Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T06:49:28.6133039Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-06-26T06:49:28.6156742Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6165901Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-06-26T06:49:28.6197074Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-06-26T06:49:28.6445538Z Entering 'android/libs/fbjni' 2024-06-26T06:49:28.6472247Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6498783Z Entering 'third_party/FP16' 2024-06-26T06:49:28.6526371Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6552997Z Entering 'third_party/FXdiv' 2024-06-26T06:49:28.6579567Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6608624Z Entering 'third_party/NNPACK' 2024-06-26T06:49:28.6636089Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6663623Z Entering 'third_party/VulkanMemoryAllocator' 2024-06-26T06:49:28.6691318Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6719892Z Entering 'third_party/XNNPACK' 2024-06-26T06:49:28.6746895Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6791349Z Entering 'third_party/benchmark' 2024-06-26T06:49:28.6818876Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6845862Z Entering 'third_party/cpp-httplib' 2024-06-26T06:49:28.6872972Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6900113Z Entering 'third_party/cpuinfo' 2024-06-26T06:49:28.6926773Z http.https://github.com/.extraheader 2024-06-26T06:49:28.6955661Z Entering 'third_party/cudnn_frontend' 2024-06-26T06:49:28.6982234Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7010623Z Entering 'third_party/cutlass' 2024-06-26T06:49:28.7038314Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7075797Z Entering 'third_party/eigen' 2024-06-26T06:49:28.7102605Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7132177Z Entering 'third_party/fbgemm' 2024-06-26T06:49:28.7160317Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7188005Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-06-26T06:49:28.7214175Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7242375Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-06-26T06:49:28.7268173Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7295270Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-06-26T06:49:28.7320675Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7356395Z Entering 'third_party/fbgemm/third_party/googletest' 2024-06-26T06:49:28.7382109Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7408532Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-06-26T06:49:28.7435587Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7462952Z Entering 'third_party/flatbuffers' 2024-06-26T06:49:28.7489976Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7520315Z Entering 'third_party/fmt' 2024-06-26T06:49:28.7546526Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7574352Z Entering 'third_party/foxi' 2024-06-26T06:49:28.7601113Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7628230Z Entering 'third_party/gemmlowp/gemmlowp' 2024-06-26T06:49:28.7655262Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7681890Z Entering 'third_party/gloo' 2024-06-26T06:49:28.7709380Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7736569Z Entering 'third_party/googletest' 2024-06-26T06:49:28.7763453Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7790598Z Entering 'third_party/ideep' 2024-06-26T06:49:28.7817715Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7843404Z Entering 'third_party/ideep/mkl-dnn' 2024-06-26T06:49:28.7870133Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7904686Z Entering 'third_party/ittapi' 2024-06-26T06:49:28.7933053Z http.https://github.com/.extraheader 2024-06-26T06:49:28.7960191Z Entering 'third_party/kineto' 2024-06-26T06:49:28.7987650Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8014725Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-06-26T06:49:28.8041858Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8069073Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-06-26T06:49:28.8095526Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8124343Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-06-26T06:49:28.8150318Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8178297Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-06-26T06:49:28.8204967Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8234220Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-06-26T06:49:28.8260257Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8287823Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-06-26T06:49:28.8314945Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8344129Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-06-26T06:49:28.8371731Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8399929Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-06-26T06:49:28.8426760Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8454922Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-06-26T06:49:28.8481670Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8510347Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-06-26T06:49:28.8537268Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8566052Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-06-26T06:49:28.8593429Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8620197Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-06-26T06:49:28.8646836Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8676175Z Entering 'third_party/mimalloc' 2024-06-26T06:49:28.8707421Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8735255Z Entering 'third_party/nccl/nccl' 2024-06-26T06:49:28.8763159Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8791264Z Entering 'third_party/nlohmann' 2024-06-26T06:49:28.8818401Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8848232Z Entering 'third_party/onnx' 2024-06-26T06:49:28.8876499Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8921025Z Entering 'third_party/onnx/third_party/benchmark' 2024-06-26T06:49:28.8948438Z http.https://github.com/.extraheader 2024-06-26T06:49:28.8977904Z Entering 'third_party/onnx/third_party/pybind11' 2024-06-26T06:49:28.9005479Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9035130Z Entering 'third_party/opentelemetry-cpp' 2024-06-26T06:49:28.9063220Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9093930Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-06-26T06:49:28.9120802Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9148686Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-06-26T06:49:28.9175851Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9202937Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-06-26T06:49:28.9228711Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9255912Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-06-26T06:49:28.9282503Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9311062Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-06-26T06:49:28.9337194Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9364542Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-06-26T06:49:28.9390501Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9417671Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-06-26T06:49:28.9445129Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9472187Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-06-26T06:49:28.9499357Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9528913Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-06-26T06:49:28.9556976Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9586765Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-06-26T06:49:28.9613968Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9663024Z Entering 'third_party/pocketfft' 2024-06-26T06:49:28.9691297Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9719042Z Entering 'third_party/protobuf' 2024-06-26T06:49:28.9746597Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9777138Z Entering 'third_party/protobuf/third_party/benchmark' 2024-06-26T06:49:28.9804608Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9831581Z Entering 'third_party/protobuf/third_party/googletest' 2024-06-26T06:49:28.9858222Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9887760Z Entering 'third_party/psimd' 2024-06-26T06:49:28.9916821Z http.https://github.com/.extraheader 2024-06-26T06:49:28.9945513Z Entering 'third_party/pthreadpool' 2024-06-26T06:49:28.9972845Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0001906Z Entering 'third_party/pybind11' 2024-06-26T06:49:29.0028952Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0057727Z Entering 'third_party/python-peachpy' 2024-06-26T06:49:29.0085382Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0111924Z Entering 'third_party/sleef' 2024-06-26T06:49:29.0139391Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0167829Z Entering 'third_party/tensorpipe' 2024-06-26T06:49:29.0195499Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0223255Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-06-26T06:49:29.0249487Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0276901Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-06-26T06:49:29.0302811Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0330734Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-06-26T06:49:29.0356791Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0384124Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-06-26T06:49:29.0410986Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0438048Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-06-26T06:49:29.0464676Z http.https://github.com/.extraheader 2024-06-26T06:49:29.0588121Z A job completed hook has been configured by the self-hosted runner administrator 2024-06-26T06:49:29.0608688Z ##[group]Run '/home/ec2-user/runner-scripts/cleanup.sh' 2024-06-26T06:49:29.0615543Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-06-26T06:49:29.0616059Z ##[endgroup] 2024-06-26T06:49:29.8130976Z Cleaning up orphan processes