2024-08-06T20:21:40.9954797Z Current runner version: '2.318.0' 2024-08-06T20:21:40.9962023Z Runner name: 'i-0035969de18878034' 2024-08-06T20:21:40.9962934Z Runner group name: 'Default' 2024-08-06T20:21:40.9964024Z Machine name: 'ip-10-0-41-185' 2024-08-06T20:21:40.9968744Z ##[group]GITHUB_TOKEN Permissions 2024-08-06T20:21:40.9971627Z Actions: read 2024-08-06T20:21:40.9972308Z Attestations: read 2024-08-06T20:21:40.9972998Z Checks: read 2024-08-06T20:21:40.9973574Z Contents: read 2024-08-06T20:21:40.9974194Z Deployments: read 2024-08-06T20:21:40.9975137Z Discussions: read 2024-08-06T20:21:40.9975718Z Issues: read 2024-08-06T20:21:40.9976334Z Metadata: read 2024-08-06T20:21:40.9977063Z Packages: read 2024-08-06T20:21:40.9977655Z Pages: read 2024-08-06T20:21:40.9978253Z PullRequests: read 2024-08-06T20:21:40.9978952Z RepositoryProjects: read 2024-08-06T20:21:40.9979627Z SecurityEvents: read 2024-08-06T20:21:40.9980286Z Statuses: read 2024-08-06T20:21:40.9980939Z ##[endgroup] 2024-08-06T20:21:40.9984310Z Secret source: Actions 2024-08-06T20:21:40.9985320Z Prepare workflow directory 2024-08-06T20:21:41.3043251Z Prepare all required actions 2024-08-06T20:21:41.3087783Z Getting action download info 2024-08-06T20:21:41.4846588Z Download action repository 'pytorch/test-infra@main' (SHA:a1f5a89251fc4258ab59806094fe3108f7d6741a) 2024-08-06T20:21:42.7106507Z Download action repository 'pytorch/pytorch@main' (SHA:de00c7958301ce81b9716bdef5731ed40d4d14ca) 2024-08-06T20:21:52.8931939Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2024-08-06T20:21:53.2459283Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2024-08-06T20:21:53.4944425Z Getting action download info 2024-08-06T20:21:53.6043244Z Download action repository 'malfet/checkout@silent-checkout' (SHA:e07af140b3ccefc05679e3755b9db68f4ee4589c) 2024-08-06T20:21:53.9041029Z Getting action download info 2024-08-06T20:21:54.0235863Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2024-08-06T20:21:54.1890252Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/pull/132710/merge (bf5bb5a1585a03379137fab341e87c02c77e76cd) 2024-08-06T20:21:54.1892363Z ##[group] Inputs 2024-08-06T20:21:54.1892709Z build-environment: linux-jammy-py3.8-gcc11 2024-08-06T20:21:54.1895540Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}]} 2024-08-06T20:21:54.1898689Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:21:54.1899446Z sync-tag: 2024-08-06T20:21:54.1900230Z timeout-minutes: 240 2024-08-06T20:21:54.1900511Z use-gha: 2024-08-06T20:21:54.1900752Z dashboard-tag: 2024-08-06T20:21:54.1900994Z s3-bucket: gha-artifacts 2024-08-06T20:21:54.1901276Z aws-role-to-assume: 2024-08-06T20:21:54.1901561Z ##[endgroup] 2024-08-06T20:21:54.1901995Z Complete job name: linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:21:54.2361787Z A job started hook has been configured by the self-hosted runner administrator 2024-08-06T20:21:54.2466910Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2024-08-06T20:21:54.2476727Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:21:54.2477461Z ##[endgroup] 2024-08-06T20:21:55.7745737Z Runner Type: amz2023.linux.2xlarge 2024-08-06T20:21:55.7746272Z Instance Type: c5.2xlarge 2024-08-06T20:21:55.7746625Z AMI Name: al2023-ami-2023.5.20240701.0-kernel-6.1-x86_64 2024-08-06T20:21:55.7747008Z AMI ID: ami-06c68f701d8090592 2024-08-06T20:22:01.5095349Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2024-08-06T20:22:01.5095834Z with: 2024-08-06T20:22:01.5096543Z github-secret: *** 2024-08-06T20:22:01.5097288Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-06T20:22:01.5098081Z activate-with-label: false 2024-08-06T20:22:01.5098369Z label: with-ssh 2024-08-06T20:22:01.5098613Z remove-existing-keys: true 2024-08-06T20:22:01.5098903Z fail-silently: true 2024-08-06T20:22:01.5099162Z env: 2024-08-06T20:22:01.5099416Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:22:01.5099691Z ##[endgroup] 2024-08-06T20:22:01.5929625Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2024-08-06T20:22:01.9359996Z Grabbing public ssh keys from https://github.com/drisspg.keys 2024-08-06T20:22:02.0045716Z ~/.ssh/authorized_keys file found on node, removing ~/.ssh and starting fresh 2024-08-06T20:22:02.0058658Z Public keys pulled and installed to /home/ec2-user/.ssh/authorized_keys 2024-08-06T20:22:02.0084808Z Login using: ssh ec2-user@ec2-3-95-33-222.compute-1.amazonaws.com 2024-08-06T20:22:02.0085505Z All testing is done inside the container, to start an interactive session run: 2024-08-06T20:22:02.0086188Z docker exec -it $(docker container ps --format '{{.ID}}') bash 2024-08-06T20:22:02.0252596Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2024-08-06T20:22:02.0253039Z with: 2024-08-06T20:22:02.0253280Z submodules: recursive 2024-08-06T20:22:02.0253566Z fetch-depth: 0 2024-08-06T20:22:02.0253795Z env: 2024-08-06T20:22:02.0254021Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:22:02.0254282Z ##[endgroup] 2024-08-06T20:22:02.0335133Z ##[group]Run retry () { 2024-08-06T20:22:02.0335471Z retry () { 2024-08-06T20:22:02.0335816Z  $* || (sleep 1 && $*) || (sleep 2 && $*) || (sleep 4 && $*) || (sleep 8 && $*) 2024-08-06T20:22:02.0336216Z } 2024-08-06T20:22:02.0336463Z echo "${GITHUB_WORKSPACE}" 2024-08-06T20:22:02.0336779Z if [ -z "${NO_SUDO}" ]; then 2024-08-06T20:22:02.0337134Z  retry sudo rm -rf "${GITHUB_WORKSPACE}" 2024-08-06T20:22:02.0337479Z else 2024-08-06T20:22:02.0337734Z  retry rm -rf "${GITHUB_WORKSPACE}" 2024-08-06T20:22:02.0338062Z fi 2024-08-06T20:22:02.0338355Z mkdir "${GITHUB_WORKSPACE}" 2024-08-06T20:22:02.0346437Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:22:02.0346841Z env: 2024-08-06T20:22:02.0347053Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:22:02.0347335Z NO_SUDO: 2024-08-06T20:22:02.0347557Z ##[endgroup] 2024-08-06T20:22:02.0373655Z /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-06T20:22:04.1818800Z ##[group]Run malfet/checkout@silent-checkout 2024-08-06T20:22:04.1819193Z with: 2024-08-06T20:22:04.1819435Z ref: b9d86fa89636e301796d4201f36d86c73f6e49bc 2024-08-06T20:22:04.1819784Z fetch-depth: 0 2024-08-06T20:22:04.1820039Z submodules: recursive 2024-08-06T20:22:04.1820293Z quiet-checkout: true 2024-08-06T20:22:04.1820571Z repository: pytorch/pytorch 2024-08-06T20:22:04.1820968Z token: *** 2024-08-06T20:22:04.1821201Z ssh-strict: true 2024-08-06T20:22:04.1821446Z persist-credentials: true 2024-08-06T20:22:04.1821728Z clean: true 2024-08-06T20:22:04.1821989Z sparse-checkout-cone-mode: true 2024-08-06T20:22:04.1822294Z lfs: false 2024-08-06T20:22:04.1822529Z set-safe-directory: true 2024-08-06T20:22:04.1822782Z env: 2024-08-06T20:22:04.1822996Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:22:04.1823466Z ##[endgroup] 2024-08-06T20:22:04.2756138Z Syncing repository: pytorch/pytorch 2024-08-06T20:22:04.2757514Z ##[group]Getting Git version info 2024-08-06T20:22:04.2758020Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-06T20:22:04.2758709Z [command]/usr/bin/git version 2024-08-06T20:22:04.2758993Z git version 2.40.1 2024-08-06T20:22:04.2765702Z ##[endgroup] 2024-08-06T20:22:04.2779240Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/46d6fba8-ddd4-466f-af6f-1a72795ad807' before making global git config changes 2024-08-06T20:22:04.2780251Z Adding repository directory to the temporary git global config as a safe directory 2024-08-06T20:22:04.2784250Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-06T20:22:04.2822922Z Deleting the contents of '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2024-08-06T20:22:04.2826478Z ##[group]Initializing the repository 2024-08-06T20:22:04.2829124Z [command]/usr/bin/git init /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-06T20:22:04.2858994Z hint: Using 'master' as the name for the initial branch. This default branch name 2024-08-06T20:22:04.2859664Z hint: is subject to change. To configure the initial branch name to use in all 2024-08-06T20:22:04.2860267Z hint: of your new repositories, which will suppress this warning, call: 2024-08-06T20:22:04.2860697Z hint: 2024-08-06T20:22:04.2861042Z hint: git config --global init.defaultBranch 2024-08-06T20:22:04.2861429Z hint: 2024-08-06T20:22:04.2861925Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-08-06T20:22:04.2862972Z hint: 'development'. The just-created branch can be renamed via this command: 2024-08-06T20:22:04.2864093Z hint: 2024-08-06T20:22:04.2864491Z hint: git branch -m 2024-08-06T20:22:04.2865444Z Initialized empty Git repository in /home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/ 2024-08-06T20:22:04.2871310Z [command]/usr/bin/git remote add origin https://github.com/pytorch/pytorch 2024-08-06T20:22:04.2901815Z ##[endgroup] 2024-08-06T20:22:04.2902569Z ##[group]Disabling automatic garbage collection 2024-08-06T20:22:04.2905564Z [command]/usr/bin/git config --local gc.auto 0 2024-08-06T20:22:04.2934103Z ##[endgroup] 2024-08-06T20:22:04.2934823Z ##[group]Setting up auth 2024-08-06T20:22:04.2940887Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-06T20:22:04.2972176Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-06T20:22:04.3225499Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-06T20:22:04.3255405Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-06T20:22:04.3506924Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-06T20:22:04.3573159Z ##[endgroup] 2024-08-06T20:22:04.3573951Z ##[group]Fetching the repository 2024-08-06T20:22:04.3580540Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --progress --no-recurse-submodules --quiet origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2024-08-06T20:22:06.6647412Z remote: Enumerating objects: 1008384 2024-08-06T20:22:06.6647927Z remote: Enumerating objects: 1008673, done. 2024-08-06T20:22:06.6648613Z remote: Counting objects: 0% (1/289) 2024-08-06T20:22:06.6649110Z remote: Counting objects: 1% (3/289) 2024-08-06T20:22:06.6649641Z remote: Counting objects: 2% (6/289) 2024-08-06T20:22:06.6650202Z remote: Counting objects: 3% (9/289) 2024-08-06T20:22:06.6650712Z remote: Counting objects: 4% (12/289) 2024-08-06T20:22:06.6651614Z remote: Counting objects: 5% (15/289) 2024-08-06T20:22:06.6652112Z remote: Counting objects: 6% (18/289) 2024-08-06T20:22:06.6652741Z remote: Counting objects: 7% (21/289) 2024-08-06T20:22:06.6653297Z remote: Counting objects: 8% (24/289) 2024-08-06T20:22:06.6653874Z remote: Counting objects: 9% (27/289) 2024-08-06T20:22:06.6654464Z remote: Counting objects: 10% (29/289) 2024-08-06T20:22:06.6655045Z remote: Counting objects: 11% (32/289) 2024-08-06T20:22:06.6655630Z remote: Counting objects: 12% (35/289) 2024-08-06T20:22:06.6656408Z remote: Counting objects: 13% (38/289) 2024-08-06T20:22:06.6657032Z remote: Counting objects: 14% (41/289) 2024-08-06T20:22:06.6657668Z remote: Counting objects: 15% (44/289) 2024-08-06T20:22:06.6658283Z remote: Counting objects: 16% (47/289) 2024-08-06T20:22:06.6658940Z remote: Counting objects: 17% (50/289) 2024-08-06T20:22:06.6659590Z remote: Counting objects: 18% (53/289) 2024-08-06T20:22:06.6660178Z remote: Counting objects: 19% (55/289) 2024-08-06T20:22:06.6660812Z remote: Counting objects: 20% (58/289) 2024-08-06T20:22:06.6661438Z remote: Counting objects: 21% (61/289) 2024-08-06T20:22:06.6662081Z remote: Counting objects: 22% (64/289) 2024-08-06T20:22:06.6662727Z remote: Counting objects: 23% (67/289) 2024-08-06T20:22:06.6663387Z remote: Counting objects: 24% (70/289) 2024-08-06T20:22:06.6663981Z remote: Counting objects: 25% (73/289) 2024-08-06T20:22:06.6664625Z remote: Counting objects: 26% (76/289) 2024-08-06T20:22:06.6665390Z remote: Counting objects: 27% (79/289) 2024-08-06T20:22:06.6666318Z remote: Counting objects: 28% (81/289) 2024-08-06T20:22:06.6667087Z remote: Counting objects: 29% (84/289) 2024-08-06T20:22:06.6667737Z remote: Counting objects: 30% (87/289) 2024-08-06T20:22:06.6668374Z remote: Counting objects: 31% (90/289) 2024-08-06T20:22:06.6669012Z remote: Counting objects: 32% (93/289) 2024-08-06T20:22:06.6669645Z remote: Counting objects: 33% (96/289) 2024-08-06T20:22:06.6670230Z remote: Counting objects: 34% (99/289) 2024-08-06T20:22:06.6670790Z remote: Counting objects: 35% (102/289) 2024-08-06T20:22:06.6671367Z remote: Counting objects: 36% (105/289) 2024-08-06T20:22:06.6671985Z remote: Counting objects: 37% (107/289) 2024-08-06T20:22:06.6672625Z remote: Counting objects: 38% (110/289) 2024-08-06T20:22:06.6673243Z remote: Counting objects: 39% (113/289) 2024-08-06T20:22:06.6673872Z remote: Counting objects: 40% (116/289) 2024-08-06T20:22:06.6674817Z remote: Counting objects: 41% (119/289) 2024-08-06T20:22:06.6675461Z remote: Counting objects: 42% (122/289) 2024-08-06T20:22:06.6676107Z remote: Counting objects: 43% (125/289) 2024-08-06T20:22:06.6676747Z remote: Counting objects: 44% (128/289) 2024-08-06T20:22:06.6677401Z remote: Counting objects: 45% (131/289) 2024-08-06T20:22:06.6678051Z remote: Counting objects: 46% (133/289) 2024-08-06T20:22:06.6678649Z remote: Counting objects: 47% (136/289) 2024-08-06T20:22:06.6679221Z remote: Counting objects: 48% (139/289) 2024-08-06T20:22:06.6679839Z remote: Counting objects: 49% (142/289) 2024-08-06T20:22:06.6680488Z remote: Counting objects: 50% (145/289) 2024-08-06T20:22:06.6681138Z remote: Counting objects: 51% (148/289) 2024-08-06T20:22:06.6681765Z remote: Counting objects: 52% (151/289) 2024-08-06T20:22:06.6682423Z remote: Counting objects: 53% (154/289) 2024-08-06T20:22:06.6683025Z remote: Counting objects: 54% (157/289) 2024-08-06T20:22:06.6683624Z remote: Counting objects: 55% (159/289) 2024-08-06T20:22:06.6684226Z remote: Counting objects: 56% (162/289) 2024-08-06T20:22:06.6684822Z remote: Counting objects: 57% (165/289) 2024-08-06T20:22:06.6685786Z remote: Counting objects: 58% (168/289) 2024-08-06T20:22:06.6686426Z remote: Counting objects: 59% (171/289) 2024-08-06T20:22:06.6687079Z remote: Counting objects: 60% (174/289) 2024-08-06T20:22:06.6687724Z remote: Counting objects: 61% (177/289) 2024-08-06T20:22:06.6688385Z remote: Counting objects: 62% (180/289) 2024-08-06T20:22:06.6689089Z remote: Counting objects: 63% (183/289) 2024-08-06T20:22:06.6689755Z remote: Counting objects: 64% (185/289) 2024-08-06T20:22:06.6690402Z remote: Counting objects: 65% (188/289) 2024-08-06T20:22:06.6691036Z remote: Counting objects: 66% (191/289) 2024-08-06T20:22:06.6691625Z remote: Counting objects: 67% (194/289) 2024-08-06T20:22:06.6692701Z remote: Counting objects: 68% (197/289) 2024-08-06T20:22:06.6693379Z remote: Counting objects: 69% (200/289) 2024-08-06T20:22:06.6693981Z remote: Counting objects: 70% (203/289) 2024-08-06T20:22:06.6694583Z remote: Counting objects: 71% (206/289) 2024-08-06T20:22:06.6695223Z remote: Counting objects: 72% (209/289) 2024-08-06T20:22:06.6695866Z remote: Counting objects: 73% (211/289) 2024-08-06T20:22:06.6696516Z remote: Counting objects: 74% (214/289) 2024-08-06T20:22:06.6697162Z remote: Counting objects: 75% (217/289) 2024-08-06T20:22:06.6697827Z remote: Counting objects: 76% (220/289) 2024-08-06T20:22:06.6698475Z remote: Counting objects: 77% (223/289) 2024-08-06T20:22:06.6699143Z remote: Counting objects: 78% (226/289) 2024-08-06T20:22:06.6699798Z remote: Counting objects: 79% (229/289) 2024-08-06T20:22:06.6700423Z remote: Counting objects: 80% (232/289) 2024-08-06T20:22:06.6701263Z remote: Counting objects: 81% (235/289) 2024-08-06T20:22:06.6701932Z remote: Counting objects: 82% (237/289) 2024-08-06T20:22:06.6702582Z remote: Counting objects: 83% (240/289) 2024-08-06T20:22:06.6703254Z remote: Counting objects: 84% (243/289) 2024-08-06T20:22:06.6703915Z remote: Counting objects: 85% (246/289) 2024-08-06T20:22:06.6704565Z remote: Counting objects: 86% (249/289) 2024-08-06T20:22:06.6705191Z remote: Counting objects: 87% (252/289) 2024-08-06T20:22:06.6705792Z remote: Counting objects: 88% (255/289) 2024-08-06T20:22:06.6706432Z remote: Counting objects: 89% (258/289) 2024-08-06T20:22:06.6707076Z remote: Counting objects: 90% (261/289) 2024-08-06T20:22:06.6707729Z remote: Counting objects: 91% (263/289) 2024-08-06T20:22:06.6708370Z remote: Counting objects: 92% (266/289) 2024-08-06T20:22:06.6709035Z remote: Counting objects: 93% (269/289) 2024-08-06T20:22:06.6709659Z remote: Counting objects: 94% (272/289) 2024-08-06T20:22:06.6710244Z remote: Counting objects: 95% (275/289) 2024-08-06T20:22:06.6710892Z remote: Counting objects: 96% (278/289) 2024-08-06T20:22:06.6711546Z remote: Counting objects: 97% (281/289) 2024-08-06T20:22:06.6712188Z remote: Counting objects: 98% (284/289) 2024-08-06T20:22:06.6712795Z remote: Counting objects: 99% (287/289) 2024-08-06T20:22:06.6713396Z remote: Counting objects: 100% (289/289) 2024-08-06T20:22:06.6714032Z remote: Counting objects: 100% (289/289), done. 2024-08-06T20:22:06.6714697Z remote: Compressing objects: 0% (1/161) 2024-08-06T20:22:06.6715303Z remote: Compressing objects: 1% (2/161) 2024-08-06T20:22:06.6715961Z remote: Compressing objects: 2% (4/161) 2024-08-06T20:22:06.6716579Z remote: Compressing objects: 3% (5/161) 2024-08-06T20:22:06.6717209Z remote: Compressing objects: 4% (7/161) 2024-08-06T20:22:06.6717898Z remote: Compressing objects: 5% (9/161) 2024-08-06T20:22:06.6718678Z remote: Compressing objects: 6% (10/161) 2024-08-06T20:22:06.6719331Z remote: Compressing objects: 7% (12/161) 2024-08-06T20:22:06.6720283Z remote: Compressing objects: 8% (13/161) 2024-08-06T20:22:06.6731593Z remote: Compressing objects: 9% (15/161) 2024-08-06T20:22:06.6903712Z remote: Compressing objects: 10% (17/161) 2024-08-06T20:22:06.6904232Z remote: Compressing objects: 11% (18/161) 2024-08-06T20:22:06.6904655Z remote: Compressing objects: 12% (20/161) 2024-08-06T20:22:06.6905086Z remote: Compressing objects: 13% (21/161) 2024-08-06T20:22:06.6905526Z remote: Compressing objects: 14% (23/161) 2024-08-06T20:22:06.6905908Z remote: Compressing objects: 15% (25/161) 2024-08-06T20:22:06.6906302Z remote: Compressing objects: 16% (26/161) 2024-08-06T20:22:06.6906720Z remote: Compressing objects: 17% (28/161) 2024-08-06T20:22:06.6907120Z remote: Compressing objects: 18% (29/161) 2024-08-06T20:22:06.6907509Z remote: Compressing objects: 19% (31/161) 2024-08-06T20:22:06.6907942Z remote: Compressing objects: 20% (33/161) 2024-08-06T20:22:06.6935251Z remote: Compressing objects: 21% (34/161) 2024-08-06T20:22:06.6935953Z remote: Compressing objects: 22% (36/161) 2024-08-06T20:22:06.6936657Z remote: Compressing objects: 23% (38/161) 2024-08-06T20:22:06.6937061Z remote: Compressing objects: 24% (39/161) 2024-08-06T20:22:06.6937618Z remote: Compressing objects: 25% (41/161) 2024-08-06T20:22:06.6938005Z remote: Compressing objects: 26% (42/161) 2024-08-06T20:22:06.6938480Z remote: Compressing objects: 27% (44/161) 2024-08-06T20:22:06.6939028Z remote: Compressing objects: 28% (46/161) 2024-08-06T20:22:06.6939410Z remote: Compressing objects: 29% (47/161) 2024-08-06T20:22:06.6939868Z remote: Compressing objects: 30% (49/161) 2024-08-06T20:22:06.6940696Z remote: Compressing objects: 31% (50/161) 2024-08-06T20:22:06.6941156Z remote: Compressing objects: 32% (52/161) 2024-08-06T20:22:06.6941672Z remote: Compressing objects: 33% (54/161) 2024-08-06T20:22:06.6942172Z remote: Compressing objects: 34% (55/161) 2024-08-06T20:22:06.6942801Z remote: Compressing objects: 35% (57/161) 2024-08-06T20:22:06.6943247Z remote: Compressing objects: 36% (58/161) 2024-08-06T20:22:06.6943643Z remote: Compressing objects: 37% (60/161) 2024-08-06T20:22:06.6944036Z remote: Compressing objects: 38% (62/161) 2024-08-06T20:22:06.6944446Z remote: Compressing objects: 39% (63/161) 2024-08-06T20:22:06.6944838Z remote: Compressing objects: 40% (65/161) 2024-08-06T20:22:06.6945231Z remote: Compressing objects: 41% (67/161) 2024-08-06T20:22:06.6945823Z remote: Compressing objects: 42% (68/161) 2024-08-06T20:22:06.6946233Z remote: Compressing objects: 43% (70/161) 2024-08-06T20:22:06.6946624Z remote: Compressing objects: 44% (71/161) 2024-08-06T20:22:06.6947309Z remote: Compressing objects: 45% (73/161) 2024-08-06T20:22:06.6948072Z remote: Compressing objects: 46% (75/161) 2024-08-06T20:22:06.6948845Z remote: Compressing objects: 47% (76/161) 2024-08-06T20:22:06.6949648Z remote: Compressing objects: 48% (78/161) 2024-08-06T20:22:06.6950396Z remote: Compressing objects: 49% (79/161) 2024-08-06T20:22:06.6951117Z remote: Compressing objects: 50% (81/161) 2024-08-06T20:22:06.6951500Z remote: Compressing objects: 51% (83/161) 2024-08-06T20:22:06.6952032Z remote: Compressing objects: 52% (84/161) 2024-08-06T20:22:06.6952794Z remote: Compressing objects: 53% (86/161) 2024-08-06T20:22:06.6953554Z remote: Compressing objects: 54% (87/161) 2024-08-06T20:22:06.6954052Z remote: Compressing objects: 55% (89/161) 2024-08-06T20:22:06.6954871Z remote: Compressing objects: 56% (91/161) 2024-08-06T20:22:06.6955545Z remote: Compressing objects: 57% (92/161) 2024-08-06T20:22:06.6955942Z remote: Compressing objects: 58% (94/161) 2024-08-06T20:22:06.6956583Z remote: Compressing objects: 59% (95/161) 2024-08-06T20:22:06.6956961Z remote: Compressing objects: 60% (97/161) 2024-08-06T20:22:06.6957392Z remote: Compressing objects: 61% (99/161) 2024-08-06T20:22:06.6957829Z remote: Compressing objects: 62% (100/161) 2024-08-06T20:22:06.6958220Z remote: Compressing objects: 63% (102/161) 2024-08-06T20:22:06.6958620Z remote: Compressing objects: 64% (104/161) 2024-08-06T20:22:06.6959018Z remote: Compressing objects: 65% (105/161) 2024-08-06T20:22:06.6959447Z remote: Compressing objects: 66% (107/161) 2024-08-06T20:22:06.6959883Z remote: Compressing objects: 67% (108/161) 2024-08-06T20:22:06.6960274Z remote: Compressing objects: 68% (110/161) 2024-08-06T20:22:06.6960702Z remote: Compressing objects: 69% (112/161) 2024-08-06T20:22:06.6961099Z remote: Compressing objects: 70% (113/161) 2024-08-06T20:22:06.6961523Z remote: Compressing objects: 71% (115/161) 2024-08-06T20:22:06.6961943Z remote: Compressing objects: 72% (116/161) 2024-08-06T20:22:06.6962338Z remote: Compressing objects: 73% (118/161) 2024-08-06T20:22:06.6962767Z remote: Compressing objects: 74% (120/161) 2024-08-06T20:22:06.6963148Z remote: Compressing objects: 75% (121/161) 2024-08-06T20:22:06.6963545Z remote: Compressing objects: 76% (123/161) 2024-08-06T20:22:06.6963938Z remote: Compressing objects: 77% (124/161) 2024-08-06T20:22:06.6964328Z remote: Compressing objects: 78% (126/161) 2024-08-06T20:22:06.6964709Z remote: Compressing objects: 79% (128/161) 2024-08-06T20:22:06.6965094Z remote: Compressing objects: 80% (129/161) 2024-08-06T20:22:06.6965566Z remote: Compressing objects: 81% (131/161) 2024-08-06T20:22:06.6966043Z remote: Compressing objects: 82% (133/161) 2024-08-06T20:22:06.6966438Z remote: Compressing objects: 83% (134/161) 2024-08-06T20:22:06.6966836Z remote: Compressing objects: 84% (136/161) 2024-08-06T20:22:06.6967219Z remote: Compressing objects: 85% (137/161) 2024-08-06T20:22:06.6967615Z remote: Compressing objects: 86% (139/161) 2024-08-06T20:22:06.6968010Z remote: Compressing objects: 87% (141/161) 2024-08-06T20:22:06.6968391Z remote: Compressing objects: 88% (142/161) 2024-08-06T20:22:06.6968837Z remote: Compressing objects: 89% (144/161) 2024-08-06T20:22:06.6969236Z remote: Compressing objects: 90% (145/161) 2024-08-06T20:22:06.6969623Z remote: Compressing objects: 91% (147/161) 2024-08-06T20:22:06.6970065Z remote: Compressing objects: 92% (149/161) 2024-08-06T20:22:06.6970465Z remote: Compressing objects: 93% (150/161) 2024-08-06T20:22:06.6970850Z remote: Compressing objects: 94% (152/161) 2024-08-06T20:22:06.6971248Z remote: Compressing objects: 95% (153/161) 2024-08-06T20:22:06.6971722Z remote: Compressing objects: 96% (155/161) 2024-08-06T20:22:06.6972111Z remote: Compressing objects: 97% (157/161) 2024-08-06T20:22:06.6972501Z remote: Compressing objects: 98% (158/161) 2024-08-06T20:22:06.6972889Z remote: Compressing objects: 99% (160/161) 2024-08-06T20:22:06.6973267Z remote: Compressing objects: 100% (161/161) 2024-08-06T20:22:06.6974002Z remote: Compressing objects: 100% (161/161), done. 2024-08-06T20:22:27.0754534Z remote: Total 1008673 (delta 139), reused 248 (delta 126), pack-reused 1008384 2024-08-06T20:22:54.0447369Z [command]/usr/bin/git rev-parse --verify --quiet b9d86fa89636e301796d4201f36d86c73f6e49bc^{object} 2024-08-06T20:22:54.0473916Z b9d86fa89636e301796d4201f36d86c73f6e49bc 2024-08-06T20:22:54.0479184Z ##[endgroup] 2024-08-06T20:22:54.0479683Z ##[group]Determining the checkout info 2024-08-06T20:22:54.0480194Z ##[endgroup] 2024-08-06T20:22:54.0480595Z ##[group]Checking out the ref 2024-08-06T20:22:54.0483406Z [command]/usr/bin/git checkout --quiet --force b9d86fa89636e301796d4201f36d86c73f6e49bc 2024-08-06T20:22:55.4080739Z ##[endgroup] 2024-08-06T20:22:55.4081204Z ##[group]Setting up auth for fetching submodules 2024-08-06T20:22:55.4083525Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2024-08-06T20:22:55.4130601Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2024-08-06T20:22:55.4160378Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2024-08-06T20:22:55.4189799Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2024-08-06T20:22:55.4215404Z ##[endgroup] 2024-08-06T20:22:55.4215809Z ##[group]Fetching submodules 2024-08-06T20:22:55.4219932Z [command]/usr/bin/git submodule sync --recursive 2024-08-06T20:22:55.4495557Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2024-08-06T20:22:55.4766488Z Submodule 'android/libs/fbjni' (https://github.com/facebookincubator/fbjni.git) registered for path 'android/libs/fbjni' 2024-08-06T20:22:55.4767763Z Submodule 'third_party/NNPACK_deps/FP16' (https://github.com/Maratyszcza/FP16.git) registered for path 'third_party/FP16' 2024-08-06T20:22:55.4769441Z Submodule 'third_party/NNPACK_deps/FXdiv' (https://github.com/Maratyszcza/FXdiv.git) registered for path 'third_party/FXdiv' 2024-08-06T20:22:55.4771753Z Submodule 'third_party/NNPACK' (https://github.com/Maratyszcza/NNPACK.git) registered for path 'third_party/NNPACK' 2024-08-06T20:22:55.4774632Z Submodule 'third_party/VulkanMemoryAllocator' (https://github.com/GPUOpen-LibrariesAndSDKs/VulkanMemoryAllocator.git) registered for path 'third_party/VulkanMemoryAllocator' 2024-08-06T20:22:55.4777230Z Submodule 'third_party/XNNPACK' (https://github.com/google/XNNPACK.git) registered for path 'third_party/XNNPACK' 2024-08-06T20:22:55.4779616Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/benchmark' 2024-08-06T20:22:55.4782492Z Submodule 'third_party/cpp-httplib' (https://github.com/yhirose/cpp-httplib.git) registered for path 'third_party/cpp-httplib' 2024-08-06T20:22:55.4785195Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo.git) registered for path 'third_party/cpuinfo' 2024-08-06T20:22:55.4788235Z Submodule 'third_party/cudnn_frontend' (https://github.com/NVIDIA/cudnn-frontend.git) registered for path 'third_party/cudnn_frontend' 2024-08-06T20:22:55.4791158Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' 2024-08-06T20:22:55.4794246Z Submodule 'third_party/eigen' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen' 2024-08-06T20:22:55.4797356Z Submodule 'third_party/fbgemm' (https://github.com/pytorch/fbgemm) registered for path 'third_party/fbgemm' 2024-08-06T20:22:55.4800777Z Submodule 'third_party/flatbuffers' (https://github.com/google/flatbuffers.git) registered for path 'third_party/flatbuffers' 2024-08-06T20:22:55.4804050Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/fmt' 2024-08-06T20:22:55.4808249Z Submodule 'third_party/foxi' (https://github.com/houseroad/foxi.git) registered for path 'third_party/foxi' 2024-08-06T20:22:55.4813637Z Submodule 'third_party/gemmlowp/gemmlowp' (https://github.com/google/gemmlowp.git) registered for path 'third_party/gemmlowp/gemmlowp' 2024-08-06T20:22:55.4817270Z Submodule 'third_party/gloo' (https://github.com/facebookincubator/gloo) registered for path 'third_party/gloo' 2024-08-06T20:22:55.4821008Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/googletest' 2024-08-06T20:22:55.4824966Z Submodule 'third_party/ideep' (https://github.com/intel/ideep) registered for path 'third_party/ideep' 2024-08-06T20:22:55.4829116Z Submodule 'third_party/ittapi' (https://github.com/intel/ittapi.git) registered for path 'third_party/ittapi' 2024-08-06T20:22:55.4833224Z Submodule 'third_party/kineto' (https://github.com/pytorch/kineto) registered for path 'third_party/kineto' 2024-08-06T20:22:55.4837474Z Submodule 'third_party/mimalloc' (https://github.com/microsoft/mimalloc.git) registered for path 'third_party/mimalloc' 2024-08-06T20:22:55.4841951Z Submodule 'third_party/nccl/nccl' (https://github.com/NVIDIA/nccl) registered for path 'third_party/nccl/nccl' 2024-08-06T20:22:55.4846395Z Submodule 'third_party/nlohmann' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann' 2024-08-06T20:22:55.4850706Z Submodule 'third_party/onnx' (https://github.com/onnx/onnx.git) registered for path 'third_party/onnx' 2024-08-06T20:22:55.4855473Z Submodule 'third_party/opentelemetry-cpp' (https://github.com/open-telemetry/opentelemetry-cpp.git) registered for path 'third_party/opentelemetry-cpp' 2024-08-06T20:22:55.4859994Z Submodule 'third_party/pocketfft' (https://github.com/mreineck/pocketfft) registered for path 'third_party/pocketfft' 2024-08-06T20:22:55.4864648Z Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' 2024-08-06T20:22:55.4869402Z Submodule 'third_party/NNPACK_deps/psimd' (https://github.com/Maratyszcza/psimd.git) registered for path 'third_party/psimd' 2024-08-06T20:22:55.4876080Z Submodule 'third_party/NNPACK_deps/pthreadpool' (https://github.com/Maratyszcza/pthreadpool.git) registered for path 'third_party/pthreadpool' 2024-08-06T20:22:55.4880490Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 2024-08-06T20:22:55.4885571Z Submodule 'third_party/python-peachpy' (https://github.com/malfet/PeachPy.git) registered for path 'third_party/python-peachpy' 2024-08-06T20:22:55.4892246Z Submodule 'third_party/sleef' (https://github.com/shibatch/sleef) registered for path 'third_party/sleef' 2024-08-06T20:22:55.4897482Z Submodule 'third_party/tensorpipe' (https://github.com/pytorch/tensorpipe.git) registered for path 'third_party/tensorpipe' 2024-08-06T20:22:55.4924953Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/android/libs/fbjni'... 2024-08-06T20:22:55.7889726Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FP16'... 2024-08-06T20:22:55.9765922Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/FXdiv'... 2024-08-06T20:22:57.1339119Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/NNPACK'... 2024-08-06T20:22:57.3852267Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/VulkanMemoryAllocator'... 2024-08-06T20:22:59.4789418Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/XNNPACK'... 2024-08-06T20:23:13.1110829Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/benchmark'... 2024-08-06T20:23:13.5110821Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpp-httplib'... 2024-08-06T20:23:13.9855096Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cpuinfo'... 2024-08-06T20:23:14.5702735Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cudnn_frontend'... 2024-08-06T20:23:15.7734737Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/cutlass'... 2024-08-06T20:23:17.6433080Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/eigen'... 2024-08-06T20:23:23.0688080Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm'... 2024-08-06T20:23:24.5546195Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/flatbuffers'... 2024-08-06T20:23:26.4657630Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fmt'... 2024-08-06T20:23:27.9149484Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/foxi'... 2024-08-06T20:23:28.1250407Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gemmlowp/gemmlowp'... 2024-08-06T20:23:28.5107121Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/gloo'... 2024-08-06T20:23:28.9235078Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/googletest'... 2024-08-06T20:23:30.0794817Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep'... 2024-08-06T20:23:30.4318948Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ittapi'... 2024-08-06T20:23:30.7712537Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto'... 2024-08-06T20:23:32.3906439Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/mimalloc'... 2024-08-06T20:23:33.1564993Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nccl/nccl'... 2024-08-06T20:23:33.8328782Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/nlohmann'... 2024-08-06T20:23:40.0753775Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx'... 2024-08-06T20:23:42.2618643Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp'... 2024-08-06T20:23:48.0768858Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pocketfft'... 2024-08-06T20:23:48.3072529Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf'... 2024-08-06T20:23:57.5084851Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/psimd'... 2024-08-06T20:23:57.6769413Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pthreadpool'... 2024-08-06T20:23:58.5272222Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/pybind11'... 2024-08-06T20:23:59.3856224Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/python-peachpy'... 2024-08-06T20:23:59.6570042Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/sleef'... 2024-08-06T20:24:00.3187906Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe'... 2024-08-06T20:24:00.7296506Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2024-08-06T20:24:00.7407348Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2024-08-06T20:24:00.7493211Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2024-08-06T20:24:00.7724143Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2024-08-06T20:24:00.8091399Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2024-08-06T20:24:01.7287549Z Submodule path 'third_party/XNNPACK': checked out 'fcbf55af6cf28a4627bcd1f703ab7ad843f0f3a2' 2024-08-06T20:24:01.7511947Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2024-08-06T20:24:01.7947164Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2024-08-06T20:24:01.8885574Z Submodule path 'third_party/cpuinfo': checked out '3c8b1533ac03dd6531ab6e7b9245d488f13a82a5' 2024-08-06T20:24:01.9209757Z Submodule path 'third_party/cudnn_frontend': checked out '98ca4e1941fe3263f128f74f10063a3ea35c7019' 2024-08-06T20:24:02.4065134Z Submodule path 'third_party/cutlass': checked out 'bbe579a9e3beb6ea6626d9227ec32d0dae119a49' 2024-08-06T20:24:02.6508575Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2024-08-06T20:24:02.7284932Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2024-08-06T20:24:02.7302905Z Submodule 'third_party/asmjit' (https://github.com/asmjit/asmjit.git) registered for path 'third_party/fbgemm/third_party/asmjit' 2024-08-06T20:24:02.7305796Z Submodule 'third_party/cpuinfo' (https://github.com/pytorch/cpuinfo) registered for path 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T20:24:02.7307767Z Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/fbgemm/third_party/cutlass' 2024-08-06T20:24:02.7309243Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/fbgemm/third_party/googletest' 2024-08-06T20:24:02.7311819Z Submodule 'third_party/hipify_torch' (https://github.com/ROCmSoftwarePlatform/hipify_torch.git) registered for path 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T20:24:02.7336665Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/asmjit'... 2024-08-06T20:24:03.8665763Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cpuinfo'... 2024-08-06T20:24:04.4795165Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/cutlass'... 2024-08-06T20:24:06.8623498Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/googletest'... 2024-08-06T20:24:08.0709020Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/fbgemm/third_party/hipify_torch'... 2024-08-06T20:24:08.3844820Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2024-08-06T20:24:08.4778141Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2024-08-06T20:24:08.8680286Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2024-08-06T20:24:08.9284034Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2024-08-06T20:24:08.9407657Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2024-08-06T20:24:09.0539199Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2024-08-06T20:24:09.0943790Z Submodule path 'third_party/fmt': checked out '0c9fce2ffefecfdce794e1859584e25877b7b592' 2024-08-06T20:24:09.1037598Z Submodule path 'third_party/foxi': checked out 'c278588e34e535f0bb8f00df3880d26928038cad' 2024-08-06T20:24:09.1424115Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2024-08-06T20:24:09.1669892Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2024-08-06T20:24:09.2110011Z Submodule path 'third_party/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-06T20:24:09.2230796Z Submodule path 'third_party/ideep': checked out '55ca0191687aaf19aca5cdb7881c791e3bea442b' 2024-08-06T20:24:09.2244939Z Submodule 'mkl-dnn' (https://github.com/intel/mkl-dnn.git) registered for path 'third_party/ideep/mkl-dnn' 2024-08-06T20:24:09.2267963Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/ideep/mkl-dnn'... 2024-08-06T20:24:23.1394163Z Submodule path 'third_party/ideep/mkl-dnn': checked out '1137e04ec0b5251ca2b4400a4fd3c667ce843d67' 2024-08-06T20:24:23.1567860Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2024-08-06T20:24:23.2408636Z Submodule path 'third_party/kineto': checked out 'da2f2682cabaf95d601fa2a9b7e0979f84fe7667' 2024-08-06T20:24:23.2424956Z Submodule 'libkineto/third_party/dynolog' (https://github.com/facebookincubator/dynolog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T20:24:23.2427230Z Submodule 'libkineto/third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T20:24:23.2429965Z Submodule 'libkineto/third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T20:24:23.2458138Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog'... 2024-08-06T20:24:23.8769332Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/fmt'... 2024-08-06T20:24:25.1681642Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/googletest'... 2024-08-06T20:24:26.4054252Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2024-08-06T20:24:26.4069031Z Submodule 'third_party/DCGM' (https://github.com/NVIDIA/DCGM.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T20:24:26.4071790Z Submodule 'third_party/cpr' (https://github.com/libcpr/cpr.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T20:24:26.4074821Z Submodule 'third_party/fmt' (https://github.com/fmtlib/fmt.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T20:24:26.4077889Z Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T20:24:26.4080936Z Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T20:24:26.4084645Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T20:24:26.4087947Z Submodule 'third_party/json' (https://github.com/nlohmann/json.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T20:24:26.4091419Z Submodule 'third_party/pfs' (https://github.com/dtrugman/pfs.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T20:24:26.4117920Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM'... 2024-08-06T20:24:27.3165506Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/cpr'... 2024-08-06T20:24:27.6920938Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/fmt'... 2024-08-06T20:24:29.0380930Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags'... 2024-08-06T20:24:29.3549681Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/glog'... 2024-08-06T20:24:29.9499565Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/googletest'... 2024-08-06T20:24:31.1554846Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/json'... 2024-08-06T20:24:37.5356151Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/pfs'... 2024-08-06T20:24:37.9164329Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2024-08-06T20:24:37.9344427Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2024-08-06T20:24:37.9702523Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2024-08-06T20:24:37.9830363Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2024-08-06T20:24:37.9844650Z Submodule 'doc' (https://github.com/gflags/gflags.git) registered for path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T20:24:37.9869098Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc'... 2024-08-06T20:24:38.2815488Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2024-08-06T20:24:38.2991815Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2024-08-06T20:24:38.3382655Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2024-08-06T20:24:38.4381337Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2024-08-06T20:24:38.4538091Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2024-08-06T20:24:38.4922084Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2024-08-06T20:24:38.5483963Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2024-08-06T20:24:38.5847115Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2024-08-06T20:24:38.6078064Z Submodule path 'third_party/nccl/nccl': checked out 'ab2b89c4c339bd7f816fbc114a4b05d386b66290' 2024-08-06T20:24:38.7072463Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2024-08-06T20:24:39.0482861Z Submodule path 'third_party/onnx': checked out '3bf92c03a9f27eba3bda1e5b9e63ea20ec213557' 2024-08-06T20:24:39.0516756Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/onnx/third_party/benchmark' 2024-08-06T20:24:39.0519530Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/onnx/third_party/pybind11' 2024-08-06T20:24:39.0544462Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/benchmark'... 2024-08-06T20:24:39.4763874Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/onnx/third_party/pybind11'... 2024-08-06T20:24:40.3578901Z Submodule path 'third_party/onnx/third_party/benchmark': checked out '2dd015dfef425c866d9a43f2c67d8b52d709acb6' 2024-08-06T20:24:40.3905627Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '5b0a6fc2017fcc176545afe3e09c9f9885283242' 2024-08-06T20:24:40.4561530Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2024-08-06T20:24:40.4579205Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark) registered for path 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T20:24:40.4581015Z Submodule 'third_party/googletest' (https://github.com/google/googletest) registered for path 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T20:24:40.4583360Z Submodule 'third_party/ms-gsl' (https://github.com/microsoft/GSL) registered for path 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T20:24:40.4585850Z Submodule 'third_party/nlohmann-json' (https://github.com/nlohmann/json) registered for path 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T20:24:40.4588533Z Submodule 'third_party/opentelemetry-proto' (https://github.com/open-telemetry/opentelemetry-proto) registered for path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T20:24:40.4591099Z Submodule 'third_party/opentracing-cpp' (https://github.com/opentracing/opentracing-cpp.git) registered for path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T20:24:40.4593768Z Submodule 'third_party/prometheus-cpp' (https://github.com/jupp0r/prometheus-cpp) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T20:24:40.4596438Z Submodule 'tools/vcpkg' (https://github.com/Microsoft/vcpkg) registered for path 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T20:24:40.4621572Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/benchmark'... 2024-08-06T20:24:40.9220454Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/googletest'... 2024-08-06T20:24:42.1140126Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/ms-gsl'... 2024-08-06T20:24:42.4150552Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/nlohmann-json'... 2024-08-06T20:24:48.7920256Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentelemetry-proto'... 2024-08-06T20:24:49.0659031Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/opentracing-cpp'... 2024-08-06T20:24:49.2821066Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp'... 2024-08-06T20:24:49.6169708Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/tools/vcpkg'... 2024-08-06T20:24:55.7017316Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2024-08-06T20:24:55.7406049Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2024-08-06T20:24:55.7555143Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2024-08-06T20:24:55.8503287Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2024-08-06T20:24:55.8628026Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2024-08-06T20:24:55.8765350Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2024-08-06T20:24:55.8913299Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2024-08-06T20:24:55.8927217Z Submodule 'civetweb' (https://github.com/civetweb/civetweb.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T20:24:55.8929473Z Submodule 'googletest' (https://github.com/google/googletest.git) registered for path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T20:24:55.8953050Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb'... 2024-08-06T20:24:58.0889122Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest'... 2024-08-06T20:24:59.5057874Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2024-08-06T20:24:59.5506273Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2024-08-06T20:24:59.9924021Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2024-08-06T20:25:00.0046722Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2024-08-06T20:25:00.2615806Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2024-08-06T20:25:00.2636132Z Submodule 'third_party/benchmark' (https://github.com/google/benchmark.git) registered for path 'third_party/protobuf/third_party/benchmark' 2024-08-06T20:25:00.2638881Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/protobuf/third_party/googletest' 2024-08-06T20:25:00.2667088Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/benchmark'... 2024-08-06T20:25:00.7183500Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/protobuf/third_party/googletest'... 2024-08-06T20:25:01.9759322Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2024-08-06T20:25:02.0456339Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2024-08-06T20:25:02.0546442Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2024-08-06T20:25:02.0665686Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2024-08-06T20:25:02.1025140Z Submodule path 'third_party/pybind11': checked out '941f45bcb51457884fa1afd6e24a67377d70f75c' 2024-08-06T20:25:02.1306504Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2024-08-06T20:25:02.1708087Z Submodule path 'third_party/sleef': checked out '60e76d2bce17d278b439d9da17177c8f957a9e9b' 2024-08-06T20:25:02.1962093Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2024-08-06T20:25:02.1980175Z Submodule 'third_party/googletest' (https://github.com/google/googletest.git) registered for path 'third_party/tensorpipe/third_party/googletest' 2024-08-06T20:25:02.1982724Z Submodule 'third_party/libnop' (https://github.com/google/libnop.git) registered for path 'third_party/tensorpipe/third_party/libnop' 2024-08-06T20:25:02.1984759Z Submodule 'third_party/libuv' (https://github.com/libuv/libuv.git) registered for path 'third_party/tensorpipe/third_party/libuv' 2024-08-06T20:25:02.1987231Z Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T20:25:02.2012753Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/googletest'... 2024-08-06T20:25:03.4164212Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libnop'... 2024-08-06T20:25:03.7402856Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/libuv'... 2024-08-06T20:25:04.9218852Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11'... 2024-08-06T20:25:05.9143826Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2024-08-06T20:25:05.9294076Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2024-08-06T20:25:05.9953210Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2024-08-06T20:25:06.0229817Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2024-08-06T20:25:06.0244085Z Submodule 'tools/clang' (https://github.com/wjakob/clang-cindex-python3) registered for path 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T20:25:06.0268452Z Cloning into '/home/ec2-user/actions-runner/_work/pytorch/pytorch/third_party/tensorpipe/third_party/pybind11/tools/clang'... 2024-08-06T20:25:06.2409411Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2024-08-06T20:25:06.2440342Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2024-08-06T20:25:06.2717477Z Entering 'android/libs/fbjni' 2024-08-06T20:25:06.2756354Z Entering 'third_party/FP16' 2024-08-06T20:25:06.2794606Z Entering 'third_party/FXdiv' 2024-08-06T20:25:06.2832520Z Entering 'third_party/NNPACK' 2024-08-06T20:25:06.2871403Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-06T20:25:06.2910872Z Entering 'third_party/XNNPACK' 2024-08-06T20:25:06.2966652Z Entering 'third_party/benchmark' 2024-08-06T20:25:06.3004946Z Entering 'third_party/cpp-httplib' 2024-08-06T20:25:06.3042178Z Entering 'third_party/cpuinfo' 2024-08-06T20:25:06.3080297Z Entering 'third_party/cudnn_frontend' 2024-08-06T20:25:06.3118376Z Entering 'third_party/cutlass' 2024-08-06T20:25:06.3163892Z Entering 'third_party/eigen' 2024-08-06T20:25:06.3204214Z Entering 'third_party/fbgemm' 2024-08-06T20:25:06.3242391Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-06T20:25:06.3279241Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T20:25:06.3315935Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-06T20:25:06.3360372Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-06T20:25:06.3398639Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T20:25:06.3437129Z Entering 'third_party/flatbuffers' 2024-08-06T20:25:06.3478125Z Entering 'third_party/fmt' 2024-08-06T20:25:06.3515067Z Entering 'third_party/foxi' 2024-08-06T20:25:06.3553502Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-06T20:25:06.3591921Z Entering 'third_party/gloo' 2024-08-06T20:25:06.3629952Z Entering 'third_party/googletest' 2024-08-06T20:25:06.3667789Z Entering 'third_party/ideep' 2024-08-06T20:25:06.3705850Z Entering 'third_party/ideep/mkl-dnn' 2024-08-06T20:25:06.3749768Z Entering 'third_party/ittapi' 2024-08-06T20:25:06.3787663Z Entering 'third_party/kineto' 2024-08-06T20:25:06.3825579Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T20:25:06.3863437Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T20:25:06.3902697Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T20:25:06.3940412Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T20:25:06.3978534Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T20:25:06.4015574Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T20:25:06.4055199Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T20:25:06.4095757Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T20:25:06.4133908Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T20:25:06.4173945Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T20:25:06.4214369Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T20:25:06.4252620Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T20:25:06.4292601Z Entering 'third_party/mimalloc' 2024-08-06T20:25:06.4331185Z Entering 'third_party/nccl/nccl' 2024-08-06T20:25:06.4368603Z Entering 'third_party/nlohmann' 2024-08-06T20:25:06.4408582Z Entering 'third_party/onnx' 2024-08-06T20:25:06.4462619Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-06T20:25:06.4501958Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-06T20:25:06.4542287Z Entering 'third_party/opentelemetry-cpp' 2024-08-06T20:25:06.4582257Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T20:25:06.4619547Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T20:25:06.4658142Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T20:25:06.4694921Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T20:25:06.4732482Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T20:25:06.4769287Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T20:25:06.4805535Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T20:25:06.4841932Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T20:25:06.4883199Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T20:25:06.4922277Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T20:25:06.4979850Z Entering 'third_party/pocketfft' 2024-08-06T20:25:06.5018936Z Entering 'third_party/protobuf' 2024-08-06T20:25:06.5061783Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-06T20:25:06.5100158Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-06T20:25:06.5139539Z Entering 'third_party/psimd' 2024-08-06T20:25:06.5181041Z Entering 'third_party/pthreadpool' 2024-08-06T20:25:06.5218796Z Entering 'third_party/pybind11' 2024-08-06T20:25:06.5256589Z Entering 'third_party/python-peachpy' 2024-08-06T20:25:06.5295210Z Entering 'third_party/sleef' 2024-08-06T20:25:06.5333980Z Entering 'third_party/tensorpipe' 2024-08-06T20:25:06.5372416Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-06T20:25:06.5409210Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-06T20:25:06.5446886Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-06T20:25:06.5484119Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T20:25:06.5520661Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T20:25:06.5571608Z ##[endgroup] 2024-08-06T20:25:06.5572858Z ##[group]Persisting credentials for submodules 2024-08-06T20:25:06.5579495Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2024-08-06T20:25:06.5857227Z Entering 'android/libs/fbjni' 2024-08-06T20:25:06.5909222Z Entering 'third_party/FP16' 2024-08-06T20:25:06.5958769Z Entering 'third_party/FXdiv' 2024-08-06T20:25:06.6009985Z Entering 'third_party/NNPACK' 2024-08-06T20:25:06.6060556Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-06T20:25:06.6111436Z Entering 'third_party/XNNPACK' 2024-08-06T20:25:06.6180547Z Entering 'third_party/benchmark' 2024-08-06T20:25:06.6231020Z Entering 'third_party/cpp-httplib' 2024-08-06T20:25:06.6281133Z Entering 'third_party/cpuinfo' 2024-08-06T20:25:06.6331619Z Entering 'third_party/cudnn_frontend' 2024-08-06T20:25:06.6381603Z Entering 'third_party/cutlass' 2024-08-06T20:25:06.6440808Z Entering 'third_party/eigen' 2024-08-06T20:25:06.6492366Z Entering 'third_party/fbgemm' 2024-08-06T20:25:06.6542951Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-06T20:25:06.6594088Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T20:25:06.6643146Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-06T20:25:06.6699253Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-06T20:25:06.6748033Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T20:25:06.6798256Z Entering 'third_party/flatbuffers' 2024-08-06T20:25:06.6853074Z Entering 'third_party/fmt' 2024-08-06T20:25:06.6903444Z Entering 'third_party/foxi' 2024-08-06T20:25:06.6952959Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-06T20:25:06.7002855Z Entering 'third_party/gloo' 2024-08-06T20:25:06.7052903Z Entering 'third_party/googletest' 2024-08-06T20:25:06.7102328Z Entering 'third_party/ideep' 2024-08-06T20:25:06.7151324Z Entering 'third_party/ideep/mkl-dnn' 2024-08-06T20:25:06.7208457Z Entering 'third_party/ittapi' 2024-08-06T20:25:06.7259919Z Entering 'third_party/kineto' 2024-08-06T20:25:06.7310423Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T20:25:06.7359629Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T20:25:06.7410705Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T20:25:06.7460906Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T20:25:06.7510192Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T20:25:06.7558228Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T20:25:06.7611862Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T20:25:06.7661364Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T20:25:06.7711488Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T20:25:06.7762040Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T20:25:06.7812919Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T20:25:06.7861553Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T20:25:06.7912882Z Entering 'third_party/mimalloc' 2024-08-06T20:25:06.7964076Z Entering 'third_party/nccl/nccl' 2024-08-06T20:25:06.8014730Z Entering 'third_party/nlohmann' 2024-08-06T20:25:06.8065250Z Entering 'third_party/onnx' 2024-08-06T20:25:06.8130931Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-06T20:25:06.8182010Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-06T20:25:06.8233069Z Entering 'third_party/opentelemetry-cpp' 2024-08-06T20:25:06.8285756Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T20:25:06.8335070Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T20:25:06.8384816Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T20:25:06.8433770Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T20:25:06.8484289Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T20:25:06.8532002Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T20:25:06.8580612Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T20:25:06.8628062Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T20:25:06.8679348Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T20:25:06.8729886Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T20:25:06.8799999Z Entering 'third_party/pocketfft' 2024-08-06T20:25:06.8851533Z Entering 'third_party/protobuf' 2024-08-06T20:25:06.8905664Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-06T20:25:06.8954860Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-06T20:25:06.9007000Z Entering 'third_party/psimd' 2024-08-06T20:25:06.9056889Z Entering 'third_party/pthreadpool' 2024-08-06T20:25:06.9107461Z Entering 'third_party/pybind11' 2024-08-06T20:25:06.9156724Z Entering 'third_party/python-peachpy' 2024-08-06T20:25:06.9206217Z Entering 'third_party/sleef' 2024-08-06T20:25:06.9255928Z Entering 'third_party/tensorpipe' 2024-08-06T20:25:06.9305403Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-06T20:25:06.9354898Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-06T20:25:06.9405005Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-06T20:25:06.9455231Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T20:25:06.9503633Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T20:25:06.9570081Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2024-08-06T20:25:06.9853234Z Entering 'android/libs/fbjni' 2024-08-06T20:25:06.9902734Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2024-08-06T20:25:06.9917459Z Entering 'third_party/FP16' 2024-08-06T20:25:06.9964315Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2024-08-06T20:25:06.9979978Z Entering 'third_party/FXdiv' 2024-08-06T20:25:07.0025660Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2024-08-06T20:25:07.0040391Z Entering 'third_party/NNPACK' 2024-08-06T20:25:07.0086321Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2024-08-06T20:25:07.0101465Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-06T20:25:07.0147203Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2024-08-06T20:25:07.0162048Z Entering 'third_party/XNNPACK' 2024-08-06T20:25:07.0208215Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2024-08-06T20:25:07.0240055Z Entering 'third_party/benchmark' 2024-08-06T20:25:07.0288549Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2024-08-06T20:25:07.0303860Z Entering 'third_party/cpp-httplib' 2024-08-06T20:25:07.0350849Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2024-08-06T20:25:07.0365489Z Entering 'third_party/cpuinfo' 2024-08-06T20:25:07.0411764Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2024-08-06T20:25:07.0427455Z Entering 'third_party/cudnn_frontend' 2024-08-06T20:25:07.0473543Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2024-08-06T20:25:07.0488157Z Entering 'third_party/cutlass' 2024-08-06T20:25:07.0534883Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2024-08-06T20:25:07.0559386Z Entering 'third_party/eigen' 2024-08-06T20:25:07.0605240Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2024-08-06T20:25:07.0621915Z Entering 'third_party/fbgemm' 2024-08-06T20:25:07.0668713Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2024-08-06T20:25:07.0682949Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-06T20:25:07.0729496Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2024-08-06T20:25:07.0743769Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T20:25:07.0790294Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2024-08-06T20:25:07.0804786Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-06T20:25:07.0849404Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2024-08-06T20:25:07.0870089Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-06T20:25:07.0914960Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2024-08-06T20:25:07.0929218Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T20:25:07.0974040Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2024-08-06T20:25:07.0989993Z Entering 'third_party/flatbuffers' 2024-08-06T20:25:07.1037333Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2024-08-06T20:25:07.1056385Z Entering 'third_party/fmt' 2024-08-06T20:25:07.1103288Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2024-08-06T20:25:07.1118062Z Entering 'third_party/foxi' 2024-08-06T20:25:07.1163433Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/foxi/config remote.origin.url 2024-08-06T20:25:07.1179496Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-06T20:25:07.1225359Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2024-08-06T20:25:07.1239991Z Entering 'third_party/gloo' 2024-08-06T20:25:07.1285022Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2024-08-06T20:25:07.1299877Z Entering 'third_party/googletest' 2024-08-06T20:25:07.1345333Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2024-08-06T20:25:07.1361300Z Entering 'third_party/ideep' 2024-08-06T20:25:07.1408467Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2024-08-06T20:25:07.1422123Z Entering 'third_party/ideep/mkl-dnn' 2024-08-06T20:25:07.1467323Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2024-08-06T20:25:07.1489161Z Entering 'third_party/ittapi' 2024-08-06T20:25:07.1535483Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2024-08-06T20:25:07.1550074Z Entering 'third_party/kineto' 2024-08-06T20:25:07.1595648Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2024-08-06T20:25:07.1610035Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T20:25:07.1656991Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2024-08-06T20:25:07.1670720Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T20:25:07.1718363Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2024-08-06T20:25:07.1734012Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T20:25:07.1782280Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2024-08-06T20:25:07.1796643Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T20:25:07.1843419Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2024-08-06T20:25:07.1857592Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T20:25:07.1904581Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2024-08-06T20:25:07.1917610Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T20:25:07.1965156Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2024-08-06T20:25:07.1981278Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T20:25:07.2027496Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2024-08-06T20:25:07.2041972Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T20:25:07.2088860Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2024-08-06T20:25:07.2102762Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T20:25:07.2150024Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2024-08-06T20:25:07.2165041Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T20:25:07.2212372Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2024-08-06T20:25:07.2227824Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T20:25:07.2273796Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2024-08-06T20:25:07.2288419Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T20:25:07.2333834Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2024-08-06T20:25:07.2349473Z Entering 'third_party/mimalloc' 2024-08-06T20:25:07.2396155Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2024-08-06T20:25:07.2411290Z Entering 'third_party/nccl/nccl' 2024-08-06T20:25:07.2456944Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nccl/nccl/config remote.origin.url 2024-08-06T20:25:07.2471769Z Entering 'third_party/nlohmann' 2024-08-06T20:25:07.2516812Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2024-08-06T20:25:07.2532576Z Entering 'third_party/onnx' 2024-08-06T20:25:07.2578632Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2024-08-06T20:25:07.2607975Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-06T20:25:07.2654252Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/benchmark/config remote.origin.url 2024-08-06T20:25:07.2668733Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-06T20:25:07.2715366Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2024-08-06T20:25:07.2731908Z Entering 'third_party/opentelemetry-cpp' 2024-08-06T20:25:07.2779143Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2024-08-06T20:25:07.2795050Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T20:25:07.2842046Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2024-08-06T20:25:07.2855977Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T20:25:07.2903467Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2024-08-06T20:25:07.2917408Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T20:25:07.2962466Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2024-08-06T20:25:07.2977777Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T20:25:07.3023054Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2024-08-06T20:25:07.3038494Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T20:25:07.3084192Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2024-08-06T20:25:07.3098122Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T20:25:07.3142968Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2024-08-06T20:25:07.3157195Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T20:25:07.3204432Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2024-08-06T20:25:07.3217793Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T20:25:07.3264002Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2024-08-06T20:25:07.3284182Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T20:25:07.3330373Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2024-08-06T20:25:07.3346138Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T20:25:07.3392011Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2024-08-06T20:25:07.3426487Z Entering 'third_party/pocketfft' 2024-08-06T20:25:07.3472375Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2024-08-06T20:25:07.3487673Z Entering 'third_party/protobuf' 2024-08-06T20:25:07.3535194Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2024-08-06T20:25:07.3552827Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-06T20:25:07.3599115Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2024-08-06T20:25:07.3612732Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-06T20:25:07.3657916Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2024-08-06T20:25:07.3673838Z Entering 'third_party/psimd' 2024-08-06T20:25:07.3720074Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2024-08-06T20:25:07.3735581Z Entering 'third_party/pthreadpool' 2024-08-06T20:25:07.3782402Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2024-08-06T20:25:07.3797184Z Entering 'third_party/pybind11' 2024-08-06T20:25:07.3843314Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2024-08-06T20:25:07.3857751Z Entering 'third_party/python-peachpy' 2024-08-06T20:25:07.3903236Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2024-08-06T20:25:07.3918453Z Entering 'third_party/sleef' 2024-08-06T20:25:07.3963287Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2024-08-06T20:25:07.3978658Z Entering 'third_party/tensorpipe' 2024-08-06T20:25:07.4025049Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2024-08-06T20:25:07.4039334Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-06T20:25:07.4084800Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2024-08-06T20:25:07.4099570Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-06T20:25:07.4144536Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2024-08-06T20:25:07.4158478Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-06T20:25:07.4203414Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2024-08-06T20:25:07.4218009Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T20:25:07.4263765Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2024-08-06T20:25:07.4277660Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T20:25:07.4323341Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2024-08-06T20:25:07.5295572Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2024-08-06T20:25:07.5573429Z Entering 'android/libs/fbjni' 2024-08-06T20:25:07.5613013Z Entering 'third_party/FP16' 2024-08-06T20:25:07.5651239Z Entering 'third_party/FXdiv' 2024-08-06T20:25:07.5689285Z Entering 'third_party/NNPACK' 2024-08-06T20:25:07.5727117Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-06T20:25:07.5765004Z Entering 'third_party/XNNPACK' 2024-08-06T20:25:07.5820071Z Entering 'third_party/benchmark' 2024-08-06T20:25:07.5857802Z Entering 'third_party/cpp-httplib' 2024-08-06T20:25:07.5896167Z Entering 'third_party/cpuinfo' 2024-08-06T20:25:07.5934080Z Entering 'third_party/cudnn_frontend' 2024-08-06T20:25:07.5971883Z Entering 'third_party/cutlass' 2024-08-06T20:25:07.6016408Z Entering 'third_party/eigen' 2024-08-06T20:25:07.6055828Z Entering 'third_party/fbgemm' 2024-08-06T20:25:07.6095405Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-06T20:25:07.6132505Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T20:25:07.6169528Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-06T20:25:07.6213507Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-06T20:25:07.6250458Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T20:25:07.6290146Z Entering 'third_party/flatbuffers' 2024-08-06T20:25:07.6330571Z Entering 'third_party/fmt' 2024-08-06T20:25:07.6368494Z Entering 'third_party/foxi' 2024-08-06T20:25:07.6406946Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-06T20:25:07.6444387Z Entering 'third_party/gloo' 2024-08-06T20:25:07.6483317Z Entering 'third_party/googletest' 2024-08-06T20:25:07.6521787Z Entering 'third_party/ideep' 2024-08-06T20:25:07.6558746Z Entering 'third_party/ideep/mkl-dnn' 2024-08-06T20:25:07.6604262Z Entering 'third_party/ittapi' 2024-08-06T20:25:07.6642346Z Entering 'third_party/kineto' 2024-08-06T20:25:07.6681399Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T20:25:07.6719188Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T20:25:07.6758462Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T20:25:07.6796597Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T20:25:07.6833285Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T20:25:07.6869379Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T20:25:07.6908039Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T20:25:07.6945477Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T20:25:07.6983913Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T20:25:07.7021826Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T20:25:07.7060884Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T20:25:07.7099326Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T20:25:07.7137674Z Entering 'third_party/mimalloc' 2024-08-06T20:25:07.7176314Z Entering 'third_party/nccl/nccl' 2024-08-06T20:25:07.7214546Z Entering 'third_party/nlohmann' 2024-08-06T20:25:07.7253228Z Entering 'third_party/onnx' 2024-08-06T20:25:07.7307069Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-06T20:25:07.7344631Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-06T20:25:07.7385641Z Entering 'third_party/opentelemetry-cpp' 2024-08-06T20:25:07.7425218Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T20:25:07.7462024Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T20:25:07.7499467Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T20:25:07.7535741Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T20:25:07.7574066Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T20:25:07.7614152Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T20:25:07.7650534Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T20:25:07.7687782Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T20:25:07.7727104Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T20:25:07.7766208Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T20:25:07.7824514Z Entering 'third_party/pocketfft' 2024-08-06T20:25:07.7862817Z Entering 'third_party/protobuf' 2024-08-06T20:25:07.7905826Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-06T20:25:07.7942847Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-06T20:25:07.7981367Z Entering 'third_party/psimd' 2024-08-06T20:25:07.8019798Z Entering 'third_party/pthreadpool' 2024-08-06T20:25:07.8057081Z Entering 'third_party/pybind11' 2024-08-06T20:25:07.8095226Z Entering 'third_party/python-peachpy' 2024-08-06T20:25:07.8133515Z Entering 'third_party/sleef' 2024-08-06T20:25:07.8171262Z Entering 'third_party/tensorpipe' 2024-08-06T20:25:07.8211149Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-06T20:25:07.8247294Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-06T20:25:07.8284401Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-06T20:25:07.8321705Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T20:25:07.8357404Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T20:25:07.8409295Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2024-08-06T20:25:07.8680807Z Entering 'android/libs/fbjni' 2024-08-06T20:25:07.8719234Z Entering 'third_party/FP16' 2024-08-06T20:25:07.8757357Z Entering 'third_party/FXdiv' 2024-08-06T20:25:07.8796101Z Entering 'third_party/NNPACK' 2024-08-06T20:25:07.8833930Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-06T20:25:07.8872922Z Entering 'third_party/XNNPACK' 2024-08-06T20:25:07.8928769Z Entering 'third_party/benchmark' 2024-08-06T20:25:07.8967058Z Entering 'third_party/cpp-httplib' 2024-08-06T20:25:07.9005391Z Entering 'third_party/cpuinfo' 2024-08-06T20:25:07.9043912Z Entering 'third_party/cudnn_frontend' 2024-08-06T20:25:07.9082272Z Entering 'third_party/cutlass' 2024-08-06T20:25:07.9127833Z Entering 'third_party/eigen' 2024-08-06T20:25:07.9167351Z Entering 'third_party/fbgemm' 2024-08-06T20:25:07.9205631Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-06T20:25:07.9242891Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T20:25:07.9281459Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-06T20:25:07.9326608Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-06T20:25:07.9362936Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T20:25:07.9402025Z Entering 'third_party/flatbuffers' 2024-08-06T20:25:07.9444296Z Entering 'third_party/fmt' 2024-08-06T20:25:07.9482191Z Entering 'third_party/foxi' 2024-08-06T20:25:07.9520613Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-06T20:25:07.9559312Z Entering 'third_party/gloo' 2024-08-06T20:25:07.9598397Z Entering 'third_party/googletest' 2024-08-06T20:25:07.9636340Z Entering 'third_party/ideep' 2024-08-06T20:25:07.9673768Z Entering 'third_party/ideep/mkl-dnn' 2024-08-06T20:25:07.9718227Z Entering 'third_party/ittapi' 2024-08-06T20:25:07.9756079Z Entering 'third_party/kineto' 2024-08-06T20:25:07.9794937Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T20:25:07.9832658Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T20:25:07.9871602Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T20:25:07.9910061Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T20:25:07.9947118Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T20:25:07.9984239Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T20:25:08.0023123Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T20:25:08.0061138Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T20:25:08.0099054Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T20:25:08.0137358Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T20:25:08.0176193Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T20:25:08.0213046Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T20:25:08.0251832Z Entering 'third_party/mimalloc' 2024-08-06T20:25:08.0291633Z Entering 'third_party/nccl/nccl' 2024-08-06T20:25:08.0329216Z Entering 'third_party/nlohmann' 2024-08-06T20:25:08.0369270Z Entering 'third_party/onnx' 2024-08-06T20:25:08.0423434Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-06T20:25:08.0461656Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-06T20:25:08.0501971Z Entering 'third_party/opentelemetry-cpp' 2024-08-06T20:25:08.0542847Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T20:25:08.0580244Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T20:25:08.0617044Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T20:25:08.0653364Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T20:25:08.0691468Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T20:25:08.0727747Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T20:25:08.0764115Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T20:25:08.0800426Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T20:25:08.0840248Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T20:25:08.0879228Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T20:25:08.0937349Z Entering 'third_party/pocketfft' 2024-08-06T20:25:08.0976796Z Entering 'third_party/protobuf' 2024-08-06T20:25:08.1018059Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-06T20:25:08.1055005Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-06T20:25:08.1094491Z Entering 'third_party/psimd' 2024-08-06T20:25:08.1133309Z Entering 'third_party/pthreadpool' 2024-08-06T20:25:08.1171028Z Entering 'third_party/pybind11' 2024-08-06T20:25:08.1208965Z Entering 'third_party/python-peachpy' 2024-08-06T20:25:08.1246473Z Entering 'third_party/sleef' 2024-08-06T20:25:08.1284913Z Entering 'third_party/tensorpipe' 2024-08-06T20:25:08.1325620Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-06T20:25:08.1362783Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-06T20:25:08.1399115Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-06T20:25:08.1436838Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T20:25:08.1472655Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T20:25:08.1521936Z ##[endgroup] 2024-08-06T20:25:08.1559286Z [command]/usr/bin/git log -1 --format='%H' 2024-08-06T20:25:08.1585938Z 'b9d86fa89636e301796d4201f36d86c73f6e49bc' 2024-08-06T20:25:08.1726842Z Prepare all required actions 2024-08-06T20:25:08.1727353Z Getting action download info 2024-08-06T20:25:08.3124268Z ##[group]Run ./.github/actions/setup-linux 2024-08-06T20:25:08.3124620Z env: 2024-08-06T20:25:08.3124838Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:08.3125111Z ##[endgroup] 2024-08-06T20:25:08.3174813Z ##[group]Run set -euo pipefail 2024-08-06T20:25:08.3175170Z set -euo pipefail 2024-08-06T20:25:08.3175483Z function get_ec2_metadata() { 2024-08-06T20:25:08.3175880Z  # Pulled from instance metadata endpoint for EC2 2024-08-06T20:25:08.3176519Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2024-08-06T20:25:08.3177100Z  category=$1 2024-08-06T20:25:08.3177472Z  # If it is GCP runner (runner name contains gcp), do not run this 2024-08-06T20:25:08.3177911Z  runner_name_str=i-0035969de18878034 2024-08-06T20:25:08.3178335Z  if [[ -f /.inarc ]]; then 2024-08-06T20:25:08.3178679Z  echo "ARC Runner, no info on ec2 metadata" 2024-08-06T20:25:08.3179078Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2024-08-06T20:25:08.3179560Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2024-08-06T20:25:08.3180001Z  else 2024-08-06T20:25:08.3180342Z  curl -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2024-08-06T20:25:08.3180762Z  fi 2024-08-06T20:25:08.3180987Z } 2024-08-06T20:25:08.3181241Z echo "ami-id: $(get_ec2_metadata ami-id)" 2024-08-06T20:25:08.3181679Z echo "instance-id: $(get_ec2_metadata instance-id)" 2024-08-06T20:25:08.3182174Z echo "instance-type: $(get_ec2_metadata instance-type)" 2024-08-06T20:25:08.3182591Z echo "system info $(uname -a)" 2024-08-06T20:25:08.3189745Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:08.3190147Z env: 2024-08-06T20:25:08.3190371Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:08.3190643Z ##[endgroup] 2024-08-06T20:25:08.3280222Z ami-id: ami-06c68f701d8090592 2024-08-06T20:25:08.3328035Z instance-id: i-0035969de18878034 2024-08-06T20:25:08.3372515Z instance-type: c5.2xlarge 2024-08-06T20:25:08.3382217Z system info Linux ip-10-0-41-185.ec2.internal 6.1.94-99.176.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Jun 18 14:57:56 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux 2024-08-06T20:25:08.3415787Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-06T20:25:08.3416459Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> $GITHUB_OUTPUT 2024-08-06T20:25:08.3422788Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:08.3423184Z env: 2024-08-06T20:25:08.3423410Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:08.3423670Z ##[endgroup] 2024-08-06T20:25:08.3501540Z ##[group]Run if systemctl is-active --quiet docker; then 2024-08-06T20:25:08.3502391Z if systemctl is-active --quiet docker; then 2024-08-06T20:25:08.3503015Z  echo "Docker daemon is running..."; 2024-08-06T20:25:08.3503547Z else 2024-08-06T20:25:08.3504141Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2024-08-06T20:25:08.3504896Z fi 2024-08-06T20:25:08.3512175Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:08.3512871Z env: 2024-08-06T20:25:08.3513257Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:08.3513740Z ##[endgroup] 2024-08-06T20:25:08.3584900Z Docker daemon is running... 2024-08-06T20:25:08.3649576Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-06T20:25:08.3650131Z with: 2024-08-06T20:25:08.3650351Z shell: bash 2024-08-06T20:25:08.3650572Z timeout_minutes: 5 2024-08-06T20:25:08.3650828Z max_attempts: 3 2024-08-06T20:25:08.3651078Z retry_wait_seconds: 30 2024-08-06T20:25:08.3652311Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" 2024-08-06T20:25:08.3653555Z polling_interval_seconds: 1 2024-08-06T20:25:08.3653858Z warning_on_retry: true 2024-08-06T20:25:08.3654132Z continue_on_error: false 2024-08-06T20:25:08.3654387Z env: 2024-08-06T20:25:08.3654610Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:08.3654874Z AWS_RETRY_MODE: standard 2024-08-06T20:25:08.3655147Z AWS_MAX_ATTEMPTS: 5 2024-08-06T20:25:08.3655413Z AWS_DEFAULT_REGION: us-east-1 2024-08-06T20:25:08.3655686Z ##[endgroup] 2024-08-06T20:25:09.5049438Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-06T20:25:09.5050176Z Configure a credential helper to remove this warning. See 2024-08-06T20:25:09.5051120Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-06T20:25:09.5051549Z 2024-08-06T20:25:09.5051669Z Login Succeeded 2024-08-06T20:25:10.4220272Z Command completed after 1 attempt(s). 2024-08-06T20:25:10.4283417Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-06T20:25:10.4283958Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-06T20:25:10.4284438Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2024-08-06T20:25:10.4290451Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:10.4290833Z env: 2024-08-06T20:25:10.4291067Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:10.4291340Z ##[endgroup] 2024-08-06T20:25:10.4372482Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-06T20:25:10.4373070Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-06T20:25:10.4373500Z # shellcheck disable=SC2046 2024-08-06T20:25:10.4373849Z docker stop $(docker ps -q) || true 2024-08-06T20:25:10.4374450Z # Prune all of the docker images 2024-08-06T20:25:10.4374785Z docker system prune -af 2024-08-06T20:25:10.4380006Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:10.4380397Z env: 2024-08-06T20:25:10.4380605Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:10.4380875Z ##[endgroup] 2024-08-06T20:25:10.4626968Z "docker stop" requires at least 1 argument. 2024-08-06T20:25:10.4627389Z See 'docker stop --help'. 2024-08-06T20:25:10.4627572Z 2024-08-06T20:25:10.4627741Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2024-08-06T20:25:10.4628034Z 2024-08-06T20:25:10.4628148Z Stop one or more running containers 2024-08-06T20:25:10.4786765Z Total reclaimed space: 0B 2024-08-06T20:25:10.4847472Z ##[group]Run set +e 2024-08-06T20:25:10.4847777Z set +e 2024-08-06T20:25:10.4848017Z set -x 2024-08-06T20:25:10.4848235Z  2024-08-06T20:25:10.4848485Z PT_DOMAIN=download.pytorch.org 2024-08-06T20:25:10.4849100Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2024-08-06T20:25:10.4849884Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2024-08-06T20:25:10.4850417Z # one is returned at random 2024-08-06T20:25:10.4850819Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2024-08-06T20:25:10.4851205Z  2024-08-06T20:25:10.4851427Z if [ -z "${RESOLVED_IP}" ]; then 2024-08-06T20:25:10.4851874Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2024-08-06T20:25:10.4852414Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2024-08-06T20:25:10.4852810Z  2024-08-06T20:25:10.4853054Z  if [ -z "${RESOLVED_IP}" ]; then 2024-08-06T20:25:10.4853448Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2024-08-06T20:25:10.4853808Z  exit 1 2024-08-06T20:25:10.4854048Z  fi 2024-08-06T20:25:10.4854506Z fi 2024-08-06T20:25:10.4854712Z  2024-08-06T20:25:10.4854977Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2024-08-06T20:25:10.4855355Z  # Clean up any old records first 2024-08-06T20:25:10.4855716Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2024-08-06T20:25:10.4856052Z fi 2024-08-06T20:25:10.4856269Z  2024-08-06T20:25:10.4856573Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2024-08-06T20:25:10.4856983Z cat /etc/hosts 2024-08-06T20:25:10.4862512Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:10.4862894Z env: 2024-08-06T20:25:10.4863120Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:10.4863392Z ##[endgroup] 2024-08-06T20:25:10.4885624Z + PT_DOMAIN=download.pytorch.org 2024-08-06T20:25:10.4891200Z ++ dig -4 +short download.pytorch.org 2024-08-06T20:25:10.4891858Z ++ tail -n1 2024-08-06T20:25:10.5161843Z + RESOLVED_IP=18.160.10.36 2024-08-06T20:25:10.5162262Z + '[' -z 18.160.10.36 ']' 2024-08-06T20:25:10.5162565Z + grep -r download.pytorch.org /etc/hosts 2024-08-06T20:25:10.5172726Z 18.160.10.36 download.pytorch.org 2024-08-06T20:25:10.5173821Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2024-08-06T20:25:10.7648742Z + echo '18.160.10.36 download.pytorch.org' 2024-08-06T20:25:10.7649274Z + sudo tee -a /etc/hosts 2024-08-06T20:25:10.8043417Z 18.160.10.36 download.pytorch.org 2024-08-06T20:25:10.8057620Z + cat /etc/hosts 2024-08-06T20:25:10.8065541Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2024-08-06T20:25:10.8073035Z ::1 localhost6 localhost6.localdomain6 2024-08-06T20:25:10.8073433Z 18.160.10.36 download.pytorch.org 2024-08-06T20:25:10.8207475Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2024-08-06T20:25:10.8207956Z with: 2024-08-06T20:25:10.8208631Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8209437Z docker-build-dir: .ci/docker 2024-08-06T20:25:10.8209736Z working-directory: . 2024-08-06T20:25:10.8210096Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:10.8210495Z force-push: false 2024-08-06T20:25:10.8210734Z env: 2024-08-06T20:25:10.8210943Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:10.8211214Z ##[endgroup] 2024-08-06T20:25:10.8237351Z ##[group]Run set -ex 2024-08-06T20:25:10.8237661Z set -ex 2024-08-06T20:25:10.8237899Z  2024-08-06T20:25:10.8238304Z # If the docker build directory or the build script doesn't exist, the action will 2024-08-06T20:25:10.8239027Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2024-08-06T20:25:10.8239600Z # job could then download the pre-built image as usual 2024-08-06T20:25:10.8240128Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2024-08-06T20:25:10.8240627Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8241091Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8241501Z  2024-08-06T20:25:10.8241861Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2024-08-06T20:25:10.8242313Z  exit 0 2024-08-06T20:25:10.8242531Z else 2024-08-06T20:25:10.8242799Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8243132Z fi 2024-08-06T20:25:10.8243337Z  2024-08-06T20:25:10.8243683Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2024-08-06T20:25:10.8244310Z  # The docker image name already includes the ECR prefix and tag, so we can just 2024-08-06T20:25:10.8244846Z  # use it as it is, but first let's extract the tag 2024-08-06T20:25:10.8245343Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2024-08-06T20:25:10.8246124Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8246618Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8247038Z else 2024-08-06T20:25:10.8247357Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2024-08-06T20:25:10.8247817Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8248477Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8249054Z fi 2024-08-06T20:25:10.8256525Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:10.8256921Z env: 2024-08-06T20:25:10.8257144Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:10.8257410Z REPO_NAME: pytorch 2024-08-06T20:25:10.8258125Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8258905Z DOCKER_BUILD_DIR: .ci/docker 2024-08-06T20:25:10.8259275Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:10.8259683Z ##[endgroup] 2024-08-06T20:25:10.8283463Z + [[ ! -d .ci/docker ]] 2024-08-06T20:25:10.8283875Z + [[ ! -f .ci/docker/build.sh ]] 2024-08-06T20:25:10.8284278Z + echo skip=false 2024-08-06T20:25:10.8285865Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2024-08-06T20:25:10.8290197Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8291030Z ++ awk -F '[:,]' '{print $2}' 2024-08-06T20:25:10.8309295Z + DOCKER_TAG=02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8309818Z + echo docker-tag=02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8310859Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8340271Z ##[group]Run set +e 2024-08-06T20:25:10.8340599Z set +e 2024-08-06T20:25:10.8340826Z set -x 2024-08-06T20:25:10.8341061Z  2024-08-06T20:25:10.8341284Z login() { 2024-08-06T20:25:10.8341764Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-06T20:25:10.8342300Z } 2024-08-06T20:25:10.8342515Z  2024-08-06T20:25:10.8342716Z retry () { 2024-08-06T20:25:10.8343005Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-06T20:25:10.8343332Z } 2024-08-06T20:25:10.8343532Z  2024-08-06T20:25:10.8343771Z retry login "${DOCKER_REGISTRY}" 2024-08-06T20:25:10.8344077Z  2024-08-06T20:25:10.8344416Z # Check if image already exists, if it does then skip building it 2024-08-06T20:25:10.8344932Z if docker manifest inspect "${DOCKER_IMAGE}"; then 2024-08-06T20:25:10.8345309Z  exit 0 2024-08-06T20:25:10.8345525Z fi 2024-08-06T20:25:10.8345742Z  2024-08-06T20:25:10.8346086Z # NB: This part requires a full checkout. Otherwise, the merge base will 2024-08-06T20:25:10.8346673Z # be empty. The default action would be to continue rebuild the image 2024-08-06T20:25:10.8347200Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2024-08-06T20:25:10.8347664Z  # if we're on the base branch then use the parent commit 2024-08-06T20:25:10.8348069Z  MERGE_BASE=$(git rev-parse HEAD~) 2024-08-06T20:25:10.8348399Z else 2024-08-06T20:25:10.8348734Z  # otherwise we're on a PR, so use the most recent base commit 2024-08-06T20:25:10.8349210Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2024-08-06T20:25:10.8349714Z fi 2024-08-06T20:25:10.8349931Z  2024-08-06T20:25:10.8350157Z if [[ -z "${MERGE_BASE}" ]]; then 2024-08-06T20:25:10.8350530Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8350871Z  2024-08-06T20:25:10.8351335Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2024-08-06T20:25:10.8351904Z  exit 0 2024-08-06T20:25:10.8352136Z fi 2024-08-06T20:25:10.8352339Z  2024-08-06T20:25:10.8352652Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2024-08-06T20:25:10.8353357Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2024-08-06T20:25:10.8353949Z  exit 1 2024-08-06T20:25:10.8354180Z fi 2024-08-06T20:25:10.8354395Z  2024-08-06T20:25:10.8354756Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2024-08-06T20:25:10.8355440Z # If no image exists but the hash is the same as the previous hash then we should error out here 2024-08-06T20:25:10.8356046Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2024-08-06T20:25:10.8356743Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2024-08-06T20:25:10.8357517Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2024-08-06T20:25:10.8357989Z fi 2024-08-06T20:25:10.8358208Z  2024-08-06T20:25:10.8358464Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2024-08-06T20:25:10.8363923Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:10.8364317Z env: 2024-08-06T20:25:10.8364527Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:10.8364811Z DOCKER_BUILD_DIR: .ci/docker 2024-08-06T20:25:10.8365168Z BASE_REVISION: 1736af7cf736184c356be1bb00f59fb2feea6d7d 2024-08-06T20:25:10.8366078Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8366887Z DOCKER_TAG: 02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:10.8367354Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:10.8367738Z ##[endgroup] 2024-08-06T20:25:10.8390686Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:10.8391144Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:10.8393220Z + aws ecr get-login-password --region us-east-1 2024-08-06T20:25:10.8394215Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:11.3807072Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-06T20:25:11.3807706Z Configure a credential helper to remove this warning. See 2024-08-06T20:25:11.3808485Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-06T20:25:11.3809149Z 2024-08-06T20:25:11.3809312Z Login Succeeded 2024-08-06T20:25:11.3821482Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:11.6066167Z { 2024-08-06T20:25:11.6066603Z "schemaVersion": 2, 2024-08-06T20:25:11.6067234Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2024-08-06T20:25:11.6067899Z "config": { 2024-08-06T20:25:11.6068502Z "mediaType": "application/vnd.docker.container.image.v1+json", 2024-08-06T20:25:11.6069260Z "size": 43802, 2024-08-06T20:25:11.6070036Z "digest": "sha256:eb2e8636b63e804e38c5e56190d8b860c4bf8a9e0794f88825eff958ed6b1e76" 2024-08-06T20:25:11.6070961Z }, 2024-08-06T20:25:11.6071314Z "layers": [ 2024-08-06T20:25:11.6071612Z { 2024-08-06T20:25:11.6072100Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6073160Z "size": 30439866, 2024-08-06T20:25:11.6073831Z "digest": "sha256:9b857f539cb142c9aa2201a17bb8e1cd5cf12edd4a65adf5732fe9f4343964cf" 2024-08-06T20:25:11.6074782Z }, 2024-08-06T20:25:11.6075128Z { 2024-08-06T20:25:11.6075617Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6076290Z "size": 1820, 2024-08-06T20:25:11.6077000Z "digest": "sha256:ceceb076946ee95300822daccb5d3e4e45e6857d34996ef89305d9a078410f8e" 2024-08-06T20:25:11.6077860Z }, 2024-08-06T20:25:11.6078149Z { 2024-08-06T20:25:11.6078694Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6079389Z "size": 313165371, 2024-08-06T20:25:11.6080128Z "digest": "sha256:042461771f00f834b40891f079173616ad761e9e3b2ec2eb25affa3041d71a3d" 2024-08-06T20:25:11.6080816Z }, 2024-08-06T20:25:11.6081103Z { 2024-08-06T20:25:11.6081666Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6082294Z "size": 802, 2024-08-06T20:25:11.6082876Z "digest": "sha256:bac001ac2fee5df3367ff9332bc1fcd706a8de3ad05a1885903f338197619520" 2024-08-06T20:25:11.6083557Z }, 2024-08-06T20:25:11.6083825Z { 2024-08-06T20:25:11.6084265Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6084920Z "size": 106, 2024-08-06T20:25:11.6085337Z "digest": "sha256:4a587220513dc642f8fe95f4ae1b2b643225db8ae8753fa25b68a4f84488c4ab" 2024-08-06T20:25:11.6085896Z }, 2024-08-06T20:25:11.6086100Z { 2024-08-06T20:25:11.6086435Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6086851Z "size": 542, 2024-08-06T20:25:11.6087455Z "digest": "sha256:af8081143f008c5cb1bd61f6d92fde22553cfc007b6a77c2fd2aaf6a9f0088a9" 2024-08-06T20:25:11.6087951Z }, 2024-08-06T20:25:11.6088141Z { 2024-08-06T20:25:11.6088478Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6088907Z "size": 1242, 2024-08-06T20:25:11.6089319Z "digest": "sha256:e7a423dcab0171df0317d2cf65153a533a002a33dce81ae5b0972b06d0838e26" 2024-08-06T20:25:11.6089811Z }, 2024-08-06T20:25:11.6089998Z { 2024-08-06T20:25:11.6090332Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6090756Z "size": 483, 2024-08-06T20:25:11.6091157Z "digest": "sha256:ad26542e0d01609840496a12691483f2c50eb8e23002a205becb5b695f9159fb" 2024-08-06T20:25:11.6091632Z }, 2024-08-06T20:25:11.6091830Z { 2024-08-06T20:25:11.6092150Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6092580Z "size": 110321946, 2024-08-06T20:25:11.6093009Z "digest": "sha256:9e1d4f8784a0033c6a3605f0126d93af125fed0dd0839965c97924ba177e350e" 2024-08-06T20:25:11.6093482Z }, 2024-08-06T20:25:11.6093680Z { 2024-08-06T20:25:11.6094017Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6094432Z "size": 3679, 2024-08-06T20:25:11.6094848Z "digest": "sha256:b1f815d162740bbe496657c7b85acd702ea1818a4d93554f8a822bd964920100" 2024-08-06T20:25:11.6095331Z }, 2024-08-06T20:25:11.6095515Z { 2024-08-06T20:25:11.6095848Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6096272Z "size": 1907, 2024-08-06T20:25:11.6096673Z "digest": "sha256:91f9dddffbee46981d9e74382704c1b53c87f1808350cf1dd518687805d3aa59" 2024-08-06T20:25:11.6097155Z }, 2024-08-06T20:25:11.6097352Z { 2024-08-06T20:25:11.6097672Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6098094Z "size": 699, 2024-08-06T20:25:11.6098519Z "digest": "sha256:03fb78f207e3cbcfedfc7619a1d60fa576d3293d508a7e97dc09a5e7a9c65ab0" 2024-08-06T20:25:11.6098996Z }, 2024-08-06T20:25:11.6099306Z + exit 0 2024-08-06T20:25:11.6099519Z { 2024-08-06T20:25:11.6099840Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6100273Z "size": 2627946145, 2024-08-06T20:25:11.6100705Z "digest": "sha256:8385f3c14a81343c1f329fe1449447035a2acfc7b7e7c552321cded4206f1e1d" 2024-08-06T20:25:11.6101272Z }, 2024-08-06T20:25:11.6101474Z { 2024-08-06T20:25:11.6101809Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6102222Z "size": 32, 2024-08-06T20:25:11.6102642Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6103132Z }, 2024-08-06T20:25:11.6103317Z { 2024-08-06T20:25:11.6103647Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6104070Z "size": 378, 2024-08-06T20:25:11.6104476Z "digest": "sha256:202c71391ade27762d5e9cafde793db67b4d5e4d6869debe2643d5092101c461" 2024-08-06T20:25:11.6104958Z }, 2024-08-06T20:25:11.6105147Z { 2024-08-06T20:25:11.6105480Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6105906Z "size": 222877, 2024-08-06T20:25:11.6106328Z "digest": "sha256:240ee294d88b3c8decdc8b379b5bfae83e2224ed365151fe2e8026fca366d621" 2024-08-06T20:25:11.6106824Z }, 2024-08-06T20:25:11.6107025Z { 2024-08-06T20:25:11.6107347Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6107773Z "size": 231, 2024-08-06T20:25:11.6108194Z "digest": "sha256:7a823d3d7147e0cae46f715bfd2d9ffd953c6cadae532c88c8c857092e6456da" 2024-08-06T20:25:11.6108670Z }, 2024-08-06T20:25:11.6108865Z { 2024-08-06T20:25:11.6109199Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6109614Z "size": 2933351, 2024-08-06T20:25:11.6110041Z "digest": "sha256:a1b9e8856530ee2f7a1abe6b877bf49121fe149f66fbb6ba309902c35f139fb6" 2024-08-06T20:25:11.6110526Z }, 2024-08-06T20:25:11.6110712Z { 2024-08-06T20:25:11.6111117Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6111551Z "size": 1804, 2024-08-06T20:25:11.6111968Z "digest": "sha256:9c5b585a81167e4e7befcddfd54e7b522e6ed96b7c9a9773ef7099c23000ca20" 2024-08-06T20:25:11.6112466Z }, 2024-08-06T20:25:11.6112673Z { 2024-08-06T20:25:11.6112997Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6113430Z "size": 105, 2024-08-06T20:25:11.6113858Z "digest": "sha256:9cd1bcd9f117daa712ab4916cef270b8b4ecf401bed1df3784d55147457c5de5" 2024-08-06T20:25:11.6114341Z }, 2024-08-06T20:25:11.6114545Z { 2024-08-06T20:25:11.6114883Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6115302Z "size": 563, 2024-08-06T20:25:11.6115722Z "digest": "sha256:2b9731d295d60278e361d491fc274e5d558a89ec5adeb9fdf342d7a8cc17bfec" 2024-08-06T20:25:11.6116211Z }, 2024-08-06T20:25:11.6116403Z { 2024-08-06T20:25:11.6116746Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6117175Z "size": 32, 2024-08-06T20:25:11.6117586Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6118071Z }, 2024-08-06T20:25:11.6118258Z { 2024-08-06T20:25:11.6118602Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6119034Z "size": 104, 2024-08-06T20:25:11.6119429Z "digest": "sha256:8d223c48f5429ef9db659237511d2d5f73345f1f217d316591adc008e8abb5a0" 2024-08-06T20:25:11.6119902Z }, 2024-08-06T20:25:11.6120360Z { 2024-08-06T20:25:11.6120685Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6121113Z "size": 502, 2024-08-06T20:25:11.6121525Z "digest": "sha256:49a0e418a175ac12f1b4b503e80e22679bc321e6163ed5b203af848204f0606a" 2024-08-06T20:25:11.6121990Z }, 2024-08-06T20:25:11.6122189Z { 2024-08-06T20:25:11.6122522Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6122942Z "size": 101109806, 2024-08-06T20:25:11.6123370Z "digest": "sha256:51ed474f6c3273503d24a4b965ff3b7e49e8684501e10413499ecc7249337a86" 2024-08-06T20:25:11.6123855Z }, 2024-08-06T20:25:11.6124042Z { 2024-08-06T20:25:11.6124378Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6124888Z "size": 109, 2024-08-06T20:25:11.6125294Z "digest": "sha256:1c01ecb575c64355bc7f0f73f60b8d212e7a83cd58347d573d0074c2a5926b57" 2024-08-06T20:25:11.6125848Z }, 2024-08-06T20:25:11.6126047Z { 2024-08-06T20:25:11.6126367Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6126791Z "size": 487, 2024-08-06T20:25:11.6127211Z "digest": "sha256:a2630e5fe166ae8ff146e4c14db0bdc1299ed2b6120108351c961adcd2375288" 2024-08-06T20:25:11.6127684Z }, 2024-08-06T20:25:11.6127880Z { 2024-08-06T20:25:11.6128210Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6128623Z "size": 340, 2024-08-06T20:25:11.6129039Z "digest": "sha256:554a42b2a2e61462bb2c2c08ed88f895679ad08a1e9295d040c239217102dc70" 2024-08-06T20:25:11.6129518Z }, 2024-08-06T20:25:11.6129704Z { 2024-08-06T20:25:11.6130041Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6130475Z "size": 103, 2024-08-06T20:25:11.6130882Z "digest": "sha256:c9a20a1fda169765309cb8a927a7ad545bddb403e1ed7db164678f1c0c3b5552" 2024-08-06T20:25:11.6131369Z }, 2024-08-06T20:25:11.6131567Z { 2024-08-06T20:25:11.6131888Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6132309Z "size": 1470, 2024-08-06T20:25:11.6132722Z "digest": "sha256:2c2e35b979f5fc0ecccef6efc157a97f33db01a77958fa33855dc367544a5c46" 2024-08-06T20:25:11.6133209Z }, 2024-08-06T20:25:11.6133407Z { 2024-08-06T20:25:11.6133727Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6134155Z "size": 629993175, 2024-08-06T20:25:11.6134691Z "digest": "sha256:0e3c02dff025006601de33f0303b8c2f62aefdee1d0c34db3a60419ebe1a7e30" 2024-08-06T20:25:11.6135170Z }, 2024-08-06T20:25:11.6135371Z { 2024-08-06T20:25:11.6135709Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6136122Z "size": 160, 2024-08-06T20:25:11.6136548Z "digest": "sha256:2c2cb9893903884e0cf968da484f3b97fb62e1a881f8d68b437c240c0f2f25d1" 2024-08-06T20:25:11.6137030Z }, 2024-08-06T20:25:11.6137218Z { 2024-08-06T20:25:11.6137550Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6137974Z "size": 2209, 2024-08-06T20:25:11.6138377Z "digest": "sha256:ec0a42784a49a934dcd7d8c99dbe058a3828080e6716a12cba391210891574f3" 2024-08-06T20:25:11.6138853Z }, 2024-08-06T20:25:11.6139049Z { 2024-08-06T20:25:11.6139370Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6139792Z "size": 150, 2024-08-06T20:25:11.6140202Z "digest": "sha256:a20886f4e5372f586ef3e2728653d1969c6d898d8eae0667de17908891ac278f" 2024-08-06T20:25:11.6140664Z }, 2024-08-06T20:25:11.6140863Z { 2024-08-06T20:25:11.6141196Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6141610Z "size": 643, 2024-08-06T20:25:11.6142032Z "digest": "sha256:af1fb4fa4eed1c385edc3660525fa1e46533ec917477c141d430c07c735ff8da" 2024-08-06T20:25:11.6142523Z }, 2024-08-06T20:25:11.6142712Z { 2024-08-06T20:25:11.6143053Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6143482Z "size": 32, 2024-08-06T20:25:11.6143892Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6144380Z }, 2024-08-06T20:25:11.6144576Z { 2024-08-06T20:25:11.6144898Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6145321Z "size": 162, 2024-08-06T20:25:11.6145744Z "digest": "sha256:de13eba39cb5160281708ab7fda3d1c4e26a9edb7793e8fddc3355c37a2c2bb6" 2024-08-06T20:25:11.6146227Z }, 2024-08-06T20:25:11.6146424Z { 2024-08-06T20:25:11.6146743Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6147180Z "size": 109, 2024-08-06T20:25:11.6147608Z "digest": "sha256:ac851722c4ad33e4e6ad7a9580ff1f61e91dc5ec40f5e5ff5629cd32c8a6dff9" 2024-08-06T20:25:11.6148158Z }, 2024-08-06T20:25:11.6148363Z { 2024-08-06T20:25:11.6148704Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6149124Z "size": 102, 2024-08-06T20:25:11.6149537Z "digest": "sha256:225d8e1484f0c72016ef99e76b8309a3472d6fb528b34633eb25c00394e350d9" 2024-08-06T20:25:11.6150015Z }, 2024-08-06T20:25:11.6150204Z { 2024-08-06T20:25:11.6150544Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6150979Z "size": 421, 2024-08-06T20:25:11.6151377Z "digest": "sha256:0b92275d203788d5d990e589228173aa2fe9709737328fd78f2aa02bf159a285" 2024-08-06T20:25:11.6151857Z }, 2024-08-06T20:25:11.6152056Z { 2024-08-06T20:25:11.6152385Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6152817Z "size": 32, 2024-08-06T20:25:11.6153245Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6153721Z }, 2024-08-06T20:25:11.6153926Z { 2024-08-06T20:25:11.6154262Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6154684Z "size": 111, 2024-08-06T20:25:11.6155107Z "digest": "sha256:86d521d46977bce4fd8bbc492e3f0310b7f26ffc5e36fafe97225a7ca8fa9ffa" 2024-08-06T20:25:11.6155593Z }, 2024-08-06T20:25:11.6155776Z { 2024-08-06T20:25:11.6156109Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6156537Z "size": 471, 2024-08-06T20:25:11.6156945Z "digest": "sha256:3914906be0cb7fd68abac1a779b275af42993ccb4ed1bd1015f467e170d0b1f4" 2024-08-06T20:25:11.6157424Z }, 2024-08-06T20:25:11.6157620Z { 2024-08-06T20:25:11.6158005Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6158434Z "size": 32, 2024-08-06T20:25:11.6158852Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6159325Z }, 2024-08-06T20:25:11.6159526Z { 2024-08-06T20:25:11.6159865Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6160278Z "size": 112, 2024-08-06T20:25:11.6160692Z "digest": "sha256:193407c5262c69087b764527f63b3d7e47e029f4f0ddf8f6a3fe4baaa7f29c57" 2024-08-06T20:25:11.6161171Z }, 2024-08-06T20:25:11.6161361Z { 2024-08-06T20:25:11.6161692Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6162105Z "size": 562, 2024-08-06T20:25:11.6162523Z "digest": "sha256:adf9d181cfbca5b0544f23797995d4ea6500cc4a635db9f7e18954c9044e9f4a" 2024-08-06T20:25:11.6163008Z }, 2024-08-06T20:25:11.6163193Z { 2024-08-06T20:25:11.6163523Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6163953Z "size": 43163921, 2024-08-06T20:25:11.6164378Z "digest": "sha256:736c4af6f5277292080e42bfc2c7edaf8412ef1b795cf6fcbf2e95beffbb7ed2" 2024-08-06T20:25:11.6164865Z }, 2024-08-06T20:25:11.6165064Z { 2024-08-06T20:25:11.6165459Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6165902Z "size": 106, 2024-08-06T20:25:11.6166321Z "digest": "sha256:801521a42094555983e4a2674ddbb195243f6fe0d15ad1aeaab4aa88d81d22c4" 2024-08-06T20:25:11.6166787Z }, 2024-08-06T20:25:11.6166989Z { 2024-08-06T20:25:11.6167329Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6167745Z "size": 294, 2024-08-06T20:25:11.6168168Z "digest": "sha256:ed7b11c2ed84119d1bd1ebf8b7317c20e0f79da24ca754a02cb6775c00a17ae1" 2024-08-06T20:25:11.6168656Z }, 2024-08-06T20:25:11.6168839Z { 2024-08-06T20:25:11.6169177Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6169639Z "size": 32, 2024-08-06T20:25:11.6170048Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6170534Z }, 2024-08-06T20:25:11.6170730Z { 2024-08-06T20:25:11.6171050Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6171548Z "size": 106, 2024-08-06T20:25:11.6171969Z "digest": "sha256:5c6f2f3fe7c213d4b989fac53b07197b9f9ab99fe04360200826bcb2ca7ac66e" 2024-08-06T20:25:11.6172441Z }, 2024-08-06T20:25:11.6172644Z { 2024-08-06T20:25:11.6172978Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6173390Z "size": 424, 2024-08-06T20:25:11.6173813Z "digest": "sha256:3886e8f57dc887a87bb710fbda080ef4fd521f1ed2e560a895b000c05f6e9b0a" 2024-08-06T20:25:11.6174489Z }, 2024-08-06T20:25:11.6174680Z { 2024-08-06T20:25:11.6175014Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6175442Z "size": 19308828, 2024-08-06T20:25:11.6175864Z "digest": "sha256:cc822658f193feb19cb990795b3114bca9c649bd221c0b1aab684e652069c295" 2024-08-06T20:25:11.6176345Z }, 2024-08-06T20:25:11.6176529Z { 2024-08-06T20:25:11.6176865Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6177290Z "size": 108, 2024-08-06T20:25:11.6177688Z "digest": "sha256:cca044783521353ee93922f8ea943e74964e2a9815b43751866ff494b8d4d8d9" 2024-08-06T20:25:11.6178164Z }, 2024-08-06T20:25:11.6178365Z { 2024-08-06T20:25:11.6178691Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6179122Z "size": 438, 2024-08-06T20:25:11.6179542Z "digest": "sha256:0eb80a0ac0006a45aa6b4581263cc1613ddf9545bd4a1d5a544310efe898ad81" 2024-08-06T20:25:11.6180014Z }, 2024-08-06T20:25:11.6180212Z { 2024-08-06T20:25:11.6180544Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6180957Z "size": 699, 2024-08-06T20:25:11.6181502Z "digest": "sha256:03fb78f207e3cbcfedfc7619a1d60fa576d3293d508a7e97dc09a5e7a9c65ab0" 2024-08-06T20:25:11.6181995Z }, 2024-08-06T20:25:11.6182181Z { 2024-08-06T20:25:11.6182518Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6182952Z "size": 141, 2024-08-06T20:25:11.6183364Z "digest": "sha256:a9f11b2b3622f5530c5cfefe973e96e028323fab1ff02e7a6337eb86fadebeb5" 2024-08-06T20:25:11.6183860Z }, 2024-08-06T20:25:11.6184063Z { 2024-08-06T20:25:11.6184386Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6184814Z "size": 135, 2024-08-06T20:25:11.6185230Z "digest": "sha256:d7e94279f8b2fe549e3f23637275d9dca8c831563ce84f1d44117eb297ddc871" 2024-08-06T20:25:11.6185696Z }, 2024-08-06T20:25:11.6185894Z { 2024-08-06T20:25:11.6186231Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6186646Z "size": 32, 2024-08-06T20:25:11.6187062Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6187552Z }, 2024-08-06T20:25:11.6187739Z { 2024-08-06T20:25:11.6188072Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6188505Z "size": 190, 2024-08-06T20:25:11.6188908Z "digest": "sha256:073f669362431eb57b23c427bcb2898ba4bb050cf4f9d37c09e270ceb847ccd6" 2024-08-06T20:25:11.6189391Z }, 2024-08-06T20:25:11.6189578Z { 2024-08-06T20:25:11.6189912Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6190342Z "size": 1210, 2024-08-06T20:25:11.6190757Z "digest": "sha256:719a1c2abcfd7e4113aa2f03adeb54350a5e381c720688ea53bc0e18401ad33d" 2024-08-06T20:25:11.6191242Z }, 2024-08-06T20:25:11.6191436Z { 2024-08-06T20:25:11.6191755Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6192182Z "size": 699, 2024-08-06T20:25:11.6192600Z "digest": "sha256:03fb78f207e3cbcfedfc7619a1d60fa576d3293d508a7e97dc09a5e7a9c65ab0" 2024-08-06T20:25:11.6193304Z }, 2024-08-06T20:25:11.6193642Z { 2024-08-06T20:25:11.6194083Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6194582Z "size": 138, 2024-08-06T20:25:11.6195121Z "digest": "sha256:8e1355d516c5e0527c25402c664fc648a8a2b814090e6ee0fdd60f49a8826ac1" 2024-08-06T20:25:11.6195795Z }, 2024-08-06T20:25:11.6196068Z { 2024-08-06T20:25:11.6196520Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6197056Z "size": 1842834361, 2024-08-06T20:25:11.6197567Z "digest": "sha256:4d5ca8eafd7982e3b256257abe6dfce2dc314e52d34defe80c8298de227a5f19" 2024-08-06T20:25:11.6198173Z }, 2024-08-06T20:25:11.6198487Z { 2024-08-06T20:25:11.6198881Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6199427Z "size": 153, 2024-08-06T20:25:11.6199947Z "digest": "sha256:73831405501a21694a29eaa05a64c05dbc545d9c5ba676a5b5f204fa2300291a" 2024-08-06T20:25:11.6224352Z }, 2024-08-06T20:25:11.6224647Z { 2024-08-06T20:25:11.6225018Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6225444Z "size": 846, 2024-08-06T20:25:11.6225857Z "digest": "sha256:0b48a1547ae65f413b4be264aad75996efd1ab0fac4107687531843d1ee54e5c" 2024-08-06T20:25:11.6226328Z }, 2024-08-06T20:25:11.6226521Z { 2024-08-06T20:25:11.6226846Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6227255Z "size": 699, 2024-08-06T20:25:11.6227655Z "digest": "sha256:03fb78f207e3cbcfedfc7619a1d60fa576d3293d508a7e97dc09a5e7a9c65ab0" 2024-08-06T20:25:11.6228126Z }, 2024-08-06T20:25:11.6228309Z { 2024-08-06T20:25:11.6228617Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6229027Z "size": 139, 2024-08-06T20:25:11.6229444Z "digest": "sha256:794615be0ac3201bd2845c4cd2e2f9e9651f1fba0142b0c74dccfda79fee82b1" 2024-08-06T20:25:11.6229909Z }, 2024-08-06T20:25:11.6230088Z { 2024-08-06T20:25:11.6230542Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6230949Z "size": 32, 2024-08-06T20:25:11.6231350Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6231815Z }, 2024-08-06T20:25:11.6231988Z { 2024-08-06T20:25:11.6232307Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6232732Z "size": 157, 2024-08-06T20:25:11.6233132Z "digest": "sha256:ad492c23051a703625b3e779faf07bba8b9bea291956c20e744bba89898af6be" 2024-08-06T20:25:11.6233603Z }, 2024-08-06T20:25:11.6233789Z { 2024-08-06T20:25:11.6234104Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6234521Z "size": 905, 2024-08-06T20:25:11.6234940Z "digest": "sha256:fc956bf4e5b49119cab7cc7bda867c61bed76c76c1e113dfa7c7b184251f8173" 2024-08-06T20:25:11.6235415Z }, 2024-08-06T20:25:11.6235607Z { 2024-08-06T20:25:11.6235931Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6236343Z "size": 699, 2024-08-06T20:25:11.6236761Z "digest": "sha256:03fb78f207e3cbcfedfc7619a1d60fa576d3293d508a7e97dc09a5e7a9c65ab0" 2024-08-06T20:25:11.6237246Z }, 2024-08-06T20:25:11.6237431Z { 2024-08-06T20:25:11.6237759Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6238175Z "size": 134, 2024-08-06T20:25:11.6238572Z "digest": "sha256:874491333fb5b81d9cbbd71520163a6baf07e6f011dc148b1634b94e301972b8" 2024-08-06T20:25:11.6239041Z }, 2024-08-06T20:25:11.6239220Z { 2024-08-06T20:25:11.6239550Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6239967Z "size": 32, 2024-08-06T20:25:11.6240369Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6240852Z }, 2024-08-06T20:25:11.6241038Z { 2024-08-06T20:25:11.6241357Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6241782Z "size": 156, 2024-08-06T20:25:11.6242208Z "digest": "sha256:62fd235ebb62f15f85f93abd31bdfcd2445df1b40f97d0b474a4879e05a47b0e" 2024-08-06T20:25:11.6242681Z }, 2024-08-06T20:25:11.6242879Z { 2024-08-06T20:25:11.6243213Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6243626Z "size": 1577, 2024-08-06T20:25:11.6244116Z "digest": "sha256:42646dcb0889a48f164507344b56ed0254f1c64ca68b2f974c7fa9f2569f1925" 2024-08-06T20:25:11.6244596Z }, 2024-08-06T20:25:11.6244784Z { 2024-08-06T20:25:11.6245119Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6245628Z "size": 32, 2024-08-06T20:25:11.6246039Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6246531Z }, 2024-08-06T20:25:11.6246732Z { 2024-08-06T20:25:11.6247052Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6247482Z "size": 128, 2024-08-06T20:25:11.6247910Z "digest": "sha256:5df8c6bd8177de4d452857fef1396a5c9574f50e37b342b1a192f89ec36fb4e5" 2024-08-06T20:25:11.6248379Z }, 2024-08-06T20:25:11.6248578Z { 2024-08-06T20:25:11.6248912Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6249325Z "size": 377, 2024-08-06T20:25:11.6249745Z "digest": "sha256:96381dfde5a802fe7b27ba3ae3b5f8589f88c170c5bae6863be97a37fa86688b" 2024-08-06T20:25:11.6250234Z }, 2024-08-06T20:25:11.6250418Z { 2024-08-06T20:25:11.6250751Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6251165Z "size": 32, 2024-08-06T20:25:11.6251582Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6252066Z }, 2024-08-06T20:25:11.6252256Z { 2024-08-06T20:25:11.6252594Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6253026Z "size": 104, 2024-08-06T20:25:11.6253426Z "digest": "sha256:d0dba839d4c041ba853621262a7e730c3699058d43cfe7d6f31ec311708acc73" 2024-08-06T20:25:11.6253977Z }, 2024-08-06T20:25:11.6254180Z { 2024-08-06T20:25:11.6254501Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6254927Z "size": 1839, 2024-08-06T20:25:11.6255352Z "digest": "sha256:c1d4cac78640fc7d364011da807a363d6b248a2c46ccf99a6e1488c4974c17e3" 2024-08-06T20:25:11.6255827Z }, 2024-08-06T20:25:11.6256026Z { 2024-08-06T20:25:11.6256362Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6256781Z "size": 7529628, 2024-08-06T20:25:11.6257212Z "digest": "sha256:67cb12cd081ccde6047c7cbbdd4d99c4499d4b12d3db421c307ef6d901ff0c81" 2024-08-06T20:25:11.6257704Z }, 2024-08-06T20:25:11.6257890Z { 2024-08-06T20:25:11.6258224Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6258651Z "size": 106, 2024-08-06T20:25:11.6259058Z "digest": "sha256:b431724b7afe431951242ade99ee881ce85e51dc44dd1f8c0c1ed1710de62f68" 2024-08-06T20:25:11.6259541Z }, 2024-08-06T20:25:11.6259745Z { 2024-08-06T20:25:11.6260066Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6260495Z "size": 161, 2024-08-06T20:25:11.6260910Z "digest": "sha256:190dccfa687dc1e698f27965d8065a183168d7c66361505f368765456ff9f4bc" 2024-08-06T20:25:11.6261378Z }, 2024-08-06T20:25:11.6261577Z { 2024-08-06T20:25:11.6261914Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6262329Z "size": 7942, 2024-08-06T20:25:11.6262755Z "digest": "sha256:b01bea4b6634f47c51ede2b4a95ceade4e61356ca29551168b493ae6d4492f44" 2024-08-06T20:25:11.6263244Z }, 2024-08-06T20:25:11.6263431Z { 2024-08-06T20:25:11.6263767Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6264196Z "size": 8065, 2024-08-06T20:25:11.6264612Z "digest": "sha256:77fc3d1eca2c044fa3497f2e035f9ca2e5ffcd8f16b810f1173ae52af23b71a7" 2024-08-06T20:25:11.6265101Z }, 2024-08-06T20:25:11.6265292Z { 2024-08-06T20:25:11.6265633Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6266060Z "size": 302, 2024-08-06T20:25:11.6266466Z "digest": "sha256:96d6dcd01b9f6c5557ba405d028442d808dd329f4f93e75f2c3ba0554e703a52" 2024-08-06T20:25:11.6266946Z }, 2024-08-06T20:25:11.6267207Z { 2024-08-06T20:25:11.6267528Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6267957Z "size": 32, 2024-08-06T20:25:11.6268379Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6268853Z }, 2024-08-06T20:25:11.6269051Z { 2024-08-06T20:25:11.6269384Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6269798Z "size": 108, 2024-08-06T20:25:11.6270215Z "digest": "sha256:79ef14b93271d6a0315533761cb955f79fba8ee77b9a73ba823923e7dd1613f7" 2024-08-06T20:25:11.6270694Z }, 2024-08-06T20:25:11.6270883Z { 2024-08-06T20:25:11.6271220Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6271646Z "size": 54145774, 2024-08-06T20:25:11.6272062Z "digest": "sha256:45103ff2548064a8f9e94bdb31d8bc89e396f9880773cc06e0540dac48d20e10" 2024-08-06T20:25:11.6272539Z }, 2024-08-06T20:25:11.6272738Z { 2024-08-06T20:25:11.6273062Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2024-08-06T20:25:11.6273490Z "size": 32, 2024-08-06T20:25:11.6273908Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2024-08-06T20:25:11.6274580Z } 2024-08-06T20:25:11.6274783Z ] 2024-08-06T20:25:11.6274988Z } 2024-08-06T20:25:11.6349664Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2024-08-06T20:25:11.6350044Z tag=${ECR_DOCKER_IMAGE##*/} 2024-08-06T20:25:11.6350458Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2024-08-06T20:25:11.6356128Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:11.6356507Z env: 2024-08-06T20:25:11.6356727Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:11.6357457Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:11.6358204Z ##[endgroup] 2024-08-06T20:25:11.6383245Z docker pull ghcr.io/pytorch/ci-image:pytorch-linux-jammy-py3.8-gcc11-02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:11.6433571Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2024-08-06T20:25:11.6434022Z with: 2024-08-06T20:25:11.6434675Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:11.6435520Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:11.6435920Z env: 2024-08-06T20:25:11.6436130Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:11.6436397Z ##[endgroup] 2024-08-06T20:25:11.6461773Z ##[group]Run set -x 2024-08-06T20:25:11.6462053Z set -x 2024-08-06T20:25:11.6462281Z set +e 2024-08-06T20:25:11.6462509Z  2024-08-06T20:25:11.6462723Z login() { 2024-08-06T20:25:11.6463197Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2024-08-06T20:25:11.6463728Z } 2024-08-06T20:25:11.6463956Z  2024-08-06T20:25:11.6464203Z retry () { 2024-08-06T20:25:11.6464470Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2024-08-06T20:25:11.6464796Z } 2024-08-06T20:25:11.6465011Z  2024-08-06T20:25:11.6465237Z retry login "${DOCKER_REGISTRY}" 2024-08-06T20:25:11.6465554Z  2024-08-06T20:25:11.6465766Z set -e 2024-08-06T20:25:11.6466106Z # ignore output since only exit code is used for conditional 2024-08-06T20:25:11.6466610Z # only pull docker image if it's not available locally 2024-08-06T20:25:11.6467171Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2024-08-06T20:25:11.6467677Z  retry docker pull "${DOCKER_IMAGE}" 2024-08-06T20:25:11.6468008Z fi 2024-08-06T20:25:11.6473166Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:25:11.6473550Z env: 2024-08-06T20:25:11.6473779Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:25:11.6474894Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:11.6475737Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:11.6476141Z ##[endgroup] 2024-08-06T20:25:11.6498062Z + set +e 2024-08-06T20:25:11.6498665Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:11.6499140Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:11.6501465Z + aws ecr get-login-password --region us-east-1 2024-08-06T20:25:11.6502996Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2024-08-06T20:25:12.1922540Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2024-08-06T20:25:12.1923236Z Configure a credential helper to remove this warning. See 2024-08-06T20:25:12.1924076Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2024-08-06T20:25:12.1924697Z 2024-08-06T20:25:12.1924854Z Login Succeeded 2024-08-06T20:25:12.1934938Z + set -e 2024-08-06T20:25:12.1935720Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:12.2061313Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:12.2062531Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:25:12.4996491Z 02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9: Pulling from pytorch/pytorch-linux-jammy-py3.8-gcc11 2024-08-06T20:25:12.5005727Z 9b857f539cb1: Pulling fs layer 2024-08-06T20:25:12.5006419Z ceceb076946e: Pulling fs layer 2024-08-06T20:25:12.5006980Z 042461771f00: Pulling fs layer 2024-08-06T20:25:12.5007581Z bac001ac2fee: Pulling fs layer 2024-08-06T20:25:12.5008069Z 4a587220513d: Pulling fs layer 2024-08-06T20:25:12.5008982Z af8081143f00: Pulling fs layer 2024-08-06T20:25:12.5009530Z e7a423dcab01: Pulling fs layer 2024-08-06T20:25:12.5010050Z ad26542e0d01: Pulling fs layer 2024-08-06T20:25:12.5010531Z bac001ac2fee: Waiting 2024-08-06T20:25:12.5011009Z 9e1d4f8784a0: Pulling fs layer 2024-08-06T20:25:12.5011465Z 4a587220513d: Waiting 2024-08-06T20:25:12.5011898Z b1f815d16274: Pulling fs layer 2024-08-06T20:25:12.5012410Z e7a423dcab01: Waiting 2024-08-06T20:25:12.5012844Z af8081143f00: Waiting 2024-08-06T20:25:12.5013309Z 91f9dddffbee: Pulling fs layer 2024-08-06T20:25:12.5013816Z 9e1d4f8784a0: Waiting 2024-08-06T20:25:12.5014283Z 03fb78f207e3: Pulling fs layer 2024-08-06T20:25:12.5014635Z 8385f3c14a81: Pulling fs layer 2024-08-06T20:25:12.5014925Z 4f4fb700ef54: Pulling fs layer 2024-08-06T20:25:12.5015204Z ad26542e0d01: Waiting 2024-08-06T20:25:12.5015437Z b1f815d16274: Waiting 2024-08-06T20:25:12.5015683Z 91f9dddffbee: Waiting 2024-08-06T20:25:12.5015940Z 202c71391ade: Pulling fs layer 2024-08-06T20:25:12.5016237Z 240ee294d88b: Pulling fs layer 2024-08-06T20:25:12.5016515Z 03fb78f207e3: Waiting 2024-08-06T20:25:12.5017059Z 7a823d3d7147: Pulling fs layer 2024-08-06T20:25:12.5017329Z 8385f3c14a81: Waiting 2024-08-06T20:25:12.5017585Z a1b9e8856530: Pulling fs layer 2024-08-06T20:25:12.5017863Z 202c71391ade: Waiting 2024-08-06T20:25:12.5018103Z 9c5b585a8116: Pulling fs layer 2024-08-06T20:25:12.5018382Z 240ee294d88b: Waiting 2024-08-06T20:25:12.5018626Z 9cd1bcd9f117: Pulling fs layer 2024-08-06T20:25:12.5018911Z 4f4fb700ef54: Waiting 2024-08-06T20:25:12.5019167Z 2b9731d295d6: Pulling fs layer 2024-08-06T20:25:12.5019432Z a1b9e8856530: Waiting 2024-08-06T20:25:12.5019681Z 9c5b585a8116: Waiting 2024-08-06T20:25:12.5019927Z 7a823d3d7147: Waiting 2024-08-06T20:25:12.5020188Z 8d223c48f542: Pulling fs layer 2024-08-06T20:25:12.5020581Z 9cd1bcd9f117: Waiting 2024-08-06T20:25:12.5020830Z 2b9731d295d6: Waiting 2024-08-06T20:25:12.5021084Z 49a0e418a175: Pulling fs layer 2024-08-06T20:25:12.5021532Z 8d223c48f542: Waiting 2024-08-06T20:25:12.5021798Z 51ed474f6c32: Pulling fs layer 2024-08-06T20:25:12.5022088Z 1c01ecb575c6: Pulling fs layer 2024-08-06T20:25:12.5022362Z a2630e5fe166: Pulling fs layer 2024-08-06T20:25:12.5022640Z 49a0e418a175: Waiting 2024-08-06T20:25:12.5022897Z 554a42b2a2e6: Pulling fs layer 2024-08-06T20:25:12.5023165Z 51ed474f6c32: Waiting 2024-08-06T20:25:12.5023425Z c9a20a1fda16: Pulling fs layer 2024-08-06T20:25:12.5023698Z 1c01ecb575c6: Waiting 2024-08-06T20:25:12.5023953Z 2c2e35b979f5: Pulling fs layer 2024-08-06T20:25:12.5024240Z 0e3c02dff025: Pulling fs layer 2024-08-06T20:25:12.5024513Z 2c2cb9893903: Pulling fs layer 2024-08-06T20:25:12.5024787Z a2630e5fe166: Waiting 2024-08-06T20:25:12.5025045Z ec0a42784a49: Pulling fs layer 2024-08-06T20:25:12.5025309Z 2c2e35b979f5: Waiting 2024-08-06T20:25:12.5025571Z 554a42b2a2e6: Waiting 2024-08-06T20:25:12.5025828Z a20886f4e537: Pulling fs layer 2024-08-06T20:25:12.5026092Z 2c2cb9893903: Waiting 2024-08-06T20:25:12.5026463Z 0e3c02dff025: Waiting 2024-08-06T20:25:12.5026735Z af1fb4fa4eed: Pulling fs layer 2024-08-06T20:25:12.5027128Z ec0a42784a49: Waiting 2024-08-06T20:25:12.5027537Z a20886f4e537: Waiting 2024-08-06T20:25:12.5027912Z af1fb4fa4eed: Waiting 2024-08-06T20:25:12.5028166Z de13eba39cb5: Pulling fs layer 2024-08-06T20:25:12.5028488Z c9a20a1fda16: Waiting 2024-08-06T20:25:12.5028747Z ac851722c4ad: Pulling fs layer 2024-08-06T20:25:12.5029023Z 225d8e1484f0: Pulling fs layer 2024-08-06T20:25:12.5029306Z 0b92275d2037: Pulling fs layer 2024-08-06T20:25:12.5029621Z 86d521d46977: Pulling fs layer 2024-08-06T20:25:12.5029893Z 3914906be0cb: Pulling fs layer 2024-08-06T20:25:12.5030178Z 193407c5262c: Pulling fs layer 2024-08-06T20:25:12.5030443Z de13eba39cb5: Waiting 2024-08-06T20:25:12.5030689Z 0b92275d2037: Waiting 2024-08-06T20:25:12.5030946Z adf9d181cfbc: Pulling fs layer 2024-08-06T20:25:12.5031215Z ac851722c4ad: Waiting 2024-08-06T20:25:12.5031494Z 736c4af6f527: Pulling fs layer 2024-08-06T20:25:12.5031769Z 225d8e1484f0: Waiting 2024-08-06T20:25:12.5032008Z 3914906be0cb: Waiting 2024-08-06T20:25:12.5032385Z 86d521d46977: Waiting 2024-08-06T20:25:12.5032635Z adf9d181cfbc: Waiting 2024-08-06T20:25:12.5032880Z 801521a42094: Pulling fs layer 2024-08-06T20:25:12.5033157Z 736c4af6f527: Waiting 2024-08-06T20:25:12.5033435Z ed7b11c2ed84: Pulling fs layer 2024-08-06T20:25:12.5033702Z 801521a42094: Waiting 2024-08-06T20:25:12.5033962Z 5c6f2f3fe7c2: Pulling fs layer 2024-08-06T20:25:12.5034235Z ed7b11c2ed84: Waiting 2024-08-06T20:25:12.5034496Z 3886e8f57dc8: Pulling fs layer 2024-08-06T20:25:12.5034787Z cc822658f193: Pulling fs layer 2024-08-06T20:25:12.5035057Z 5c6f2f3fe7c2: Waiting 2024-08-06T20:25:12.5035397Z cca044783521: Pulling fs layer 2024-08-06T20:25:12.5035694Z 0eb80a0ac000: Pulling fs layer 2024-08-06T20:25:12.5035973Z a9f11b2b3622: Pulling fs layer 2024-08-06T20:25:12.5036379Z d7e94279f8b2: Pulling fs layer 2024-08-06T20:25:12.5036663Z 3886e8f57dc8: Waiting 2024-08-06T20:25:12.5036908Z 073f66936243: Pulling fs layer 2024-08-06T20:25:12.5037197Z cca044783521: Waiting 2024-08-06T20:25:12.5037465Z 719a1c2abcfd: Pulling fs layer 2024-08-06T20:25:12.5037737Z 0eb80a0ac000: Waiting 2024-08-06T20:25:12.5037987Z a9f11b2b3622: Waiting 2024-08-06T20:25:12.5038239Z 8e1355d516c5: Pulling fs layer 2024-08-06T20:25:12.5038518Z 4d5ca8eafd79: Pulling fs layer 2024-08-06T20:25:12.5038799Z d7e94279f8b2: Waiting 2024-08-06T20:25:12.5039048Z 719a1c2abcfd: Waiting 2024-08-06T20:25:12.5039294Z 73831405501a: Pulling fs layer 2024-08-06T20:25:12.5039584Z 0b48a1547ae6: Pulling fs layer 2024-08-06T20:25:12.5039865Z 4d5ca8eafd79: Waiting 2024-08-06T20:25:12.5040109Z 794615be0ac3: Pulling fs layer 2024-08-06T20:25:12.5040383Z 8e1355d516c5: Waiting 2024-08-06T20:25:12.5040717Z ad492c23051a: Pulling fs layer 2024-08-06T20:25:12.5041009Z fc956bf4e5b4: Pulling fs layer 2024-08-06T20:25:12.5041295Z 874491333fb5: Pulling fs layer 2024-08-06T20:25:12.5041569Z 62fd235ebb62: Pulling fs layer 2024-08-06T20:25:12.5041859Z 42646dcb0889: Pulling fs layer 2024-08-06T20:25:12.5042226Z 794615be0ac3: Waiting 2024-08-06T20:25:12.5042460Z 874491333fb5: Waiting 2024-08-06T20:25:12.5042715Z 5df8c6bd8177: Pulling fs layer 2024-08-06T20:25:12.5042998Z ad492c23051a: Waiting 2024-08-06T20:25:12.5043245Z 96381dfde5a8: Pulling fs layer 2024-08-06T20:25:12.5043526Z fc956bf4e5b4: Waiting 2024-08-06T20:25:12.5043774Z 62fd235ebb62: Waiting 2024-08-06T20:25:12.5044022Z d0dba839d4c0: Pulling fs layer 2024-08-06T20:25:12.5044302Z 42646dcb0889: Waiting 2024-08-06T20:25:12.5044546Z 5df8c6bd8177: Waiting 2024-08-06T20:25:12.5044790Z c1d4cac78640: Pulling fs layer 2024-08-06T20:25:12.5045163Z 96381dfde5a8: Waiting 2024-08-06T20:25:12.5045540Z 67cb12cd081c: Pulling fs layer 2024-08-06T20:25:12.5045912Z c1d4cac78640: Waiting 2024-08-06T20:25:12.5046174Z b431724b7afe: Pulling fs layer 2024-08-06T20:25:12.5046556Z 190dccfa687d: Pulling fs layer 2024-08-06T20:25:12.5046856Z b01bea4b6634: Pulling fs layer 2024-08-06T20:25:12.5047153Z 77fc3d1eca2c: Pulling fs layer 2024-08-06T20:25:12.5047427Z d0dba839d4c0: Waiting 2024-08-06T20:25:12.5047686Z b431724b7afe: Waiting 2024-08-06T20:25:12.5047952Z 96d6dcd01b9f: Pulling fs layer 2024-08-06T20:25:12.5048221Z b01bea4b6634: Waiting 2024-08-06T20:25:12.5048477Z 79ef14b93271: Pulling fs layer 2024-08-06T20:25:12.5048758Z 96d6dcd01b9f: Waiting 2024-08-06T20:25:12.5048999Z 45103ff25480: Pulling fs layer 2024-08-06T20:25:12.5049272Z 79ef14b93271: Waiting 2024-08-06T20:25:12.5049513Z 45103ff25480: Waiting 2024-08-06T20:25:12.5049742Z 0b48a1547ae6: Waiting 2024-08-06T20:25:12.5050037Z 77fc3d1eca2c: Waiting 2024-08-06T20:25:12.6196215Z ceceb076946e: Verifying Checksum 2024-08-06T20:25:12.6196591Z ceceb076946e: Download complete 2024-08-06T20:25:12.6991950Z bac001ac2fee: Verifying Checksum 2024-08-06T20:25:12.6992504Z bac001ac2fee: Download complete 2024-08-06T20:25:12.7870573Z 4a587220513d: Download complete 2024-08-06T20:25:12.8604810Z 9b857f539cb1: Verifying Checksum 2024-08-06T20:25:12.8606265Z 9b857f539cb1: Download complete 2024-08-06T20:25:12.8696320Z af8081143f00: Verifying Checksum 2024-08-06T20:25:12.8696741Z af8081143f00: Download complete 2024-08-06T20:25:12.9375020Z e7a423dcab01: Download complete 2024-08-06T20:25:12.9563838Z ad26542e0d01: Verifying Checksum 2024-08-06T20:25:12.9564409Z ad26542e0d01: Download complete 2024-08-06T20:25:13.0508757Z b1f815d16274: Download complete 2024-08-06T20:25:13.1626746Z 91f9dddffbee: Download complete 2024-08-06T20:25:13.2307831Z 03fb78f207e3: Verifying Checksum 2024-08-06T20:25:13.2308473Z 03fb78f207e3: Download complete 2024-08-06T20:25:13.8387239Z 9b857f539cb1: Pull complete 2024-08-06T20:25:13.8550609Z ceceb076946e: Pull complete 2024-08-06T20:25:14.1358412Z 9e1d4f8784a0: Verifying Checksum 2024-08-06T20:25:14.1358884Z 9e1d4f8784a0: Download complete 2024-08-06T20:25:14.1448445Z 4f4fb700ef54: Download complete 2024-08-06T20:25:14.2202110Z 202c71391ade: Verifying Checksum 2024-08-06T20:25:14.2202524Z 202c71391ade: Download complete 2024-08-06T20:25:14.3007249Z 240ee294d88b: Download complete 2024-08-06T20:25:14.3771668Z 7a823d3d7147: Download complete 2024-08-06T20:25:14.4604735Z a1b9e8856530: Verifying Checksum 2024-08-06T20:25:14.4605177Z a1b9e8856530: Download complete 2024-08-06T20:25:14.5545088Z 9c5b585a8116: Verifying Checksum 2024-08-06T20:25:14.5545535Z 9c5b585a8116: Download complete 2024-08-06T20:25:14.6326715Z 9cd1bcd9f117: Download complete 2024-08-06T20:25:14.7035900Z 2b9731d295d6: Verifying Checksum 2024-08-06T20:25:14.7036347Z 2b9731d295d6: Download complete 2024-08-06T20:25:14.7780779Z 8d223c48f542: Verifying Checksum 2024-08-06T20:25:14.7781179Z 8d223c48f542: Download complete 2024-08-06T20:25:14.8489584Z 49a0e418a175: Download complete 2024-08-06T20:25:15.6946180Z 042461771f00: Verifying Checksum 2024-08-06T20:25:15.6946809Z 042461771f00: Download complete 2024-08-06T20:25:15.7746150Z 1c01ecb575c6: Verifying Checksum 2024-08-06T20:25:15.7746762Z 1c01ecb575c6: Download complete 2024-08-06T20:25:15.8953193Z 51ed474f6c32: Verifying Checksum 2024-08-06T20:25:15.8980801Z a2630e5fe166: Verifying Checksum 2024-08-06T20:25:15.8981621Z a2630e5fe166: Download complete 2024-08-06T20:25:15.9666571Z 554a42b2a2e6: Verifying Checksum 2024-08-06T20:25:15.9667128Z 554a42b2a2e6: Download complete 2024-08-06T20:25:15.9969280Z c9a20a1fda16: Verifying Checksum 2024-08-06T20:25:15.9969912Z c9a20a1fda16: Download complete 2024-08-06T20:25:16.0604355Z 2c2e35b979f5: Verifying Checksum 2024-08-06T20:25:16.0604867Z 2c2e35b979f5: Download complete 2024-08-06T20:25:16.1438883Z 2c2cb9893903: Download complete 2024-08-06T20:25:16.2119424Z ec0a42784a49: Verifying Checksum 2024-08-06T20:25:16.2119927Z ec0a42784a49: Download complete 2024-08-06T20:25:16.2780067Z a20886f4e537: Download complete 2024-08-06T20:25:16.3568000Z af1fb4fa4eed: Verifying Checksum 2024-08-06T20:25:16.3568565Z af1fb4fa4eed: Download complete 2024-08-06T20:25:16.4202907Z de13eba39cb5: Verifying Checksum 2024-08-06T20:25:16.4203590Z de13eba39cb5: Download complete 2024-08-06T20:25:16.5003817Z ac851722c4ad: Verifying Checksum 2024-08-06T20:25:16.5004585Z ac851722c4ad: Download complete 2024-08-06T20:25:16.5732229Z 225d8e1484f0: Verifying Checksum 2024-08-06T20:25:16.5732827Z 225d8e1484f0: Download complete 2024-08-06T20:25:16.6600988Z 0b92275d2037: Verifying Checksum 2024-08-06T20:25:16.6601568Z 0b92275d2037: Download complete 2024-08-06T20:25:16.7288131Z 86d521d46977: Verifying Checksum 2024-08-06T20:25:16.7288671Z 86d521d46977: Download complete 2024-08-06T20:25:16.8063103Z 3914906be0cb: Verifying Checksum 2024-08-06T20:25:16.8063698Z 3914906be0cb: Download complete 2024-08-06T20:25:16.8786283Z 193407c5262c: Verifying Checksum 2024-08-06T20:25:16.8786755Z 193407c5262c: Download complete 2024-08-06T20:25:16.9517016Z adf9d181cfbc: Verifying Checksum 2024-08-06T20:25:16.9517635Z adf9d181cfbc: Download complete 2024-08-06T20:25:17.4404582Z 736c4af6f527: Verifying Checksum 2024-08-06T20:25:17.5187863Z 736c4af6f527: Download complete 2024-08-06T20:25:17.5188425Z 801521a42094: Verifying Checksum 2024-08-06T20:25:17.5189214Z 801521a42094: Download complete 2024-08-06T20:25:17.6015955Z ed7b11c2ed84: Verifying Checksum 2024-08-06T20:25:17.6016937Z ed7b11c2ed84: Download complete 2024-08-06T20:25:17.6807589Z 5c6f2f3fe7c2: Verifying Checksum 2024-08-06T20:25:17.6808211Z 5c6f2f3fe7c2: Download complete 2024-08-06T20:25:17.7558498Z 3886e8f57dc8: Download complete 2024-08-06T20:25:18.0018711Z cc822658f193: Verifying Checksum 2024-08-06T20:25:18.0019337Z cc822658f193: Download complete 2024-08-06T20:25:18.0863606Z cca044783521: Verifying Checksum 2024-08-06T20:25:18.0864133Z cca044783521: Download complete 2024-08-06T20:25:18.1664119Z 0eb80a0ac000: Download complete 2024-08-06T20:25:18.2369258Z a9f11b2b3622: Verifying Checksum 2024-08-06T20:25:18.2369893Z a9f11b2b3622: Download complete 2024-08-06T20:25:18.3567290Z d7e94279f8b2: Verifying Checksum 2024-08-06T20:25:18.3567850Z d7e94279f8b2: Download complete 2024-08-06T20:25:18.4383773Z 073f66936243: Verifying Checksum 2024-08-06T20:25:18.4384371Z 073f66936243: Download complete 2024-08-06T20:25:18.5049993Z 719a1c2abcfd: Verifying Checksum 2024-08-06T20:25:18.5050676Z 719a1c2abcfd: Download complete 2024-08-06T20:25:18.5776937Z 8e1355d516c5: Verifying Checksum 2024-08-06T20:25:18.5777383Z 8e1355d516c5: Download complete 2024-08-06T20:25:22.3892865Z 0e3c02dff025: Verifying Checksum 2024-08-06T20:25:22.3893288Z 0e3c02dff025: Download complete 2024-08-06T20:25:22.4919871Z 73831405501a: Download complete 2024-08-06T20:25:22.5609481Z 0b48a1547ae6: Verifying Checksum 2024-08-06T20:25:22.5609879Z 0b48a1547ae6: Download complete 2024-08-06T20:25:22.6424221Z 794615be0ac3: Download complete 2024-08-06T20:25:22.7303199Z ad492c23051a: Verifying Checksum 2024-08-06T20:25:22.7303773Z ad492c23051a: Download complete 2024-08-06T20:25:22.8177358Z fc956bf4e5b4: Download complete 2024-08-06T20:25:22.8816986Z 874491333fb5: Verifying Checksum 2024-08-06T20:25:22.8817543Z 874491333fb5: Download complete 2024-08-06T20:25:22.9563108Z 62fd235ebb62: Verifying Checksum 2024-08-06T20:25:22.9563717Z 62fd235ebb62: Download complete 2024-08-06T20:25:23.0208465Z 42646dcb0889: Verifying Checksum 2024-08-06T20:25:23.0209097Z 42646dcb0889: Download complete 2024-08-06T20:25:23.0942119Z 5df8c6bd8177: Verifying Checksum 2024-08-06T20:25:23.0942669Z 5df8c6bd8177: Download complete 2024-08-06T20:25:23.1636478Z 96381dfde5a8: Verifying Checksum 2024-08-06T20:25:23.2667734Z d0dba839d4c0: Verifying Checksum 2024-08-06T20:25:23.2668267Z d0dba839d4c0: Download complete 2024-08-06T20:25:23.3557790Z c1d4cac78640: Verifying Checksum 2024-08-06T20:25:23.3558360Z c1d4cac78640: Download complete 2024-08-06T20:25:23.4995573Z 67cb12cd081c: Verifying Checksum 2024-08-06T20:25:23.4996191Z 67cb12cd081c: Download complete 2024-08-06T20:25:23.5755954Z b431724b7afe: Verifying Checksum 2024-08-06T20:25:23.5756512Z b431724b7afe: Download complete 2024-08-06T20:25:23.6521755Z 190dccfa687d: Verifying Checksum 2024-08-06T20:25:23.6522283Z 190dccfa687d: Download complete 2024-08-06T20:25:23.7497406Z b01bea4b6634: Download complete 2024-08-06T20:25:23.8275596Z 77fc3d1eca2c: Download complete 2024-08-06T20:25:23.8915926Z 96d6dcd01b9f: Verifying Checksum 2024-08-06T20:25:23.8916411Z 96d6dcd01b9f: Download complete 2024-08-06T20:25:23.9560180Z 79ef14b93271: Verifying Checksum 2024-08-06T20:25:23.9560674Z 79ef14b93271: Download complete 2024-08-06T20:25:25.8334470Z 45103ff25480: Verifying Checksum 2024-08-06T20:25:25.8334894Z 45103ff25480: Download complete 2024-08-06T20:25:26.8711551Z 042461771f00: Pull complete 2024-08-06T20:25:27.0154794Z bac001ac2fee: Pull complete 2024-08-06T20:25:27.1002261Z 4a587220513d: Pull complete 2024-08-06T20:25:27.2541304Z af8081143f00: Pull complete 2024-08-06T20:25:27.3212677Z e7a423dcab01: Pull complete 2024-08-06T20:25:27.3778408Z ad26542e0d01: Pull complete 2024-08-06T20:25:47.9327284Z 4d5ca8eafd79: Verifying Checksum 2024-08-06T20:25:47.9327678Z 4d5ca8eafd79: Download complete 2024-08-06T20:25:48.0623068Z 9e1d4f8784a0: Pull complete 2024-08-06T20:25:48.2590531Z b1f815d16274: Pull complete 2024-08-06T20:25:48.4603343Z 91f9dddffbee: Pull complete 2024-08-06T20:25:48.6377635Z 03fb78f207e3: Pull complete 2024-08-06T20:25:51.1821226Z 8385f3c14a81: Verifying Checksum 2024-08-06T20:25:51.1821916Z 8385f3c14a81: Download complete 2024-08-06T20:26:39.6496844Z 8385f3c14a81: Pull complete 2024-08-06T20:26:39.7554240Z 4f4fb700ef54: Pull complete 2024-08-06T20:26:39.8816348Z 202c71391ade: Pull complete 2024-08-06T20:26:39.9821037Z 240ee294d88b: Pull complete 2024-08-06T20:26:40.0205015Z 7a823d3d7147: Pull complete 2024-08-06T20:26:40.2126411Z a1b9e8856530: Pull complete 2024-08-06T20:26:40.3865169Z 9c5b585a8116: Pull complete 2024-08-06T20:26:40.5853070Z 9cd1bcd9f117: Pull complete 2024-08-06T20:26:40.6766436Z 2b9731d295d6: Pull complete 2024-08-06T20:26:41.3175320Z 8d223c48f542: Pull complete 2024-08-06T20:26:41.5669518Z 49a0e418a175: Pull complete 2024-08-06T20:26:43.6783474Z 51ed474f6c32: Pull complete 2024-08-06T20:26:43.9308620Z 1c01ecb575c6: Pull complete 2024-08-06T20:26:44.0488203Z a2630e5fe166: Pull complete 2024-08-06T20:26:44.2477914Z 554a42b2a2e6: Pull complete 2024-08-06T20:26:44.4162366Z c9a20a1fda16: Pull complete 2024-08-06T20:26:44.5109628Z 2c2e35b979f5: Pull complete 2024-08-06T20:26:52.8931128Z 0e3c02dff025: Pull complete 2024-08-06T20:26:52.9108879Z 2c2cb9893903: Pull complete 2024-08-06T20:26:52.9274202Z ec0a42784a49: Pull complete 2024-08-06T20:26:52.9450064Z a20886f4e537: Pull complete 2024-08-06T20:26:52.9626223Z af1fb4fa4eed: Pull complete 2024-08-06T20:26:52.9939883Z de13eba39cb5: Pull complete 2024-08-06T20:26:53.0088983Z ac851722c4ad: Pull complete 2024-08-06T20:26:53.0246713Z 225d8e1484f0: Pull complete 2024-08-06T20:26:53.0424865Z 0b92275d2037: Pull complete 2024-08-06T20:26:53.0746767Z 86d521d46977: Pull complete 2024-08-06T20:26:53.0891665Z 3914906be0cb: Pull complete 2024-08-06T20:26:53.1186632Z 193407c5262c: Pull complete 2024-08-06T20:26:53.1341883Z adf9d181cfbc: Pull complete 2024-08-06T20:26:54.6337411Z 736c4af6f527: Pull complete 2024-08-06T20:26:54.6598805Z 801521a42094: Pull complete 2024-08-06T20:26:54.6947829Z ed7b11c2ed84: Pull complete 2024-08-06T20:26:54.7951710Z 5c6f2f3fe7c2: Pull complete 2024-08-06T20:26:54.8294478Z 3886e8f57dc8: Pull complete 2024-08-06T20:26:55.0428779Z cc822658f193: Pull complete 2024-08-06T20:26:55.0610906Z cca044783521: Pull complete 2024-08-06T20:26:55.0768526Z 0eb80a0ac000: Pull complete 2024-08-06T20:26:55.1076747Z a9f11b2b3622: Pull complete 2024-08-06T20:26:55.1224281Z d7e94279f8b2: Pull complete 2024-08-06T20:26:55.1538820Z 073f66936243: Pull complete 2024-08-06T20:26:55.1760185Z 719a1c2abcfd: Pull complete 2024-08-06T20:26:55.2083612Z 8e1355d516c5: Pull complete 2024-08-06T20:27:29.6154654Z 4d5ca8eafd79: Pull complete 2024-08-06T20:27:29.8045710Z 73831405501a: Pull complete 2024-08-06T20:27:29.8782879Z 0b48a1547ae6: Pull complete 2024-08-06T20:27:30.1716928Z 794615be0ac3: Pull complete 2024-08-06T20:27:30.4779910Z ad492c23051a: Pull complete 2024-08-06T20:27:30.6536659Z fc956bf4e5b4: Pull complete 2024-08-06T20:27:31.0182658Z 874491333fb5: Pull complete 2024-08-06T20:27:31.2234586Z 62fd235ebb62: Pull complete 2024-08-06T20:27:31.3038786Z 42646dcb0889: Pull complete 2024-08-06T20:27:31.5369598Z 5df8c6bd8177: Pull complete 2024-08-06T20:27:31.7212085Z 96381dfde5a8: Pull complete 2024-08-06T20:27:31.9818000Z d0dba839d4c0: Pull complete 2024-08-06T20:27:32.1711362Z c1d4cac78640: Pull complete 2024-08-06T20:27:32.5645000Z 67cb12cd081c: Pull complete 2024-08-06T20:27:32.6360019Z b431724b7afe: Pull complete 2024-08-06T20:27:32.7200656Z 190dccfa687d: Pull complete 2024-08-06T20:27:32.7629743Z b01bea4b6634: Pull complete 2024-08-06T20:27:32.8187376Z 77fc3d1eca2c: Pull complete 2024-08-06T20:27:32.9237440Z 96d6dcd01b9f: Pull complete 2024-08-06T20:27:33.2476505Z 79ef14b93271: Pull complete 2024-08-06T20:27:35.8303497Z 45103ff25480: Pull complete 2024-08-06T20:27:36.1425732Z Digest: sha256:c75221497aa22766802555fccb76014708414eebd47578b213b43b3f8f4cddb9 2024-08-06T20:27:36.1657828Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:27:36.1839589Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:27:36.1879561Z ##[group]Run echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-06T20:27:36.1880274Z echo "IN_ARC_RUNNER=$([ -f /.inarc ] && echo true || echo false)" >> "$GITHUB_OUTPUT" 2024-08-06T20:27:36.1888374Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:36.1888769Z env: 2024-08-06T20:27:36.1888985Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:36.1889254Z ##[endgroup] 2024-08-06T20:27:36.2008866Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-06T20:27:36.2009473Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 2024-08-06T20:27:36.2010006Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2024-08-06T20:27:36.2010486Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2024-08-06T20:27:36.2016418Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:36.2016829Z env: 2024-08-06T20:27:36.2017055Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:36.2017315Z ##[endgroup] 2024-08-06T20:27:36.5584130Z Defaulting to user installation because normal site-packages is not writeable 2024-08-06T20:27:36.5753206Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2024-08-06T20:27:36.5760439Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2024-08-06T20:27:36.7121286Z Prepare all required actions 2024-08-06T20:27:36.7121885Z Getting action download info 2024-08-06T20:27:36.8256194Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2024-08-06T20:27:37.1882280Z Download action repository 'actions/download-artifact@v3' (SHA:9bc31d5ccc31df68ecc42ccf4149144866c47d8a) 2024-08-06T20:27:37.3656695Z ##[group]Run ./.github/actions/download-build-artifacts 2024-08-06T20:27:37.3657232Z with: 2024-08-06T20:27:37.3657483Z name: linux-jammy-py3.8-gcc11 2024-08-06T20:27:37.3657781Z s3-bucket: gha-artifacts 2024-08-06T20:27:37.3658056Z env: 2024-08-06T20:27:37.3658285Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:37.3658546Z ##[endgroup] 2024-08-06T20:27:37.3796932Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-06T20:27:37.3797298Z with: 2024-08-06T20:27:37.3797529Z name: linux-jammy-py3.8-gcc11 2024-08-06T20:27:37.3797838Z s3-bucket: gha-artifacts 2024-08-06T20:27:37.3798166Z region: us-east-1 2024-08-06T20:27:37.3798404Z env: 2024-08-06T20:27:37.3798612Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:37.3798879Z ##[endgroup] 2024-08-06T20:27:38.0659988Z (node:107328) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-06T20:27:38.0660522Z 2024-08-06T20:27:38.0660735Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-06T20:27:38.0661389Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-06T20:27:38.0662282Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-06T20:27:38.1387863Z Found 1 objects with prefix pytorch/pytorch/10273124344/linux-jammy-py3.8-gcc11/ 2024-08-06T20:27:38.1388592Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-06T20:27:41.8608944Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2024-08-06T20:27:41.8617051Z Artifact download has finished successfully 2024-08-06T20:27:41.8785608Z ##[group]Run unzip -o artifacts.zip 2024-08-06T20:27:41.8785978Z unzip -o artifacts.zip 2024-08-06T20:27:41.8791797Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:41.8792192Z env: 2024-08-06T20:27:41.8792437Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:41.8792699Z ##[endgroup] 2024-08-06T20:27:41.9070662Z Archive: artifacts.zip 2024-08-06T20:27:41.9071430Z creating: dist/ 2024-08-06T20:27:42.8425476Z inflating: dist/torch-2.5.0a0+gitb9d86fa-cp38-cp38-linux_x86_64.whl 2024-08-06T20:27:42.8426389Z creating: build/custom_test_artifacts/ 2024-08-06T20:27:42.8426870Z creating: build/custom_test_artifacts/custom-op-build/ 2024-08-06T20:27:42.8427429Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2024-08-06T20:27:42.8428199Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2024-08-06T20:27:42.8430735Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-06T20:27:42.8431452Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/ 2024-08-06T20:27:42.8432151Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-06T20:27:42.8432893Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-06T20:27:42.8433606Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-06T20:27:42.8434455Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-06T20:27:42.8435561Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-06T20:27:42.8436315Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-06T20:27:42.8437047Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-06T20:27:42.8438996Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-06T20:27:42.8439900Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-06T20:27:42.8441304Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-06T20:27:42.8442160Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-06T20:27:42.8443374Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-06T20:27:42.8444382Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-06T20:27:42.8445125Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2024-08-06T20:27:42.8445861Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2024-08-06T20:27:42.8446563Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2024-08-06T20:27:42.8447331Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2024-08-06T20:27:42.8448194Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2024-08-06T20:27:42.8449035Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2024-08-06T20:27:42.8449822Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2024-08-06T20:27:42.8450634Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2024-08-06T20:27:42.8451440Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2024-08-06T20:27:42.8452254Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2024-08-06T20:27:42.8453076Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2024-08-06T20:27:42.8453864Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2024-08-06T20:27:42.8469567Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2024-08-06T20:27:42.8598020Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2024-08-06T20:27:42.8598801Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2024-08-06T20:27:42.8599612Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2024-08-06T20:27:42.8600543Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2024-08-06T20:27:42.8601427Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2024-08-06T20:27:42.8602260Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2024-08-06T20:27:42.8603104Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2024-08-06T20:27:42.8603974Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2024-08-06T20:27:42.8604833Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2024-08-06T20:27:42.8605767Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2024-08-06T20:27:42.8606612Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2024-08-06T20:27:42.8624094Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2024-08-06T20:27:42.8700190Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2024-08-06T20:27:42.8701949Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-06T20:27:42.8703431Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2024-08-06T20:27:42.8704746Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2024-08-06T20:27:42.8705976Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2024-08-06T20:27:42.8707389Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2024-08-06T20:27:42.8708582Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2024-08-06T20:27:42.8709569Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2024-08-06T20:27:42.8710624Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2024-08-06T20:27:42.8819792Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2024-08-06T20:27:42.8878781Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2024-08-06T20:27:42.8879742Z creating: build/custom_test_artifacts/jit-hook-build/ 2024-08-06T20:27:42.8880593Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2024-08-06T20:27:42.8881609Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2024-08-06T20:27:42.8883623Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-06T20:27:42.8884857Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/ 2024-08-06T20:27:42.8886161Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-06T20:27:42.8887430Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-06T20:27:42.8888739Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-06T20:27:42.8890177Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-06T20:27:42.8891643Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-06T20:27:42.8892934Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-06T20:27:42.8894247Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-06T20:27:42.8895769Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-06T20:27:42.8897368Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-06T20:27:42.8898942Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-06T20:27:42.8900421Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-06T20:27:42.8902013Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-06T20:27:42.8903670Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-06T20:27:42.8905072Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2024-08-06T20:27:42.8906294Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2024-08-06T20:27:42.8907637Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2024-08-06T20:27:42.8909097Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2024-08-06T20:27:42.8910714Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2024-08-06T20:27:42.8912177Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2024-08-06T20:27:42.8959776Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2024-08-06T20:27:42.8961281Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2024-08-06T20:27:42.8962845Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2024-08-06T20:27:42.8964400Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2024-08-06T20:27:42.8966133Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2024-08-06T20:27:42.8967601Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2024-08-06T20:27:42.8969093Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2024-08-06T20:27:42.8999287Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2024-08-06T20:27:42.9000948Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-06T20:27:42.9002390Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2024-08-06T20:27:42.9003687Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2024-08-06T20:27:42.9004870Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2024-08-06T20:27:42.9006180Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2024-08-06T20:27:42.9007353Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2024-08-06T20:27:42.9008497Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2024-08-06T20:27:42.9009564Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2024-08-06T20:27:42.9055287Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2024-08-06T20:27:42.9056302Z creating: build/custom_test_artifacts/custom-backend-build/ 2024-08-06T20:27:42.9057269Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2024-08-06T20:27:42.9058352Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2024-08-06T20:27:42.9060121Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2024-08-06T20:27:42.9061470Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/ 2024-08-06T20:27:42.9062800Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeSystem.cmake 2024-08-06T20:27:42.9064186Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/ 2024-08-06T20:27:42.9065562Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/tmp/ 2024-08-06T20:27:42.9067183Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/CMakeCCompilerId.c 2024-08-06T20:27:42.9068765Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdC/a.out 2024-08-06T20:27:42.9070229Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/ 2024-08-06T20:27:42.9071645Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/tmp/ 2024-08-06T20:27:42.9073322Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2024-08-06T20:27:42.9075219Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CompilerIdCXX/a.out 2024-08-06T20:27:42.9076862Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_C.bin 2024-08-06T20:27:42.9078563Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCCompiler.cmake 2024-08-06T20:27:42.9080507Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeDetermineCompilerABI_CXX.bin 2024-08-06T20:27:42.9082211Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.26.4/CMakeCXXCompiler.cmake 2024-08-06T20:27:42.9083684Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2024-08-06T20:27:42.9085036Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2024-08-06T20:27:42.9086666Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2024-08-06T20:27:42.9088141Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2024-08-06T20:27:42.9089828Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2024-08-06T20:27:42.9091607Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2024-08-06T20:27:42.9093246Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2024-08-06T20:27:42.9094891Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2024-08-06T20:27:42.9096498Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2024-08-06T20:27:42.9098181Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2024-08-06T20:27:42.9099845Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2024-08-06T20:27:42.9101387Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2024-08-06T20:27:42.9103155Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2024-08-06T20:27:42.9208825Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2024-08-06T20:27:42.9210558Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2024-08-06T20:27:42.9212275Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2024-08-06T20:27:42.9214154Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2024-08-06T20:27:42.9215973Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2024-08-06T20:27:42.9217585Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2024-08-06T20:27:42.9219233Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2024-08-06T20:27:42.9221006Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2024-08-06T20:27:42.9222683Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2024-08-06T20:27:42.9224309Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2024-08-06T20:27:42.9225959Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2024-08-06T20:27:42.9236639Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2024-08-06T20:27:42.9288506Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2024-08-06T20:27:42.9290535Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-06T20:27:42.9292105Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2024-08-06T20:27:42.9293689Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2024-08-06T20:27:42.9295012Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2024-08-06T20:27:42.9296321Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2024-08-06T20:27:42.9297568Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2024-08-06T20:27:42.9298835Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2024-08-06T20:27:42.9300013Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2024-08-06T20:27:42.9395556Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2024-08-06T20:27:42.9436639Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2024-08-06T20:27:42.9437556Z creating: build/lib/ 2024-08-06T20:27:42.9438032Z inflating: build/lib/libclog.a 2024-08-06T20:27:42.9447809Z inflating: build/lib/libpthreadpool.a 2024-08-06T20:27:42.9511000Z inflating: build/lib/libgtest.a 2024-08-06T20:27:42.9519300Z inflating: build/lib/libcpuinfo.a 2024-08-06T20:27:42.9527453Z inflating: build/lib/libcpuinfo_internals.a 2024-08-06T20:27:42.9534971Z inflating: build/lib/libittnotify.a 2024-08-06T20:27:42.9614060Z inflating: build/lib/libprotobuf-lite.a 2024-08-06T20:27:42.9683877Z inflating: build/lib/libbenchmark.a 2024-08-06T20:27:42.9712363Z inflating: build/lib/libtensorpipe_uv.a 2024-08-06T20:27:42.9773365Z inflating: build/lib/libasmjit.a 2024-08-06T20:27:43.0195744Z inflating: build/lib/libprotobuf.a 2024-08-06T20:27:43.0302900Z inflating: build/lib/libgloo.a 2024-08-06T20:27:43.0322297Z inflating: build/lib/libfmt.a 2024-08-06T20:27:43.0322981Z inflating: build/lib/libfoxi_loader.a 2024-08-06T20:27:43.0324253Z inflating: build/lib/libtorch_global_deps.so 2024-08-06T20:27:43.0414635Z inflating: build/lib/libc10.so 2024-08-06T20:27:43.0416793Z inflating: build/lib/libnnpack_reference_layers.a 2024-08-06T20:27:43.0434822Z inflating: build/lib/libpytorch_qnnpack.a 2024-08-06T20:27:43.0906073Z inflating: build/lib/libprotoc.a 2024-08-06T20:27:43.0922229Z inflating: build/lib/libgmock.a 2024-08-06T20:27:43.0922880Z inflating: build/lib/libgtest_main.a 2024-08-06T20:27:43.0923477Z inflating: build/lib/libbenchmark_main.a 2024-08-06T20:27:43.0940604Z inflating: build/lib/libnnpack.a 2024-08-06T20:27:44.0031292Z inflating: build/lib/libdnnl.a 2024-08-06T20:27:44.0551163Z inflating: build/lib/libtensorpipe.a 2024-08-06T20:27:44.1531167Z inflating: build/lib/libfbgemm.a 2024-08-06T20:27:44.1532025Z inflating: build/lib/libgmock_main.a 2024-08-06T20:27:44.1805287Z inflating: build/lib/libkineto.a 2024-08-06T20:27:44.1843418Z inflating: build/lib/libonnx_proto.a 2024-08-06T20:27:44.2017796Z inflating: build/lib/libXNNPACK.a 2024-08-06T20:27:44.2678504Z inflating: build/lib/libonnx.a 2024-08-06T20:27:46.4775362Z inflating: build/lib/libtorch_cpu.so 2024-08-06T20:27:46.4776329Z inflating: build/lib/libtorch.so 2024-08-06T20:27:46.4780860Z inflating: build/lib/libunbox_lib.a 2024-08-06T20:27:46.4784418Z inflating: build/lib/libshm.so 2024-08-06T20:27:46.4802970Z inflating: build/lib/libjitbackend_test.so 2024-08-06T20:27:46.4870319Z inflating: build/lib/libtorchbind_test.so 2024-08-06T20:27:46.4894524Z inflating: build/lib/libaoti_custom_ops.so 2024-08-06T20:27:46.4918362Z inflating: build/lib/libbackend_with_compiler.so 2024-08-06T20:27:46.6724435Z inflating: build/lib/libtorch_python.so 2024-08-06T20:27:46.6757766Z inflating: build/lib/libnnapi_backend.so 2024-08-06T20:27:46.6758222Z creating: build/bin/ 2024-08-06T20:27:46.6758604Z creating: build/bin/CMakeFiles/ 2024-08-06T20:27:46.6759178Z inflating: build/bin/CMakeFiles/CMakeDirectoryInformation.cmake 2024-08-06T20:27:46.6760023Z extracting: build/bin/CMakeFiles/progress.marks 2024-08-06T20:27:46.6760500Z inflating: build/bin/Makefile 2024-08-06T20:27:46.6760934Z inflating: build/bin/cmake_install.cmake 2024-08-06T20:27:46.6761291Z inflating: build/bin/CTestTestfile.cmake 2024-08-06T20:27:46.6811569Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2024-08-06T20:27:46.6863125Z inflating: build/bin/c10_DeviceGuard_test 2024-08-06T20:27:46.6913808Z inflating: build/bin/c10_Device_test 2024-08-06T20:27:46.6974773Z inflating: build/bin/c10_DispatchKeySet_test 2024-08-06T20:27:46.7028397Z inflating: build/bin/c10_Scalar_test 2024-08-06T20:27:46.7078057Z inflating: build/bin/c10_StreamGuard_test 2024-08-06T20:27:46.7129669Z inflating: build/bin/c10_SymInt_test 2024-08-06T20:27:46.7185516Z inflating: build/bin/c10_InlineStreamGuard_test 2024-08-06T20:27:46.7240123Z inflating: build/bin/c10_InlineDeviceGuard_test 2024-08-06T20:27:46.7296290Z inflating: build/bin/c10_SizesAndStrides_test 2024-08-06T20:27:46.7349524Z inflating: build/bin/c10_Bitset_test 2024-08-06T20:27:46.7420094Z inflating: build/bin/c10_cow_test 2024-08-06T20:27:46.7468998Z inflating: build/bin/c10_ConstexprCrc_test 2024-08-06T20:27:46.7518914Z inflating: build/bin/c10_DeadlockDetection_test 2024-08-06T20:27:46.7570148Z inflating: build/bin/c10_Half_test 2024-08-06T20:27:46.7626088Z inflating: build/bin/c10_LeftRight_test 2024-08-06T20:27:46.7681717Z inflating: build/bin/c10_Metaprogramming_test 2024-08-06T20:27:46.7732210Z inflating: build/bin/c10_Synchronized_test 2024-08-06T20:27:46.7788112Z inflating: build/bin/c10_ThreadLocal_test 2024-08-06T20:27:46.7839782Z inflating: build/bin/c10_TypeIndex_test 2024-08-06T20:27:46.7891702Z inflating: build/bin/c10_TypeList_test 2024-08-06T20:27:46.7941192Z inflating: build/bin/c10_TypeTraits_test 2024-08-06T20:27:46.7993201Z inflating: build/bin/c10_accumulate_test 2024-08-06T20:27:46.8043972Z inflating: build/bin/c10_bit_cast_test 2024-08-06T20:27:46.8100840Z inflating: build/bin/c10_bfloat16_test 2024-08-06T20:27:46.8157165Z inflating: build/bin/c10_complex_math_test 2024-08-06T20:27:46.8212800Z inflating: build/bin/c10_complex_test 2024-08-06T20:27:46.8265550Z inflating: build/bin/c10_exception_test 2024-08-06T20:27:46.8316193Z inflating: build/bin/c10_flags_test 2024-08-06T20:27:46.8366692Z inflating: build/bin/c10_generic_math_test 2024-08-06T20:27:46.8525502Z inflating: build/bin/c10_intrusive_ptr_test 2024-08-06T20:27:46.8576905Z inflating: build/bin/c10_irange_test 2024-08-06T20:27:46.8630791Z inflating: build/bin/c10_lazy_test 2024-08-06T20:27:46.8688110Z inflating: build/bin/c10_logging_test 2024-08-06T20:27:46.8764271Z inflating: build/bin/c10_optional_test 2024-08-06T20:27:46.8826697Z inflating: build/bin/c10_ordered_preserving_dict_test 2024-08-06T20:27:46.8880336Z inflating: build/bin/c10_registry_test 2024-08-06T20:27:46.9027318Z inflating: build/bin/c10_small_vector_test 2024-08-06T20:27:46.9079521Z inflating: build/bin/c10_string_util_test 2024-08-06T20:27:46.9132464Z inflating: build/bin/c10_ssize_test 2024-08-06T20:27:46.9183491Z inflating: build/bin/c10_tempfile_test 2024-08-06T20:27:46.9242283Z inflating: build/bin/c10_string_view_test 2024-08-06T20:27:46.9298868Z inflating: build/bin/c10_typeid_test 2024-08-06T20:27:46.9345943Z inflating: build/bin/c10_intrusive_ptr_benchmark 2024-08-06T20:27:46.9787874Z inflating: build/bin/protoc-3.13.0.0 2024-08-06T20:27:47.0227564Z inflating: build/bin/protoc 2024-08-06T20:27:47.0548271Z inflating: build/bin/vec_test_all_types_DEFAULT 2024-08-06T20:27:47.0886469Z inflating: build/bin/vec_test_all_types_AVX512 2024-08-06T20:27:47.1236942Z inflating: build/bin/vec_test_all_types_AVX2 2024-08-06T20:27:47.1289644Z inflating: build/bin/BackoffTest 2024-08-06T20:27:47.1342783Z inflating: build/bin/FileStoreTest 2024-08-06T20:27:47.1398875Z inflating: build/bin/TCPStoreTest 2024-08-06T20:27:47.1452699Z inflating: build/bin/HashStoreTest 2024-08-06T20:27:47.1455066Z inflating: build/bin/example_allreduce 2024-08-06T20:27:47.1520257Z inflating: build/bin/ProcessGroupGlooTest 2024-08-06T20:27:47.1574813Z inflating: build/bin/test_dist_autograd 2024-08-06T20:27:47.1577053Z inflating: build/bin/parallel_benchmark 2024-08-06T20:27:47.1644749Z inflating: build/bin/test_cpp_rpc 2024-08-06T20:27:47.1710817Z inflating: build/bin/test_mobile_nnc 2024-08-06T20:27:47.1719340Z inflating: build/bin/aot_model_compiler_test 2024-08-06T20:27:47.2055777Z inflating: build/bin/test_lazy 2024-08-06T20:27:47.2113310Z inflating: build/bin/static_runtime_bench 2024-08-06T20:27:47.2186549Z inflating: build/bin/Dict_test 2024-08-06T20:27:47.2239380Z inflating: build/bin/Dimname_test 2024-08-06T20:27:47.2303933Z inflating: build/bin/MaybeOwned_test 2024-08-06T20:27:47.2547652Z inflating: build/bin/static_runtime_test 2024-08-06T20:27:47.2606595Z inflating: build/bin/apply_utils_test 2024-08-06T20:27:47.2663731Z inflating: build/bin/NamedTensor_test 2024-08-06T20:27:47.2722041Z inflating: build/bin/atest 2024-08-06T20:27:47.2785339Z inflating: build/bin/basic 2024-08-06T20:27:47.2839928Z inflating: build/bin/broadcast_test 2024-08-06T20:27:47.2891237Z inflating: build/bin/cpu_allocator_test 2024-08-06T20:27:47.2949327Z inflating: build/bin/cpu_generator_test 2024-08-06T20:27:47.2999725Z inflating: build/bin/dlconvertor_test 2024-08-06T20:27:47.3053003Z inflating: build/bin/cpu_profiling_allocator_test 2024-08-06T20:27:47.3103579Z inflating: build/bin/dispatch_key_set_test 2024-08-06T20:27:47.3194796Z inflating: build/bin/cpu_rng_test 2024-08-06T20:27:47.3252485Z inflating: build/bin/extension_backend_test 2024-08-06T20:27:47.3314050Z inflating: build/bin/half_test 2024-08-06T20:27:47.3364098Z inflating: build/bin/lazy_tensor_test 2024-08-06T20:27:47.3457633Z inflating: build/bin/ivalue_test 2024-08-06T20:27:47.3511424Z inflating: build/bin/math_kernel_test 2024-08-06T20:27:47.3564395Z inflating: build/bin/memory_format_test 2024-08-06T20:27:47.3617788Z inflating: build/bin/memory_overlapping_test 2024-08-06T20:27:47.3670670Z inflating: build/bin/mobile_memory_cleanup 2024-08-06T20:27:47.3721535Z inflating: build/bin/operator_name_test 2024-08-06T20:27:47.3777483Z inflating: build/bin/native_test 2024-08-06T20:27:47.3828245Z inflating: build/bin/operators_test 2024-08-06T20:27:47.3880381Z inflating: build/bin/packedtensoraccessor_test 2024-08-06T20:27:47.4969275Z inflating: build/bin/test_api 2024-08-06T20:27:47.5035587Z inflating: build/bin/pow_test 2024-08-06T20:27:47.5092875Z inflating: build/bin/quantized_test 2024-08-06T20:27:47.5144063Z inflating: build/bin/reportMemoryUsage_test 2024-08-06T20:27:47.5194132Z inflating: build/bin/reduce_ops_test 2024-08-06T20:27:47.5251527Z inflating: build/bin/scalar_tensor_test 2024-08-06T20:27:47.5311044Z inflating: build/bin/scalar_test 2024-08-06T20:27:47.5362405Z inflating: build/bin/StorageUtils_test 2024-08-06T20:27:47.5415147Z inflating: build/bin/stride_properties_test 2024-08-06T20:27:47.5493339Z inflating: build/bin/tensor_iterator_test 2024-08-06T20:27:47.5548263Z inflating: build/bin/type_ptr_test 2024-08-06T20:27:47.5550746Z inflating: build/bin/thread_init_test 2024-08-06T20:27:47.5604745Z inflating: build/bin/test_parallel 2024-08-06T20:27:47.5664186Z inflating: build/bin/type_test 2024-08-06T20:27:47.5716386Z inflating: build/bin/undefined_tensor_test 2024-08-06T20:27:47.5717787Z inflating: build/bin/verify_api_visibility 2024-08-06T20:27:47.5786575Z inflating: build/bin/legacy_vmap_test 2024-08-06T20:27:47.5839986Z inflating: build/bin/weakref_test 2024-08-06T20:27:47.5892086Z inflating: build/bin/wrapdim_test 2024-08-06T20:27:47.5943893Z inflating: build/bin/xla_tensor_test 2024-08-06T20:27:47.6048161Z inflating: build/bin/List_test 2024-08-06T20:27:47.6107112Z inflating: build/bin/IListRef_test 2024-08-06T20:27:47.6172719Z inflating: build/bin/KernelFunction_test 2024-08-06T20:27:47.6290875Z inflating: build/bin/kernel_function_legacy_test 2024-08-06T20:27:47.6384900Z inflating: build/bin/kernel_function_test 2024-08-06T20:27:47.6507942Z inflating: build/bin/kernel_lambda_legacy_test 2024-08-06T20:27:47.6607885Z inflating: build/bin/kernel_lambda_test 2024-08-06T20:27:47.6658811Z inflating: build/bin/CppSignature_test 2024-08-06T20:27:47.6719106Z inflating: build/bin/kernel_stackbased_test 2024-08-06T20:27:47.6812909Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2024-08-06T20:27:47.6861694Z inflating: build/bin/op_allowlist_test 2024-08-06T20:27:47.6916955Z inflating: build/bin/backend_fallback_test 2024-08-06T20:27:47.6980553Z inflating: build/bin/inline_container_test 2024-08-06T20:27:47.7284764Z inflating: build/bin/op_registration_test 2024-08-06T20:27:47.7337788Z inflating: build/bin/test_edge_op_registration 2024-08-06T20:27:47.7341829Z inflating: build/bin/torch_shm_manager 2024-08-06T20:27:47.7354149Z inflating: build/bin/tutorial_tensorexpr 2024-08-06T20:27:47.8120585Z inflating: build/bin/test_tensorexpr 2024-08-06T20:27:47.8679087Z inflating: build/bin/test_jit 2024-08-06T20:27:47.8679470Z creating: .additional_ci_files/ 2024-08-06T20:27:47.8733910Z inflating: .additional_ci_files/test-times.json 2024-08-06T20:27:47.8955170Z inflating: .additional_ci_files/test-class-times.json 2024-08-06T20:27:47.8984662Z ##[group]Run rm artifacts.zip 2024-08-06T20:27:47.8985009Z rm artifacts.zip 2024-08-06T20:27:47.8990545Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:47.8990963Z env: 2024-08-06T20:27:47.8991185Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:47.8991462Z ##[endgroup] 2024-08-06T20:27:47.9358846Z ##[group]Run df -H 2024-08-06T20:27:47.9359132Z df -H 2024-08-06T20:27:47.9364728Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:47.9365120Z env: 2024-08-06T20:27:47.9365447Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:47.9365722Z ##[endgroup] 2024-08-06T20:27:47.9458702Z Filesystem Size Used Avail Use% Mounted on 2024-08-06T20:27:47.9459280Z devtmpfs 4.2M 0 4.2M 0% /dev 2024-08-06T20:27:47.9459858Z tmpfs 8.2G 0 8.2G 0% /dev/shm 2024-08-06T20:27:47.9460451Z tmpfs 3.3G 488k 3.3G 1% /run 2024-08-06T20:27:47.9460989Z /dev/nvme0n1p1 161G 26G 136G 17% / 2024-08-06T20:27:47.9461423Z tmpfs 8.2G 13k 8.2G 1% /tmp 2024-08-06T20:27:47.9461783Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2024-08-06T20:27:47.9525193Z Prepare all required actions 2024-08-06T20:27:47.9525951Z Getting action download info 2024-08-06T20:27:48.0826404Z ##[group]Run ./.github/actions/download-td-artifacts 2024-08-06T20:27:48.0826776Z with: 2024-08-06T20:27:48.0826975Z env: 2024-08-06T20:27:48.0827197Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:48.0827465Z ##[endgroup] 2024-08-06T20:27:48.0892202Z ##[group]Run seemethere/download-artifact-s3@v4 2024-08-06T20:27:48.0892564Z with: 2024-08-06T20:27:48.0892785Z name: td_results 2024-08-06T20:27:48.0893022Z s3-bucket: gha-artifacts 2024-08-06T20:27:48.0893305Z region: us-east-1 2024-08-06T20:27:48.0893541Z env: 2024-08-06T20:27:48.0893746Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:48.0894029Z ##[endgroup] 2024-08-06T20:27:48.5607370Z (node:107346) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2024-08-06T20:27:48.5607911Z 2024-08-06T20:27:48.5608178Z Please migrate your code to use AWS SDK for JavaScript (v3). 2024-08-06T20:27:48.5608725Z For more information, check the migration guide at https://a.co/7PzMCcy 2024-08-06T20:27:48.5609316Z (Use `node --trace-warnings ...` to show where the warning was created) 2024-08-06T20:27:48.6427986Z Found 1 objects with prefix pytorch/pytorch/10273124344/td_results/ 2024-08-06T20:27:48.6428677Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-08-06T20:27:48.6888755Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2024-08-06T20:27:48.6894565Z Artifact download has finished successfully 2024-08-06T20:27:48.7211736Z ##[group]Run mkdir -p .additional_ci_files 2024-08-06T20:27:48.7212134Z mkdir -p .additional_ci_files 2024-08-06T20:27:48.7212695Z mv td_results.json .additional_ci_files/td_results.json 2024-08-06T20:27:48.7218479Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:48.7218878Z env: 2024-08-06T20:27:48.7219111Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:48.7219388Z ##[endgroup] 2024-08-06T20:27:48.7567260Z ##[group]Run .github/scripts/parse_ref.py 2024-08-06T20:27:48.7567802Z .github/scripts/parse_ref.py 2024-08-06T20:27:48.7573585Z shell: /usr/bin/bash -e {0} 2024-08-06T20:27:48.7574007Z env: 2024-08-06T20:27:48.7574554Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:48.7574893Z ##[endgroup] 2024-08-06T20:27:48.8023591Z Prepare all required actions 2024-08-06T20:27:48.8163853Z ##[group]Run ./.github/actions/get-workflow-job-id 2024-08-06T20:27:48.8164237Z with: 2024-08-06T20:27:48.8164663Z github-token: *** 2024-08-06T20:27:48.8164897Z env: 2024-08-06T20:27:48.8165124Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:48.8165503Z ##[endgroup] 2024-08-06T20:27:48.8259032Z ##[group]Run set -eux 2024-08-06T20:27:48.8259323Z set -eux 2024-08-06T20:27:48.8259770Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2024-08-06T20:27:48.8265479Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:48.8265867Z env: 2024-08-06T20:27:48.8266084Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:48.8266620Z GITHUB_TOKEN: *** 2024-08-06T20:27:48.8266869Z ##[endgroup] 2024-08-06T20:27:48.8290025Z + python3 .github/scripts/get_workflow_job_id.py 10273124344 i-0035969de18878034 2024-08-06T20:27:52.0067884Z setting job-id=28427732585 2024-08-06T20:27:52.0068517Z setting job-name=linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:27:52.0355697Z Prepare all required actions 2024-08-06T20:27:52.0356430Z Getting action download info 2024-08-06T20:27:52.1564680Z ##[group]Run ./.github/actions/filter-test-configs 2024-08-06T20:27:52.1565040Z with: 2024-08-06T20:27:52.1565599Z github-token: *** 2024-08-06T20:27:52.1568310Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}]} 2024-08-06T20:27:52.1571192Z job-name: linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:27:52.1571681Z env: 2024-08-06T20:27:52.1571899Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:52.1572169Z ##[endgroup] 2024-08-06T20:27:52.1688221Z ##[group]Run nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482 2024-08-06T20:27:52.1688657Z with: 2024-08-06T20:27:52.1688884Z shell: bash 2024-08-06T20:27:52.1689116Z timeout_minutes: 10 2024-08-06T20:27:52.1689361Z max_attempts: 5 2024-08-06T20:27:52.1689606Z retry_wait_seconds: 30 2024-08-06T20:27:52.1690418Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-06T20:27:52.1691275Z polling_interval_seconds: 1 2024-08-06T20:27:52.1691574Z warning_on_retry: true 2024-08-06T20:27:52.1691855Z continue_on_error: false 2024-08-06T20:27:52.1692109Z env: 2024-08-06T20:27:52.1692328Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:52.1692924Z GITHUB_TOKEN: *** 2024-08-06T20:27:52.1693169Z ##[endgroup] 2024-08-06T20:27:52.2513801Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2024-08-06T20:27:52.4920010Z Defaulting to user installation because normal site-packages is not writeable 2024-08-06T20:27:52.5084456Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2024-08-06T20:27:52.5088306Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2024-08-06T20:27:52.5203032Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2024-08-06T20:27:52.5207032Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2024.7.4) 2024-08-06T20:27:52.5217262Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2024-08-06T20:27:52.5227782Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2024-08-06T20:27:53.2225307Z Command completed after 1 attempt(s). 2024-08-06T20:27:53.2276502Z ##[group]Run set -x 2024-08-06T20:27:53.2276787Z set -x 2024-08-06T20:27:53.2277014Z  2024-08-06T20:27:53.2277413Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-06T20:27:53.2277925Z # in runner workspace 2024-08-06T20:27:53.2278318Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2024-08-06T20:27:53.2284030Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:53.2284428Z env: 2024-08-06T20:27:53.2284648Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:53.2285095Z ##[endgroup] 2024-08-06T20:27:53.2308138Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2024-08-06T20:27:53.2550715Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-06T20:27:53.2551178Z echo "Workflow: ${GITHUB_WORKFLOW}" 2024-08-06T20:27:53.2551519Z echo "Job name: ${JOB_NAME}" 2024-08-06T20:27:53.2551825Z  2024-08-06T20:27:53.2552214Z # Use relative path here as this could be checked out anywhere, not necessarily 2024-08-06T20:27:53.2552692Z # in runner workspace 2024-08-06T20:27:53.2553139Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2024-08-06T20:27:53.2553636Z  --workflow "${GITHUB_WORKFLOW}" \ 2024-08-06T20:27:53.2553983Z  --job-name "${JOB_NAME}" \ 2024-08-06T20:27:53.2556738Z  --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}]}" \ 2024-08-06T20:27:53.2559499Z  --selected-test-configs "" \ 2024-08-06T20:27:53.2559838Z  --pr-number "${PR_NUMBER}" \ 2024-08-06T20:27:53.2560164Z  --tag "${TAG}" \ 2024-08-06T20:27:53.2560466Z  --event-name "${EVENT_NAME}" \ 2024-08-06T20:27:53.2560794Z  --schedule "${SCHEDULE}" \ 2024-08-06T20:27:53.2561116Z  --branch "${HEAD_BRANCH}" 2024-08-06T20:27:53.2566746Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:53.2567129Z env: 2024-08-06T20:27:53.2567492Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:53.2567976Z GITHUB_TOKEN: *** 2024-08-06T20:27:53.2568383Z JOB_NAME: linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:27:53.2568871Z PR_NUMBER: 132710 2024-08-06T20:27:53.2569112Z TAG: 2024-08-06T20:27:53.2569322Z EVENT_NAME: pull_request 2024-08-06T20:27:53.2569592Z SCHEDULE: 2024-08-06T20:27:53.2569818Z HEAD_BRANCH: 2024-08-06T20:27:53.2570038Z ##[endgroup] 2024-08-06T20:27:53.2592453Z Workflow: pull 2024-08-06T20:27:53.2592893Z Job name: linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:27:53.5023491Z INFO:root:Found no test-config label on the PR, so all test configs are included 2024-08-06T20:27:53.6910295Z ##[group]Run echo "Filtered matrix:" 2024-08-06T20:27:53.6910657Z echo "Filtered matrix:" 2024-08-06T20:27:53.6913358Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 2, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 3, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "default", "shard": 4, "num_shards": 4, "runner": "amz2023.linux.2xlarge"}, {"config": "docs_test", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "jit_legacy", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "backwards_compat", "shard": 1, "num_shards": 1, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 1, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}, {"config": "distributed", "shard": 2, "num_shards": 2, "runner": "amz2023.linux.2xlarge"}]}" 2024-08-06T20:27:53.6916066Z  2024-08-06T20:27:53.6916433Z echo 2024-08-06T20:27:53.6916725Z echo "Is the current job unstable? False" 2024-08-06T20:27:53.6917063Z  2024-08-06T20:27:53.6917280Z echo 2024-08-06T20:27:53.6917557Z echo "Is keep-going label set? False" 2024-08-06T20:27:53.6917887Z  2024-08-06T20:27:53.6918104Z echo 2024-08-06T20:27:53.6918353Z echo "Renabled issues? " 2024-08-06T20:27:53.6923969Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:53.6924367Z env: 2024-08-06T20:27:53.6924613Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:53.6924878Z ##[endgroup] 2024-08-06T20:27:53.6948053Z Filtered matrix: 2024-08-06T20:27:53.6952034Z {include: [{config: default, shard: 1, num_shards: 4, runner: amz2023.linux.2xlarge}, {config: default, shard: 2, num_shards: 4, runner: amz2023.linux.2xlarge}, {config: default, shard: 3, num_shards: 4, runner: amz2023.linux.2xlarge}, {config: default, shard: 4, num_shards: 4, runner: amz2023.linux.2xlarge}, {config: docs_test, shard: 1, num_shards: 1, runner: amz2023.linux.2xlarge}, {config: jit_legacy, shard: 1, num_shards: 1, runner: amz2023.linux.2xlarge}, {config: backwards_compat, shard: 1, num_shards: 1, runner: amz2023.linux.2xlarge}, {config: distributed, shard: 1, num_shards: 2, runner: amz2023.linux.2xlarge}, {config: distributed, shard: 2, num_shards: 2, runner: amz2023.linux.2xlarge}]} 2024-08-06T20:27:53.6954613Z 2024-08-06T20:27:53.6954734Z Is the current job unstable? False 2024-08-06T20:27:53.6954944Z 2024-08-06T20:27:53.6955070Z Is keep-going label set? False 2024-08-06T20:27:53.6955263Z 2024-08-06T20:27:53.6955358Z Renabled issues? 2024-08-06T20:27:53.7001287Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-06T20:27:53.7001814Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2024-08-06T20:27:53.7007305Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T20:27:53.7007702Z env: 2024-08-06T20:27:53.7007915Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:53.7008188Z JOB_TIMEOUT: 240 2024-08-06T20:27:53.7008428Z ##[endgroup] 2024-08-06T20:27:53.7092644Z ##[group]Run set -x 2024-08-06T20:27:53.7092969Z set -x 2024-08-06T20:27:53.7093190Z  2024-08-06T20:27:53.7093590Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2024-08-06T20:27:53.7093998Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2024-08-06T20:27:53.7094396Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2024-08-06T20:27:53.7094775Z  TEST_COMMAND=.ci/onnx/test.sh 2024-08-06T20:27:53.7095095Z else 2024-08-06T20:27:53.7095347Z  TEST_COMMAND=.ci/pytorch/test.sh 2024-08-06T20:27:53.7095675Z fi 2024-08-06T20:27:53.7095888Z  2024-08-06T20:27:53.7096225Z # detached container should get cleaned up by teardown_ec2_linux 2024-08-06T20:27:53.7096784Z # TODO: Stop building test binaries as part of the build phase 2024-08-06T20:27:53.7097273Z # Used for GPU_FLAG since that doesn't play nice 2024-08-06T20:27:53.7097710Z # shellcheck disable=SC2086,SC2090 2024-08-06T20:27:53.7098053Z container_name=$(docker run \ 2024-08-06T20:27:53.7098377Z  ${GPU_FLAG:-} \ 2024-08-06T20:27:53.7098673Z  -e BUILD_ENVIRONMENT \ 2024-08-06T20:27:53.7098971Z  -e PR_NUMBER \ 2024-08-06T20:27:53.7099255Z  -e GITHUB_ACTIONS \ 2024-08-06T20:27:53.7099556Z  -e GITHUB_REPOSITORY \ 2024-08-06T20:27:53.7099853Z  -e GITHUB_WORKFLOW \ 2024-08-06T20:27:53.7100149Z  -e GITHUB_JOB \ 2024-08-06T20:27:53.7100426Z  -e GITHUB_RUN_ID \ 2024-08-06T20:27:53.7100703Z  -e GITHUB_RUN_NUMBER \ 2024-08-06T20:27:53.7101012Z  -e GITHUB_RUN_ATTEMPT \ 2024-08-06T20:27:53.7101312Z  -e JOB_ID \ 2024-08-06T20:27:53.7101565Z  -e JOB_NAME \ 2024-08-06T20:27:53.7101833Z  -e BASE_SHA \ 2024-08-06T20:27:53.7102096Z  -e BRANCH \ 2024-08-06T20:27:53.7102342Z  -e SHA1 \ 2024-08-06T20:27:53.7102612Z  -e AWS_DEFAULT_REGION \ 2024-08-06T20:27:53.7102918Z  -e IN_WHEEL_TEST \ 2024-08-06T20:27:53.7103190Z  -e SHARD_NUMBER \ 2024-08-06T20:27:53.7103476Z  -e TEST_CONFIG \ 2024-08-06T20:27:53.7103759Z  -e NUM_TEST_SHARDS \ 2024-08-06T20:27:53.7104049Z  -e REENABLED_ISSUES \ 2024-08-06T20:27:53.7104362Z  -e CONTINUE_THROUGH_ERROR \ 2024-08-06T20:27:53.7104686Z  -e VERBOSE_TEST_LOGS \ 2024-08-06T20:27:53.7104981Z  -e TEST_SHOWLOCALS \ 2024-08-06T20:27:53.7105280Z  -e NO_TEST_TIMEOUT \ 2024-08-06T20:27:53.7105567Z  -e NO_TD \ 2024-08-06T20:27:53.7105819Z  -e TD_DISTRIBUTED \ 2024-08-06T20:27:53.7106113Z  -e PR_LABELS \ 2024-08-06T20:27:53.7106416Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2024-08-06T20:27:53.7106748Z  -e SCCACHE_BUCKET \ 2024-08-06T20:27:53.7107053Z  -e SCCACHE_S3_KEY_PREFIX \ 2024-08-06T20:27:53.7107363Z  -e XLA_CUDA \ 2024-08-06T20:27:53.7107656Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2024-08-06T20:27:53.7108031Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2024-08-06T20:27:53.7108421Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2024-08-06T20:27:53.7108790Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2024-08-06T20:27:53.7109145Z  -e HUGGING_FACE_HUB_TOKEN \ 2024-08-06T20:27:53.7109466Z  -e DASHBOARD_TAG \ 2024-08-06T20:27:53.7109801Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2024-08-06T20:27:53.7110211Z  --security-opt seccomp=unconfined \ 2024-08-06T20:27:53.7110566Z  --cap-add=SYS_PTRACE \ 2024-08-06T20:27:53.7110855Z  --ipc=host \ 2024-08-06T20:27:53.7111133Z  --shm-size="${SHM_SIZE}" \ 2024-08-06T20:27:53.7111437Z  --tty \ 2024-08-06T20:27:53.7111672Z  --detach \ 2024-08-06T20:27:53.7111947Z  --name="${container_name}" \ 2024-08-06T20:27:53.7112382Z  --user jenkins \ 2024-08-06T20:27:53.7112740Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2024-08-06T20:27:53.7113157Z  -w /var/lib/jenkins/workspace \ 2024-08-06T20:27:53.7113557Z  "${DOCKER_IMAGE}" 2024-08-06T20:27:53.7113814Z ) 2024-08-06T20:27:53.7114114Z # Propagate download.pytorch.org IP to container 2024-08-06T20:27:53.7114810Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2024-08-06T20:27:53.7115532Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2024-08-06T20:27:53.7116216Z docker exec -t "${container_name}" sh -c "pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2024-08-06T20:27:53.7121485Z shell: /usr/bin/bash -e {0} 2024-08-06T20:27:53.7121756Z env: 2024-08-06T20:27:53.7121979Z GIT_DEFAULT_BRANCH: main 2024-08-06T20:27:53.7122294Z BUILD_ENVIRONMENT: linux-jammy-py3.8-gcc11 2024-08-06T20:27:53.7122630Z PR_NUMBER: 132710 2024-08-06T20:27:53.7122899Z GITHUB_REPOSITORY: pytorch/pytorch 2024-08-06T20:27:53.7123217Z GITHUB_WORKFLOW: pull 2024-08-06T20:27:53.7123471Z GITHUB_JOB: test 2024-08-06T20:27:53.7123714Z GITHUB_RUN_ID: 10273124344 2024-08-06T20:27:53.7123993Z GITHUB_RUN_NUMBER: 233985 2024-08-06T20:27:53.7124256Z GITHUB_RUN_ATTEMPT: 1 2024-08-06T20:27:53.7124508Z JOB_ID: 28427732585 2024-08-06T20:27:53.7124924Z JOB_NAME: linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:27:53.7125501Z BRANCH: pull/132710 2024-08-06T20:27:53.7125791Z SHA1: b9d86fa89636e301796d4201f36d86c73f6e49bc 2024-08-06T20:27:53.7126179Z BASE_SHA: 1736af7cf736184c356be1bb00f59fb2feea6d7d 2024-08-06T20:27:53.7126526Z TEST_CONFIG: distributed 2024-08-06T20:27:53.7126798Z SHARD_NUMBER: 1 2024-08-06T20:27:53.7127037Z NUM_TEST_SHARDS: 2 2024-08-06T20:27:53.7127276Z REENABLED_ISSUES: 2024-08-06T20:27:53.7127539Z CONTINUE_THROUGH_ERROR: False 2024-08-06T20:27:53.7127845Z VERBOSE_TEST_LOGS: False 2024-08-06T20:27:53.7128111Z TEST_SHOWLOCALS: False 2024-08-06T20:27:53.7128383Z NO_TEST_TIMEOUT: False 2024-08-06T20:27:53.7128663Z NO_TD: False 2024-08-06T20:27:53.7128890Z TD_DISTRIBUTED: False 2024-08-06T20:27:53.7129215Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2024-08-06T20:27:53.7129594Z SCCACHE_S3_KEY_PREFIX: pull 2024-08-06T20:27:53.7129866Z SHM_SIZE: 1g 2024-08-06T20:27:53.7130542Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:27:53.7131288Z XLA_CUDA: 2024-08-06T20:27:53.7131646Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2024-08-06T20:27:53.7132122Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2024-08-06T20:27:53.7132462Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2024-08-06T20:27:53.7132771Z DASHBOARD_TAG: 2024-08-06T20:27:53.7133025Z HUGGING_FACE_HUB_TOKEN: 2024-08-06T20:27:53.7133300Z ##[endgroup] 2024-08-06T20:27:53.7154318Z + [[ distributed == \m\u\l\t\i\g\p\u ]] 2024-08-06T20:27:53.7154686Z + [[ linux-jammy-py3.8-gcc11 == *onnx* ]] 2024-08-06T20:27:53.7155046Z + TEST_COMMAND=.ci/pytorch/test.sh 2024-08-06T20:27:53.7162088Z +++ nproc --ignore=2 2024-08-06T20:27:53.7181296Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=6 -e SCCACHE_BUCKET -e SCCACHE_S3_KEY_PREFIX -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/tmp/github_env_10273124344 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T20:28:02.6601695Z + container_name=c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T20:28:02.6603386Z + grep download.pytorch.org /etc/hosts 2024-08-06T20:28:02.6605090Z + docker exec -i c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 sudo bash -c '/bin/cat >> /etc/hosts' 2024-08-06T20:28:02.8083963Z + echo DOCKER_CONTAINER_ID=c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T20:28:02.8086851Z ++ echo dist/torch-2.5.0a0+gitb9d86fa-cp38-cp38-linux_x86_64.whl 2024-08-06T20:28:02.8088926Z + docker exec -t c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 sh -c 'pip install dist/torch-2.5.0a0+gitb9d86fa-cp38-cp38-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2024-08-06T20:28:03.8241858Z Processing ./dist/torch-2.5.0a0+gitb9d86fa-cp38-cp38-linux_x86_64.whl (from torch==2.5.0a0+gitb9d86fa) 2024-08-06T20:28:04.2569468Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (3.13.1) 2024-08-06T20:28:04.2575211Z Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (4.12.2) 2024-08-06T20:28:04.2578265Z Requirement already satisfied: networkx in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (2.8.8) 2024-08-06T20:28:04.2581344Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (3.1.4) 2024-08-06T20:28:04.2584534Z Requirement already satisfied: fsspec in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (2024.6.1) 2024-08-06T20:28:04.2594451Z Requirement already satisfied: sympy==1.12.1 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (1.12.1) 2024-08-06T20:28:04.2615604Z Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from sympy==1.12.1->torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (1.3.0) 2024-08-06T20:28:04.2640734Z Requirement already satisfied: opt-einsum>=3.3 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (3.3.0) 2024-08-06T20:28:04.2704187Z Requirement already satisfied: numpy>=1.7 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from opt-einsum>=3.3->torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (1.21.2) 2024-08-06T20:28:04.3561691Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.8/lib/python3.8/site-packages (from jinja2->torch==2.5.0a0+gitb9d86fa->torch==2.5.0a0+gitb9d86fa) (2.1.5) 2024-08-06T20:28:05.6142350Z Installing collected packages: torch 2024-08-06T20:28:13.5103479Z Successfully installed torch-2.5.0a0+gitb9d86fa 2024-08-06T20:28:13.5902111Z ++ dirname .ci/pytorch/test.sh 2024-08-06T20:28:13.5916568Z + source .ci/pytorch/common.sh 2024-08-06T20:28:13.5922988Z +++ dirname .ci/pytorch/common.sh 2024-08-06T20:28:13.5929047Z ++ source .ci/pytorch/common_utils.sh 2024-08-06T20:28:13.5933379Z +++ declare -f -t trap_add 2024-08-06T20:28:13.5937709Z ++ set -ex 2024-08-06T20:28:13.5938137Z ++ [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-08-06T20:28:13.5938692Z ++ BUILD_TEST_LIBTORCH=0 2024-08-06T20:28:13.5939140Z + [[ linux-jammy-py3.8-gcc11 != *rocm* ]] 2024-08-06T20:28:13.5941976Z ++ stat -c %u /var/lib/jenkins/workspace 2024-08-06T20:28:13.5987824Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2024-08-06T20:28:13.5988779Z + trap_add cleanup_workspace EXIT 2024-08-06T20:28:13.5989132Z + trap_add_cmd=cleanup_workspace 2024-08-06T20:28:13.5989415Z + shift 2024-08-06T20:28:13.5989763Z + for trap_add_name in "$@" 2024-08-06T20:28:13.5994333Z +++ trap -p EXIT 2024-08-06T20:28:13.5997231Z ++ eval 'extract_trap_cmd ' 2024-08-06T20:28:13.5997607Z +++ extract_trap_cmd 2024-08-06T20:28:13.5997868Z +++ printf '%s\n' '' 2024-08-06T20:28:13.5998124Z ++ printf '%s\n' cleanup_workspace 2024-08-06T20:28:13.5999057Z + trap -- ' 2024-08-06T20:28:13.5999392Z cleanup_workspace' EXIT 2024-08-06T20:28:13.5999717Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2024-08-06T20:28:14.0998475Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2024-08-06T20:28:14.1201959Z + echo 'Environment variables:' 2024-08-06T20:28:14.1202433Z Environment variables: 2024-08-06T20:28:14.1202694Z + env 2024-08-06T20:28:14.1219872Z INSTALLED_DB=yes 2024-08-06T20:28:14.1220531Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-06T20:28:14.1221366Z CONTINUE_THROUGH_ERROR=False 2024-08-06T20:28:14.1221899Z BUILD_ENVIRONMENT=linux-jammy-py3.8-gcc11 2024-08-06T20:28:14.1222264Z HOSTNAME=c5a57db8914d 2024-08-06T20:28:14.1222867Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1223579Z GITHUB_ACTION=__self 2024-08-06T20:28:14.1223859Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-06T20:28:14.1224163Z GITHUB_RUN_NUMBER=233985 2024-08-06T20:28:14.1224440Z TEST_CONFIG=distributed 2024-08-06T20:28:14.1224746Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-06T20:28:14.1225139Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-06T20:28:14.1225523Z GITHUB_TRIGGERING_ACTOR=drisspg 2024-08-06T20:28:14.1225809Z GITHUB_REF_TYPE=branch 2024-08-06T20:28:14.1226079Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-06T20:28:14.1226408Z BASE_SHA=1736af7cf736184c356be1bb00f59fb2feea6d7d 2024-08-06T20:28:14.1226741Z XLA_CUDA= 2024-08-06T20:28:14.1226980Z HUGGING_FACE_HUB_TOKEN= 2024-08-06T20:28:14.1227429Z *** 2024-08-06T20:28:14.1227643Z GITHUB_REPOSITORY_ID=65600975 2024-08-06T20:28:14.1227940Z GITHUB_ACTIONS=true 2024-08-06T20:28:14.1228228Z SHA1=b9d86fa89636e301796d4201f36d86c73f6e49bc 2024-08-06T20:28:14.1228601Z GITHUB_SHA=bf5bb5a1585a03379137fab341e87c02c77e76cd 2024-08-06T20:28:14.1229162Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/132710/merge 2024-08-06T20:28:14.1229676Z UCC_HOME=/usr 2024-08-06T20:28:14.1229903Z VERBOSE_TEST_LOGS=False 2024-08-06T20:28:14.1230176Z GITHUB_REF=refs/pull/132710/merge 2024-08-06T20:28:14.1230468Z SHARD_NUMBER=1 2024-08-06T20:28:14.1230701Z GITHUB_REF_PROTECTED=false 2024-08-06T20:28:14.1230978Z HOME=/var/lib/jenkins 2024-08-06T20:28:14.1231265Z GITHUB_API_URL=https://api.github.com 2024-08-06T20:28:14.1231597Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-06T20:28:14.1231899Z UCX_COMMIT= 2024-08-06T20:28:14.1232131Z SCCACHE_S3_KEY_PREFIX=pull 2024-08-06T20:28:14.1232393Z NUM_TEST_SHARDS=2 2024-08-06T20:28:14.1232634Z UCX_HOME=/usr 2024-08-06T20:28:14.1233223Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1234049Z JOB_NAME=linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:28:14.1234841Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1235670Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-06T20:28:14.1236205Z GITHUB_EVENT_NAME=pull_request 2024-08-06T20:28:14.1236485Z DASHBOARD_TAG= 2024-08-06T20:28:14.1236731Z GITHUB_RUN_ID=10273124344 2024-08-06T20:28:14.1237390Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1238074Z GITHUB_ACTOR=drisspg 2024-08-06T20:28:14.1238341Z PR_NUMBER=132710 2024-08-06T20:28:14.1238590Z DESIRED_CUDA= 2024-08-06T20:28:14.1239046Z GITHUB_RUN_ATTEMPT=1 2024-08-06T20:28:14.1239324Z ANACONDA_PYTHON_VERSION=3.8 2024-08-06T20:28:14.1239673Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-06T20:28:14.1240135Z TERM=xterm 2024-08-06T20:28:14.1240367Z INSTALLED_VISION=yes 2024-08-06T20:28:14.1240632Z BRANCH=pull/132710 2024-08-06T20:28:14.1240881Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-06T20:28:14.1241178Z CUDA_PATH=/usr/local/cuda 2024-08-06T20:28:14.1241704Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-06T20:28:14.1242302Z GITHUB_SERVER_URL=https://github.com 2024-08-06T20:28:14.1242622Z UCC_COMMIT= 2024-08-06T20:28:14.1242838Z REENABLED_ISSUES= 2024-08-06T20:28:14.1243076Z DOCS=yes 2024-08-06T20:28:14.1243290Z INSTALLED_ANDROID= 2024-08-06T20:28:14.1243514Z SHLVL=1 2024-08-06T20:28:14.1243722Z MAX_JOBS=6 2024-08-06T20:28:14.1243950Z GITHUB_ACTOR_ID=32754868 2024-08-06T20:28:14.1244294Z GITHUB_WORKFLOW_SHA=bf5bb5a1585a03379137fab341e87c02c77e76cd 2024-08-06T20:28:14.1244695Z GITHUB_REF_NAME=132710/merge 2024-08-06T20:28:14.1245111Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-06T20:28:14.1245654Z GITHUB_JOB=test 2024-08-06T20:28:14.1245898Z NO_TEST_TIMEOUT=False 2024-08-06T20:28:14.1246162Z TD_DISTRIBUTED=False 2024-08-06T20:28:14.1246429Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-06T20:28:14.1246748Z GITHUB_RETENTION_DAYS=90 2024-08-06T20:28:14.1247029Z OPENSSL_DIR=/opt/openssl 2024-08-06T20:28:14.1247297Z GITHUB_ACTION_REPOSITORY= 2024-08-06T20:28:14.1248100Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-06T20:28:14.1248946Z GITHUB_BASE_REF=gh/drisspg/23/base 2024-08-06T20:28:14.1249244Z INSTALLED_ACL= 2024-08-06T20:28:14.1249474Z CI=true 2024-08-06T20:28:14.1249704Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-06T20:28:14.1249984Z JOB_ID=28427732585 2024-08-06T20:28:14.1250233Z INSTALLED_PROTOBUF=yes 2024-08-06T20:28:14.1250510Z GITHUB_HEAD_REF=gh/drisspg/23/head 2024-08-06T20:28:14.1250806Z GITHUB_ACTION_REF= 2024-08-06T20:28:14.1251109Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-06T20:28:14.1251464Z TEST_SHOWLOCALS=False 2024-08-06T20:28:14.1251728Z GITHUB_WORKFLOW=pull 2024-08-06T20:28:14.1251997Z DEBIAN_FRONTEND=noninteractive 2024-08-06T20:28:14.1252634Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1253292Z NO_TD=False 2024-08-06T20:28:14.1253532Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-06T20:28:14.1253805Z _=/usr/bin/env 2024-08-06T20:28:14.1254142Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2024-08-06T20:28:14.1634327Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch 2024-08-06T20:28:14.1635245Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/bin 2024-08-06T20:28:14.1635919Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib 2024-08-06T20:28:14.1636529Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/test 2024-08-06T20:28:14.1637005Z + BUILD_DIR=build 2024-08-06T20:28:14.1637257Z + BUILD_RENAMED_DIR=build_renamed 2024-08-06T20:28:14.1637568Z + BUILD_BIN_DIR=build/bin 2024-08-06T20:28:14.1637862Z + SHARD_NUMBER=1 2024-08-06T20:28:14.1638213Z + NUM_TEST_SHARDS=2 2024-08-06T20:28:14.1638501Z + export VALGRIND=ON 2024-08-06T20:28:14.1638822Z + VALGRIND=ON 2024-08-06T20:28:14.1639071Z + [[ linux-jammy-py3.8-gcc11 == *clang9* ]] 2024-08-06T20:28:14.1639395Z + [[ 0 == \1 ]] 2024-08-06T20:28:14.1639611Z + [[ False == \1 ]] 2024-08-06T20:28:14.1639880Z + [[ linux-jammy-py3.8-gcc11 != *bazel* ]] 2024-08-06T20:28:14.1640227Z ++ realpath build/custom_test_artifacts 2024-08-06T20:28:14.1658226Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2024-08-06T20:28:14.1658815Z + [[ -n '' ]] 2024-08-06T20:28:14.1659299Z + echo 'Environment variables' 2024-08-06T20:28:14.1659616Z Environment variables 2024-08-06T20:28:14.1659855Z + env 2024-08-06T20:28:14.1665842Z INSTALLED_DB=yes 2024-08-06T20:28:14.1666817Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-06T20:28:14.1667627Z CONTINUE_THROUGH_ERROR=False 2024-08-06T20:28:14.1668198Z BUILD_ENVIRONMENT=linux-jammy-py3.8-gcc11 2024-08-06T20:28:14.1668803Z HOSTNAME=c5a57db8914d 2024-08-06T20:28:14.1669859Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1671083Z GITHUB_ACTION=__self 2024-08-06T20:28:14.1671501Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2024-08-06T20:28:14.1672000Z GITHUB_RUN_NUMBER=233985 2024-08-06T20:28:14.1672440Z TEST_CONFIG=distributed 2024-08-06T20:28:14.1672737Z GITHUB_REPOSITORY_OWNER_ID=21003710 2024-08-06T20:28:14.1673083Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2024-08-06T20:28:14.1673497Z GITHUB_TRIGGERING_ACTOR=drisspg 2024-08-06T20:28:14.1673804Z GITHUB_REF_TYPE=branch 2024-08-06T20:28:14.1674063Z TORCH_CUDA_ARCH_LIST=Maxwell 2024-08-06T20:28:14.1674628Z BASE_SHA=1736af7cf736184c356be1bb00f59fb2feea6d7d 2024-08-06T20:28:14.1674994Z XLA_CUDA= 2024-08-06T20:28:14.1675211Z HUGGING_FACE_HUB_TOKEN= 2024-08-06T20:28:14.1675648Z *** 2024-08-06T20:28:14.1675877Z GITHUB_REPOSITORY_ID=65600975 2024-08-06T20:28:14.1676157Z GITHUB_ACTIONS=true 2024-08-06T20:28:14.1676439Z SHA1=b9d86fa89636e301796d4201f36d86c73f6e49bc 2024-08-06T20:28:14.1676829Z GITHUB_SHA=bf5bb5a1585a03379137fab341e87c02c77e76cd 2024-08-06T20:28:14.1677382Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/pull/132710/merge 2024-08-06T20:28:14.1678000Z UCC_HOME=/usr 2024-08-06T20:28:14.1678271Z VERBOSE_TEST_LOGS=False 2024-08-06T20:28:14.1678659Z GITHUB_REF=refs/pull/132710/merge 2024-08-06T20:28:14.1678965Z SHARD_NUMBER=1 2024-08-06T20:28:14.1679219Z GITHUB_REF_PROTECTED=false 2024-08-06T20:28:14.1679487Z HOME=/var/lib/jenkins 2024-08-06T20:28:14.1679788Z GITHUB_API_URL=https://api.github.com 2024-08-06T20:28:14.1680194Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2024-08-06T20:28:14.1680586Z UCX_COMMIT= 2024-08-06T20:28:14.1680829Z SCCACHE_S3_KEY_PREFIX=pull 2024-08-06T20:28:14.1681096Z NUM_TEST_SHARDS=2 2024-08-06T20:28:14.1681338Z UCX_HOME=/usr 2024-08-06T20:28:14.1681967Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1682855Z JOB_NAME=linux-jammy-py3.8-gcc11 / test (distributed, 1, 2, amz2023.linux.2xlarge) 2024-08-06T20:28:14.1683775Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1684609Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2024-08-06T20:28:14.1685262Z GITHUB_EVENT_NAME=pull_request 2024-08-06T20:28:14.1685630Z DASHBOARD_TAG= 2024-08-06T20:28:14.1685875Z GITHUB_RUN_ID=10273124344 2024-08-06T20:28:14.1686540Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1687340Z GITHUB_ACTOR=drisspg 2024-08-06T20:28:14.1687609Z PR_NUMBER=132710 2024-08-06T20:28:14.1687849Z DESIRED_CUDA= 2024-08-06T20:28:14.1688070Z GITHUB_RUN_ATTEMPT=1 2024-08-06T20:28:14.1688346Z VALGRIND=ON 2024-08-06T20:28:14.1688636Z ANACONDA_PYTHON_VERSION=3.8 2024-08-06T20:28:14.1689031Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2024-08-06T20:28:14.1689490Z TERM=xterm 2024-08-06T20:28:14.1689795Z INSTALLED_VISION=yes 2024-08-06T20:28:14.1690054Z BRANCH=pull/132710 2024-08-06T20:28:14.1690394Z OPENSSL_ROOT_DIR=/opt/openssl 2024-08-06T20:28:14.1690680Z CUDA_PATH=/usr/local/cuda 2024-08-06T20:28:14.1691215Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2024-08-06T20:28:14.1691844Z GITHUB_SERVER_URL=https://github.com 2024-08-06T20:28:14.1692158Z UCC_COMMIT= 2024-08-06T20:28:14.1692371Z REENABLED_ISSUES= 2024-08-06T20:28:14.1692883Z DOCS=yes 2024-08-06T20:28:14.1693101Z INSTALLED_ANDROID= 2024-08-06T20:28:14.1693340Z SHLVL=1 2024-08-06T20:28:14.1693554Z MAX_JOBS=6 2024-08-06T20:28:14.1693957Z GITHUB_ACTOR_ID=32754868 2024-08-06T20:28:14.1694333Z GITHUB_WORKFLOW_SHA=bf5bb5a1585a03379137fab341e87c02c77e76cd 2024-08-06T20:28:14.1694746Z GITHUB_REF_NAME=132710/merge 2024-08-06T20:28:14.1695157Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2024-08-06T20:28:14.1695710Z GITHUB_JOB=test 2024-08-06T20:28:14.1695985Z NO_TEST_TIMEOUT=False 2024-08-06T20:28:14.1696234Z TD_DISTRIBUTED=False 2024-08-06T20:28:14.1696512Z GITHUB_REPOSITORY=pytorch/pytorch 2024-08-06T20:28:14.1696827Z GITHUB_RETENTION_DAYS=90 2024-08-06T20:28:14.1697091Z OPENSSL_DIR=/opt/openssl 2024-08-06T20:28:14.1697370Z GITHUB_ACTION_REPOSITORY= 2024-08-06T20:28:14.1698264Z PATH=/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-06T20:28:14.1699106Z GITHUB_BASE_REF=gh/drisspg/23/base 2024-08-06T20:28:14.1699515Z INSTALLED_ACL= 2024-08-06T20:28:14.1699796Z CI=true 2024-08-06T20:28:14.1700053Z GITHUB_REPOSITORY_OWNER=pytorch 2024-08-06T20:28:14.1700469Z JOB_ID=28427732585 2024-08-06T20:28:14.1700716Z INSTALLED_PROTOBUF=yes 2024-08-06T20:28:14.1700981Z GITHUB_HEAD_REF=gh/drisspg/23/head 2024-08-06T20:28:14.1701285Z GITHUB_ACTION_REF= 2024-08-06T20:28:14.1701684Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2024-08-06T20:28:14.1702048Z TEST_SHOWLOCALS=False 2024-08-06T20:28:14.1702314Z GITHUB_WORKFLOW=pull 2024-08-06T20:28:14.1702661Z DEBIAN_FRONTEND=noninteractive 2024-08-06T20:28:14.1703309Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_1917b82e-81b9-4b17-a187-63d6786a04e2 2024-08-06T20:28:14.1703967Z NO_TD=False 2024-08-06T20:28:14.1704208Z SKIP_SCCACHE_INITIALIZATION=1 2024-08-06T20:28:14.1704572Z _=/usr/bin/env 2024-08-06T20:28:14.1704814Z + echo 'Testing pytorch' 2024-08-06T20:28:14.1705129Z Testing pytorch 2024-08-06T20:28:14.1705425Z + export LANG=C.UTF-8 2024-08-06T20:28:14.1705677Z + LANG=C.UTF-8 2024-08-06T20:28:14.1724240Z + PR_NUMBER=132710 2024-08-06T20:28:14.1724686Z + [[ distributed == \d\e\f\a\u\l\t ]] 2024-08-06T20:28:14.1725161Z + [[ distributed == \d\i\s\t\r\i\b\u\t\e\d ]] 2024-08-06T20:28:14.1725810Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-08-06T20:28:14.1726291Z + [[ distributed == \s\l\o\w ]] 2024-08-06T20:28:14.1726697Z + [[ linux-jammy-py3.8-gcc11 == *slow-gradcheck* ]] 2024-08-06T20:28:14.1727143Z + [[ linux-jammy-py3.8-gcc11 == *cuda* ]] 2024-08-06T20:28:14.1727474Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-08-06T20:28:14.1727817Z + [[ linux-jammy-py3.8-gcc11 == *xpu* ]] 2024-08-06T20:28:14.1728147Z + [[ distributed == *crossref* ]] 2024-08-06T20:28:14.1728466Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-08-06T20:28:14.1728811Z + [[ linux-jammy-py3.8-gcc11 == *xpu* ]] 2024-08-06T20:28:14.1730461Z + [[ linux-jammy-py3.8-gcc11 != *-bazel-* ]] 2024-08-06T20:28:14.1730830Z + pip_install --user ninja==1.10.2 2024-08-06T20:28:14.1731326Z + pip install --progress-bar off --user ninja==1.10.2 2024-08-06T20:28:15.5662399Z Collecting ninja==1.10.2 2024-08-06T20:28:15.5831951Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2024-08-06T20:28:15.6452362Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2024-08-06T20:28:16.8735584Z Installing collected packages: ninja 2024-08-06T20:28:16.8833195Z  WARNING: The script ninja is installed in '/var/lib/jenkins/.local/bin' which is not on PATH. 2024-08-06T20:28:16.8834200Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2024-08-06T20:28:16.8885465Z Successfully installed ninja-1.10.2 2024-08-06T20:28:16.9716066Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-06T20:28:16.9717694Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-06T20:28:16.9718784Z + [[ linux-jammy-py3.8-gcc11 == *aarch64* ]] 2024-08-06T20:28:16.9719112Z + install_tlparse 2024-08-06T20:28:16.9719392Z + pip_install --user tlparse==0.3.7 2024-08-06T20:28:16.9719778Z + pip install --progress-bar off --user tlparse==0.3.7 2024-08-06T20:28:17.3904275Z Collecting tlparse==0.3.7 2024-08-06T20:28:17.4060384Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (346 bytes) 2024-08-06T20:28:17.4137725Z Downloading tlparse-0.3.7-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) 2024-08-06T20:28:18.6193266Z Installing collected packages: tlparse 2024-08-06T20:28:18.6592361Z Successfully installed tlparse-0.3.7 2024-08-06T20:28:18.7370030Z ++ python -m site --user-base 2024-08-06T20:28:18.7592683Z + PATH=/var/lib/jenkins/.local/bin:/var/lib/jenkins/.local/bin:/opt/cache/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/opt/conda/envs/py_3.8/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2024-08-06T20:28:18.7593836Z + [[ linux-jammy-py3.8-gcc11 == *asan* ]] 2024-08-06T20:28:18.7594196Z + [[ linux-jammy-py3.8-gcc11 == *-debug* ]] 2024-08-06T20:28:18.7594609Z + [[ linux-jammy-py3.8-gcc11 != *-bazel-* ]] 2024-08-06T20:28:18.7595189Z + echo 'We are not in debug mode: linux-jammy-py3.8-gcc11. Expect the assertion to pass' 2024-08-06T20:28:18.7595933Z We are not in debug mode: linux-jammy-py3.8-gcc11. Expect the assertion to pass 2024-08-06T20:28:18.7596445Z + cd test 2024-08-06T20:28:18.7596797Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2024-08-06T20:28:20.3333737Z + [[ distributed == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2024-08-06T20:28:20.3334230Z + [[ distributed == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2024-08-06T20:28:20.3336155Z + DYNAMO_BENCHMARK_FLAGS=() 2024-08-06T20:28:20.3336765Z + [[ distributed == *dynamo_eager* ]] 2024-08-06T20:28:20.3337384Z + [[ distributed == *aot_eager* ]] 2024-08-06T20:28:20.3337979Z + [[ distributed == *aot_inductor* ]] 2024-08-06T20:28:20.3338585Z + [[ distributed == *inductor* ]] 2024-08-06T20:28:20.3339147Z + [[ distributed == *dynamic* ]] 2024-08-06T20:28:20.3340552Z + [[ distributed == *cpu* ]] 2024-08-06T20:28:20.3341141Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2024-08-06T20:28:20.3360497Z + [[ linux-jammy-py3.8-gcc11 == *libtorch* ]] 2024-08-06T20:28:20.3360925Z + [[ linux-jammy-py3.8-gcc11 == *-bazel-* ]] 2024-08-06T20:28:20.3363286Z + cd test 2024-08-06T20:28:20.3364448Z + python -c 'import torch; print(torch.__config__.show())' 2024-08-06T20:28:21.5632114Z PyTorch built with: 2024-08-06T20:28:21.5632441Z - GCC 11.4 2024-08-06T20:28:21.5632711Z - C++ Version: 201703 2024-08-06T20:28:21.5633384Z - Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-06T20:28:21.5634186Z - Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-06T20:28:21.5634648Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-06T20:28:21.5635059Z - LAPACK is enabled (usually provided by MKL) 2024-08-06T20:28:21.5635411Z - NNPACK is enabled 2024-08-06T20:28:21.5635727Z - CPU capability usage: AVX512 2024-08-06T20:28:21.5641498Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=pedantic -Wno-error=old-style-cast -Wno-missing-braces -fdiagnostics-color=always -faligned-new -Werror -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=2.5.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2024-08-06T20:28:21.5647324Z 2024-08-06T20:28:21.8060557Z + cd test 2024-08-06T20:28:21.8061025Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2024-08-06T20:28:23.0203236Z ATen/Parallel: 2024-08-06T20:28:23.0203585Z at::get_num_threads() : 4 2024-08-06T20:28:23.0203908Z at::get_num_interop_threads() : 4 2024-08-06T20:28:23.0204250Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2024-08-06T20:28:23.0204558Z omp_get_max_threads() : 4 2024-08-06T20:28:23.0205142Z Intel(R) oneAPI Math Kernel Library Version 2021.4-Product Build 20210904 for Intel(R) 64 architecture applications 2024-08-06T20:28:23.0205842Z mkl_get_max_threads() : 4 2024-08-06T20:28:23.0206244Z Intel(R) MKL-DNN v3.4.2 (Git Hash 1137e04ec0b5251ca2b4400a4fd3c667ce843d67) 2024-08-06T20:28:23.0206707Z std::thread::hardware_concurrency() : 8 2024-08-06T20:28:23.0207025Z Environment variables: 2024-08-06T20:28:23.0207302Z OMP_NUM_THREADS : [not set] 2024-08-06T20:28:23.0207594Z MKL_NUM_THREADS : [not set] 2024-08-06T20:28:23.0207874Z ATen parallel backend: OpenMP 2024-08-06T20:28:23.0208075Z 2024-08-06T20:28:23.2308320Z + [[ linux-jammy-py3.8-gcc11 == *aarch64* ]] 2024-08-06T20:28:23.2308876Z + [[ distributed == *backward* ]] 2024-08-06T20:28:23.2309179Z + [[ distributed == *xla* ]] 2024-08-06T20:28:23.2309492Z + [[ distributed == *executorch* ]] 2024-08-06T20:28:23.2309845Z + [[ distributed == \j\i\t\_\l\e\g\a\c\y ]] 2024-08-06T20:28:23.2310187Z + [[ linux-jammy-py3.8-gcc11 == *libtorch* ]] 2024-08-06T20:28:23.2310541Z + [[ distributed == distributed ]] 2024-08-06T20:28:23.2310859Z + test_distributed 2024-08-06T20:28:23.2311122Z + echo 'Testing distributed python tests' 2024-08-06T20:28:23.2311468Z Testing distributed python tests 2024-08-06T20:28:23.2311896Z + python test/run_test.py --distributed-tests --shard 1 2 --verbose 2024-08-06T20:28:23.3497006Z test/run_test.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-08-06T20:28:23.3497749Z import pkg_resources 2024-08-06T20:28:26.8262000Z Downloading https://ossci-metrics.s3.amazonaws.com/slow-tests.json to /var/lib/jenkins/workspace/test/.pytorch-slow-tests.json 2024-08-06T20:28:26.8695998Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-08-06T20:28:26.9077477Z Ignoring disabled issues: [''] 2024-08-06T20:28:26.9189164Z Found test times from artifacts 2024-08-06T20:28:26.9607511Z Found test times from artifacts 2024-08-06T20:28:26.9623719Z Running all tests 2024-08-06T20:28:26.9752402Z Running parallel tests on 3 processes 2024-08-06T20:28:26.9757367Z Name: tests to run (est. time: 60.01min) 2024-08-06T20:28:26.9757913Z Serial tests (99): 2024-08-06T20:28:26.9758295Z distributed/test_c10d_functional_native 1/1 2024-08-06T20:28:26.9758736Z distributed/_tensor/test_dtensor_ops 1/1 2024-08-06T20:28:26.9759495Z distributed/pipelining/test_schedule_multiproc 1/1 2024-08-06T20:28:26.9760236Z distributed/pipelining/test_pipe 1/1 2024-08-06T20:28:26.9760814Z distributed/_tools/test_mem_tracker 1/1 2024-08-06T20:28:26.9761193Z distributed/_tensor/test_experimental_ops 1/1 2024-08-06T20:28:26.9761566Z distributed/_tensor/test_common_rules 1/1 2024-08-06T20:28:26.9761926Z distributed/fsdp/test_fsdp_fx 1/1 2024-08-06T20:28:26.9762575Z distributed/_tensor/experimental/test_register_sharding 1/1 2024-08-06T20:28:26.9763001Z distributed/_tensor/test_api 1/1 2024-08-06T20:28:26.9763342Z distributed/_tensor/test_random_ops 1/1 2024-08-06T20:28:26.9763859Z distributed/_tensor/test_init 1/1 2024-08-06T20:28:26.9764211Z distributed/tensor/parallel/test_tp_style 1/1 2024-08-06T20:28:26.9764640Z distributed/_tensor/debug/test_comm_mode_features 1/1 2024-08-06T20:28:26.9765039Z distributed/_tensor/test_math_ops 1/1 2024-08-06T20:28:26.9765485Z distributed/checkpoint/e2e/test_fsdp_ep 1/1 2024-08-06T20:28:26.9765871Z distributed/optim/test_named_optimizer 1/1 2024-08-06T20:28:26.9766253Z distributed/test_compute_comm_reordering 1/1 2024-08-06T20:28:26.9766615Z distributed/_tensor/test_matrix_ops 1/1 2024-08-06T20:28:26.9766985Z distributed/_composable/test_checkpoint 1/1 2024-08-06T20:28:26.9767372Z distributed/_tools/test_fsdp2_mem_tracker 1/1 2024-08-06T20:28:26.9767739Z distributed/_tensor/test_redistribute 1/1 2024-08-06T20:28:26.9768117Z distributed/_tensor/test_pointwise_ops 1/1 2024-08-06T20:28:26.9768496Z distributed/checkpoint/test_save_load_api 1/1 2024-08-06T20:28:26.9768882Z distributed/checkpoint/test_tp_checkpoint 1/1 2024-08-06T20:28:26.9769299Z distributed/_tensor/experimental/test_local_map 1/1 2024-08-06T20:28:26.9769712Z distributed/checkpoint/test_format_utils 1/1 2024-08-06T20:28:26.9770081Z distributed/test_dynamo_distributed 1/1 2024-08-06T20:28:26.9770443Z distributed/_tools/test_memory_tracker 1/1 2024-08-06T20:28:26.9770848Z distributed/checkpoint/test_dtensor_resharding 1/1 2024-08-06T20:28:26.9771287Z distributed/_composable/fsdp/test_fully_shard_state 1/1 2024-08-06T20:28:26.9771750Z distributed/tensor/parallel/test_tp_random_state 1/1 2024-08-06T20:28:26.9772188Z distributed/checkpoint/test_fsdp_optim_state 1/1 2024-08-06T20:28:26.9772611Z distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 2024-08-06T20:28:26.9773086Z distributed/_composable/fsdp/test_fully_shard_logging 1/1 2024-08-06T20:28:26.9773572Z distributed/_composable/fsdp/test_fully_shard_overlap 1/1 2024-08-06T20:28:26.9774047Z distributed/_composable/fsdp/test_fully_shard_compile 1/1 2024-08-06T20:28:26.9774684Z distributed/_tensor/test_embedding_ops 1/1 2024-08-06T20:28:26.9775060Z distributed/pipelining/test_schedule 1/1 2024-08-06T20:28:26.9775497Z distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 2024-08-06T20:28:26.9775944Z distributed/_tensor/test_view_ops 1/1 2024-08-06T20:28:26.9776345Z distributed/tensor/parallel/test_parallelize_api 1/1 2024-08-06T20:28:26.9776744Z distributed/test_control_collectives 1/1 2024-08-06T20:28:26.9777158Z distributed/optim/test_apply_optimizer_in_backward 1/1 2024-08-06T20:28:26.9777603Z distributed/checkpoint/test_state_dict_utils 1/1 2024-08-06T20:28:26.9778028Z distributed/tensor/parallel/test_fsdp_2d_parallel 1/1 2024-08-06T20:28:26.9778446Z distributed/_tensor/test_optimizers 1/1 2024-08-06T20:28:26.9778800Z distributed/fsdp/test_shard_utils 1/1 2024-08-06T20:28:26.9779148Z distributed/_tensor/debug/test_comm_mode 1/1 2024-08-06T20:28:26.9779618Z distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ 1/1 2024-08-06T20:28:26.9780071Z distributed/test_functional_api 1/1 2024-08-06T20:28:26.9780437Z distributed/checkpoint/test_fsdp_model_state 1/1 2024-08-06T20:28:26.9780916Z distributed/_composable/fully_shard/test_fully_shard_compile 1/1 2024-08-06T20:28:26.9781378Z distributed/_composable/test_replicate 1/1 2024-08-06T20:28:26.9781858Z distributed/_composable/fully_shard/test_fully_shard_mixed_precision 1/1 2024-08-06T20:28:26.9782343Z distributed/_tensor/test_utils 1/1 2024-08-06T20:28:26.9782680Z distributed/fsdp/test_fsdp_core 1/1 2024-08-06T20:28:26.9783018Z distributed/test_distributed_spawn 2/3 2024-08-06T20:28:26.9783405Z distributed/fsdp/test_fsdp_backward_prefetch 1/1 2024-08-06T20:28:26.9784066Z distributed/_composable/fully_shard/test_fully_shard_model_checkpoint 1/1 2024-08-06T20:28:26.9784600Z distributed/optim/test_zero_redundancy_optimizer 1/1 2024-08-06T20:28:26.9785107Z distributed/fsdp/test_fsdp_flatten_params 1/1 2024-08-06T20:28:26.9785541Z distributed/checkpoint/test_file_system_checkpoint 1/1 2024-08-06T20:28:26.9785949Z distributed/checkpoint/test_state_dict 1/1 2024-08-06T20:28:26.9786396Z distributed/_composable/fully_shard/test_fully_shard_init 1/1 2024-08-06T20:28:26.9786862Z distributed/fsdp/test_checkpoint_wrapper 1/1 2024-08-06T20:28:26.9787254Z distributed/fsdp/test_fsdp_clip_grad_norm 1/1 2024-08-06T20:28:26.9787604Z distributed/test_c10d_logger 1/1 2024-08-06T20:28:26.9787940Z distributed/fsdp/test_fsdp_grad_acc 1/1 2024-08-06T20:28:26.9788299Z distributed/fsdp/test_fsdp_unshard_params 1/1 2024-08-06T20:28:26.9788675Z distributed/nn/jit/test_instantiator 1/1 2024-08-06T20:28:26.9789081Z distributed/_composable/fsdp/test_fully_shard_comm 1/1 2024-08-06T20:28:26.9789491Z distributed/fsdp/test_fsdp_overlap 1/1 2024-08-06T20:28:26.9789892Z distributed/_composable/test_replicate_with_compiler 1/1 2024-08-06T20:28:26.9790323Z distributed/fsdp/test_fsdp_hybrid_shard 1/1 2024-08-06T20:28:26.9790766Z distributed/_composable/fsdp/test_fully_shard_extensions 1/1 2024-08-06T20:28:26.9791225Z distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1 2024-08-06T20:28:26.9791646Z distributed/fsdp/test_fsdp_freezing_weights 1/1 2024-08-06T20:28:26.9792063Z distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 2024-08-06T20:28:26.9792454Z distributed/test_c10d_object_collectives 1/1 2024-08-06T20:28:26.9792848Z distributed/fsdp/test_fsdp_use_orig_params 1/1 2024-08-06T20:28:26.9793286Z distributed/_shard/sharding_spec/test_sharding_spec 1/1 2024-08-06T20:28:26.9793680Z distributed/fsdp/test_utils 1/1 2024-08-06T20:28:26.9794009Z distributed/fsdp/test_fsdp_meta 1/1 2024-08-06T20:28:26.9794459Z distributed/algorithms/quantization/test_quantization 1/1 2024-08-06T20:28:26.9794886Z distributed/fsdp/test_wrap 1/1 2024-08-06T20:28:26.9795204Z distributed/algorithms/test_join 1/1 2024-08-06T20:28:26.9795572Z distributed/fsdp/test_fsdp_checkpoint 1/1 2024-08-06T20:28:26.9795945Z distributed/fsdp/test_fsdp_fine_tune 1/1 2024-08-06T20:28:26.9796284Z distributed/_shard/test_sharder 1/1 2024-08-06T20:28:26.9796655Z distributed/fsdp/test_fsdp_exec_order 1/1 2024-08-06T20:28:26.9797075Z distributed/_shard/sharding_plan/test_sharding_plan 1/1 2024-08-06T20:28:26.9797487Z distributed/rpc/test_tensorpipe_agent 1/3 2024-08-06T20:28:26.9797862Z distributed/rpc/test_tensorpipe_agent 3/3 2024-08-06T20:28:26.9798216Z distributed/test_c10d_ucc 1/1 2024-08-06T20:28:26.9798592Z distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1 2024-08-06T20:28:26.9799082Z distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 2024-08-06T20:28:26.9799497Z distributed/test_c10d_gloo 1/1 2024-08-06T20:28:26.9799814Z distributed/test_c10d_ops_nccl 1/1 2024-08-06T20:28:26.9800135Z Parallel tests (0): 2024-08-06T20:28:26.9800405Z Name: excluded (est. time: 0.0min) 2024-08-06T20:28:26.9800704Z Serial tests (0): 2024-08-06T20:28:26.9800956Z Parallel tests (0): 2024-08-06T20:28:26.9801339Z Starting test batch 'tests to run' 0.0 seconds after initiating testing 2024-08-06T20:28:26.9998319Z Running distributed/test_c10d_functional_native 1/1 ... [2024-08-06 20:28:26.999319] 2024-08-06T20:28:27.0003580Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_functional_native.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:28:26.999948] 2024-08-06T20:28:30.2774726Z 2024-08-06T20:28:30.2776348Z distributed/test_c10d_functional_native 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_functional_native_1.1_c6bd6ebd46f3e6e2_.log 2024-08-06T20:28:30.2788384Z Running 25 items in this shard: test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_gather_into_tensor_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_gather_into_tensor_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_coalesced_, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_reduce_single_, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_all_to_all_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_broadcast, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_inductor_dtypeview_memory_leak, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_py_work, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_reduce_scatter_tensor_single, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_threading, test/distributed/test_c10d_functional_native.py::TestWithNCCL::test_unwaited, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_gather_into_tensor_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_gather_into_tensor_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_reduce_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_all_to_all_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_broadcast, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_inplace_op_on_view, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reduce_scatter_tensor_single, test/distributed/test_c10d_functional_native.py::CompileTest::test_inductor_reuse_buffer_after_inplace_collective, test/distributed/test_c10d_functional_native.py::CompileTest::test_ranks_and_tag 2024-08-06T20:28:30.2799437Z 2024-08-06T20:28:30.2799719Z Running distributed/_tensor/test_dtensor_ops 1/1 ... [2024-08-06 20:28:30.278152] 2024-08-06T20:28:30.2801106Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_dtensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:28:30.278581] 2024-08-06T20:29:47.7556774Z 2024-08-06T20:29:47.7558005Z distributed/_tensor/test_dtensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_dtensor_ops_1.1_d6e3c12edb33f40a_.log 2024-08-06T20:29:47.8139638Z Running 667 items in this shard: test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_H_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_T_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___getitem___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___radd___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rdiv___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmatmul___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmod___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rmul___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rpow___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db___rsub___cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__batch_norm_with_update_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__chunk_cat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__native_batch_norm_legit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__segment_reduce_lengths_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__segment_reduce_offsets_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__softmax_backward_data_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__unsafe_masked_index_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__unsafe_masked_index_put_accumulate_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db__upsample_bilinear2d_aa_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_abs_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_acos_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_acosh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addbmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addcdiv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addcmul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmm_decomposed_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addmv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_addr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_alias_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_all_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_allclose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_aminmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_angle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_any_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_arange_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argsort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_argwhere_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_partial_views_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_as_strided_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_asin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_asinh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atan2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_atleast_3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_baddbmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bernoulli_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bfloat16_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_block_diag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bool_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_shapes_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_broadcast_to_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_bucketize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_byte_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cartesian_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cauchy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cdist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cdouble_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ceil_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cfloat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_chalf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_char_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_inverse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cholesky_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_chunk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_max_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clamp_min_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_clone_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_column_stack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_combinations_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_complex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_conj_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_conj_physical_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_constant_pad_nd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_contiguous_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_copysign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_corrcoef_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cos_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cosh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_count_nonzero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cov_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cross_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cummax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cummin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumprod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_cumulative_trapezoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_deg2rad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diag_embed_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagflat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diagonal_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_diff_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_digamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_floor_rounding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_no_rounding_mode_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_div_trunc_rounding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_double_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_dstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_einsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_permuted_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_empty_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_eq_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_equal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erfc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_erfinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exp2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expand_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_expm1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_exponential_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_eye_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_fftshift_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_hfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ifftshift_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_ihfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_irfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfft2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fft_rfftn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flatten_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flip_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fliplr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_flipud_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_float_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_float_power_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_floor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_floor_divide_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_fmod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_frac_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_frexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_full_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_full_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gather_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ge_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_geometric_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_geqrf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gradient_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_grid_sampler_2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_gt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_half_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_heaviside_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histogram_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_histogramdd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_hypot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_i0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_igamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_igammac_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_put_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_reduce_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_index_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_inner_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_int_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isclose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isfinite_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isinf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isnan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isneginf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isposinf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_isreal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_item_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_2inputs_2outputs_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_4inputs_with_extra_args_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_binary_return_by_ref_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_jiterator_unary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_kron_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_kthvalue_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ldexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_le_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lerp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lgamma_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cholesky_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cholesky_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cond_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_cross_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_det_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_det_singular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_diagonal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eig_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigvals_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_eigvalsh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_householder_product_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_inv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_inv_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_factor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_factor_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_ldl_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lstsq_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lstsq_grad_oriented_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_factor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_factor_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_lu_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_power_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_rank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_matrix_rank_hermitian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_multi_dot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_norm_subgradients_at_zero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_hermitian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_pinv_singular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_qr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_slogdet_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_ex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_solve_triangular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_svd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_svdvals_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_tensorinv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_tensorsolve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vander_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vecdot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linalg_vector_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linspace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_linspace_tensor_overload_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log10_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log1p_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_normal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_log_softmax_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logaddexp2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logaddexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logcumsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logdet_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_and_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_not_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_or_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logical_xor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logspace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logspace_tensor_overload_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_logsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_long_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_lu_unpack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mH_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mT_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_argmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_argmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_cumprod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_cumsum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_fill_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_log_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_logaddexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_logsumexp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_median_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_normalize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_softmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_std_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_masked_var_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_matmul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_matrix_exp_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_pool2d_with_indices_backward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_reduction_no_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_max_reduction_with_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_maximum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_median_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_meshgrid_list_of_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_meshgrid_variadic_tensors_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_binary_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_reduction_no_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_min_reduction_with_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_minimum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mode_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_movedim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_msort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mul_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_multinomial_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mv_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_mvlgamma_mvlgamma_p_5_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nan_to_num_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanmean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanmedian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nanquantile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nansum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_narrow_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_narrow_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_batch_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_dropout_backward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_native_layer_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ne_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_neg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_empty_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_empty_strided_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_full_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_ones_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_new_zeros_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nextafter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_avg_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_adaptive_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_alpha_dropout_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_avg_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_batch_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_binary_cross_entropy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_binary_cross_entropy_with_logits_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_celu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_channel_shuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_conv_transpose3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cosine_embedding_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cosine_similarity_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_cross_entropy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_ctc_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_dropout_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_elu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_embedding_bag_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_embedding_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_feature_alpha_dropout_with_train_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_feature_alpha_dropout_without_train_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_fractional_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_fractional_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_gaussian_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_gelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_glu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_grid_sample_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_group_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardsigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardswish_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hardtanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_hinge_embedding_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_huber_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_instance_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_area_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_bicubic_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_linear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_nearest-exact_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_nearest_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_interpolate_trilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_kl_div_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_l1_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_layer_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_leaky_relu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_linear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_local_response_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_logsigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_margin_ranking_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_pool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool1d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool1d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool2d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool2d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool3d_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_max_unpool3d_grad_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_mish_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_mse_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multi_head_attention_forward_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multi_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multilabel_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_multilabel_soft_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_normalize_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_circular_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_constant_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_reflect_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_replicate_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pad_replicate_negative_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pairwise_distance_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pdist_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pixel_shuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_pixel_unshuffle_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_poisson_nll_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_prelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_relu6_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_relu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_rms_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_rrelu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_scaled_dot_product_attention_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_selu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_silu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_smooth_l1_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_soft_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softmin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softmin_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softplus_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_softsign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_tanhshrink_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_threshold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_triplet_margin_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_triplet_margin_with_distance_loss_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_unfold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_upsample_bilinear_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nn_functional_upsample_nearest_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nonzero_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_nonzero_static_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_fro_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_inf_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_norm_nuc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_in_place_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_normal_number_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ones_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ones_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ormqr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_outer_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pca_lowrank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_permute_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pinverse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polar_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_2_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_polygamma_polygamma_n_4_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_positive_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_pow_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_put_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_qr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_quantile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rad2deg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rand_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randint_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randint_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_randn_like_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_ravel_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_real_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reciprocal_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_remainder_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_renorm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_repeat_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_repeat_interleave_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reshape_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_reshape_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resize__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resize_as__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resolve_conj_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_resolve_neg_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_roll_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rot90_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_round_decimals_neg_3_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rsqrt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_rsub_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scalar_tensor_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_add_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_amax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_amin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_prod_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_scatter_reduce_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_searchsorted_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_select_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_select_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sgn_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_short_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sigmoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sign_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_bartlett_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_blackman_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_cosine_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_exponential_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_gaussian_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_general_cosine_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_general_hamming_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_hamming_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_hann_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_kaiser_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signal_windows_nuttall_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_signbit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sin_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sinc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sinh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_slice_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_slice_scatter_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_softmax_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_softmax_with_dtype_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sort_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sparse_mm_reduce_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sparse_sampled_addmm_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_airy_ai_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_j0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_j1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_y0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_bessel_y1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_u_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_v_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_chebyshev_polynomial_w_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_entr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_erfcx_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_hermite_polynomial_h_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_hermite_polynomial_he_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i0e_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_i1e_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_laguerre_polynomial_l_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_legendre_polynomial_p_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_log_ndtr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_i0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_i1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_k0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_modified_bessel_k1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_ndtr_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_ndtri_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_polygamma_special_polygamma_n_0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_scaled_modified_bessel_k0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_scaled_modified_bessel_k1_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_u_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_v_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_shifted_chebyshev_polynomial_w_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_spherical_bessel_j0_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_xlog1py_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_special_zeta_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_list_args_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_with_sizes_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_split_with_sizes_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sqrt_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_square_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_squeeze_multiple_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_stack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_mean_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_std_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_stft_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sub_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sum_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_sum_to_size_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_svd_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_svd_lowrank_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_t_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_t_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_take_along_dim_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_take_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tan_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tanh_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tensor_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tensordot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tile_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_to_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_to_sparse_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_topk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_torch_ops_aten__safe_softmax_default_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trace_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_transpose_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trapezoid_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trapz_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_triangular_solve_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_tril_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_triu_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_true_divide_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_trunc_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unbind_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unflatten_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unfold_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unfold_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_uniform_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unique_consecutive_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unique_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsafe_chunk_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsafe_split_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsqueeze_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_unsqueeze_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_mean_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_mean_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_var_unbiased_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vdot_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_as_complex_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_as_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_copy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_view_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vsplit_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_vstack_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_where_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_xlogy_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zero__cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zeros_cpu_float32, test/distributed/_tensor/test_dtensor_ops.py::TestDTensorOpsCPU::test_dtensor_op_db_zeros_like_cpu_float32 2024-08-06T20:29:47.8451687Z 2024-08-06T20:29:47.8468431Z Running distributed/pipelining/test_schedule_multiproc 1/1 ... [2024-08-06 20:29:47.846618] 2024-08-06T20:29:47.8473051Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/pipelining/test_schedule_multiproc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:29:47.847080] 2024-08-06T20:29:51.0269988Z 2024-08-06T20:29:51.0271187Z distributed/pipelining/test_schedule_multiproc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_schedule_multiproc_1.1_6d79f23de6e8e40c_.log 2024-08-06T20:29:51.0272138Z 2024-08-06T20:29:51.0276201Z Running distributed/pipelining/test_pipe 1/1 ... [2024-08-06 20:29:51.027416] 2024-08-06T20:29:51.0280917Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/pipelining/test_pipe.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:29:51.027877] 2024-08-06T20:29:55.1043496Z 2024-08-06T20:29:55.1044756Z distributed/pipelining/test_pipe 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_pipe_1.1_a89fb196fb13e145_.log 2024-08-06T20:29:55.1046826Z Running 3 items in this shard: test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass0, test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass1, test/distributed/pipelining/test_pipe.py::PipeTests::test_model_split_ModelClass2 2024-08-06T20:29:55.1048097Z 2024-08-06T20:29:55.1051008Z Running distributed/_tools/test_mem_tracker 1/1 ... [2024-08-06 20:29:55.104890] 2024-08-06T20:29:55.1055799Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tools/test_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:29:55.105325] 2024-08-06T20:29:58.0301516Z 2024-08-06T20:29:58.0303265Z distributed/_tools/test_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_mem_tracker_1.1_415c2e5e0cffb81c_.log 2024-08-06T20:29:58.0307207Z Running 3 items in this shard: test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_cuda_tracker_equivalence, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_attribution, test/distributed/_tools/test_mem_tracker.py::TestMemTracker::test_tracker_with_activation_checkpointing 2024-08-06T20:29:58.0309683Z 2024-08-06T20:29:58.0311425Z Running distributed/_tensor/test_experimental_ops 1/1 ... [2024-08-06 20:29:58.030913] 2024-08-06T20:29:58.0317245Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_experimental_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:29:58.031452] 2024-08-06T20:30:08.8690996Z 2024-08-06T20:30:08.8692689Z distributed/_tensor/test_experimental_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_experimental_ops_1.1_43203dacc9acba0e_.log 2024-08-06T20:30:08.8694857Z Running 3 items in this shard: test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_bernoulli, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_nll, test/distributed/_tensor/test_experimental_ops.py::DistOtherOpsTest::test_slice 2024-08-06T20:30:08.8696247Z 2024-08-06T20:30:08.8698438Z Running distributed/_tensor/test_common_rules 1/1 ... [2024-08-06 20:30:08.869547] 2024-08-06T20:30:08.8704243Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_common_rules.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:30:08.870058] 2024-08-06T20:30:40.2616965Z 2024-08-06T20:30:40.2618142Z distributed/_tensor/test_common_rules 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_common_rules_1.1_862950ab468c6662_.log 2024-08-06T20:30:40.2623559Z Running 10 items in this shard: test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_basic_propagation, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_errors, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_linearity, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_merge_sharding, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_multi_sharding_on_mesh_dim, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_einop_pointwise_propagation, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_enforce_sharding_multi_sharding_on_mesh_dim, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_multi_sharding_on_mesh_dim, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_rules_broadcasting, test/distributed/_tensor/test_common_rules.py::CommonRulesTest::test_pointwise_rules_suggestion 2024-08-06T20:30:40.2628019Z 2024-08-06T20:30:40.2628316Z Running distributed/fsdp/test_fsdp_fx 1/1 ... [2024-08-06 20:30:40.262082] 2024-08-06T20:30:40.2629671Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fx.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:30:40.262539] 2024-08-06T20:30:43.1372246Z 2024-08-06T20:30:43.1373349Z distributed/fsdp/test_fsdp_fx 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_3632c351ed8e9131_.log 2024-08-06T20:30:43.1387296Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_fx.py::TestSymbolicTracing::test_symbolic_tracing_outputs 2024-08-06T20:30:43.1387893Z 2024-08-06T20:30:43.1388259Z Running distributed/_tensor/experimental/test_register_sharding 1/1 ... [2024-08-06 20:30:43.137720] 2024-08-06T20:30:43.1389745Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/experimental/test_register_sharding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:30:43.138139] 2024-08-06T20:30:52.2254124Z 2024-08-06T20:30:52.2255648Z distributed/_tensor/experimental/test_register_sharding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_register_sharding_1.1_3beb8a2413620e4f_.log 2024-08-06T20:30:52.2257683Z Running 2 items in this shard: test/distributed/_tensor/experimental/test_register_sharding.py::TestRegisterSharding::test_argmax, test/distributed/_tensor/experimental/test_register_sharding.py::TestRegisterSharding::test_softmax_fwd 2024-08-06T20:30:52.2258792Z 2024-08-06T20:30:52.2260328Z Running distributed/_tensor/test_api 1/1 ... [2024-08-06 20:30:52.225845] 2024-08-06T20:30:52.2265460Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:30:52.226284] 2024-08-06T20:31:17.3478433Z 2024-08-06T20:31:17.3479724Z distributed/_tensor/test_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_api_1.1_0b2970b17ea9095e_.log 2024-08-06T20:31:17.3483820Z Running 8 items in this shard: test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_casting, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_input_fn_output_fn_warning, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_module_meta, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_errors, test/distributed/_tensor/test_api.py::DTensorAPITest::test_distribute_tensor_uneven_sharding 2024-08-06T20:31:17.3487634Z 2024-08-06T20:31:17.3487924Z Running distributed/_tensor/test_random_ops 1/1 ... [2024-08-06 20:31:17.348354] 2024-08-06T20:31:17.3490644Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_random_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:31:17.348798] 2024-08-06T20:31:39.6655186Z 2024-08-06T20:31:39.6656351Z distributed/_tensor/test_random_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_random_ops_1.1_273d7b1875f94d0e_.log 2024-08-06T20:31:39.6660351Z Running 7 items in this shard: test/distributed/_tensor/test_random_ops.py::DistTensorRandomInitTest::test_init_ops, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_dropout_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_rand_1d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_deterministic_uniform_2d, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_manual_seed, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_meta_tensor_init, test/distributed/_tensor/test_random_ops.py::DistTensorRandomOpTest::test_rng_tracker_init 2024-08-06T20:31:39.6663556Z 2024-08-06T20:31:39.6663863Z Running distributed/_tensor/test_init 1/1 ... [2024-08-06 20:31:39.665993] 2024-08-06T20:31:39.6666462Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:31:39.666429] 2024-08-06T20:32:02.3825962Z 2024-08-06T20:32:02.3827230Z distributed/_tensor/test_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_init_1.1_197da0a6f20284be_.log 2024-08-06T20:32:02.3830378Z Running 7 items in this shard: test/distributed/_tensor/test_init.py::DTensorInitOpsTest::test_init_ops, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_empty, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_full, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_ones, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros_full_mesh, test/distributed/_tensor/test_init.py::DTensorConstructorTest::test_zeros_submesh 2024-08-06T20:32:02.3832986Z 2024-08-06T20:32:02.3833299Z Running distributed/tensor/parallel/test_tp_style 1/1 ... [2024-08-06 20:32:02.383055] 2024-08-06T20:32:02.3836982Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_style.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:32:02.383482] 2024-08-06T20:32:31.3614840Z 2024-08-06T20:32:31.3617049Z distributed/tensor/parallel/test_tp_style 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_style_1.1_2290aaa44ce9c7ec_.log 2024-08-06T20:32:31.3627329Z Running 9 items in this shard: test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_colwise_parallel_embedding, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_colwise_parallel_style, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_input, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_input_multiple_inputs, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_kwargs_input, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_prepare_module_output, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_rowwise_parallel_embedding, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_rowwise_parallel_style, test/distributed/tensor/parallel/test_tp_style.py::TensorParallelStyleTest::test_sequence_parallel_style 2024-08-06T20:32:31.3634872Z 2024-08-06T20:32:31.3635367Z Running distributed/_tensor/debug/test_comm_mode_features 1/1 ... [2024-08-06 20:32:31.362278] 2024-08-06T20:32:31.3637319Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/debug/test_comm_mode_features.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:32:31.362845] 2024-08-06T20:32:45.4110594Z 2024-08-06T20:32:45.4111790Z distributed/_tensor/debug/test_comm_mode_features 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_comm_mode_features_1.1_feb54f6e469760ac_.log 2024-08-06T20:32:45.4114809Z Running 4 items in this shard: test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLPStacked_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_distributed_sharding_display, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_MLP_module_tracing, test/distributed/_tensor/debug/test_comm_mode_features.py::TestCommModeFeatures::test_transformer_module_tracing 2024-08-06T20:32:45.4117344Z 2024-08-06T20:32:45.4117660Z Running distributed/_tensor/test_math_ops 1/1 ... [2024-08-06 20:32:45.411591] 2024-08-06T20:32:45.4122562Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_math_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:32:45.412038] 2024-08-06T20:33:21.8055751Z 2024-08-06T20:33:21.8056884Z distributed/_tensor/test_math_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_math_ops_1.1_11bfb2741fe4c24c_.log 2024-08-06T20:33:21.8062034Z Running 11 items in this shard: test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_foreach_norm, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_layer_norm_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_linear_op_reductions, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_mean, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_nll_loss_and_cross_entropy, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard0_svd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_shard_math_ops, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_fwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_softmax_with_bwd, test/distributed/_tensor/test_math_ops.py::DistMathOpsTest::test_topk 2024-08-06T20:33:21.8066245Z 2024-08-06T20:33:21.8066617Z Running distributed/checkpoint/e2e/test_fsdp_ep 1/1 ... [2024-08-06 20:33:21.806031] 2024-08-06T20:33:21.8068319Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/e2e/test_fsdp_ep.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:33:21.806457] 2024-08-06T20:33:24.6810464Z 2024-08-06T20:33:24.6811556Z distributed/checkpoint/e2e/test_fsdp_ep 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_56d102369b7f7dcd_.log 2024-08-06T20:33:24.6812829Z Running 1 items in this shard: test/distributed/checkpoint/e2e/test_fsdp_ep.py::TestFSDPWithEP::test_e2e 2024-08-06T20:33:24.6813317Z 2024-08-06T20:33:24.6816758Z Running distributed/optim/test_named_optimizer 1/1 ... [2024-08-06 20:33:24.681490] 2024-08-06T20:33:24.6821146Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/optim/test_named_optimizer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:33:24.681906] 2024-08-06T20:33:26.7668218Z 2024-08-06T20:33:26.7669331Z distributed/optim/test_named_optimizer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_named_optimizer_1.1_0f770f34e510b94a_.log 2024-08-06T20:33:26.7670182Z 2024-08-06T20:33:26.7673813Z Running distributed/test_compute_comm_reordering 1/1 ... [2024-08-06 20:33:26.767213] 2024-08-06T20:33:26.7678608Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_compute_comm_reordering.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:33:26.767645] 2024-08-06T20:33:29.6423853Z 2024-08-06T20:33:29.6425073Z distributed/test_compute_comm_reordering 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_compute_comm_reordering_1.1_8f649c69de62f40b_.log 2024-08-06T20:33:29.6430233Z Running 7 items in this shard: test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_grouped_scheduler_node, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_nccl_heuristics, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_raise_comms, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_reorder_compute_for_overlap, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_reorder_compute_for_overlap_custom_runtime_estimation, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_sink_waits, test/distributed/test_compute_comm_reordering.py::TestComputeCommReorderingMultiProc::test_sink_waits_raise_comms 2024-08-06T20:33:29.6434489Z 2024-08-06T20:33:29.6434774Z Running distributed/_tensor/test_matrix_ops 1/1 ... [2024-08-06 20:33:29.642649] 2024-08-06T20:33:29.6436051Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_matrix_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:33:29.643096] 2024-08-06T20:33:57.9712639Z 2024-08-06T20:33:57.9714307Z distributed/_tensor/test_matrix_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_matrix_ops_1.1_0b47d8e320d30f5f_.log 2024-08-06T20:33:57.9726669Z Running 9 items in this shard: test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_auto_redistribute, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_addmm_empty_operand, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_baddbmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_bmm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_mm, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_scaled_dot_product_attention, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t, test/distributed/_tensor/test_matrix_ops.py::DistMatrixOpsTest::test_t_partial 2024-08-06T20:33:57.9731960Z 2024-08-06T20:33:57.9732380Z Running distributed/_composable/test_checkpoint 1/1 ... [2024-08-06 20:33:57.971914] 2024-08-06T20:33:57.9734280Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/test_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:33:57.972430] 2024-08-06T20:34:00.8974365Z 2024-08-06T20:34:00.8976238Z distributed/_composable/test_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_checkpoint_1.1_3cb3fdaa995547bb_.log 2024-08-06T20:34:00.8982160Z Running 6 items in this shard: test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_checkpoint_kwargs, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_clears_state_on_error_in_forward, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_multi_args, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_random_cpu, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_tensor_only_cpu, test/distributed/_composable/test_checkpoint.py::TestCheckpoint::test_tensor_only_gpu 2024-08-06T20:34:00.8986541Z 2024-08-06T20:34:00.8987003Z Running distributed/_tools/test_fsdp2_mem_tracker 1/1 ... [2024-08-06 20:34:00.898168] 2024-08-06T20:34:00.8990110Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tools/test_fsdp2_mem_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:34:00.898721] 2024-08-06T20:34:03.8235307Z 2024-08-06T20:34:03.8236563Z distributed/_tools/test_fsdp2_mem_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_fsdp2_mem_tracker_1.1_54175da6201777f7_.log 2024-08-06T20:34:03.8239178Z Running 3 items in this shard: test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCore::test_tracker_multi_group_eager, test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCore::test_tracker_non_root_forward_backward, test/distributed/_tools/test_fsdp2_mem_tracker.py::TestTrackerFullyShard1DTrainingCompose::test_tracker_with_activation_checkpointing 2024-08-06T20:34:03.8241261Z 2024-08-06T20:34:03.8241608Z Running distributed/_tensor/test_redistribute 1/1 ... [2024-08-06 20:34:03.823989] 2024-08-06T20:34:03.8246826Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_redistribute.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:34:03.824439] 2024-08-06T20:34:43.6268750Z 2024-08-06T20:34:43.6270052Z distributed/_tensor/test_redistribute 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_redistribute_1.1_6f6833e6c0154c05_.log 2024-08-06T20:34:43.6276927Z Running 12 items in this shard: test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_partial_to_shard, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_negative_shard_dim, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_shard_dim_change, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_redistribute_uneven_sharding, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_local_partial_grad, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_partial, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_replicate_to_shard_forward_backward, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_shard_dim_alltoall, test/distributed/_tensor/test_redistribute.py::RedistributeTest::test_shard_to_replicate_forward_backward, test/distributed/_tensor/test_redistribute.py::MultiDimRedistributeTest::test_multi_dim_mesh 2024-08-06T20:34:43.6283320Z 2024-08-06T20:34:43.6283599Z Running distributed/_tensor/test_pointwise_ops 1/1 ... [2024-08-06 20:34:43.627441] 2024-08-06T20:34:43.6284927Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_pointwise_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:34:43.627928] 2024-08-06T20:34:46.6026830Z 2024-08-06T20:34:46.6027934Z distributed/_tensor/test_pointwise_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_pointwise_ops_1.1_06a1239f99f90b29_.log 2024-08-06T20:34:46.6031598Z Running 7 items in this shard: test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_activations, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_backward, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_dropout_errors, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_mul_out, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_add, test/distributed/_tensor/test_pointwise_ops.py::DistElementwiseOpsTest::test_partial_mul 2024-08-06T20:34:46.6034616Z 2024-08-06T20:34:46.6034911Z Running distributed/checkpoint/test_save_load_api 1/1 ... [2024-08-06 20:34:46.603131] 2024-08-06T20:34:46.6038479Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_save_load_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:34:46.603581] 2024-08-06T20:34:52.1830372Z 2024-08-06T20:34:52.1831794Z distributed/checkpoint/test_save_load_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_save_load_api_1.1_0e4292288d64f9d2_.log 2024-08-06T20:34:52.1833152Z Running 1 items in this shard: test/distributed/checkpoint/test_save_load_api.py::TestSaveAndLoadAPI::test_auto_detect 2024-08-06T20:34:52.1833717Z 2024-08-06T20:34:52.1837164Z Running distributed/checkpoint/test_tp_checkpoint 1/1 ... [2024-08-06 20:34:52.183513] 2024-08-06T20:34:52.1841871Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_tp_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:34:52.183942] 2024-08-06T20:35:00.7718568Z 2024-08-06T20:35:00.7720432Z distributed/checkpoint/test_tp_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_tp_checkpoint_1.1_4c19e3b46de881c9_.log 2024-08-06T20:35:00.7723666Z Running 2 items in this shard: test/distributed/checkpoint/test_tp_checkpoint.py::TestTpCheckpoint::test_tp_checkpoint, test/distributed/checkpoint/test_tp_checkpoint.py::TestTpCheckpoint::test_tp_checkpoint_load_on_meta_device 2024-08-06T20:35:00.7725647Z 2024-08-06T20:35:00.7726568Z Running distributed/_tensor/experimental/test_local_map 1/1 ... [2024-08-06 20:35:00.772265] 2024-08-06T20:35:00.7731984Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/experimental/test_local_map.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:35:00.772847] 2024-08-06T20:35:14.2650172Z 2024-08-06T20:35:14.2651556Z distributed/_tensor/experimental/test_local_map 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.experimental.test_local_map_1.1_0188ea2942f2ab03_.log 2024-08-06T20:35:14.2654799Z Running 4 items in this shard: test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_correctness, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_in_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_out_placements, test/distributed/_tensor/experimental/test_local_map.py::TestLocalMap::test_local_map_redistribute 2024-08-06T20:35:14.2657112Z 2024-08-06T20:35:14.2657415Z Running distributed/checkpoint/test_format_utils 1/1 ... [2024-08-06 20:35:14.265483] 2024-08-06T20:35:14.2661402Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_format_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:35:14.265920] 2024-08-06T20:35:25.5585357Z 2024-08-06T20:35:25.5586526Z distributed/checkpoint/test_format_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_format_utils_1.1_f3a70ea2788987df_.log 2024-08-06T20:35:25.5588707Z Running 3 items in this shard: test/distributed/checkpoint/test_format_utils.py::TestFormatUtils::test_dcp_to_torch_save, test/distributed/checkpoint/test_format_utils.py::TestFormatUtils::test_online_torch_save_to_dcp, test/distributed/checkpoint/test_format_utils.py::TestFormatUtils::test_torch_save_to_dcp 2024-08-06T20:35:25.5590086Z 2024-08-06T20:35:25.5592215Z Running distributed/test_dynamo_distributed 1/1 ... [2024-08-06 20:35:25.559060] 2024-08-06T20:35:25.5596790Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_dynamo_distributed.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:35:25.559473] 2024-08-06T20:35:55.6811354Z 2024-08-06T20:35:55.6813310Z distributed/test_dynamo_distributed 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_dynamo_distributed_1.1_b7bca7bd92bce29e_.log 2024-08-06T20:35:55.6835946Z Running 46 items in this shard: test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_call_method_forward, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_hf_bert_ddp_aot_eager, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_hf_bert_ddp_inductor, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_issue90375, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_symbol_splitting, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_direct, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_indirect, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_no_binding, test/distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_unbacked_symbol_splitting_torture_multi, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_scalar, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_speculation_divergence, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_automatic_dynamic_tensor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_compiler_collectives_graph_break_empty_graph_still_collective, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_ddp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_ddp_baseline_aot_eager_multiprocess, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_aot_eager, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_inductor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_fsdp_setattr, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_aot_eager, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_aot_eager_static_graph, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_inductor, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_ddp_inductor_static_graph, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_fsdp, test/distributed/test_dynamo_distributed.py::TestMultiProc::test_hf_bert_fsdp_activation_checkpointing, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_aot_autograd, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_async_subclass_no_specialize, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_custom_layer, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ddp_baseline_aot_eager, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ddp_baseline_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_empty_graph_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_dup_tensors_diff_source, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_dup_tensors_same_source, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_orig_params_assert, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_skip_guards, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_skip_register_attr_or_module, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_fsdp_staticmethod, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_ctx_manager, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_layout_optimizations_inference, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_layout_optimizations_training, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_graph_split_inductor_transpose, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_higher_order_op, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_ignored_parameters, test/distributed/test_dynamo_distributed.py::TestSingleProc::test_no_split 2024-08-06T20:35:55.6855473Z 2024-08-06T20:35:55.6855755Z Running distributed/_tools/test_memory_tracker 1/1 ... [2024-08-06 20:35:55.681927] 2024-08-06T20:35:55.6857163Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tools/test_memory_tracker.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:35:55.682520] 2024-08-06T20:35:58.5611763Z 2024-08-06T20:35:58.5612924Z distributed/_tools/test_memory_tracker 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tools.test_memory_tracker_1.1_a58d5582db2ebaba_.log 2024-08-06T20:35:58.5616085Z Running 1 items in this shard: test/distributed/_tools/test_memory_tracker.py::TestMemoryTracker::test_local_model 2024-08-06T20:35:58.5616776Z 2024-08-06T20:35:58.5617835Z Running distributed/checkpoint/test_dtensor_resharding 1/1 ... [2024-08-06 20:35:58.561588] 2024-08-06T20:35:58.5623040Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_dtensor_resharding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:35:58.562045] 2024-08-06T20:36:15.3168352Z 2024-08-06T20:36:15.3170508Z distributed/checkpoint/test_dtensor_resharding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_86bd9110f977347f_.log 2024-08-06T20:36:15.3178103Z Running 5 items in this shard: test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_1d_to_1d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardPlacementChange::test_2d_to_2d_reshard_placement_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_1d_to_2d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_2d_to_1d_reshard_mesh_change, test/distributed/checkpoint/test_dtensor_resharding.py::TestDTensorReshardMeshChange::test_dtensor_checkpoint_resharding_with_empty_shard 2024-08-06T20:36:15.3185536Z 2024-08-06T20:36:15.3186128Z Running distributed/_composable/fsdp/test_fully_shard_state 1/1 ... [2024-08-06 20:36:15.317622] 2024-08-06T20:36:15.3188047Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:36:15.318171] 2024-08-06T20:36:18.1443279Z 2024-08-06T20:36:18.1444540Z distributed/_composable/fsdp/test_fully_shard_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_state_1.1_27837a1a809f3b0b_.log 2024-08-06T20:36:18.1447971Z Running 5 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_cls, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_deepcopy, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_reapply, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_state, test/distributed/_composable/fsdp/test_fully_shard_state.py::TestFullyShardState::test_fully_shard_unsupported_module_cls 2024-08-06T20:36:18.1450495Z 2024-08-06T20:36:18.1450843Z Running distributed/tensor/parallel/test_tp_random_state 1/1 ... [2024-08-06 20:36:18.144798] 2024-08-06T20:36:18.1454556Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_tp_random_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:36:18.145225] 2024-08-06T20:36:23.8752510Z 2024-08-06T20:36:23.8754168Z distributed/tensor/parallel/test_tp_random_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_tp_random_state_1.1_04310ae142def7da_.log 2024-08-06T20:36:23.8756128Z Running 1 items in this shard: test/distributed/tensor/parallel/test_tp_random_state.py::TensorParallelRandomStateTests::test_model_init 2024-08-06T20:36:23.8756770Z 2024-08-06T20:36:23.8759232Z Running distributed/checkpoint/test_fsdp_optim_state 1/1 ... [2024-08-06 20:36:23.875741] 2024-08-06T20:36:23.8764159Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_optim_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:36:23.876149] 2024-08-06T20:36:32.2621492Z 2024-08-06T20:36:32.2622751Z distributed/checkpoint/test_fsdp_optim_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_optim_state_1.1_2a38b1b1c2a5e13b_.log 2024-08-06T20:36:32.2624949Z Running 2 items in this shard: test/distributed/checkpoint/test_fsdp_optim_state.py::FsdpOptimStateCheckpoint::test_load_sharded_optimizer_state_dict_pass_planner_False, test/distributed/checkpoint/test_fsdp_optim_state.py::FsdpOptimStateCheckpoint::test_load_sharded_optimizer_state_dict_pass_planner_True 2024-08-06T20:36:32.2626387Z 2024-08-06T20:36:32.2627759Z Running distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 ... [2024-08-06 20:36:32.262579] 2024-08-06T20:36:32.2632345Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/e2e/test_e2e_save_and_load.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:36:32.263016] 2024-08-06T20:37:13.4184031Z 2024-08-06T20:37:13.4185817Z distributed/checkpoint/e2e/test_e2e_save_and_load 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.e2e.test_e2e_save_and_load_1.1_fe6790321c2e0bdc_.log 2024-08-06T20:37:13.4194243Z Running 14 items in this shard: test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_different_ordered_state_dict_keys, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_async_cached_cache_staged_state_dict_False, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_async_cached_cache_staged_state_dict_True, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_False_model_type0, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_False_model_type1, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_False_model_type2, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_True_model_type0, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_True_model_type1, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_e2e_compile_True_model_type2, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_no_dist, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_overwrite, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestE2ESaveAndLoad::test_partial_load, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestNoCPU::test_no_cpu, test/distributed/checkpoint/e2e/test_e2e_save_and_load.py::TestInitStateDict::test_init_state_dict 2024-08-06T20:37:13.4201313Z 2024-08-06T20:37:13.4201658Z Running distributed/_composable/fsdp/test_fully_shard_logging 1/1 ... [2024-08-06 20:37:13.419024] 2024-08-06T20:37:13.4203111Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_logging.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:37:13.419482] 2024-08-06T20:37:16.1033263Z 2024-08-06T20:37:16.1034503Z distributed/_composable/fsdp/test_fully_shard_logging 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_logging_1.1_0edb734a517b1b6e_.log 2024-08-06T20:37:16.1035608Z Running 0 items in this shard: 2024-08-06T20:37:16.1035803Z 2024-08-06T20:37:16.1039874Z Running distributed/_composable/fsdp/test_fully_shard_overlap 1/1 ... [2024-08-06 20:37:16.103769] 2024-08-06T20:37:16.1044770Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_overlap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:37:16.104203] 2024-08-06T20:37:19.0290111Z 2024-08-06T20:37:19.0291619Z distributed/_composable/fsdp/test_fully_shard_overlap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_overlap_1.1_a07029165daf906b_.log 2024-08-06T20:37:19.0293737Z Running 2 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_overlap.py::TestFullyShardOverlap::test_fully_shard_post_optim_event_overlap, test/distributed/_composable/fsdp/test_fully_shard_overlap.py::TestFullyShardOverlap::test_fully_shard_training_overlap 2024-08-06T20:37:19.0294978Z 2024-08-06T20:37:19.0296984Z Running distributed/_composable/fsdp/test_fully_shard_compile 1/1 ... [2024-08-06 20:37:19.029477] 2024-08-06T20:37:19.0301832Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:37:19.029920] 2024-08-06T20:37:28.5663343Z 2024-08-06T20:37:28.5665249Z distributed/_composable/fsdp/test_fully_shard_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_compile_1.1_ac13231938e4c911_.log 2024-08-06T20:37:28.5679521Z Running 12 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompileCompute::test_disable_compiling_hooks, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_dynamo_trace_use_training_state, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_nested_fully_shard_backend_inductor, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_simple_mlp_fullgraph_backend_inductor, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_trace_fsdp_set_, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_aot_eager, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_aot_eager_decomp_partition, test/distributed/_composable/fsdp/test_fully_shard_compile.py::TestFullyShardCompile::test_transformer_backend_inductor 2024-08-06T20:37:28.5693647Z 2024-08-06T20:37:28.5694187Z Running distributed/_tensor/test_embedding_ops 1/1 ... [2024-08-06 20:37:28.566813] 2024-08-06T20:37:28.5696494Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_embedding_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:37:28.567257] 2024-08-06T20:37:43.7173698Z 2024-08-06T20:37:43.7175169Z distributed/_tensor/test_embedding_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_embedding_ops_1.1_0a66b577f3149121_.log 2024-08-06T20:37:43.7178074Z Running 4 items in this shard: test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_multiple_embeddings_rowwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_colwise_max_norm_errors, test/distributed/_tensor/test_embedding_ops.py::TestEmbeddingOp::test_sharded_embedding_rowwise 2024-08-06T20:37:43.7180078Z 2024-08-06T20:37:43.7184681Z Running distributed/pipelining/test_schedule 1/1 ... [2024-08-06 20:37:43.718265] 2024-08-06T20:37:43.7190657Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/pipelining/test_schedule.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:37:43.718834] 2024-08-06T20:38:51.0805359Z 2024-08-06T20:38:51.0806817Z distributed/pipelining/test_schedule 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.pipelining.test_schedule_1.1_d9d5b3c24a69d891_.log 2024-08-06T20:38:51.0813781Z Running 12 items in this shard: test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_ScheduleClass0, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_ScheduleClass1, test/distributed/pipelining/test_schedule.py::TestSchedulePlan::test_pipeline_order_flex_and_zero_bubble_ScheduleClass0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref1, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref2, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref3, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref4, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref5, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_action_parse_action_str_and_ref6, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_send_recv_test_info0, test/distributed/pipelining/test_schedule.py::TestScheduleLowering::test_unshard_reshard_test_info0 2024-08-06T20:38:51.0820248Z 2024-08-06T20:38:51.0820625Z Running distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 ... [2024-08-06 20:38:51.081002] 2024-08-06T20:38:51.0822125Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:38:51.081443] 2024-08-06T20:38:56.8621143Z 2024-08-06T20:38:56.8623358Z distributed/checkpoint/test_fsdp_tp_checkpoint_conversion 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion_1.1_6212e946a38d7f2e_.log 2024-08-06T20:38:56.8626516Z Running 1 items in this shard: test/distributed/checkpoint/test_fsdp_tp_checkpoint_conversion.py::TestFsdpTpCheckpointConversion::test_fsdp_to_tp 2024-08-06T20:38:56.8627814Z 2024-08-06T20:38:56.8630611Z Running distributed/_tensor/test_view_ops 1/1 ... [2024-08-06 20:38:56.862856] 2024-08-06T20:38:56.8636790Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_view_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:38:56.863354] 2024-08-06T20:39:28.8851189Z 2024-08-06T20:39:28.8852540Z distributed/_tensor/test_view_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_view_ops_1.1_bb46bc9929f91e2d_.log 2024-08-06T20:39:28.8854638Z Running 3 items in this shard: test/distributed/_tensor/test_view_ops.py::TestViewOps::test_complex_view_ops, test/distributed/_tensor/test_view_ops.py::TestViewOps::test_view_groups, test/distributed/_tensor/test_view_ops.py::TestViewOps::test_view_ops 2024-08-06T20:39:28.8872364Z 2024-08-06T20:39:28.8872741Z Running distributed/tensor/parallel/test_parallelize_api 1/1 ... [2024-08-06 20:39:28.885600] 2024-08-06T20:39:28.8874173Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_parallelize_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:39:28.886062] 2024-08-06T20:40:00.5228282Z 2024-08-06T20:40:00.5229539Z distributed/tensor/parallel/test_parallelize_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_parallelize_api_1.1_623a65fae501b325_.log 2024-08-06T20:40:00.5237387Z Running 10 items in this shard: test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_linear_col_wise_parallel, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_linear_row_wise_parallel, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_mlp_with_module_api, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_mlp_with_module_api_nested, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_multi_wildcard, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_digit, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_question, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_parallelize_module_with_star, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_prepare_module_input, test/distributed/tensor/parallel/test_parallelize_api.py::TensorParallelAPITests::test_prepare_module_output 2024-08-06T20:40:00.5243729Z 2024-08-06T20:40:00.5244006Z Running distributed/test_control_collectives 1/1 ... [2024-08-06 20:40:00.523421] 2024-08-06T20:40:00.5245324Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_control_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:40:00.523854] 2024-08-06T20:40:03.4988836Z 2024-08-06T20:40:03.4990574Z distributed/test_control_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_control_collectives_1.1_25002c9215433958_.log 2024-08-06T20:40:03.4996682Z Running 13 items in this shard: test/distributed/test_control_collectives.py::TestCollectives::test_all_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum, test/distributed/test_control_collectives.py::TestCollectives::test_all_sum_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_barrier, test/distributed/test_control_collectives.py::TestCollectives::test_barrier_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast, test/distributed/test_control_collectives.py::TestCollectives::test_broadcast_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_gather, test/distributed/test_control_collectives.py::TestCollectives::test_gather_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_scatter, test/distributed/test_control_collectives.py::TestCollectives::test_scatter_timeout, test/distributed/test_control_collectives.py::TestCollectives::test_simple_user_func, test/distributed/test_control_collectives.py::TestCollectives::test_unique 2024-08-06T20:40:03.5002287Z 2024-08-06T20:40:03.5002865Z Running distributed/optim/test_apply_optimizer_in_backward 1/1 ... [2024-08-06 20:40:03.499344] 2024-08-06T20:40:03.5004306Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/optim/test_apply_optimizer_in_backward.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:40:03.499780] 2024-08-06T20:40:05.5591418Z 2024-08-06T20:40:05.5592861Z distributed/optim/test_apply_optimizer_in_backward 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_apply_optimizer_in_backward_1.1_bc7d90dafe534830_.log 2024-08-06T20:40:05.5593829Z 2024-08-06T20:40:05.5597804Z Running distributed/checkpoint/test_state_dict_utils 1/1 ... [2024-08-06 20:40:05.559585] 2024-08-06T20:40:05.5602594Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_state_dict_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:40:05.560017] 2024-08-06T20:40:08.4848479Z 2024-08-06T20:40:08.4850384Z distributed/checkpoint/test_state_dict_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_state_dict_utils_1.1_3cbe526b0c63d116_.log 2024-08-06T20:40:08.4856430Z Running 5 items in this shard: test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_complicated_dict, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_cpu_and_ranks_only, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_create_cpu_state_dict, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_gather_state_dict_dtensor, test/distributed/checkpoint/test_state_dict_utils.py::TestStateDictUtils::test_gather_with_cpu_and_ranks_only 2024-08-06T20:40:08.4860685Z 2024-08-06T20:40:08.4861356Z Running distributed/tensor/parallel/test_fsdp_2d_parallel 1/1 ... [2024-08-06 20:40:08.485653] 2024-08-06T20:40:08.4865582Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/tensor/parallel/test_fsdp_2d_parallel.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:40:08.486221] 2024-08-06T20:40:44.8801420Z 2024-08-06T20:40:44.8803849Z distributed/tensor/parallel/test_fsdp_2d_parallel 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.tensor.parallel.test_fsdp_2d_parallel_1.1_02976e61754c0b73_.log 2024-08-06T20:40:44.8818437Z Running 12 items in this shard: test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelTraining::test_2d_e2e_training_default, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelTraining::test_2d_e2e_training_not_use_orig_params, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelTraining::test_2d_e2e_training_use_orig_params, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelTraining::test_2d_fsdp_state_enable_extension, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelTraining::test_raise_invalid_tp_composition, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelStateDict::test_2d_load_state_dict_is_even_sharded_model_False, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelStateDict::test_2d_load_state_dict_is_even_sharded_model_True, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelStateDict::test_2d_optim_state_dict_is_even_sharded_model_False, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelStateDict::test_2d_optim_state_dict_is_even_sharded_model_True, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelStateDict::test_2d_state_dict_is_even_sharded_model_False, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelStateDict::test_2d_state_dict_is_even_sharded_model_True, test/distributed/tensor/parallel/test_fsdp_2d_parallel.py::TestNew2dParallelStateDict::test_fsdp_2d_extension 2024-08-06T20:40:44.8828917Z 2024-08-06T20:40:44.8829343Z Running distributed/_tensor/test_optimizers 1/1 ... [2024-08-06 20:40:44.880916] 2024-08-06T20:40:44.8831223Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_optimizers.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:40:44.881478] 2024-08-06T20:41:23.2324383Z 2024-08-06T20:41:23.2325481Z distributed/_tensor/test_optimizers 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_optimizers_1.1_a18d8998fa4a0187_.log 2024-08-06T20:41:23.2331703Z Running 11 items in this shard: test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_RMSprop_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adadelta_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adagrad_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adam_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adamax_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_adamw_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_asgd_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_nadam_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_optimizer_foreach_supported_types_include_DTensor, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_radam_1d_sharding, test/distributed/_tensor/test_optimizers.py::TestDTensorOptimizer::test_sgd_1d_sharding 2024-08-06T20:41:23.2336576Z 2024-08-06T20:41:23.2337004Z Running distributed/fsdp/test_shard_utils 1/1 ... [2024-08-06 20:41:23.233566] 2024-08-06T20:41:23.2342140Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_shard_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:41:23.233992] 2024-08-06T20:41:31.4190186Z 2024-08-06T20:41:31.4191340Z distributed/fsdp/test_shard_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_shard_utils_1.1_93b92bc31bb1b349_.log 2024-08-06T20:41:31.4193254Z Running 2 items in this shard: test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributed::test_create_chunk_sharded_tensor, test/distributed/fsdp/test_shard_utils.py::TestShardUtilsDistributedDTensor::test_create_chunk_dtensor 2024-08-06T20:41:31.4194496Z 2024-08-06T20:41:31.4199608Z Running distributed/_tensor/debug/test_comm_mode 1/1 ... [2024-08-06 20:41:31.419730] 2024-08-06T20:41:31.4204890Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/debug/test_comm_mode.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:41:31.420243] 2024-08-06T20:41:34.3449525Z 2024-08-06T20:41:34.3450612Z distributed/_tensor/debug/test_comm_mode 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.debug.test_comm_mode_1.1_71967a0bddb4c0fe_.log 2024-08-06T20:41:34.3453235Z Running 4 items in this shard: test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_coalesced, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_with_c10d, test/distributed/_tensor/debug/test_comm_mode.py::TestCommMode::test_comm_mode_with_dtensor 2024-08-06T20:41:34.3454945Z 2024-08-06T20:41:34.3455604Z Running distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ 1/1 ... [2024-08-06 20:41:34.345393] 2024-08-06T20:41:34.3460648Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:41:34.345825] 2024-08-06T20:41:37.3204228Z 2024-08-06T20:41:37.3205548Z distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_ 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_clip_grad_norm__1.1_58a2c5846e27b366_.log 2024-08-06T20:41:37.3207809Z Running 2 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_.py::TestClipGradNormWorldSize2::test_clip_grad_norm_1d, test/distributed/_composable/fsdp/test_fully_shard_clip_grad_norm_.py::TestClipGradNormWorldSize4::test_clip_grad_norm_2d 2024-08-06T20:41:37.3209013Z 2024-08-06T20:41:37.3210999Z Running distributed/test_functional_api 1/1 ... [2024-08-06 20:41:37.320918] 2024-08-06T20:41:37.3215887Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_functional_api.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:41:37.321365] 2024-08-06T20:42:07.8434862Z 2024-08-06T20:42:07.8436746Z distributed/test_functional_api 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_functional_api_1.1_96fff99b65e75091_.log 2024-08-06T20:42:07.8472605Z Running 50 items in this shard: test/distributed/test_functional_api.py::TestExpand::test_expand_1d_rank_list, test/distributed/test_functional_api.py::TestExpand::test_expand_2d_rank_list, test/distributed/test_functional_api.py::TestExpand::test_expand_device_mesh, test/distributed/test_functional_api.py::TestExpand::test_expand_device_mesh_tuple, test/distributed/test_functional_api.py::TestExpand::test_expand_process_group, test/distributed/test_functional_api.py::TestPgTag::test_find_or_create_pg, test/distributed/test_functional_api.py::TestPgTag::test_find_root_pg, test/distributed/test_functional_api.py::TestPgTag::test_pg_creation_with_tag, test/distributed/test_functional_api.py::TestPgTag::test_pg_lookup_roundtrip, test/distributed/test_functional_api.py::TestPgTag::test_pg_lookup_with_tag, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_into_tensor_coalesced_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_into_tensor_coalesced_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_tensor_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_gather_tensor_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_coalesced_eager_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_coalesced_eager_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_eager_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_all_reduce_eager_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_broadcast_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_broadcast_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_into_tensor_coalesced_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_into_tensor_coalesced_device_cuda, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_tensor_device_cpu, test/distributed/test_functional_api.py::TestTraceableCollectives::test_reduce_scatter_tensor_device_cuda, test/distributed/test_functional_api.py::TestMetaCollectives::test_all_reduce, test/distributed/test_functional_api.py::TestGradCollectives::test_all_reduce, test/distributed/test_functional_api.py::TestMakeFx::test_all_reduce_tracing, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_gather_into_tensor_coalesced, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_to_all_single, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_to_all_single_1d_input, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_all_to_all_single_split_sizes_none, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_tracing, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_tracing_with_dce_code, test/distributed/test_functional_api.py::TestCollectivesWithNCCL::test_tracing_with_fakepg, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_gather_into_tensor_coalesced, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_to_all_single, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_to_all_single_1d_input, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_all_to_all_single_split_sizes_none, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_permute_tensor_with_sub_group, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_tracing, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_tracing_with_dce_code, test/distributed/test_functional_api.py::TestNCCLCollectivesWithWorldSize4::test_tracing_with_fakepg, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_gather_tensor_compile_False, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_gather_tensor_compile_True, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_to_all_single_compile_False, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_to_all_single_compile_True, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_all_to_all_single_inductor, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_reduce_scatter_tensor_compile_False, test/distributed/test_functional_api.py::TestFunctionalAutograd::test_reduce_scatter_tensor_compile_True, test/distributed/test_functional_api.py::TestFunctionalAutogradWithNCCL::test_all_to_all_single 2024-08-06T20:42:07.8503735Z 2024-08-06T20:42:07.8504098Z Running distributed/checkpoint/test_fsdp_model_state 1/1 ... [2024-08-06 20:42:07.844376] 2024-08-06T20:42:07.8505517Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_fsdp_model_state.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:42:07.844956] 2024-08-06T20:42:16.2331349Z 2024-08-06T20:42:16.2332861Z distributed/checkpoint/test_fsdp_model_state 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_fsdp_model_state_1.1_52d85154fc5af3d9_.log 2024-08-06T20:42:16.2334878Z Running 2 items in this shard: test/distributed/checkpoint/test_fsdp_model_state.py::FsdpModelStateCheckpoint::test_fsdp_model_state_no_resharding, test/distributed/checkpoint/test_fsdp_model_state.py::FsdpModelStateCheckpoint::test_fsdp_model_state_with_resharding 2024-08-06T20:42:16.2336113Z 2024-08-06T20:42:16.2338456Z Running distributed/_composable/fully_shard/test_fully_shard_compile 1/1 ... [2024-08-06 20:42:16.233622] 2024-08-06T20:42:16.2343264Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_compile.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:42:16.234057] 2024-08-06T20:42:18.8081295Z 2024-08-06T20:42:18.8082605Z distributed/_composable/fully_shard/test_fully_shard_compile 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_compile_1.1_4b1b872ffb956d7d_.log 2024-08-06T20:42:18.8084157Z Running 1 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_compile.py::TestCompile::test_compile 2024-08-06T20:42:18.8084742Z 2024-08-06T20:42:18.8087211Z Running distributed/_composable/test_replicate 1/1 ... [2024-08-06 20:42:18.808543] 2024-08-06T20:42:18.8091752Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/test_replicate.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:42:18.808962] 2024-08-06T20:42:45.7729229Z 2024-08-06T20:42:45.7730455Z distributed/_composable/test_replicate 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_replicate_1.1_669ed51ea8804e53_.log 2024-08-06T20:42:45.7735570Z Running 9 items in this shard: test/distributed/_composable/test_replicate.py::ReplicateStateDictTest::test_replicate_non_root_multiple_save_load, test/distributed/_composable/test_replicate.py::ReplicateStateDictTest::test_replicate_single_module_save_load, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_device_id, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_ignore_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_move_args_kwargs_to_device, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_multi_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_single_module, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_with_kwargs, test/distributed/_composable/test_replicate.py::ReplicateTest::test_replicate_wrong_device_id_type 2024-08-06T20:42:45.7739827Z 2024-08-06T20:42:45.7740241Z Running distributed/_composable/fully_shard/test_fully_shard_mixed_precision 1/1 ... [2024-08-06 20:42:45.773199] 2024-08-06T20:42:45.7741812Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_mixed_precision.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:42:45.773671] 2024-08-06T20:42:51.3024082Z 2024-08-06T20:42:51.3026312Z distributed/_composable/fully_shard/test_fully_shard_mixed_precision 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_mixed_precision_1.1_8f585cb1a3959764_.log 2024-08-06T20:42:51.3029696Z Running 1 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_mixed_precision.py::TestMixedPrecision::test_float16_cast_forward 2024-08-06T20:42:51.3031071Z 2024-08-06T20:42:51.3031529Z Running distributed/_tensor/test_utils 1/1 ... [2024-08-06 20:42:51.302784] 2024-08-06T20:42:51.3035915Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_tensor/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:42:51.303236] 2024-08-06T20:43:15.1709121Z 2024-08-06T20:43:15.1710574Z distributed/_tensor/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._tensor.test_utils_1.1_916168bb70e00643_.log 2024-08-06T20:43:15.1716418Z Running 5 items in this shard: test/distributed/_tensor/test_utils.py::UtilTest::test_compute_local_shape_2d_uneven, test/distributed/_tensor/test_utils.py::UtilTest::test_compute_local_shape_and_global_offset_1D, test/distributed/_tensor/test_utils.py::UtilTest::test_compute_local_shape_and_global_offset_2D, test/distributed/_tensor/test_utils.py::Test2DStridedLocalShard::test_fsdp1_tp_2d_dtensor_local_shards_and_offsets, test/distributed/_tensor/test_utils.py::Test2DStridedLocalShard::test_fsdp2_tp_2d_dtensor_local_shards_and_offsets 2024-08-06T20:43:15.1718868Z 2024-08-06T20:43:15.1719153Z Running distributed/fsdp/test_fsdp_core 1/1 ... [2024-08-06 20:43:15.171451] 2024-08-06T20:43:15.1721429Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_core.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:43:15.171926] 2024-08-06T20:46:05.3748068Z 2024-08-06T20:46:05.3751308Z distributed/fsdp/test_fsdp_core 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_core_1.1_6c0ff85ac26974b7_.log 2024-08-06T20:46:05.3783657Z Running 60 items in this shard: test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_optim_step_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_delayed_reduce_scatter_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_mixture_of_experts_with_delay_before_free_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_always_wrap_model_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_nested_wrapped_model_single_iteration_mixed_precision_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_false_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_no_shard, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_none, test/distributed/fsdp/test_fsdp_core.py::TestParityWithDDP::test_transformer_offload_true_shard_grad_op, test/distributed/fsdp/test_fsdp_core.py::TestParamInit::test_param_change_after_init_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestParamInit::test_param_change_after_init_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_after_state_dict, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_cuda_first_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_pre_backward_hook_registration_cuda_first_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_False_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_False_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_True_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestHooks::test_register_functions_called_cuda_first_True_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestNoGrad::test_transformer_no_grad_mixed_precision_False, test/distributed/fsdp/test_fsdp_core.py::TestNoGrad::test_transformer_no_grad_mixed_precision_True, test/distributed/fsdp/test_fsdp_core.py::TestAutograd::test_unshard_params_as_tensors 2024-08-06T20:46:05.3812795Z 2024-08-06T20:46:05.3813071Z Running distributed/test_distributed_spawn 2/3 ... [2024-08-06 20:46:05.375534] 2024-08-06T20:46:05.3826534Z MPI not available -- MPI backend tests will be skipped 2024-08-06T20:46:05.3828333Z Running distributed tests for the test backend with env init_method 2024-08-06T20:46:05.3836921Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=2', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:46:05.383436] 2024-08-06T20:46:08.1885036Z 2024-08-06T20:46:08.1886236Z distributed/test_distributed_spawn 2/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_2.3_d77ae325a8db6e5b_.log 2024-08-06T20:46:08.1887179Z Running 0 items in this shard: 2024-08-06T20:46:08.1887409Z 2024-08-06T20:46:08.1894357Z Running distributed tests for the test backend with file init_method 2024-08-06T20:46:08.1900430Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=2', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:46:08.189788] 2024-08-06T20:46:10.9581949Z 2024-08-06T20:46:10.9583027Z distributed/test_distributed_spawn 2/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_2.3_087312bf5d0f0e79_.log 2024-08-06T20:46:10.9583965Z Running 0 items in this shard: 2024-08-06T20:46:10.9584161Z 2024-08-06T20:46:10.9591100Z Running distributed tests for the gloo backend with env init_method 2024-08-06T20:46:10.9596587Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=2', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:46:10.959432] 2024-08-06T20:54:16.9555247Z 2024-08-06T20:54:16.9556629Z distributed/test_distributed_spawn 2/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_2.3_b27caee39b281be9_.log 2024-08-06T20:54:16.9634533Z Running 92 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged 2024-08-06T20:54:16.9686056Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel 2024-08-06T20:54:16.9687280Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm 2024-08-06T20:54:16.9690691Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process 2024-08-06T20:54:16.9692173Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half 2024-08-06T20:54:16.9693360Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding 2024-08-06T20:54:16.9694466Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group 2024-08-06T20:54:16.9695683Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook 2024-08-06T20:54:16.9696910Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group 2024-08-06T20:54:16.9698034Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple 2024-08-06T20:54:16.9699159Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty 2024-08-06T20:54:16.9700237Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex 2024-08-06T20:54:16.9701265Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex 2024-08-06T20:54:16.9702297Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda 2024-08-06T20:54:16.9703358Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product 2024-08-06T20:54:16.9704504Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops 2024-08-06T20:54:16.9705615Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum 2024-08-06T20:54:16.9706674Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min 2024-08-06T20:54:16.9707710Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex 2024-08-06T20:54:16.9708729Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda 2024-08-06T20:54:16.9709713Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all 2024-08-06T20:54:16.9710847Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex 2024-08-06T20:54:16.9711849Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda 2024-08-06T20:54:16.9712933Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex 2024-08-06T20:54:16.9714108Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda 2024-08-06T20:54:16.9715260Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split 2024-08-06T20:54:16.9716432Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex 2024-08-06T20:54:16.9718194Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex 2024-08-06T20:54:16.9719457Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda 2024-08-06T20:54:16.9720760Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group 2024-08-06T20:54:16.9721835Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_group 2024-08-06T20:54:16.9722809Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group 2024-08-06T20:54:16.9723826Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global 2024-08-06T20:54:16.9724875Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl 2024-08-06T20:54:16.9726003Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err 2024-08-06T20:54:16.9727032Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda 2024-08-06T20:54:16.9728021Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group 2024-08-06T20:54:16.9729073Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward 2024-08-06T20:54:16.9730253Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params 2024-08-06T20:54:16.9731394Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer 2024-08-06T20:54:16.9732520Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future 2024-08-06T20:54:16.9733642Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging 2024-08-06T20:54:16.9734737Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization 2024-08-06T20:54:16.9735853Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs 2024-08-06T20:54:16.9736895Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized 2024-08-06T20:54:16.9737945Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce 2024-08-06T20:54:16.9739032Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD 2024-08-06T20:54:16.9740063Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference 2024-08-06T20:54:16.9741093Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence 2024-08-06T20:54:16.9742294Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params 2024-08-06T20:54:16.9743653Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none 2024-08-06T20:54:16.9745065Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none 2024-08-06T20:54:16.9746408Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler 2024-08-06T20:54:16.9747548Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler 2024-08-06T20:54:16.9748663Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone 2024-08-06T20:54:16.9749720Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval 2024-08-06T20:54:16.9750811Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception 2024-08-06T20:54:16.9751980Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception 2024-08-06T20:54:16.9753138Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features 2024-08-06T20:54:16.9754176Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group 2024-08-06T20:54:16.9755178Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group 2024-08-06T20:54:16.9756230Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static 2024-08-06T20:54:16.9757333Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars 2024-08-06T20:54:16.9758343Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda 2024-08-06T20:54:16.9759343Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup 2024-08-06T20:54:16.9760341Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend 2024-08-06T20:54:16.9761347Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group 2024-08-06T20:54:16.9762466Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync 2024-08-06T20:54:16.9763512Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend 2024-08-06T20:54:16.9764479Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler 2024-08-06T20:54:16.9765687Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks 2024-08-06T20:54:16.9766929Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout 2024-08-06T20:54:16.9768086Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast 2024-08-06T20:54:16.9769194Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration 2024-08-06T20:54:16.9770422Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size 2024-08-06T20:54:16.9771687Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed 2024-08-06T20:54:16.9772849Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module 2024-08-06T20:54:16.9774019Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager 2024-08-06T20:54:16.9775549Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd 2024-08-06T20:54:16.9776921Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload 2024-08-06T20:54:16.9778038Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max 2024-08-06T20:54:16.9779077Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product 2024-08-06T20:54:16.9780082Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum 2024-08-06T20:54:16.9781053Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max 2024-08-06T20:54:16.9782146Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda 2024-08-06T20:54:16.9783157Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice 2024-08-06T20:54:16.9784141Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group 2024-08-06T20:54:16.9785152Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source 2024-08-06T20:54:16.9786257Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler 2024-08-06T20:54:16.9787386Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler 2024-08-06T20:54:16.9788506Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum 2024-08-06T20:54:16.9789557Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp 2024-08-06T20:54:16.9790582Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged 2024-08-06T20:54:16.9791128Z 2024-08-06T20:54:16.9791354Z Running distributed tests for the gloo backend with file init_method 2024-08-06T20:54:16.9792664Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_distributed_spawn.py', '--shard-id=2', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 20:54:16.960791] 2024-08-06T21:02:25.6230647Z 2024-08-06T21:02:25.6232207Z distributed/test_distributed_spawn 2/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_distributed_spawn_2.3_14f1d3f530dcbbb6_.log 2024-08-06T21:02:25.6289436Z Running 92 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp, test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged 2024-08-06T21:02:25.6332259Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel 2024-08-06T21:02:25.6333416Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm 2024-08-06T21:02:25.6334734Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_Single_Input_Per_Process 2024-08-06T21:02:25.6336090Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedDataParallel_SyncBatchNorm_half 2024-08-06T21:02:25.6337305Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_DistributedSampler_padding 2024-08-06T21:02:25.6338406Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_SyncBatchNorm_process_group 2024-08-06T21:02:25.6339624Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_accumulate_gradients_no_sync_allreduce_with_then_hook 2024-08-06T21:02:25.6340846Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_full_group 2024-08-06T21:02:25.6341969Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_simple 2024-08-06T21:02:25.6343095Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_coalesced_with_empty 2024-08-06T21:02:25.6344179Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_complex 2024-08-06T21:02:25.6345206Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_cuda_complex 2024-08-06T21:02:25.6346247Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_gather_v_cuda 2024-08-06T21:02:25.6347305Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_coalesced_product 2024-08-06T21:02:25.6348434Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_complex_unsupported_ops 2024-08-06T21:02:25.6349567Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_full_group_sum 2024-08-06T21:02:25.6350622Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_group_min 2024-08-06T21:02:25.6351666Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_complex 2024-08-06T21:02:25.6352690Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_reduce_sum_cuda 2024-08-06T21:02:25.6353674Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all 2024-08-06T21:02:25.6354655Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_complex 2024-08-06T21:02:25.6355654Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_cuda 2024-08-06T21:02:25.6356823Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_complex 2024-08-06T21:02:25.6358090Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_equal_split_cuda 2024-08-06T21:02:25.6359249Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split 2024-08-06T21:02:25.6360414Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_complex 2024-08-06T21:02:25.6361643Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_cuda_complex 2024-08-06T21:02:25.6362912Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_full_group_cuda 2024-08-06T21:02:25.6364142Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_all_to_all_single_unequal_split_group 2024-08-06T21:02:25.6365325Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_backend_group 2024-08-06T21:02:25.6366309Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_group 2024-08-06T21:02:25.6367326Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_barrier_timeout_global 2024-08-06T21:02:25.6368376Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_nccl 2024-08-06T21:02:25.6369420Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_batch_isend_irecv_op_err 2024-08-06T21:02:25.6370450Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_cuda 2024-08-06T21:02:25.6371438Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_broadcast_group 2024-08-06T21:02:25.6372479Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward 2024-08-06T21:02:25.6373644Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_apply_optim_in_backward_ignored_params 2024-08-06T21:02:25.6374972Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_broadcast_buffer 2024-08-06T21:02:25.6376092Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_buffer_hook_allreduce_return_future 2024-08-06T21:02:25.6377216Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_comm_hook_logging 2024-08-06T21:02:25.6378301Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_device_mesh_initialization 2024-08-06T21:02:25.6379423Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_grad_div_uneven_inputs 2024-08-06T21:02:25.6380470Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_has_finalized 2024-08-06T21:02:25.6381498Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_allreduce 2024-08-06T21:02:25.6382570Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_hook_parity_powerSGD 2024-08-06T21:02:25.6383591Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_inference 2024-08-06T21:02:25.6384746Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_join_model_equivalence 2024-08-06T21:02:25.6386030Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_multiple_nested_unused_params_err_ignore_params 2024-08-06T21:02:25.6387390Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_grad_as_bucket_view_no_set_grad_none 2024-08-06T21:02:25.6388805Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_native_mixed_precision_no_grad_as_bucket_view_set_grad_to_none 2024-08-06T21:02:25.6390075Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_autograd_profiler 2024-08-06T21:02:25.6391210Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_profiling_torch_profiler 2024-08-06T21:02:25.6392270Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sink_noclone 2024-08-06T21:02:25.6393327Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_sync_bn_training_vs_eval 2024-08-06T21:02:25.6394415Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_uneven_input_exception 2024-08-06T21:02:25.6395585Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_unused_params_rebuild_buckets_exception 2024-08-06T21:02:25.6396747Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_ddp_zero_output_features 2024-08-06T21:02:25.6397787Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_full_group 2024-08-06T21:02:25.6398774Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_destroy_group 2024-08-06T21:02:25.6399822Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_detect_ddp_is_actually_static 2024-08-06T21:02:25.6400925Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_dump_DDP_relevant_env_vars 2024-08-06T21:02:25.6401936Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_cuda 2024-08-06T21:02:25.6402938Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_gather_object_subgroup 2024-08-06T21:02:25.6403936Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_backend 2024-08-06T21:02:25.6404947Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_get_rank_size_full_group 2024-08-06T21:02:25.6406208Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_grads_same_across_ranks_with_no_sync 2024-08-06T21:02:25.6407263Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend 2024-08-06T21:02:25.6408240Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_isend_torch_profiler 2024-08-06T21:02:25.6409490Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_allreduce_hang_wait_all_ranks 2024-08-06T21:02:25.6410716Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_monitored_barrier_gloo_rank_0_timeout 2024-08-06T21:02:25.6411861Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_nccl_backend_bool_broadcast 2024-08-06T21:02:25.6413048Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration 2024-08-06T21:02:25.6414432Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_by_enumeration_input_rank_exceeds_world_size 2024-08-06T21:02:25.6415689Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_new_subgroups_overlap_not_allowed 2024-08-06T21:02:25.6416852Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_output_unused_in_loss_dict_module 2024-08-06T21:02:25.6417964Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_periodic_model_averager 2024-08-06T21:02:25.6419143Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_parity_with_hierarchical_sgd 2024-08-06T21:02:25.6420611Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_post_localSGD_optimizer_step_reload 2024-08-06T21:02:25.6421732Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_full_group_max 2024-08-06T21:02:25.6422771Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_product 2024-08-06T21:02:25.6423773Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_group_sum 2024-08-06T21:02:25.6424742Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_max 2024-08-06T21:02:25.6425736Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_scatter_v_cuda 2024-08-06T21:02:25.6426754Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_reduce_sum_twice 2024-08-06T21:02:25.6427725Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_scatter_group 2024-08-06T21:02:25.6428731Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source 2024-08-06T21:02:25.6429826Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_any_source_torch_profiler 2024-08-06T21:02:25.6430956Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_send_recv_autograd_profiler 2024-08-06T21:02:25.6432019Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sparse_all_reduce_sum 2024-08-06T21:02:25.6433072Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_stateless_api_with_ddp 2024-08-06T21:02:25.6434085Z Running 1 items in this shard: test/distributed/test_distributed_spawn.py::TestDistBackendWithSpawn::test_sync_bn_logged 2024-08-06T21:02:25.6434636Z 2024-08-06T21:02:25.6434940Z Running distributed/fsdp/test_fsdp_backward_prefetch 1/1 ... [2024-08-06 21:02:25.627676] 2024-08-06T21:02:25.6436306Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_backward_prefetch.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:02:25.628072] 2024-08-06T21:02:31.2072487Z 2024-08-06T21:02:31.2073706Z distributed/fsdp/test_fsdp_backward_prefetch 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_backward_prefetch_1.1_909e46a856b46082_.log 2024-08-06T21:02:31.2075546Z Running 1 items in this shard: test/distributed/fsdp/test_fsdp_backward_prefetch.py::TestBackwardPrefetch::test_backward_prefetch 2024-08-06T21:02:31.2076141Z 2024-08-06T21:02:31.2079100Z Running distributed/_composable/fully_shard/test_fully_shard_model_checkpoint 1/1 ... [2024-08-06 21:02:31.207694] 2024-08-06T21:02:31.2083606Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_model_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:02:31.208125] 2024-08-06T21:02:44.7509141Z 2024-08-06T21:02:44.7510545Z distributed/_composable/fully_shard/test_fully_shard_model_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_model_checkpoint_1.1_5db0c7f3dddb29ab_.log 2024-08-06T21:02:44.7514515Z Running 4 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_model_checkpoint.py::TestModelCheckpointing::test_full_state_dict_save_load_mixed_sharding, test/distributed/_composable/fully_shard/test_fully_shard_model_checkpoint.py::TestModelCheckpointing::test_state_dict_save_load_flow, test/distributed/_composable/fully_shard/test_fully_shard_model_checkpoint.py::TestModelCheckpointing::test_state_dict_save_load_root_fully_shard, test/distributed/_composable/fully_shard/test_fully_shard_model_checkpoint.py::TestModelCheckpointing::test_state_dict_save_load_submodule_fully_shard 2024-08-06T21:02:44.7517286Z 2024-08-06T21:02:44.7517673Z Running distributed/optim/test_zero_redundancy_optimizer 1/1 ... [2024-08-06 21:02:44.751166] 2024-08-06T21:02:44.7519068Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/optim/test_zero_redundancy_optimizer.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:02:44.751622] 2024-08-06T21:03:58.4305386Z 2024-08-06T21:03:58.4306891Z distributed/optim/test_zero_redundancy_optimizer 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.optim.test_zero_redundancy_optimizer_1.1_1b6e745f4c97b3b0_.log 2024-08-06T21:03:58.4340209Z Running 42 items in this shard: test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_constructor, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_lr_scheduler, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_same_dense_param_type, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_state_dict, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_step_with_extra_inner_key, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_step_with_kwargs, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_step_without_closure, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerSingleRank::test_zero_grad, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_add_param_group, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_collect_shards, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_False_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_False_gradient_as_bucket_view_True_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_False_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_False_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_False_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_True_shard_buckets_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_ddp_zero_overlap_use_gpu_True_use_interleaved_hook_True_gradient_as_bucket_view_True_static_graph_True_shard_buckets_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_AdamW_maximize_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_AdamW_maximize_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_Adam_maximize_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_Adam_maximize_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_SGD_maximize_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_local_optimizer_parity_optimizer_class_str_SGD_maximize_True, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_lr_scheduler, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_multiple_param_groups, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_nondefault_process_group, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_sharding, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_step, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_step_with_closure, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_join_cpu, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_join_gpu, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_model_parallel_parameters_as_bucket_view_False, test/distributed/optim/test_zero_redundancy_optimizer.py::TestZeroRedundancyOptimizerDistributed::test_zero_model_parallel_parameters_as_bucket_view_True 2024-08-06T21:03:58.4371744Z 2024-08-06T21:03:58.4372054Z Running distributed/fsdp/test_fsdp_flatten_params 1/1 ... [2024-08-06 21:03:58.431185] 2024-08-06T21:03:58.4373402Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_flatten_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:03:58.431631] 2024-08-06T21:04:29.2008603Z 2024-08-06T21:04:29.2010190Z distributed/fsdp/test_fsdp_flatten_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_flatten_params_1.1_140ba7a24a4ad234_.log 2024-08-06T21:04:29.2016925Z Running 11 items in this shard: test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_empty_module, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_aligned_full_precision, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_aligned_mixed_precision, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flat_param_shard_metadata_unaligned, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_flatten_nothing, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_numel_with_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_numel_without_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_output_with_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_output_without_shared_params, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_partial_flattening, test/distributed/fsdp/test_fsdp_flatten_params.py::TestFlattenParams::test_pnorm_after_step_with_shared_params 2024-08-06T21:04:29.2022722Z 2024-08-06T21:04:29.2023141Z Running distributed/checkpoint/test_file_system_checkpoint 1/1 ... [2024-08-06 21:04:29.201341] 2024-08-06T21:04:29.2024688Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_file_system_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:04:29.201839] 2024-08-06T21:04:32.1265983Z 2024-08-06T21:04:32.1267962Z distributed/checkpoint/test_file_system_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_file_system_checkpoint_1.1_348430256f106ff1_.log 2024-08-06T21:04:32.1277001Z Running 6 items in this shard: test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedStateDictSaveLoad::test_read_write_only_tensor, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedStateDictSaveLoadWithSharedTensor::test_read_write_shard_tensor, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_load_rowwise_to_colwise, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_load_with_different_shard_plan, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_save_load_bytes, test/distributed/checkpoint/test_file_system_checkpoint.py::TestDistributedReshardOnLoad::test_switch_between_sharded_tensor_to_tensor 2024-08-06T21:04:32.1283488Z 2024-08-06T21:04:32.1283896Z Running distributed/checkpoint/test_state_dict 1/1 ... [2024-08-06 21:04:32.127320] 2024-08-06T21:04:32.1285816Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/checkpoint/test_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:04:32.127910] 2024-08-06T21:04:38.5605401Z 2024-08-06T21:04:38.5606599Z distributed/checkpoint/test_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.checkpoint.test_state_dict_1.1_9f2133b998cc50f1_.log 2024-08-06T21:04:38.5617344Z Running 25 items in this shard: test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_activation_ckpt_fqns_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_activation_ckpt_fqns_fsdp1, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_broadcast_from_rank0, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_broadcast_from_rank0_hsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_compiled_fsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_cpu_offload_full_state_dict, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_deprecate_fsdp_api, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_deprecate_partial, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_extra_state, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_flattened_osd, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_frozen_parameters, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp2, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp_ddp, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_fsdp_root_not_initialized, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_non_persistent_buffers, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_optim_state_dict_param_matching, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_optim_state_dict_tensor_matching, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_setting_meta_device_model, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_setting_meta_device_model_broadcasting, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_shared_weight, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_single_gpu, test/distributed/checkpoint/test_state_dict.py::TestStateDict::test_strict, test/distributed/checkpoint/test_state_dict.py::TestNoComm::test_no_dist 2024-08-06T21:04:38.5627123Z 2024-08-06T21:04:38.5627499Z Running distributed/_composable/fully_shard/test_fully_shard_init 1/1 ... [2024-08-06 21:04:38.561116] 2024-08-06T21:04:38.5629240Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fully_shard/test_fully_shard_init.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:04:38.561582] 2024-08-06T21:04:57.4130424Z 2024-08-06T21:04:57.4131678Z distributed/_composable/fully_shard/test_fully_shard_init 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fully_shard.test_fully_shard_init_1.1_9c11d3ec05c77a20_.log 2024-08-06T21:04:57.4135986Z Running 6 items in this shard: test/distributed/_composable/fully_shard/test_fully_shard_init.py::TestInitialization::test_device_id, test/distributed/_composable/fully_shard/test_fully_shard_init.py::TestInitialization::test_manual_fully_shard, test/distributed/_composable/fully_shard/test_fully_shard_init.py::TestInitialization::test_materialize_meta_module, test/distributed/_composable/fully_shard/test_fully_shard_init.py::TestInitialization::test_nested_fully_shard_shared_state, test/distributed/_composable/fully_shard/test_fully_shard_init.py::TestInitialization::test_policy, test/distributed/_composable/fully_shard/test_fully_shard_init.py::TestInitialization::test_sync_module_states 2024-08-06T21:04:57.4139156Z 2024-08-06T21:04:57.4139459Z Running distributed/fsdp/test_checkpoint_wrapper 1/1 ... [2024-08-06 21:04:57.413459] 2024-08-06T21:04:57.4141306Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_checkpoint_wrapper.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:04:57.413908] 2024-08-06T21:05:00.3885385Z 2024-08-06T21:05:00.3886528Z distributed/fsdp/test_checkpoint_wrapper 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_checkpoint_wrapper_1.1_3d6cd7fec0e7ba55_.log 2024-08-06T21:05:00.3891489Z Running 8 items in this shard: test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_apply_activation_checkpointing, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_args_kwargs, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_cpu_offload, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_kwarg_support, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_checkpoint_wrapper_parity, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_forward_missing_attributes, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_fqn, test/distributed/fsdp/test_checkpoint_wrapper.py::CheckpointWrapperTest::test_load_activation_checkpointed_module 2024-08-06T21:05:00.3895668Z 2024-08-06T21:05:00.3895963Z Running distributed/fsdp/test_fsdp_clip_grad_norm 1/1 ... [2024-08-06 21:05:00.388990] 2024-08-06T21:05:00.3897298Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_clip_grad_norm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:05:00.389412] 2024-08-06T21:05:15.1379145Z 2024-08-06T21:05:15.1380370Z distributed/fsdp/test_fsdp_clip_grad_norm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_clip_grad_norm_1.1_d5f263d83d9fd57d_.log 2024-08-06T21:05:15.1382988Z Running 4 items in this shard: test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_ddp_parity, test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_low_precision_grads, test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_no_gradients, test/distributed/fsdp/test_fsdp_clip_grad_norm.py::TestClipGradNorm::test_non_root 2024-08-06T21:05:15.1384854Z 2024-08-06T21:05:15.1385150Z Running distributed/test_c10d_logger 1/1 ... [2024-08-06 21:05:15.138352] 2024-08-06T21:05:15.1390449Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_logger.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:05:15.138791] 2024-08-06T21:05:26.0758569Z 2024-08-06T21:05:26.0760610Z distributed/test_c10d_logger 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_logger_1.1_27fd61be176924f7_.log 2024-08-06T21:05:26.0764971Z Running 3 items in this shard: test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_exception_logger, test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_get_or_create_logger, test/distributed/test_c10d_logger.py::C10dErrorLoggerTest::test_time_logger 2024-08-06T21:05:26.0767921Z 2024-08-06T21:05:26.0768477Z Running distributed/fsdp/test_fsdp_grad_acc 1/1 ... [2024-08-06 21:05:26.076474] 2024-08-06T21:05:26.0774830Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_grad_acc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:05:26.077065] 2024-08-06T21:05:46.3790464Z 2024-08-06T21:05:46.3792057Z distributed/fsdp/test_fsdp_grad_acc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_grad_acc_1.1_5387fabc57b19be7_.log 2024-08-06T21:05:46.3796286Z Running 6 items in this shard: test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs0_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs0_use_orig_params_True, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs1_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_configs1_use_orig_params_True, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_cpu_offload_use_orig_params_False, test/distributed/fsdp/test_fsdp_grad_acc.py::TestGradAcc::test_grad_acc_cpu_offload_use_orig_params_True 2024-08-06T21:05:46.3799744Z 2024-08-06T21:05:46.3800174Z Running distributed/fsdp/test_fsdp_unshard_params 1/1 ... [2024-08-06 21:05:46.379618] 2024-08-06T21:05:46.3803857Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_unshard_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:05:46.380137] 2024-08-06T21:06:31.7280537Z 2024-08-06T21:06:31.7282909Z distributed/fsdp/test_fsdp_unshard_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_unshard_params_1.1_679814d643e741b0_.log 2024-08-06T21:06:31.7301070Z Running 15 items in this shard: test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_named_parameters_and_buffers, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_param_data, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_recurse, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_respects_reshard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_params_writeback, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_singleton_param_writeback, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_unshard_submodule, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_with_grads_core, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParams::test_with_grads_none_grads, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsNoShard::test_unshard_params_param_data_no_shard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsNoShard::test_unshard_params_writeback_no_shard, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_offload_to_cpu_no_shard_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_rank0_only_with_writeback_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_unshard_params_from_backward_raises, test/distributed/fsdp/test_fsdp_unshard_params.py::TestUnshardParamsErrors::test_unshard_params_from_forward_raises 2024-08-06T21:06:31.7315106Z 2024-08-06T21:06:31.7315678Z Running distributed/nn/jit/test_instantiator 1/1 ... [2024-08-06 21:06:31.728786] 2024-08-06T21:06:31.7318143Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/nn/jit/test_instantiator.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:06:31.729363] 2024-08-06T21:06:34.6554169Z 2024-08-06T21:06:34.6556463Z distributed/nn/jit/test_instantiator 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.nn.jit.test_instantiator_1.1_f480bc37e0fe8e90_.log 2024-08-06T21:06:34.6561995Z Running 3 items in this shard: test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_get_arg_return_types_from_interface, test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_instantiate_non_scripted_remote_module_template, test/distributed/nn/jit/test_instantiator.py::TestInstantiator::test_instantiate_scripted_remote_module_template 2024-08-06T21:06:34.6565796Z 2024-08-06T21:06:34.6566721Z Running distributed/_composable/fsdp/test_fully_shard_comm 1/1 ... [2024-08-06 21:06:34.655849] 2024-08-06T21:06:34.6569439Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_comm.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:06:34.656420] 2024-08-06T21:06:37.6317441Z 2024-08-06T21:06:37.6320016Z distributed/_composable/fsdp/test_fully_shard_comm 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_comm_1.1_ef6603226e42d1b0_.log 2024-08-06T21:06:37.6338774Z Running 14 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_all_gather_fp32, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_reduce_scatter_fp16, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCollectiveOps::test_reduce_scatter_fp32, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_fully_shard_communication_count, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_manual_reshard_with_reshard_after_forward_false, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardCommunication::test_set_reduce_scatter_divide_factor, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_multi_module_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_fully_shard_multi_module_unused_module, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_set_modules_to_backward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardPrefetch::test_set_modules_to_forward_prefetch, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiProcess::test_unshard_async, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiThread::test_unshard_no_param_group, test/distributed/_composable/fsdp/test_fully_shard_comm.py::TestFullyShardUnshardMultiThread::test_unshard_without_lazy_init 2024-08-06T21:06:37.6353799Z 2024-08-06T21:06:37.6354685Z Running distributed/fsdp/test_fsdp_overlap 1/1 ... [2024-08-06 21:06:37.632485] 2024-08-06T21:06:37.6357095Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_overlap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:06:37.633066] 2024-08-06T21:06:46.0177456Z 2024-08-06T21:06:46.0178863Z distributed/fsdp/test_fsdp_overlap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_overlap_1.1_0e864b8872b794b9_.log 2024-08-06T21:06:46.0180628Z Running 2 items in this shard: test/distributed/fsdp/test_fsdp_overlap.py::TestForwardOverlapWorldSizeOne::test_forward_overlap, test/distributed/fsdp/test_fsdp_overlap.py::TestForwardOverlapWorldSizeTwo::test_forward_overlap 2024-08-06T21:06:46.0181701Z 2024-08-06T21:06:46.0184372Z Running distributed/_composable/test_replicate_with_compiler 1/1 ... [2024-08-06 21:06:46.018218] 2024-08-06T21:06:46.0189598Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/test_replicate_with_compiler.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:06:46.018687] 2024-08-06T21:06:48.9438491Z 2024-08-06T21:06:48.9440033Z distributed/_composable/test_replicate_with_compiler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.test_replicate_with_compiler_1.1_1cc809acb8690a63_.log 2024-08-06T21:06:48.9446034Z Running 10 items in this shard: test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_bucketing_coalesced_op, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_bucketing_concat_op, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_backward_only, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_bf16, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_cpu, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_cpu_no_sync, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_fp16, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_gpu, test/distributed/_composable/test_replicate_with_compiler.py::ReplicateTest::test_compile_gpu_ac, test/distributed/_composable/test_replicate_with_compiler.py::DDP_TP_Test::test_ddp_tp 2024-08-06T21:06:48.9450997Z 2024-08-06T21:06:48.9451288Z Running distributed/fsdp/test_fsdp_hybrid_shard 1/1 ... [2024-08-06 21:06:48.944339] 2024-08-06T21:06:48.9452624Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_hybrid_shard.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:06:48.944830] 2024-08-06T21:07:09.0471732Z 2024-08-06T21:07:09.0472900Z distributed/fsdp/test_fsdp_hybrid_shard 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_8a2f9ff0981e0d95_.log 2024-08-06T21:07:09.0477112Z Running 6 items in this shard: test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_basic_setup, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_fsdp_hybrid_shard_parity, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_save_load_state_dict, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_hsdp_sync_module_state, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_invalid_pg_specification_raises, test/distributed/fsdp/test_fsdp_hybrid_shard.py::TestFSDPHybridShard::test_raises_manual_wrap_hybrid_shard_when_none_policy 2024-08-06T21:07:09.0480136Z 2024-08-06T21:07:09.0480511Z Running distributed/_composable/fsdp/test_fully_shard_extensions 1/1 ... [2024-08-06 21:07:09.047630] 2024-08-06T21:07:09.0484421Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_composable/fsdp/test_fully_shard_extensions.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:07:09.048200] 2024-08-06T21:07:15.3287965Z 2024-08-06T21:07:15.3289672Z distributed/_composable/fsdp/test_fully_shard_extensions 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._composable.fsdp.test_fully_shard_extensions_1.1_b1b4fa12e3688fd2_.log 2024-08-06T21:07:15.3294240Z Running 3 items in this shard: test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiProcess::test_all_gather_extensions_train_parity, test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiThread::test_all_gather_extensions_end_to_end, test/distributed/_composable/fsdp/test_fully_shard_extensions.py::TestFullyShardAllGatherExtensionsMultiThread::test_all_gather_extensions_monkey_patch 2024-08-06T21:07:15.3297130Z 2024-08-06T21:07:15.3297540Z Running distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1 ... [2024-08-06 21:07:15.329268] 2024-08-06T21:07:15.3300103Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_sharded_grad_scaler.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:07:15.329738] 2024-08-06T21:08:11.4150580Z 2024-08-06T21:08:11.4152218Z distributed/fsdp/test_fsdp_sharded_grad_scaler 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_sharded_grad_scaler_1.1_1625d7263f912c86_.log 2024-08-06T21:08:11.4171980Z Running 20 items in this shard: test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_grad_scaling, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_inf_gradients_skip_optim_step, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardGradScaler::test_scaling_unscaling_sparse, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_none_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_false_shard_grad_op_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_none_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_mixed_precision_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_mixed_precision_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_none_none, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_fsdp_ddp_parity_with_grad_scaler_offload_true_shard_grad_op_none_use_orig_params, test/distributed/fsdp/test_fsdp_sharded_grad_scaler.py::TestShardedGradScalerParityWithDDP::test_sharded_grad_scaler_found_inf 2024-08-06T21:08:11.4189568Z 2024-08-06T21:08:11.4189928Z Running distributed/fsdp/test_fsdp_freezing_weights 1/1 ... [2024-08-06 21:08:11.415595] 2024-08-06T21:08:11.4191536Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_freezing_weights.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:08:11.416080] 2024-08-06T21:09:56.6519307Z 2024-08-06T21:09:56.6521399Z distributed/fsdp/test_fsdp_freezing_weights 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_freezing_weights_1.1_ec730d03fc166856_.log 2024-08-06T21:09:56.6575333Z Running 32 items in this shard: test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_False_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_GradToNone_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_False_disable_autograd_True_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_False_forward_prefetch_True, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_False, test/distributed/fsdp/test_fsdp_freezing_weights.py::TestFreezingWeights::test_freezing_weights_with_nested_trunk_True_freezing_method_FreezingMethod_RequiresGrad_freeze_after_wrap_fsdp_True_disable_autograd_True_forward_prefetch_True 2024-08-06T21:09:56.6611101Z 2024-08-06T21:09:56.6611442Z Running distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 ... [2024-08-06 21:09:56.652937] 2024-08-06T21:09:56.6612831Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_hsdp_dtensor_state_dict.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:09:56.653501] 2024-08-06T21:10:24.9321172Z 2024-08-06T21:10:24.9326954Z distributed/fsdp/test_hsdp_dtensor_state_dict 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_hsdp_dtensor_state_dict_1.1_72e61f44d4068d68_.log 2024-08-06T21:10:24.9334677Z Running 8 items in this shard: test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_False, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_model_load_state_dict_offload_to_cpu_True, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_False, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_optim_load_state_dict_offload_to_cpu_True, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_False, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_dtensor_sharded_tensor_state_dict_identical_offload_to_cpu_True, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_hsdp_init_with_device_mesh, test/distributed/fsdp/test_hsdp_dtensor_state_dict.py::TestHSDPWithDeviceMeshAndDTensor::test_root_module_is_not_FSDP 2024-08-06T21:10:24.9340112Z 2024-08-06T21:10:24.9340403Z Running distributed/test_c10d_object_collectives 1/1 ... [2024-08-06 21:10:24.932611] 2024-08-06T21:10:24.9341745Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_object_collectives.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:10:24.933110] 2024-08-06T21:10:54.2596564Z 2024-08-06T21:10:54.2597958Z distributed/test_c10d_object_collectives 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_object_collectives_1.1_8ecc9f5f016e84fd_.log 2024-08-06T21:10:54.2602918Z Running 9 items in this shard: test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_all_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_broadcast_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_scatter_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_send_recv_object_list, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_all_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_broadcast_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_gather_object, test/distributed/test_c10d_object_collectives.py::TestObjectCollectives::test_subpg_scatter_object 2024-08-06T21:10:54.2607411Z 2024-08-06T21:10:54.2607783Z Running distributed/fsdp/test_fsdp_use_orig_params 1/1 ... [2024-08-06 21:10:54.260158] 2024-08-06T21:10:54.2609214Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_use_orig_params.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:10:54.260658] 2024-08-06T21:12:05.8959855Z 2024-08-06T21:12:05.8961673Z distributed/fsdp/test_fsdp_use_orig_params 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_6dc220fd84ee6cc4_.log 2024-08-06T21:12:05.8983061Z Running 25 items in this shard: test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_cpu_offload_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_full_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_no_shard, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_hyperparams_sharding_strategy_str_shard_grad_op, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_diff_trainability, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_fsdp_compile, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsMultipleParamGroups::test_multiple_optimizers, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_multiple_forward_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_False, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsUnshardReshard::test_summon_between_two_forwards_offload_params_True, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsParamAccess::test_access_params_after_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_grad_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_no_reshard_and_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_param_writeback, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_between_fwd_and_bwd_for_no_reshard_raises, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsWriteback::test_writeback_shape_mismatch, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsFQNs::test_named_parameters_in_forward, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_correctness, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsNoSync::test_no_sync_mixed_precision, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestFSDPUseOrigParamsInit::test_non_uniform_requires_grad, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cpu, test/distributed/fsdp/test_fsdp_use_orig_params.py::TestMultiTensorApply::test_multi_tensor_apply_size0_tensors_cuda 2024-08-06T21:12:05.8997705Z 2024-08-06T21:12:05.8998085Z Running distributed/_shard/sharding_spec/test_sharding_spec 1/1 ... [2024-08-06 21:12:05.896433] 2024-08-06T21:12:05.8999516Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/sharding_spec/test_sharding_spec.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:12:05.896939] 2024-08-06T21:12:12.2289714Z 2024-08-06T21:12:12.2291226Z distributed/_shard/sharding_spec/test_sharding_spec 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharding_spec.test_sharding_spec_1.1_678d683ed630e0a2_.log 2024-08-06T21:12:12.2299374Z Running 11 items in this shard: test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_check_overlapping, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_chunked_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_device_placement, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_enumerable_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_chunk_sharding_params, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_chunked_dim_size, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_get_split_size, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestShardingSpec::test_infer_sharding_spec_from_shards_metadata, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec_shard_tensor, test/distributed/_shard/sharding_spec/test_sharding_spec.py::TestCustomShardingSpec::test_custom_sharding_spec_tensor_ctor 2024-08-06T21:12:12.2306410Z 2024-08-06T21:12:12.2306689Z Running distributed/fsdp/test_utils 1/1 ... [2024-08-06 21:12:12.229396] 2024-08-06T21:12:12.2308200Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:12:12.229836] 2024-08-06T21:12:15.1544430Z 2024-08-06T21:12:15.1546051Z distributed/fsdp/test_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_utils_1.1_d35dd1a4ca3db7c6_.log 2024-08-06T21:12:15.1549517Z Running 5 items in this shard: test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_cpu_cuda, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices0, test/distributed/fsdp/test_utils.py::TestUtils::test_apply_to_tensors_devices1, test/distributed/fsdp/test_utils.py::TestUtils::test_packed_sequence, test/distributed/fsdp/test_utils.py::TestUtils::test_replace_by_prefix 2024-08-06T21:12:15.1552209Z 2024-08-06T21:12:15.1552518Z Running distributed/fsdp/test_fsdp_meta 1/1 ... [2024-08-06 21:12:15.154819] 2024-08-06T21:12:15.1555163Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_meta.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:12:15.155272] 2024-08-06T21:12:40.1139430Z 2024-08-06T21:12:40.1141183Z distributed/fsdp/test_fsdp_meta 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_meta_1.1_2e1fd32f2190fb8e_.log 2024-08-06T21:12:40.1152374Z Running 15 items in this shard: test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_bad_arg_meta, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_bad_arg_torchdistx, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_meta_device_with_mixed_precision, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_default_init_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_default_init_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_reset_params_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_meta_device_reset_params_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_default_init_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_default_init_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_init_fn_auto_wrap_False, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_nested_model_with_torchdistX_init_fn_auto_wrap_True, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_meta_device_default_init, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_meta_device_reset_params, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_torchdistX_default_init, test/distributed/fsdp/test_fsdp_meta.py::TestFSDPWithMetaDevice::test_simple_model_with_torchdistX_init_fn 2024-08-06T21:12:40.1160121Z 2024-08-06T21:12:40.1160496Z Running distributed/algorithms/quantization/test_quantization 1/1 ... [2024-08-06 21:12:40.114403] 2024-08-06T21:12:40.1217117Z MPI not available -- MPI backend tests will be skipped 2024-08-06T21:12:40.1219083Z Running distributed tests for the test backend with env init_method 2024-08-06T21:12:40.1227008Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:12:40.122462] 2024-08-06T21:12:42.6316540Z 2024-08-06T21:12:42.6318191Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_74f8dbebcf8dae14_.log 2024-08-06T21:12:42.6319625Z Running 0 items in this shard: 2024-08-06T21:12:42.6319885Z 2024-08-06T21:12:42.6325048Z Running distributed tests for the test backend with file init_method 2024-08-06T21:12:42.6331093Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:12:42.632855] 2024-08-06T21:12:45.1694208Z 2024-08-06T21:12:45.1696252Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_7f1548be9910fbb8_.log 2024-08-06T21:12:45.1697667Z Running 0 items in this shard: 2024-08-06T21:12:45.1697892Z 2024-08-06T21:12:45.1702896Z Running distributed tests for the gloo backend with env init_method 2024-08-06T21:12:45.1709219Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:12:45.170625] 2024-08-06T21:13:09.5552403Z 2024-08-06T21:13:09.5553785Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_b4e8ec43c012f2a9_.log 2024-08-06T21:13:09.5557929Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-08-06T21:13:09.5561688Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16 2024-08-06T21:13:09.5563142Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16 2024-08-06T21:13:09.5564367Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16 2024-08-06T21:13:09.5565626Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16 2024-08-06T21:13:09.5566855Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16 2024-08-06T21:13:09.5568260Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-08-06T21:13:09.5569004Z 2024-08-06T21:13:09.5569250Z Running distributed tests for the gloo backend with file init_method 2024-08-06T21:13:09.5570668Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/quantization/test_quantization.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:13:09.556697] 2024-08-06T21:13:34.6951652Z 2024-08-06T21:13:34.6952944Z distributed/algorithms/quantization/test_quantization 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_27aeb1d4402e8188_.log 2024-08-06T21:13:34.6957383Z Running 6 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16, test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-08-06T21:13:34.6961130Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_bfp16 2024-08-06T21:13:34.6962462Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_gather_fp16 2024-08-06T21:13:34.6963659Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_bfp16 2024-08-06T21:13:34.6964839Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_fp16 2024-08-06T21:13:34.6966344Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_bfp16 2024-08-06T21:13:34.6967727Z Running 1 items in this shard: test/distributed/algorithms/quantization/test_quantization.py::DistQuantizationTests::test_all_to_all_single_fp16 2024-08-06T21:13:34.6968467Z 2024-08-06T21:13:34.6968721Z Running distributed/fsdp/test_wrap 1/1 ... [2024-08-06 21:13:34.696415] 2024-08-06T21:13:34.6970184Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_wrap.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:13:34.696815] 2024-08-06T21:14:52.6798172Z 2024-08-06T21:14:52.6799587Z distributed/fsdp/test_wrap 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_wrap_1.1_5c56c79543dc905c_.log 2024-08-06T21:14:52.6827710Z Running 51 items in this shard: test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_bn_always_wrapped_individually, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_False_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_False_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_True_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_error_already_wrapped_nested_True_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_False_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_False_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_True_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch0_forward_prefetch_True_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_False_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_False_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_True_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload0_backward_prefetch1_forward_prefetch_True_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_False_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_False_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_True_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch0_forward_prefetch_True_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_False_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_False_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_True_cuda_init_mode0, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_main_wrap_api_cpu_offload1_backward_prefetch1_forward_prefetch_True_cuda_init_mode1, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_wrap_batchnorm_individually_use_or_policy_False, test/distributed/fsdp/test_wrap.py::TestFSDPWrap::test_wrap_batchnorm_individually_use_or_policy_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_always_wrap, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_always_wrap_with_ignored_modules_wrap_method0, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_always_wrap_with_ignored_modules_wrap_method1, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_api, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_exclude_wrap, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_exclude_wrap_include_children, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_force_leaf, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_preset_force_leaf_custom, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode0_cpu_offload0_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode0_cpu_offload0_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode0_cpu_offload1_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode0_cpu_offload1_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode1_cpu_offload0_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode1_cpu_offload0_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode1_cpu_offload1_use_device_id_False, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_smoke_test_cuda_init_mode1_cpu_offload1_use_device_id_True, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_with_ignored_modules_wrap_method0, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_auto_wrap_with_ignored_modules_wrap_method1, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_custom_policy, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_frozen_params, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_module_wrap_policy, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_module_wrap_policy_callable, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_transformer_auto_wrap_policy, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_disabled_outside_context, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_override_defaults, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_wrap_method0, test/distributed/fsdp/test_wrap.py::TestAutoWrap::test_wrap_wrap_method1, test/distributed/fsdp/test_wrap.py::TestWrapUtils::test_validate_frozen_params 2024-08-06T21:14:52.6851206Z 2024-08-06T21:14:52.6851491Z Running distributed/algorithms/test_join 1/1 ... [2024-08-06 21:14:52.680516] 2024-08-06T21:14:52.6852779Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/algorithms/test_join.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:14:52.681024] 2024-08-06T21:15:19.2925213Z 2024-08-06T21:15:19.2927286Z distributed/algorithms/test_join 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.algorithms.test_join_1.1_a609eb172fe5f2e7_.log 2024-08-06T21:15:19.2934263Z Running 9 items in this shard: test/distributed/algorithms/test_join.py::TestJoin::test_join_kwargs, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinable_disable, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinables, test/distributed/algorithms/test_join.py::TestJoin::test_multiple_joinables_throw, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_disable, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_main_hooks, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_post_hooks, test/distributed/algorithms/test_join.py::TestJoin::test_single_joinable_throw 2024-08-06T21:15:19.2940039Z 2024-08-06T21:15:19.2940466Z Running distributed/fsdp/test_fsdp_checkpoint 1/1 ... [2024-08-06 21:15:19.292903] 2024-08-06T21:15:19.2942326Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_checkpoint.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:15:19.293490] 2024-08-06T21:16:11.0712981Z 2024-08-06T21:16:11.0714276Z distributed/fsdp/test_fsdp_checkpoint 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_checkpoint_1.1_6265c3d68bd5f456_.log 2024-08-06T21:16:11.0727916Z Running 17 items in this shard: test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload0_offload_activations_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_basic_checkpoint_end_to_end_cpu_offload1_offload_activations_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload0_offload_activations_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_False_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_False_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_True_use_orig_params_False, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpoint::test_checkpoint_fsdp_wrapping_cpu_offload1_offload_activations_True_use_orig_params_True, test/distributed/fsdp/test_fsdp_checkpoint.py::TestFSDPCheckpointSubmodule::test_checkpoint_submodule_use_reentrant_False 2024-08-06T21:16:11.0739642Z 2024-08-06T21:16:11.0739930Z Running distributed/fsdp/test_fsdp_fine_tune 1/1 ... [2024-08-06 21:16:11.071926] 2024-08-06T21:16:11.0741210Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_fine_tune.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:16:11.072411] 2024-08-06T21:16:13.9469927Z 2024-08-06T21:16:13.9471248Z distributed/fsdp/test_fsdp_fine_tune 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_3c55217be77f83c0_.log 2024-08-06T21:16:13.9474162Z Running 4 items in this shard: test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_backward_reshard_hooks, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_hooks_multi_traversal, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_parity_with_ddp, test/distributed/fsdp/test_fsdp_fine_tune.py::TestFSDPFineTune::test_parity_with_non_frozen_fsdp 2024-08-06T21:16:13.9476579Z 2024-08-06T21:16:13.9476903Z Running distributed/_shard/test_sharder 1/1 ... [2024-08-06 21:16:13.947501] 2024-08-06T21:16:13.9481997Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/test_sharder.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:16:13.947962] 2024-08-06T21:16:16.5222015Z 2024-08-06T21:16:16.5223067Z distributed/_shard/test_sharder 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.test_sharder_1.1_f9987e621e7e564a_.log 2024-08-06T21:16:16.5224657Z Running 2 items in this shard: test/distributed/_shard/test_sharder.py::TestCustomSharder::test_custom_sharder, test/distributed/_shard/test_sharder.py::TestCustomSharder::test_custom_sharder_errors 2024-08-06T21:16:16.5225548Z 2024-08-06T21:16:16.5228769Z Running distributed/fsdp/test_fsdp_exec_order 1/1 ... [2024-08-06 21:16:16.522693] 2024-08-06T21:16:16.5233767Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/fsdp/test_fsdp_exec_order.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:16:16.523151] 2024-08-06T21:16:42.8969636Z 2024-08-06T21:16:42.8970701Z distributed/fsdp/test_fsdp_exec_order 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_ff1f1993be97ffc8_.log 2024-08-06T21:16:42.8976207Z Running 8 items in this shard: test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_first_iter_order_sharding_strategy1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy0_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_1, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_invalid_later_iter_order_sharding_strategy1_iters_before_path_change_3, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy0, test/distributed/fsdp/test_fsdp_exec_order.py::TestFSDPExecOrder::test_train_eval_sharding_strategy1 2024-08-06T21:16:42.8980987Z 2024-08-06T21:16:42.8981579Z Running distributed/_shard/sharding_plan/test_sharding_plan 1/1 ... [2024-08-06 21:16:42.897379] 2024-08-06T21:16:42.8983014Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/sharding_plan/test_sharding_plan.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:16:42.897881] 2024-08-06T21:16:45.4723270Z 2024-08-06T21:16:45.4724463Z distributed/_shard/sharding_plan/test_sharding_plan 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharding_plan.test_sharding_plan_1.1_b543825be598ee47_.log 2024-08-06T21:16:45.4726967Z Running 3 items in this shard: test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_custom_sharding_planner, test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_shard_module_sub_process_group, test/distributed/_shard/sharding_plan/test_sharding_plan.py::TestShardingPlan::test_sharding_plan_errors 2024-08-06T21:16:45.4728659Z 2024-08-06T21:16:45.4729390Z Running distributed/rpc/test_tensorpipe_agent 1/3 ... [2024-08-06 21:16:45.472764] 2024-08-06T21:16:45.4734347Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=1', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:16:45.473215] 2024-08-06T21:34:59.1466471Z 2024-08-06T21:34:59.1467536Z distributed/rpc/test_tensorpipe_agent 1/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_1.3_1c33cc0adf9f09e3_.log 2024-08-06T21:34:59.1573730Z Running 153 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_with_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_chain, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_in_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_custom_exception_throw_during_reconstruction, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_deadlock, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_nested_callback, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown_with_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_my_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_key_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_constructor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_same_worker, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_partial_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_non_exist, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc_torchscript, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_script_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_body, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wrong_types, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_no_grad_on_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backwards_nested_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_clean_context_during_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_error_in_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_copy_sparse_indices_extra_ref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_backward_accumulate_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_post_hooks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception_on_constructor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_all_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_kwargs_are_neither_passed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_simple, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_kwargs_not_passed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_more_than_needed_args_are_specified, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_module_rref_in_py_and_use_in_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_some_kwargs_are_populated_by_defaults, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_bad_module, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_unsupported_methods, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeReinforcementLearningRpcTest::test_rl_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_mismatched_type_for_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_builtin_remote_ret_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_non_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_world_size_one_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_nested_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-08-06T21:34:59.1642659Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add 2024-08-06T21:34:59.1643565Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_with_id 2024-08-06T21:34:59.1644494Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather 2024-08-06T21:34:59.1645498Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_all_gather_timeout 2024-08-06T21:34:59.1646460Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method 2024-08-06T21:34:59.1647465Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_method_remote 2024-08-06T21:34:59.1648489Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy 2024-08-06T21:34:59.1649495Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_chained 2024-08-06T21:34:59.1650563Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_async 2024-08-06T21:34:59.1651692Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained_remote 2024-08-06T21:34:59.1652786Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout 2024-08-06T21:34:59.1653855Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_async 2024-08-06T21:34:59.1654915Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested 2024-08-06T21:34:59.1655953Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_nested_remote 2024-08-06T21:34:59.1656979Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise 2024-08-06T21:34:59.1657996Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_raise_remote 2024-08-06T21:34:59.1659025Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_simple 2024-08-06T21:34:59.1660076Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor 2024-08-06T21:34:59.1661160Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type 2024-08-06T21:34:59.1662302Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_double_end_callbacks 2024-08-06T21:34:59.1663504Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method 2024-08-06T21:34:59.1664562Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_self 2024-08-06T21:34:59.1665518Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_chain 2024-08-06T21:34:59.1666470Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_in_rpc 2024-08-06T21:34:59.1667453Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_num 2024-08-06T21:34:59.1668516Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_cannot_infer_backend_from_options 2024-08-06T21:34:59.1669669Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_custom_exception_throw_during_reconstruction 2024-08-06T21:34:59.1670727Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_deadlock 2024-08-06T21:34:59.1671638Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_debug_info 2024-08-06T21:34:59.1672549Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_expected_src 2024-08-06T21:34:59.1673523Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_future_nested_callback 2024-08-06T21:34:59.1674682Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_pg_then_rpc 2024-08-06T21:34:59.1675678Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown_with_rpc 2024-08-06T21:34:59.1676702Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_value_not_on_owner 2024-08-06T21:34:59.1677694Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_mark_future_twice 2024-08-06T21:34:59.1678639Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_rpc 2024-08-06T21:34:59.1679575Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_my_parameter_server 2024-08-06T21:34:59.1680521Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rpc 2024-08-06T21:34:59.1681454Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pass_local_rrefs 2024-08-06T21:34:59.1682422Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pg_init_no_rpc_init 2024-08-06T21:34:59.1683413Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_key_names 2024-08-06T21:34:59.1684409Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_memory 2024-08-06T21:34:59.1685590Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context_single_threaded 2024-08-06T21:34:59.1686809Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin_single_threaded 2024-08-06T21:34:59.1688011Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_async_rpc_single_threaded 2024-08-06T21:34:59.1689145Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf 2024-08-06T21:34:59.1690363Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_sync_rpc_udf_single_threaded 2024-08-06T21:34:59.1691442Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_constructor 2024-08-06T21:34:59.1692492Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_method 2024-08-06T21:34:59.1693471Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_function_exception 2024-08-06T21:34:59.1694465Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_no_return_result 2024-08-06T21:34:59.1695442Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func 2024-08-06T21:34:59.1696510Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_raise_in_user_func_escaped_str 2024-08-06T21:34:59.1697577Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_in_container 2024-08-06T21:34:59.1698563Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_same_worker 2024-08-06T21:34:59.1699513Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_throw 2024-08-06T21:34:59.1700478Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_remote_with_exception 2024-08-06T21:34:59.1701464Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_local_rrefs 2024-08-06T21:34:59.1702457Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_multithreaded 2024-08-06T21:34:59.1703501Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_partial_subset 2024-08-06T21:34:59.1704506Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_subset 2024-08-06T21:34:59.1705526Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function 2024-08-06T21:34:59.1706544Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_non_exist 2024-08-06T21:34:59.1707519Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_reuse 2024-08-06T21:34:59.1708501Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor_self 2024-08-06T21:34:59.1709525Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_py_pickle_not_supported 2024-08-06T21:34:59.1710524Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_timeout 2024-08-06T21:34:59.1711473Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_blocking 2024-08-06T21:34:59.1712464Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_non_blocking 2024-08-06T21:34:59.1713482Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_non_blocking 2024-08-06T21:34:59.1714562Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_non_blocking 2024-08-06T21:34:59.1715599Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_py_udf_remote 2024-08-06T21:34:59.1716613Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_remote_arg 2024-08-06T21:34:59.1717688Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc 2024-08-06T21:34:59.1718747Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_heavy_rpc_torchscript 2024-08-06T21:34:59.1719760Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_stress_light_rpc 2024-08-06T21:34:59.1720715Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rref_backward 2024-08-06T21:34:59.1721701Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed 2024-08-06T21:34:59.1722724Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_user_rrefs_confirmed_remote 2024-08-06T21:34:59.1723775Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_builtin 2024-08-06T21:34:59.1724851Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_script_function 2024-08-06T21:34:59.1725981Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_multiple_call 2024-08-06T21:34:59.1726993Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_raise_in_body 2024-08-06T21:34:59.1727964Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_timeout 2024-08-06T21:34:59.1728904Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wrong_types 2024-08-06T21:34:59.1729902Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_async_dist_autograd 2024-08-06T21:34:59.1730992Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_invalid_args 2024-08-06T21:34:59.1732104Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_no_grad_on_tensor 2024-08-06T21:34:59.1733192Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref 2024-08-06T21:34:59.1734230Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple 2024-08-06T21:34:59.1735326Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_simple_python_udf 2024-08-06T21:34:59.1736448Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_context 2024-08-06T21:34:59.1737559Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_without_rpc 2024-08-06T21:34:59.1738680Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backwards_nested_python_udf 2024-08-06T21:34:59.1739838Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_clean_context_during_backward 2024-08-06T21:34:59.1740921Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_debug_info 2024-08-06T21:34:59.1741939Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_error_in_context 2024-08-06T21:34:59.1743076Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_copy_sparse_indices_extra_ref 2024-08-06T21:34:59.1744239Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_grad_only_on_return_value 2024-08-06T21:34:59.1745468Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_remote_call 2024-08-06T21:34:59.1746714Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_call_itself 2024-08-06T21:34:59.1747839Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward 2024-08-06T21:34:59.1748955Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_nested_backward_accumulate_grads 2024-08-06T21:34:59.1750057Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_post_hooks 2024-08-06T21:34:59.1751062Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim 2024-08-06T21:34:59.1752107Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception 2024-08-06T21:34:59.1753277Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistOptimizerTest::test_dist_optim_exception_on_constructor 2024-08-06T21:34:59.1754490Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_all_kwargs_are_populated_by_defaults 2024-08-06T21:34:59.1755637Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_args_kwargs_are_neither_passed 2024-08-06T21:34:59.1756704Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_simple 2024-08-06T21:34:59.1757791Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type 2024-08-06T21:34:59.1758869Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_throw 2024-08-06T21:34:59.1759865Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_script_udf 2024-08-06T21:34:59.1760837Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_simple 2024-08-06T21:34:59.1761848Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_callback_with_exception 2024-08-06T21:34:59.1762866Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_kwargs_not_passed 2024-08-06T21:34:59.1763933Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_less_than_needed_args_are_specified 2024-08-06T21:34:59.1765096Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_more_than_needed_args_are_specified 2024-08-06T21:34:59.1766325Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_no_kwargs_are_populated_by_defaults 2024-08-06T21:34:59.1767409Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_remote_script_udf 2024-08-06T21:34:59.1768553Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_module_rref_in_py_and_use_in_script 2024-08-06T21:34:59.1769781Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_torchscript_record_function 2024-08-06T21:34:59.1770825Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_is_owner 2024-08-06T21:34:59.1771859Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_jit_pickle_not_supported 2024-08-06T21:34:59.1773045Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_some_kwargs_are_populated_by_defaults 2024-08-06T21:34:59.1774201Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function 2024-08-06T21:34:59.1775452Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_torchscript_function_exception 2024-08-06T21:34:59.1776530Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed 2024-08-06T21:34:59.1777528Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_bad_module 2024-08-06T21:34:59.1778534Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_sync 2024-08-06T21:34:59.1779675Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported 2024-08-06T21:34:59.1780830Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_unsupported_methods 2024-08-06T21:34:59.1781967Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside 2024-08-06T21:34:59.1783223Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpUnderDistAutogradTest::test_backward_ddp_outside_uneven_inputs 2024-08-06T21:34:59.1784486Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_dist_autograd_sparse_grads 2024-08-06T21:34:59.1785619Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeReinforcementLearningRpcTest::test_rl_rpc 2024-08-06T21:34:59.1786921Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank_cuda 2024-08-06T21:34:59.1788418Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_new_rank_can_communicated_with_existing_rank 2024-08-06T21:34:59.1789778Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_mismatched_type_for_options 2024-08-06T21:34:59.1791011Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_builtin_remote_ret_sparse 2024-08-06T21:34:59.1792204Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_multi_rpc_sparse 2024-08-06T21:34:59.1793336Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rref_sparse 2024-08-06T21:34:59.1794533Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_rref_args_user_share_sparse 2024-08-06T21:34:59.1795798Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_rref_get_type_timeout_non_blocking 2024-08-06T21:34:59.1797040Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_sparse 2024-08-06T21:34:59.1798218Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_world_size_one_sparse 2024-08-06T21:34:59.1799420Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_sparse 2024-08-06T21:34:59.1800748Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_nested_rpc_sparse 2024-08-06T21:34:59.1802262Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_context_cleanup_tensor_with_grad_sparse 2024-08-06T21:34:59.1803808Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_itself_sparse 2024-08-06T21:34:59.1805217Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_call_sparse 2024-08-06T21:34:59.1806736Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote_sparse 2024-08-06T21:34:59.1808155Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_rpc_complex_args_sparse 2024-08-06T21:34:59.1808858Z 2024-08-06T21:34:59.1809149Z Running distributed/rpc/test_tensorpipe_agent 3/3 ... [2024-08-06 21:34:59.154622] 2024-08-06T21:34:59.1810518Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/rpc/test_tensorpipe_agent.py', '--shard-id=3', '--num-shards=3', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:34:59.155062] 2024-08-06T21:54:51.8446887Z 2024-08-06T21:54:51.8448869Z distributed/rpc/test_tensorpipe_agent 3/3 was successful, full logs can be found in artifacts with path test/test-reports/distributed.rpc.test_tensorpipe_agent_3.3_454f70d984ac2ff2_.log 2024-08-06T21:54:51.8602749Z Running 167 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_done_callback, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_cbs_jit_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_call_method_on_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_ret, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_disable_gil_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_ignore_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_then_pg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_rref_no_fork, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_layer_nested_async_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nonzero, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_static_method, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args_user_share, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_udf_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_register_rpc_backend_and_set_and_start_rpc_backend, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_remote_record_function, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_return_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_blocking, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_exception, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_accumulate_grads, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_autograd_engine_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_dtypes, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_roots, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure_python_udf, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_python_udf_error, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_verify_hooks, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_nested_rpc, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_no_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call_itself, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_call, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_mixed_requires_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_thread_local_context_id, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_rpc_with_profiling, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_class_rref_in_py, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_module_rref_in_py, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_python_annotation, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_my_script_module_with_rrefs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_class_rref_in_py_and_use_in_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_python_annotation, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed_remote, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_self_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_infer_backend_from_options, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_remote_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_rpc_arg_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_send_to_rank_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_stress_heavy_rpc_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_options_throw_on_timedelta_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_twice_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_different_dtypes_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backwards_nested_python_udf_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_embedding_bag_with_no_grad_tensors, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse, test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_remote_complex_args_sparse 2024-08-06T21:54:51.8683897Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_add_done_callback 2024-08-06T21:54:51.8684878Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_add 2024-08-06T21:54:51.8685932Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_async 2024-08-06T21:54:51.8687015Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_class_rref_proxy_remote 2024-08-06T21:54:51.8688076Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_chained 2024-08-06T21:54:51.8689169Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_multi_fanout_remote 2024-08-06T21:54:51.8690307Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_with_future_ctor_remote 2024-08-06T21:54:51.8691693Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_function_wrong_return_type_async 2024-08-06T21:54:51.8692824Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_cbs_jit_call 2024-08-06T21:54:51.8694016Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_record_function_legacy 2024-08-06T21:54:51.8695076Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_async_static_method_remote 2024-08-06T21:54:51.8696075Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_builtin_remote_ret 2024-08-06T21:54:51.8697060Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_call_method_on_rref 2024-08-06T21:54:51.8698045Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_error 2024-08-06T21:54:51.8699023Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_with_ret 2024-08-06T21:54:51.8700006Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_callback_wrong_arg_type 2024-08-06T21:54:51.8701020Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_default_timeout_used 2024-08-06T21:54:51.8702020Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_disable_gil_profiling 2024-08-06T21:54:51.8703002Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_duplicate_name 2024-08-06T21:54:51.8704042Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_graceful_shutdown_with_uneven_workload 2024-08-06T21:54:51.8705129Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_handle_send_exceptions 2024-08-06T21:54:51.8706120Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_ignore_rref_leak 2024-08-06T21:54:51.8707069Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_init_rpc_then_pg 2024-08-06T21:54:51.8708024Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_invalid_names 2024-08-06T21:54:51.8708979Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_rref_no_fork 2024-08-06T21:54:51.8709934Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_local_shutdown 2024-08-06T21:54:51.8710923Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_layer_nested_async_rpc 2024-08-06T21:54:51.8711944Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_multi_py_udf_remote 2024-08-06T21:54:51.8712893Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref 2024-08-06T21:54:51.8713831Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nested_rref_stress 2024-08-06T21:54:51.8714791Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_non_cont_tensors 2024-08-06T21:54:51.8715711Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_nonzero 2024-08-06T21:54:51.8716623Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_owner_equality 2024-08-06T21:54:51.8717549Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_pickle_future 2024-08-06T21:54:51.8719045Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_export_trace 2024-08-06T21:54:51.8720108Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled 2024-08-06T21:54:51.8721337Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_remote_events_profiled_single_threaded 2024-08-06T21:54:51.8722481Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_rpc_record_shapes 2024-08-06T21:54:51.8723552Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_builtin 2024-08-06T21:54:51.8724630Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf 2024-08-06T21:54:51.8725828Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_async_rpc_udf_single_threaded 2024-08-06T21:54:51.8726974Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_autograd_context 2024-08-06T21:54:51.8728050Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_builtin 2024-08-06T21:54:51.8729172Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_remote_udf_single_threaded 2024-08-06T21:54:51.8730361Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_remote_rpc_single_threaded 2024-08-06T21:54:51.8731519Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc 2024-08-06T21:54:51.8732671Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_profiler_with_script_sync_rpc_single_threaded 2024-08-06T21:54:51.8733747Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_built_in 2024-08-06T21:54:51.8734707Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_class_static_method 2024-08-06T21:54:51.8735674Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args 2024-08-06T21:54:51.8736656Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_rref_args_user_share 2024-08-06T21:54:51.8737609Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors 2024-08-06T21:54:51.8738590Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_tensors_multi_async_call 2024-08-06T21:54:51.8739588Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_udf_remote 2024-08-06T21:54:51.8740539Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_py_user_defined 2024-08-06T21:54:51.8741631Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_register_rpc_backend_and_set_and_start_rpc_backend 2024-08-06T21:54:51.8742724Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future 2024-08-06T21:54:51.8743687Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_async 2024-08-06T21:54:51.8744661Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_return_future_remote 2024-08-06T21:54:51.8745632Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_barrier_all 2024-08-06T21:54:51.8746780Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_async_function_single_threaded 2024-08-06T21:54:51.8747956Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_profiling_remote_record_function 2024-08-06T21:54:51.8749050Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_return_rref 2024-08-06T21:54:51.8749993Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rpc_timeouts 2024-08-06T21:54:51.8750910Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_leak 2024-08-06T21:54:51.8751843Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class 2024-08-06T21:54:51.8752815Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_class_self 2024-08-06T21:54:51.8753802Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_proxy_tensor 2024-08-06T21:54:51.8754738Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_str 2024-08-06T21:54:51.8755690Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_owner_blocking 2024-08-06T21:54:51.8756739Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_rref_type_with_error_blocking 2024-08-06T21:54:51.8757838Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_remote_arg 2024-08-06T21:54:51.8758950Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_self_remote_rref_as_self_rpc_arg 2024-08-06T21:54:51.8760032Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_server_process_global_profiler 2024-08-06T21:54:51.8761114Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_set_and_get_default_rpc_timeout 2024-08-06T21:54:51.8762135Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_shutdown_errors 2024-08-06T21:54:51.8763071Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_use_rpc_pickler 2024-08-06T21:54:51.8763992Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all 2024-08-06T21:54:51.8764960Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_exit_early_python 2024-08-06T21:54:51.8766098Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_with_exception 2024-08-06T21:54:51.8767110Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_wait_all_workers_timeout 2024-08-06T21:54:51.8768076Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRpcTest::test_worker_id 2024-08-06T21:54:51.8769157Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeParameterServerTest::test_batch_updating_parameter_server 2024-08-06T21:54:51.8770346Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_accumulate_grads 2024-08-06T21:54:51.8771497Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_autograd_engine_error 2024-08-06T21:54:51.8772669Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_complex_python_udf 2024-08-06T21:54:51.8773896Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_different_dtypes 2024-08-06T21:54:51.8775246Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_output_tensors 2024-08-06T21:54:51.8776518Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_multiple_roots 2024-08-06T21:54:51.8777704Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_node_failure_python_udf 2024-08-06T21:54:51.8778865Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_python_udf_error 2024-08-06T21:54:51.8779979Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_rref_multi 2024-08-06T21:54:51.8781076Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_unused_tensors 2024-08-06T21:54:51.8782181Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_backward_verify_hooks 2024-08-06T21:54:51.8783295Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_nested_rpc 2024-08-06T21:54:51.8784447Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_no_tensors 2024-08-06T21:54:51.8785616Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_context_cleanup_tensor_no_grad 2024-08-06T21:54:51.8786767Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_builtin_call 2024-08-06T21:54:51.8787909Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call 2024-08-06T21:54:51.8789145Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_py_nested_remote_call_itself 2024-08-06T21:54:51.8790335Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_graph_for_python_call 2024-08-06T21:54:51.8791425Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_mixed_requires_grad 2024-08-06T21:54:51.8792545Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_multiple_backward_with_errors 2024-08-06T21:54:51.8793646Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy 2024-08-06T21:54:51.8794694Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_grad_copy_sparse 2024-08-06T21:54:51.8795852Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad 2024-08-06T21:54:51.8797140Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_no_graph_with_tensors_not_require_grad_remote 2024-08-06T21:54:51.8798332Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_remote_complex_args 2024-08-06T21:54:51.8799426Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_thread_local_context_id 2024-08-06T21:54:51.8800468Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps 2024-08-06T21:54:51.8801574Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_trainer_ps_torchscript_functions 2024-08-06T21:54:51.8802789Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDistAutogradTest::test_worker_ids_recorded 2024-08-06T21:54:51.8803911Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_decorator_order 2024-08-06T21:54:51.8805140Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_async_function_wrong_return_type_remote 2024-08-06T21:54:51.8806475Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_python_function_remotely_from_script_not_supported 2024-08-06T21:54:51.8807668Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_rpc_with_profiling 2024-08-06T21:54:51.8808845Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_call_script_function_that_raises_remotely_from_script 2024-08-06T21:54:51.8810080Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_class_rref_in_py 2024-08-06T21:54:51.8811259Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_local_script_module_rref_in_py 2024-08-06T21:54:51.8812412Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_create_script_module_on_remote 2024-08-06T21:54:51.8813543Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_passed_between_python_and_jit 2024-08-06T21:54:51.8814664Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_future_python_annotation 2024-08-06T21:54:51.8815782Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_load_script_module_with_pickled_rref 2024-08-06T21:54:51.8816915Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_my_script_module_with_rrefs 2024-08-06T21:54:51.8818028Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_record_function_on_caller_rpc_async 2024-08-06T21:54:51.8819271Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_return_local_script_class_rref_in_py_and_use_in_script 2024-08-06T21:54:51.8820454Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rpc_async_jit_profiled 2024-08-06T21:54:51.8821470Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_list_mutate 2024-08-06T21:54:51.8822445Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_local_value 2024-08-06T21:54:51.8823464Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_rref_python_annotation 2024-08-06T21:54:51.8824532Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeJitRpcTest::test_user_rrefs_confirmed_remote 2024-08-06T21:54:51.8825578Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async 2024-08-06T21:54:51.8826632Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_async_script 2024-08-06T21:54:51.8827715Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_forward_with_kwargs 2024-08-06T21:54:51.8828769Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_get_module_rref 2024-08-06T21:54:51.8829932Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_module_py_pickle_not_supported_script 2024-08-06T21:54:51.8831193Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeRemoteModuleTest::test_remote_parameters 2024-08-06T21:54:51.8832301Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison 2024-08-06T21:54:51.8833425Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeDdpComparisonTest::test_ddp_comparison_uneven_inputs 2024-08-06T21:54:51.8834623Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_builtin_remote_self_sparse 2024-08-06T21:54:51.8835893Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_and_static_init_rpc_together 2024-08-06T21:54:51.8837298Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_dynamic_rpc_existing_rank_can_communicate_with_new_rank 2024-08-06T21:54:51.8838649Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_infer_backend_from_options 2024-08-06T21:54:51.8839817Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_nested_rpc_sparse 2024-08-06T21:54:51.8840965Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_op_with_invalid_args 2024-08-06T21:54:51.8842174Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_py_sparse_tensors_in_container 2024-08-06T21:54:51.8843455Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_remote_arg_sparse 2024-08-06T21:54:51.8844768Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_rpc_arg_sparse 2024-08-06T21:54:51.8846149Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_self_remote_rref_as_self_rpc_arg_sparse 2024-08-06T21:54:51.8847396Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_send_to_rank_sparse 2024-08-06T21:54:51.8848554Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_stress_heavy_rpc_sparse 2024-08-06T21:54:51.8849846Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_options_throw_on_timedelta_timeout 2024-08-06T21:54:51.8851175Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_tensorpipe_set_default_timeout 2024-08-06T21:54:51.8852436Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentRpcTest::test_wait_all_workers_twice_sparse 2024-08-06T21:54:51.8853741Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_different_dtypes_sparse 2024-08-06T21:54:51.8855148Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_multiple_round_trips_sparse 2024-08-06T21:54:51.8856524Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_rref_nested_sparse 2024-08-06T21:54:51.8857887Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_python_udf_sparse 2024-08-06T21:54:51.8859267Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backward_simple_script_call_sparse 2024-08-06T21:54:51.8860735Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_backwards_nested_python_udf_sparse 2024-08-06T21:54:51.8862175Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_embedding_bag_with_no_grad_tensors 2024-08-06T21:54:51.8863580Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_builtin_remote_call_sparse 2024-08-06T21:54:51.8864959Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_call_sparse 2024-08-06T21:54:51.8866364Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_py_nested_remote_call_sparse 2024-08-06T21:54:51.8867788Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_graph_for_python_remote_call_sparse 2024-08-06T21:54:51.8869164Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_mixed_requires_grad_sparse 2024-08-06T21:54:51.8870474Z Running 1 items in this shard: test/distributed/rpc/test_tensorpipe_agent.py::TensorPipeTensorPipeAgentDistAutogradTest::test_remote_complex_args_sparse 2024-08-06T21:54:51.8871204Z 2024-08-06T21:54:51.8871424Z Running distributed/test_c10d_ucc 1/1 ... [2024-08-06 21:54:51.855464] 2024-08-06T21:54:51.8872682Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_ucc.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:54:51.856063] 2024-08-06T21:54:53.3127884Z 2024-08-06T21:54:53.3129448Z distributed/test_c10d_ucc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_ucc_1.1_64ef50b2eeff4372_.log 2024-08-06T21:54:53.3130826Z 2024-08-06T21:54:53.3136275Z Running distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1 ... [2024-08-06 21:54:53.313394] 2024-08-06T21:54:53.3142393Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_tensor_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:54:53.313903] 2024-08-06T21:54:55.9385538Z 2024-08-06T21:54:55.9387578Z distributed/_shard/sharded_tensor/ops/test_tensor_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_tensor_ops_1.1_5059dcad59e9afe9_.log 2024-08-06T21:54:55.9393333Z Running 5 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_clone, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_deep_copy, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_detach, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_inplace_copy, test/distributed/_shard/sharded_tensor/ops/test_tensor_ops.py::TestTensorOps::test_set_requires_grad 2024-08-06T21:54:55.9397175Z 2024-08-06T21:54:55.9397804Z Running distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 ... [2024-08-06 21:54:55.939338] 2024-08-06T21:54:55.9402727Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/_shard/sharded_tensor/ops/test_binary_cmp.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:54:55.939923] 2024-08-06T21:54:58.5643749Z 2024-08-06T21:54:58.5645311Z distributed/_shard/sharded_tensor/ops/test_binary_cmp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed._shard.sharded_tensor.ops.test_binary_cmp_1.1_c70ed2c53e28960d_.log 2024-08-06T21:54:58.5648665Z Running 4 items in this shard: test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_allclose, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_allclose_tensor_specs, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_equal, test/distributed/_shard/sharded_tensor/ops/test_binary_cmp.py::TestShardedTensorBinaryOps::test_torch_equal_tensor_specs 2024-08-06T21:54:58.5651543Z 2024-08-06T21:54:58.5651790Z Running distributed/test_c10d_gloo 1/1 ... [2024-08-06 21:54:58.564878] 2024-08-06T21:54:58.5655926Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_gloo.py', '--shard-id=1', '--num-shards=1', '-v', '--subprocess', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 21:54:58.565337] 2024-08-06T22:06:18.6608227Z 2024-08-06T22:06:18.6609788Z distributed/test_c10d_gloo 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_gloo_1.1_32d509d1740021f6_.log 2024-08-06T22:06:18.6698110Z Running 122 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init, test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_round_robin, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_round_robin_create_destroy, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks, test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input, test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer, test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket, test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket, test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu, test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership, test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo, test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex, test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend, test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg, test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check 2024-08-06T22:06:18.6751898Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::RendezvousEnvTest::test_logging_init 2024-08-06T22:06:18.6752762Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::TimeoutTest::test_default_store_timeout_gloo 2024-08-06T22:06:18.6753642Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics 2024-08-06T22:06:18.6754550Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_basics_cuda 2024-08-06T22:06:18.6755445Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_checks 2024-08-06T22:06:18.6756368Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_async 2024-08-06T22:06:18.6757313Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_coalesced_checks 2024-08-06T22:06:18.6758295Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_into_tensor_coalesced 2024-08-06T22:06:18.6759298Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_noncontiguous_input 2024-08-06T22:06:18.6760237Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress 2024-08-06T22:06:18.6761125Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allgather_stress_cuda 2024-08-06T22:06:18.6762020Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics 2024-08-06T22:06:18.6762916Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_basics_cuda 2024-08-06T22:06:18.6763809Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_checks 2024-08-06T22:06:18.6764710Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_async 2024-08-06T22:06:18.6765663Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_basics 2024-08-06T22:06:18.6766681Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks 2024-08-06T22:06:18.6767655Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_checks_cuda 2024-08-06T22:06:18.6768638Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_coalesced_stress 2024-08-06T22:06:18.6769561Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress 2024-08-06T22:06:18.6770458Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_allreduce_stress_cuda 2024-08-06T22:06:18.6771359Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_barrier_implies_wait 2024-08-06T22:06:18.6772247Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics 2024-08-06T22:06:18.6773135Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_basics_cuda 2024-08-06T22:06:18.6774166Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_checks 2024-08-06T22:06:18.6775238Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress 2024-08-06T22:06:18.6776291Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_broadcast_stress_cuda 2024-08-06T22:06:18.6777181Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_empty_tensors 2024-08-06T22:06:18.6778021Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics 2024-08-06T22:06:18.6778899Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_basics_cuda 2024-08-06T22:06:18.6779772Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_checks 2024-08-06T22:06:18.6780671Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_noncontiguous_input 2024-08-06T22:06:18.6781574Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress 2024-08-06T22:06:18.6782445Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_gather_stress_cuda 2024-08-06T22:06:18.6783356Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_multi_device_constructor 2024-08-06T22:06:18.6784237Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics 2024-08-06T22:06:18.6785105Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_basics_cuda 2024-08-06T22:06:18.6785972Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_checks 2024-08-06T22:06:18.6786841Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor 2024-08-06T22:06:18.6787808Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_scatter_tensor_coalesced 2024-08-06T22:06:18.6788741Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress 2024-08-06T22:06:18.6789615Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_reduce_stress_cuda 2024-08-06T22:06:18.6790468Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_round_robin 2024-08-06T22:06:18.6791370Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_round_robin_create_destroy 2024-08-06T22:06:18.6792279Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics 2024-08-06T22:06:18.6793145Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_basics_cuda 2024-08-06T22:06:18.6794024Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_checks 2024-08-06T22:06:18.6794883Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress 2024-08-06T22:06:18.6795759Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_scatter_stress_cuda 2024-08-06T22:06:18.6796646Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_send_recv_all_to_all 2024-08-06T22:06:18.6797542Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_set_gloo_pg_timeout 2024-08-06T22:06:18.6798455Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics 2024-08-06T22:06:18.6799393Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_basics_cuda 2024-08-06T22:06:18.6800431Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_checks 2024-08-06T22:06:18.6801411Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ProcessGroupGlooTest::test_sparse_allreduce_cuda_dispatched 2024-08-06T22:06:18.6802452Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output 2024-08-06T22:06:18.6803447Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_dataclass_output_unused_param 2024-08-06T22:06:18.6804536Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_module 2024-08-06T22:06:18.6805679Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_dynamic_weight_sharing 2024-08-06T22:06:18.6806943Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_False 2024-08-06T22:06:18.6808135Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_once_use_reentrant_True 2024-08-06T22:06:18.6809384Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_False 2024-08-06T22:06:18.6810683Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_static_graph_use_reentrant_True 2024-08-06T22:06:18.6811915Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_False 2024-08-06T22:06:18.6813106Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_use_reentrant_True 2024-08-06T22:06:18.6814278Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_twice_weight_sharing 2024-08-06T22:06:18.6815477Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_False 2024-08-06T22:06:18.6816714Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_unused_params_use_reentrant_True 2024-08-06T22:06:18.6817969Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_False 2024-08-06T22:06:18.6819229Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_checkpointing_weight_sharing_use_reentrant_True 2024-08-06T22:06:18.6820403Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_cpu 2024-08-06T22:06:18.6821512Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_future_passing_gpu_gloo 2024-08-06T22:06:18.6822628Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_register_just_once 2024-08-06T22:06:18.6823725Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_comm_hook_sparse_gradients 2024-08-06T22:06:18.6824783Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_init 2024-08-06T22:06:18.6825841Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ddp_invalid_comm_hook_return_type 2024-08-06T22:06:18.6827024Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_find_unused_parameters_when_unused_parameters_empty 2024-08-06T22:06:18.6828253Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad 2024-08-06T22:06:18.6829398Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_grad_is_view 2024-08-06T22:06:18.6830679Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_global_local_unused_params_grad_with_static_graph 2024-08-06T22:06:18.6831902Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_integer_list 2024-08-06T22:06:18.6833141Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_1gpu_module_device_ids_torch_device_list 2024-08-06T22:06:18.6834271Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_2gpu_module 2024-08-06T22:06:18.6835289Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_4gpu_module 2024-08-06T22:06:18.6836297Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module 2024-08-06T22:06:18.6837370Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_gloo_backend_cpu_module_grad_is_view 2024-08-06T22:06:18.6838388Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output 2024-08-06T22:06:18.6839423Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_output_with_unused_parameters 2024-08-06T22:06:18.6840491Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_ignored_sharded_tensor 2024-08-06T22:06:18.6841478Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_invalid_powerSGD_state 2024-08-06T22:06:18.6842465Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_save_load_checkpoint 2024-08-06T22:06:18.6843429Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients 2024-08-06T22:06:18.6844435Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sparse_gradients_grad_is_view 2024-08-06T22:06:18.6845482Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_empty_input 2024-08-06T22:06:18.6846629Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::DistributedDataParallelTest::test_sync_batch_norm_only_empty_input 2024-08-06T22:06:18.6847582Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward 2024-08-06T22:06:18.6848425Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_optimizer 2024-08-06T22:06:18.6849319Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_forward_backward_unused_parameters 2024-08-06T22:06:18.6850215Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_multi_bucket 2024-08-06T22:06:18.6851074Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_multi_dtype_single_bucket 2024-08-06T22:06:18.6851928Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::ReducerTest::test_single_dtype_single_bucket 2024-08-06T22:06:18.6852734Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_bool_tensors 2024-08-06T22:06:18.6853536Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cpu 2024-08-06T22:06:18.6854403Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_broadcast_coalesced_gloo_cuda 2024-08-06T22:06:18.6855305Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_rank_membership 2024-08-06T22:06:18.6856122Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_gloo_warn_not_in_group 2024-08-06T22:06:18.6857055Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_default 2024-08-06T22:06:18.6857976Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_incremented_gloo_subgroup 2024-08-06T22:06:18.6858891Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_default_pg_gloo 2024-08-06T22:06:18.6859777Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_sequence_num_set_gloo_new_group 2024-08-06T22:06:18.6860627Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_complex 2024-08-06T22:06:18.6861427Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::CommTest::test_tensor_dtype_mismatch 2024-08-06T22:06:18.6862423Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_all_to_all_single 2024-08-06T22:06:18.6863613Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allgather_coalesced 2024-08-06T22:06:18.6864804Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_allreduce_coalesced 2024-08-06T22:06:18.6865966Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_collectives 2024-08-06T22:06:18.6867200Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_for_all_backends 2024-08-06T22:06:18.6868555Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_init_process_group_optional_backend 2024-08-06T22:06:18.6869812Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::GlooProcessGroupWithDispatchedCollectivesTests::test_monitored_barrier 2024-08-06T22:06:18.6870830Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync 2024-08-06T22:06:18.6871724Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_duplicate_pg 2024-08-06T22:06:18.6872664Z Running 1 items in this shard: test/distributed/test_c10d_gloo.py::LargeCommTest::test_new_group_local_sync_sanity_check 2024-08-06T22:06:18.6873189Z 2024-08-06T22:06:18.6873426Z Running distributed/test_c10d_ops_nccl 1/1 ... [2024-08-06 22:06:18.665391] 2024-08-06T22:06:18.6874847Z Executing ['/opt/conda/envs/py_3.8/bin/python', '-bb', 'distributed/test_c10d_ops_nccl.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '-x', '--reruns=2', '--import-slow-tests', '--import-disabled-tests'] ... [2024-08-06 22:06:18.665968] 2024-08-06T22:06:20.0997360Z 2024-08-06T22:06:20.0998595Z distributed/test_c10d_ops_nccl 1/1 was successful, full logs can be found in artifacts with path test/test-reports/distributed.test_c10d_ops_nccl_1.1_dd17ac1327c75369_.log 2024-08-06T22:06:20.0999443Z 2024-08-06T22:06:21.0117259Z 2024-08-06T22:06:21.0117847Z real 97m57.781s 2024-08-06T22:06:21.0118311Z user 207m15.515s 2024-08-06T22:06:21.0118682Z sys 39m30.814s 2024-08-06T22:06:21.0119055Z + assert_git_not_dirty 2024-08-06T22:06:21.0119521Z + [[ linux-jammy-py3.8-gcc11 != *rocm* ]] 2024-08-06T22:06:21.0120043Z + [[ linux-jammy-py3.8-gcc11 != *xla* ]] 2024-08-06T22:06:21.0124647Z ++ git status --porcelain 2024-08-06T22:06:21.0125360Z ++ grep -v '?? third_party' 2024-08-06T22:06:42.8615956Z ++ true 2024-08-06T22:06:42.8616954Z + git_status= 2024-08-06T22:06:42.8617320Z + [[ -n '' ]] 2024-08-06T22:06:42.8617962Z + [[ linux-jammy-py3.8-gcc11 == *cuda* ]] 2024-08-06T22:06:42.8618383Z + [[ linux-jammy-py3.8-gcc11 == *rocm* ]] 2024-08-06T22:06:42.8618872Z + [[ 1 == 1 ]] 2024-08-06T22:06:42.8619480Z + test_rpc 2024-08-06T22:06:42.8619832Z + echo 'Testing RPC C++ tests' 2024-08-06T22:06:42.8620122Z Testing RPC C++ tests 2024-08-06T22:06:42.8622259Z + ln -sf /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib/libtorch.so /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib/libtorch_cpu.so /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib/libtorch_global_deps.so /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib/libtorch_python.so /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib/libtorchbind_test.so /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/bin 2024-08-06T22:06:42.8647499Z + ln -sf /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib/libc10.so /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/bin 2024-08-06T22:06:42.8657517Z + CPP_TESTS_DIR=/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/bin 2024-08-06T22:06:42.8658105Z + python test/run_test.py --cpp --verbose -i cpp/test_cpp_rpc 2024-08-06T22:06:42.9634281Z test/run_test.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2024-08-06T22:06:42.9635026Z import pkg_resources 2024-08-06T22:06:46.1069603Z Downloading https://ossci-metrics.s3.amazonaws.com/slow-tests.json to /var/lib/jenkins/workspace/test/.pytorch-slow-tests.json 2024-08-06T22:06:46.1070840Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/workspace/test/.pytorch-disabled-tests.json 2024-08-06T22:06:46.1175967Z Found test times from artifacts 2024-08-06T22:06:46.1597768Z Found test times from artifacts 2024-08-06T22:06:46.1613885Z Running all tests 2024-08-06T22:06:46.1617092Z Running parallel tests on 3 processes 2024-08-06T22:06:46.1617525Z Name: tests to run (est. time: 0.0min) 2024-08-06T22:06:46.1617888Z Serial tests (1): 2024-08-06T22:06:46.1618178Z cpp/test_cpp_rpc 1/1 2024-08-06T22:06:46.1618454Z Parallel tests (0): 2024-08-06T22:06:46.1618713Z Name: excluded (est. time: 0.0min) 2024-08-06T22:06:46.1619027Z Serial tests (0): 2024-08-06T22:06:46.1619275Z Parallel tests (0): 2024-08-06T22:06:46.1619652Z Starting test batch 'tests to run' 0.0 seconds after initiating testing 2024-08-06T22:06:46.1838793Z Running cpp/test_cpp_rpc 1/1 ... [2024-08-06 22:06:46.183475] 2024-08-06T22:06:46.1871041Z Executing ['pytest', '/opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/bin/test_cpp_rpc', '-v', '-vv', '-rfEX', '-n', '3', '--junit-xml-reruns', 'test-reports/python-pytest/test.run_test/test.run_test-f5c3256513e9bd19.xml', '-x', '--reruns=2'] ... [2024-08-06 22:06:46.186649] 2024-08-06T22:06:50.9703213Z 2024-08-06T22:06:50.9704520Z cpp/test_cpp_rpc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/cpp.test_cpp_rpc_1.1_08a6a4087e5ce7b3_.log 2024-08-06T22:06:50.9705621Z 2024-08-06T22:06:51.9444021Z + cleanup_workspace 2024-08-06T22:06:51.9444619Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2024-08-06T22:06:51.9445448Z sudo may print the following warning message that can be ignored. The chown command will still run. 2024-08-06T22:06:51.9446091Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2024-08-06T22:06:51.9446648Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2024-08-06T22:06:51.9447191Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2024-08-06T22:06:51.9447808Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2024-08-06T22:06:51.9448305Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2024-08-06T22:06:52.7026045Z ##[group]Run cat test/**/*_toprint.log || true 2024-08-06T22:06:52.7026449Z cat test/**/*_toprint.log || true 2024-08-06T22:06:52.7035373Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:52.7035776Z env: 2024-08-06T22:06:52.7035991Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:52.7036460Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:52.7037140Z ##[endgroup] 2024-08-06T22:06:52.7111482Z cat: 'test/**/*_toprint.log': No such file or directory 2024-08-06T22:06:52.7144967Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2024-08-06T22:06:52.7145328Z kill "$MONITOR_SCRIPT_PID" 2024-08-06T22:06:52.7150693Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:52.7151088Z env: 2024-08-06T22:06:52.7151301Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:52.7151771Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:52.7152292Z MONITOR_SCRIPT_PID: 107319 2024-08-06T22:06:52.7152559Z ##[endgroup] 2024-08-06T22:06:52.7293794Z Prepare all required actions 2024-08-06T22:06:52.7294231Z Getting action download info 2024-08-06T22:06:52.9271071Z Download action repository 'actions/upload-artifact@v3' (SHA:a8a3f3ad30e3422c9c7b888a15615d19a852ae32) 2024-08-06T22:06:53.1270064Z ##[group]Run ./.github/actions/upload-test-artifacts 2024-08-06T22:06:53.1270468Z with: 2024-08-06T22:06:53.1270810Z file-suffix: test-distributed-1-2-amz2023.linux.2xlarge_28427732585 2024-08-06T22:06:53.1271257Z s3-bucket: gha-artifacts 2024-08-06T22:06:53.1271527Z env: 2024-08-06T22:06:53.1271740Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:53.1272209Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:53.1272715Z ##[endgroup] 2024-08-06T22:06:53.1304995Z ##[group]Run # Remove any previous test jsons if they exist 2024-08-06T22:06:53.1305475Z # Remove any previous test jsons if they exist 2024-08-06T22:06:53.1305854Z rm -f test-jsons-*.zip 2024-08-06T22:06:53.1306298Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test -i '*.json' 2024-08-06T22:06:53.1312048Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:53.1312440Z env: 2024-08-06T22:06:53.1312667Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:53.1313128Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:53.1313782Z FILE_SUFFIX: test-distributed-1-2-amz2023.linux.2xlarge_28427732585 2024-08-06T22:06:53.1314217Z ##[endgroup] 2024-08-06T22:06:53.1556179Z adding: test/allowlist_for_publicAPI.json (deflated 79%) 2024-08-06T22:06:53.1583625Z adding: test/benchmark_utils/callgrind_artifacts.json (deflated 92%) 2024-08-06T22:06:53.1584161Z adding: test/minioptest_failures_dict.json (deflated 70%) 2024-08-06T22:06:53.1590070Z adding: test/profiler/profiler_utils_mock_events.json (deflated 87%) 2024-08-06T22:06:53.1591981Z adding: test/test-reports/td_exclusions-83ff5aa81bb25fcd0cb6.json (deflated 86%) 2024-08-06T22:06:53.1592667Z adding: test/test-reports/td_exclusions-55af74a35dfe2e5a8d56.json (deflated 18%) 2024-08-06T22:06:53.1593239Z adding: test/.pytorch-slow-tests.json (deflated 66%) 2024-08-06T22:06:53.1605257Z adding: test/.pytorch-disabled-tests.json (deflated 89%) 2024-08-06T22:06:53.1638037Z ##[group]Run # Remove any previous test reports if they exist 2024-08-06T22:06:53.1638548Z # Remove any previous test reports if they exist 2024-08-06T22:06:53.1638938Z rm -f test-reports-*.zip 2024-08-06T22:06:53.1639386Z zip -r "test-reports-${FILE_SUFFIX}.zip" test -i '*.xml' -i '*.csv' 2024-08-06T22:06:53.1644891Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:53.1645272Z env: 2024-08-06T22:06:53.1645612Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:53.1646090Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:53.1646720Z FILE_SUFFIX: test-distributed-1-2-amz2023.linux.2xlarge_28427732585 2024-08-06T22:06:53.1647179Z ##[endgroup] 2024-08-06T22:06:53.1901101Z adding: test/test-reports/python-pytest/distributed.test_c10d_functional_native/distributed.test_c10d_functional_native-4b795b5f601b2c1b.xml (deflated 93%) 2024-08-06T22:06:53.1916531Z adding: test/test-reports/python-pytest/distributed._tensor.test_dtensor_ops/distributed._tensor.test_dtensor_ops-ba363b62b20ce5d8.xml (deflated 96%) 2024-08-06T22:06:53.1919306Z adding: test/test-reports/python-pytest/distributed.pipelining.test_pipe/distributed.pipelining.test_pipe-554f369474423ec5.xml (deflated 65%) 2024-08-06T22:06:53.1921765Z adding: test/test-reports/python-pytest/distributed._tools.test_mem_tracker/distributed._tools.test_mem_tracker-9752aeffca2f3ff8.xml (deflated 65%) 2024-08-06T22:06:53.1924353Z adding: test/test-reports/python-pytest/distributed._tensor.test_experimental_ops/distributed._tensor.test_experimental_ops-fdb83ea9db8a87fc.xml (deflated 60%) 2024-08-06T22:06:53.1927234Z adding: test/test-reports/python-pytest/distributed._tensor.test_common_rules/distributed._tensor.test_common_rules-dd60a446e99f2a66.xml (deflated 80%) 2024-08-06T22:06:53.1929580Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fx/distributed.fsdp.test_fsdp_fx-53b7774efac93a0a.xml (deflated 37%) 2024-08-06T22:06:53.1932351Z adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_register_sharding/distributed._tensor.experimental.test_register_sharding-1c35331048a9d55b.xml (deflated 52%) 2024-08-06T22:06:53.1935092Z adding: test/test-reports/python-pytest/distributed._tensor.test_api/distributed._tensor.test_api-3f9f83c81e4baaa6.xml (deflated 78%) 2024-08-06T22:06:53.1937443Z adding: test/test-reports/python-pytest/distributed._tensor.test_random_ops/distributed._tensor.test_random_ops-f6bdcb3654dd16bb.xml (deflated 83%) 2024-08-06T22:06:53.1939787Z adding: test/test-reports/python-pytest/distributed._tensor.test_init/distributed._tensor.test_init-4a504c17f8822b6d.xml (deflated 74%) 2024-08-06T22:06:53.1942313Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_style/distributed.tensor.parallel.test_tp_style-330b38271a073b8b.xml (deflated 81%) 2024-08-06T22:06:53.1945086Z adding: test/test-reports/python-pytest/distributed._tensor.debug.test_comm_mode_features/distributed._tensor.debug.test_comm_mode_features-6b6317d96a2d4f48.xml (deflated 65%) 2024-08-06T22:06:53.1947727Z adding: test/test-reports/python-pytest/distributed._tensor.test_math_ops/distributed._tensor.test_math_ops-7903c3b8086ef58d.xml (deflated 79%) 2024-08-06T22:06:53.1950180Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_fsdp_ep/distributed.checkpoint.e2e.test_fsdp_ep-8310a90dd7e1e045.xml (deflated 33%) 2024-08-06T22:06:53.1952845Z adding: test/test-reports/python-pytest/distributed.test_compute_comm_reordering/distributed.test_compute_comm_reordering-deb722343cf80e5e.xml (deflated 86%) 2024-08-06T22:06:53.1955380Z adding: test/test-reports/python-pytest/distributed._tensor.test_matrix_ops/distributed._tensor.test_matrix_ops-93ec698b87e3c178.xml (deflated 77%) 2024-08-06T22:06:53.1957922Z adding: test/test-reports/python-pytest/distributed._composable.test_checkpoint/distributed._composable.test_checkpoint-1766432e892a171b.xml (deflated 70%) 2024-08-06T22:06:53.1960567Z adding: test/test-reports/python-pytest/distributed._tools.test_fsdp2_mem_tracker/distributed._tools.test_fsdp2_mem_tracker-7f76ce1135bb1c60.xml (deflated 60%) 2024-08-06T22:06:53.1963156Z adding: test/test-reports/python-pytest/distributed._tensor.test_redistribute/distributed._tensor.test_redistribute-2e6c1317b9bcccf7.xml (deflated 82%) 2024-08-06T22:06:53.1965783Z adding: test/test-reports/python-pytest/distributed._tensor.test_pointwise_ops/distributed._tensor.test_pointwise_ops-9b28364d706c5045.xml (deflated 70%) 2024-08-06T22:06:53.1968389Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_save_load_api/distributed.checkpoint.test_save_load_api-292669e20188b5ae.xml (deflated 44%) 2024-08-06T22:06:53.1971091Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_tp_checkpoint/distributed.checkpoint.test_tp_checkpoint-9fe17f5d4fe5edf6.xml (deflated 65%) 2024-08-06T22:06:53.1973919Z adding: test/test-reports/python-pytest/distributed._tensor.experimental.test_local_map/distributed._tensor.experimental.test_local_map-fe9165bf423f15af.xml (deflated 68%) 2024-08-06T22:06:53.1976996Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_format_utils/distributed.checkpoint.test_format_utils-22c7e986123d6176.xml (deflated 59%) 2024-08-06T22:06:53.1979668Z adding: test/test-reports/python-pytest/distributed.test_dynamo_distributed/distributed.test_dynamo_distributed-49aa3e6f79cdaec8.xml (deflated 92%) 2024-08-06T22:06:53.1982239Z adding: test/test-reports/python-pytest/distributed._tools.test_memory_tracker/distributed._tools.test_memory_tracker-c7c29a53a31b769b.xml (deflated 44%) 2024-08-06T22:06:53.1985238Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_dtensor_resharding/distributed.checkpoint.test_dtensor_resharding-c7ae84f74c5501d5.xml (deflated 80%) 2024-08-06T22:06:53.1988286Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_state/distributed._composable.fsdp.test_fully_shard_state-061f07a500e25541.xml (deflated 81%) 2024-08-06T22:06:53.1991343Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_tp_random_state/distributed.tensor.parallel.test_tp_random_state-b7a03bfa423732f8.xml (deflated 46%) 2024-08-06T22:06:53.1994296Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_optim_state/distributed.checkpoint.test_fsdp_optim_state-217ae9794bae6a3c.xml (deflated 66%) 2024-08-06T22:06:53.1997227Z adding: test/test-reports/python-pytest/distributed.checkpoint.e2e.test_e2e_save_and_load/distributed.checkpoint.e2e.test_e2e_save_and_load-ebcb4d87893c4e85.xml (deflated 90%) 2024-08-06T22:06:53.2000263Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_logging/distributed._composable.fsdp.test_fully_shard_logging-a1f4ff6c0d594658.xml (deflated 28%) 2024-08-06T22:06:53.2003402Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_overlap/distributed._composable.fsdp.test_fully_shard_overlap-5464e7356023d207.xml (deflated 55%) 2024-08-06T22:06:53.2006621Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_compile/distributed._composable.fsdp.test_fully_shard_compile-1b468e021b66fad3.xml (deflated 89%) 2024-08-06T22:06:53.2009505Z adding: test/test-reports/python-pytest/distributed._tensor.test_embedding_ops/distributed._tensor.test_embedding_ops-149054509f6e9200.xml (deflated 66%) 2024-08-06T22:06:53.2012147Z adding: test/test-reports/python-pytest/distributed.pipelining.test_schedule/distributed.pipelining.test_schedule-25b186d8b727a9fa.xml (deflated 83%) 2024-08-06T22:06:53.2015166Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion-95f49af5091529de.xml (deflated 48%) 2024-08-06T22:06:53.2018069Z adding: test/test-reports/python-pytest/distributed._tensor.test_view_ops/distributed._tensor.test_view_ops-1bfd11a6c8d4cc8b.xml (deflated 58%) 2024-08-06T22:06:53.2020827Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_parallelize_api/distributed.tensor.parallel.test_parallelize_api-418d6f906156fcb6.xml (deflated 82%) 2024-08-06T22:06:53.2023663Z adding: test/test-reports/python-pytest/distributed.test_control_collectives/distributed.test_control_collectives-ad8bf4e6df74416e.xml (deflated 84%) 2024-08-06T22:06:53.2026394Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_state_dict_utils/distributed.checkpoint.test_state_dict_utils-0eafca234e32d227.xml (deflated 71%) 2024-08-06T22:06:53.2029368Z adding: test/test-reports/python-pytest/distributed.tensor.parallel.test_fsdp_2d_parallel/distributed.tensor.parallel.test_fsdp_2d_parallel-5eac53241ca98c1a.xml (deflated 89%) 2024-08-06T22:06:53.2032161Z adding: test/test-reports/python-pytest/distributed._tensor.test_optimizers/distributed._tensor.test_optimizers-2d284e0534e692f9.xml (deflated 82%) 2024-08-06T22:06:53.2034650Z adding: test/test-reports/python-pytest/distributed.fsdp.test_shard_utils/distributed.fsdp.test_shard_utils-ecc4b9dca4a1a934.xml (deflated 63%) 2024-08-06T22:06:53.2037370Z adding: test/test-reports/python-pytest/distributed._tensor.debug.test_comm_mode/distributed._tensor.debug.test_comm_mode-382dbed5da84ef17.xml (deflated 60%) 2024-08-06T22:06:53.2040354Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_clip_grad_norm_/distributed._composable.fsdp.test_fully_shard_clip_grad_norm_-c9ed15b7d2e192e8.xml (deflated 53%) 2024-08-06T22:06:53.2043228Z adding: test/test-reports/python-pytest/distributed.test_functional_api/distributed.test_functional_api-761526a83fe60776.xml (deflated 88%) 2024-08-06T22:06:53.2046022Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_fsdp_model_state/distributed.checkpoint.test_fsdp_model_state-880660084cc0017f.xml (deflated 65%) 2024-08-06T22:06:53.2049139Z adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_compile/distributed._composable.fully_shard.test_fully_shard_compile-80f22b8200f65e0f.xml (deflated 49%) 2024-08-06T22:06:53.2052164Z adding: test/test-reports/python-pytest/distributed._composable.test_replicate/distributed._composable.test_replicate-2a3d19791308af14.xml (deflated 79%) 2024-08-06T22:06:53.2055139Z adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_mixed_precision/distributed._composable.fully_shard.test_fully_shard_mixed_precision-ccc83878fa8523e3.xml (deflated 47%) 2024-08-06T22:06:53.2058134Z adding: test/test-reports/python-pytest/distributed._tensor.test_utils/distributed._tensor.test_utils-22045dfc663d56f0.xml (deflated 68%) 2024-08-06T22:06:53.2060475Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_core/distributed.fsdp.test_fsdp_core-80e841b4f0b1e6fb.xml (deflated 95%) 2024-08-06T22:06:53.2063100Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_backward_prefetch/distributed.fsdp.test_fsdp_backward_prefetch-f2bfd7278520a844.xml (deflated 47%) 2024-08-06T22:06:53.2066352Z adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_model_checkpoint/distributed._composable.fully_shard.test_fully_shard_model_checkpoint-c5363ec3344d1e7b.xml (deflated 80%) 2024-08-06T22:06:53.2069701Z adding: test/test-reports/python-pytest/distributed.optim.test_zero_redundancy_optimizer/distributed.optim.test_zero_redundancy_optimizer-1ee84ea5418f5bb3.xml (deflated 94%) 2024-08-06T22:06:53.2072581Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_flatten_params/distributed.fsdp.test_fsdp_flatten_params-fecc277e1b4e82b5.xml (deflated 84%) 2024-08-06T22:06:53.2075590Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_file_system_checkpoint/distributed.checkpoint.test_file_system_checkpoint-4c5a5926e08e1c5b.xml (deflated 79%) 2024-08-06T22:06:53.2078500Z adding: test/test-reports/python-pytest/distributed.checkpoint.test_state_dict/distributed.checkpoint.test_state_dict-d566ba17d81d2a9b.xml (deflated 85%) 2024-08-06T22:06:53.2081491Z adding: test/test-reports/python-pytest/distributed._composable.fully_shard.test_fully_shard_init/distributed._composable.fully_shard.test_fully_shard_init-7d3c566b276eff85.xml (deflated 83%) 2024-08-06T22:06:53.2084444Z adding: test/test-reports/python-pytest/distributed.fsdp.test_checkpoint_wrapper/distributed.fsdp.test_checkpoint_wrapper-47b76b0d8691018d.xml (deflated 76%) 2024-08-06T22:06:53.2087217Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_clip_grad_norm/distributed.fsdp.test_fsdp_clip_grad_norm-668e9f0dd63999d9.xml (deflated 77%) 2024-08-06T22:06:53.2089703Z adding: test/test-reports/python-pytest/distributed.test_c10d_logger/distributed.test_c10d_logger-d37e94fe7d39c7a2.xml (deflated 65%) 2024-08-06T22:06:53.2092079Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_grad_acc/distributed.fsdp.test_fsdp_grad_acc-4d5d563691dd605b.xml (deflated 84%) 2024-08-06T22:06:53.2094797Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_unshard_params/distributed.fsdp.test_fsdp_unshard_params-6817e0d549ad5c58.xml (deflated 89%) 2024-08-06T22:06:53.2097421Z adding: test/test-reports/python-pytest/distributed.nn.jit.test_instantiator/distributed.nn.jit.test_instantiator-0c97d0f518d5842d.xml (deflated 61%) 2024-08-06T22:06:53.2100215Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_comm/distributed._composable.fsdp.test_fully_shard_comm-20d733f8ea885194.xml (deflated 84%) 2024-08-06T22:06:53.2103077Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_overlap/distributed.fsdp.test_fsdp_overlap-67ba5e5edec63df2.xml (deflated 64%) 2024-08-06T22:06:53.2105888Z adding: test/test-reports/python-pytest/distributed._composable.test_replicate_with_compiler/distributed._composable.test_replicate_with_compiler-fd63d161a5940a0f.xml (deflated 86%) 2024-08-06T22:06:53.2108786Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_hybrid_shard/distributed.fsdp.test_fsdp_hybrid_shard-543070ecf1384365.xml (deflated 80%) 2024-08-06T22:06:53.2111735Z adding: test/test-reports/python-pytest/distributed._composable.fsdp.test_fully_shard_extensions/distributed._composable.fsdp.test_fully_shard_extensions-448af2288cbe891f.xml (deflated 71%) 2024-08-06T22:06:53.2114815Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_sharded_grad_scaler/distributed.fsdp.test_fsdp_sharded_grad_scaler-d6230dfd249186e5.xml (deflated 93%) 2024-08-06T22:06:53.2117633Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_freezing_weights/distributed.fsdp.test_fsdp_freezing_weights-b0fa7f4902348cc6.xml (deflated 96%) 2024-08-06T22:06:53.2120444Z adding: test/test-reports/python-pytest/distributed.fsdp.test_hsdp_dtensor_state_dict/distributed.fsdp.test_hsdp_dtensor_state_dict-b2cb02a6a6052ab7.xml (deflated 86%) 2024-08-06T22:06:53.2123218Z adding: test/test-reports/python-pytest/distributed.test_c10d_object_collectives/distributed.test_c10d_object_collectives-b70ed4506fbf588a.xml (deflated 80%) 2024-08-06T22:06:53.2125992Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_use_orig_params/distributed.fsdp.test_fsdp_use_orig_params-7b4c876b249b4941.xml (deflated 90%) 2024-08-06T22:06:53.2128831Z adding: test/test-reports/python-pytest/distributed._shard.sharding_spec.test_sharding_spec/distributed._shard.sharding_spec.test_sharding_spec-56d84e8ee046739b.xml (deflated 83%) 2024-08-06T22:06:53.2131470Z adding: test/test-reports/python-pytest/distributed.fsdp.test_utils/distributed.fsdp.test_utils-1906627efb017951.xml (deflated 70%) 2024-08-06T22:06:53.2133779Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_meta/distributed.fsdp.test_fsdp_meta-a693ec02e1195237.xml (deflated 90%) 2024-08-06T22:06:53.2136077Z adding: test/test-reports/python-pytest/distributed.fsdp.test_wrap/distributed.fsdp.test_wrap-c73f491687b94fdb.xml (deflated 94%) 2024-08-06T22:06:53.2138435Z adding: test/test-reports/python-pytest/distributed.algorithms.test_join/distributed.algorithms.test_join-ba28b2057d53e767.xml (deflated 79%) 2024-08-06T22:06:53.2140988Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_checkpoint/distributed.fsdp.test_fsdp_checkpoint-ca15e436d87aaf59.xml (deflated 93%) 2024-08-06T22:06:53.2143547Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_fine_tune/distributed.fsdp.test_fsdp_fine_tune-725075b0a8e6b50d.xml (deflated 64%) 2024-08-06T22:06:53.2146136Z adding: test/test-reports/python-pytest/distributed._shard.test_sharder/distributed._shard.test_sharder-5a2cd7457fb95389.xml (deflated 66%) 2024-08-06T22:06:53.2148581Z adding: test/test-reports/python-pytest/distributed.fsdp.test_fsdp_exec_order/distributed.fsdp.test_fsdp_exec_order-f95789952021d0c8.xml (deflated 87%) 2024-08-06T22:06:53.2151355Z adding: test/test-reports/python-pytest/distributed._shard.sharding_plan.test_sharding_plan/distributed._shard.sharding_plan.test_sharding_plan-985b9d4925dd707b.xml (deflated 75%) 2024-08-06T22:06:53.2154306Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3af8c09e65e703f9.xml (deflated 36%) 2024-08-06T22:06:53.2156921Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0665ec5f83ad4eb5.xml (deflated 35%) 2024-08-06T22:06:53.2159512Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a3b558d1c8d39b94.xml (deflated 35%) 2024-08-06T22:06:53.2162213Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4ebcef94d261b46f.xml (deflated 36%) 2024-08-06T22:06:53.2164816Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dd9b2a1e90f21d24.xml (deflated 36%) 2024-08-06T22:06:53.2167471Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2a1c9f57493eb734.xml (deflated 36%) 2024-08-06T22:06:53.2170071Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-26c86d610754de68.xml (deflated 36%) 2024-08-06T22:06:53.2172657Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-98047639b9d83fa7.xml (deflated 35%) 2024-08-06T22:06:53.2175419Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4e24dd2900ad06fc.xml (deflated 36%) 2024-08-06T22:06:53.2176850Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bb3d945c7169cf86.xml (deflated 36%) 2024-08-06T22:06:53.2178174Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0b86c600ebae31da.xml (deflated 35%) 2024-08-06T22:06:53.2179503Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8816952f7824c368.xml (deflated 36%) 2024-08-06T22:06:53.2180804Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-35773442bc91f581.xml (deflated 35%) 2024-08-06T22:06:53.2182116Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-21c6ac5f7739af88.xml (deflated 36%) 2024-08-06T22:06:53.2183420Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-01f2da69650463ac.xml (deflated 35%) 2024-08-06T22:06:53.2184728Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e845555190df9c29.xml (deflated 35%) 2024-08-06T22:06:53.2186038Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0672ed9c92cda295.xml (deflated 35%) 2024-08-06T22:06:53.2187354Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-043a415a092271a4.xml (deflated 36%) 2024-08-06T22:06:53.2188657Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7db297f31c8cdc61.xml (deflated 35%) 2024-08-06T22:06:53.2189965Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7be46508ae83151e.xml (deflated 36%) 2024-08-06T22:06:53.2191284Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-53fd4eddff19db38.xml (deflated 36%) 2024-08-06T22:06:53.2192606Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-999ca3f8db958da8.xml (deflated 35%) 2024-08-06T22:06:53.2193916Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3cbc378c02bfc05a.xml (deflated 36%) 2024-08-06T22:06:53.2195415Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8aff1078137c5e66.xml (deflated 35%) 2024-08-06T22:06:53.2196735Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3f80c60cd72a48a6.xml (deflated 35%) 2024-08-06T22:06:53.2198056Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5ede584a82a97e2f.xml (deflated 35%) 2024-08-06T22:06:53.2199454Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2ebcd3e4a63afd4d.xml (deflated 35%) 2024-08-06T22:06:53.2200781Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3954a168a0553948.xml (deflated 35%) 2024-08-06T22:06:53.2202108Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5c95c7d1605ea4a5.xml (deflated 35%) 2024-08-06T22:06:53.2203429Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-020e9cfa6cfa920a.xml (deflated 35%) 2024-08-06T22:06:53.2204735Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-738e279ea18b601f.xml (deflated 35%) 2024-08-06T22:06:53.2206123Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5fb2b0d0cd818588.xml (deflated 35%) 2024-08-06T22:06:53.2207438Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b598b4027ff391ad.xml (deflated 35%) 2024-08-06T22:06:53.2208752Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e368f2a072364330.xml (deflated 35%) 2024-08-06T22:06:53.2210059Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-88a9ae9c6b83f8cf.xml (deflated 35%) 2024-08-06T22:06:53.2211383Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5f2c3f2873ad5bd6.xml (deflated 35%) 2024-08-06T22:06:53.2212698Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f9f9c0c71466966d.xml (deflated 35%) 2024-08-06T22:06:53.2214021Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-08c9bfbfd3c8d6f6.xml (deflated 35%) 2024-08-06T22:06:53.2215326Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b0c18af6d67285a5.xml (deflated 35%) 2024-08-06T22:06:53.2216652Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba4a8b3afcb70727.xml (deflated 36%) 2024-08-06T22:06:53.2217967Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-38d3f896fd382096.xml (deflated 56%) 2024-08-06T22:06:53.2219266Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7ce9ed615c2e8fb5.xml (deflated 35%) 2024-08-06T22:06:53.2220599Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c677e8ffbe76f615.xml (deflated 36%) 2024-08-06T22:06:53.2221927Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e6bd92841460c6aa.xml (deflated 35%) 2024-08-06T22:06:53.2223245Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-58c125c83871bd1c.xml (deflated 36%) 2024-08-06T22:06:53.2224617Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e4bb448b7e0068bf.xml (deflated 36%) 2024-08-06T22:06:53.2225934Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-76f77bf5f2730c22.xml (deflated 35%) 2024-08-06T22:06:53.2227253Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c3ba8be23a7251ac.xml (deflated 36%) 2024-08-06T22:06:53.2228626Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b31af0ef2c31562f.xml (deflated 36%) 2024-08-06T22:06:53.2229929Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-234dac7ed7436b8b.xml (deflated 35%) 2024-08-06T22:06:53.2231246Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2548c1598c945e67.xml (deflated 35%) 2024-08-06T22:06:53.2232574Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-52edd4fabcc4b751.xml (deflated 35%) 2024-08-06T22:06:53.2233892Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a21ec823e3e6ccbd.xml (deflated 36%) 2024-08-06T22:06:53.2235213Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-978266ae2918c478.xml (deflated 36%) 2024-08-06T22:06:53.2236534Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4ee54b2d3377f9ed.xml (deflated 35%) 2024-08-06T22:06:53.2237863Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e9de1df448efa654.xml (deflated 35%) 2024-08-06T22:06:53.2239195Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a14cbcdcd01413a7.xml (deflated 35%) 2024-08-06T22:06:53.2240503Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-eef436792836601d.xml (deflated 35%) 2024-08-06T22:06:53.2241824Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6b19fdd10ac0eb85.xml (deflated 35%) 2024-08-06T22:06:53.2243146Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2d0c1139279309f0.xml (deflated 36%) 2024-08-06T22:06:53.2244463Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-083043ac48b40b22.xml (deflated 36%) 2024-08-06T22:06:53.2245842Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-18ad7c715c402441.xml (deflated 35%) 2024-08-06T22:06:53.2247163Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0860b2b954209080.xml (deflated 35%) 2024-08-06T22:06:53.2248484Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a7cfe50ea865363d.xml (deflated 35%) 2024-08-06T22:06:53.2249804Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b42946f242bf1273.xml (deflated 36%) 2024-08-06T22:06:53.2251110Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d1000e90ef371f0c.xml (deflated 36%) 2024-08-06T22:06:53.2252425Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7bf11a5917881f0f.xml (deflated 36%) 2024-08-06T22:06:53.2253865Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-21ad019773f4b998.xml (deflated 36%) 2024-08-06T22:06:53.2255212Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1842def63e6cedf9.xml (deflated 35%) 2024-08-06T22:06:53.2256625Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c8d40a18d5198c9d.xml (deflated 35%) 2024-08-06T22:06:53.2258002Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-22e7780751427580.xml (deflated 36%) 2024-08-06T22:06:53.2259397Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6bd56f642a32c9de.xml (deflated 35%) 2024-08-06T22:06:53.2261596Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a2e907188c22fb31.xml (deflated 36%) 2024-08-06T22:06:53.2263772Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9b4ff050bf2d3442.xml (deflated 35%) 2024-08-06T22:06:53.2265094Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-55828c4532d775f6.xml (deflated 35%) 2024-08-06T22:06:53.2266416Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9b6cefbb4386c527.xml (deflated 35%) 2024-08-06T22:06:53.2267739Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8218750c8597aef6.xml (deflated 35%) 2024-08-06T22:06:53.2269041Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6c2574a37853868d.xml (deflated 35%) 2024-08-06T22:06:53.2270360Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ea3478d6b21d8f88.xml (deflated 35%) 2024-08-06T22:06:53.2271675Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a8022106165eb615.xml (deflated 35%) 2024-08-06T22:06:53.2272992Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e0cc943ce0ec2011.xml (deflated 35%) 2024-08-06T22:06:53.2274496Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a744f7cc700df62c.xml (deflated 35%) 2024-08-06T22:06:53.2275828Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d34d79b6bdd3d2fe.xml (deflated 35%) 2024-08-06T22:06:53.2277152Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-72e74549ad9c51fe.xml (deflated 35%) 2024-08-06T22:06:53.2278477Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c13af502206e2216.xml (deflated 35%) 2024-08-06T22:06:53.2279786Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7b148c3c73c14cdd.xml (deflated 36%) 2024-08-06T22:06:53.2281111Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-22a8bcbcc69f6632.xml (deflated 34%) 2024-08-06T22:06:53.2282436Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fbfcdde31e248b26.xml (deflated 35%) 2024-08-06T22:06:53.2283757Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-256772c31e2dfd7b.xml (deflated 33%) 2024-08-06T22:06:53.2285061Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4d541003c00776d3.xml (deflated 34%) 2024-08-06T22:06:53.2286586Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7db059abc9ff84ea.xml (deflated 34%) 2024-08-06T22:06:53.2287943Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dbfe71c509df2939.xml (deflated 34%) 2024-08-06T22:06:53.2289252Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-55cce772f8734f7d.xml (deflated 34%) 2024-08-06T22:06:53.2290677Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d8e63a86333c1c46.xml (deflated 34%) 2024-08-06T22:06:53.2291996Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b6986fad289c0eab.xml (deflated 34%) 2024-08-06T22:06:53.2293317Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-19202a53580fae62.xml (deflated 35%) 2024-08-06T22:06:53.2294660Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0f6b17e15bf1bdac.xml (deflated 35%) 2024-08-06T22:06:53.2295988Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d29efc941ed40315.xml (deflated 34%) 2024-08-06T22:06:53.2297312Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-82d6829620925188.xml (deflated 35%) 2024-08-06T22:06:53.2298622Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-60650ce54296ba83.xml (deflated 34%) 2024-08-06T22:06:53.2299924Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b263f4cb14ba754c.xml (deflated 34%) 2024-08-06T22:06:53.2301240Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9395b5d7c83f0022.xml (deflated 34%) 2024-08-06T22:06:53.2302562Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-58acfc5383a01ffb.xml (deflated 35%) 2024-08-06T22:06:53.2303876Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9e176b7dc6414b47.xml (deflated 35%) 2024-08-06T22:06:53.2305179Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-78eba9723f2bed5e.xml (deflated 35%) 2024-08-06T22:06:53.2306500Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-72acb9aaddf8bc88.xml (deflated 35%) 2024-08-06T22:06:53.2307821Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1b18c8ba0ff59168.xml (deflated 35%) 2024-08-06T22:06:53.2309139Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-926187b1b7c171d5.xml (deflated 34%) 2024-08-06T22:06:53.2310443Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-154ca2e4de629b1e.xml (deflated 35%) 2024-08-06T22:06:53.2311766Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9e33089700f4a5e1.xml (deflated 35%) 2024-08-06T22:06:53.2313086Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-47bb5bf86948878c.xml (deflated 34%) 2024-08-06T22:06:53.2314406Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-28fcef7c922aa7df.xml (deflated 34%) 2024-08-06T22:06:53.2315768Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-df4582c2bbcb0337.xml (deflated 35%) 2024-08-06T22:06:53.2317088Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-75744fe56b9ba68c.xml (deflated 35%) 2024-08-06T22:06:53.2318412Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-071d7393ddc6b5fa.xml (deflated 34%) 2024-08-06T22:06:53.2319778Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0e86d0ee31d5a6cf.xml (deflated 34%) 2024-08-06T22:06:53.2321087Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6a2e275bb2cd2576.xml (deflated 36%) 2024-08-06T22:06:53.2322409Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c1dffd43360da925.xml (deflated 35%) 2024-08-06T22:06:53.2323734Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9273fa4c7315cfb8.xml (deflated 35%) 2024-08-06T22:06:53.2325058Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0a05192f9b7ca77b.xml (deflated 34%) 2024-08-06T22:06:53.2326465Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f484e9fb6543c63c.xml (deflated 35%) 2024-08-06T22:06:53.2327785Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4ab190ef95dc8f22.xml (deflated 35%) 2024-08-06T22:06:53.2329099Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3b15798292cb54dc.xml (deflated 34%) 2024-08-06T22:06:53.2330423Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d59f5c6de05ad8a4.xml (deflated 35%) 2024-08-06T22:06:53.2331732Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a64c6b42d6786e98.xml (deflated 34%) 2024-08-06T22:06:53.2333049Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6d03e42cf9a67a76.xml (deflated 35%) 2024-08-06T22:06:53.2334372Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f626bf059f673cbb.xml (deflated 35%) 2024-08-06T22:06:53.2335692Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-53b2585aa91c2ce5.xml (deflated 35%) 2024-08-06T22:06:53.2336999Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-515e4b33eb836a2b.xml (deflated 35%) 2024-08-06T22:06:53.2338318Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d8dd04fa29d7c6ac.xml (deflated 34%) 2024-08-06T22:06:53.2339639Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-48e6dec0107e0a7c.xml (deflated 36%) 2024-08-06T22:06:53.2340966Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-87c807bb82a3ab00.xml (deflated 35%) 2024-08-06T22:06:53.2342285Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d35a47db8a780d7f.xml (deflated 55%) 2024-08-06T22:06:53.2343607Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3d53d52d2ffcd2f6.xml (deflated 55%) 2024-08-06T22:06:53.2344990Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6891808fdb495c49.xml (deflated 35%) 2024-08-06T22:06:53.2346286Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-984edf7919371d49.xml (deflated 35%) 2024-08-06T22:06:53.2347601Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ba88f40c3c86c3ec.xml (deflated 41%) 2024-08-06T22:06:53.2348984Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bde6da19367afa3b.xml (deflated 37%) 2024-08-06T22:06:53.2350304Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-04908169a9bdb72e.xml (deflated 37%) 2024-08-06T22:06:53.2351602Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-86b4c10bffd633d9.xml (deflated 37%) 2024-08-06T22:06:53.2352927Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1e7e4a5aeff40c91.xml (deflated 37%) 2024-08-06T22:06:53.2354241Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-89493f70012a77cc.xml (deflated 37%) 2024-08-06T22:06:53.2355561Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-26a30c4445578aff.xml (deflated 36%) 2024-08-06T22:06:53.2356871Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7522b966d8a10c59.xml (deflated 37%) 2024-08-06T22:06:53.2358210Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-34fc483fad670b32.xml (deflated 36%) 2024-08-06T22:06:53.2359526Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f3f3e8029b4dd801.xml (deflated 36%) 2024-08-06T22:06:53.2360862Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7a502a00cca3ea3d.xml (deflated 36%) 2024-08-06T22:06:53.2362171Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-cd762df0a80794dd.xml (deflated 36%) 2024-08-06T22:06:53.2363492Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6824a955f6178081.xml (deflated 37%) 2024-08-06T22:06:53.2364807Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1a5eb406d684e490.xml (deflated 37%) 2024-08-06T22:06:53.2366255Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-559e24e236d703d4.xml (deflated 36%) 2024-08-06T22:06:53.2367550Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-25435684a0644be7.xml (deflated 37%) 2024-08-06T22:06:53.2368866Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0c6f7a02207eff64.xml (deflated 36%) 2024-08-06T22:06:53.2370188Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-03a973b9e808e8d9.xml (deflated 35%) 2024-08-06T22:06:53.2371510Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9e2ddc07139e3712.xml (deflated 35%) 2024-08-06T22:06:53.2372810Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ae9b8f5ad391e134.xml (deflated 36%) 2024-08-06T22:06:53.2374145Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a8905d0d62e2261f.xml (deflated 35%) 2024-08-06T22:06:53.2375774Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d14f64d29902b408.xml (deflated 35%) 2024-08-06T22:06:53.2377092Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0a8595e3fb378968.xml (deflated 35%) 2024-08-06T22:06:53.2378400Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a48950c9773be9d2.xml (deflated 36%) 2024-08-06T22:06:53.2379827Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-00f03a15888d1364.xml (deflated 36%) 2024-08-06T22:06:53.2381142Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-72daf103a98f6864.xml (deflated 35%) 2024-08-06T22:06:53.2382468Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c4a7de63d86600e0.xml (deflated 35%) 2024-08-06T22:06:53.2383784Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-59ba7fd3cf1b19dd.xml (deflated 36%) 2024-08-06T22:06:53.2385110Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bbfc6c0ebad37013.xml (deflated 35%) 2024-08-06T22:06:53.2386436Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5708a8090b91bb71.xml (deflated 34%) 2024-08-06T22:06:53.2387750Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-261b6a3986ba7445.xml (deflated 36%) 2024-08-06T22:06:53.2389052Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-61a10900f3eb43d7.xml (deflated 35%) 2024-08-06T22:06:53.2390372Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b3124f078e6daede.xml (deflated 34%) 2024-08-06T22:06:53.2391698Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-254276f38fadaf84.xml (deflated 36%) 2024-08-06T22:06:53.2393011Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d464c36102b343b2.xml (deflated 36%) 2024-08-06T22:06:53.2394315Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-90557e9529c71238.xml (deflated 36%) 2024-08-06T22:06:53.2395628Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9e6a46c36704a695.xml (deflated 34%) 2024-08-06T22:06:53.2396941Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2b6e99006070f23e.xml (deflated 35%) 2024-08-06T22:06:53.2398260Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2aadb3785955aa88.xml (deflated 35%) 2024-08-06T22:06:53.2399571Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-77b43cd6453f426a.xml (deflated 35%) 2024-08-06T22:06:53.2400887Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0b6cc6e3e09130a0.xml (deflated 35%) 2024-08-06T22:06:53.2402211Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-62e82fad0912fd2a.xml (deflated 36%) 2024-08-06T22:06:53.2403523Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-98eb31441ba1d197.xml (deflated 35%) 2024-08-06T22:06:53.2404943Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4697049b13955532.xml (deflated 35%) 2024-08-06T22:06:53.2406336Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b814ec0884862869.xml (deflated 35%) 2024-08-06T22:06:53.2407656Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4f0e4c6bc29f919a.xml (deflated 36%) 2024-08-06T22:06:53.2409023Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e9b87bf9f770ca68.xml (deflated 36%) 2024-08-06T22:06:53.2410341Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4e322e47ae45231a.xml (deflated 36%) 2024-08-06T22:06:53.2411658Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5b4af639d05aff1f.xml (deflated 35%) 2024-08-06T22:06:53.2412987Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-83a02a6fe6a94918.xml (deflated 35%) 2024-08-06T22:06:53.2414291Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a9b769f4d591db0c.xml (deflated 35%) 2024-08-06T22:06:53.2415611Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-45136432aeb437b0.xml (deflated 36%) 2024-08-06T22:06:53.2416929Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-830bed097c447083.xml (deflated 36%) 2024-08-06T22:06:53.2418249Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ea43b7375dd5f773.xml (deflated 36%) 2024-08-06T22:06:53.2419561Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1d27eda110dc0272.xml (deflated 35%) 2024-08-06T22:06:53.2420888Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2aab4665eaca49db.xml (deflated 35%) 2024-08-06T22:06:53.2422211Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fa766fd14ca9ce4d.xml (deflated 35%) 2024-08-06T22:06:53.2423543Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fa53b01441c34ccd.xml (deflated 35%) 2024-08-06T22:06:53.2424862Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b93aaa4353ccd569.xml (deflated 35%) 2024-08-06T22:06:53.2426180Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-912e6358e2f2edf7.xml (deflated 35%) 2024-08-06T22:06:53.2427499Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3a7a222f81c7e8f9.xml (deflated 36%) 2024-08-06T22:06:53.2428814Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3ac24229bb3765bc.xml (deflated 36%) 2024-08-06T22:06:53.2430118Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f9c385592d36095e.xml (deflated 35%) 2024-08-06T22:06:53.2431442Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-04ec41788a82afc8.xml (deflated 36%) 2024-08-06T22:06:53.2432756Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a93012458a57e484.xml (deflated 35%) 2024-08-06T22:06:53.2434067Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8373f8d9144f35a3.xml (deflated 35%) 2024-08-06T22:06:53.2435429Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4b1940af9f94d775.xml (deflated 35%) 2024-08-06T22:06:53.2436767Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1f6f8219b87a0d3e.xml (deflated 35%) 2024-08-06T22:06:53.2438088Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3fbf3df41eed97aa.xml (deflated 36%) 2024-08-06T22:06:53.2439473Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3bbc39c03a59490d.xml (deflated 36%) 2024-08-06T22:06:53.2440769Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4654c48f43db515b.xml (deflated 35%) 2024-08-06T22:06:53.2442089Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e56951d230105768.xml (deflated 35%) 2024-08-06T22:06:53.2443411Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-71c360d711a8b23e.xml (deflated 38%) 2024-08-06T22:06:53.2444733Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-24ec834a6c1d40ef.xml (deflated 35%) 2024-08-06T22:06:53.2446118Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-62c377ad5379e055.xml (deflated 35%) 2024-08-06T22:06:53.2447434Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-41dd959971e9e758.xml (deflated 36%) 2024-08-06T22:06:53.2448769Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0391240c562c0862.xml (deflated 36%) 2024-08-06T22:06:53.2450102Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d6630abd23198e33.xml (deflated 35%) 2024-08-06T22:06:53.2451428Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0f0ca6893c391ab2.xml (deflated 35%) 2024-08-06T22:06:53.2452745Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fd425eae3ad12e7f.xml (deflated 36%) 2024-08-06T22:06:53.2454066Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-de7383e60b1197cb.xml (deflated 36%) 2024-08-06T22:06:53.2455384Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f6161b88dd049d6d.xml (deflated 35%) 2024-08-06T22:06:53.2456697Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4ca4ae065e62f69c.xml (deflated 35%) 2024-08-06T22:06:53.2458019Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3d217ace71b602ee.xml (deflated 35%) 2024-08-06T22:06:53.2459342Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ab17b5cc834d25cb.xml (deflated 36%) 2024-08-06T22:06:53.2460663Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d50df17d2d49d434.xml (deflated 35%) 2024-08-06T22:06:53.2461966Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-d2f5f51bcf56eaab.xml (deflated 35%) 2024-08-06T22:06:53.2463293Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5c723dcfd9e14d5e.xml (deflated 35%) 2024-08-06T22:06:53.2464683Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7abbd1a4720b2033.xml (deflated 37%) 2024-08-06T22:06:53.2465994Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-824174d7ad32ee96.xml (deflated 36%) 2024-08-06T22:06:53.2467312Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-796aa892249e86ee.xml (deflated 35%) 2024-08-06T22:06:53.2468693Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-92b98115676d8b1c.xml (deflated 35%) 2024-08-06T22:06:53.2470009Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-21df331639b780cf.xml (deflated 36%) 2024-08-06T22:06:53.2471313Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c960923d84eff1f5.xml (deflated 36%) 2024-08-06T22:06:53.2472634Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a703a6a5296a63b5.xml (deflated 35%) 2024-08-06T22:06:53.2473951Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7e3a17812ee5b4f9.xml (deflated 35%) 2024-08-06T22:06:53.2475428Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b8594742e9d04e8f.xml (deflated 35%) 2024-08-06T22:06:53.2476739Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-14f9f9792385c5d7.xml (deflated 35%) 2024-08-06T22:06:53.2478059Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ccbb3d78ba7c0fb9.xml (deflated 35%) 2024-08-06T22:06:53.2479392Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1f8938fa6870edd2.xml (deflated 37%) 2024-08-06T22:06:53.2480731Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b8e0add88a4fda04.xml (deflated 34%) 2024-08-06T22:06:53.2482040Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8ba1de0b39252191.xml (deflated 35%) 2024-08-06T22:06:53.2483386Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bf77b06ad0a0649f.xml (deflated 34%) 2024-08-06T22:06:53.2484730Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3a88f56ca8765c70.xml (deflated 35%) 2024-08-06T22:06:53.2486122Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dbbc72bd8ca431e8.xml (deflated 35%) 2024-08-06T22:06:53.2487443Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4826ab6aaf6460d7.xml (deflated 34%) 2024-08-06T22:06:53.2488765Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-aee676d739b229a6.xml (deflated 35%) 2024-08-06T22:06:53.2490096Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8eb462af112d3b99.xml (deflated 35%) 2024-08-06T22:06:53.2491422Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-1169254a151a6112.xml (deflated 34%) 2024-08-06T22:06:53.2492729Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-277a27fec9c60419.xml (deflated 35%) 2024-08-06T22:06:53.2494186Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-26ef2da2f50c96ed.xml (deflated 33%) 2024-08-06T22:06:53.2495509Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9f5f1affe2254752.xml (deflated 35%) 2024-08-06T22:06:53.2496828Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-db3d0e89392c4ef6.xml (deflated 35%) 2024-08-06T22:06:53.2498213Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a3f094578de22741.xml (deflated 35%) 2024-08-06T22:06:53.2499536Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-af67f7a3a70de177.xml (deflated 34%) 2024-08-06T22:06:53.2500853Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6453a3ffb77997fc.xml (deflated 34%) 2024-08-06T22:06:53.2502246Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-826f83c4373c998a.xml (deflated 35%) 2024-08-06T22:06:53.2504469Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f8e7e06d13f0f98f.xml (deflated 35%) 2024-08-06T22:06:53.2507139Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4fc4a31bf33a263a.xml (deflated 34%) 2024-08-06T22:06:53.2509654Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8905a78535bb4907.xml (deflated 34%) 2024-08-06T22:06:53.2511694Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-afaae25c899ca020.xml (deflated 35%) 2024-08-06T22:06:53.2513725Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-07dfc38b2ebc92ea.xml (deflated 35%) 2024-08-06T22:06:53.2516005Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c26a09e4da0d95aa.xml (deflated 35%) 2024-08-06T22:06:53.2518017Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-054509ea766ba6f4.xml (deflated 36%) 2024-08-06T22:06:53.2520047Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-40b92288d9fb7687.xml (deflated 34%) 2024-08-06T22:06:53.2522278Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9a898ce98fcf338c.xml (deflated 34%) 2024-08-06T22:06:53.2524525Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e90ae0364be5e356.xml (deflated 35%) 2024-08-06T22:06:53.2526867Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9281fe0cc00fee93.xml (deflated 35%) 2024-08-06T22:06:53.2529230Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fcca22b0b8b5f90e.xml (deflated 34%) 2024-08-06T22:06:53.2531752Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-6286afca1d81e8ab.xml (deflated 34%) 2024-08-06T22:06:53.2534307Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4a664e2756075a6e.xml (deflated 34%) 2024-08-06T22:06:53.2536669Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7070acd1ca148634.xml (deflated 35%) 2024-08-06T22:06:53.2539221Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c4d4f43c37ace8db.xml (deflated 34%) 2024-08-06T22:06:53.2541953Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c6a38e6f103e6916.xml (deflated 35%) 2024-08-06T22:06:53.2544465Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-426640783a54234d.xml (deflated 35%) 2024-08-06T22:06:53.2546808Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-27d34ace225ef398.xml (deflated 35%) 2024-08-06T22:06:53.2549506Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-27d94222a683cac0.xml (deflated 35%) 2024-08-06T22:06:53.2552054Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-90fa0bba792d212a.xml (deflated 34%) 2024-08-06T22:06:53.2554598Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-31cc4bc99e99e1f5.xml (deflated 35%) 2024-08-06T22:06:53.2556980Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-2e25410e1e4d5f17.xml (deflated 35%) 2024-08-06T22:06:53.2559154Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c0da1c8d19c59b97.xml (deflated 35%) 2024-08-06T22:06:53.2561441Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-ec6cb6cf8d265f69.xml (deflated 36%) 2024-08-06T22:06:53.2563698Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-bd49c6d52b6408c8.xml (deflated 36%) 2024-08-06T22:06:53.2565996Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8dcc5f9b2c121f04.xml (deflated 35%) 2024-08-06T22:06:53.2568268Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0c2da0dd14fb6fc6.xml (deflated 35%) 2024-08-06T22:06:53.2570470Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-e5e540e31aac38ce.xml (deflated 34%) 2024-08-06T22:06:53.2572766Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-f11ed490999abd45.xml (deflated 35%) 2024-08-06T22:06:53.2575328Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-fba1e61fdcc5db82.xml (deflated 35%) 2024-08-06T22:06:53.2577837Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-da34cb3adb855c24.xml (deflated 34%) 2024-08-06T22:06:53.2580351Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-90b5736c2b3918d7.xml (deflated 35%) 2024-08-06T22:06:53.2582888Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-56cfaa566359cd4f.xml (deflated 34%) 2024-08-06T22:06:53.2585375Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-305531253f8e454f.xml (deflated 35%) 2024-08-06T22:06:53.2587724Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-88d60afb628d0dd7.xml (deflated 36%) 2024-08-06T22:06:53.2590023Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0a4b33bd4476069e.xml (deflated 36%) 2024-08-06T22:06:53.2592313Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-3659a6d7692495cf.xml (deflated 36%) 2024-08-06T22:06:53.2594788Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-182d7eb167ba7f82.xml (deflated 36%) 2024-08-06T22:06:53.2596994Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8c850e3e6e996496.xml (deflated 37%) 2024-08-06T22:06:53.2599155Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-875398df02b040e5.xml (deflated 36%) 2024-08-06T22:06:53.2601510Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-7ce6b6db856e702c.xml (deflated 36%) 2024-08-06T22:06:53.2603715Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a0ec98d06c27a066.xml (deflated 37%) 2024-08-06T22:06:53.2605990Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4481b16d5ed6143f.xml (deflated 37%) 2024-08-06T22:06:53.2608206Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8fe70902480b2304.xml (deflated 36%) 2024-08-06T22:06:53.2610537Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c3d19b6cd43f5a84.xml (deflated 37%) 2024-08-06T22:06:53.2612691Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4ec5f21f39d6df42.xml (deflated 37%) 2024-08-06T22:06:53.2614676Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-c01797a4870dd547.xml (deflated 37%) 2024-08-06T22:06:53.2616105Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-be7def37413d6ee0.xml (deflated 37%) 2024-08-06T22:06:53.2617440Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-de60aaf23f81da32.xml (deflated 36%) 2024-08-06T22:06:53.2618764Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-4a9f97bc136e3cf8.xml (deflated 36%) 2024-08-06T22:06:53.2620078Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-9544eae12ffddd47.xml (deflated 39%) 2024-08-06T22:06:53.2621401Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a5a4125c8ae7d422.xml (deflated 39%) 2024-08-06T22:06:53.2622714Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-db938612ac330474.xml (deflated 35%) 2024-08-06T22:06:53.2624028Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-0c462081099f5058.xml (deflated 37%) 2024-08-06T22:06:53.2625335Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-681875c5ed5f0e0a.xml (deflated 36%) 2024-08-06T22:06:53.2626650Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5940e91fa5885389.xml (deflated 36%) 2024-08-06T22:06:53.2627962Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a4841b5389619022.xml (deflated 36%) 2024-08-06T22:06:53.2629280Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-924e6888e7fa39dd.xml (deflated 36%) 2024-08-06T22:06:53.2630582Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-b7659794f93f8416.xml (deflated 37%) 2024-08-06T22:06:53.2632004Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-a9d8fbf8e8bff35e.xml (deflated 37%) 2024-08-06T22:06:53.2633321Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-5da38123277cc251.xml (deflated 37%) 2024-08-06T22:06:53.2634649Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-8116b98a9ea2427a.xml (deflated 37%) 2024-08-06T22:06:53.2635955Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-31542fb160dfe3d6.xml (deflated 36%) 2024-08-06T22:06:53.2637329Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-779576b5c9be34ad.xml (deflated 36%) 2024-08-06T22:06:53.2638654Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-dd90cf21fe0ff33e.xml (deflated 36%) 2024-08-06T22:06:53.2639972Z adding: test/test-reports/python-pytest/distributed.rpc.test_tensorpipe_agent/distributed.rpc.test_tensorpipe_agent-777b87cf1b7597ec.xml (deflated 36%) 2024-08-06T22:06:53.2641399Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_tensor_ops/distributed._shard.sharded_tensor.ops.test_tensor_ops-e63893fc201c88ee.xml (deflated 83%) 2024-08-06T22:06:53.2642965Z adding: test/test-reports/python-pytest/distributed._shard.sharded_tensor.ops.test_binary_cmp/distributed._shard.sharded_tensor.ops.test_binary_cmp-cb915696069999fe.xml (deflated 81%) 2024-08-06T22:06:53.2644308Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f561dc0d2f22675c.xml (deflated 34%) 2024-08-06T22:06:53.2645495Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2cfc7607af36c301.xml (deflated 37%) 2024-08-06T22:06:53.2646601Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ad9fb267a7e3b794.xml (deflated 35%) 2024-08-06T22:06:53.2647720Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0a093c29a85d9e75.xml (deflated 43%) 2024-08-06T22:06:53.2648833Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0a153c8558c4334a.xml (deflated 35%) 2024-08-06T22:06:53.2649949Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-794b82616c5ed428.xml (deflated 35%) 2024-08-06T22:06:53.2651053Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e4139c072b356aef.xml (deflated 36%) 2024-08-06T22:06:53.2652166Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-53e63dce2d375782.xml (deflated 35%) 2024-08-06T22:06:53.2653282Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-dd92ab972f2981c9.xml (deflated 35%) 2024-08-06T22:06:53.2654386Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6d824fdc5e1d0a59.xml (deflated 35%) 2024-08-06T22:06:53.2655502Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-36ca6059fe854422.xml (deflated 42%) 2024-08-06T22:06:53.2656612Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9e07bccc511c120e.xml (deflated 35%) 2024-08-06T22:06:53.2657733Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0b8bf64ed06e213a.xml (deflated 42%) 2024-08-06T22:06:53.2658841Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fd0410adf06f7745.xml (deflated 36%) 2024-08-06T22:06:53.2659958Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a8155841b2cc7d46.xml (deflated 35%) 2024-08-06T22:06:53.2661134Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d35371bfa2d2cd39.xml (deflated 35%) 2024-08-06T22:06:53.2662249Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-155bcc46ba9beb43.xml (deflated 36%) 2024-08-06T22:06:53.2663353Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e6ced7e95b0d9397.xml (deflated 42%) 2024-08-06T22:06:53.2664471Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3327b01bed0f09dc.xml (deflated 35%) 2024-08-06T22:06:53.2665656Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b90af10207164ebe.xml (deflated 35%) 2024-08-06T22:06:53.2666763Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-26cef4e23fefce64.xml (deflated 43%) 2024-08-06T22:06:53.2667878Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f0e919c0254be75e.xml (deflated 34%) 2024-08-06T22:06:53.2668992Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-31dc2706679e37e7.xml (deflated 36%) 2024-08-06T22:06:53.2670106Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f04fe2705a96bfba.xml (deflated 43%) 2024-08-06T22:06:53.2671204Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8ed387e1db688f85.xml (deflated 35%) 2024-08-06T22:06:53.2672320Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6598abfdca12bd1d.xml (deflated 35%) 2024-08-06T22:06:53.2673560Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4263cdb71351b849.xml (deflated 43%) 2024-08-06T22:06:53.2674967Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-dbfacc2ab3ad5e2d.xml (deflated 35%) 2024-08-06T22:06:53.2676328Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-273456bfadd0079f.xml (deflated 35%) 2024-08-06T22:06:53.2677520Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a35dc9e4d67b6101.xml (deflated 42%) 2024-08-06T22:06:53.2678683Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7ec23b975d42dd79.xml (deflated 35%) 2024-08-06T22:06:53.2700620Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1beddd03595fec1f.xml (deflated 35%) 2024-08-06T22:06:53.2701802Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0781d543bf22eb88.xml (deflated 35%) 2024-08-06T22:06:53.2702913Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0318684e170e1580.xml (deflated 42%) 2024-08-06T22:06:53.2704019Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-950cdeaf4e2abd27.xml (deflated 35%) 2024-08-06T22:06:53.2705138Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a10221fe9688c2a4.xml (deflated 35%) 2024-08-06T22:06:53.2706241Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e544f301a6fbe270.xml (deflated 42%) 2024-08-06T22:06:53.2707444Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f38b36250a1b7442.xml (deflated 35%) 2024-08-06T22:06:53.2708546Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-60588e357bfafa2d.xml (deflated 35%) 2024-08-06T22:06:53.2709663Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-83606bf587c0c9f2.xml (deflated 35%) 2024-08-06T22:06:53.2710891Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d5dee8cfd80b9fb9.xml (deflated 35%) 2024-08-06T22:06:53.2712186Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-edfc4185c013f446.xml (deflated 42%) 2024-08-06T22:06:53.2713293Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-82990e8e99192b9c.xml (deflated 36%) 2024-08-06T22:06:53.2714399Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d5d5ba31a2ea8750.xml (deflated 35%) 2024-08-06T22:06:53.2715610Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-46730ead3d9f8902.xml (deflated 35%) 2024-08-06T22:06:53.2716705Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-03577b6bd9ae7215.xml (deflated 42%) 2024-08-06T22:06:53.2717804Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-465c6218e73031bc.xml (deflated 35%) 2024-08-06T22:06:53.2718911Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0cdb0d307343e793.xml (deflated 35%) 2024-08-06T22:06:53.2720017Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-6f7d69fba59f4098.xml (deflated 47%) 2024-08-06T22:06:53.2721112Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a44541d01ae594cb.xml (deflated 35%) 2024-08-06T22:06:53.2722212Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9d4a612186fa9398.xml (deflated 57%) 2024-08-06T22:06:53.2723324Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1bf3168bdd86f1a2.xml (deflated 35%) 2024-08-06T22:06:53.2724416Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-bd728bf84524a8e4.xml (deflated 43%) 2024-08-06T22:06:53.2725595Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3b04852e93f1d976.xml (deflated 35%) 2024-08-06T22:06:53.2726704Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-42bf0c9f7bd33cec.xml (deflated 42%) 2024-08-06T22:06:53.2727813Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5784d80735b2aba8.xml (deflated 43%) 2024-08-06T22:06:53.2728912Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cb4e2752d8c11b11.xml (deflated 43%) 2024-08-06T22:06:53.2730021Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-fdc32014ae6a27b1.xml (deflated 42%) 2024-08-06T22:06:53.2731130Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9cd6d63e9920d853.xml (deflated 42%) 2024-08-06T22:06:53.2732241Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-dea65a238d6264c9.xml (deflated 42%) 2024-08-06T22:06:53.2733339Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-63180871a638a01d.xml (deflated 42%) 2024-08-06T22:06:53.2734448Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-f5ece5a5391a686a.xml (deflated 42%) 2024-08-06T22:06:53.2735557Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2c2787f052e699e8.xml (deflated 42%) 2024-08-06T22:06:53.2736660Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1d34f6da682ee105.xml (deflated 42%) 2024-08-06T22:06:53.2737767Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2e5212a122d5cfec.xml (deflated 42%) 2024-08-06T22:06:53.2738869Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3b64ba8a87207ea8.xml (deflated 42%) 2024-08-06T22:06:53.2740057Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5d5e138762dd8b74.xml (deflated 42%) 2024-08-06T22:06:53.2741159Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-91173b44cebfaafe.xml (deflated 42%) 2024-08-06T22:06:53.2742327Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-01be47a296bd19ad.xml (deflated 42%) 2024-08-06T22:06:53.2743436Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-de797beb5a321584.xml (deflated 42%) 2024-08-06T22:06:53.2744599Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-475e4c20d755ca78.xml (deflated 36%) 2024-08-06T22:06:53.2745696Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-409c140c30fef3a3.xml (deflated 43%) 2024-08-06T22:06:53.2746806Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8c8fe6f042f3dcc8.xml (deflated 36%) 2024-08-06T22:06:53.2747925Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b6a5bdddc8ed305c.xml (deflated 36%) 2024-08-06T22:06:53.2749034Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-63bf3a0b42d8be16.xml (deflated 36%) 2024-08-06T22:06:53.2750130Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-289550863de4d17f.xml (deflated 36%) 2024-08-06T22:06:53.2751237Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3b0b2a199fc702f7.xml (deflated 45%) 2024-08-06T22:06:53.2752338Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-8c22e94539b8f19a.xml (deflated 44%) 2024-08-06T22:06:53.2753430Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cf0511eb61aa4ff4.xml (deflated 44%) 2024-08-06T22:06:53.2754539Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-db7b12518c318714.xml (deflated 43%) 2024-08-06T22:06:53.2755643Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1cdd2f9e1235e4fe.xml (deflated 44%) 2024-08-06T22:06:53.2756741Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-739087ec36228612.xml (deflated 44%) 2024-08-06T22:06:53.2757828Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-73a2e17c3331536b.xml (deflated 44%) 2024-08-06T22:06:53.2758934Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-eddd4836d35b70af.xml (deflated 44%) 2024-08-06T22:06:53.2760039Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ec80f60919323010.xml (deflated 36%) 2024-08-06T22:06:53.2761141Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-efe029112694a3b0.xml (deflated 36%) 2024-08-06T22:06:53.2762242Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3fc4f6eb90d5ef3f.xml (deflated 36%) 2024-08-06T22:06:53.2763350Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-b6af78f39892d201.xml (deflated 35%) 2024-08-06T22:06:53.2764460Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-00da7b2b3ccf467b.xml (deflated 44%) 2024-08-06T22:06:53.2765635Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-d2243af8ba6af2c7.xml (deflated 36%) 2024-08-06T22:06:53.2766757Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0ef98aa4f4b4deed.xml (deflated 44%) 2024-08-06T22:06:53.2767869Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-44a7d667e8ce9e36.xml (deflated 37%) 2024-08-06T22:06:53.2769039Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-30293f2ea5bc62a4.xml (deflated 36%) 2024-08-06T22:06:53.2770132Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-7c1f3a386b7a199f.xml (deflated 42%) 2024-08-06T22:06:53.2771236Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-31157c0339a49a45.xml (deflated 42%) 2024-08-06T22:06:53.2772392Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0672169b695f25b9.xml (deflated 35%) 2024-08-06T22:06:53.2773494Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e59dc44e4e0b4e4a.xml (deflated 35%) 2024-08-06T22:06:53.2774787Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a598f3ddfc94c342.xml (deflated 36%) 2024-08-06T22:06:53.2775907Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a9963fa3b16da193.xml (deflated 37%) 2024-08-06T22:06:53.2777013Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-809516dfd85622f5.xml (deflated 35%) 2024-08-06T22:06:53.2778106Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5ef39afa45782f93.xml (deflated 37%) 2024-08-06T22:06:53.2779213Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-9d48e71386f2ec0e.xml (deflated 37%) 2024-08-06T22:06:53.2780325Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0c5cbd5fd65d22e4.xml (deflated 37%) 2024-08-06T22:06:53.2781438Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-cd6c1697ab2cdc89.xml (deflated 44%) 2024-08-06T22:06:53.2782541Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-a093679976397d89.xml (deflated 44%) 2024-08-06T22:06:53.2783648Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-1715529707cdba37.xml (deflated 44%) 2024-08-06T22:06:53.2784794Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-764516dba81a6f06.xml (deflated 43%) 2024-08-06T22:06:53.2785902Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-0edd36532fd69acf.xml (deflated 44%) 2024-08-06T22:06:53.2787008Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-c1a888b9ebf62452.xml (deflated 44%) 2024-08-06T22:06:53.2788112Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-ef9a6a232db12784.xml (deflated 44%) 2024-08-06T22:06:53.2789220Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-4002b3106d9affa7.xml (deflated 43%) 2024-08-06T22:06:53.2790318Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-279be542b753d386.xml (deflated 43%) 2024-08-06T22:06:53.2791420Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-3873d8bf66f836f8.xml (deflated 34%) 2024-08-06T22:06:53.2792530Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-2d4a405b46dd94a4.xml (deflated 34%) 2024-08-06T22:06:53.2793675Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-814ba34c5c022ae1.xml (deflated 34%) 2024-08-06T22:06:53.2794775Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-26a75a6ec6bec901.xml (deflated 36%) 2024-08-06T22:06:53.2795901Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-587e7287b19e87e0.xml (deflated 34%) 2024-08-06T22:06:53.2797118Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-dc088d69b25e7334.xml (deflated 34%) 2024-08-06T22:06:53.2798234Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-eeb759478e4496a0.xml (deflated 34%) 2024-08-06T22:06:53.2799324Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-e184882510370508.xml (deflated 34%) 2024-08-06T22:06:53.2800429Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-5ddb711168f80a26.xml (deflated 34%) 2024-08-06T22:06:53.2801614Z adding: test/test-reports/python-pytest/distributed.test_c10d_gloo/distributed.test_c10d_gloo-bdd0d4b6765418b7.xml (deflated 34%) 2024-08-06T22:06:53.2802589Z adding: test/test-reports/python-pytest/test.run_test/test.run_test-f5c3256513e9bd19.xml (deflated 65%) 2024-08-06T22:06:53.2803635Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0c919d9ae2debc77.xml (deflated 57%) 2024-08-06T22:06:53.2804864Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0899087eb71b4574.xml (deflated 42%) 2024-08-06T22:06:53.2806192Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eae4c972676260a5.xml (deflated 41%) 2024-08-06T22:06:53.2807404Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6cac89d09c9db294.xml (deflated 42%) 2024-08-06T22:06:53.2808636Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b447d504fd218787.xml (deflated 43%) 2024-08-06T22:06:53.2809858Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9b9a98ba2edf11de.xml (deflated 42%) 2024-08-06T22:06:53.2811094Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-50bc7e53df8d9b5b.xml (deflated 35%) 2024-08-06T22:06:53.2812305Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-60490a105a0d4f3c.xml (deflated 35%) 2024-08-06T22:06:53.2813523Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ee1a27d0ab8314ed.xml (deflated 35%) 2024-08-06T22:06:53.2814745Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0994296bafded557.xml (deflated 35%) 2024-08-06T22:06:53.2815991Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d358fc7159438805.xml (deflated 35%) 2024-08-06T22:06:53.2817193Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-58af1340208eaa15.xml (deflated 43%) 2024-08-06T22:06:53.2818411Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-57f75e891def2c49.xml (deflated 44%) 2024-08-06T22:06:53.2819630Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7dae308a306e0de2.xml (deflated 36%) 2024-08-06T22:06:53.2820836Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f5f225e0a7624e16.xml (deflated 35%) 2024-08-06T22:06:53.2822051Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6e81ea3512e3ab60.xml (deflated 35%) 2024-08-06T22:06:53.2823269Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9bc9955e571681d9.xml (deflated 35%) 2024-08-06T22:06:53.2824480Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-16c8480e15a1c3c2.xml (deflated 35%) 2024-08-06T22:06:53.2825763Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-eb088f42ac870bde.xml (deflated 42%) 2024-08-06T22:06:53.2826980Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dd6b005a387e02a1.xml (deflated 43%) 2024-08-06T22:06:53.2828197Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e1c4c8e294cf67e0.xml (deflated 43%) 2024-08-06T22:06:53.2829409Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-34649dab6944f57c.xml (deflated 43%) 2024-08-06T22:06:53.2830662Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ba49a67907c0e4f.xml (deflated 44%) 2024-08-06T22:06:53.2831878Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3bb502f0f51d9e6c.xml (deflated 45%) 2024-08-06T22:06:53.2833099Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e320859ddd44c7ba.xml (deflated 44%) 2024-08-06T22:06:53.2834317Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-936b8c73a3db2386.xml (deflated 44%) 2024-08-06T22:06:53.2835527Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bfc11941412dbd97.xml (deflated 44%) 2024-08-06T22:06:53.2836742Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3723f4f081f5b1a5.xml (deflated 44%) 2024-08-06T22:06:53.2837961Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-67ca2e28781173b7.xml (deflated 44%) 2024-08-06T22:06:53.2839178Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c717fcbc06754647.xml (deflated 43%) 2024-08-06T22:06:53.2840388Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-243532108496cc22.xml (deflated 35%) 2024-08-06T22:06:53.2841605Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fc44e8b417adcb1c.xml (deflated 50%) 2024-08-06T22:06:53.2842835Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ec4fd9bdf7c71f30.xml (deflated 42%) 2024-08-06T22:06:53.2844053Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-254775ff5c5edfa1.xml (deflated 42%) 2024-08-06T22:06:53.2845271Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a70817a40fe927dd.xml (deflated 42%) 2024-08-06T22:06:53.2846565Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f6a7acef0a312f6a.xml (deflated 36%) 2024-08-06T22:06:53.2847790Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4287a9c83d0896bc.xml (deflated 42%) 2024-08-06T22:06:53.2849002Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dee6eb6e0f4f6c68.xml (deflated 56%) 2024-08-06T22:06:53.2850231Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7a03b34f27d417d3.xml (deflated 42%) 2024-08-06T22:06:53.2851460Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e47d5cc050eaa182.xml (deflated 42%) 2024-08-06T22:06:53.2852682Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6878f5bd6e0dacd4.xml (deflated 42%) 2024-08-06T22:06:53.2853892Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5b2bb350bb44d07d.xml (deflated 42%) 2024-08-06T22:06:53.2855170Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-74b122d5541cbb8d.xml (deflated 42%) 2024-08-06T22:06:53.2856393Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f1ced646786f7dff.xml (deflated 48%) 2024-08-06T22:06:53.2857620Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-61ca89e5cdd4cb75.xml (deflated 42%) 2024-08-06T22:06:53.2858870Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9d31ca4180750a4c.xml (deflated 41%) 2024-08-06T22:06:53.2860084Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-270481805daea577.xml (deflated 42%) 2024-08-06T22:06:53.2861297Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-50a32959f037357c.xml (deflated 42%) 2024-08-06T22:06:53.2862506Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0470176f852a0085.xml (deflated 42%) 2024-08-06T22:06:53.2863709Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-02a345d68f90b2f9.xml (deflated 42%) 2024-08-06T22:06:53.2864924Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-35fb35853fff9d3c.xml (deflated 41%) 2024-08-06T22:06:53.2866146Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a80c68060611b490.xml (deflated 44%) 2024-08-06T22:06:53.2867354Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-71afc8e17231efed.xml (deflated 43%) 2024-08-06T22:06:53.2868570Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a8b9232c9dfae9da.xml (deflated 42%) 2024-08-06T22:06:53.2869797Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fcbb71062ab547c0.xml (deflated 47%) 2024-08-06T22:06:53.2871013Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5362eba786a9f8c9.xml (deflated 42%) 2024-08-06T22:06:53.2872218Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6d391c461a9d312d.xml (deflated 41%) 2024-08-06T22:06:53.2873435Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-093d226d38ac9c10.xml (deflated 42%) 2024-08-06T22:06:53.2874838Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5382c662972d9226.xml (deflated 36%) 2024-08-06T22:06:53.2876062Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c0b3756c1bcc550f.xml (deflated 36%) 2024-08-06T22:06:53.2877279Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-65443ea0de81fc3d.xml (deflated 42%) 2024-08-06T22:06:53.2878527Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-75f623bf67592195.xml (deflated 35%) 2024-08-06T22:06:53.2879738Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e225673244d3f2af.xml (deflated 43%) 2024-08-06T22:06:53.2880952Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-775d90e405893dae.xml (deflated 35%) 2024-08-06T22:06:53.2882153Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7d2d48deb850be30.xml (deflated 36%) 2024-08-06T22:06:53.2883368Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a79a36993566cf41.xml (deflated 34%) 2024-08-06T22:06:53.2884687Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1d211900a9b29980.xml (deflated 36%) 2024-08-06T22:06:53.2885953Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a20727a4b9ad154f.xml (deflated 36%) 2024-08-06T22:06:53.2887153Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-11305095648859f6.xml (deflated 35%) 2024-08-06T22:06:53.2888426Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-99ce92b653a4f229.xml (deflated 42%) 2024-08-06T22:06:53.2889646Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ed9b56c91e187992.xml (deflated 35%) 2024-08-06T22:06:53.2890858Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f241b986a593cab5.xml (deflated 45%) 2024-08-06T22:06:53.2892112Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d181775242ce5efb.xml (deflated 43%) 2024-08-06T22:06:53.2893337Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-87dbf8cd7dc8508a.xml (deflated 42%) 2024-08-06T22:06:53.2894563Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ed496b814a386c8.xml (deflated 43%) 2024-08-06T22:06:53.2895771Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5a062b79b8c56565.xml (deflated 42%) 2024-08-06T22:06:53.2896993Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-83b6e78c6e9c80ab.xml (deflated 42%) 2024-08-06T22:06:53.2898248Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-80fba6ce7eb44496.xml (deflated 41%) 2024-08-06T22:06:53.2899496Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-af306ea05d17206d.xml (deflated 56%) 2024-08-06T22:06:53.2900705Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bb72ca5edcaa2de3.xml (deflated 35%) 2024-08-06T22:06:53.2901933Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4ec1ab5bac358ff3.xml (deflated 35%) 2024-08-06T22:06:53.2903160Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7ab7bec6187e5c31.xml (deflated 35%) 2024-08-06T22:06:53.2904380Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4ff1dafed8734e79.xml (deflated 35%) 2024-08-06T22:06:53.2905588Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bf2d0803099ff5f2.xml (deflated 44%) 2024-08-06T22:06:53.2906813Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d8c1d2fdeb341404.xml (deflated 36%) 2024-08-06T22:06:53.2908061Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-459c703f524ee303.xml (deflated 35%) 2024-08-06T22:06:53.2909354Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-fa909f68bc11e345.xml (deflated 35%) 2024-08-06T22:06:53.2910566Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b7ef96462fae92f7.xml (deflated 35%) 2024-08-06T22:06:53.2911795Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d5b7a3ca17eddad8.xml (deflated 35%) 2024-08-06T22:06:53.2913070Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-042f267933262917.xml (deflated 35%) 2024-08-06T22:06:53.2914273Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9224163febaf985e.xml (deflated 42%) 2024-08-06T22:06:53.2915499Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3e090b5cef616beb.xml (deflated 42%) 2024-08-06T22:06:53.2916758Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c069db2b65dc4bbc.xml (deflated 57%) 2024-08-06T22:06:53.2918090Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a117dbbe5e729a43.xml (deflated 42%) 2024-08-06T22:06:53.2919341Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-54be3d35265e75df.xml (deflated 41%) 2024-08-06T22:06:53.2920565Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b1eb4df064002a44.xml (deflated 42%) 2024-08-06T22:06:53.2921792Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-684738db28fecad6.xml (deflated 43%) 2024-08-06T22:06:53.2923023Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ac58a2bccf7cbf52.xml (deflated 42%) 2024-08-06T22:06:53.2924232Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-99856b088066128c.xml (deflated 35%) 2024-08-06T22:06:53.2925556Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f80ca08002c563c.xml (deflated 36%) 2024-08-06T22:06:53.2926778Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-66e76d90f36c8f15.xml (deflated 35%) 2024-08-06T22:06:53.2928104Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e443c7d24ee86cb9.xml (deflated 36%) 2024-08-06T22:06:53.2929314Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-754520bf246fb849.xml (deflated 35%) 2024-08-06T22:06:53.2930532Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ca44adc4fe2b7448.xml (deflated 43%) 2024-08-06T22:06:53.2931754Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c912ce50681b515b.xml (deflated 44%) 2024-08-06T22:06:53.2932974Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1b049fdfce32c4d5.xml (deflated 36%) 2024-08-06T22:06:53.2934179Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4132cb685f22a6e3.xml (deflated 35%) 2024-08-06T22:06:53.2935396Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-bc40833d8f125ab4.xml (deflated 35%) 2024-08-06T22:06:53.2936732Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8cb2aa58b419ea56.xml (deflated 35%) 2024-08-06T22:06:53.2938056Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-88ddfd485e0d1771.xml (deflated 35%) 2024-08-06T22:06:53.2939297Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2ab382ab6532ac9b.xml (deflated 42%) 2024-08-06T22:06:53.2940515Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d2a6b152afb99479.xml (deflated 43%) 2024-08-06T22:06:53.2941732Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2e137052fdaa6d9d.xml (deflated 43%) 2024-08-06T22:06:53.2943014Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2996700b5dcf51da.xml (deflated 43%) 2024-08-06T22:06:53.2944266Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-98515aa3d07b340b.xml (deflated 44%) 2024-08-06T22:06:53.2945539Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-400f32a4ea7670fe.xml (deflated 45%) 2024-08-06T22:06:53.2946945Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-58a7902b4a6ef656.xml (deflated 44%) 2024-08-06T22:06:53.2948285Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c440550e278cb3d3.xml (deflated 44%) 2024-08-06T22:06:53.2949509Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-723ac8e0f1ca7d8e.xml (deflated 44%) 2024-08-06T22:06:53.2950732Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-667f47778ec118bd.xml (deflated 44%) 2024-08-06T22:06:53.2951954Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6c851a7c64bfa270.xml (deflated 44%) 2024-08-06T22:06:53.2953166Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a60bc6d0748e774e.xml (deflated 43%) 2024-08-06T22:06:53.2954390Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6e6b81f57ef6ac96.xml (deflated 35%) 2024-08-06T22:06:53.2955657Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-98a3b5ab3105738a.xml (deflated 50%) 2024-08-06T22:06:53.2956896Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2318e9354502df73.xml (deflated 42%) 2024-08-06T22:06:53.2958101Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-dea17575c091fb03.xml (deflated 42%) 2024-08-06T22:06:53.2959316Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-0f3610b0e4494192.xml (deflated 42%) 2024-08-06T22:06:53.2960540Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ffefbeaba11bc8ba.xml (deflated 36%) 2024-08-06T22:06:53.2961755Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8f205366a1b8d948.xml (deflated 42%) 2024-08-06T22:06:53.2962974Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70593679fe3a9bf0.xml (deflated 56%) 2024-08-06T22:06:53.2964193Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-cde98044b42599ef.xml (deflated 42%) 2024-08-06T22:06:53.2965554Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-6265a53ecc2c94a4.xml (deflated 41%) 2024-08-06T22:06:53.2966765Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a59892fa4fd38d4f.xml (deflated 42%) 2024-08-06T22:06:53.2967988Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d884a776912c5c39.xml (deflated 42%) 2024-08-06T22:06:53.2969215Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-94a51ea302abaa41.xml (deflated 42%) 2024-08-06T22:06:53.2970439Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3c88d5f737e5d722.xml (deflated 48%) 2024-08-06T22:06:53.2971646Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-aef023c2fe0c9ba0.xml (deflated 42%) 2024-08-06T22:06:53.2972929Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d562dad5709ac892.xml (deflated 41%) 2024-08-06T22:06:53.2974148Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-af5f97e0dc5d2506.xml (deflated 42%) 2024-08-06T22:06:53.2975531Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-066545477ac7c25d.xml (deflated 42%) 2024-08-06T22:06:53.2976835Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-36b04abaf31bf567.xml (deflated 42%) 2024-08-06T22:06:53.2978059Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1ccf56ba41c8a121.xml (deflated 42%) 2024-08-06T22:06:53.2979283Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-defb6529afefb0b4.xml (deflated 42%) 2024-08-06T22:06:53.2980507Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5ebde04985222cf2.xml (deflated 44%) 2024-08-06T22:06:53.2981713Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-573a18d57f4327fa.xml (deflated 43%) 2024-08-06T22:06:53.2982936Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-f82e80ecaab67a17.xml (deflated 42%) 2024-08-06T22:06:53.2984157Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9365acf3876ff0e1.xml (deflated 47%) 2024-08-06T22:06:53.2985367Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-60bc2dda88e43c1a.xml (deflated 42%) 2024-08-06T22:06:53.2986587Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-d8439be43ec85c46.xml (deflated 41%) 2024-08-06T22:06:53.2987806Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-25f822875e549b22.xml (deflated 42%) 2024-08-06T22:06:53.2989017Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-2fe16548445ac0d3.xml (deflated 36%) 2024-08-06T22:06:53.2990219Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-31d4e1475d208d80.xml (deflated 36%) 2024-08-06T22:06:53.2991428Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-00d3e49e5efd1960.xml (deflated 42%) 2024-08-06T22:06:53.2992643Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9898adbad8119ea2.xml (deflated 35%) 2024-08-06T22:06:53.2993861Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-9e50ef0c68d92b43.xml (deflated 43%) 2024-08-06T22:06:53.2995066Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ba18fde8276ad6e3.xml (deflated 35%) 2024-08-06T22:06:53.2996293Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e19d1b8ed3bd17e1.xml (deflated 36%) 2024-08-06T22:06:53.2997517Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c3f0715de5cd39da.xml (deflated 35%) 2024-08-06T22:06:53.2998738Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-944f77b786896bb8.xml (deflated 36%) 2024-08-06T22:06:53.2999943Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4daefc1c057c1b90.xml (deflated 36%) 2024-08-06T22:06:53.3001245Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-42e873ae8b479c7e.xml (deflated 35%) 2024-08-06T22:06:53.3002460Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-382adfd163721ce8.xml (deflated 42%) 2024-08-06T22:06:53.3003683Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ebf85fd619ba083e.xml (deflated 35%) 2024-08-06T22:06:53.3004891Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-110cf161ea44d0f4.xml (deflated 45%) 2024-08-06T22:06:53.3006246Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-b7076c0462947238.xml (deflated 43%) 2024-08-06T22:06:53.3007464Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1402a0b220983a4a.xml (deflated 42%) 2024-08-06T22:06:53.3008667Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-70377372ded92f9e.xml (deflated 43%) 2024-08-06T22:06:53.3009886Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-1bd7ad11323ab50a.xml (deflated 42%) 2024-08-06T22:06:53.3011098Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-10b9419f244e1f1f.xml (deflated 42%) 2024-08-06T22:06:53.3012313Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-af04851d6bd3318c.xml (deflated 41%) 2024-08-06T22:06:53.3013523Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7c5f6decee1e666f.xml (deflated 56%) 2024-08-06T22:06:53.3014752Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-ebfd1ec43135e70e.xml (deflated 35%) 2024-08-06T22:06:53.3015981Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-afc65ad69a02ec27.xml (deflated 35%) 2024-08-06T22:06:53.3017206Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-a2c6e3ba38ffcea1.xml (deflated 35%) 2024-08-06T22:06:53.3018413Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-e31f8fd2ccc77653.xml (deflated 35%) 2024-08-06T22:06:53.3019638Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c12cf12956e3b69b.xml (deflated 44%) 2024-08-06T22:06:53.3020852Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-5fe86f670851e1b8.xml (deflated 35%) 2024-08-06T22:06:53.3022067Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-8d10618b4f1e35c8.xml (deflated 35%) 2024-08-06T22:06:53.3023275Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-4ffb2f933437307b.xml (deflated 35%) 2024-08-06T22:06:53.3024493Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-3499a8c9e4c4866a.xml (deflated 35%) 2024-08-06T22:06:53.3025710Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-39a95e62457f263b.xml (deflated 35%) 2024-08-06T22:06:53.3026929Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-79c86ba7ce79c341.xml (deflated 35%) 2024-08-06T22:06:53.3028137Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-c757858611c68cdd.xml (deflated 42%) 2024-08-06T22:06:53.3029347Z adding: test/test-reports/dist-gloo/distributed.test_distributed_spawn/distributed.test_distributed_spawn-7db4861235296834.xml (deflated 42%) 2024-08-06T22:06:53.3030837Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-ac22c7f92b71df1b.xml (deflated 38%) 2024-08-06T22:06:53.3032499Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-ab42ccf558bad249.xml (deflated 38%) 2024-08-06T22:06:53.3034143Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-2a7bbf1132855385.xml (deflated 48%) 2024-08-06T22:06:53.3035845Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-95f3bdc7963e198e.xml (deflated 49%) 2024-08-06T22:06:53.3037493Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-74ab4d954690bc60.xml (deflated 48%) 2024-08-06T22:06:53.3039138Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-dbf2b492d9884393.xml (deflated 48%) 2024-08-06T22:06:53.3040773Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-debc120c6fd5d158.xml (deflated 38%) 2024-08-06T22:06:53.3042435Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-e5ed5ae9c2fec43d.xml (deflated 37%) 2024-08-06T22:06:53.3044081Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-0d3d155b55856ce2.xml (deflated 48%) 2024-08-06T22:06:53.3045806Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-ec201e0d54eab320.xml (deflated 49%) 2024-08-06T22:06:53.3047458Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-5b7f71e5c1e345e7.xml (deflated 48%) 2024-08-06T22:06:53.3049108Z adding: test/test-reports/dist-gloo/distributed.algorithms.quantization.test_quantization/distributed.algorithms.quantization.test_quantization-0faaa55e705f1553.xml (deflated 48%) 2024-08-06T22:06:53.3079253Z ##[group]Run # Remove any previous usage logs if they exist 2024-08-06T22:06:53.3079737Z # Remove any previous usage logs if they exist 2024-08-06T22:06:53.3080129Z rm -f logs-*.zip 2024-08-06T22:06:53.3080595Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2024-08-06T22:06:53.3081156Z # so check to see if the file exists first 2024-08-06T22:06:53.3081535Z if [ -f 'usage_log.txt' ]; then 2024-08-06T22:06:53.3081910Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2024-08-06T22:06:53.3082262Z fi 2024-08-06T22:06:53.3082534Z if ls test/**/*.log 1> /dev/null 2>&1; then 2024-08-06T22:06:53.3082931Z  zip -r "logs-${FILE_SUFFIX}.zip" test -i '*.log' 2024-08-06T22:06:53.3083294Z fi 2024-08-06T22:06:53.3088911Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:53.3089286Z env: 2024-08-06T22:06:53.3089519Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:53.3089995Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:53.3090633Z FILE_SUFFIX: test-distributed-1-2-amz2023.linux.2xlarge_28427732585 2024-08-06T22:06:53.3091066Z ##[endgroup] 2024-08-06T22:06:53.3180811Z adding: usage_log.txt (deflated 92%) 2024-08-06T22:06:53.3425521Z adding: test/test-reports/distributed.test_c10d_functional_native_1.1_c6bd6ebd46f3e6e2_.log (deflated 86%) 2024-08-06T22:06:53.4580835Z adding: test/test-reports/distributed._tensor.test_dtensor_ops_1.1_d6e3c12edb33f40a_.log (deflated 96%) 2024-08-06T22:06:53.4581845Z adding: test/test-reports/distributed.pipelining.test_schedule_multiproc_1.1_6d79f23de6e8e40c_.log (deflated 2%) 2024-08-06T22:06:53.4582975Z adding: test/test-reports/distributed.pipelining.test_pipe_1.1_a89fb196fb13e145_.log (deflated 62%) 2024-08-06T22:06:53.4583879Z adding: test/test-reports/distributed._tools.test_mem_tracker_1.1_415c2e5e0cffb81c_.log (deflated 62%) 2024-08-06T22:06:53.4584944Z adding: test/test-reports/distributed._tensor.test_experimental_ops_1.1_43203dacc9acba0e_.log (deflated 74%) 2024-08-06T22:06:53.4586150Z adding: test/test-reports/distributed._tensor.test_common_rules_1.1_862950ab468c6662_.log (deflated 76%) 2024-08-06T22:06:53.4587061Z adding: test/test-reports/distributed.fsdp.test_fsdp_fx_1.1_3632c351ed8e9131_.log (deflated 53%) 2024-08-06T22:06:53.4587856Z adding: test/test-reports/distributed._shard.test_sharder_1.1_f9987e621e7e564a_.log (deflated 59%) 2024-08-06T22:06:53.4588924Z adding: test/test-reports/distributed._tensor.experimental.test_register_sharding_1.1_3beb8a2413620e4f_.log (deflated 77%) 2024-08-06T22:06:53.4589902Z adding: test/test-reports/distributed._tensor.test_api_1.1_0b2970b17ea9095e_.log (deflated 89%) 2024-08-06T22:06:53.4590807Z adding: test/test-reports/distributed._tensor.test_random_ops_1.1_273d7b1875f94d0e_.log (deflated 75%) 2024-08-06T22:06:53.4591699Z adding: test/test-reports/distributed._tensor.test_init_1.1_197da0a6f20284be_.log (deflated 70%) 2024-08-06T22:06:53.4592585Z adding: test/test-reports/distributed.tensor.parallel.test_tp_style_1.1_2290aaa44ce9c7ec_.log (deflated 90%) 2024-08-06T22:06:53.4593638Z adding: test/test-reports/distributed._tensor.debug.test_comm_mode_features_1.1_feb54f6e469760ac_.log (deflated 82%) 2024-08-06T22:06:53.4594603Z adding: test/test-reports/distributed._tensor.test_math_ops_1.1_11bfb2741fe4c24c_.log (deflated 89%) 2024-08-06T22:06:53.4595559Z adding: test/test-reports/distributed.checkpoint.e2e.test_fsdp_ep_1.1_56d102369b7f7dcd_.log (deflated 54%) 2024-08-06T22:06:53.4596507Z adding: test/test-reports/distributed.optim.test_named_optimizer_1.1_0f770f34e510b94a_.log (deflated 34%) 2024-08-06T22:06:53.4597479Z adding: test/test-reports/distributed.test_compute_comm_reordering_1.1_8f649c69de62f40b_.log (deflated 76%) 2024-08-06T22:06:53.4598426Z adding: test/test-reports/distributed._tensor.test_matrix_ops_1.1_0b47d8e320d30f5f_.log (deflated 88%) 2024-08-06T22:06:53.4599355Z adding: test/test-reports/distributed._composable.test_checkpoint_1.1_3cb3fdaa995547bb_.log (deflated 69%) 2024-08-06T22:06:53.4600311Z adding: test/test-reports/distributed._tools.test_fsdp2_mem_tracker_1.1_54175da6201777f7_.log (deflated 67%) 2024-08-06T22:06:53.4602261Z adding: test/test-reports/distributed._tensor.test_redistribute_1.1_6f6833e6c0154c05_.log (deflated 92%) 2024-08-06T22:06:53.4603824Z adding: test/test-reports/distributed._tensor.test_pointwise_ops_1.1_06a1239f99f90b29_.log (deflated 69%) 2024-08-06T22:06:53.4605630Z adding: test/test-reports/distributed.checkpoint.test_save_load_api_1.1_0e4292288d64f9d2_.log (deflated 53%) 2024-08-06T22:06:53.4607358Z adding: test/test-reports/distributed.checkpoint.test_tp_checkpoint_1.1_4c19e3b46de881c9_.log (deflated 60%) 2024-08-06T22:06:53.4609105Z adding: test/test-reports/distributed._tensor.experimental.test_local_map_1.1_0188ea2942f2ab03_.log (deflated 78%) 2024-08-06T22:06:53.4610904Z adding: test/test-reports/distributed.checkpoint.test_format_utils_1.1_f3a70ea2788987df_.log (deflated 86%) 2024-08-06T22:06:53.4612600Z adding: test/test-reports/distributed.test_dynamo_distributed_1.1_b7bca7bd92bce29e_.log (deflated 88%) 2024-08-06T22:06:53.4614217Z adding: test/test-reports/distributed._tools.test_memory_tracker_1.1_a58d5582db2ebaba_.log (deflated 54%) 2024-08-06T22:06:53.4615907Z adding: test/test-reports/distributed.checkpoint.test_dtensor_resharding_1.1_86bd9110f977347f_.log (deflated 72%) 2024-08-06T22:06:53.4617955Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_state_1.1_27837a1a809f3b0b_.log (deflated 72%) 2024-08-06T22:06:53.4619815Z adding: test/test-reports/distributed.tensor.parallel.test_tp_random_state_1.1_04310ae142def7da_.log (deflated 55%) 2024-08-06T22:06:53.4621576Z adding: test/test-reports/distributed.checkpoint.test_fsdp_optim_state_1.1_2a38b1b1c2a5e13b_.log (deflated 62%) 2024-08-06T22:06:53.4623274Z adding: test/test-reports/distributed.checkpoint.e2e.test_e2e_save_and_load_1.1_fe6790321c2e0bdc_.log (deflated 94%) 2024-08-06T22:06:53.4625107Z adding: test/test-reports/distributed.fsdp.test_fsdp_exec_order_1.1_ff1f1993be97ffc8_.log (deflated 80%) 2024-08-06T22:06:53.4626859Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_logging_1.1_0edb734a517b1b6e_.log (deflated 53%) 2024-08-06T22:06:53.4628669Z adding: test/test-reports/distributed._shard.sharding_plan.test_sharding_plan_1.1_b543825be598ee47_.log (deflated 66%) 2024-08-06T22:06:53.4630477Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_overlap_1.1_a07029165daf906b_.log (deflated 63%) 2024-08-06T22:06:53.4670222Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_1.3_1c33cc0adf9f09e3_.log (deflated 97%) 2024-08-06T22:06:53.4671996Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_compile_1.1_ac13231938e4c911_.log (deflated 82%) 2024-08-06T22:06:53.4673667Z adding: test/test-reports/distributed._tensor.test_embedding_ops_1.1_0a66b577f3149121_.log (deflated 84%) 2024-08-06T22:06:53.4675411Z adding: test/test-reports/distributed.pipelining.test_schedule_1.1_d9d5b3c24a69d891_.log (deflated 79%) 2024-08-06T22:06:53.4726899Z adding: test/test-reports/distributed.rpc.test_tensorpipe_agent_3.3_454f70d984ac2ff2_.log (deflated 97%) 2024-08-06T22:06:53.4728732Z adding: test/test-reports/distributed.checkpoint.test_fsdp_tp_checkpoint_conversion_1.1_6212e946a38d7f2e_.log (deflated 57%) 2024-08-06T22:06:53.4730593Z adding: test/test-reports/distributed._tensor.test_view_ops_1.1_bb46bc9929f91e2d_.log (deflated 81%) 2024-08-06T22:06:53.4732319Z adding: test/test-reports/distributed.tensor.parallel.test_parallelize_api_1.1_623a65fae501b325_.log (deflated 91%) 2024-08-06T22:06:53.4733942Z adding: test/test-reports/distributed.test_control_collectives_1.1_25002c9215433958_.log (deflated 78%) 2024-08-06T22:06:53.4735612Z adding: test/test-reports/distributed.optim.test_apply_optimizer_in_backward_1.1_bc7d90dafe534830_.log (deflated 32%) 2024-08-06T22:06:53.4737444Z adding: test/test-reports/distributed.checkpoint.test_state_dict_utils_1.1_3cbe526b0c63d116_.log (deflated 73%) 2024-08-06T22:06:53.4739172Z adding: test/test-reports/distributed.tensor.parallel.test_fsdp_2d_parallel_1.1_02976e61754c0b73_.log (deflated 82%) 2024-08-06T22:06:53.4744913Z adding: test/test-reports/distributed._tensor.test_optimizers_1.1_a18d8998fa4a0187_.log (deflated 95%) 2024-08-06T22:06:53.4746470Z adding: test/test-reports/distributed.fsdp.test_shard_utils_1.1_93b92bc31bb1b349_.log (deflated 59%) 2024-08-06T22:06:53.4748112Z adding: test/test-reports/distributed._tensor.debug.test_comm_mode_1.1_71967a0bddb4c0fe_.log (deflated 62%) 2024-08-06T22:06:53.4749747Z adding: test/test-reports/distributed.fsdp.test_fsdp_checkpoint_1.1_6265c3d68bd5f456_.log (deflated 87%) 2024-08-06T22:06:53.4751584Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_clip_grad_norm__1.1_58a2c5846e27b366_.log (deflated 63%) 2024-08-06T22:06:53.4753363Z adding: test/test-reports/distributed.test_functional_api_1.1_96fff99b65e75091_.log (deflated 86%) 2024-08-06T22:06:53.4755036Z adding: test/test-reports/distributed.checkpoint.test_fsdp_model_state_1.1_52d85154fc5af3d9_.log (deflated 61%) 2024-08-06T22:06:53.4756720Z adding: test/test-reports/distributed.fsdp.test_fsdp_fine_tune_1.1_3c55217be77f83c0_.log (deflated 68%) 2024-08-06T22:06:53.4758449Z adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_compile_1.1_4b1b872ffb956d7d_.log (deflated 56%) 2024-08-06T22:06:53.4760510Z adding: test/test-reports/distributed._composable.test_replicate_1.1_669ed51ea8804e53_.log (deflated 74%) 2024-08-06T22:06:53.4762296Z adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_mixed_precision_1.1_8f585cb1a3959764_.log (deflated 58%) 2024-08-06T22:06:53.4764094Z adding: test/test-reports/distributed._tensor.test_utils_1.1_916168bb70e00643_.log (deflated 87%) 2024-08-06T22:06:53.4765660Z adding: test/test-reports/distributed.fsdp.test_fsdp_core_1.1_6c0ff85ac26974b7_.log (deflated 92%) 2024-08-06T22:06:53.4767330Z adding: test/test-reports/distributed.test_distributed_spawn_2.3_d77ae325a8db6e5b_.log (deflated 37%) 2024-08-06T22:06:53.4768891Z adding: test/test-reports/distributed.test_distributed_spawn_2.3_087312bf5d0f0e79_.log (deflated 37%) 2024-08-06T22:06:53.4780969Z adding: test/test-reports/distributed.test_distributed_spawn_2.3_b27caee39b281be9_.log (deflated 97%) 2024-08-06T22:06:53.4797563Z adding: test/test-reports/distributed.test_distributed_spawn_2.3_14f1d3f530dcbbb6_.log (deflated 97%) 2024-08-06T22:06:53.4799272Z adding: test/test-reports/distributed.fsdp.test_fsdp_backward_prefetch_1.1_909e46a856b46082_.log (deflated 55%) 2024-08-06T22:06:53.4800849Z adding: test/test-reports/distributed.algorithms.test_join_1.1_a609eb172fe5f2e7_.log (deflated 81%) 2024-08-06T22:06:53.4802725Z adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_model_checkpoint_1.1_5db0c7f3dddb29ab_.log (deflated 73%) 2024-08-06T22:06:53.4804755Z adding: test/test-reports/distributed.optim.test_zero_redundancy_optimizer_1.1_1b6e745f4c97b3b0_.log (deflated 94%) 2024-08-06T22:06:53.4806605Z adding: test/test-reports/distributed.fsdp.test_fsdp_flatten_params_1.1_140ba7a24a4ad234_.log (deflated 82%) 2024-08-06T22:06:53.4808418Z adding: test/test-reports/distributed.checkpoint.test_file_system_checkpoint_1.1_348430256f106ff1_.log (deflated 73%) 2024-08-06T22:06:53.4810203Z adding: test/test-reports/distributed.checkpoint.test_state_dict_1.1_9f2133b998cc50f1_.log (deflated 87%) 2024-08-06T22:06:53.4811745Z adding: test/test-reports/distributed.test_c10d_ucc_1.1_64ef50b2eeff4372_.log (stored 0%) 2024-08-06T22:06:53.4813448Z adding: test/test-reports/distributed._composable.fully_shard.test_fully_shard_init_1.1_9c11d3ec05c77a20_.log (deflated 75%) 2024-08-06T22:06:53.4815287Z adding: test/test-reports/distributed.fsdp.test_checkpoint_wrapper_1.1_3d6cd7fec0e7ba55_.log (deflated 74%) 2024-08-06T22:06:53.4816978Z adding: test/test-reports/distributed.fsdp.test_fsdp_clip_grad_norm_1.1_d5f263d83d9fd57d_.log (deflated 69%) 2024-08-06T22:06:53.4818581Z adding: test/test-reports/distributed.test_c10d_logger_1.1_27fd61be176924f7_.log (deflated 60%) 2024-08-06T22:06:53.4820132Z adding: test/test-reports/distributed.fsdp.test_fsdp_grad_acc_1.1_5387fabc57b19be7_.log (deflated 74%) 2024-08-06T22:06:53.4821804Z adding: test/test-reports/distributed.fsdp.test_fsdp_unshard_params_1.1_679814d643e741b0_.log (deflated 83%) 2024-08-06T22:06:53.4823437Z adding: test/test-reports/distributed.nn.jit.test_instantiator_1.1_f480bc37e0fe8e90_.log (deflated 64%) 2024-08-06T22:06:53.4825118Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_comm_1.1_ef6603226e42d1b0_.log (deflated 83%) 2024-08-06T22:06:53.4826849Z adding: test/test-reports/distributed.fsdp.test_fsdp_overlap_1.1_0e864b8872b794b9_.log (deflated 59%) 2024-08-06T22:06:53.4828612Z adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_tensor_ops_1.1_5059dcad59e9afe9_.log (deflated 71%) 2024-08-06T22:06:53.4830527Z adding: test/test-reports/distributed._composable.test_replicate_with_compiler_1.1_1cc809acb8690a63_.log (deflated 78%) 2024-08-06T22:06:53.4832321Z adding: test/test-reports/distributed.fsdp.test_fsdp_hybrid_shard_1.1_8a2f9ff0981e0d95_.log (deflated 73%) 2024-08-06T22:06:53.4834111Z adding: test/test-reports/distributed._shard.sharded_tensor.ops.test_binary_cmp_1.1_c70ed2c53e28960d_.log (deflated 71%) 2024-08-06T22:06:53.4836269Z adding: test/test-reports/distributed._composable.fsdp.test_fully_shard_extensions_1.1_b1b4fa12e3688fd2_.log (deflated 67%) 2024-08-06T22:06:53.4838124Z adding: test/test-reports/distributed.fsdp.test_fsdp_sharded_grad_scaler_1.1_1625d7263f912c86_.log (deflated 89%) 2024-08-06T22:06:53.4839831Z adding: test/test-reports/distributed.fsdp.test_fsdp_freezing_weights_1.1_ec730d03fc166856_.log (deflated 93%) 2024-08-06T22:06:53.4841477Z adding: test/test-reports/distributed.fsdp.test_hsdp_dtensor_state_dict_1.1_72e61f44d4068d68_.log (deflated 79%) 2024-08-06T22:06:53.4843202Z adding: test/test-reports/distributed.test_c10d_object_collectives_1.1_8ecc9f5f016e84fd_.log (deflated 76%) 2024-08-06T22:06:53.4844897Z adding: test/test-reports/distributed.fsdp.test_fsdp_use_orig_params_1.1_6dc220fd84ee6cc4_.log (deflated 86%) 2024-08-06T22:06:53.4846770Z adding: test/test-reports/distributed._shard.sharding_spec.test_sharding_spec_1.1_678d683ed630e0a2_.log (deflated 78%) 2024-08-06T22:06:53.4848311Z adding: test/test-reports/distributed.fsdp.test_utils_1.1_d35dd1a4ca3db7c6_.log (deflated 64%) 2024-08-06T22:06:53.4849738Z adding: test/test-reports/distributed.fsdp.test_fsdp_meta_1.1_2e1fd32f2190fb8e_.log (deflated 84%) 2024-08-06T22:06:53.4851484Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_74f8dbebcf8dae14_.log (deflated 14%) 2024-08-06T22:06:53.4853391Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_7f1548be9910fbb8_.log (deflated 14%) 2024-08-06T22:06:53.4855412Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_b4e8ec43c012f2a9_.log (deflated 90%) 2024-08-06T22:06:53.4857338Z adding: test/test-reports/distributed.algorithms.quantization.test_quantization_1.1_27aeb1d4402e8188_.log (deflated 90%) 2024-08-06T22:06:53.4858978Z adding: test/test-reports/distributed.fsdp.test_wrap_1.1_5c56c79543dc905c_.log (deflated 90%) 2024-08-06T22:06:53.4862523Z adding: test/test-reports/distributed.test_c10d_gloo_1.1_32d509d1740021f6_.log (deflated 96%) 2024-08-06T22:06:53.4863826Z adding: test/test-reports/distributed.test_c10d_ops_nccl_1.1_dd17ac1327c75369_.log (stored 0%) 2024-08-06T22:06:53.4864979Z adding: test/test-reports/cpp.test_cpp_rpc_1.1_08a6a4087e5ce7b3_.log (deflated 78%) 2024-08-06T22:06:53.4912456Z ##[group]Run # Remove any previous debugging artifacts if they exist 2024-08-06T22:06:53.4913415Z # Remove any previous debugging artifacts if they exist 2024-08-06T22:06:53.4914142Z rm -f debug-*.zip 2024-08-06T22:06:53.4914640Z if [ -d 'test/debug' ]; then 2024-08-06T22:06:53.4915263Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2024-08-06T22:06:53.4915846Z fi 2024-08-06T22:06:53.4923632Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:53.4924326Z env: 2024-08-06T22:06:53.4924672Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:53.4925547Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:53.4926649Z FILE_SUFFIX: test-distributed-1-2-amz2023.linux.2xlarge_28427732585 2024-08-06T22:06:53.4927369Z ##[endgroup] 2024-08-06T22:06:53.5024629Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-06T22:06:53.5024981Z with: 2024-08-06T22:06:53.5025195Z s3-bucket: gha-artifacts 2024-08-06T22:06:53.5025523Z s3-prefix: pytorch/pytorch/10273124344/1/artifact 2024-08-06T22:06:53.5025887Z retention-days: 14 2024-08-06T22:06:53.5026136Z if-no-files-found: warn 2024-08-06T22:06:53.5026418Z path: test-jsons-*.zip 2024-08-06T22:06:53.5026684Z name: artifact 2024-08-06T22:06:53.5026925Z region: us-east-1 2024-08-06T22:06:53.5027167Z env: 2024-08-06T22:06:53.5027387Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:53.5027847Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:53.5028354Z ##[endgroup] 2024-08-06T22:06:53.8659455Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-06T22:06:53.8660296Z With the provided path, there will be 1 file uploaded 2024-08-06T22:06:53.8660978Z Uploading to s3 prefix: pytorch/pytorch/10273124344/1/artifact 2024-08-06T22:06:53.8735086Z Starting upload of test-jsons-test-distributed-1-2-amz2023.linux.2xlarge_28427732585.zip 2024-08-06T22:06:53.9827071Z Finished upload of test-jsons-test-distributed-1-2-amz2023.linux.2xlarge_28427732585.zip 2024-08-06T22:06:54.0029492Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-06T22:06:54.0029847Z with: 2024-08-06T22:06:54.0030079Z s3-bucket: gha-artifacts 2024-08-06T22:06:54.0030546Z s3-prefix: pytorch/pytorch/10273124344/1/artifact 2024-08-06T22:06:54.0030914Z retention-days: 14 2024-08-06T22:06:54.0031180Z if-no-files-found: error 2024-08-06T22:06:54.0031454Z path: test-reports-*.zip 2024-08-06T22:06:54.0031727Z name: artifact 2024-08-06T22:06:54.0031965Z region: us-east-1 2024-08-06T22:06:54.0032189Z env: 2024-08-06T22:06:54.0032425Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:54.0032895Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:54.0033391Z ##[endgroup] 2024-08-06T22:06:54.3444892Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-06T22:06:54.3445586Z With the provided path, there will be 1 file uploaded 2024-08-06T22:06:54.3446096Z Uploading to s3 prefix: pytorch/pytorch/10273124344/1/artifact 2024-08-06T22:06:54.3485489Z Starting upload of test-reports-test-distributed-1-2-amz2023.linux.2xlarge_28427732585.zip 2024-08-06T22:06:54.5317346Z Finished upload of test-reports-test-distributed-1-2-amz2023.linux.2xlarge_28427732585.zip 2024-08-06T22:06:54.5499128Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-06T22:06:54.5499483Z with: 2024-08-06T22:06:54.5499700Z s3-bucket: gha-artifacts 2024-08-06T22:06:54.5500029Z s3-prefix: pytorch/pytorch/10273124344/1/artifact 2024-08-06T22:06:54.5500390Z retention-days: 14 2024-08-06T22:06:54.5500640Z if-no-files-found: ignore 2024-08-06T22:06:54.5500928Z path: logs-*.zip 2024-08-06T22:06:54.5501168Z name: artifact 2024-08-06T22:06:54.5501392Z region: us-east-1 2024-08-06T22:06:54.5501634Z env: 2024-08-06T22:06:54.5501856Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:54.5502336Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:54.5502833Z ##[endgroup] 2024-08-06T22:06:54.8929305Z NOTE: s3-prefix specified, ignoring name parameter 2024-08-06T22:06:54.8930083Z With the provided path, there will be 1 file uploaded 2024-08-06T22:06:54.8930814Z Uploading to s3 prefix: pytorch/pytorch/10273124344/1/artifact 2024-08-06T22:06:54.8971090Z Starting upload of logs-test-distributed-1-2-amz2023.linux.2xlarge_28427732585.zip 2024-08-06T22:06:55.1027184Z Finished upload of logs-test-distributed-1-2-amz2023.linux.2xlarge_28427732585.zip 2024-08-06T22:06:55.1232332Z ##[group]Run seemethere/upload-artifact-s3@v5 2024-08-06T22:06:55.1232692Z with: 2024-08-06T22:06:55.1232941Z s3-bucket: gha-artifacts 2024-08-06T22:06:55.1233278Z s3-prefix: pytorch/pytorch/10273124344/1/artifact 2024-08-06T22:06:55.1233642Z retention-days: 14 2024-08-06T22:06:55.1233894Z if-no-files-found: ignore 2024-08-06T22:06:55.1234179Z path: debug-*.zip 2024-08-06T22:06:55.1234426Z name: artifact 2024-08-06T22:06:55.1234653Z region: us-east-1 2024-08-06T22:06:55.1234890Z env: 2024-08-06T22:06:55.1235114Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:55.1235574Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:55.1236085Z ##[endgroup] 2024-08-06T22:06:55.4636508Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2024-08-06T22:06:55.4817283Z ##[group]Run # shellcheck disable=SC2156 2024-08-06T22:06:55.4817657Z # shellcheck disable=SC2156 2024-08-06T22:06:55.4818256Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2024-08-06T22:06:55.4824218Z shell: /usr/bin/bash -e {0} 2024-08-06T22:06:55.4824493Z env: 2024-08-06T22:06:55.4824725Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:55.4825202Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:55.4825703Z ##[endgroup] 2024-08-06T22:06:55.7019057Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2024-08-06T22:06:55.7019501Z with: 2024-08-06T22:06:55.7019707Z env: 2024-08-06T22:06:55.7019929Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:55.7020407Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:55.7020900Z ##[endgroup] 2024-08-06T22:06:55.7043982Z ##[group]Run set -eou pipefail 2024-08-06T22:06:55.7044323Z set -eou pipefail 2024-08-06T22:06:55.7044591Z  2024-08-06T22:06:55.7044975Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2024-08-06T22:06:55.7045554Z for _ in $(seq 1440); do 2024-08-06T22:06:55.7045904Z  # Break if no ssh session exists anymore 2024-08-06T22:06:55.7046271Z  if [ "$(who)" = "" ]; then 2024-08-06T22:06:55.7046585Z  break 2024-08-06T22:06:55.7046822Z  fi 2024-08-06T22:06:55.7047104Z  echo "." 2024-08-06T22:06:55.7047349Z  sleep 5 2024-08-06T22:06:55.7047602Z done 2024-08-06T22:06:55.7053198Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:55.7053582Z env: 2024-08-06T22:06:55.7053808Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:55.7054283Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:55.7054784Z ##[endgroup] 2024-08-06T22:06:55.7077129Z Holding runner for 2 hours until all ssh sessions have logged out 2024-08-06T22:06:55.7149409Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2024-08-06T22:06:55.7149991Z # ignore expansion of "docker ps -q" since it could be empty 2024-08-06T22:06:55.7150439Z # shellcheck disable=SC2046 2024-08-06T22:06:55.7150784Z docker stop $(docker ps -q) || true 2024-08-06T22:06:55.7151143Z # Prune all of the docker images 2024-08-06T22:06:55.7151469Z docker system prune -af 2024-08-06T22:06:55.7156737Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:06:55.7157126Z env: 2024-08-06T22:06:55.7157339Z GIT_DEFAULT_BRANCH: main 2024-08-06T22:06:55.7157808Z DOCKER_CONTAINER_ID: c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:06:55.7158313Z ##[endgroup] 2024-08-06T22:07:06.3091487Z c5a57db8914d 2024-08-06T22:07:06.6490989Z Deleted Containers: 2024-08-06T22:07:06.6491448Z c5a57db8914dff9167c98602f76029c84305198e6ea92e41312ec800d3673b72 2024-08-06T22:07:06.6491788Z 2024-08-06T22:07:09.7763995Z Deleted Images: 2024-08-06T22:07:09.7765048Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11:02ec4fbd5adcb3fb91cf5ce431dec18b633de7d9 2024-08-06T22:07:09.7766550Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/pytorch-linux-jammy-py3.8-gcc11@sha256:c75221497aa22766802555fccb76014708414eebd47578b213b43b3f8f4cddb9 2024-08-06T22:07:09.7767616Z deleted: sha256:eb2e8636b63e804e38c5e56190d8b860c4bf8a9e0794f88825eff958ed6b1e76 2024-08-06T22:07:09.7768318Z deleted: sha256:3a75aa289a82638e31ac4b969360c49c8013f3546a449692cb458fcde3935f22 2024-08-06T22:07:09.7768982Z deleted: sha256:bdfa3e02d65d776f3bb70b6bf71d852ddca4c1dfbdca2356544996f07fef2ed8 2024-08-06T22:07:09.7769639Z deleted: sha256:6a85078ea3791ab81c962cdfc07c05a8b7eb4c5576721c3b56b45f4adf3fd0d1 2024-08-06T22:07:09.7770318Z deleted: sha256:935ccaf7b02ef4b0aabe934f8ed13eaf6bbc24da0954bdc3eea688aafcf5aea6 2024-08-06T22:07:09.7771002Z deleted: sha256:eef572047e96af9ee6bb247ba9acc9c558d7468ff89e2297aa4ad37d1f6043bb 2024-08-06T22:07:09.7771663Z deleted: sha256:4cde019d0b2c20c0af3f1631adfd033c260533dfeefc25dad09f2900dd488b69 2024-08-06T22:07:09.7772595Z deleted: sha256:d2e3c7156b77f135b6bfcbd686f30b96a9fdd1cf7c08b62815572e2d2f7c68be 2024-08-06T22:07:09.7773270Z deleted: sha256:9cd733cd617c46bdc2cb513ead975cec6d449f22a08e36d803cbcef61fa1ef01 2024-08-06T22:07:09.7774059Z deleted: sha256:64744261caf2f507a0f6160868b1d4f0a4a435fb546701053735b889023799eb 2024-08-06T22:07:09.7774943Z deleted: sha256:a2047a4af9745168d52ba90b39a780bc22dc15918425324774e959c0755645a5 2024-08-06T22:07:09.7775603Z deleted: sha256:7d8b4203c0f94a0eccdf0a3ee5819d3be23e8acb9412c3330f66669f03d23e4a 2024-08-06T22:07:09.7776257Z deleted: sha256:7c66ee01d3a6002bf7c53c998d9320f1fb14268af96da395dc28488d5e28001e 2024-08-06T22:07:09.7776921Z deleted: sha256:c1821ba8bdf74b922560615bc28d42e36b63152f7f8e7b07fead450cf78c03b3 2024-08-06T22:07:09.7777594Z deleted: sha256:738da9c7930e061cb698fdaff5ab4d9019fd00adeeacbc24c07eeef3b9a1e8f3 2024-08-06T22:07:09.7778249Z deleted: sha256:b035793979cb8d15291d75f7ceb86be4c7e50b0b55c3ad2de59633310f8eb2ad 2024-08-06T22:07:09.7778903Z deleted: sha256:8caa23c592f4ec71096f15d741c7f74b3674d14f201069b87058d486ee469d80 2024-08-06T22:07:09.7779552Z deleted: sha256:5ec471cacf0cf9317535522156613c2b647715813f96552a7756767caa05b5bc 2024-08-06T22:07:09.7780196Z deleted: sha256:3ddc946b392989b8e7e8086bc23fdab9391ec27042559856bb40fd155a0626b0 2024-08-06T22:07:09.7780842Z deleted: sha256:8bb9b390febb36e87a303534a0672e799f14263107dccecb8fb816711b19b197 2024-08-06T22:07:09.7781507Z deleted: sha256:7636da8a45668f13fc8bdd44f4bcbdfe08506e1222f2e6bf0b6173ff1ebc9d73 2024-08-06T22:07:09.7782172Z deleted: sha256:db811dce25acbc1220f0b64f6b6378af1a8715aadf36172b548ccf95a8a10f5c 2024-08-06T22:07:09.7782827Z deleted: sha256:ea9f1876d9bef2b9737a8084aa575ae2ccf54320762796b1a25b2fd7a1f9a842 2024-08-06T22:07:09.7783490Z deleted: sha256:ee9308661047f85a0cb1e065673e3e34a223a0fabc0d758ca482d1caf72bc156 2024-08-06T22:07:09.7784149Z deleted: sha256:83af056623fdf4bdd8eb6689dd830c618fc706f07f5745771bd23dee1a9df53c 2024-08-06T22:07:09.7784789Z deleted: sha256:1697cd38e32034c99390abaf80e0ef262175ceb38304c2a33a2391ea089625ce 2024-08-06T22:07:09.7785496Z deleted: sha256:2c941f6435258652fe85b0aa3fe7dfd6446f8ad4b90ff57b75cff5173ca901d1 2024-08-06T22:07:09.7786148Z deleted: sha256:de31781f10299152d97a453b662468e0fe812bf2c80e40d7e87d21f1aeebe0de 2024-08-06T22:07:09.7786787Z deleted: sha256:df51025351b2d7b823ae2da119ef42f7a8bcb65067852d58b58793b87a4020cd 2024-08-06T22:07:09.7787447Z deleted: sha256:dea53edb79ae100c832ff7d8e52aa46514a05f85b18820e9798e14cfca8d2b0a 2024-08-06T22:07:09.7788115Z deleted: sha256:30a0b14b371bbf3393cc59e86ebddb2c2bf5ec6e14a2623357e0e8522004373a 2024-08-06T22:07:09.7788817Z deleted: sha256:86275d2a7f4ab08c4db777a2d58601c8e9a33f085073ee419cecc0f80706ba0a 2024-08-06T22:07:09.7789460Z deleted: sha256:be527c207999e42b06dd2b66329fee5905a775d5a617576a8822937689e181b2 2024-08-06T22:07:09.7790109Z deleted: sha256:b726bfe9f806f36a474aff38d139841ad1f3062ad40b2644b38a070efa891fc4 2024-08-06T22:07:09.7790760Z deleted: sha256:79621bf70363b2e574b56de08889a123c0aafdf331b6d403b1227d601196878f 2024-08-06T22:07:09.7791411Z deleted: sha256:23da9a238173789a5e64303a1d5b580bdc2ff4ee4adb1726a937e74fccdb3304 2024-08-06T22:07:09.7792064Z deleted: sha256:6ae72960efb5326803e5d131f2b788bea7d945094d6b4154fbb0d23a1724bc9d 2024-08-06T22:07:09.7792724Z deleted: sha256:4b522ca122bee088c81b99d32935d0c7f798acd919e4787f71f60860f47039c8 2024-08-06T22:07:09.7793382Z deleted: sha256:8099c7b0342e10a71c3957854138df7a86715582a05dfeb507862407dda38fc3 2024-08-06T22:07:09.7794022Z deleted: sha256:9a3099fdec71a88416fee7bf46f4a7692b473fb9684dd93aaa0370840bb1ec2a 2024-08-06T22:07:09.7794682Z deleted: sha256:c7ffa0248132fad86167206fd29b1b8f49bf20a42406063d47df97a13d8f198a 2024-08-06T22:07:09.7795340Z deleted: sha256:496001e36192545049eca8ecc830251c2fa1eb6daf21421c8dafe0acb1f81538 2024-08-06T22:07:09.7795987Z deleted: sha256:9813a6d93cac15977f4540b3e5b3fe849269f35658ed780bdda563ee74b15b3f 2024-08-06T22:07:09.7796635Z deleted: sha256:e29ab5e9037a9838843863a372ef1748406bc95406369a70955134a7cae06d63 2024-08-06T22:07:09.7797291Z deleted: sha256:27d3f1ba6f4aaf25f597a8dcf5d90168631cbbaa2283d5d82528bb267dbc9aa4 2024-08-06T22:07:09.7798106Z deleted: sha256:e7b742f0c6815a00a368e84b648d3d3707bb9f50fc1111d2c99506f5e446552f 2024-08-06T22:07:09.7798750Z deleted: sha256:fd8caf0a273887946a30471b6d8565942faac80f5294f4b3f60779ba4fb1589c 2024-08-06T22:07:09.7799516Z deleted: sha256:6b4ae34804843731029058254b2a78ec9bf655c143179356562fb6792a6d387e 2024-08-06T22:07:09.7800177Z deleted: sha256:5eb13a2c08fccfe8a68cb2eedd5374ca8533971837acdecf1a6241b970be84d4 2024-08-06T22:07:09.7800841Z deleted: sha256:d782a8ac99055b7a7b36960eadce2aa26f0702a2e9de910d9a282b4ad4cf0409 2024-08-06T22:07:09.7801512Z deleted: sha256:32b90a12e0e9cbec20f720d2dd8dc1fe94d05f62a3106ccbe443c7674bcc4ce0 2024-08-06T22:07:09.7802183Z deleted: sha256:ec714b229d3a0dff80ffbf136428ab5a5271e5df7b61198f3fefcda6287ccb6c 2024-08-06T22:07:09.7802835Z deleted: sha256:2f5754399f29badb5803e0b433f6704280c4b79475b44de6728af1dfbcbb2323 2024-08-06T22:07:09.7803505Z deleted: sha256:7bf42df28ece50b780ec31bab2ecea6382f1fe26a88816cc6b9718265cf3465e 2024-08-06T22:07:09.7804180Z deleted: sha256:9a6aa7079f47ded223c38219eed1824b2ffb668af29fa9bcb485254f7e83ab21 2024-08-06T22:07:09.7804835Z deleted: sha256:e9724bcc7ec56c5acb95e352940c94b1c2a9ee52109ad8aab536930bc9728176 2024-08-06T22:07:09.7805607Z deleted: sha256:8f8ef3805ce4283573b6bf58f161a9b3331f50a60ce8d81d4ac659f1fff055c0 2024-08-06T22:07:09.7806265Z deleted: sha256:0729580f4cbe15e55af6aad9352c76c40a739f10bb9b43550680d486bd5c076b 2024-08-06T22:07:09.7806919Z deleted: sha256:4a0b4eb049da56b51a7fdfa4d8206378bdbb1b016dfc6e0bca982791a12fd5eb 2024-08-06T22:07:09.7807599Z deleted: sha256:cf4eeeecbbf6221e1ef64a38d6ba85c73e0bbf10869125ebf081e18f5ef4e9e0 2024-08-06T22:07:09.7808266Z deleted: sha256:f3f2f0324ca26243445f66f17828f234c7a77640dc5d9c44b7a90746c31a2c69 2024-08-06T22:07:09.7808925Z deleted: sha256:014362212fc6cec487fa443cf40098dfadb1562fbd6c17eaa1d987bcac2005d5 2024-08-06T22:07:09.7809583Z deleted: sha256:9d8bd07fc065e2f3faa82c6be619acdbe2a0ac5c84fa4d34564dd9ca50c1abb4 2024-08-06T22:07:09.7810263Z deleted: sha256:be515201f04cb68521fbdaf149a170e1cfee851eb7cf0d0e21cf44788d2d2738 2024-08-06T22:07:09.7810911Z deleted: sha256:a80708e23e0af5c08681444d907936033a760a3707ff65145db0d08946092e6c 2024-08-06T22:07:09.7811548Z deleted: sha256:a12ed841d341f49b467e30c6f384e0cba615d2dc38e7c23f7a3e926f8218fee0 2024-08-06T22:07:09.7812213Z deleted: sha256:508edf28b5543e1a9d07f1caeb9dddf6e77d34ef0d416dc734399f3f49335923 2024-08-06T22:07:09.7812876Z deleted: sha256:0e101de6946d43b7137acf4e038ab8d10e32dbf0c2480641c24be8ed6086abc1 2024-08-06T22:07:09.7813532Z deleted: sha256:c1c19d0e8afe1ecbbde109ac71c1d3f17a00bfcf3d50834770b8d5464ee9c8b2 2024-08-06T22:07:09.7814194Z deleted: sha256:9dc9d6055307261f20c9b3b25bff6eba44e06a05a5b285d733599015160c7dbc 2024-08-06T22:07:09.7814858Z deleted: sha256:7b94babd6975875afe9642a2b9bcf59e402dc13a48cc8be6fd65c2a5fef3ca7c 2024-08-06T22:07:09.7815511Z deleted: sha256:3873bca3dc5064ab463ae26e0a2ab4e9372bea50dd21aa9d60f740676dad7486 2024-08-06T22:07:09.7816174Z deleted: sha256:cbf23c83ce2d413d3afd8790f223a461b296a546765135e62cd690dad638d411 2024-08-06T22:07:09.7816839Z deleted: sha256:bf83fffdacd881f54312039756eae0f29ee91313edb99240a21b46a7a8a52112 2024-08-06T22:07:09.7817493Z deleted: sha256:f8a51c6f429112858d9fa585e8865b12aef6f984426a6b249a9c2405bd6bc617 2024-08-06T22:07:09.7818152Z deleted: sha256:a5f3bdddd25f3ff04aeee3425b589034eea5abb8f3356a23da937bdfae388f96 2024-08-06T22:07:09.7818829Z deleted: sha256:a63fb4f23633e92cf452b4d42c11fabe08bc5941a7b3ccfdb514d9f5df78ace9 2024-08-06T22:07:09.7819494Z deleted: sha256:55935042e44f44818cd67bfb9dbce2a9b57e383adb3caee10c52a60bb4ca2907 2024-08-06T22:07:09.7820144Z deleted: sha256:4e77f30e7a210eadab33be7d5a8e30b207fe0595cc887f660034793669ad4882 2024-08-06T22:07:09.7820809Z deleted: sha256:ff95c9e3cc791feac6467bb1a86bd910894d5aa807dbc7ef8d0656f4c313fb55 2024-08-06T22:07:09.7821474Z deleted: sha256:2d609ec5d6f0f513dc06ab2d069d1f3705dbb888c1c33b153d4d7b402a3a8445 2024-08-06T22:07:09.7822117Z deleted: sha256:6871dd9601fad505a94c55343d42d89a15ba2f3a15352e4264e4aef36be2d3b2 2024-08-06T22:07:09.7822851Z deleted: sha256:e7aab1aad704a9457fcc4018383183080c494fdd601a6d38dc2a06489e3819a6 2024-08-06T22:07:09.7823509Z deleted: sha256:77b1d18f5457391c44c5bf9bfbbdac615becb4cf2149d82856165b77ad19132e 2024-08-06T22:07:09.7824227Z deleted: sha256:5ad805ac6b7297997e85c12ead27e5b34775f55d66c96af2c9c643752c231060 2024-08-06T22:07:09.7824880Z deleted: sha256:f169358745a88fef9997e00330b991a45ceb3553651bbc391a938a896ddeaebf 2024-08-06T22:07:09.7825535Z deleted: sha256:51b3d62ea293d971aac7f5c6e7a8cac80e68e53419b75c0f225b3e14c1b78b1b 2024-08-06T22:07:09.7826180Z deleted: sha256:380d79122c2fdff1088471ef238b65b189372fe3d073caf4500c53935a53a6f5 2024-08-06T22:07:09.7826831Z deleted: sha256:cf4619277942bc0846de485114cca961fa146acbd85711f3a6ee5160681d0a8a 2024-08-06T22:07:09.7827491Z deleted: sha256:331c0a0477e8aa63e33aba884616ecd6cf5dafa7fe512374b8e8d01fb50bdf6f 2024-08-06T22:07:09.7828160Z deleted: sha256:052665ffd1620d190087d835e6fae9b128aaea33ff929767ce2a7d6b5c9c77f2 2024-08-06T22:07:09.7828809Z deleted: sha256:4534c8036770494ac61772b0ffe2379aaa62dbeb0d1307fff0164be698430f2c 2024-08-06T22:07:09.7829465Z deleted: sha256:931b7ff0cb6f494b27d31a4cbec3efe62ac54676add9c7469560302f1541ecaf 2024-08-06T22:07:09.7829858Z 2024-08-06T22:07:09.7837067Z Total reclaimed space: 15.25GB 2024-08-06T22:07:09.7924604Z Post job cleanup. 2024-08-06T22:07:09.7975437Z Post job cleanup. 2024-08-06T22:07:09.8862862Z [command]/usr/bin/git version 2024-08-06T22:07:09.8907749Z git version 2.40.1 2024-08-06T22:07:09.8944126Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/34cb4fa8-ae7c-4c22-b9da-643bcd4d0020' before making global git config changes 2024-08-06T22:07:09.8945112Z Adding repository directory to the temporary git global config as a safe directory 2024-08-06T22:07:09.8949235Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2024-08-06T22:07:09.8988903Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2024-08-06T22:07:09.9020434Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2024-08-06T22:07:09.9311831Z Entering 'android/libs/fbjni' 2024-08-06T22:07:09.9363134Z Entering 'third_party/FP16' 2024-08-06T22:07:09.9413017Z Entering 'third_party/FXdiv' 2024-08-06T22:07:09.9463728Z Entering 'third_party/NNPACK' 2024-08-06T22:07:09.9513658Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-06T22:07:09.9562654Z Entering 'third_party/XNNPACK' 2024-08-06T22:07:09.9628876Z Entering 'third_party/benchmark' 2024-08-06T22:07:09.9680592Z Entering 'third_party/cpp-httplib' 2024-08-06T22:07:09.9728312Z Entering 'third_party/cpuinfo' 2024-08-06T22:07:09.9778412Z Entering 'third_party/cudnn_frontend' 2024-08-06T22:07:09.9827509Z Entering 'third_party/cutlass' 2024-08-06T22:07:09.9887268Z Entering 'third_party/eigen' 2024-08-06T22:07:09.9937050Z Entering 'third_party/fbgemm' 2024-08-06T22:07:09.9986613Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-06T22:07:10.0034321Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T22:07:10.0083663Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-06T22:07:10.0139059Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-06T22:07:10.0187207Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T22:07:10.0235966Z Entering 'third_party/flatbuffers' 2024-08-06T22:07:10.0289030Z Entering 'third_party/fmt' 2024-08-06T22:07:10.0337175Z Entering 'third_party/foxi' 2024-08-06T22:07:10.0386336Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-06T22:07:10.0435373Z Entering 'third_party/gloo' 2024-08-06T22:07:10.0486047Z Entering 'third_party/googletest' 2024-08-06T22:07:10.0536107Z Entering 'third_party/ideep' 2024-08-06T22:07:10.0584196Z Entering 'third_party/ideep/mkl-dnn' 2024-08-06T22:07:10.0639774Z Entering 'third_party/ittapi' 2024-08-06T22:07:10.0688341Z Entering 'third_party/kineto' 2024-08-06T22:07:10.0736765Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T22:07:10.0785514Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T22:07:10.0835339Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T22:07:10.0882941Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T22:07:10.0930967Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T22:07:10.0978340Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T22:07:10.1028567Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T22:07:10.1078404Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T22:07:10.1127665Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T22:07:10.1177474Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T22:07:10.1227199Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T22:07:10.1275952Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T22:07:10.1326353Z Entering 'third_party/mimalloc' 2024-08-06T22:07:10.1376676Z Entering 'third_party/nccl/nccl' 2024-08-06T22:07:10.1425664Z Entering 'third_party/nlohmann' 2024-08-06T22:07:10.1476068Z Entering 'third_party/onnx' 2024-08-06T22:07:10.1542259Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-06T22:07:10.1593150Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-06T22:07:10.1645070Z Entering 'third_party/opentelemetry-cpp' 2024-08-06T22:07:10.1697044Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T22:07:10.1744985Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T22:07:10.1792580Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T22:07:10.1840095Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T22:07:10.1890109Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T22:07:10.1937667Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T22:07:10.1986660Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T22:07:10.2033679Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T22:07:10.2083403Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T22:07:10.2134228Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T22:07:10.2205059Z Entering 'third_party/pocketfft' 2024-08-06T22:07:10.2255279Z Entering 'third_party/protobuf' 2024-08-06T22:07:10.2307866Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-06T22:07:10.2356493Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-06T22:07:10.2409744Z Entering 'third_party/psimd' 2024-08-06T22:07:10.2460123Z Entering 'third_party/pthreadpool' 2024-08-06T22:07:10.2510283Z Entering 'third_party/pybind11' 2024-08-06T22:07:10.2559441Z Entering 'third_party/python-peachpy' 2024-08-06T22:07:10.2608853Z Entering 'third_party/sleef' 2024-08-06T22:07:10.2657757Z Entering 'third_party/tensorpipe' 2024-08-06T22:07:10.2708066Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-06T22:07:10.2756208Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-06T22:07:10.2804658Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-06T22:07:10.2852542Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T22:07:10.2899620Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T22:07:10.2966245Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2024-08-06T22:07:10.2993786Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3003076Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2024-08-06T22:07:10.3039030Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2024-08-06T22:07:10.3310085Z Entering 'android/libs/fbjni' 2024-08-06T22:07:10.3345314Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3376101Z Entering 'third_party/FP16' 2024-08-06T22:07:10.3410188Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3440520Z Entering 'third_party/FXdiv' 2024-08-06T22:07:10.3473041Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3502859Z Entering 'third_party/NNPACK' 2024-08-06T22:07:10.3535709Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3566136Z Entering 'third_party/VulkanMemoryAllocator' 2024-08-06T22:07:10.3599862Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3629853Z Entering 'third_party/XNNPACK' 2024-08-06T22:07:10.3662823Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3710417Z Entering 'third_party/benchmark' 2024-08-06T22:07:10.3744308Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3775276Z Entering 'third_party/cpp-httplib' 2024-08-06T22:07:10.3809072Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3839230Z Entering 'third_party/cpuinfo' 2024-08-06T22:07:10.3873053Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3903476Z Entering 'third_party/cudnn_frontend' 2024-08-06T22:07:10.3937371Z http.https://github.com/.extraheader 2024-08-06T22:07:10.3967524Z Entering 'third_party/cutlass' 2024-08-06T22:07:10.4001044Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4038353Z Entering 'third_party/eigen' 2024-08-06T22:07:10.4071380Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4105779Z Entering 'third_party/fbgemm' 2024-08-06T22:07:10.4139634Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4171171Z Entering 'third_party/fbgemm/third_party/asmjit' 2024-08-06T22:07:10.4204716Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4234632Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2024-08-06T22:07:10.4267919Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4298466Z Entering 'third_party/fbgemm/third_party/cutlass' 2024-08-06T22:07:10.4331014Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4367842Z Entering 'third_party/fbgemm/third_party/googletest' 2024-08-06T22:07:10.4400692Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4430473Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2024-08-06T22:07:10.4463096Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4495438Z Entering 'third_party/flatbuffers' 2024-08-06T22:07:10.4528628Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4562220Z Entering 'third_party/fmt' 2024-08-06T22:07:10.4595347Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4626104Z Entering 'third_party/foxi' 2024-08-06T22:07:10.4659675Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4690648Z Entering 'third_party/gemmlowp/gemmlowp' 2024-08-06T22:07:10.4723284Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4754156Z Entering 'third_party/gloo' 2024-08-06T22:07:10.4787578Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4817194Z Entering 'third_party/googletest' 2024-08-06T22:07:10.4849999Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4880190Z Entering 'third_party/ideep' 2024-08-06T22:07:10.4912638Z http.https://github.com/.extraheader 2024-08-06T22:07:10.4941840Z Entering 'third_party/ideep/mkl-dnn' 2024-08-06T22:07:10.4973985Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5011528Z Entering 'third_party/ittapi' 2024-08-06T22:07:10.5044125Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5073801Z Entering 'third_party/kineto' 2024-08-06T22:07:10.5106543Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5136288Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2024-08-06T22:07:10.5168470Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5199459Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2024-08-06T22:07:10.5232113Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5263881Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2024-08-06T22:07:10.5297705Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5328551Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2024-08-06T22:07:10.5360933Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5392166Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2024-08-06T22:07:10.5424823Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5454238Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2024-08-06T22:07:10.5487075Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5519419Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2024-08-06T22:07:10.5552050Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5586426Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2024-08-06T22:07:10.5618164Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5649275Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2024-08-06T22:07:10.5682087Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5713952Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2024-08-06T22:07:10.5745930Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5780138Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2024-08-06T22:07:10.5810441Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5841042Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2024-08-06T22:07:10.5873983Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5906293Z Entering 'third_party/mimalloc' 2024-08-06T22:07:10.5939717Z http.https://github.com/.extraheader 2024-08-06T22:07:10.5970402Z Entering 'third_party/nccl/nccl' 2024-08-06T22:07:10.6003889Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6034281Z Entering 'third_party/nlohmann' 2024-08-06T22:07:10.6067804Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6098573Z Entering 'third_party/onnx' 2024-08-06T22:07:10.6131411Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6178802Z Entering 'third_party/onnx/third_party/benchmark' 2024-08-06T22:07:10.6211476Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6242244Z Entering 'third_party/onnx/third_party/pybind11' 2024-08-06T22:07:10.6275750Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6308114Z Entering 'third_party/opentelemetry-cpp' 2024-08-06T22:07:10.6341419Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6373847Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2024-08-06T22:07:10.6406655Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6436565Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2024-08-06T22:07:10.6469601Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6499862Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2024-08-06T22:07:10.6532026Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6561344Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2024-08-06T22:07:10.6595175Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6626548Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2024-08-06T22:07:10.6658507Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6688185Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2024-08-06T22:07:10.6719991Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6749387Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2024-08-06T22:07:10.6781927Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6811891Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2024-08-06T22:07:10.6844675Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6877694Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2024-08-06T22:07:10.6910631Z http.https://github.com/.extraheader 2024-08-06T22:07:10.6943010Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2024-08-06T22:07:10.6976101Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7026336Z Entering 'third_party/pocketfft' 2024-08-06T22:07:10.7059928Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7091243Z Entering 'third_party/protobuf' 2024-08-06T22:07:10.7124930Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7158559Z Entering 'third_party/protobuf/third_party/benchmark' 2024-08-06T22:07:10.7191389Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7221186Z Entering 'third_party/protobuf/third_party/googletest' 2024-08-06T22:07:10.7253160Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7286459Z Entering 'third_party/psimd' 2024-08-06T22:07:10.7318905Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7348737Z Entering 'third_party/pthreadpool' 2024-08-06T22:07:10.7381418Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7411449Z Entering 'third_party/pybind11' 2024-08-06T22:07:10.7444237Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7477177Z Entering 'third_party/python-peachpy' 2024-08-06T22:07:10.7510182Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7540122Z Entering 'third_party/sleef' 2024-08-06T22:07:10.7572991Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7603061Z Entering 'third_party/tensorpipe' 2024-08-06T22:07:10.7636050Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7667196Z Entering 'third_party/tensorpipe/third_party/googletest' 2024-08-06T22:07:10.7700284Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7729875Z Entering 'third_party/tensorpipe/third_party/libnop' 2024-08-06T22:07:10.7761757Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7793732Z Entering 'third_party/tensorpipe/third_party/libuv' 2024-08-06T22:07:10.7825732Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7856346Z Entering 'third_party/tensorpipe/third_party/pybind11' 2024-08-06T22:07:10.7889648Z http.https://github.com/.extraheader 2024-08-06T22:07:10.7918975Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2024-08-06T22:07:10.7951318Z http.https://github.com/.extraheader 2024-08-06T22:07:10.8058637Z A job completed hook has been configured by the self-hosted runner administrator 2024-08-06T22:07:10.8084390Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2024-08-06T22:07:10.8089757Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2024-08-06T22:07:10.8090150Z ##[endgroup] 2024-08-06T22:07:17.8728821Z Cleaning up orphan processes